2024-04-04T06:38:29.882 INFO:root:teuthology version: 0.0.1.dev265+gd7d6e60 2024-04-04T06:38:29.883 DEBUG:teuthology.run:Teuthology command: teuthology --description fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v2 tasks/xfstests-dev} --owner scheduled_vshankar@teuthology --verbose --name vshankar-2024-04-04_05:15:36-fs-wip-vshankar-testing-20240330.172700-testing-default-smithi --archive /home/teuthworker/archive/vshankar-2024-04-04_05:15:36-fs-wip-vshankar-testing-20240330.172700-testing-default-smithi/7639251 -- /home/teuthworker/archive/vshankar-2024-04-04_05:15:36-fs-wip-vshankar-testing-20240330.172700-testing-default-smithi/7639251/orig.config.yaml 2024-04-04T06:38:29.930 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-04T06:38:30.012 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/vshankar-2024-04-04_05:15:36-fs-wip-vshankar-testing-20240330.172700-testing-default-smithi/7639251 branch: wip-vshankar-testing-20240330.172700 description: fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v2 tasks/xfstests-dev} email: vshankar@redhat.com first_in_suite: false job_id: '7639251' kernel: flavor: default kdb: true sha1: 1df0c7e8a2354c42d738e5454ba83ea7332deac2 last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: vshankar-2024-04-04_05:15:36-fs-wip-vshankar-testing-20240330.172700-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-vshankar-testing-20240330.172700 ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability sha1: addbc488dc763e752c640619b677f10e0da02c9f ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: addbc488dc763e752c640619b677f10e0da02c9f selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 subvolume_version: 2 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-vshankar-testing-20240330.172700 sha1: addbc488dc763e752c640619b677f10e0da02c9f owner: scheduled_vshankar@teuthology priority: 70 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 3016 sha1: addbc488dc763e752c640619b677f10e0da02c9f sleep_before_teardown: 0 subset: 140/1024 suite: fs suite_branch: wip-vshankar-testing-20240330.172700 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_addbc488dc763e752c640619b677f10e0da02c9f/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: addbc488dc763e752c640619b677f10e0da02c9f syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi072.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNyoLAhm8l/R+XlpFbOmSXJ4Ep2sWnsqC8v6f/EvOACZZpwj04Qalk/kmjSY8NiD6jDfxucO/cjNqiibFLwf2m4= smithi117.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBC9MY64edoooXrlHPxmwqyICoctoOA4oPvQjsOEt2C6W3tr8whFb1S8ljKLqFie0K7EABOLhpoib8EKMl7RUd2g= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - sequential: - mgrmodules - ceph-fuse: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.tests_from_xfstests_dev teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: d7d6e60867cadf19fbfd7655a551ae7d58060757 timestamp: 2024-04-04_05:15:36 tube: smithi user: vshankar verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-04-04T06:38:30.012 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_addbc488dc763e752c640619b677f10e0da02c9f/qa; will attempt to use it 2024-04-04T06:38:30.013 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_addbc488dc763e752c640619b677f10e0da02c9f/qa/tasks 2024-04-04T06:38:30.013 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-04-04T06:38:30.015 INFO:teuthology.task.internal:Checking packages... 2024-04-04T06:38:30.044 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'addbc488dc763e752c640619b677f10e0da02c9f' 2024-04-04T06:38:30.045 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-04T06:38:30.045 INFO:teuthology.packaging:ref: None 2024-04-04T06:38:30.045 INFO:teuthology.packaging:tag: None 2024-04-04T06:38:30.045 INFO:teuthology.packaging:branch: wip-vshankar-testing-20240330.172700 2024-04-04T06:38:30.045 INFO:teuthology.packaging:sha1: addbc488dc763e752c640619b677f10e0da02c9f 2024-04-04T06:38:30.046 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-vshankar-testing-20240330.172700 2024-04-04T06:38:30.282 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-2571.gaddbc488 2024-04-04T06:38:30.284 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-04-04T06:38:30.290 INFO:teuthology.task.internal:no buildpackages task found 2024-04-04T06:38:30.290 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-04-04T06:38:30.330 INFO:teuthology.task.internal:Saving configuration 2024-04-04T06:38:30.354 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-04-04T06:38:30.360 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-04T06:38:30.385 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi072.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-04-04_05:15:36-fs-wip-vshankar-testing-20240330.172700-testing-default-smithi/7639251', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-04 06:33:06.211608', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNyoLAhm8l/R+XlpFbOmSXJ4Ep2sWnsqC8v6f/EvOACZZpwj04Qalk/kmjSY8NiD6jDfxucO/cjNqiibFLwf2m4='} 2024-04-04T06:38:30.408 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi117.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-04-04_05:15:36-fs-wip-vshankar-testing-20240330.172700-testing-default-smithi/7639251', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-04 06:33:06.210780', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBC9MY64edoooXrlHPxmwqyICoctoOA4oPvQjsOEt2C6W3tr8whFb1S8ljKLqFie0K7EABOLhpoib8EKMl7RUd2g='} 2024-04-04T06:38:30.408 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-04-04T06:38:30.414 INFO:teuthology.task.internal:roles: ubuntu@smithi072.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2024-04-04T06:38:30.414 INFO:teuthology.task.internal:roles: ubuntu@smithi117.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2024-04-04T06:38:30.414 INFO:teuthology.run_tasks:Running task console_log... 2024-04-04T06:38:30.503 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f25ba6e6160>, signals=[15]) 2024-04-04T06:38:30.503 INFO:teuthology.run_tasks:Running task internal.connect... 2024-04-04T06:38:30.510 INFO:teuthology.task.internal:Opening connections... 2024-04-04T06:38:30.510 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi072.front.sepia.ceph.com 2024-04-04T06:38:30.516 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-04T06:38:30.604 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi117.front.sepia.ceph.com 2024-04-04T06:38:30.605 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-04T06:38:30.693 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-04-04T06:38:30.700 DEBUG:teuthology.orchestra.run.smithi072:> uname -m 2024-04-04T06:38:30.718 INFO:teuthology.orchestra.run.smithi072.stdout:x86_64 2024-04-04T06:38:30.719 DEBUG:teuthology.orchestra.run.smithi072:> cat /etc/os-release 2024-04-04T06:38:30.775 INFO:teuthology.orchestra.run.smithi072.stdout:NAME="CentOS Stream" 2024-04-04T06:38:30.776 INFO:teuthology.orchestra.run.smithi072.stdout:VERSION="9" 2024-04-04T06:38:30.776 INFO:teuthology.orchestra.run.smithi072.stdout:ID="centos" 2024-04-04T06:38:30.776 INFO:teuthology.orchestra.run.smithi072.stdout:ID_LIKE="rhel fedora" 2024-04-04T06:38:30.776 INFO:teuthology.orchestra.run.smithi072.stdout:VERSION_ID="9" 2024-04-04T06:38:30.776 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM_ID="platform:el9" 2024-04-04T06:38:30.776 INFO:teuthology.orchestra.run.smithi072.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-04T06:38:30.776 INFO:teuthology.orchestra.run.smithi072.stdout:ANSI_COLOR="0;31" 2024-04-04T06:38:30.776 INFO:teuthology.orchestra.run.smithi072.stdout:LOGO="fedora-logo-icon" 2024-04-04T06:38:30.776 INFO:teuthology.orchestra.run.smithi072.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-04T06:38:30.776 INFO:teuthology.orchestra.run.smithi072.stdout:HOME_URL="https://centos.org/" 2024-04-04T06:38:30.776 INFO:teuthology.orchestra.run.smithi072.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-04T06:38:30.776 INFO:teuthology.orchestra.run.smithi072.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-04T06:38:30.776 INFO:teuthology.orchestra.run.smithi072.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-04T06:38:30.777 INFO:teuthology.lock.ops:Updating smithi072.front.sepia.ceph.com on lock server 2024-04-04T06:38:30.801 DEBUG:teuthology.orchestra.run.smithi117:> uname -m 2024-04-04T06:38:30.819 INFO:teuthology.orchestra.run.smithi117.stdout:x86_64 2024-04-04T06:38:30.819 DEBUG:teuthology.orchestra.run.smithi117:> cat /etc/os-release 2024-04-04T06:38:30.877 INFO:teuthology.orchestra.run.smithi117.stdout:NAME="CentOS Stream" 2024-04-04T06:38:30.877 INFO:teuthology.orchestra.run.smithi117.stdout:VERSION="9" 2024-04-04T06:38:30.877 INFO:teuthology.orchestra.run.smithi117.stdout:ID="centos" 2024-04-04T06:38:30.877 INFO:teuthology.orchestra.run.smithi117.stdout:ID_LIKE="rhel fedora" 2024-04-04T06:38:30.877 INFO:teuthology.orchestra.run.smithi117.stdout:VERSION_ID="9" 2024-04-04T06:38:30.877 INFO:teuthology.orchestra.run.smithi117.stdout:PLATFORM_ID="platform:el9" 2024-04-04T06:38:30.877 INFO:teuthology.orchestra.run.smithi117.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-04T06:38:30.877 INFO:teuthology.orchestra.run.smithi117.stdout:ANSI_COLOR="0;31" 2024-04-04T06:38:30.877 INFO:teuthology.orchestra.run.smithi117.stdout:LOGO="fedora-logo-icon" 2024-04-04T06:38:30.877 INFO:teuthology.orchestra.run.smithi117.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-04T06:38:30.877 INFO:teuthology.orchestra.run.smithi117.stdout:HOME_URL="https://centos.org/" 2024-04-04T06:38:30.878 INFO:teuthology.orchestra.run.smithi117.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-04T06:38:30.878 INFO:teuthology.orchestra.run.smithi117.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-04T06:38:30.878 INFO:teuthology.orchestra.run.smithi117.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-04T06:38:30.878 INFO:teuthology.lock.ops:Updating smithi117.front.sepia.ceph.com on lock server 2024-04-04T06:38:30.918 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-04-04T06:38:30.927 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-04-04T06:38:30.964 INFO:teuthology.task.internal:Checking for old test directory... 2024-04-04T06:38:30.964 DEBUG:teuthology.orchestra.run.smithi072:> test '!' -e /home/ubuntu/cephtest 2024-04-04T06:38:30.967 DEBUG:teuthology.orchestra.run.smithi117:> test '!' -e /home/ubuntu/cephtest 2024-04-04T06:38:30.983 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-04-04T06:38:30.988 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-04-04T06:38:30.988 DEBUG:teuthology.orchestra.run.smithi072:> test -z $(ls -A /var/lib/ceph) 2024-04-04T06:38:31.023 DEBUG:teuthology.orchestra.run.smithi117:> test -z $(ls -A /var/lib/ceph) 2024-04-04T06:38:31.049 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-04-04T06:38:31.100 INFO:teuthology.run_tasks:Running task kernel... 2024-04-04T06:38:31.114 INFO:teuthology.task.kernel:normalize config orig: {'flavor': 'default', 'kdb': True, 'sha1': '1df0c7e8a2354c42d738e5454ba83ea7332deac2'} 2024-04-04T06:38:31.114 INFO:teuthology.task.kernel:config {'mon.a': {'flavor': 'default', 'kdb': True, 'sha1': '1df0c7e8a2354c42d738e5454ba83ea7332deac2'}, 'mon.b': {'flavor': 'default', 'kdb': True, 'sha1': '1df0c7e8a2354c42d738e5454ba83ea7332deac2'}}, timeout 300 2024-04-04T06:38:31.115 DEBUG:teuthology.orchestra.run.smithi072:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-04T06:38:31.115 DEBUG:teuthology.orchestra.run.smithi117:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-04T06:38:31.132 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-04T06:38:31.132 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-04T06:38:31.133 DEBUG:teuthology.task.kernel:sha1 for mon.a is 1df0c7e8a2354c42d738e5454ba83ea7332deac2 2024-04-04T06:38:31.133 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "1df0c7e8a2354c42d738e5454ba83ea7332deac2"... 2024-04-04T06:38:31.133 DEBUG:teuthology.orchestra.run.smithi072:> uname -r 2024-04-04T06:38:31.133 DEBUG:teuthology.task.kernel:sha1 for mon.b is 1df0c7e8a2354c42d738e5454ba83ea7332deac2 2024-04-04T06:38:31.133 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "1df0c7e8a2354c42d738e5454ba83ea7332deac2"... 2024-04-04T06:38:31.134 DEBUG:teuthology.orchestra.run.smithi117:> uname -r 2024-04-04T06:38:31.189 INFO:teuthology.orchestra.run.smithi117.stdout:5.14.0-361.el9.x86_64 2024-04-04T06:38:31.189 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-361.el9.x86_64 vs 1df0c7e8a2354c42d738e5454ba83ea7332deac2 2024-04-04T06:38:31.189 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-04-04T06:38:31.189 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1df0c7e8a2354c42d738e5454ba83ea7332deac2 2024-04-04T06:38:31.193 INFO:teuthology.orchestra.run.smithi072.stdout:5.14.0-361.el9.x86_64 2024-04-04T06:38:31.193 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-361.el9.x86_64 vs 1df0c7e8a2354c42d738e5454ba83ea7332deac2 2024-04-04T06:38:31.194 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-04-04T06:38:31.194 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1df0c7e8a2354c42d738e5454ba83ea7332deac2 2024-04-04T06:38:31.340 DEBUG:teuthology.orchestra.run.smithi072:> sudo yum upgrade -y linux-firmware 2024-04-04T06:38:31.536 DEBUG:teuthology.orchestra.run.smithi117:> sudo yum upgrade -y linux-firmware 2024-04-04T06:38:33.606 INFO:teuthology.orchestra.run.smithi117.stdout:CentOS-9 - AppStream 12 MB/s | 6.7 MB 00:00 2024-04-04T06:38:34.492 INFO:teuthology.orchestra.run.smithi072.stdout:CentOS-9 - AppStream 12 MB/s | 6.7 MB 00:00 2024-04-04T06:38:35.231 INFO:teuthology.orchestra.run.smithi117.stdout:CentOS-9 - BaseOS 3.8 MB/s | 2.0 MB 00:00 2024-04-04T06:38:35.910 INFO:teuthology.orchestra.run.smithi072.stdout:CentOS-9 - BaseOS 6.4 MB/s | 2.0 MB 00:00 2024-04-04T06:38:36.955 INFO:teuthology.orchestra.run.smithi117.stdout:CentOS Stream 9 - BaseOS 5.8 MB/s | 8.0 MB 00:01 2024-04-04T06:38:39.078 INFO:teuthology.orchestra.run.smithi072.stdout:CentOS Stream 9 - BaseOS 2.8 MB/s | 8.0 MB 00:02 2024-04-04T06:38:40.889 INFO:teuthology.orchestra.run.smithi072.stdout:CentOS Stream 9 - AppStream 30 MB/s | 19 MB 00:00 2024-04-04T06:38:44.955 INFO:teuthology.orchestra.run.smithi117.stdout:CentOS Stream 9 - AppStream 2.7 MB/s | 19 MB 00:06 2024-04-04T06:38:46.207 INFO:teuthology.orchestra.run.smithi072.stdout:CentOS Stream 9 - CRB 3.4 MB/s | 6.1 MB 00:01 2024-04-04T06:38:47.669 INFO:teuthology.orchestra.run.smithi072.stdout:CentOS Stream 9 - Extras packages 48 kB/s | 16 kB 00:00 2024-04-04T06:38:52.896 INFO:teuthology.orchestra.run.smithi117.stdout:CentOS Stream 9 - CRB 1.4 MB/s | 6.1 MB 00:04 2024-04-04T06:38:54.313 INFO:teuthology.orchestra.run.smithi117.stdout:CentOS Stream 9 - Extras packages 56 kB/s | 16 kB 00:00 2024-04-04T06:38:57.166 INFO:teuthology.orchestra.run.smithi117.stdout:Extra Packages for Enterprise Linux 7.6 MB/s | 21 MB 00:02 2024-04-04T06:39:02.188 INFO:teuthology.orchestra.run.smithi117.stdout:lab-extras 14 kB/s | 1.7 kB 00:00 2024-04-04T06:39:04.557 INFO:teuthology.orchestra.run.smithi117.stdout:Dependencies resolved. 2024-04-04T06:39:04.567 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2024-04-04T06:39:04.567 INFO:teuthology.orchestra.run.smithi117.stdout: Package Arch Version Repository Size 2024-04-04T06:39:04.567 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2024-04-04T06:39:04.567 INFO:teuthology.orchestra.run.smithi117.stdout:Upgrading: 2024-04-04T06:39:04.567 INFO:teuthology.orchestra.run.smithi117.stdout: linux-firmware noarch 20240219-143.el9 CentOS-BaseOS 375 M 2024-04-04T06:39:04.568 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-04T06:39:04.568 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction Summary 2024-04-04T06:39:04.568 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2024-04-04T06:39:04.568 INFO:teuthology.orchestra.run.smithi117.stdout:Upgrade 1 Package 2024-04-04T06:39:04.568 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-04T06:39:04.568 INFO:teuthology.orchestra.run.smithi117.stdout:Total download size: 375 M 2024-04-04T06:39:04.568 INFO:teuthology.orchestra.run.smithi117.stdout:Downloading Packages: 2024-04-04T06:39:20.012 INFO:teuthology.orchestra.run.smithi117.stdout:linux-firmware-20240219-143.el9.noarch.rpm 24 MB/s | 375 MB 00:15 2024-04-04T06:39:20.013 INFO:teuthology.orchestra.run.smithi117.stdout:-------------------------------------------------------------------------------- 2024-04-04T06:39:20.013 INFO:teuthology.orchestra.run.smithi117.stdout:Total 24 MB/s | 375 MB 00:15 2024-04-04T06:39:20.014 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction check 2024-04-04T06:39:20.096 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction check succeeded. 2024-04-04T06:39:20.097 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction test 2024-04-04T06:39:22.519 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction test succeeded. 2024-04-04T06:39:22.519 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction 2024-04-04T06:39:28.752 INFO:teuthology.orchestra.run.smithi117.stdout: Preparing : 1/1 2024-04-04T06:39:28.987 INFO:teuthology.orchestra.run.smithi117.stdout: Upgrading : linux-firmware-20240219-143.el9.noarch 1/2 2024-04-04T06:39:29.076 INFO:teuthology.orchestra.run.smithi117.stdout: Cleanup : linux-firmware-20230814-139.el9.noarch 2/2 2024-04-04T06:39:30.200 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: linux-firmware-20230814-139.el9.noarch 2/2 2024-04-04T06:39:30.200 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : linux-firmware-20240219-143.el9.noarch 1/2 2024-04-04T06:39:30.581 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : linux-firmware-20230814-139.el9.noarch 2/2 2024-04-04T06:39:30.581 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-04T06:39:30.581 INFO:teuthology.orchestra.run.smithi117.stdout:Upgraded: 2024-04-04T06:39:30.581 INFO:teuthology.orchestra.run.smithi117.stdout: linux-firmware-20240219-143.el9.noarch 2024-04-04T06:39:30.581 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-04T06:39:30.581 INFO:teuthology.orchestra.run.smithi117.stdout:Complete! 2024-04-04T06:39:30.889 INFO:teuthology.task.kernel:Downloading kernel 1df0c7e8a2354c42d738e5454ba83ea7332deac2 on mon.b... 2024-04-04T06:39:30.889 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1df0c7e8a2354c42d738e5454ba83ea7332deac2 2024-04-04T06:39:31.181 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/1df0c7e8a2354c42d738e5454ba83ea7332deac2/centos/9/flavors/default/x86_64/ 2024-04-04T06:39:31.181 DEBUG:teuthology.orchestra.run.smithi117:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.8.0_g1df0c7e8a235-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://3.chacra.ceph.com/r/kernel/testing/1df0c7e8a2354c42d738e5454ba83ea7332deac2/centos/9/flavors/default/x86_64/ --input-file=- 2024-04-04T06:39:31.183 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi117.front.sepia.ceph.com to complete... 2024-04-04T06:39:46.788 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04 06:39:46 URL:https://3.chacra.ceph.com/r/kernel/testing/1df0c7e8a2354c42d738e5454ba83ea7332deac2/centos/9/flavors/default/x86_64/kernel-6.8.0_g1df0c7e8a235-1.x86_64.rpm [336317861/336317861] -> "/tmp/kernel.x86_64.rpm" [1] 2024-04-04T06:39:46.788 INFO:teuthology.orchestra.run.smithi117.stderr:FINISHED --2024-04-04 06:39:46-- 2024-04-04T06:39:46.788 INFO:teuthology.orchestra.run.smithi117.stderr:Total wall clock time: 16s 2024-04-04T06:39:46.788 INFO:teuthology.orchestra.run.smithi117.stderr:Downloaded: 1 files, 321M in 15s (21.0 MB/s) 2024-04-04T06:39:46.791 INFO:teuthology.task.kernel:Installing kernel 1df0c7e8a2354c42d738e5454ba83ea7332deac2 on mon.b... 2024-04-04T06:39:46.791 DEBUG:teuthology.orchestra.run.smithi117:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-04-04T06:39:48.723 INFO:teuthology.orchestra.run.smithi117.stdout:Verifying... ######################################## 2024-04-04T06:39:48.839 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing... ######################################## 2024-04-04T06:39:48.919 INFO:teuthology.orchestra.run.smithi117.stdout:Updating / installing... 2024-04-04T06:39:56.474 INFO:teuthology.orchestra.run.smithi117.stdout:kernel-6.8.0_g1df0c7e8a235-1 ######################################## 2024-04-04T06:40:12.316 INFO:teuthology.orchestra.run.smithi117.stderr:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-04-04T06:40:34.709 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi117.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-04-04T06:40:34.710 DEBUG:teuthology.orchestra.run.smithi117:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-04-04T06:40:34.785 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235 2024-04-04T06:40:34.786 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/System.map 2024-04-04T06:40:34.786 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/config 2024-04-04T06:40:34.786 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel 2024-04-04T06:40:34.786 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch 2024-04-04T06:40:34.786 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86 2024-04-04T06:40:34.786 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto 2024-04-04T06:40:34.786 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-04-04T06:40:34.786 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-04-04T06:40:34.786 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-04-04T06:40:34.786 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-04-04T06:40:34.786 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-04-04T06:40:34.787 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-04-04T06:40:34.787 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-04-04T06:40:34.787 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/crc32c-intel.ko 2024-04-04T06:40:34.787 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-04-04T06:40:34.787 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-04-04T06:40:34.787 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-04-04T06:40:34.787 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-04-04T06:40:34.787 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/serpent-avx2.ko 2024-04-04T06:40:34.787 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-04-04T06:40:34.787 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-04-04T06:40:34.787 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-04-04T06:40:34.787 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-04-04T06:40:34.788 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-04-04T06:40:34.788 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-04-04T06:40:34.788 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-04-04T06:40:34.788 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kernel 2024-04-04T06:40:34.788 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kernel/cpu 2024-04-04T06:40:34.788 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kernel/cpu/mce 2024-04-04T06:40:34.788 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-04-04T06:40:34.788 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kvm 2024-04-04T06:40:34.788 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kvm/kvm-amd.ko 2024-04-04T06:40:34.788 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kvm/kvm-intel.ko 2024-04-04T06:40:34.788 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kvm/kvm.ko 2024-04-04T06:40:34.788 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto 2024-04-04T06:40:34.788 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/ansi_cprng.ko 2024-04-04T06:40:34.788 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/anubis.ko 2024-04-04T06:40:34.789 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/arc4.ko 2024-04-04T06:40:34.789 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx 2024-04-04T06:40:34.789 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx/async_memcpy.ko 2024-04-04T06:40:34.789 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx/async_pq.ko 2024-04-04T06:40:34.789 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx/async_raid6_recov.ko 2024-04-04T06:40:34.789 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx/async_tx.ko 2024-04-04T06:40:34.789 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx/async_xor.ko 2024-04-04T06:40:34.789 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx/raid6test.ko 2024-04-04T06:40:34.789 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/authenc.ko 2024-04-04T06:40:34.789 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/authencesn.ko 2024-04-04T06:40:34.789 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/blake2b_generic.ko 2024-04-04T06:40:34.789 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/blowfish_common.ko 2024-04-04T06:40:34.789 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/blowfish_generic.ko 2024-04-04T06:40:34.790 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/camellia_generic.ko 2024-04-04T06:40:34.790 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/cast5_generic.ko 2024-04-04T06:40:34.790 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/cast6_generic.ko 2024-04-04T06:40:34.790 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/cast_common.ko 2024-04-04T06:40:34.790 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/ccm.ko 2024-04-04T06:40:34.790 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/cmac.ko 2024-04-04T06:40:34.790 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/crc32_generic.ko 2024-04-04T06:40:34.790 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/crypto_engine.ko 2024-04-04T06:40:34.790 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/crypto_user.ko 2024-04-04T06:40:34.790 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/cts.ko 2024-04-04T06:40:34.790 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/des_generic.ko 2024-04-04T06:40:34.791 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/dh_generic.ko 2024-04-04T06:40:34.791 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/echainiv.ko 2024-04-04T06:40:34.791 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/essiv.ko 2024-04-04T06:40:34.791 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/fcrypt.ko 2024-04-04T06:40:34.791 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/khazad.ko 2024-04-04T06:40:34.791 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/lz4.ko 2024-04-04T06:40:34.791 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/lz4hc.ko 2024-04-04T06:40:34.791 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/md4.ko 2024-04-04T06:40:34.791 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/michael_mic.ko 2024-04-04T06:40:34.791 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/pcbc.ko 2024-04-04T06:40:34.792 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/pcrypt.ko 2024-04-04T06:40:34.792 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/rmd160.ko 2024-04-04T06:40:34.792 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/seed.ko 2024-04-04T06:40:34.792 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/serpent_generic.ko 2024-04-04T06:40:34.792 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/tcrypt.ko 2024-04-04T06:40:34.792 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/tea.ko 2024-04-04T06:40:34.792 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/twofish_common.ko 2024-04-04T06:40:34.792 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/twofish_generic.ko 2024-04-04T06:40:34.792 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/vmac.ko 2024-04-04T06:40:34.792 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/wp512.ko 2024-04-04T06:40:34.792 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/xcbc.ko 2024-04-04T06:40:34.792 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/xor.ko 2024-04-04T06:40:34.792 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/xxhash_generic.ko 2024-04-04T06:40:34.792 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers 2024-04-04T06:40:34.793 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi 2024-04-04T06:40:34.793 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/acpi_ipmi.ko 2024-04-04T06:40:34.793 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/acpi_pad.ko 2024-04-04T06:40:34.793 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/custom_method.ko 2024-04-04T06:40:34.793 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/ec_sys.ko 2024-04-04T06:40:34.793 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/platform_profile.ko 2024-04-04T06:40:34.793 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/sbs.ko 2024-04-04T06:40:34.793 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/sbshc.ko 2024-04-04T06:40:34.793 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/video.ko 2024-04-04T06:40:34.793 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata 2024-04-04T06:40:34.793 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/acard-ahci.ko 2024-04-04T06:40:34.793 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/ahci_platform.ko 2024-04-04T06:40:34.793 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/ata_generic.ko 2024-04-04T06:40:34.794 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/libahci_platform.ko 2024-04-04T06:40:34.794 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_acpi.ko 2024-04-04T06:40:34.794 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_ali.ko 2024-04-04T06:40:34.794 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_amd.ko 2024-04-04T06:40:34.794 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_artop.ko 2024-04-04T06:40:34.794 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_atiixp.ko 2024-04-04T06:40:34.794 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_atp867x.ko 2024-04-04T06:40:34.794 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_cmd640.ko 2024-04-04T06:40:34.794 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_cmd64x.ko 2024-04-04T06:40:34.794 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_cypress.ko 2024-04-04T06:40:34.794 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_efar.ko 2024-04-04T06:40:34.794 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_hpt366.ko 2024-04-04T06:40:34.794 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_hpt37x.ko 2024-04-04T06:40:34.795 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_hpt3x2n.ko 2024-04-04T06:40:34.795 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_hpt3x3.ko 2024-04-04T06:40:34.795 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_it8213.ko 2024-04-04T06:40:34.795 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_it821x.ko 2024-04-04T06:40:34.795 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_jmicron.ko 2024-04-04T06:40:34.795 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_marvell.ko 2024-04-04T06:40:34.795 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_mpiix.ko 2024-04-04T06:40:34.795 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_netcell.ko 2024-04-04T06:40:34.795 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_ninja32.ko 2024-04-04T06:40:34.795 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_ns87410.ko 2024-04-04T06:40:34.795 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_ns87415.ko 2024-04-04T06:40:34.795 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_oldpiix.ko 2024-04-04T06:40:34.795 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_opti.ko 2024-04-04T06:40:34.795 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_optidma.ko 2024-04-04T06:40:34.796 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_pcmcia.ko 2024-04-04T06:40:34.796 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_pdc2027x.ko 2024-04-04T06:40:34.796 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-04-04T06:40:34.796 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_piccolo.ko 2024-04-04T06:40:34.796 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_rdc.ko 2024-04-04T06:40:34.796 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_sch.ko 2024-04-04T06:40:34.796 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_serverworks.ko 2024-04-04T06:40:34.796 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_sil680.ko 2024-04-04T06:40:34.796 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_sis.ko 2024-04-04T06:40:34.796 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_sl82c105.ko 2024-04-04T06:40:34.796 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_triflex.ko 2024-04-04T06:40:34.796 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_via.ko 2024-04-04T06:40:34.796 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pdc_adma.ko 2024-04-04T06:40:34.797 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_inic162x.ko 2024-04-04T06:40:34.797 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_mv.ko 2024-04-04T06:40:34.797 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_nv.ko 2024-04-04T06:40:34.797 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_promise.ko 2024-04-04T06:40:34.797 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_qstor.ko 2024-04-04T06:40:34.797 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_sil.ko 2024-04-04T06:40:34.797 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_sil24.ko 2024-04-04T06:40:34.797 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_sis.ko 2024-04-04T06:40:34.797 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_svw.ko 2024-04-04T06:40:34.797 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_sx4.ko 2024-04-04T06:40:34.797 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_uli.ko 2024-04-04T06:40:34.797 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_via.ko 2024-04-04T06:40:34.797 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_vsc.ko 2024-04-04T06:40:34.797 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/auxdisplay 2024-04-04T06:40:34.798 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/auxdisplay/ks0108.ko 2024-04-04T06:40:34.798 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/base 2024-04-04T06:40:34.798 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/base/regmap 2024-04-04T06:40:34.798 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/base/regmap/regmap-i2c.ko 2024-04-04T06:40:34.798 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/base/regmap/regmap-mmio.ko 2024-04-04T06:40:34.798 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/bcma 2024-04-04T06:40:34.798 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/bcma/bcma.ko 2024-04-04T06:40:34.798 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block 2024-04-04T06:40:34.798 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/aoe 2024-04-04T06:40:34.798 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/aoe/aoe.ko 2024-04-04T06:40:34.798 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/brd.ko 2024-04-04T06:40:34.798 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/drbd 2024-04-04T06:40:34.798 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/drbd/drbd.ko 2024-04-04T06:40:34.799 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/floppy.ko 2024-04-04T06:40:34.799 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/loop.ko 2024-04-04T06:40:34.799 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/mtip32xx 2024-04-04T06:40:34.799 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-04-04T06:40:34.799 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/nbd.ko 2024-04-04T06:40:34.799 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/null_blk 2024-04-04T06:40:34.799 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/null_blk/null_blk.ko 2024-04-04T06:40:34.799 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/pktcdvd.ko 2024-04-04T06:40:34.799 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/rbd.ko 2024-04-04T06:40:34.799 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/virtio_blk.ko 2024-04-04T06:40:34.799 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/xen-blkback 2024-04-04T06:40:34.799 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-04-04T06:40:34.799 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/xen-blkfront.ko 2024-04-04T06:40:34.799 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/zram 2024-04-04T06:40:34.800 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/zram/zram.ko 2024-04-04T06:40:34.800 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char 2024-04-04T06:40:34.800 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hangcheck-timer.ko 2024-04-04T06:40:34.800 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hw_random 2024-04-04T06:40:34.800 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hw_random/amd-rng.ko 2024-04-04T06:40:34.800 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hw_random/intel-rng.ko 2024-04-04T06:40:34.800 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-04-04T06:40:34.800 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hw_random/via-rng.ko 2024-04-04T06:40:34.800 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hw_random/virtio-rng.ko 2024-04-04T06:40:34.800 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi 2024-04-04T06:40:34.800 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-04-04T06:40:34.800 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-04-04T06:40:34.800 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-04-04T06:40:34.800 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi/ipmi_si.ko 2024-04-04T06:40:34.801 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-04-04T06:40:34.801 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-04-04T06:40:34.801 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/lp.ko 2024-04-04T06:40:34.801 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/mwave 2024-04-04T06:40:34.801 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/mwave/mwave.ko 2024-04-04T06:40:34.801 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ppdev.ko 2024-04-04T06:40:34.801 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tlclk.ko 2024-04-04T06:40:34.801 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm 2024-04-04T06:40:34.801 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm/tpm.ko 2024-04-04T06:40:34.801 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm/tpm_atmel.ko 2024-04-04T06:40:34.801 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm/tpm_infineon.ko 2024-04-04T06:40:34.801 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm/tpm_nsc.ko 2024-04-04T06:40:34.801 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm/tpm_tis.ko 2024-04-04T06:40:34.801 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-04-04T06:40:34.802 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/uv_mmtimer.ko 2024-04-04T06:40:34.802 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/virtio_console.ko 2024-04-04T06:40:34.802 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq 2024-04-04T06:40:34.802 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-04-04T06:40:34.802 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-04-04T06:40:34.802 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq/p4-clockmod.ko 2024-04-04T06:40:34.802 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-04-04T06:40:34.802 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq/powernow-k8.ko 2024-04-04T06:40:34.802 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq/speedstep-lib.ko 2024-04-04T06:40:34.802 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto 2024-04-04T06:40:34.802 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/ccp 2024-04-04T06:40:34.802 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-04-04T06:40:34.802 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/ccp/ccp.ko 2024-04-04T06:40:34.803 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/intel 2024-04-04T06:40:34.803 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/intel/qat 2024-04-04T06:40:34.803 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/intel/qat/qat_common 2024-04-04T06:40:34.803 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-04-04T06:40:34.803 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-04-04T06:40:34.803 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-04-04T06:40:34.803 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/padlock-aes.ko 2024-04-04T06:40:34.803 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/padlock-sha.ko 2024-04-04T06:40:34.803 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/virtio 2024-04-04T06:40:34.803 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-04-04T06:40:34.803 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dca 2024-04-04T06:40:34.803 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dca/dca.ko 2024-04-04T06:40:34.803 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/devfreq 2024-04-04T06:40:34.803 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-04-04T06:40:34.804 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dma 2024-04-04T06:40:34.804 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dma/dw 2024-04-04T06:40:34.804 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dma/dw/dw_dmac.ko 2024-04-04T06:40:34.804 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dma/ioat 2024-04-04T06:40:34.804 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dma/ioat/ioatdma.ko 2024-04-04T06:40:34.804 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac 2024-04-04T06:40:34.804 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/amd64_edac.ko 2024-04-04T06:40:34.804 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/e752x_edac.ko 2024-04-04T06:40:34.804 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/edac_mce_amd.ko 2024-04-04T06:40:34.804 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i3000_edac.ko 2024-04-04T06:40:34.804 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i3200_edac.ko 2024-04-04T06:40:34.804 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i5100_edac.ko 2024-04-04T06:40:34.804 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i5400_edac.ko 2024-04-04T06:40:34.805 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i7300_edac.ko 2024-04-04T06:40:34.805 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i7core_edac.ko 2024-04-04T06:40:34.805 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i82975x_edac.ko 2024-04-04T06:40:34.805 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/ie31200_edac.ko 2024-04-04T06:40:34.805 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/sb_edac.ko 2024-04-04T06:40:34.805 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/x38_edac.ko 2024-04-04T06:40:34.805 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/firmware 2024-04-04T06:40:34.805 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/firmware/edd.ko 2024-04-04T06:40:34.805 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/firmware/iscsi_ibft.ko 2024-04-04T06:40:34.805 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/gpio 2024-04-04T06:40:34.805 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/gpio/gpio-ich.ko 2024-04-04T06:40:34.805 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/gpio/gpio-viperboard.ko 2024-04-04T06:40:34.805 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid 2024-04-04T06:40:34.806 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-appleir.ko 2024-04-04T06:40:34.806 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-aureal.ko 2024-04-04T06:40:34.806 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-axff.ko 2024-04-04T06:40:34.806 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-dr.ko 2024-04-04T06:40:34.806 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-elecom.ko 2024-04-04T06:40:34.806 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-elo.ko 2024-04-04T06:40:34.806 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-emsff.ko 2024-04-04T06:40:34.806 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-gaff.ko 2024-04-04T06:40:34.806 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-gt683r.ko 2024-04-04T06:40:34.806 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-gyration.ko 2024-04-04T06:40:34.806 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-holtek-kbd.ko 2024-04-04T06:40:34.806 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-holtek-mouse.ko 2024-04-04T06:40:34.806 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-holtekff.ko 2024-04-04T06:40:34.806 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-hyperv.ko 2024-04-04T06:40:34.807 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-icade.ko 2024-04-04T06:40:34.807 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-keytouch.ko 2024-04-04T06:40:34.807 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-kye.ko 2024-04-04T06:40:34.807 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-lcpower.ko 2024-04-04T06:40:34.807 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-led.ko 2024-04-04T06:40:34.807 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-lenovo.ko 2024-04-04T06:40:34.807 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-logitech-dj.ko 2024-04-04T06:40:34.807 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-04-04T06:40:34.807 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-multitouch.ko 2024-04-04T06:40:34.807 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-ortek.ko 2024-04-04T06:40:34.807 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-penmount.ko 2024-04-04T06:40:34.807 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-petalynx.ko 2024-04-04T06:40:34.808 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-picolcd.ko 2024-04-04T06:40:34.808 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-pl.ko 2024-04-04T06:40:34.808 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-plantronics.ko 2024-04-04T06:40:34.808 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-primax.ko 2024-04-04T06:40:34.808 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-rmi.ko 2024-04-04T06:40:34.808 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-arvo.ko 2024-04-04T06:40:34.808 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-common.ko 2024-04-04T06:40:34.808 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-isku.ko 2024-04-04T06:40:34.808 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-kone.ko 2024-04-04T06:40:34.808 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-04-04T06:40:34.808 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-konepure.ko 2024-04-04T06:40:34.808 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-04-04T06:40:34.808 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-lua.ko 2024-04-04T06:40:34.808 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-pyra.ko 2024-04-04T06:40:34.809 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-ryos.ko 2024-04-04T06:40:34.809 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-savu.ko 2024-04-04T06:40:34.809 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat.ko 2024-04-04T06:40:34.809 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-saitek.ko 2024-04-04T06:40:34.809 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-samsung.ko 2024-04-04T06:40:34.809 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-sensor-hub.ko 2024-04-04T06:40:34.809 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-sjoy.ko 2024-04-04T06:40:34.809 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-sony.ko 2024-04-04T06:40:34.809 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-speedlink.ko 2024-04-04T06:40:34.809 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-steelseries.ko 2024-04-04T06:40:34.809 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-sunplus.ko 2024-04-04T06:40:34.809 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-thrustmaster.ko 2024-04-04T06:40:34.809 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-tivo.ko 2024-04-04T06:40:34.809 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-tmff.ko 2024-04-04T06:40:34.810 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-topseed.ko 2024-04-04T06:40:34.810 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-twinhan.ko 2024-04-04T06:40:34.810 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-uclogic.ko 2024-04-04T06:40:34.810 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-waltop.ko 2024-04-04T06:40:34.810 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-wiimote.ko 2024-04-04T06:40:34.810 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-xinmo.ko 2024-04-04T06:40:34.810 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-zpff.ko 2024-04-04T06:40:34.810 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-zydacron.ko 2024-04-04T06:40:34.810 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/uhid.ko 2024-04-04T06:40:34.810 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/wacom.ko 2024-04-04T06:40:34.810 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hv 2024-04-04T06:40:34.810 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hv/hv_balloon.ko 2024-04-04T06:40:34.811 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hv/hv_utils.ko 2024-04-04T06:40:34.811 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hv/hv_vmbus.ko 2024-04-04T06:40:34.811 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon 2024-04-04T06:40:34.811 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/abituguru.ko 2024-04-04T06:40:34.811 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/abituguru3.ko 2024-04-04T06:40:34.811 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/acpi_power_meter.ko 2024-04-04T06:40:34.811 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ad7414.ko 2024-04-04T06:40:34.811 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ad7418.ko 2024-04-04T06:40:34.811 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adc128d818.ko 2024-04-04T06:40:34.811 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adm1025.ko 2024-04-04T06:40:34.811 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adm1026.ko 2024-04-04T06:40:34.811 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adm1029.ko 2024-04-04T06:40:34.811 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adm1031.ko 2024-04-04T06:40:34.811 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adm9240.ko 2024-04-04T06:40:34.812 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ads7828.ko 2024-04-04T06:40:34.812 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adt7410.ko 2024-04-04T06:40:34.812 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adt7411.ko 2024-04-04T06:40:34.812 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adt7462.ko 2024-04-04T06:40:34.812 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adt7470.ko 2024-04-04T06:40:34.812 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adt7475.ko 2024-04-04T06:40:34.812 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adt7x10.ko 2024-04-04T06:40:34.812 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/amc6821.ko 2024-04-04T06:40:34.812 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/applesmc.ko 2024-04-04T06:40:34.812 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/asb100.ko 2024-04-04T06:40:34.812 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/asc7621.ko 2024-04-04T06:40:34.812 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/asus_atk0110.ko 2024-04-04T06:40:34.812 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/atxp1.ko 2024-04-04T06:40:34.813 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/coretemp.ko 2024-04-04T06:40:34.813 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-04-04T06:40:34.813 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/dme1737.ko 2024-04-04T06:40:34.813 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ds1621.ko 2024-04-04T06:40:34.813 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ds620.ko 2024-04-04T06:40:34.813 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/emc1403.ko 2024-04-04T06:40:34.813 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/emc6w201.ko 2024-04-04T06:40:34.813 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/f71805f.ko 2024-04-04T06:40:34.813 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/f71882fg.ko 2024-04-04T06:40:34.813 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/f75375s.ko 2024-04-04T06:40:34.813 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/fam15h_power.ko 2024-04-04T06:40:34.813 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/fschmd.ko 2024-04-04T06:40:34.813 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/g760a.ko 2024-04-04T06:40:34.813 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/g762.ko 2024-04-04T06:40:34.814 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/gl518sm.ko 2024-04-04T06:40:34.814 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/gl520sm.ko 2024-04-04T06:40:34.814 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/hwmon-vid.ko 2024-04-04T06:40:34.814 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/i5500_temp.ko 2024-04-04T06:40:34.814 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/i5k_amb.ko 2024-04-04T06:40:34.814 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ibmaem.ko 2024-04-04T06:40:34.814 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ibmpex.ko 2024-04-04T06:40:34.814 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ina209.ko 2024-04-04T06:40:34.814 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ina2xx.ko 2024-04-04T06:40:34.814 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/it87.ko 2024-04-04T06:40:34.814 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/k10temp.ko 2024-04-04T06:40:34.814 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/k8temp.ko 2024-04-04T06:40:34.814 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lineage-pem.ko 2024-04-04T06:40:34.815 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm63.ko 2024-04-04T06:40:34.815 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm73.ko 2024-04-04T06:40:34.815 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm75.ko 2024-04-04T06:40:34.815 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm77.ko 2024-04-04T06:40:34.815 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm78.ko 2024-04-04T06:40:34.815 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm80.ko 2024-04-04T06:40:34.815 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm83.ko 2024-04-04T06:40:34.815 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm85.ko 2024-04-04T06:40:34.815 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm87.ko 2024-04-04T06:40:34.815 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm90.ko 2024-04-04T06:40:34.815 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm92.ko 2024-04-04T06:40:34.815 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm93.ko 2024-04-04T06:40:34.815 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm95234.ko 2024-04-04T06:40:34.816 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm95241.ko 2024-04-04T06:40:34.816 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm95245.ko 2024-04-04T06:40:34.816 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc2945.ko 2024-04-04T06:40:34.816 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc4151.ko 2024-04-04T06:40:34.816 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc4215.ko 2024-04-04T06:40:34.816 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc4222.ko 2024-04-04T06:40:34.816 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc4245.ko 2024-04-04T06:40:34.816 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc4260.ko 2024-04-04T06:40:34.816 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc4261.ko 2024-04-04T06:40:34.816 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max16065.ko 2024-04-04T06:40:34.816 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max1619.ko 2024-04-04T06:40:34.816 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max1668.ko 2024-04-04T06:40:34.816 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max197.ko 2024-04-04T06:40:34.816 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max6639.ko 2024-04-04T06:40:34.817 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max6650.ko 2024-04-04T06:40:34.817 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max6697.ko 2024-04-04T06:40:34.817 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/mcp3021.ko 2024-04-04T06:40:34.817 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/nct6683.ko 2024-04-04T06:40:34.817 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/nct6775-core.ko 2024-04-04T06:40:34.817 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/nct6775.ko 2024-04-04T06:40:34.817 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/nct7802.ko 2024-04-04T06:40:34.817 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pc87360.ko 2024-04-04T06:40:34.817 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pc87427.ko 2024-04-04T06:40:34.817 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pcf8591.ko 2024-04-04T06:40:34.817 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus 2024-04-04T06:40:34.817 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-04-04T06:40:34.817 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-04-04T06:40:34.818 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-04-04T06:40:34.818 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/max16064.ko 2024-04-04T06:40:34.818 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/max34440.ko 2024-04-04T06:40:34.818 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/max8688.ko 2024-04-04T06:40:34.818 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-04-04T06:40:34.818 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-04-04T06:40:34.818 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-04-04T06:40:34.818 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-04-04T06:40:34.818 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-04-04T06:40:34.818 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-04-04T06:40:34.818 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/powr1220.ko 2024-04-04T06:40:34.818 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/sch5627.ko 2024-04-04T06:40:34.819 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/sch5636.ko 2024-04-04T06:40:34.819 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/sch56xx-common.ko 2024-04-04T06:40:34.819 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/sht15.ko 2024-04-04T06:40:34.819 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/sht21.ko 2024-04-04T06:40:34.819 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/shtc1.ko 2024-04-04T06:40:34.819 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/sis5595.ko 2024-04-04T06:40:34.819 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/smsc47b397.ko 2024-04-04T06:40:34.819 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/smsc47m1.ko 2024-04-04T06:40:34.819 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/smsc47m192.ko 2024-04-04T06:40:34.819 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/thmc50.ko 2024-04-04T06:40:34.819 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/tmp102.ko 2024-04-04T06:40:34.819 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/tmp103.ko 2024-04-04T06:40:34.819 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/tmp401.ko 2024-04-04T06:40:34.820 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/tmp421.ko 2024-04-04T06:40:34.820 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/via-cputemp.ko 2024-04-04T06:40:34.820 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/via686a.ko 2024-04-04T06:40:34.820 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/vt1211.ko 2024-04-04T06:40:34.820 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/vt8231.ko 2024-04-04T06:40:34.820 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83627ehf.ko 2024-04-04T06:40:34.820 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83627hf.ko 2024-04-04T06:40:34.820 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83781d.ko 2024-04-04T06:40:34.820 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83791d.ko 2024-04-04T06:40:34.820 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83792d.ko 2024-04-04T06:40:34.820 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83793.ko 2024-04-04T06:40:34.820 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83795.ko 2024-04-04T06:40:34.820 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83l785ts.ko 2024-04-04T06:40:34.820 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83l786ng.ko 2024-04-04T06:40:34.821 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c 2024-04-04T06:40:34.821 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/algos 2024-04-04T06:40:34.821 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-04-04T06:40:34.821 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-04-04T06:40:34.821 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses 2024-04-04T06:40:34.821 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-04-04T06:40:34.821 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-04-04T06:40:34.821 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-04-04T06:40:34.821 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-04-04T06:40:34.821 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-04-04T06:40:34.821 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-04-04T06:40:34.821 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-04-04T06:40:34.821 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-04-04T06:40:34.821 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-i801.ko 2024-04-04T06:40:34.822 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-isch.ko 2024-04-04T06:40:34.822 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-04-04T06:40:34.822 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-04-04T06:40:34.822 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-04-04T06:40:34.822 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-parport.ko 2024-04-04T06:40:34.822 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-04-04T06:40:34.822 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-04-04T06:40:34.822 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-04-04T06:40:34.822 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-04-04T06:40:34.822 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-04-04T06:40:34.822 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-04-04T06:40:34.822 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-via.ko 2024-04-04T06:40:34.823 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-04-04T06:40:34.823 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-04-04T06:40:34.823 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/i2c-dev.ko 2024-04-04T06:40:34.823 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/i2c-mux.ko 2024-04-04T06:40:34.823 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-04-04T06:40:34.823 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/i2c-smbus.ko 2024-04-04T06:40:34.823 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/i2c-stub.ko 2024-04-04T06:40:34.823 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband 2024-04-04T06:40:34.823 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core 2024-04-04T06:40:34.823 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/ib_cm.ko 2024-04-04T06:40:34.823 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/ib_core.ko 2024-04-04T06:40:34.823 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/ib_umad.ko 2024-04-04T06:40:34.823 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-04-04T06:40:34.823 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/iw_cm.ko 2024-04-04T06:40:34.824 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/rdma_cm.ko 2024-04-04T06:40:34.824 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-04-04T06:40:34.824 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw 2024-04-04T06:40:34.824 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/cxgb4 2024-04-04T06:40:34.824 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-04-04T06:40:34.824 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/mlx4 2024-04-04T06:40:34.824 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-04-04T06:40:34.824 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/mlx5 2024-04-04T06:40:34.824 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-04-04T06:40:34.824 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/mthca 2024-04-04T06:40:34.824 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-04-04T06:40:34.824 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp 2024-04-04T06:40:34.825 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/ipoib 2024-04-04T06:40:34.825 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-04-04T06:40:34.825 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/iser 2024-04-04T06:40:34.825 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-04-04T06:40:34.825 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/isert 2024-04-04T06:40:34.825 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-04-04T06:40:34.825 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/srp 2024-04-04T06:40:34.825 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-04-04T06:40:34.825 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/srpt 2024-04-04T06:40:34.825 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-04-04T06:40:34.825 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input 2024-04-04T06:40:34.825 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/gameport 2024-04-04T06:40:34.825 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-04-04T06:40:34.825 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/gameport/fm801-gp.ko 2024-04-04T06:40:34.826 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/gameport/gameport.ko 2024-04-04T06:40:34.826 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/joydev.ko 2024-04-04T06:40:34.826 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/keyboard 2024-04-04T06:40:34.826 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/keyboard/gpio_keys.ko 2024-04-04T06:40:34.826 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse 2024-04-04T06:40:34.826 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/appletouch.ko 2024-04-04T06:40:34.826 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/bcm5974.ko 2024-04-04T06:40:34.826 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/cyapatp.ko 2024-04-04T06:40:34.826 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/elan_i2c.ko 2024-04-04T06:40:34.826 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/sermouse.ko 2024-04-04T06:40:34.826 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-04-04T06:40:34.826 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/synaptics_usb.ko 2024-04-04T06:40:34.826 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/vsxxxaa.ko 2024-04-04T06:40:34.827 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/rmi4 2024-04-04T06:40:34.827 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/rmi4/rmi_core.ko 2024-04-04T06:40:34.827 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/serio 2024-04-04T06:40:34.827 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/serio/altera_ps2.ko 2024-04-04T06:40:34.827 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/serio/arc_ps2.ko 2024-04-04T06:40:34.827 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-04-04T06:40:34.827 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/serio/serio_raw.ko 2024-04-04T06:40:34.827 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/sparse-keymap.ko 2024-04-04T06:40:34.827 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds 2024-04-04T06:40:34.827 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/leds-blinkm.ko 2024-04-04T06:40:34.827 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/leds-lm3530.ko 2024-04-04T06:40:34.827 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/leds-lp3944.ko 2024-04-04T06:40:34.827 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/leds-ss4200.ko 2024-04-04T06:40:34.828 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger 2024-04-04T06:40:34.828 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-04-04T06:40:34.828 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-04-04T06:40:34.828 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-04-04T06:40:34.828 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-04-04T06:40:34.828 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-04-04T06:40:34.828 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-04-04T06:40:34.828 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-04-04T06:40:34.828 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-04-04T06:40:34.828 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-04-04T06:40:34.828 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md 2024-04-04T06:40:34.828 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/bcache 2024-04-04T06:40:34.828 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/bcache/bcache.ko 2024-04-04T06:40:34.829 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-bio-prison.ko 2024-04-04T06:40:34.829 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-cache-smq.ko 2024-04-04T06:40:34.829 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-cache.ko 2024-04-04T06:40:34.829 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-crypt.ko 2024-04-04T06:40:34.829 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-delay.ko 2024-04-04T06:40:34.829 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-flakey.ko 2024-04-04T06:40:34.829 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-log-userspace.ko 2024-04-04T06:40:34.829 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-multipath.ko 2024-04-04T06:40:34.829 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-queue-length.ko 2024-04-04T06:40:34.829 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-raid.ko 2024-04-04T06:40:34.829 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-round-robin.ko 2024-04-04T06:40:34.829 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-service-time.ko 2024-04-04T06:40:34.829 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-switch.ko 2024-04-04T06:40:34.829 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-thin-pool.ko 2024-04-04T06:40:34.830 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-verity.ko 2024-04-04T06:40:34.830 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/persistent-data 2024-04-04T06:40:34.830 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-04-04T06:40:34.830 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/raid0.ko 2024-04-04T06:40:34.830 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/raid1.ko 2024-04-04T06:40:34.830 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/raid10.ko 2024-04-04T06:40:34.830 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/raid456.ko 2024-04-04T06:40:34.830 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message 2024-04-04T06:40:34.830 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion 2024-04-04T06:40:34.830 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptbase.ko 2024-04-04T06:40:34.830 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptctl.ko 2024-04-04T06:40:34.830 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptfc.ko 2024-04-04T06:40:34.830 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptlan.ko 2024-04-04T06:40:34.830 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptsas.ko 2024-04-04T06:40:34.831 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptscsih.ko 2024-04-04T06:40:34.831 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptspi.ko 2024-04-04T06:40:34.831 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd 2024-04-04T06:40:34.831 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/lpc_ich.ko 2024-04-04T06:40:34.831 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/lpc_sch.ko 2024-04-04T06:40:34.831 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/mfd-core.ko 2024-04-04T06:40:34.831 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/sm501.ko 2024-04-04T06:40:34.831 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/viperboard.ko 2024-04-04T06:40:34.831 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/vx855.ko 2024-04-04T06:40:34.831 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/wl1273-core.ko 2024-04-04T06:40:34.831 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc 2024-04-04T06:40:34.831 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/altera-stapl 2024-04-04T06:40:34.831 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-04-04T06:40:34.831 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/apds9802als.ko 2024-04-04T06:40:34.831 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/apds990x.ko 2024-04-04T06:40:34.832 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/bh1770glc.ko 2024-04-04T06:40:34.832 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/cb710 2024-04-04T06:40:34.832 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/cb710/cb710.ko 2024-04-04T06:40:34.832 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/eeprom 2024-04-04T06:40:34.832 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/eeprom/at24.ko 2024-04-04T06:40:34.832 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-04-04T06:40:34.832 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/eeprom/max6875.ko 2024-04-04T06:40:34.832 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/enclosure.ko 2024-04-04T06:40:34.832 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/hpilo.ko 2024-04-04T06:40:34.832 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/isl29003.ko 2024-04-04T06:40:34.832 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/isl29020.ko 2024-04-04T06:40:34.832 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/lis3lv02d 2024-04-04T06:40:34.832 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-04-04T06:40:34.833 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-04-04T06:40:34.833 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/mei 2024-04-04T06:40:34.833 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/mei/mei-me.ko 2024-04-04T06:40:34.833 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/mei/mei-txe.ko 2024-04-04T06:40:34.833 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/mei/mei.ko 2024-04-04T06:40:34.833 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/sgi-gru 2024-04-04T06:40:34.833 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/sgi-gru/gru.ko 2024-04-04T06:40:34.833 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/sgi-xp 2024-04-04T06:40:34.833 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/sgi-xp/xp.ko 2024-04-04T06:40:34.833 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/sgi-xp/xpc.ko 2024-04-04T06:40:34.833 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-04-04T06:40:34.833 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/tifm_7xx1.ko 2024-04-04T06:40:34.833 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/tifm_core.ko 2024-04-04T06:40:34.833 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/tsl2550.ko 2024-04-04T06:40:34.834 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/vmw_balloon.ko 2024-04-04T06:40:34.834 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/vmw_vmci 2024-04-04T06:40:34.834 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-04-04T06:40:34.834 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net 2024-04-04T06:40:34.834 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/bonding 2024-04-04T06:40:34.834 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/bonding/bonding.ko 2024-04-04T06:40:34.834 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa 2024-04-04T06:40:34.834 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa/b53 2024-04-04T06:40:34.834 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa/b53/b53_common.ko 2024-04-04T06:40:34.834 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa/bcm-sf2.ko 2024-04-04T06:40:34.834 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa/mv88e6060.ko 2024-04-04T06:40:34.834 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa/mv88e6xxx 2024-04-04T06:40:34.834 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-04-04T06:40:34.835 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dummy.ko 2024-04-04T06:40:34.835 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/eql.ko 2024-04-04T06:40:34.835 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet 2024-04-04T06:40:34.835 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/3com 2024-04-04T06:40:34.835 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-04-04T06:40:34.835 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-04-04T06:40:34.835 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-04-04T06:40:34.835 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-04-04T06:40:34.835 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/8390 2024-04-04T06:40:34.835 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/8390/8390.ko 2024-04-04T06:40:34.835 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-04-04T06:40:34.835 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-04-04T06:40:34.835 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-04-04T06:40:34.835 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/adaptec 2024-04-04T06:40:34.836 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-04-04T06:40:34.836 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/agere 2024-04-04T06:40:34.836 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/agere/et131x.ko 2024-04-04T06:40:34.836 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/alteon 2024-04-04T06:40:34.836 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-04-04T06:40:34.836 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/altera 2024-04-04T06:40:34.836 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-04-04T06:40:34.836 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/amd 2024-04-04T06:40:34.836 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-04-04T06:40:34.836 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-04-04T06:40:34.836 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-04-04T06:40:34.836 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros 2024-04-04T06:40:34.836 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/alx 2024-04-04T06:40:34.836 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-04-04T06:40:34.836 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atl1c 2024-04-04T06:40:34.837 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-04-04T06:40:34.837 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atl1e 2024-04-04T06:40:34.837 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-04-04T06:40:34.837 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atlx 2024-04-04T06:40:34.837 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-04-04T06:40:34.837 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-04-04T06:40:34.837 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom 2024-04-04T06:40:34.837 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-04-04T06:40:34.837 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-04-04T06:40:34.837 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-04-04T06:40:34.837 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-04-04T06:40:34.837 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-04-04T06:40:34.837 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/genet 2024-04-04T06:40:34.837 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-04-04T06:40:34.838 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-04-04T06:40:34.838 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/brocade 2024-04-04T06:40:34.838 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/brocade/bna 2024-04-04T06:40:34.838 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-04-04T06:40:34.838 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio 2024-04-04T06:40:34.838 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb 2024-04-04T06:40:34.838 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-04-04T06:40:34.838 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-04-04T06:40:34.838 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-04-04T06:40:34.838 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-04-04T06:40:34.838 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-04-04T06:40:34.838 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-04-04T06:40:34.838 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-04-04T06:40:34.838 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-04-04T06:40:34.839 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-04-04T06:40:34.839 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/cisco 2024-04-04T06:40:34.839 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/cisco/enic 2024-04-04T06:40:34.839 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-04-04T06:40:34.839 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec 2024-04-04T06:40:34.839 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip 2024-04-04T06:40:34.839 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-04-04T06:40:34.839 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-04-04T06:40:34.839 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-04-04T06:40:34.839 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-04-04T06:40:34.839 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-04-04T06:40:34.839 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-04-04T06:40:34.839 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dlink 2024-04-04T06:40:34.839 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-04-04T06:40:34.840 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-04-04T06:40:34.840 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dnet.ko 2024-04-04T06:40:34.840 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/emulex 2024-04-04T06:40:34.840 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/emulex/benet 2024-04-04T06:40:34.840 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-04-04T06:40:34.840 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/ethoc.ko 2024-04-04T06:40:34.840 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/fealnx.ko 2024-04-04T06:40:34.840 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel 2024-04-04T06:40:34.840 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/e100.ko 2024-04-04T06:40:34.840 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/e1000 2024-04-04T06:40:34.840 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-04-04T06:40:34.840 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/e1000e 2024-04-04T06:40:34.840 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-04-04T06:40:34.840 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/fm10k 2024-04-04T06:40:34.841 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-04-04T06:40:34.841 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/i40e 2024-04-04T06:40:34.841 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-04-04T06:40:34.841 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/iavf 2024-04-04T06:40:34.841 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-04-04T06:40:34.841 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/igb 2024-04-04T06:40:34.841 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-04-04T06:40:34.841 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/igbvf 2024-04-04T06:40:34.841 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-04-04T06:40:34.841 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/ixgbe 2024-04-04T06:40:34.841 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-04-04T06:40:34.841 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/ixgbevf 2024-04-04T06:40:34.841 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-04-04T06:40:34.841 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/jme.ko 2024-04-04T06:40:34.842 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/marvell 2024-04-04T06:40:34.842 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-04-04T06:40:34.842 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/marvell/skge.ko 2024-04-04T06:40:34.842 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-04-04T06:40:34.842 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox 2024-04-04T06:40:34.842 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox/mlx4 2024-04-04T06:40:34.842 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-04-04T06:40:34.842 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-04-04T06:40:34.842 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox/mlx5 2024-04-04T06:40:34.842 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-04-04T06:40:34.842 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-04-04T06:40:34.842 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/micrel 2024-04-04T06:40:34.842 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-04-04T06:40:34.842 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/myricom 2024-04-04T06:40:34.843 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/myricom/myri10ge 2024-04-04T06:40:34.843 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-04-04T06:40:34.843 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/natsemi 2024-04-04T06:40:34.843 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-04-04T06:40:34.843 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-04-04T06:40:34.843 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/neterion 2024-04-04T06:40:34.843 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-04-04T06:40:34.843 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/nvidia 2024-04-04T06:40:34.843 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-04-04T06:40:34.843 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/packetengines 2024-04-04T06:40:34.843 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-04-04T06:40:34.843 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-04-04T06:40:34.843 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/qlogic 2024-04-04T06:40:34.843 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/qlogic/netxen 2024-04-04T06:40:34.844 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-04-04T06:40:34.844 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-04-04T06:40:34.844 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-04-04T06:40:34.844 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-04-04T06:40:34.844 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/rdc 2024-04-04T06:40:34.844 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-04-04T06:40:34.844 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/realtek 2024-04-04T06:40:34.844 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-04-04T06:40:34.844 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-04-04T06:40:34.844 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/realtek/atp.ko 2024-04-04T06:40:34.844 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-04-04T06:40:34.844 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/rocker 2024-04-04T06:40:34.844 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-04-04T06:40:34.844 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sfc 2024-04-04T06:40:34.845 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-04-04T06:40:34.845 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/silan 2024-04-04T06:40:34.845 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-04-04T06:40:34.845 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sis 2024-04-04T06:40:34.845 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sis/sis190.ko 2024-04-04T06:40:34.845 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sis/sis900.ko 2024-04-04T06:40:34.845 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/smsc 2024-04-04T06:40:34.845 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-04-04T06:40:34.845 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-04-04T06:40:34.845 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-04-04T06:40:34.845 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-04-04T06:40:34.845 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/stmicro 2024-04-04T06:40:34.845 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/stmicro/stmmac 2024-04-04T06:40:34.845 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-04-04T06:40:34.846 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-04-04T06:40:34.846 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sun 2024-04-04T06:40:34.846 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sun/cassini.ko 2024-04-04T06:40:34.846 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sun/niu.ko 2024-04-04T06:40:34.846 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sun/sungem.ko 2024-04-04T06:40:34.846 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-04-04T06:40:34.846 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/tehuti 2024-04-04T06:40:34.846 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-04-04T06:40:34.846 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/ti 2024-04-04T06:40:34.846 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/ti/tlan.ko 2024-04-04T06:40:34.846 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/via 2024-04-04T06:40:34.846 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-04-04T06:40:34.846 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-04-04T06:40:34.846 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/wiznet 2024-04-04T06:40:34.847 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-04-04T06:40:34.847 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-04-04T06:40:34.847 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/xircom 2024-04-04T06:40:34.847 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-04-04T06:40:34.847 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/geneve.ko 2024-04-04T06:40:34.847 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/hyperv 2024-04-04T06:40:34.847 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-04-04T06:40:34.847 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ieee802154 2024-04-04T06:40:34.847 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ieee802154/fakelb.ko 2024-04-04T06:40:34.847 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ifb.ko 2024-04-04T06:40:34.847 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ipvlan 2024-04-04T06:40:34.847 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ipvlan/ipvlan.ko 2024-04-04T06:40:34.847 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/macvlan.ko 2024-04-04T06:40:34.847 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/macvtap.ko 2024-04-04T06:40:34.848 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/mdio 2024-04-04T06:40:34.848 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/mdio.ko 2024-04-04T06:40:34.848 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-04-04T06:40:34.848 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-04-04T06:40:34.848 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/mdio/mdio-regmap.ko 2024-04-04T06:40:34.848 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/mii.ko 2024-04-04T06:40:34.848 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/net_failover.ko 2024-04-04T06:40:34.848 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/netconsole.ko 2024-04-04T06:40:34.848 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/nlmon.ko 2024-04-04T06:40:34.848 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/pcs 2024-04-04T06:40:34.848 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/pcs/pcs-lynx.ko 2024-04-04T06:40:34.848 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-04-04T06:40:34.848 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy 2024-04-04T06:40:34.848 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/amd.ko 2024-04-04T06:40:34.849 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-04-04T06:40:34.849 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-04-04T06:40:34.849 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/bcm7xxx.ko 2024-04-04T06:40:34.849 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/bcm87xx.ko 2024-04-04T06:40:34.849 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/broadcom.ko 2024-04-04T06:40:34.849 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/cicada.ko 2024-04-04T06:40:34.849 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/davicom.ko 2024-04-04T06:40:34.849 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/dp83640.ko 2024-04-04T06:40:34.849 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/et1011c.ko 2024-04-04T06:40:34.849 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/icplus.ko 2024-04-04T06:40:34.849 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/lxt.ko 2024-04-04T06:40:34.849 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/marvell.ko 2024-04-04T06:40:34.849 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/micrel.ko 2024-04-04T06:40:34.849 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/national.ko 2024-04-04T06:40:34.850 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/phylink.ko 2024-04-04T06:40:34.850 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/qsemi.ko 2024-04-04T06:40:34.850 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/realtek.ko 2024-04-04T06:40:34.850 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/smsc.ko 2024-04-04T06:40:34.850 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/ste10Xp.ko 2024-04-04T06:40:34.850 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/vitesse.ko 2024-04-04T06:40:34.850 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp 2024-04-04T06:40:34.850 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/bsd_comp.ko 2024-04-04T06:40:34.850 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/ppp_async.ko 2024-04-04T06:40:34.850 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/ppp_deflate.ko 2024-04-04T06:40:34.850 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/ppp_generic.ko 2024-04-04T06:40:34.850 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/ppp_mppe.ko 2024-04-04T06:40:34.850 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/ppp_synctty.ko 2024-04-04T06:40:34.850 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/pppoe.ko 2024-04-04T06:40:34.851 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/pppox.ko 2024-04-04T06:40:34.851 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/pptp.ko 2024-04-04T06:40:34.851 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/slip 2024-04-04T06:40:34.851 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/slip/slhc.ko 2024-04-04T06:40:34.851 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/slip/slip.ko 2024-04-04T06:40:34.851 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/sungem_phy.ko 2024-04-04T06:40:34.851 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/tap.ko 2024-04-04T06:40:34.851 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team 2024-04-04T06:40:34.851 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team/team.ko 2024-04-04T06:40:34.851 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team/team_mode_activebackup.ko 2024-04-04T06:40:34.851 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team/team_mode_broadcast.ko 2024-04-04T06:40:34.851 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-04-04T06:40:34.851 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team/team_mode_random.ko 2024-04-04T06:40:34.851 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-04-04T06:40:34.852 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/tun.ko 2024-04-04T06:40:34.852 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/veth.ko 2024-04-04T06:40:34.852 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/virtio_net.ko 2024-04-04T06:40:34.852 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/vmxnet3 2024-04-04T06:40:34.852 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-04-04T06:40:34.852 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/vxlan 2024-04-04T06:40:34.852 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/vxlan/vxlan.ko 2024-04-04T06:40:34.852 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/xen-netback 2024-04-04T06:40:34.852 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/xen-netback/xen-netback.ko 2024-04-04T06:40:34.852 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/xen-netfront.ko 2024-04-04T06:40:34.852 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ntb 2024-04-04T06:40:34.852 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ntb/ntb.ko 2024-04-04T06:40:34.852 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/nvme 2024-04-04T06:40:34.852 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/nvme/host 2024-04-04T06:40:34.853 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/nvme/host/nvme-core.ko 2024-04-04T06:40:34.853 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/nvme/host/nvme.ko 2024-04-04T06:40:34.853 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/parport 2024-04-04T06:40:34.853 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/parport/parport.ko 2024-04-04T06:40:34.853 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/parport/parport_cs.ko 2024-04-04T06:40:34.853 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/parport/parport_pc.ko 2024-04-04T06:40:34.853 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/parport/parport_serial.ko 2024-04-04T06:40:34.853 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pci 2024-04-04T06:40:34.853 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pci/hotplug 2024-04-04T06:40:34.853 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-04-04T06:40:34.853 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pci/pcie 2024-04-04T06:40:34.853 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pci/pcie/aer_inject.ko 2024-04-04T06:40:34.853 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pci/xen-pcifront.ko 2024-04-04T06:40:34.853 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pcmcia 2024-04-04T06:40:34.854 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pcmcia/i82092.ko 2024-04-04T06:40:34.854 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pcmcia/pd6729.ko 2024-04-04T06:40:34.854 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pcmcia/yenta_socket.ko 2024-04-04T06:40:34.854 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pinctrl 2024-04-04T06:40:34.854 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pinctrl/intel 2024-04-04T06:40:34.854 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-04-04T06:40:34.854 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform 2024-04-04T06:40:34.854 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86 2024-04-04T06:40:34.854 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/acer-wmi.ko 2024-04-04T06:40:34.854 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/acerhdf.ko 2024-04-04T06:40:34.854 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/apple-gmux.ko 2024-04-04T06:40:34.854 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/asus-laptop.ko 2024-04-04T06:40:34.854 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-04-04T06:40:34.854 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/asus-wmi.ko 2024-04-04T06:40:34.855 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/classmate-laptop.ko 2024-04-04T06:40:34.855 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-04-04T06:40:34.855 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-04-04T06:40:34.855 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-04-04T06:40:34.855 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-04-04T06:40:34.855 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/hdaps.ko 2024-04-04T06:40:34.855 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/intel 2024-04-04T06:40:34.855 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-04-04T06:40:34.855 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/intel_ips.ko 2024-04-04T06:40:34.855 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/msi-wmi.ko 2024-04-04T06:40:34.855 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/mxm-wmi.ko 2024-04-04T06:40:34.855 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-04-04T06:40:34.855 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/samsung-laptop.ko 2024-04-04T06:40:34.855 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/samsung-q10.ko 2024-04-04T06:40:34.856 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/topstar-laptop.ko 2024-04-04T06:40:34.856 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-04-04T06:40:34.856 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/toshiba_haps.ko 2024-04-04T06:40:34.856 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/wmi-bmof.ko 2024-04-04T06:40:34.856 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/wmi.ko 2024-04-04T06:40:34.856 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/powercap 2024-04-04T06:40:34.856 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/powercap/intel_rapl_common.ko 2024-04-04T06:40:34.856 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/powercap/intel_rapl_msr.ko 2024-04-04T06:40:34.856 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pps 2024-04-04T06:40:34.856 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pps/clients 2024-04-04T06:40:34.856 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pps/clients/pps-gpio.ko 2024-04-04T06:40:34.856 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pps/clients/pps-ldisc.ko 2024-04-04T06:40:34.856 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pps/clients/pps_parport.ko 2024-04-04T06:40:34.856 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pps/pps_core.ko 2024-04-04T06:40:34.857 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ptp 2024-04-04T06:40:34.857 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ptp/ptp.ko 2024-04-04T06:40:34.857 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ptp/ptp_kvm.ko 2024-04-04T06:40:34.857 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc 2024-04-04T06:40:34.857 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-bq32k.ko 2024-04-04T06:40:34.857 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1286.ko 2024-04-04T06:40:34.857 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1307.ko 2024-04-04T06:40:34.857 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1374.ko 2024-04-04T06:40:34.857 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1511.ko 2024-04-04T06:40:34.857 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1553.ko 2024-04-04T06:40:34.857 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1672.ko 2024-04-04T06:40:34.857 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1742.ko 2024-04-04T06:40:34.857 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds2404.ko 2024-04-04T06:40:34.857 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds3232.ko 2024-04-04T06:40:34.858 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-em3027.ko 2024-04-04T06:40:34.858 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-fm3130.ko 2024-04-04T06:40:34.858 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-isl12022.ko 2024-04-04T06:40:34.858 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-isl1208.ko 2024-04-04T06:40:34.858 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-m41t80.ko 2024-04-04T06:40:34.858 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-m48t35.ko 2024-04-04T06:40:34.858 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-m48t59.ko 2024-04-04T06:40:34.858 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-max6900.ko 2024-04-04T06:40:34.858 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-msm6242.ko 2024-04-04T06:40:34.858 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-pcf2127.ko 2024-04-04T06:40:34.858 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-pcf85063.ko 2024-04-04T06:40:34.858 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-pcf8523.ko 2024-04-04T06:40:34.858 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-pcf8563.ko 2024-04-04T06:40:34.859 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-pcf8583.ko 2024-04-04T06:40:34.859 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-rp5c01.ko 2024-04-04T06:40:34.859 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-rs5c372.ko 2024-04-04T06:40:34.859 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-04-04T06:40:34.859 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-rx8025.ko 2024-04-04T06:40:34.859 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-rx8581.ko 2024-04-04T06:40:34.859 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-04-04T06:40:34.859 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-x1205.ko 2024-04-04T06:40:34.859 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi 2024-04-04T06:40:34.859 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/3w-9xxx.ko 2024-04-04T06:40:34.859 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/3w-sas.ko 2024-04-04T06:40:34.859 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/3w-xxxx.ko 2024-04-04T06:40:34.859 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/BusLogic.ko 2024-04-04T06:40:34.859 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/a100u2w.ko 2024-04-04T06:40:34.859 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/aacraid 2024-04-04T06:40:34.860 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/aacraid/aacraid.ko 2024-04-04T06:40:34.860 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/advansys.ko 2024-04-04T06:40:34.860 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/aic7xxx 2024-04-04T06:40:34.860 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-04-04T06:40:34.860 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-04-04T06:40:34.860 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/am53c974.ko 2024-04-04T06:40:34.860 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/arcmsr 2024-04-04T06:40:34.860 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-04-04T06:40:34.860 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/atp870u.ko 2024-04-04T06:40:34.860 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/be2iscsi 2024-04-04T06:40:34.860 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-04-04T06:40:34.860 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/bfa 2024-04-04T06:40:34.860 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/bfa/bfa.ko 2024-04-04T06:40:34.860 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/bnx2fc 2024-04-04T06:40:34.861 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-04-04T06:40:34.861 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/bnx2i 2024-04-04T06:40:34.861 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-04-04T06:40:34.861 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/ch.ko 2024-04-04T06:40:34.861 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/csiostor 2024-04-04T06:40:34.861 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/csiostor/csiostor.ko 2024-04-04T06:40:34.861 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/cxgbi 2024-04-04T06:40:34.861 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/cxgbi/cxgb3i 2024-04-04T06:40:34.861 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-04-04T06:40:34.861 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/cxgbi/cxgb4i 2024-04-04T06:40:34.861 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-04-04T06:40:34.861 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-04-04T06:40:34.861 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/dc395x.ko 2024-04-04T06:40:34.861 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/device_handler 2024-04-04T06:40:34.861 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-04-04T06:40:34.862 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-04-04T06:40:34.862 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-04-04T06:40:34.862 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-04-04T06:40:34.862 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/dmx3191d.ko 2024-04-04T06:40:34.862 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/esas2r 2024-04-04T06:40:34.862 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/esas2r/esas2r.ko 2024-04-04T06:40:34.862 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/esp_scsi.ko 2024-04-04T06:40:34.862 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/fcoe 2024-04-04T06:40:34.862 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/fcoe/fcoe.ko 2024-04-04T06:40:34.862 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-04-04T06:40:34.862 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/fnic 2024-04-04T06:40:34.862 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/fnic/fnic.ko 2024-04-04T06:40:34.862 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/hpsa.ko 2024-04-04T06:40:34.862 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/hptiop.ko 2024-04-04T06:40:34.863 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/hv_storvsc.ko 2024-04-04T06:40:34.863 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/initio.ko 2024-04-04T06:40:34.863 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/ipr.ko 2024-04-04T06:40:34.863 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/ips.ko 2024-04-04T06:40:34.863 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/isci 2024-04-04T06:40:34.863 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/isci/isci.ko 2024-04-04T06:40:34.863 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-04-04T06:40:34.863 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/iscsi_tcp.ko 2024-04-04T06:40:34.863 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/libfc 2024-04-04T06:40:34.863 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/libfc/libfc.ko 2024-04-04T06:40:34.863 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/libiscsi.ko 2024-04-04T06:40:34.863 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/libiscsi_tcp.ko 2024-04-04T06:40:34.863 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/libsas 2024-04-04T06:40:34.864 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/libsas/libsas.ko 2024-04-04T06:40:34.864 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/lpfc 2024-04-04T06:40:34.864 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/lpfc/lpfc.ko 2024-04-04T06:40:34.864 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/megaraid 2024-04-04T06:40:34.864 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/megaraid.ko 2024-04-04T06:40:34.864 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-04-04T06:40:34.864 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-04-04T06:40:34.864 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-04-04T06:40:34.864 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/mpt3sas 2024-04-04T06:40:34.864 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-04-04T06:40:34.864 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/mvsas 2024-04-04T06:40:34.864 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/mvsas/mvsas.ko 2024-04-04T06:40:34.864 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/mvumi.ko 2024-04-04T06:40:34.864 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/pm8001 2024-04-04T06:40:34.864 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-04-04T06:40:34.865 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/pmcraid.ko 2024-04-04T06:40:34.865 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/qla1280.ko 2024-04-04T06:40:34.865 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/qla2xxx 2024-04-04T06:40:34.865 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-04-04T06:40:34.865 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-04-04T06:40:34.865 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/qla4xxx 2024-04-04T06:40:34.865 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-04-04T06:40:34.865 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/raid_class.ko 2024-04-04T06:40:34.865 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/scsi_debug.ko 2024-04-04T06:40:34.865 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/scsi_transport_fc.ko 2024-04-04T06:40:34.865 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-04-04T06:40:34.865 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/scsi_transport_sas.ko 2024-04-04T06:40:34.865 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/scsi_transport_spi.ko 2024-04-04T06:40:34.865 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/scsi_transport_srp.ko 2024-04-04T06:40:34.866 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/ses.ko 2024-04-04T06:40:34.866 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/st.ko 2024-04-04T06:40:34.866 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/stex.ko 2024-04-04T06:40:34.866 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/sym53c8xx_2 2024-04-04T06:40:34.866 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-04-04T06:40:34.866 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/virtio_scsi.ko 2024-04-04T06:40:34.866 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/vmw_pvscsi.ko 2024-04-04T06:40:34.866 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/wd719x.ko 2024-04-04T06:40:34.866 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ssb 2024-04-04T06:40:34.866 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ssb/ssb.ko 2024-04-04T06:40:34.866 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target 2024-04-04T06:40:34.866 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/iscsi 2024-04-04T06:40:34.866 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-04-04T06:40:34.867 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/loopback 2024-04-04T06:40:34.867 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/loopback/tcm_loop.ko 2024-04-04T06:40:34.867 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/target_core_file.ko 2024-04-04T06:40:34.867 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/target_core_iblock.ko 2024-04-04T06:40:34.867 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/target_core_mod.ko 2024-04-04T06:40:34.867 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/target_core_pscsi.ko 2024-04-04T06:40:34.867 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/target_core_user.ko 2024-04-04T06:40:34.867 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/tcm_fc 2024-04-04T06:40:34.867 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-04-04T06:40:34.867 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal 2024-04-04T06:40:34.867 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel 2024-04-04T06:40:34.867 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal 2024-04-04T06:40:34.867 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-04-04T06:40:34.867 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-04-04T06:40:34.868 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-04-04T06:40:34.868 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-04-04T06:40:34.868 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-04-04T06:40:34.868 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-04-04T06:40:34.868 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-04-04T06:40:34.868 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-04-04T06:40:34.868 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-04-04T06:40:34.868 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-04-04T06:40:34.868 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-04-04T06:40:34.868 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-04-04T06:40:34.868 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-04-04T06:40:34.868 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-04-04T06:40:34.868 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-04-04T06:40:34.869 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-04-04T06:40:34.869 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-04-04T06:40:34.869 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-04-04T06:40:34.869 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty 2024-04-04T06:40:34.869 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/ipwireless 2024-04-04T06:40:34.869 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-04-04T06:40:34.869 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/n_gsm.ko 2024-04-04T06:40:34.869 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/n_hdlc.ko 2024-04-04T06:40:34.869 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/nozomi.ko 2024-04-04T06:40:34.869 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/serial 2024-04-04T06:40:34.869 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/serial/8250 2024-04-04T06:40:34.869 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-04-04T06:40:34.869 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/serial/arc_uart.ko 2024-04-04T06:40:34.869 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/serial/jsm 2024-04-04T06:40:34.869 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/serial/jsm/jsm.ko 2024-04-04T06:40:34.870 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ufs 2024-04-04T06:40:34.870 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ufs/core 2024-04-04T06:40:34.870 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ufs/core/ufshcd-core.ko 2024-04-04T06:40:34.870 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ufs/host 2024-04-04T06:40:34.870 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-04-04T06:40:34.870 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/uio 2024-04-04T06:40:34.870 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/uio/uio.ko 2024-04-04T06:40:34.870 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/uio/uio_aec.ko 2024-04-04T06:40:34.870 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/uio/uio_cif.ko 2024-04-04T06:40:34.870 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/uio/uio_pci_generic.ko 2024-04-04T06:40:34.870 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/uio/uio_sercos3.ko 2024-04-04T06:40:34.870 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb 2024-04-04T06:40:34.870 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/class 2024-04-04T06:40:34.870 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/class/cdc-acm.ko 2024-04-04T06:40:34.871 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/class/cdc-wdm.ko 2024-04-04T06:40:34.871 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/class/usblp.ko 2024-04-04T06:40:34.871 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/class/usbtmc.ko 2024-04-04T06:40:34.871 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/host 2024-04-04T06:40:34.871 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/host/sl811-hcd.ko 2024-04-04T06:40:34.871 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/image 2024-04-04T06:40:34.871 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/image/mdc800.ko 2024-04-04T06:40:34.871 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/image/microtek.ko 2024-04-04T06:40:34.871 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc 2024-04-04T06:40:34.871 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/adutux.ko 2024-04-04T06:40:34.871 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/appledisplay.ko 2024-04-04T06:40:34.871 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/emi26.ko 2024-04-04T06:40:34.871 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/emi62.ko 2024-04-04T06:40:34.871 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/ezusb.ko 2024-04-04T06:40:34.872 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/idmouse.ko 2024-04-04T06:40:34.872 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/iowarrior.ko 2024-04-04T06:40:34.872 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/isight_firmware.ko 2024-04-04T06:40:34.872 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/ldusb.ko 2024-04-04T06:40:34.872 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/legousbtower.ko 2024-04-04T06:40:34.872 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/sisusbvga 2024-04-04T06:40:34.872 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-04-04T06:40:34.872 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/trancevibrator.ko 2024-04-04T06:40:34.872 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/usb3503.ko 2024-04-04T06:40:34.872 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/usblcd.ko 2024-04-04T06:40:34.872 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/usbsevseg.ko 2024-04-04T06:40:34.872 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/uss720.ko 2024-04-04T06:40:34.872 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/yurex.ko 2024-04-04T06:40:34.872 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/phy 2024-04-04T06:40:34.873 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/phy/phy-generic.ko 2024-04-04T06:40:34.873 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial 2024-04-04T06:40:34.873 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/aircable.ko 2024-04-04T06:40:34.873 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ark3116.ko 2024-04-04T06:40:34.873 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/belkin_sa.ko 2024-04-04T06:40:34.873 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ch341.ko 2024-04-04T06:40:34.873 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/cp210x.ko 2024-04-04T06:40:34.873 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/cyberjack.ko 2024-04-04T06:40:34.873 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/cypress_m8.ko 2024-04-04T06:40:34.873 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/digi_acceleport.ko 2024-04-04T06:40:34.873 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/empeg.ko 2024-04-04T06:40:34.873 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ftdi_sio.ko 2024-04-04T06:40:34.873 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/garmin_gps.ko 2024-04-04T06:40:34.873 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/io_edgeport.ko 2024-04-04T06:40:34.874 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/io_ti.ko 2024-04-04T06:40:34.874 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ipaq.ko 2024-04-04T06:40:34.874 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ipw.ko 2024-04-04T06:40:34.874 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ir-usb.ko 2024-04-04T06:40:34.874 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-04-04T06:40:34.874 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/keyspan.ko 2024-04-04T06:40:34.874 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/keyspan_pda.ko 2024-04-04T06:40:34.874 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/kl5kusb105.ko 2024-04-04T06:40:34.874 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/kobil_sct.ko 2024-04-04T06:40:34.874 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/mct_u232.ko 2024-04-04T06:40:34.874 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/mos7720.ko 2024-04-04T06:40:34.874 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/mos7840.ko 2024-04-04T06:40:34.874 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/navman.ko 2024-04-04T06:40:34.874 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/omninet.ko 2024-04-04T06:40:34.875 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/opticon.ko 2024-04-04T06:40:34.875 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/option.ko 2024-04-04T06:40:34.875 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/oti6858.ko 2024-04-04T06:40:34.875 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/pl2303.ko 2024-04-04T06:40:34.875 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/qcaux.ko 2024-04-04T06:40:34.875 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/qcserial.ko 2024-04-04T06:40:34.875 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/quatech2.ko 2024-04-04T06:40:34.875 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/safe_serial.ko 2024-04-04T06:40:34.875 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/sierra.ko 2024-04-04T06:40:34.875 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/spcp8x5.ko 2024-04-04T06:40:34.875 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ssu100.ko 2024-04-04T06:40:34.875 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/symbolserial.ko 2024-04-04T06:40:34.875 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-04-04T06:40:34.875 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-04-04T06:40:34.875 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/usb_debug.ko 2024-04-04T06:40:34.876 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/usb_wwan.ko 2024-04-04T06:40:34.876 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/visor.ko 2024-04-04T06:40:34.876 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/whiteheat.ko 2024-04-04T06:40:34.876 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/xsens_mt.ko 2024-04-04T06:40:34.876 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage 2024-04-04T06:40:34.876 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/uas.ko 2024-04-04T06:40:34.876 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-alauda.ko 2024-04-04T06:40:34.876 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-cypress.ko 2024-04-04T06:40:34.876 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-datafab.ko 2024-04-04T06:40:34.876 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-04-04T06:40:34.876 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-freecom.ko 2024-04-04T06:40:34.876 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-isd200.ko 2024-04-04T06:40:34.876 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-04-04T06:40:34.876 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-karma.ko 2024-04-04T06:40:34.877 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-onetouch.ko 2024-04-04T06:40:34.877 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-realtek.ko 2024-04-04T06:40:34.877 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-sddr09.ko 2024-04-04T06:40:34.877 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-sddr55.ko 2024-04-04T06:40:34.877 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-usbat.ko 2024-04-04T06:40:34.877 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/usb-storage.ko 2024-04-04T06:40:34.877 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/usbip 2024-04-04T06:40:34.877 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/usbip/usbip-core.ko 2024-04-04T06:40:34.877 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/usbip/usbip-host.ko 2024-04-04T06:40:34.877 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-04-04T06:40:34.877 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vfio 2024-04-04T06:40:34.877 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vfio/pci 2024-04-04T06:40:34.877 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-04-04T06:40:34.877 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vfio/pci/vfio-pci.ko 2024-04-04T06:40:34.878 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vfio/vfio.ko 2024-04-04T06:40:34.878 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-04-04T06:40:34.878 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vhost 2024-04-04T06:40:34.878 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vhost/vhost.ko 2024-04-04T06:40:34.878 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vhost/vhost_iotlb.ko 2024-04-04T06:40:34.878 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vhost/vhost_net.ko 2024-04-04T06:40:34.878 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vhost/vhost_scsi.ko 2024-04-04T06:40:34.878 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video 2024-04-04T06:40:34.878 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video/backlight 2024-04-04T06:40:34.878 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video/backlight/apple_bl.ko 2024-04-04T06:40:34.878 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video/backlight/lcd.ko 2024-04-04T06:40:34.878 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video/backlight/platform_lcd.ko 2024-04-04T06:40:34.878 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio 2024-04-04T06:40:34.879 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio/virtio.ko 2024-04-04T06:40:34.879 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio/virtio_balloon.ko 2024-04-04T06:40:34.879 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio/virtio_mmio.ko 2024-04-04T06:40:34.879 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio/virtio_pci.ko 2024-04-04T06:40:34.879 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-04-04T06:40:34.879 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-04-04T06:40:34.879 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio/virtio_ring.ko 2024-04-04T06:40:34.879 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1 2024-04-04T06:40:34.879 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/masters 2024-04-04T06:40:34.879 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/masters/ds2482.ko 2024-04-04T06:40:34.879 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/masters/ds2490.ko 2024-04-04T06:40:34.879 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves 2024-04-04T06:40:34.879 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-04-04T06:40:34.879 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-04-04T06:40:34.879 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-04-04T06:40:34.880 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-04-04T06:40:34.880 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-04-04T06:40:34.880 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-04-04T06:40:34.880 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-04-04T06:40:34.880 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-04-04T06:40:34.880 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-04-04T06:40:34.880 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_smem.ko 2024-04-04T06:40:34.880 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_therm.ko 2024-04-04T06:40:34.880 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/wire.ko 2024-04-04T06:40:34.880 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog 2024-04-04T06:40:34.880 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/alim1535_wdt.ko 2024-04-04T06:40:34.880 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/alim7101_wdt.ko 2024-04-04T06:40:34.880 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/f71808e_wdt.ko 2024-04-04T06:40:34.880 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/hpwdt.ko 2024-04-04T06:40:34.880 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/i6300esb.ko 2024-04-04T06:40:34.881 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-04-04T06:40:34.881 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/iTCO_wdt.ko 2024-04-04T06:40:34.881 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/ib700wdt.ko 2024-04-04T06:40:34.881 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/ibmasr.ko 2024-04-04T06:40:34.881 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-04-04T06:40:34.881 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/it8712f_wdt.ko 2024-04-04T06:40:34.881 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/it87_wdt.ko 2024-04-04T06:40:34.881 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/machzwd.ko 2024-04-04T06:40:34.881 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/nv_tco.ko 2024-04-04T06:40:34.881 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/pcwd_pci.ko 2024-04-04T06:40:34.881 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/pcwd_usb.ko 2024-04-04T06:40:34.881 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-04-04T06:40:34.881 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/sch311x_wdt.ko 2024-04-04T06:40:34.881 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/softdog.ko 2024-04-04T06:40:34.882 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/sp5100_tco.ko 2024-04-04T06:40:34.882 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/via_wdt.ko 2024-04-04T06:40:34.882 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-04-04T06:40:34.882 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/w83877f_wdt.ko 2024-04-04T06:40:34.882 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/w83977f_wdt.ko 2024-04-04T06:40:34.882 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/wdt_pci.ko 2024-04-04T06:40:34.882 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/xen_wdt.ko 2024-04-04T06:40:34.882 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen 2024-04-04T06:40:34.882 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-acpi-processor.ko 2024-04-04T06:40:34.882 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-evtchn.ko 2024-04-04T06:40:34.882 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-gntalloc.ko 2024-04-04T06:40:34.882 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-gntdev.ko 2024-04-04T06:40:34.882 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-pciback 2024-04-04T06:40:34.883 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-04-04T06:40:34.883 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-privcmd.ko 2024-04-04T06:40:34.883 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xenfs 2024-04-04T06:40:34.883 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xenfs/xenfs.ko 2024-04-04T06:40:34.883 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs 2024-04-04T06:40:34.883 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/9p 2024-04-04T06:40:34.883 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/9p/9p.ko 2024-04-04T06:40:34.883 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/affs 2024-04-04T06:40:34.883 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/affs/affs.ko 2024-04-04T06:40:34.883 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/befs 2024-04-04T06:40:34.883 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/befs/befs.ko 2024-04-04T06:40:34.883 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/binfmt_misc.ko 2024-04-04T06:40:34.883 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/btrfs 2024-04-04T06:40:34.883 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/btrfs/btrfs.ko 2024-04-04T06:40:34.884 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/cachefiles 2024-04-04T06:40:34.884 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/cachefiles/cachefiles.ko 2024-04-04T06:40:34.884 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ceph 2024-04-04T06:40:34.884 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ceph/ceph.ko 2024-04-04T06:40:34.884 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/coda 2024-04-04T06:40:34.884 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/coda/coda.ko 2024-04-04T06:40:34.884 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/cramfs 2024-04-04T06:40:34.884 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/cramfs/cramfs.ko 2024-04-04T06:40:34.884 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/dlm 2024-04-04T06:40:34.884 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/dlm/dlm.ko 2024-04-04T06:40:34.884 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ecryptfs 2024-04-04T06:40:34.884 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ecryptfs/ecryptfs.ko 2024-04-04T06:40:34.884 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/f2fs 2024-04-04T06:40:34.884 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/f2fs/f2fs.ko 2024-04-04T06:40:34.885 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fat 2024-04-04T06:40:34.885 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fat/fat.ko 2024-04-04T06:40:34.885 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fat/msdos.ko 2024-04-04T06:40:34.885 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fat/vfat.ko 2024-04-04T06:40:34.885 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fuse 2024-04-04T06:40:34.885 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fuse/cuse.ko 2024-04-04T06:40:34.885 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fuse/fuse.ko 2024-04-04T06:40:34.885 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/gfs2 2024-04-04T06:40:34.885 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/gfs2/gfs2.ko 2024-04-04T06:40:34.885 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/hfs 2024-04-04T06:40:34.885 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/hfs/hfs.ko 2024-04-04T06:40:34.885 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/hfsplus 2024-04-04T06:40:34.885 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/hfsplus/hfsplus.ko 2024-04-04T06:40:34.885 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/isofs 2024-04-04T06:40:34.885 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/isofs/isofs.ko 2024-04-04T06:40:34.886 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/jfs 2024-04-04T06:40:34.886 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/jfs/jfs.ko 2024-04-04T06:40:34.886 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/lockd 2024-04-04T06:40:34.886 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/lockd/lockd.ko 2024-04-04T06:40:34.886 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/minix 2024-04-04T06:40:34.886 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/minix/minix.ko 2024-04-04T06:40:34.886 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/netfs 2024-04-04T06:40:34.886 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/netfs/netfs.ko 2024-04-04T06:40:34.886 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs 2024-04-04T06:40:34.886 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/blocklayout 2024-04-04T06:40:34.886 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-04-04T06:40:34.886 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/filelayout 2024-04-04T06:40:34.886 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-04-04T06:40:34.886 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/flexfilelayout 2024-04-04T06:40:34.887 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-04-04T06:40:34.887 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/nfs.ko 2024-04-04T06:40:34.887 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/nfsv3.ko 2024-04-04T06:40:34.887 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/nfsv4.ko 2024-04-04T06:40:34.887 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs_common 2024-04-04T06:40:34.887 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs_common/grace.ko 2024-04-04T06:40:34.887 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs_common/nfs_acl.ko 2024-04-04T06:40:34.887 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfsd 2024-04-04T06:40:34.887 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfsd/nfsd.ko 2024-04-04T06:40:34.887 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nilfs2 2024-04-04T06:40:34.887 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nilfs2/nilfs2.ko 2024-04-04T06:40:34.887 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls 2024-04-04T06:40:34.887 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-celtic.ko 2024-04-04T06:40:34.887 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-centeuro.ko 2024-04-04T06:40:34.888 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-croatian.ko 2024-04-04T06:40:34.888 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-cyrillic.ko 2024-04-04T06:40:34.888 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-gaelic.ko 2024-04-04T06:40:34.888 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-greek.ko 2024-04-04T06:40:34.888 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-iceland.ko 2024-04-04T06:40:34.888 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-inuit.ko 2024-04-04T06:40:34.888 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-roman.ko 2024-04-04T06:40:34.888 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-romanian.ko 2024-04-04T06:40:34.888 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-turkish.ko 2024-04-04T06:40:34.888 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp1250.ko 2024-04-04T06:40:34.888 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp1251.ko 2024-04-04T06:40:34.888 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp1255.ko 2024-04-04T06:40:34.888 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp737.ko 2024-04-04T06:40:34.888 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp775.ko 2024-04-04T06:40:34.888 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp850.ko 2024-04-04T06:40:34.889 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp852.ko 2024-04-04T06:40:34.889 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp855.ko 2024-04-04T06:40:34.889 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp857.ko 2024-04-04T06:40:34.889 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp860.ko 2024-04-04T06:40:34.889 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp861.ko 2024-04-04T06:40:34.889 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp862.ko 2024-04-04T06:40:34.889 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp863.ko 2024-04-04T06:40:34.889 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp864.ko 2024-04-04T06:40:34.889 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp865.ko 2024-04-04T06:40:34.889 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp866.ko 2024-04-04T06:40:34.889 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp869.ko 2024-04-04T06:40:34.889 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp874.ko 2024-04-04T06:40:34.889 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp932.ko 2024-04-04T06:40:34.889 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp936.ko 2024-04-04T06:40:34.890 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp949.ko 2024-04-04T06:40:34.890 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp950.ko 2024-04-04T06:40:34.890 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_euc-jp.ko 2024-04-04T06:40:34.890 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-1.ko 2024-04-04T06:40:34.890 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-13.ko 2024-04-04T06:40:34.890 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-14.ko 2024-04-04T06:40:34.890 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-15.ko 2024-04-04T06:40:34.890 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-2.ko 2024-04-04T06:40:34.890 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-3.ko 2024-04-04T06:40:34.890 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-4.ko 2024-04-04T06:40:34.890 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-5.ko 2024-04-04T06:40:34.890 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-6.ko 2024-04-04T06:40:34.890 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-7.ko 2024-04-04T06:40:34.890 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-9.ko 2024-04-04T06:40:34.891 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_koi8-r.ko 2024-04-04T06:40:34.891 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_koi8-ru.ko 2024-04-04T06:40:34.891 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_koi8-u.ko 2024-04-04T06:40:34.891 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_ucs2_utils.ko 2024-04-04T06:40:34.891 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_utf8.ko 2024-04-04T06:40:34.891 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2 2024-04-04T06:40:34.891 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/cluster 2024-04-04T06:40:34.891 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-04-04T06:40:34.891 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/dlm 2024-04-04T06:40:34.891 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-04-04T06:40:34.891 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/dlmfs 2024-04-04T06:40:34.891 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-04-04T06:40:34.891 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/ocfs2.ko 2024-04-04T06:40:34.891 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-04-04T06:40:34.892 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-04-04T06:40:34.892 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-04-04T06:40:34.892 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/overlayfs 2024-04-04T06:40:34.892 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/overlayfs/overlay.ko 2024-04-04T06:40:34.892 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/pstore 2024-04-04T06:40:34.892 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/pstore/ramoops.ko 2024-04-04T06:40:34.892 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/reiserfs 2024-04-04T06:40:34.892 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/reiserfs/reiserfs.ko 2024-04-04T06:40:34.892 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/romfs 2024-04-04T06:40:34.892 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/romfs/romfs.ko 2024-04-04T06:40:34.892 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/smb 2024-04-04T06:40:34.892 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/smb/client 2024-04-04T06:40:34.892 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/smb/client/cifs.ko 2024-04-04T06:40:34.892 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/smb/common 2024-04-04T06:40:34.893 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/smb/common/cifs_arc4.ko 2024-04-04T06:40:34.893 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/smb/common/cifs_md4.ko 2024-04-04T06:40:34.893 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/squashfs 2024-04-04T06:40:34.893 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/squashfs/squashfs.ko 2024-04-04T06:40:34.893 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/sysv 2024-04-04T06:40:34.893 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/sysv/sysv.ko 2024-04-04T06:40:34.893 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/udf 2024-04-04T06:40:34.893 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/udf/udf.ko 2024-04-04T06:40:34.893 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ufs 2024-04-04T06:40:34.893 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ufs/ufs.ko 2024-04-04T06:40:34.893 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/xfs 2024-04-04T06:40:34.893 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/xfs/xfs.ko 2024-04-04T06:40:34.893 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/kernel 2024-04-04T06:40:34.893 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/kernel/rcu 2024-04-04T06:40:34.894 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/kernel/rcu/rcutorture.ko 2024-04-04T06:40:34.894 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/kernel/torture.ko 2024-04-04T06:40:34.894 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/kernel/trace 2024-04-04T06:40:34.894 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-04-04T06:40:34.894 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib 2024-04-04T06:40:34.894 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/asn1_encoder.ko 2024-04-04T06:40:34.894 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/crc-itu-t.ko 2024-04-04T06:40:34.894 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/crc8.ko 2024-04-04T06:40:34.894 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/crypto 2024-04-04T06:40:34.894 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/crypto/libarc4.ko 2024-04-04T06:40:34.894 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/crypto/libdes.ko 2024-04-04T06:40:34.894 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/libcrc32c.ko 2024-04-04T06:40:34.894 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/lru_cache.ko 2024-04-04T06:40:34.895 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/lz4 2024-04-04T06:40:34.895 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/lz4/lz4_compress.ko 2024-04-04T06:40:34.895 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/lz4/lz4hc_compress.ko 2024-04-04T06:40:34.895 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/math 2024-04-04T06:40:34.895 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/math/cordic.ko 2024-04-04T06:40:34.895 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/raid6 2024-04-04T06:40:34.895 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/raid6/raid6_pq.ko 2024-04-04T06:40:34.895 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/reed_solomon 2024-04-04T06:40:34.895 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/reed_solomon/reed_solomon.ko 2024-04-04T06:40:34.895 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/ts_bm.ko 2024-04-04T06:40:34.895 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/ts_fsm.ko 2024-04-04T06:40:34.895 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/ts_kmp.ko 2024-04-04T06:40:34.895 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/zstd 2024-04-04T06:40:34.895 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/zstd/zstd_compress.ko 2024-04-04T06:40:34.896 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/mm 2024-04-04T06:40:34.896 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/mm/hwpoison-inject.ko 2024-04-04T06:40:34.896 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net 2024-04-04T06:40:34.896 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan 2024-04-04T06:40:34.896 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/6lowpan.ko 2024-04-04T06:40:34.896 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_dest.ko 2024-04-04T06:40:34.896 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_fragment.ko 2024-04-04T06:40:34.896 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_hop.ko 2024-04-04T06:40:34.896 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_ipv6.ko 2024-04-04T06:40:34.896 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_mobility.ko 2024-04-04T06:40:34.896 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_routing.ko 2024-04-04T06:40:34.896 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_udp.ko 2024-04-04T06:40:34.896 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/802 2024-04-04T06:40:34.896 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/802/garp.ko 2024-04-04T06:40:34.897 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/802/mrp.ko 2024-04-04T06:40:34.897 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/802/p8022.ko 2024-04-04T06:40:34.897 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/802/psnap.ko 2024-04-04T06:40:34.897 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/802/stp.ko 2024-04-04T06:40:34.897 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/8021q 2024-04-04T06:40:34.897 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/8021q/8021q.ko 2024-04-04T06:40:34.897 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/9p 2024-04-04T06:40:34.897 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/9p/9pnet.ko 2024-04-04T06:40:34.897 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/9p/9pnet_fd.ko 2024-04-04T06:40:34.897 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/9p/9pnet_rdma.ko 2024-04-04T06:40:34.897 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/9p/9pnet_virtio.ko 2024-04-04T06:40:34.897 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/batman-adv 2024-04-04T06:40:34.897 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/batman-adv/batman-adv.ko 2024-04-04T06:40:34.897 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge 2024-04-04T06:40:34.897 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/br_netfilter.ko 2024-04-04T06:40:34.898 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/bridge.ko 2024-04-04T06:40:34.898 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter 2024-04-04T06:40:34.898 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-04-04T06:40:34.898 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_among.ko 2024-04-04T06:40:34.898 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_arp.ko 2024-04-04T06:40:34.898 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-04-04T06:40:34.898 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-04-04T06:40:34.898 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_ip.ko 2024-04-04T06:40:34.898 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-04-04T06:40:34.898 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_limit.ko 2024-04-04T06:40:34.898 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_log.ko 2024-04-04T06:40:34.898 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_mark.ko 2024-04-04T06:40:34.898 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-04-04T06:40:34.898 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-04-04T06:40:34.899 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-04-04T06:40:34.899 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-04-04T06:40:34.899 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_snat.ko 2024-04-04T06:40:34.899 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_stp.ko 2024-04-04T06:40:34.899 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-04-04T06:40:34.899 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-04-04T06:40:34.899 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-04-04T06:40:34.899 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-04-04T06:40:34.899 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebtables.ko 2024-04-04T06:40:34.899 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-04-04T06:40:34.899 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-04-04T06:40:34.899 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-04-04T06:40:34.899 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ceph 2024-04-04T06:40:34.899 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ceph/libceph.ko 2024-04-04T06:40:34.899 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/core 2024-04-04T06:40:34.900 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/core/failover.ko 2024-04-04T06:40:34.900 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/core/pktgen.ko 2024-04-04T06:40:34.900 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dccp 2024-04-04T06:40:34.900 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dccp/dccp.ko 2024-04-04T06:40:34.900 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dccp/dccp_diag.ko 2024-04-04T06:40:34.900 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dccp/dccp_ipv4.ko 2024-04-04T06:40:34.900 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dccp/dccp_ipv6.ko 2024-04-04T06:40:34.900 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dns_resolver 2024-04-04T06:40:34.900 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dns_resolver/dns_resolver.ko 2024-04-04T06:40:34.900 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dsa 2024-04-04T06:40:34.900 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dsa/dsa_core.ko 2024-04-04T06:40:34.900 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dsa/tag_brcm.ko 2024-04-04T06:40:34.900 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dsa/tag_dsa.ko 2024-04-04T06:40:34.900 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dsa/tag_none.ko 2024-04-04T06:40:34.901 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dsa/tag_trailer.ko 2024-04-04T06:40:34.901 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ieee802154 2024-04-04T06:40:34.901 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ieee802154/6lowpan 2024-04-04T06:40:34.901 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-04-04T06:40:34.901 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ieee802154/ieee802154.ko 2024-04-04T06:40:34.901 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ieee802154/ieee802154_socket.ko 2024-04-04T06:40:34.901 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4 2024-04-04T06:40:34.901 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/ah4.ko 2024-04-04T06:40:34.901 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/esp4.ko 2024-04-04T06:40:34.901 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/fou.ko 2024-04-04T06:40:34.901 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/gre.ko 2024-04-04T06:40:34.901 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/inet_diag.ko 2024-04-04T06:40:34.901 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/ip_gre.ko 2024-04-04T06:40:34.901 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/ip_tunnel.ko 2024-04-04T06:40:34.902 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/ip_vti.ko 2024-04-04T06:40:34.902 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/ipcomp.ko 2024-04-04T06:40:34.902 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/ipip.ko 2024-04-04T06:40:34.902 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter 2024-04-04T06:40:34.902 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/arp_tables.ko 2024-04-04T06:40:34.902 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-04-04T06:40:34.902 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-04-04T06:40:34.902 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-04-04T06:40:34.902 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-04-04T06:40:34.902 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-04-04T06:40:34.902 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-04-04T06:40:34.902 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-04-04T06:40:34.902 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-04-04T06:40:34.903 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-04-04T06:40:34.903 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/iptable_security.ko 2024-04-04T06:40:34.903 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-04-04T06:40:34.903 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-04-04T06:40:34.903 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-04-04T06:40:34.903 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-04-04T06:40:34.903 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-04-04T06:40:34.903 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-04-04T06:40:34.903 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-04-04T06:40:34.903 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-04-04T06:40:34.903 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-04-04T06:40:34.903 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-04-04T06:40:34.903 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_bic.ko 2024-04-04T06:40:34.903 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_dctcp.ko 2024-04-04T06:40:34.903 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_diag.ko 2024-04-04T06:40:34.904 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_highspeed.ko 2024-04-04T06:40:34.904 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_htcp.ko 2024-04-04T06:40:34.904 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_hybla.ko 2024-04-04T06:40:34.904 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_illinois.ko 2024-04-04T06:40:34.904 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_lp.ko 2024-04-04T06:40:34.904 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_scalable.ko 2024-04-04T06:40:34.904 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_vegas.ko 2024-04-04T06:40:34.904 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_veno.ko 2024-04-04T06:40:34.904 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_westwood.ko 2024-04-04T06:40:34.904 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_yeah.ko 2024-04-04T06:40:34.904 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tunnel4.ko 2024-04-04T06:40:34.904 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/udp_diag.ko 2024-04-04T06:40:34.904 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/udp_tunnel.ko 2024-04-04T06:40:34.905 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/xfrm4_tunnel.ko 2024-04-04T06:40:34.905 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6 2024-04-04T06:40:34.905 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/ah6.ko 2024-04-04T06:40:34.905 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/esp6.ko 2024-04-04T06:40:34.905 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/fou6.ko 2024-04-04T06:40:34.905 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/ip6_tunnel.ko 2024-04-04T06:40:34.905 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-04-04T06:40:34.905 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/ip6_vti.ko 2024-04-04T06:40:34.905 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/ipcomp6.ko 2024-04-04T06:40:34.905 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter 2024-04-04T06:40:34.905 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-04-04T06:40:34.905 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-04-04T06:40:34.905 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-04-04T06:40:34.905 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-04-04T06:40:34.905 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-04-04T06:40:34.906 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-04-04T06:40:34.906 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-04-04T06:40:34.906 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-04-04T06:40:34.906 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-04-04T06:40:34.906 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-04-04T06:40:34.906 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-04-04T06:40:34.906 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-04-04T06:40:34.906 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-04-04T06:40:34.906 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-04-04T06:40:34.906 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-04-04T06:40:34.906 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-04-04T06:40:34.906 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-04-04T06:40:34.906 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-04-04T06:40:34.906 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-04-04T06:40:34.907 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-04-04T06:40:34.907 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-04-04T06:40:34.907 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-04-04T06:40:34.907 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-04-04T06:40:34.907 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-04-04T06:40:34.907 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/sit.ko 2024-04-04T06:40:34.907 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/tunnel6.ko 2024-04-04T06:40:34.907 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/xfrm6_tunnel.ko 2024-04-04T06:40:34.907 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/key 2024-04-04T06:40:34.907 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/key/af_key.ko 2024-04-04T06:40:34.907 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp 2024-04-04T06:40:34.907 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_core.ko 2024-04-04T06:40:34.907 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_debugfs.ko 2024-04-04T06:40:34.907 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_eth.ko 2024-04-04T06:40:34.907 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_ip.ko 2024-04-04T06:40:34.908 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_ip6.ko 2024-04-04T06:40:34.908 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_netlink.ko 2024-04-04T06:40:34.908 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_ppp.ko 2024-04-04T06:40:34.908 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/llc 2024-04-04T06:40:34.908 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/llc/llc.ko 2024-04-04T06:40:34.908 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/mac802154 2024-04-04T06:40:34.908 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/mac802154/mac802154.ko 2024-04-04T06:40:34.908 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/mpls 2024-04-04T06:40:34.908 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/mpls/mpls_gso.ko 2024-04-04T06:40:34.908 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter 2024-04-04T06:40:34.908 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset 2024-04-04T06:40:34.908 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set.ko 2024-04-04T06:40:34.908 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-04-04T06:40:34.908 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-04-04T06:40:34.909 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-04-04T06:40:34.909 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-04-04T06:40:34.909 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-04-04T06:40:34.909 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-04-04T06:40:34.909 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-04-04T06:40:34.909 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-04-04T06:40:34.909 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-04-04T06:40:34.909 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-04-04T06:40:34.909 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-04-04T06:40:34.909 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-04-04T06:40:34.909 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-04-04T06:40:34.909 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-04-04T06:40:34.909 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-04-04T06:40:34.909 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs 2024-04-04T06:40:34.910 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs.ko 2024-04-04T06:40:34.910 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-04-04T06:40:34.910 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-04-04T06:40:34.910 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-04-04T06:40:34.910 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-04-04T06:40:34.910 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-04-04T06:40:34.910 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-04-04T06:40:34.910 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-04-04T06:40:34.910 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-04-04T06:40:34.910 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-04-04T06:40:34.910 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-04-04T06:40:34.910 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-04-04T06:40:34.910 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-04-04T06:40:34.910 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-04-04T06:40:34.910 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conncount.ko 2024-04-04T06:40:34.911 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack.ko 2024-04-04T06:40:34.911 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-04-04T06:40:34.911 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-04-04T06:40:34.911 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-04-04T06:40:34.911 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_h323.ko 2024-04-04T06:40:34.911 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_irc.ko 2024-04-04T06:40:34.911 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-04-04T06:40:34.911 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-04-04T06:40:34.911 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-04-04T06:40:34.911 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_sane.ko 2024-04-04T06:40:34.911 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_sip.ko 2024-04-04T06:40:34.911 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-04-04T06:40:34.911 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-04-04T06:40:34.911 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_dup_netdev.ko 2024-04-04T06:40:34.912 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_flow_table.ko 2024-04-04T06:40:34.912 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_flow_table_inet.ko 2024-04-04T06:40:34.912 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_log_syslog.ko 2024-04-04T06:40:34.912 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_nat.ko 2024-04-04T06:40:34.912 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_nat_amanda.ko 2024-04-04T06:40:34.912 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_nat_ftp.ko 2024-04-04T06:40:34.912 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_nat_irc.ko 2024-04-04T06:40:34.912 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_nat_sip.ko 2024-04-04T06:40:34.912 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_nat_tftp.ko 2024-04-04T06:40:34.912 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_synproxy_core.ko 2024-04-04T06:40:34.912 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_tables.ko 2024-04-04T06:40:34.912 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nfnetlink.ko 2024-04-04T06:40:34.912 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nfnetlink_acct.ko 2024-04-04T06:40:34.912 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nfnetlink_log.ko 2024-04-04T06:40:34.913 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nfnetlink_osf.ko 2024-04-04T06:40:34.913 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nfnetlink_queue.ko 2024-04-04T06:40:34.913 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_chain_nat.ko 2024-04-04T06:40:34.913 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_compat.ko 2024-04-04T06:40:34.913 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_ct.ko 2024-04-04T06:40:34.913 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_dup_netdev.ko 2024-04-04T06:40:34.913 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_fib.ko 2024-04-04T06:40:34.913 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_fwd_netdev.ko 2024-04-04T06:40:34.913 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_hash.ko 2024-04-04T06:40:34.913 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_limit.ko 2024-04-04T06:40:34.913 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_log.ko 2024-04-04T06:40:34.913 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_masq.ko 2024-04-04T06:40:34.913 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_nat.ko 2024-04-04T06:40:34.913 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_numgen.ko 2024-04-04T06:40:34.913 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_queue.ko 2024-04-04T06:40:34.914 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_quota.ko 2024-04-04T06:40:34.914 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_redir.ko 2024-04-04T06:40:34.914 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_reject.ko 2024-04-04T06:40:34.914 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_reject_inet.ko 2024-04-04T06:40:34.914 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_socket.ko 2024-04-04T06:40:34.914 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_tunnel.ko 2024-04-04T06:40:34.914 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_AUDIT.ko 2024-04-04T06:40:34.914 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_CHECKSUM.ko 2024-04-04T06:40:34.914 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_CLASSIFY.ko 2024-04-04T06:40:34.914 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-04-04T06:40:34.914 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_CT.ko 2024-04-04T06:40:34.914 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_DSCP.ko 2024-04-04T06:40:34.914 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_HL.ko 2024-04-04T06:40:34.915 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_HMARK.ko 2024-04-04T06:40:34.915 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_IDLETIMER.ko 2024-04-04T06:40:34.915 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_LED.ko 2024-04-04T06:40:34.915 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_LOG.ko 2024-04-04T06:40:34.915 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_MASQUERADE.ko 2024-04-04T06:40:34.915 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_NETMAP.ko 2024-04-04T06:40:34.915 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_NFLOG.ko 2024-04-04T06:40:34.915 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_NFQUEUE.ko 2024-04-04T06:40:34.915 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_RATEEST.ko 2024-04-04T06:40:34.915 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_REDIRECT.ko 2024-04-04T06:40:34.915 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_SECMARK.ko 2024-04-04T06:40:34.915 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_TCPMSS.ko 2024-04-04T06:40:34.915 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-04-04T06:40:34.915 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_TEE.ko 2024-04-04T06:40:34.915 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_TPROXY.ko 2024-04-04T06:40:34.916 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_TRACE.ko 2024-04-04T06:40:34.916 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_addrtype.ko 2024-04-04T06:40:34.916 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_bpf.ko 2024-04-04T06:40:34.916 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_cgroup.ko 2024-04-04T06:40:34.916 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_cluster.ko 2024-04-04T06:40:34.916 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_comment.ko 2024-04-04T06:40:34.916 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_connbytes.ko 2024-04-04T06:40:34.916 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_connlabel.ko 2024-04-04T06:40:34.916 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_connlimit.ko 2024-04-04T06:40:34.916 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_connmark.ko 2024-04-04T06:40:34.916 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_conntrack.ko 2024-04-04T06:40:34.916 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_cpu.ko 2024-04-04T06:40:34.916 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_dccp.ko 2024-04-04T06:40:34.916 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_devgroup.ko 2024-04-04T06:40:34.916 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_dscp.ko 2024-04-04T06:40:34.917 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_ecn.ko 2024-04-04T06:40:34.917 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_esp.ko 2024-04-04T06:40:34.917 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_hashlimit.ko 2024-04-04T06:40:34.917 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_helper.ko 2024-04-04T06:40:34.917 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_hl.ko 2024-04-04T06:40:34.917 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_ipcomp.ko 2024-04-04T06:40:34.917 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_iprange.ko 2024-04-04T06:40:34.917 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_ipvs.ko 2024-04-04T06:40:34.917 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_l2tp.ko 2024-04-04T06:40:34.917 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_length.ko 2024-04-04T06:40:34.917 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_limit.ko 2024-04-04T06:40:34.917 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_mac.ko 2024-04-04T06:40:34.917 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_mark.ko 2024-04-04T06:40:34.917 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_multiport.ko 2024-04-04T06:40:34.918 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_nat.ko 2024-04-04T06:40:34.918 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_nfacct.ko 2024-04-04T06:40:34.918 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_osf.ko 2024-04-04T06:40:34.918 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_owner.ko 2024-04-04T06:40:34.918 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_physdev.ko 2024-04-04T06:40:34.918 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_pkttype.ko 2024-04-04T06:40:34.918 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_policy.ko 2024-04-04T06:40:34.918 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_quota.ko 2024-04-04T06:40:34.918 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_rateest.ko 2024-04-04T06:40:34.918 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_realm.ko 2024-04-04T06:40:34.918 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_recent.ko 2024-04-04T06:40:34.918 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_sctp.ko 2024-04-04T06:40:34.918 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_set.ko 2024-04-04T06:40:34.918 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_socket.ko 2024-04-04T06:40:34.919 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_state.ko 2024-04-04T06:40:34.919 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_statistic.ko 2024-04-04T06:40:34.919 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_string.ko 2024-04-04T06:40:34.919 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_tcpmss.ko 2024-04-04T06:40:34.919 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_time.ko 2024-04-04T06:40:34.919 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_u32.ko 2024-04-04T06:40:34.919 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netlink 2024-04-04T06:40:34.919 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netlink/netlink_diag.ko 2024-04-04T06:40:34.919 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/nsh 2024-04-04T06:40:34.919 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/nsh/nsh.ko 2024-04-04T06:40:34.919 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/openvswitch 2024-04-04T06:40:34.919 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/openvswitch/openvswitch.ko 2024-04-04T06:40:34.919 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/openvswitch/vport-geneve.ko 2024-04-04T06:40:34.919 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/openvswitch/vport-gre.ko 2024-04-04T06:40:34.920 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/openvswitch/vport-vxlan.ko 2024-04-04T06:40:34.920 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/packet 2024-04-04T06:40:34.920 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/packet/af_packet_diag.ko 2024-04-04T06:40:34.920 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/rds 2024-04-04T06:40:34.920 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/rds/rds.ko 2024-04-04T06:40:34.920 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/rds/rds_rdma.ko 2024-04-04T06:40:34.920 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/rds/rds_tcp.ko 2024-04-04T06:40:34.920 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched 2024-04-04T06:40:34.920 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_csum.ko 2024-04-04T06:40:34.920 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_gact.ko 2024-04-04T06:40:34.920 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_mirred.ko 2024-04-04T06:40:34.920 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_nat.ko 2024-04-04T06:40:34.920 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_pedit.ko 2024-04-04T06:40:34.920 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_police.ko 2024-04-04T06:40:34.921 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_simple.ko 2024-04-04T06:40:34.921 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_skbedit.ko 2024-04-04T06:40:34.921 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_vlan.ko 2024-04-04T06:40:34.921 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/cls_basic.ko 2024-04-04T06:40:34.921 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/cls_bpf.ko 2024-04-04T06:40:34.921 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/cls_flow.ko 2024-04-04T06:40:34.921 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/cls_fw.ko 2024-04-04T06:40:34.921 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/cls_route.ko 2024-04-04T06:40:34.921 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/cls_u32.ko 2024-04-04T06:40:34.921 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/em_cmp.ko 2024-04-04T06:40:34.921 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/em_ipset.ko 2024-04-04T06:40:34.921 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/em_meta.ko 2024-04-04T06:40:34.921 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/em_nbyte.ko 2024-04-04T06:40:34.921 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/em_text.ko 2024-04-04T06:40:34.921 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/em_u32.ko 2024-04-04T06:40:34.922 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_choke.ko 2024-04-04T06:40:34.922 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_codel.ko 2024-04-04T06:40:34.922 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_drr.ko 2024-04-04T06:40:34.922 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_fq.ko 2024-04-04T06:40:34.922 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_gred.ko 2024-04-04T06:40:34.922 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_hfsc.ko 2024-04-04T06:40:34.922 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_hhf.ko 2024-04-04T06:40:34.922 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_htb.ko 2024-04-04T06:40:34.922 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_ingress.ko 2024-04-04T06:40:34.922 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_mqprio.ko 2024-04-04T06:40:34.922 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_mqprio_lib.ko 2024-04-04T06:40:34.922 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_multiq.ko 2024-04-04T06:40:34.922 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_netem.ko 2024-04-04T06:40:34.922 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_pie.ko 2024-04-04T06:40:34.923 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_plug.ko 2024-04-04T06:40:34.923 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_prio.ko 2024-04-04T06:40:34.923 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_qfq.ko 2024-04-04T06:40:34.923 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_red.ko 2024-04-04T06:40:34.923 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_sfb.ko 2024-04-04T06:40:34.923 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_sfq.ko 2024-04-04T06:40:34.923 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_tbf.ko 2024-04-04T06:40:34.923 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_teql.ko 2024-04-04T06:40:34.923 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sctp 2024-04-04T06:40:34.923 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sctp/sctp.ko 2024-04-04T06:40:34.923 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sctp/sctp_diag.ko 2024-04-04T06:40:34.923 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc 2024-04-04T06:40:34.923 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc/auth_gss 2024-04-04T06:40:34.923 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-04-04T06:40:34.924 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-04-04T06:40:34.924 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc/sunrpc.ko 2024-04-04T06:40:34.924 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc/xprtrdma 2024-04-04T06:40:34.924 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-04-04T06:40:34.924 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/tipc 2024-04-04T06:40:34.924 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/tipc/diag.ko 2024-04-04T06:40:34.924 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/tipc/tipc.ko 2024-04-04T06:40:34.924 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/unix 2024-04-04T06:40:34.924 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/unix/unix_diag.ko 2024-04-04T06:40:34.924 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/vmw_vsock 2024-04-04T06:40:34.924 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-04-04T06:40:34.924 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-04-04T06:40:34.924 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/vmw_vsock/vsock.ko 2024-04-04T06:40:34.924 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/vmw_vsock/vsock_diag.ko 2024-04-04T06:40:34.924 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/vmw_vsock/vsock_loopback.ko 2024-04-04T06:40:34.925 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/xfrm 2024-04-04T06:40:34.925 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/xfrm/xfrm_ipcomp.ko 2024-04-04T06:40:34.925 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/security 2024-04-04T06:40:34.925 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/security/keys 2024-04-04T06:40:34.925 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/security/keys/encrypted-keys 2024-04-04T06:40:34.925 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-04-04T06:40:34.925 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/security/keys/trusted-keys 2024-04-04T06:40:34.925 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/security/keys/trusted-keys/trusted.ko 2024-04-04T06:40:34.925 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/virt 2024-04-04T06:40:34.925 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/virt/lib 2024-04-04T06:40:34.925 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/virt/lib/irqbypass.ko 2024-04-04T06:40:34.925 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.alias 2024-04-04T06:40:34.925 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.alias.bin 2024-04-04T06:40:34.925 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.builtin 2024-04-04T06:40:34.926 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.builtin.alias.bin 2024-04-04T06:40:34.926 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.builtin.bin 2024-04-04T06:40:34.926 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.builtin.modinfo 2024-04-04T06:40:34.926 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.dep 2024-04-04T06:40:34.926 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.dep.bin 2024-04-04T06:40:34.926 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.devname 2024-04-04T06:40:34.926 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.order 2024-04-04T06:40:34.926 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.softdep 2024-04-04T06:40:34.926 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.symbols 2024-04-04T06:40:34.926 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.symbols.bin 2024-04-04T06:40:34.926 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.8.0-g1df0c7e8a235/vmlinuz 2024-04-04T06:40:34.930 DEBUG:teuthology.task.kernel:get_image_version: 6.8.0-g1df0c7e8a235 2024-04-04T06:40:34.931 DEBUG:teuthology.orchestra.run.smithi117:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-04-04T06:40:34.953 INFO:teuthology.orchestra.run.smithi117.stdout:postinstall scriptlet (using /bin/sh): 2024-04-04T06:40:34.953 INFO:teuthology.orchestra.run.smithi117.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-04-04T06:40:34.953 INFO:teuthology.orchestra.run.smithi117.stdout: /usr/bin/kernel-install add 6.8.0-g1df0c7e8a235 /lib/modules/6.8.0-g1df0c7e8a235/vmlinuz 2024-04-04T06:40:34.953 INFO:teuthology.orchestra.run.smithi117.stdout:fi 2024-04-04T06:40:34.953 INFO:teuthology.orchestra.run.smithi117.stdout:for file in vmlinuz System.map config; do 2024-04-04T06:40:34.953 INFO:teuthology.orchestra.run.smithi117.stdout: if ! cmp --silent "/lib/modules/6.8.0-g1df0c7e8a235/${file}" "/boot/${file}-6.8.0-g1df0c7e8a235"; then 2024-04-04T06:40:34.954 INFO:teuthology.orchestra.run.smithi117.stdout: cp "/lib/modules/6.8.0-g1df0c7e8a235/${file}" "/boot/${file}-6.8.0-g1df0c7e8a235" 2024-04-04T06:40:34.954 INFO:teuthology.orchestra.run.smithi117.stdout: fi 2024-04-04T06:40:34.954 INFO:teuthology.orchestra.run.smithi117.stdout:done 2024-04-04T06:40:34.954 INFO:teuthology.orchestra.run.smithi117.stdout:preuninstall scriptlet (using /bin/sh): 2024-04-04T06:40:34.954 INFO:teuthology.orchestra.run.smithi117.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2024-04-04T06:40:34.954 INFO:teuthology.orchestra.run.smithi117.stdout:new-kernel-pkg --remove 6.8.0-g1df0c7e8a235 --rminitrd --initrdfile=/boot/initramfs-6.8.0-g1df0c7e8a235.img 2024-04-04T06:40:34.954 INFO:teuthology.orchestra.run.smithi117.stdout:elif [ -x /usr/bin/kernel-install ]; then 2024-04-04T06:40:34.954 INFO:teuthology.orchestra.run.smithi117.stdout:kernel-install remove 6.8.0-g1df0c7e8a235 2024-04-04T06:40:34.954 INFO:teuthology.orchestra.run.smithi117.stdout:fi 2024-04-04T06:40:34.954 INFO:teuthology.orchestra.run.smithi117.stdout:postuninstall scriptlet (using /bin/sh): 2024-04-04T06:40:34.954 INFO:teuthology.orchestra.run.smithi117.stdout:if [ -x /sbin/update-bootloader ]; then 2024-04-04T06:40:34.954 INFO:teuthology.orchestra.run.smithi117.stdout:/sbin/update-bootloader --remove 6.8.0-g1df0c7e8a235 2024-04-04T06:40:34.954 INFO:teuthology.orchestra.run.smithi117.stdout:fi 2024-04-04T06:40:34.957 DEBUG:teuthology.orchestra.run.smithi117:> sudo rpm -qi grub2-tools 2024-04-04T06:40:35.034 INFO:teuthology.orchestra.run.smithi117.stdout:Name : grub2-tools 2024-04-04T06:40:35.035 INFO:teuthology.orchestra.run.smithi117.stdout:Epoch : 1 2024-04-04T06:40:35.035 INFO:teuthology.orchestra.run.smithi117.stdout:Version : 2.06 2024-04-04T06:40:35.035 INFO:teuthology.orchestra.run.smithi117.stdout:Release : 68.el9 2024-04-04T06:40:35.035 INFO:teuthology.orchestra.run.smithi117.stdout:Architecture: x86_64 2024-04-04T06:40:35.035 INFO:teuthology.orchestra.run.smithi117.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-04-04T06:40:35.035 INFO:teuthology.orchestra.run.smithi117.stdout:Group : Unspecified 2024-04-04T06:40:35.035 INFO:teuthology.orchestra.run.smithi117.stdout:Size : 8264254 2024-04-04T06:40:35.035 INFO:teuthology.orchestra.run.smithi117.stdout:License : GPLv3+ 2024-04-04T06:40:35.035 INFO:teuthology.orchestra.run.smithi117.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-04-04T06:40:35.035 INFO:teuthology.orchestra.run.smithi117.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-04-04T06:40:35.035 INFO:teuthology.orchestra.run.smithi117.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-04-04T06:40:35.035 INFO:teuthology.orchestra.run.smithi117.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-04-04T06:40:35.036 INFO:teuthology.orchestra.run.smithi117.stdout:Packager : builder@centos.org 2024-04-04T06:40:35.036 INFO:teuthology.orchestra.run.smithi117.stdout:Vendor : CentOS 2024-04-04T06:40:35.036 INFO:teuthology.orchestra.run.smithi117.stdout:URL : http://www.gnu.org/software/grub/ 2024-04-04T06:40:35.036 INFO:teuthology.orchestra.run.smithi117.stdout:Summary : Support tools for GRUB. 2024-04-04T06:40:35.036 INFO:teuthology.orchestra.run.smithi117.stdout:Description : 2024-04-04T06:40:35.036 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-04T06:40:35.036 INFO:teuthology.orchestra.run.smithi117.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-04-04T06:40:35.036 INFO:teuthology.orchestra.run.smithi117.stdout:customizable bootloader with modular architecture. It supports a rich 2024-04-04T06:40:35.036 INFO:teuthology.orchestra.run.smithi117.stdout:variety of kernel formats, file systems, computer architectures and 2024-04-04T06:40:35.036 INFO:teuthology.orchestra.run.smithi117.stdout:hardware devices. 2024-04-04T06:40:35.036 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-04T06:40:35.036 INFO:teuthology.orchestra.run.smithi117.stdout:This subpackage provides tools for support of all platforms. 2024-04-04T06:40:35.037 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-04-04T06:40:35.037 INFO:teuthology.task.kernel:Updating grub on smithi117 to boot 6.8.0-g1df0c7e8a235 2024-04-04T06:40:35.038 DEBUG:teuthology.orchestra.run.smithi117:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-04-04T06:40:35.618 INFO:teuthology.orchestra.run.smithi117.stderr:Generating grub configuration file ... 2024-04-04T06:40:36.951 INFO:teuthology.orchestra.run.smithi117.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-04-04T06:40:37.004 INFO:teuthology.orchestra.run.smithi117.stderr:done 2024-04-04T06:40:37.006 DEBUG:teuthology.orchestra.run.smithi117:> mktemp 2024-04-04T06:40:37.021 INFO:teuthology.orchestra.run.smithi117.stdout:/tmp/tmp.QHocV49nRS 2024-04-04T06:40:37.021 DEBUG:teuthology.orchestra.run.smithi117:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.QHocV49nRS 2024-04-04T06:40:37.092 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod 0666 /tmp/tmp.QHocV49nRS 2024-04-04T06:40:37.232 DEBUG:teuthology.orchestra.remote:smithi117:/tmp/tmp.QHocV49nRS is 6KB 2024-04-04T06:40:37.280 DEBUG:teuthology.orchestra.run.smithi117:> rm -fr /tmp/tmp.QHocV49nRS 2024-04-04T06:40:37.294 DEBUG:teuthology.orchestra.run.smithi117:> sudo /bin/ls /boot/loader/entries || true 2024-04-04T06:40:37.358 INFO:teuthology.orchestra.run.smithi117.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-04-04T06:40:37.358 INFO:teuthology.orchestra.run.smithi117.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-04-04T06:40:37.358 INFO:teuthology.orchestra.run.smithi117.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-04-04T06:40:37.358 INFO:teuthology.orchestra.run.smithi117.stdout:15949e3c88704300882482eddfd7baae-6.8.0-g1df0c7e8a235.conf 2024-04-04T06:40:37.360 DEBUG:teuthology.orchestra.run.smithi117:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-6.8.0-g1df0c7e8a235 2024-04-04T06:40:37.513 DEBUG:teuthology.orchestra.run.smithi117:> sudo shutdown -r now 2024-04-04T06:41:07.517 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-04-04T06:41:07.517 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi117.front.sepia.ceph.com' 2024-04-04T06:41:07.518 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-04T06:41:42.174 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.117 2024-04-04T06:41:51.175 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi117.front.sepia.ceph.com' 2024-04-04T06:41:51.176 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-04T06:42:07.106 INFO:teuthology.orchestra.run.smithi072.stdout:Extra Packages for Enterprise Linux 107 kB/s | 21 MB 03:19 2024-04-04T06:42:09.566 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.117 2024-04-04T06:42:12.071 INFO:teuthology.orchestra.run.smithi072.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-04-04T06:42:14.428 INFO:teuthology.orchestra.run.smithi072.stdout:Dependencies resolved. 2024-04-04T06:42:14.443 INFO:teuthology.orchestra.run.smithi072.stdout:================================================================================ 2024-04-04T06:42:14.443 INFO:teuthology.orchestra.run.smithi072.stdout: Package Arch Version Repository Size 2024-04-04T06:42:14.443 INFO:teuthology.orchestra.run.smithi072.stdout:================================================================================ 2024-04-04T06:42:14.443 INFO:teuthology.orchestra.run.smithi072.stdout:Upgrading: 2024-04-04T06:42:14.443 INFO:teuthology.orchestra.run.smithi072.stdout: linux-firmware noarch 20240219-143.el9 CentOS-BaseOS 375 M 2024-04-04T06:42:14.443 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T06:42:14.443 INFO:teuthology.orchestra.run.smithi072.stdout:Transaction Summary 2024-04-04T06:42:14.443 INFO:teuthology.orchestra.run.smithi072.stdout:================================================================================ 2024-04-04T06:42:14.443 INFO:teuthology.orchestra.run.smithi072.stdout:Upgrade 1 Package 2024-04-04T06:42:14.443 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T06:42:14.444 INFO:teuthology.orchestra.run.smithi072.stdout:Total download size: 375 M 2024-04-04T06:42:14.444 INFO:teuthology.orchestra.run.smithi072.stdout:Downloading Packages: 2024-04-04T06:42:21.567 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi117.front.sepia.ceph.com' 2024-04-04T06:42:21.568 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-04T06:42:23.890 INFO:teuthology.orchestra.run.smithi072.stdout:linux-firmware-20240219-143.el9.noarch.rpm 40 MB/s | 375 MB 00:09 2024-04-04T06:42:23.891 INFO:teuthology.orchestra.run.smithi072.stdout:-------------------------------------------------------------------------------- 2024-04-04T06:42:23.892 INFO:teuthology.orchestra.run.smithi072.stdout:Total 40 MB/s | 375 MB 00:09 2024-04-04T06:42:23.892 INFO:teuthology.orchestra.run.smithi072.stdout:Running transaction check 2024-04-04T06:42:23.991 INFO:teuthology.orchestra.run.smithi072.stdout:Transaction check succeeded. 2024-04-04T06:42:23.991 INFO:teuthology.orchestra.run.smithi072.stdout:Running transaction test 2024-04-04T06:42:24.645 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.117 2024-04-04T06:42:26.406 INFO:teuthology.orchestra.run.smithi072.stdout:Transaction test succeeded. 2024-04-04T06:42:26.407 INFO:teuthology.orchestra.run.smithi072.stdout:Running transaction 2024-04-04T06:42:34.248 INFO:teuthology.orchestra.run.smithi072.stdout: Preparing : 1/1 2024-04-04T06:42:34.506 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : linux-firmware-20240219-143.el9.noarch 1/2 2024-04-04T06:42:34.603 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : linux-firmware-20230814-139.el9.noarch 2/2 2024-04-04T06:42:36.608 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: linux-firmware-20230814-139.el9.noarch 2/2 2024-04-04T06:42:36.608 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : linux-firmware-20240219-143.el9.noarch 1/2 2024-04-04T06:42:37.005 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : linux-firmware-20230814-139.el9.noarch 2/2 2024-04-04T06:42:37.005 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T06:42:37.005 INFO:teuthology.orchestra.run.smithi072.stdout:Upgraded: 2024-04-04T06:42:37.005 INFO:teuthology.orchestra.run.smithi072.stdout: linux-firmware-20240219-143.el9.noarch 2024-04-04T06:42:37.005 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T06:42:37.005 INFO:teuthology.orchestra.run.smithi072.stdout:Complete! 2024-04-04T06:42:37.354 INFO:teuthology.task.kernel:Downloading kernel 1df0c7e8a2354c42d738e5454ba83ea7332deac2 on mon.a... 2024-04-04T06:42:37.355 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1df0c7e8a2354c42d738e5454ba83ea7332deac2 2024-04-04T06:42:37.505 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/1df0c7e8a2354c42d738e5454ba83ea7332deac2/centos/9/flavors/default/x86_64/ 2024-04-04T06:42:37.505 DEBUG:teuthology.orchestra.run.smithi072:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.8.0_g1df0c7e8a235-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://3.chacra.ceph.com/r/kernel/testing/1df0c7e8a2354c42d738e5454ba83ea7332deac2/centos/9/flavors/default/x86_64/ --input-file=- 2024-04-04T06:42:37.507 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi072.front.sepia.ceph.com to complete... 2024-04-04T06:42:39.646 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi117.front.sepia.ceph.com' 2024-04-04T06:42:39.647 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-04T06:42:40.084 DEBUG:teuthology.orchestra.run.smithi117:> true 2024-04-04T06:42:40.878 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi117.front.sepia.ceph.com' 2024-04-04T06:42:40.878 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.8.0-g1df0c7e8a235"... 2024-04-04T06:42:40.878 DEBUG:teuthology.orchestra.run.smithi117:> uname -r 2024-04-04T06:42:40.957 INFO:teuthology.orchestra.run.smithi117.stdout:6.8.0-g1df0c7e8a235 2024-04-04T06:42:40.957 DEBUG:teuthology.task.kernel:current kernel version is 6.8.0-g1df0c7e8a235 vs 6.8.0-g1df0c7e8a235 2024-04-04T06:42:40.958 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-04T06:42:40.958 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-04-04T06:42:41.959 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-04-04T06:42:41.959 DEBUG:teuthology.orchestra.run.smithi117:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-04T06:42:42.113 INFO:teuthology.orchestra.run.smithi117.stdout:ttyS1 2024-04-04T06:42:42.156 DEBUG:teuthology.parallel:result is None 2024-04-04T06:42:48.934 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04 06:42:48 URL:https://3.chacra.ceph.com/r/kernel/testing/1df0c7e8a2354c42d738e5454ba83ea7332deac2/centos/9/flavors/default/x86_64/kernel-6.8.0_g1df0c7e8a235-1.x86_64.rpm [336317861/336317861] -> "/tmp/kernel.x86_64.rpm" [1] 2024-04-04T06:42:48.934 INFO:teuthology.orchestra.run.smithi072.stderr:FINISHED --2024-04-04 06:42:48-- 2024-04-04T06:42:48.934 INFO:teuthology.orchestra.run.smithi072.stderr:Total wall clock time: 11s 2024-04-04T06:42:48.934 INFO:teuthology.orchestra.run.smithi072.stderr:Downloaded: 1 files, 321M in 11s (28.9 MB/s) 2024-04-04T06:42:48.937 INFO:teuthology.task.kernel:Installing kernel 1df0c7e8a2354c42d738e5454ba83ea7332deac2 on mon.a... 2024-04-04T06:42:48.937 DEBUG:teuthology.orchestra.run.smithi072:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-04-04T06:42:50.864 INFO:teuthology.orchestra.run.smithi072.stdout:Verifying... ######################################## 2024-04-04T06:42:50.934 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing... ######################################## 2024-04-04T06:42:51.014 INFO:teuthology.orchestra.run.smithi072.stdout:Updating / installing... 2024-04-04T06:42:58.511 INFO:teuthology.orchestra.run.smithi072.stdout:kernel-6.8.0_g1df0c7e8a235-1 ######################################## 2024-04-04T06:43:28.975 INFO:teuthology.orchestra.run.smithi072.stderr:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-04-04T06:43:53.019 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi072.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-04-04T06:43:53.020 DEBUG:teuthology.orchestra.run.smithi072:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-04-04T06:43:53.104 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235 2024-04-04T06:43:53.104 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/System.map 2024-04-04T06:43:53.104 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/config 2024-04-04T06:43:53.104 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel 2024-04-04T06:43:53.104 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch 2024-04-04T06:43:53.104 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86 2024-04-04T06:43:53.105 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto 2024-04-04T06:43:53.105 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-04-04T06:43:53.105 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-04-04T06:43:53.105 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-04-04T06:43:53.105 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-04-04T06:43:53.105 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-04-04T06:43:53.105 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-04-04T06:43:53.105 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-04-04T06:43:53.105 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/crc32c-intel.ko 2024-04-04T06:43:53.105 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-04-04T06:43:53.105 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-04-04T06:43:53.105 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-04-04T06:43:53.105 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-04-04T06:43:53.106 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/serpent-avx2.ko 2024-04-04T06:43:53.106 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-04-04T06:43:53.106 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-04-04T06:43:53.106 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-04-04T06:43:53.106 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-04-04T06:43:53.106 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-04-04T06:43:53.106 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-04-04T06:43:53.106 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-04-04T06:43:53.106 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kernel 2024-04-04T06:43:53.106 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kernel/cpu 2024-04-04T06:43:53.106 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kernel/cpu/mce 2024-04-04T06:43:53.106 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-04-04T06:43:53.106 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kvm 2024-04-04T06:43:53.107 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kvm/kvm-amd.ko 2024-04-04T06:43:53.107 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kvm/kvm-intel.ko 2024-04-04T06:43:53.107 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kvm/kvm.ko 2024-04-04T06:43:53.107 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto 2024-04-04T06:43:53.107 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/ansi_cprng.ko 2024-04-04T06:43:53.107 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/anubis.ko 2024-04-04T06:43:53.107 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/arc4.ko 2024-04-04T06:43:53.107 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx 2024-04-04T06:43:53.107 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx/async_memcpy.ko 2024-04-04T06:43:53.107 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx/async_pq.ko 2024-04-04T06:43:53.107 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx/async_raid6_recov.ko 2024-04-04T06:43:53.107 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx/async_tx.ko 2024-04-04T06:43:53.107 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx/async_xor.ko 2024-04-04T06:43:53.108 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx/raid6test.ko 2024-04-04T06:43:53.108 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/authenc.ko 2024-04-04T06:43:53.108 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/authencesn.ko 2024-04-04T06:43:53.108 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/blake2b_generic.ko 2024-04-04T06:43:53.108 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/blowfish_common.ko 2024-04-04T06:43:53.108 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/blowfish_generic.ko 2024-04-04T06:43:53.108 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/camellia_generic.ko 2024-04-04T06:43:53.108 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/cast5_generic.ko 2024-04-04T06:43:53.108 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/cast6_generic.ko 2024-04-04T06:43:53.108 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/cast_common.ko 2024-04-04T06:43:53.108 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/ccm.ko 2024-04-04T06:43:53.108 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/cmac.ko 2024-04-04T06:43:53.108 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/crc32_generic.ko 2024-04-04T06:43:53.108 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/crypto_engine.ko 2024-04-04T06:43:53.109 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/crypto_user.ko 2024-04-04T06:43:53.109 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/cts.ko 2024-04-04T06:43:53.109 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/des_generic.ko 2024-04-04T06:43:53.109 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/dh_generic.ko 2024-04-04T06:43:53.109 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/echainiv.ko 2024-04-04T06:43:53.109 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/essiv.ko 2024-04-04T06:43:53.109 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/fcrypt.ko 2024-04-04T06:43:53.109 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/khazad.ko 2024-04-04T06:43:53.109 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/lz4.ko 2024-04-04T06:43:53.109 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/lz4hc.ko 2024-04-04T06:43:53.109 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/md4.ko 2024-04-04T06:43:53.109 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/michael_mic.ko 2024-04-04T06:43:53.109 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/pcbc.ko 2024-04-04T06:43:53.109 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/pcrypt.ko 2024-04-04T06:43:53.110 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/rmd160.ko 2024-04-04T06:43:53.110 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/seed.ko 2024-04-04T06:43:53.110 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/serpent_generic.ko 2024-04-04T06:43:53.110 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/tcrypt.ko 2024-04-04T06:43:53.110 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/tea.ko 2024-04-04T06:43:53.110 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/twofish_common.ko 2024-04-04T06:43:53.110 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/twofish_generic.ko 2024-04-04T06:43:53.110 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/vmac.ko 2024-04-04T06:43:53.110 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/wp512.ko 2024-04-04T06:43:53.111 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/xcbc.ko 2024-04-04T06:43:53.111 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/xor.ko 2024-04-04T06:43:53.111 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/xxhash_generic.ko 2024-04-04T06:43:53.111 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers 2024-04-04T06:43:53.111 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi 2024-04-04T06:43:53.111 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/acpi_ipmi.ko 2024-04-04T06:43:53.111 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/acpi_pad.ko 2024-04-04T06:43:53.111 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/custom_method.ko 2024-04-04T06:43:53.111 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/ec_sys.ko 2024-04-04T06:43:53.111 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/platform_profile.ko 2024-04-04T06:43:53.111 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/sbs.ko 2024-04-04T06:43:53.111 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/sbshc.ko 2024-04-04T06:43:53.111 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/video.ko 2024-04-04T06:43:53.111 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata 2024-04-04T06:43:53.112 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/acard-ahci.ko 2024-04-04T06:43:53.112 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/ahci_platform.ko 2024-04-04T06:43:53.112 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/ata_generic.ko 2024-04-04T06:43:53.112 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/libahci_platform.ko 2024-04-04T06:43:53.112 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_acpi.ko 2024-04-04T06:43:53.112 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_ali.ko 2024-04-04T06:43:53.112 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_amd.ko 2024-04-04T06:43:53.112 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_artop.ko 2024-04-04T06:43:53.112 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_atiixp.ko 2024-04-04T06:43:53.112 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_atp867x.ko 2024-04-04T06:43:53.112 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_cmd640.ko 2024-04-04T06:43:53.112 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_cmd64x.ko 2024-04-04T06:43:53.112 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_cypress.ko 2024-04-04T06:43:53.112 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_efar.ko 2024-04-04T06:43:53.112 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_hpt366.ko 2024-04-04T06:43:53.113 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_hpt37x.ko 2024-04-04T06:43:53.113 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_hpt3x2n.ko 2024-04-04T06:43:53.113 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_hpt3x3.ko 2024-04-04T06:43:53.113 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_it8213.ko 2024-04-04T06:43:53.113 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_it821x.ko 2024-04-04T06:43:53.113 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_jmicron.ko 2024-04-04T06:43:53.113 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_marvell.ko 2024-04-04T06:43:53.113 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_mpiix.ko 2024-04-04T06:43:53.113 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_netcell.ko 2024-04-04T06:43:53.113 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_ninja32.ko 2024-04-04T06:43:53.113 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_ns87410.ko 2024-04-04T06:43:53.113 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_ns87415.ko 2024-04-04T06:43:53.113 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_oldpiix.ko 2024-04-04T06:43:53.113 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_opti.ko 2024-04-04T06:43:53.113 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_optidma.ko 2024-04-04T06:43:53.114 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_pcmcia.ko 2024-04-04T06:43:53.114 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_pdc2027x.ko 2024-04-04T06:43:53.114 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-04-04T06:43:53.114 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_piccolo.ko 2024-04-04T06:43:53.114 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_rdc.ko 2024-04-04T06:43:53.114 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_sch.ko 2024-04-04T06:43:53.114 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_serverworks.ko 2024-04-04T06:43:53.114 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_sil680.ko 2024-04-04T06:43:53.114 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_sis.ko 2024-04-04T06:43:53.114 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_sl82c105.ko 2024-04-04T06:43:53.114 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_triflex.ko 2024-04-04T06:43:53.114 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_via.ko 2024-04-04T06:43:53.114 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pdc_adma.ko 2024-04-04T06:43:53.115 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_inic162x.ko 2024-04-04T06:43:53.115 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_mv.ko 2024-04-04T06:43:53.115 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_nv.ko 2024-04-04T06:43:53.115 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_promise.ko 2024-04-04T06:43:53.115 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_qstor.ko 2024-04-04T06:43:53.115 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_sil.ko 2024-04-04T06:43:53.115 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_sil24.ko 2024-04-04T06:43:53.115 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_sis.ko 2024-04-04T06:43:53.115 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_svw.ko 2024-04-04T06:43:53.115 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_sx4.ko 2024-04-04T06:43:53.115 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_uli.ko 2024-04-04T06:43:53.115 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_via.ko 2024-04-04T06:43:53.115 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_vsc.ko 2024-04-04T06:43:53.115 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/auxdisplay 2024-04-04T06:43:53.116 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/auxdisplay/ks0108.ko 2024-04-04T06:43:53.116 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/base 2024-04-04T06:43:53.116 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/base/regmap 2024-04-04T06:43:53.116 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/base/regmap/regmap-i2c.ko 2024-04-04T06:43:53.116 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/base/regmap/regmap-mmio.ko 2024-04-04T06:43:53.116 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/bcma 2024-04-04T06:43:53.116 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/bcma/bcma.ko 2024-04-04T06:43:53.116 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block 2024-04-04T06:43:53.116 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/aoe 2024-04-04T06:43:53.116 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/aoe/aoe.ko 2024-04-04T06:43:53.116 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/brd.ko 2024-04-04T06:43:53.116 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/drbd 2024-04-04T06:43:53.116 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/drbd/drbd.ko 2024-04-04T06:43:53.116 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/floppy.ko 2024-04-04T06:43:53.117 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/loop.ko 2024-04-04T06:43:53.117 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/mtip32xx 2024-04-04T06:43:53.117 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-04-04T06:43:53.117 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/nbd.ko 2024-04-04T06:43:53.117 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/null_blk 2024-04-04T06:43:53.117 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/null_blk/null_blk.ko 2024-04-04T06:43:53.117 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/pktcdvd.ko 2024-04-04T06:43:53.117 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/rbd.ko 2024-04-04T06:43:53.117 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/virtio_blk.ko 2024-04-04T06:43:53.117 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/xen-blkback 2024-04-04T06:43:53.117 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-04-04T06:43:53.117 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/xen-blkfront.ko 2024-04-04T06:43:53.117 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/zram 2024-04-04T06:43:53.117 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/zram/zram.ko 2024-04-04T06:43:53.117 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char 2024-04-04T06:43:53.118 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hangcheck-timer.ko 2024-04-04T06:43:53.118 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hw_random 2024-04-04T06:43:53.118 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hw_random/amd-rng.ko 2024-04-04T06:43:53.118 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hw_random/intel-rng.ko 2024-04-04T06:43:53.118 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-04-04T06:43:53.118 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hw_random/via-rng.ko 2024-04-04T06:43:53.118 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hw_random/virtio-rng.ko 2024-04-04T06:43:53.118 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi 2024-04-04T06:43:53.118 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-04-04T06:43:53.118 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-04-04T06:43:53.118 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-04-04T06:43:53.118 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi/ipmi_si.ko 2024-04-04T06:43:53.118 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-04-04T06:43:53.118 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-04-04T06:43:53.119 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/lp.ko 2024-04-04T06:43:53.119 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/mwave 2024-04-04T06:43:53.119 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/mwave/mwave.ko 2024-04-04T06:43:53.119 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ppdev.ko 2024-04-04T06:43:53.119 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tlclk.ko 2024-04-04T06:43:53.119 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm 2024-04-04T06:43:53.119 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm/tpm.ko 2024-04-04T06:43:53.119 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm/tpm_atmel.ko 2024-04-04T06:43:53.119 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm/tpm_infineon.ko 2024-04-04T06:43:53.119 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm/tpm_nsc.ko 2024-04-04T06:43:53.119 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm/tpm_tis.ko 2024-04-04T06:43:53.119 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-04-04T06:43:53.119 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/uv_mmtimer.ko 2024-04-04T06:43:53.119 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/virtio_console.ko 2024-04-04T06:43:53.120 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq 2024-04-04T06:43:53.120 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-04-04T06:43:53.120 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-04-04T06:43:53.120 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq/p4-clockmod.ko 2024-04-04T06:43:53.120 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-04-04T06:43:53.120 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq/powernow-k8.ko 2024-04-04T06:43:53.120 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq/speedstep-lib.ko 2024-04-04T06:43:53.120 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto 2024-04-04T06:43:53.120 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/ccp 2024-04-04T06:43:53.120 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-04-04T06:43:53.120 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/ccp/ccp.ko 2024-04-04T06:43:53.120 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/intel 2024-04-04T06:43:53.120 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/intel/qat 2024-04-04T06:43:53.120 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/intel/qat/qat_common 2024-04-04T06:43:53.121 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-04-04T06:43:53.121 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-04-04T06:43:53.121 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-04-04T06:43:53.121 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/padlock-aes.ko 2024-04-04T06:43:53.121 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/padlock-sha.ko 2024-04-04T06:43:53.121 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/virtio 2024-04-04T06:43:53.121 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-04-04T06:43:53.121 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dca 2024-04-04T06:43:53.121 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dca/dca.ko 2024-04-04T06:43:53.121 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/devfreq 2024-04-04T06:43:53.121 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-04-04T06:43:53.121 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dma 2024-04-04T06:43:53.122 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dma/dw 2024-04-04T06:43:53.122 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dma/dw/dw_dmac.ko 2024-04-04T06:43:53.122 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dma/ioat 2024-04-04T06:43:53.122 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dma/ioat/ioatdma.ko 2024-04-04T06:43:53.122 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac 2024-04-04T06:43:53.122 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/amd64_edac.ko 2024-04-04T06:43:53.122 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/e752x_edac.ko 2024-04-04T06:43:53.122 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/edac_mce_amd.ko 2024-04-04T06:43:53.122 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i3000_edac.ko 2024-04-04T06:43:53.122 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i3200_edac.ko 2024-04-04T06:43:53.122 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i5100_edac.ko 2024-04-04T06:43:53.122 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i5400_edac.ko 2024-04-04T06:43:53.122 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i7300_edac.ko 2024-04-04T06:43:53.122 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i7core_edac.ko 2024-04-04T06:43:53.122 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i82975x_edac.ko 2024-04-04T06:43:53.123 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/ie31200_edac.ko 2024-04-04T06:43:53.123 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/sb_edac.ko 2024-04-04T06:43:53.123 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/x38_edac.ko 2024-04-04T06:43:53.123 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/firmware 2024-04-04T06:43:53.123 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/firmware/edd.ko 2024-04-04T06:43:53.123 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/firmware/iscsi_ibft.ko 2024-04-04T06:43:53.123 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/gpio 2024-04-04T06:43:53.123 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/gpio/gpio-ich.ko 2024-04-04T06:43:53.123 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/gpio/gpio-viperboard.ko 2024-04-04T06:43:53.123 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid 2024-04-04T06:43:53.123 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-appleir.ko 2024-04-04T06:43:53.124 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-aureal.ko 2024-04-04T06:43:53.124 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-axff.ko 2024-04-04T06:43:53.124 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-dr.ko 2024-04-04T06:43:53.124 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-elecom.ko 2024-04-04T06:43:53.124 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-elo.ko 2024-04-04T06:43:53.124 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-emsff.ko 2024-04-04T06:43:53.124 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-gaff.ko 2024-04-04T06:43:53.124 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-gt683r.ko 2024-04-04T06:43:53.124 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-gyration.ko 2024-04-04T06:43:53.124 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-holtek-kbd.ko 2024-04-04T06:43:53.124 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-holtek-mouse.ko 2024-04-04T06:43:53.124 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-holtekff.ko 2024-04-04T06:43:53.124 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-hyperv.ko 2024-04-04T06:43:53.124 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-icade.ko 2024-04-04T06:43:53.124 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-keytouch.ko 2024-04-04T06:43:53.125 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-kye.ko 2024-04-04T06:43:53.125 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-lcpower.ko 2024-04-04T06:43:53.125 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-led.ko 2024-04-04T06:43:53.125 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-lenovo.ko 2024-04-04T06:43:53.125 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-logitech-dj.ko 2024-04-04T06:43:53.125 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-04-04T06:43:53.125 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-multitouch.ko 2024-04-04T06:43:53.125 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-ortek.ko 2024-04-04T06:43:53.125 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-penmount.ko 2024-04-04T06:43:53.125 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-petalynx.ko 2024-04-04T06:43:53.125 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-picolcd.ko 2024-04-04T06:43:53.125 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-pl.ko 2024-04-04T06:43:53.125 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-plantronics.ko 2024-04-04T06:43:53.125 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-primax.ko 2024-04-04T06:43:53.126 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-rmi.ko 2024-04-04T06:43:53.126 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-arvo.ko 2024-04-04T06:43:53.126 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-common.ko 2024-04-04T06:43:53.126 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-isku.ko 2024-04-04T06:43:53.126 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-kone.ko 2024-04-04T06:43:53.126 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-04-04T06:43:53.126 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-konepure.ko 2024-04-04T06:43:53.126 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-04-04T06:43:53.126 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-lua.ko 2024-04-04T06:43:53.126 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-pyra.ko 2024-04-04T06:43:53.126 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-ryos.ko 2024-04-04T06:43:53.126 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-savu.ko 2024-04-04T06:43:53.126 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat.ko 2024-04-04T06:43:53.126 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-saitek.ko 2024-04-04T06:43:53.126 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-samsung.ko 2024-04-04T06:43:53.127 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-sensor-hub.ko 2024-04-04T06:43:53.127 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-sjoy.ko 2024-04-04T06:43:53.127 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-sony.ko 2024-04-04T06:43:53.127 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-speedlink.ko 2024-04-04T06:43:53.127 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-steelseries.ko 2024-04-04T06:43:53.127 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-sunplus.ko 2024-04-04T06:43:53.127 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-thrustmaster.ko 2024-04-04T06:43:53.127 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-tivo.ko 2024-04-04T06:43:53.127 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-tmff.ko 2024-04-04T06:43:53.127 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-topseed.ko 2024-04-04T06:43:53.127 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-twinhan.ko 2024-04-04T06:43:53.128 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-uclogic.ko 2024-04-04T06:43:53.128 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-waltop.ko 2024-04-04T06:43:53.128 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-wiimote.ko 2024-04-04T06:43:53.128 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-xinmo.ko 2024-04-04T06:43:53.128 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-zpff.ko 2024-04-04T06:43:53.128 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-zydacron.ko 2024-04-04T06:43:53.128 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/uhid.ko 2024-04-04T06:43:53.128 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/wacom.ko 2024-04-04T06:43:53.128 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hv 2024-04-04T06:43:53.128 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hv/hv_balloon.ko 2024-04-04T06:43:53.128 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hv/hv_utils.ko 2024-04-04T06:43:53.128 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hv/hv_vmbus.ko 2024-04-04T06:43:53.128 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon 2024-04-04T06:43:53.128 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/abituguru.ko 2024-04-04T06:43:53.129 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/abituguru3.ko 2024-04-04T06:43:53.129 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/acpi_power_meter.ko 2024-04-04T06:43:53.129 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ad7414.ko 2024-04-04T06:43:53.129 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ad7418.ko 2024-04-04T06:43:53.129 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adc128d818.ko 2024-04-04T06:43:53.129 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adm1025.ko 2024-04-04T06:43:53.129 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adm1026.ko 2024-04-04T06:43:53.129 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adm1029.ko 2024-04-04T06:43:53.129 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adm1031.ko 2024-04-04T06:43:53.129 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adm9240.ko 2024-04-04T06:43:53.129 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ads7828.ko 2024-04-04T06:43:53.129 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adt7410.ko 2024-04-04T06:43:53.129 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adt7411.ko 2024-04-04T06:43:53.129 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adt7462.ko 2024-04-04T06:43:53.130 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adt7470.ko 2024-04-04T06:43:53.130 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adt7475.ko 2024-04-04T06:43:53.130 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adt7x10.ko 2024-04-04T06:43:53.130 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/amc6821.ko 2024-04-04T06:43:53.130 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/applesmc.ko 2024-04-04T06:43:53.130 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/asb100.ko 2024-04-04T06:43:53.130 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/asc7621.ko 2024-04-04T06:43:53.130 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/asus_atk0110.ko 2024-04-04T06:43:53.130 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/atxp1.ko 2024-04-04T06:43:53.130 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/coretemp.ko 2024-04-04T06:43:53.130 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-04-04T06:43:53.130 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/dme1737.ko 2024-04-04T06:43:53.130 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ds1621.ko 2024-04-04T06:43:53.130 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ds620.ko 2024-04-04T06:43:53.131 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/emc1403.ko 2024-04-04T06:43:53.131 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/emc6w201.ko 2024-04-04T06:43:53.131 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/f71805f.ko 2024-04-04T06:43:53.131 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/f71882fg.ko 2024-04-04T06:43:53.131 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/f75375s.ko 2024-04-04T06:43:53.131 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/fam15h_power.ko 2024-04-04T06:43:53.131 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/fschmd.ko 2024-04-04T06:43:53.131 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/g760a.ko 2024-04-04T06:43:53.131 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/g762.ko 2024-04-04T06:43:53.131 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/gl518sm.ko 2024-04-04T06:43:53.131 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/gl520sm.ko 2024-04-04T06:43:53.131 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/hwmon-vid.ko 2024-04-04T06:43:53.131 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/i5500_temp.ko 2024-04-04T06:43:53.131 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/i5k_amb.ko 2024-04-04T06:43:53.131 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ibmaem.ko 2024-04-04T06:43:53.132 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ibmpex.ko 2024-04-04T06:43:53.132 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ina209.ko 2024-04-04T06:43:53.132 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ina2xx.ko 2024-04-04T06:43:53.132 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/it87.ko 2024-04-04T06:43:53.132 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/k10temp.ko 2024-04-04T06:43:53.132 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/k8temp.ko 2024-04-04T06:43:53.132 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lineage-pem.ko 2024-04-04T06:43:53.132 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm63.ko 2024-04-04T06:43:53.132 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm73.ko 2024-04-04T06:43:53.132 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm75.ko 2024-04-04T06:43:53.132 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm77.ko 2024-04-04T06:43:53.132 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm78.ko 2024-04-04T06:43:53.132 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm80.ko 2024-04-04T06:43:53.132 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm83.ko 2024-04-04T06:43:53.133 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm85.ko 2024-04-04T06:43:53.133 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm87.ko 2024-04-04T06:43:53.133 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm90.ko 2024-04-04T06:43:53.133 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm92.ko 2024-04-04T06:43:53.133 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm93.ko 2024-04-04T06:43:53.133 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm95234.ko 2024-04-04T06:43:53.133 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm95241.ko 2024-04-04T06:43:53.133 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm95245.ko 2024-04-04T06:43:53.133 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc2945.ko 2024-04-04T06:43:53.133 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc4151.ko 2024-04-04T06:43:53.133 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc4215.ko 2024-04-04T06:43:53.133 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc4222.ko 2024-04-04T06:43:53.133 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc4245.ko 2024-04-04T06:43:53.134 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc4260.ko 2024-04-04T06:43:53.134 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc4261.ko 2024-04-04T06:43:53.134 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max16065.ko 2024-04-04T06:43:53.134 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max1619.ko 2024-04-04T06:43:53.134 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max1668.ko 2024-04-04T06:43:53.134 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max197.ko 2024-04-04T06:43:53.134 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max6639.ko 2024-04-04T06:43:53.134 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max6650.ko 2024-04-04T06:43:53.134 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max6697.ko 2024-04-04T06:43:53.134 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/mcp3021.ko 2024-04-04T06:43:53.134 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/nct6683.ko 2024-04-04T06:43:53.134 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/nct6775-core.ko 2024-04-04T06:43:53.134 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/nct6775.ko 2024-04-04T06:43:53.134 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/nct7802.ko 2024-04-04T06:43:53.135 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pc87360.ko 2024-04-04T06:43:53.135 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pc87427.ko 2024-04-04T06:43:53.135 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pcf8591.ko 2024-04-04T06:43:53.135 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus 2024-04-04T06:43:53.135 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-04-04T06:43:53.135 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-04-04T06:43:53.135 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-04-04T06:43:53.135 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/max16064.ko 2024-04-04T06:43:53.135 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/max34440.ko 2024-04-04T06:43:53.135 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/max8688.ko 2024-04-04T06:43:53.135 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-04-04T06:43:53.135 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-04-04T06:43:53.135 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-04-04T06:43:53.135 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-04-04T06:43:53.135 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-04-04T06:43:53.136 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-04-04T06:43:53.136 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/powr1220.ko 2024-04-04T06:43:53.136 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/sch5627.ko 2024-04-04T06:43:53.136 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/sch5636.ko 2024-04-04T06:43:53.136 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/sch56xx-common.ko 2024-04-04T06:43:53.136 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/sht15.ko 2024-04-04T06:43:53.136 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/sht21.ko 2024-04-04T06:43:53.136 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/shtc1.ko 2024-04-04T06:43:53.136 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/sis5595.ko 2024-04-04T06:43:53.136 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/smsc47b397.ko 2024-04-04T06:43:53.136 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/smsc47m1.ko 2024-04-04T06:43:53.136 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/smsc47m192.ko 2024-04-04T06:43:53.136 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/thmc50.ko 2024-04-04T06:43:53.136 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/tmp102.ko 2024-04-04T06:43:53.137 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/tmp103.ko 2024-04-04T06:43:53.137 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/tmp401.ko 2024-04-04T06:43:53.137 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/tmp421.ko 2024-04-04T06:43:53.137 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/via-cputemp.ko 2024-04-04T06:43:53.137 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/via686a.ko 2024-04-04T06:43:53.137 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/vt1211.ko 2024-04-04T06:43:53.137 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/vt8231.ko 2024-04-04T06:43:53.137 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83627ehf.ko 2024-04-04T06:43:53.137 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83627hf.ko 2024-04-04T06:43:53.137 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83781d.ko 2024-04-04T06:43:53.137 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83791d.ko 2024-04-04T06:43:53.137 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83792d.ko 2024-04-04T06:43:53.137 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83793.ko 2024-04-04T06:43:53.137 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83795.ko 2024-04-04T06:43:53.137 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83l785ts.ko 2024-04-04T06:43:53.138 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83l786ng.ko 2024-04-04T06:43:53.138 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c 2024-04-04T06:43:53.138 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/algos 2024-04-04T06:43:53.138 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-04-04T06:43:53.138 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-04-04T06:43:53.138 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses 2024-04-04T06:43:53.138 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-04-04T06:43:53.138 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-04-04T06:43:53.138 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-04-04T06:43:53.138 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-04-04T06:43:53.138 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-04-04T06:43:53.138 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-04-04T06:43:53.138 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-04-04T06:43:53.138 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-04-04T06:43:53.139 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-i801.ko 2024-04-04T06:43:53.139 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-isch.ko 2024-04-04T06:43:53.139 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-04-04T06:43:53.139 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-04-04T06:43:53.139 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-04-04T06:43:53.139 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-parport.ko 2024-04-04T06:43:53.139 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-04-04T06:43:53.139 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-04-04T06:43:53.139 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-04-04T06:43:53.139 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-04-04T06:43:53.139 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-04-04T06:43:53.139 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-04-04T06:43:53.139 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-via.ko 2024-04-04T06:43:53.139 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-04-04T06:43:53.140 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-04-04T06:43:53.140 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/i2c-dev.ko 2024-04-04T06:43:53.140 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/i2c-mux.ko 2024-04-04T06:43:53.140 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-04-04T06:43:53.140 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/i2c-smbus.ko 2024-04-04T06:43:53.140 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/i2c-stub.ko 2024-04-04T06:43:53.140 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband 2024-04-04T06:43:53.140 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core 2024-04-04T06:43:53.140 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/ib_cm.ko 2024-04-04T06:43:53.140 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/ib_core.ko 2024-04-04T06:43:53.140 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/ib_umad.ko 2024-04-04T06:43:53.140 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-04-04T06:43:53.140 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/iw_cm.ko 2024-04-04T06:43:53.140 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/rdma_cm.ko 2024-04-04T06:43:53.141 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-04-04T06:43:53.141 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw 2024-04-04T06:43:53.141 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/cxgb4 2024-04-04T06:43:53.141 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-04-04T06:43:53.141 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/mlx4 2024-04-04T06:43:53.141 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-04-04T06:43:53.141 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/mlx5 2024-04-04T06:43:53.141 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-04-04T06:43:53.141 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/mthca 2024-04-04T06:43:53.141 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-04-04T06:43:53.141 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp 2024-04-04T06:43:53.141 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/ipoib 2024-04-04T06:43:53.141 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-04-04T06:43:53.141 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/iser 2024-04-04T06:43:53.141 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-04-04T06:43:53.142 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/isert 2024-04-04T06:43:53.142 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-04-04T06:43:53.142 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/srp 2024-04-04T06:43:53.142 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-04-04T06:43:53.142 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/srpt 2024-04-04T06:43:53.142 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-04-04T06:43:53.142 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input 2024-04-04T06:43:53.142 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/gameport 2024-04-04T06:43:53.142 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-04-04T06:43:53.142 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/gameport/fm801-gp.ko 2024-04-04T06:43:53.142 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/gameport/gameport.ko 2024-04-04T06:43:53.142 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/joydev.ko 2024-04-04T06:43:53.142 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/keyboard 2024-04-04T06:43:53.142 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/keyboard/gpio_keys.ko 2024-04-04T06:43:53.143 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse 2024-04-04T06:43:53.143 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/appletouch.ko 2024-04-04T06:43:53.143 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/bcm5974.ko 2024-04-04T06:43:53.143 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/cyapatp.ko 2024-04-04T06:43:53.143 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/elan_i2c.ko 2024-04-04T06:43:53.143 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/sermouse.ko 2024-04-04T06:43:53.143 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-04-04T06:43:53.143 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/synaptics_usb.ko 2024-04-04T06:43:53.143 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/vsxxxaa.ko 2024-04-04T06:43:53.143 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/rmi4 2024-04-04T06:43:53.143 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/rmi4/rmi_core.ko 2024-04-04T06:43:53.143 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/serio 2024-04-04T06:43:53.143 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/serio/altera_ps2.ko 2024-04-04T06:43:53.143 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/serio/arc_ps2.ko 2024-04-04T06:43:53.143 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-04-04T06:43:53.144 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/serio/serio_raw.ko 2024-04-04T06:43:53.144 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/sparse-keymap.ko 2024-04-04T06:43:53.144 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds 2024-04-04T06:43:53.144 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/leds-blinkm.ko 2024-04-04T06:43:53.144 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/leds-lm3530.ko 2024-04-04T06:43:53.144 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/leds-lp3944.ko 2024-04-04T06:43:53.144 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/leds-ss4200.ko 2024-04-04T06:43:53.144 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger 2024-04-04T06:43:53.144 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-04-04T06:43:53.144 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-04-04T06:43:53.144 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-04-04T06:43:53.144 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-04-04T06:43:53.144 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-04-04T06:43:53.144 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-04-04T06:43:53.145 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-04-04T06:43:53.145 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-04-04T06:43:53.145 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-04-04T06:43:53.145 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md 2024-04-04T06:43:53.145 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/bcache 2024-04-04T06:43:53.145 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/bcache/bcache.ko 2024-04-04T06:43:53.145 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-bio-prison.ko 2024-04-04T06:43:53.145 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-cache-smq.ko 2024-04-04T06:43:53.145 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-cache.ko 2024-04-04T06:43:53.145 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-crypt.ko 2024-04-04T06:43:53.145 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-delay.ko 2024-04-04T06:43:53.145 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-flakey.ko 2024-04-04T06:43:53.145 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-log-userspace.ko 2024-04-04T06:43:53.145 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-multipath.ko 2024-04-04T06:43:53.145 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-queue-length.ko 2024-04-04T06:43:53.146 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-raid.ko 2024-04-04T06:43:53.146 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-round-robin.ko 2024-04-04T06:43:53.146 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-service-time.ko 2024-04-04T06:43:53.146 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-switch.ko 2024-04-04T06:43:53.146 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-thin-pool.ko 2024-04-04T06:43:53.146 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-verity.ko 2024-04-04T06:43:53.146 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/persistent-data 2024-04-04T06:43:53.146 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-04-04T06:43:53.146 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/raid0.ko 2024-04-04T06:43:53.146 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/raid1.ko 2024-04-04T06:43:53.146 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/raid10.ko 2024-04-04T06:43:53.146 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/raid456.ko 2024-04-04T06:43:53.146 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message 2024-04-04T06:43:53.146 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion 2024-04-04T06:43:53.147 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptbase.ko 2024-04-04T06:43:53.147 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptctl.ko 2024-04-04T06:43:53.147 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptfc.ko 2024-04-04T06:43:53.147 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptlan.ko 2024-04-04T06:43:53.147 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptsas.ko 2024-04-04T06:43:53.147 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptscsih.ko 2024-04-04T06:43:53.147 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptspi.ko 2024-04-04T06:43:53.147 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd 2024-04-04T06:43:53.147 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/lpc_ich.ko 2024-04-04T06:43:53.147 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/lpc_sch.ko 2024-04-04T06:43:53.147 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/mfd-core.ko 2024-04-04T06:43:53.147 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/sm501.ko 2024-04-04T06:43:53.147 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/viperboard.ko 2024-04-04T06:43:53.147 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/vx855.ko 2024-04-04T06:43:53.147 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/wl1273-core.ko 2024-04-04T06:43:53.148 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc 2024-04-04T06:43:53.148 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/altera-stapl 2024-04-04T06:43:53.148 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-04-04T06:43:53.148 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/apds9802als.ko 2024-04-04T06:43:53.148 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/apds990x.ko 2024-04-04T06:43:53.148 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/bh1770glc.ko 2024-04-04T06:43:53.148 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/cb710 2024-04-04T06:43:53.148 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/cb710/cb710.ko 2024-04-04T06:43:53.148 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/eeprom 2024-04-04T06:43:53.148 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/eeprom/at24.ko 2024-04-04T06:43:53.148 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-04-04T06:43:53.148 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/eeprom/max6875.ko 2024-04-04T06:43:53.148 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/enclosure.ko 2024-04-04T06:43:53.149 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/hpilo.ko 2024-04-04T06:43:53.149 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/isl29003.ko 2024-04-04T06:43:53.149 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/isl29020.ko 2024-04-04T06:43:53.149 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/lis3lv02d 2024-04-04T06:43:53.149 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-04-04T06:43:53.149 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-04-04T06:43:53.149 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/mei 2024-04-04T06:43:53.149 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/mei/mei-me.ko 2024-04-04T06:43:53.149 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/mei/mei-txe.ko 2024-04-04T06:43:53.149 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/mei/mei.ko 2024-04-04T06:43:53.149 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/sgi-gru 2024-04-04T06:43:53.149 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/sgi-gru/gru.ko 2024-04-04T06:43:53.149 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/sgi-xp 2024-04-04T06:43:53.149 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/sgi-xp/xp.ko 2024-04-04T06:43:53.150 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/sgi-xp/xpc.ko 2024-04-04T06:43:53.150 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-04-04T06:43:53.150 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/tifm_7xx1.ko 2024-04-04T06:43:53.150 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/tifm_core.ko 2024-04-04T06:43:53.150 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/tsl2550.ko 2024-04-04T06:43:53.150 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/vmw_balloon.ko 2024-04-04T06:43:53.150 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/vmw_vmci 2024-04-04T06:43:53.150 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-04-04T06:43:53.150 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net 2024-04-04T06:43:53.150 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/bonding 2024-04-04T06:43:53.150 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/bonding/bonding.ko 2024-04-04T06:43:53.150 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa 2024-04-04T06:43:53.150 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa/b53 2024-04-04T06:43:53.150 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa/b53/b53_common.ko 2024-04-04T06:43:53.151 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa/bcm-sf2.ko 2024-04-04T06:43:53.151 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa/mv88e6060.ko 2024-04-04T06:43:53.151 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa/mv88e6xxx 2024-04-04T06:43:53.151 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-04-04T06:43:53.151 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dummy.ko 2024-04-04T06:43:53.151 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/eql.ko 2024-04-04T06:43:53.151 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet 2024-04-04T06:43:53.151 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/3com 2024-04-04T06:43:53.151 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-04-04T06:43:53.151 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-04-04T06:43:53.151 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-04-04T06:43:53.151 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-04-04T06:43:53.151 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/8390 2024-04-04T06:43:53.151 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/8390/8390.ko 2024-04-04T06:43:53.152 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-04-04T06:43:53.152 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-04-04T06:43:53.152 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-04-04T06:43:53.152 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/adaptec 2024-04-04T06:43:53.152 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-04-04T06:43:53.152 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/agere 2024-04-04T06:43:53.152 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/agere/et131x.ko 2024-04-04T06:43:53.152 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/alteon 2024-04-04T06:43:53.152 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-04-04T06:43:53.152 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/altera 2024-04-04T06:43:53.152 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-04-04T06:43:53.152 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/amd 2024-04-04T06:43:53.152 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-04-04T06:43:53.152 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-04-04T06:43:53.153 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-04-04T06:43:53.153 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros 2024-04-04T06:43:53.153 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/alx 2024-04-04T06:43:53.153 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-04-04T06:43:53.153 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atl1c 2024-04-04T06:43:53.153 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-04-04T06:43:53.153 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atl1e 2024-04-04T06:43:53.153 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-04-04T06:43:53.153 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atlx 2024-04-04T06:43:53.153 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-04-04T06:43:53.153 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-04-04T06:43:53.153 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom 2024-04-04T06:43:53.153 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-04-04T06:43:53.153 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-04-04T06:43:53.154 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-04-04T06:43:53.154 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-04-04T06:43:53.154 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-04-04T06:43:53.154 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/genet 2024-04-04T06:43:53.154 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-04-04T06:43:53.154 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-04-04T06:43:53.154 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/brocade 2024-04-04T06:43:53.154 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/brocade/bna 2024-04-04T06:43:53.154 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-04-04T06:43:53.154 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio 2024-04-04T06:43:53.154 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb 2024-04-04T06:43:53.154 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-04-04T06:43:53.154 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-04-04T06:43:53.154 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-04-04T06:43:53.155 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-04-04T06:43:53.155 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-04-04T06:43:53.155 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-04-04T06:43:53.155 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-04-04T06:43:53.155 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-04-04T06:43:53.155 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-04-04T06:43:53.155 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/cisco 2024-04-04T06:43:53.155 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/cisco/enic 2024-04-04T06:43:53.155 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-04-04T06:43:53.155 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec 2024-04-04T06:43:53.155 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip 2024-04-04T06:43:53.155 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-04-04T06:43:53.155 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-04-04T06:43:53.155 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-04-04T06:43:53.156 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-04-04T06:43:53.156 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-04-04T06:43:53.156 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-04-04T06:43:53.156 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dlink 2024-04-04T06:43:53.156 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-04-04T06:43:53.156 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-04-04T06:43:53.156 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dnet.ko 2024-04-04T06:43:53.156 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/emulex 2024-04-04T06:43:53.156 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/emulex/benet 2024-04-04T06:43:53.156 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-04-04T06:43:53.156 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/ethoc.ko 2024-04-04T06:43:53.156 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/fealnx.ko 2024-04-04T06:43:53.156 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel 2024-04-04T06:43:53.156 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/e100.ko 2024-04-04T06:43:53.157 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/e1000 2024-04-04T06:43:53.157 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-04-04T06:43:53.157 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/e1000e 2024-04-04T06:43:53.157 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-04-04T06:43:53.157 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/fm10k 2024-04-04T06:43:53.157 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-04-04T06:43:53.157 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/i40e 2024-04-04T06:43:53.157 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-04-04T06:43:53.157 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/iavf 2024-04-04T06:43:53.157 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-04-04T06:43:53.157 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/igb 2024-04-04T06:43:53.157 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-04-04T06:43:53.158 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/igbvf 2024-04-04T06:43:53.158 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-04-04T06:43:53.158 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/ixgbe 2024-04-04T06:43:53.158 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-04-04T06:43:53.158 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/ixgbevf 2024-04-04T06:43:53.158 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-04-04T06:43:53.158 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/jme.ko 2024-04-04T06:43:53.158 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/marvell 2024-04-04T06:43:53.158 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-04-04T06:43:53.158 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/marvell/skge.ko 2024-04-04T06:43:53.158 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-04-04T06:43:53.158 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox 2024-04-04T06:43:53.158 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox/mlx4 2024-04-04T06:43:53.158 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-04-04T06:43:53.159 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-04-04T06:43:53.159 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox/mlx5 2024-04-04T06:43:53.159 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-04-04T06:43:53.159 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-04-04T06:43:53.159 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/micrel 2024-04-04T06:43:53.159 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-04-04T06:43:53.159 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/myricom 2024-04-04T06:43:53.159 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/myricom/myri10ge 2024-04-04T06:43:53.159 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-04-04T06:43:53.159 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/natsemi 2024-04-04T06:43:53.159 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-04-04T06:43:53.159 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-04-04T06:43:53.159 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/neterion 2024-04-04T06:43:53.159 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-04-04T06:43:53.160 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/nvidia 2024-04-04T06:43:53.160 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-04-04T06:43:53.160 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/packetengines 2024-04-04T06:43:53.160 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-04-04T06:43:53.160 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-04-04T06:43:53.160 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/qlogic 2024-04-04T06:43:53.160 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/qlogic/netxen 2024-04-04T06:43:53.160 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-04-04T06:43:53.160 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-04-04T06:43:53.160 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-04-04T06:43:53.160 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-04-04T06:43:53.160 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/rdc 2024-04-04T06:43:53.160 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-04-04T06:43:53.161 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/realtek 2024-04-04T06:43:53.161 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-04-04T06:43:53.161 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-04-04T06:43:53.161 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/realtek/atp.ko 2024-04-04T06:43:53.161 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-04-04T06:43:53.161 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/rocker 2024-04-04T06:43:53.161 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-04-04T06:43:53.161 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sfc 2024-04-04T06:43:53.161 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-04-04T06:43:53.161 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/silan 2024-04-04T06:43:53.161 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-04-04T06:43:53.161 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sis 2024-04-04T06:43:53.161 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sis/sis190.ko 2024-04-04T06:43:53.161 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sis/sis900.ko 2024-04-04T06:43:53.161 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/smsc 2024-04-04T06:43:53.162 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-04-04T06:43:53.162 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-04-04T06:43:53.162 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-04-04T06:43:53.162 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-04-04T06:43:53.162 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/stmicro 2024-04-04T06:43:53.162 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/stmicro/stmmac 2024-04-04T06:43:53.162 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-04-04T06:43:53.162 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-04-04T06:43:53.162 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sun 2024-04-04T06:43:53.162 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sun/cassini.ko 2024-04-04T06:43:53.162 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sun/niu.ko 2024-04-04T06:43:53.162 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sun/sungem.ko 2024-04-04T06:43:53.162 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-04-04T06:43:53.162 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/tehuti 2024-04-04T06:43:53.163 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-04-04T06:43:53.163 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/ti 2024-04-04T06:43:53.163 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/ti/tlan.ko 2024-04-04T06:43:53.163 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/via 2024-04-04T06:43:53.163 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-04-04T06:43:53.163 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-04-04T06:43:53.163 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/wiznet 2024-04-04T06:43:53.163 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-04-04T06:43:53.163 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-04-04T06:43:53.163 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/xircom 2024-04-04T06:43:53.163 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-04-04T06:43:53.163 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/geneve.ko 2024-04-04T06:43:53.163 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/hyperv 2024-04-04T06:43:53.163 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-04-04T06:43:53.163 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ieee802154 2024-04-04T06:43:53.164 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ieee802154/fakelb.ko 2024-04-04T06:43:53.164 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ifb.ko 2024-04-04T06:43:53.164 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ipvlan 2024-04-04T06:43:53.164 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ipvlan/ipvlan.ko 2024-04-04T06:43:53.164 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/macvlan.ko 2024-04-04T06:43:53.164 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/macvtap.ko 2024-04-04T06:43:53.164 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/mdio 2024-04-04T06:43:53.164 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/mdio.ko 2024-04-04T06:43:53.164 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-04-04T06:43:53.164 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-04-04T06:43:53.164 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/mdio/mdio-regmap.ko 2024-04-04T06:43:53.164 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/mii.ko 2024-04-04T06:43:53.164 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/net_failover.ko 2024-04-04T06:43:53.164 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/netconsole.ko 2024-04-04T06:43:53.165 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/nlmon.ko 2024-04-04T06:43:53.165 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/pcs 2024-04-04T06:43:53.165 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/pcs/pcs-lynx.ko 2024-04-04T06:43:53.165 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-04-04T06:43:53.165 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy 2024-04-04T06:43:53.165 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/amd.ko 2024-04-04T06:43:53.165 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-04-04T06:43:53.165 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-04-04T06:43:53.165 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/bcm7xxx.ko 2024-04-04T06:43:53.165 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/bcm87xx.ko 2024-04-04T06:43:53.165 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/broadcom.ko 2024-04-04T06:43:53.165 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/cicada.ko 2024-04-04T06:43:53.165 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/davicom.ko 2024-04-04T06:43:53.165 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/dp83640.ko 2024-04-04T06:43:53.165 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/et1011c.ko 2024-04-04T06:43:53.166 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/icplus.ko 2024-04-04T06:43:53.166 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/lxt.ko 2024-04-04T06:43:53.166 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/marvell.ko 2024-04-04T06:43:53.166 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/micrel.ko 2024-04-04T06:43:53.166 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/national.ko 2024-04-04T06:43:53.166 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/phylink.ko 2024-04-04T06:43:53.166 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/qsemi.ko 2024-04-04T06:43:53.166 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/realtek.ko 2024-04-04T06:43:53.166 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/smsc.ko 2024-04-04T06:43:53.166 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/ste10Xp.ko 2024-04-04T06:43:53.166 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/vitesse.ko 2024-04-04T06:43:53.166 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp 2024-04-04T06:43:53.166 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/bsd_comp.ko 2024-04-04T06:43:53.166 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/ppp_async.ko 2024-04-04T06:43:53.167 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/ppp_deflate.ko 2024-04-04T06:43:53.167 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/ppp_generic.ko 2024-04-04T06:43:53.167 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/ppp_mppe.ko 2024-04-04T06:43:53.167 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/ppp_synctty.ko 2024-04-04T06:43:53.167 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/pppoe.ko 2024-04-04T06:43:53.167 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/pppox.ko 2024-04-04T06:43:53.167 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/pptp.ko 2024-04-04T06:43:53.167 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/slip 2024-04-04T06:43:53.167 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/slip/slhc.ko 2024-04-04T06:43:53.167 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/slip/slip.ko 2024-04-04T06:43:53.167 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/sungem_phy.ko 2024-04-04T06:43:53.167 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/tap.ko 2024-04-04T06:43:53.167 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team 2024-04-04T06:43:53.167 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team/team.ko 2024-04-04T06:43:53.168 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team/team_mode_activebackup.ko 2024-04-04T06:43:53.168 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team/team_mode_broadcast.ko 2024-04-04T06:43:53.168 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-04-04T06:43:53.168 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team/team_mode_random.ko 2024-04-04T06:43:53.168 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-04-04T06:43:53.168 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/tun.ko 2024-04-04T06:43:53.168 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/veth.ko 2024-04-04T06:43:53.168 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/virtio_net.ko 2024-04-04T06:43:53.168 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/vmxnet3 2024-04-04T06:43:53.168 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-04-04T06:43:53.168 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/vxlan 2024-04-04T06:43:53.168 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/vxlan/vxlan.ko 2024-04-04T06:43:53.168 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/xen-netback 2024-04-04T06:43:53.169 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/xen-netback/xen-netback.ko 2024-04-04T06:43:53.169 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/xen-netfront.ko 2024-04-04T06:43:53.169 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ntb 2024-04-04T06:43:53.169 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ntb/ntb.ko 2024-04-04T06:43:53.169 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/nvme 2024-04-04T06:43:53.169 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/nvme/host 2024-04-04T06:43:53.169 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/nvme/host/nvme-core.ko 2024-04-04T06:43:53.169 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/nvme/host/nvme.ko 2024-04-04T06:43:53.169 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/parport 2024-04-04T06:43:53.169 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/parport/parport.ko 2024-04-04T06:43:53.169 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/parport/parport_cs.ko 2024-04-04T06:43:53.169 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/parport/parport_pc.ko 2024-04-04T06:43:53.169 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/parport/parport_serial.ko 2024-04-04T06:43:53.169 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pci 2024-04-04T06:43:53.170 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pci/hotplug 2024-04-04T06:43:53.170 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-04-04T06:43:53.170 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pci/pcie 2024-04-04T06:43:53.170 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pci/pcie/aer_inject.ko 2024-04-04T06:43:53.170 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pci/xen-pcifront.ko 2024-04-04T06:43:53.170 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pcmcia 2024-04-04T06:43:53.170 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pcmcia/i82092.ko 2024-04-04T06:43:53.170 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pcmcia/pd6729.ko 2024-04-04T06:43:53.170 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pcmcia/yenta_socket.ko 2024-04-04T06:43:53.170 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pinctrl 2024-04-04T06:43:53.170 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pinctrl/intel 2024-04-04T06:43:53.170 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-04-04T06:43:53.170 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform 2024-04-04T06:43:53.170 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86 2024-04-04T06:43:53.171 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/acer-wmi.ko 2024-04-04T06:43:53.171 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/acerhdf.ko 2024-04-04T06:43:53.171 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/apple-gmux.ko 2024-04-04T06:43:53.171 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/asus-laptop.ko 2024-04-04T06:43:53.171 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-04-04T06:43:53.171 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/asus-wmi.ko 2024-04-04T06:43:53.171 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/classmate-laptop.ko 2024-04-04T06:43:53.171 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-04-04T06:43:53.171 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-04-04T06:43:53.171 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-04-04T06:43:53.171 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-04-04T06:43:53.171 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/hdaps.ko 2024-04-04T06:43:53.171 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/intel 2024-04-04T06:43:53.171 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-04-04T06:43:53.172 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/intel_ips.ko 2024-04-04T06:43:53.172 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/msi-wmi.ko 2024-04-04T06:43:53.172 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/mxm-wmi.ko 2024-04-04T06:43:53.172 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-04-04T06:43:53.172 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/samsung-laptop.ko 2024-04-04T06:43:53.172 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/samsung-q10.ko 2024-04-04T06:43:53.172 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/topstar-laptop.ko 2024-04-04T06:43:53.172 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-04-04T06:43:53.172 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/toshiba_haps.ko 2024-04-04T06:43:53.172 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/wmi-bmof.ko 2024-04-04T06:43:53.172 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/wmi.ko 2024-04-04T06:43:53.172 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/powercap 2024-04-04T06:43:53.172 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/powercap/intel_rapl_common.ko 2024-04-04T06:43:53.172 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/powercap/intel_rapl_msr.ko 2024-04-04T06:43:53.172 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pps 2024-04-04T06:43:53.173 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pps/clients 2024-04-04T06:43:53.173 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pps/clients/pps-gpio.ko 2024-04-04T06:43:53.173 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pps/clients/pps-ldisc.ko 2024-04-04T06:43:53.173 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pps/clients/pps_parport.ko 2024-04-04T06:43:53.173 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pps/pps_core.ko 2024-04-04T06:43:53.173 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ptp 2024-04-04T06:43:53.173 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ptp/ptp.ko 2024-04-04T06:43:53.173 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ptp/ptp_kvm.ko 2024-04-04T06:43:53.173 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc 2024-04-04T06:43:53.173 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-bq32k.ko 2024-04-04T06:43:53.173 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1286.ko 2024-04-04T06:43:53.173 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1307.ko 2024-04-04T06:43:53.173 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1374.ko 2024-04-04T06:43:53.174 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1511.ko 2024-04-04T06:43:53.174 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1553.ko 2024-04-04T06:43:53.174 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1672.ko 2024-04-04T06:43:53.174 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1742.ko 2024-04-04T06:43:53.174 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds2404.ko 2024-04-04T06:43:53.174 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds3232.ko 2024-04-04T06:43:53.174 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-em3027.ko 2024-04-04T06:43:53.174 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-fm3130.ko 2024-04-04T06:43:53.174 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-isl12022.ko 2024-04-04T06:43:53.174 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-isl1208.ko 2024-04-04T06:43:53.174 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-m41t80.ko 2024-04-04T06:43:53.174 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-m48t35.ko 2024-04-04T06:43:53.174 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-m48t59.ko 2024-04-04T06:43:53.175 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-max6900.ko 2024-04-04T06:43:53.175 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-msm6242.ko 2024-04-04T06:43:53.175 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-pcf2127.ko 2024-04-04T06:43:53.175 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-pcf85063.ko 2024-04-04T06:43:53.175 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-pcf8523.ko 2024-04-04T06:43:53.175 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-pcf8563.ko 2024-04-04T06:43:53.175 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-pcf8583.ko 2024-04-04T06:43:53.175 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-rp5c01.ko 2024-04-04T06:43:53.175 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-rs5c372.ko 2024-04-04T06:43:53.175 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-04-04T06:43:53.175 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-rx8025.ko 2024-04-04T06:43:53.175 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-rx8581.ko 2024-04-04T06:43:53.175 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-04-04T06:43:53.175 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-x1205.ko 2024-04-04T06:43:53.176 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi 2024-04-04T06:43:53.176 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/3w-9xxx.ko 2024-04-04T06:43:53.176 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/3w-sas.ko 2024-04-04T06:43:53.176 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/3w-xxxx.ko 2024-04-04T06:43:53.176 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/BusLogic.ko 2024-04-04T06:43:53.176 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/a100u2w.ko 2024-04-04T06:43:53.176 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/aacraid 2024-04-04T06:43:53.176 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/aacraid/aacraid.ko 2024-04-04T06:43:53.176 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/advansys.ko 2024-04-04T06:43:53.176 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/aic7xxx 2024-04-04T06:43:53.176 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-04-04T06:43:53.176 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-04-04T06:43:53.176 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/am53c974.ko 2024-04-04T06:43:53.176 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/arcmsr 2024-04-04T06:43:53.176 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-04-04T06:43:53.177 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/atp870u.ko 2024-04-04T06:43:53.177 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/be2iscsi 2024-04-04T06:43:53.177 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-04-04T06:43:53.177 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/bfa 2024-04-04T06:43:53.177 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/bfa/bfa.ko 2024-04-04T06:43:53.177 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/bnx2fc 2024-04-04T06:43:53.177 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-04-04T06:43:53.177 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/bnx2i 2024-04-04T06:43:53.177 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-04-04T06:43:53.177 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/ch.ko 2024-04-04T06:43:53.177 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/csiostor 2024-04-04T06:43:53.177 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/csiostor/csiostor.ko 2024-04-04T06:43:53.177 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/cxgbi 2024-04-04T06:43:53.178 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/cxgbi/cxgb3i 2024-04-04T06:43:53.178 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-04-04T06:43:53.178 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/cxgbi/cxgb4i 2024-04-04T06:43:53.178 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-04-04T06:43:53.178 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-04-04T06:43:53.178 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/dc395x.ko 2024-04-04T06:43:53.178 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/device_handler 2024-04-04T06:43:53.178 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-04-04T06:43:53.178 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-04-04T06:43:53.178 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-04-04T06:43:53.178 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-04-04T06:43:53.178 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/dmx3191d.ko 2024-04-04T06:43:53.178 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/esas2r 2024-04-04T06:43:53.178 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/esas2r/esas2r.ko 2024-04-04T06:43:53.179 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/esp_scsi.ko 2024-04-04T06:43:53.179 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/fcoe 2024-04-04T06:43:53.179 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/fcoe/fcoe.ko 2024-04-04T06:43:53.179 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-04-04T06:43:53.179 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/fnic 2024-04-04T06:43:53.179 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/fnic/fnic.ko 2024-04-04T06:43:53.179 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/hpsa.ko 2024-04-04T06:43:53.179 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/hptiop.ko 2024-04-04T06:43:53.179 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/hv_storvsc.ko 2024-04-04T06:43:53.179 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/initio.ko 2024-04-04T06:43:53.179 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/ipr.ko 2024-04-04T06:43:53.179 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/ips.ko 2024-04-04T06:43:53.179 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/isci 2024-04-04T06:43:53.179 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/isci/isci.ko 2024-04-04T06:43:53.180 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-04-04T06:43:53.180 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/iscsi_tcp.ko 2024-04-04T06:43:53.180 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/libfc 2024-04-04T06:43:53.180 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/libfc/libfc.ko 2024-04-04T06:43:53.180 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/libiscsi.ko 2024-04-04T06:43:53.180 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/libiscsi_tcp.ko 2024-04-04T06:43:53.180 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/libsas 2024-04-04T06:43:53.180 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/libsas/libsas.ko 2024-04-04T06:43:53.180 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/lpfc 2024-04-04T06:43:53.180 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/lpfc/lpfc.ko 2024-04-04T06:43:53.180 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/megaraid 2024-04-04T06:43:53.180 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/megaraid.ko 2024-04-04T06:43:53.180 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-04-04T06:43:53.180 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-04-04T06:43:53.181 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-04-04T06:43:53.181 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/mpt3sas 2024-04-04T06:43:53.181 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-04-04T06:43:53.181 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/mvsas 2024-04-04T06:43:53.181 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/mvsas/mvsas.ko 2024-04-04T06:43:53.181 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/mvumi.ko 2024-04-04T06:43:53.181 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/pm8001 2024-04-04T06:43:53.181 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-04-04T06:43:53.181 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/pmcraid.ko 2024-04-04T06:43:53.181 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/qla1280.ko 2024-04-04T06:43:53.181 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/qla2xxx 2024-04-04T06:43:53.181 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-04-04T06:43:53.181 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-04-04T06:43:53.181 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/qla4xxx 2024-04-04T06:43:53.182 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-04-04T06:43:53.182 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/raid_class.ko 2024-04-04T06:43:53.182 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/scsi_debug.ko 2024-04-04T06:43:53.182 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/scsi_transport_fc.ko 2024-04-04T06:43:53.182 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-04-04T06:43:53.182 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/scsi_transport_sas.ko 2024-04-04T06:43:53.182 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/scsi_transport_spi.ko 2024-04-04T06:43:53.182 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/scsi_transport_srp.ko 2024-04-04T06:43:53.182 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/ses.ko 2024-04-04T06:43:53.182 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/st.ko 2024-04-04T06:43:53.182 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/stex.ko 2024-04-04T06:43:53.182 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/sym53c8xx_2 2024-04-04T06:43:53.182 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-04-04T06:43:53.182 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/virtio_scsi.ko 2024-04-04T06:43:53.183 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/vmw_pvscsi.ko 2024-04-04T06:43:53.183 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/wd719x.ko 2024-04-04T06:43:53.183 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ssb 2024-04-04T06:43:53.183 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ssb/ssb.ko 2024-04-04T06:43:53.183 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target 2024-04-04T06:43:53.183 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/iscsi 2024-04-04T06:43:53.183 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-04-04T06:43:53.183 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/loopback 2024-04-04T06:43:53.183 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/loopback/tcm_loop.ko 2024-04-04T06:43:53.183 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/target_core_file.ko 2024-04-04T06:43:53.183 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/target_core_iblock.ko 2024-04-04T06:43:53.183 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/target_core_mod.ko 2024-04-04T06:43:53.184 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/target_core_pscsi.ko 2024-04-04T06:43:53.184 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/target_core_user.ko 2024-04-04T06:43:53.184 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/tcm_fc 2024-04-04T06:43:53.184 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-04-04T06:43:53.184 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal 2024-04-04T06:43:53.184 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel 2024-04-04T06:43:53.184 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal 2024-04-04T06:43:53.184 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-04-04T06:43:53.184 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-04-04T06:43:53.184 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-04-04T06:43:53.184 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-04-04T06:43:53.184 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-04-04T06:43:53.185 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-04-04T06:43:53.185 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-04-04T06:43:53.185 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-04-04T06:43:53.185 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-04-04T06:43:53.185 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-04-04T06:43:53.185 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-04-04T06:43:53.185 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-04-04T06:43:53.185 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-04-04T06:43:53.185 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-04-04T06:43:53.185 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-04-04T06:43:53.185 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-04-04T06:43:53.185 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-04-04T06:43:53.185 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-04-04T06:43:53.185 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty 2024-04-04T06:43:53.186 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/ipwireless 2024-04-04T06:43:53.186 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-04-04T06:43:53.186 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/n_gsm.ko 2024-04-04T06:43:53.186 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/n_hdlc.ko 2024-04-04T06:43:53.186 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/nozomi.ko 2024-04-04T06:43:53.186 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/serial 2024-04-04T06:43:53.186 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/serial/8250 2024-04-04T06:43:53.186 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-04-04T06:43:53.186 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/serial/arc_uart.ko 2024-04-04T06:43:53.186 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/serial/jsm 2024-04-04T06:43:53.186 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/serial/jsm/jsm.ko 2024-04-04T06:43:53.186 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ufs 2024-04-04T06:43:53.187 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ufs/core 2024-04-04T06:43:53.187 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ufs/core/ufshcd-core.ko 2024-04-04T06:43:53.187 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ufs/host 2024-04-04T06:43:53.187 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-04-04T06:43:53.187 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/uio 2024-04-04T06:43:53.187 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/uio/uio.ko 2024-04-04T06:43:53.187 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/uio/uio_aec.ko 2024-04-04T06:43:53.187 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/uio/uio_cif.ko 2024-04-04T06:43:53.187 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/uio/uio_pci_generic.ko 2024-04-04T06:43:53.187 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/uio/uio_sercos3.ko 2024-04-04T06:43:53.187 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb 2024-04-04T06:43:53.187 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/class 2024-04-04T06:43:53.187 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/class/cdc-acm.ko 2024-04-04T06:43:53.187 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/class/cdc-wdm.ko 2024-04-04T06:43:53.188 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/class/usblp.ko 2024-04-04T06:43:53.188 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/class/usbtmc.ko 2024-04-04T06:43:53.188 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/host 2024-04-04T06:43:53.188 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/host/sl811-hcd.ko 2024-04-04T06:43:53.188 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/image 2024-04-04T06:43:53.188 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/image/mdc800.ko 2024-04-04T06:43:53.188 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/image/microtek.ko 2024-04-04T06:43:53.188 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc 2024-04-04T06:43:53.188 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/adutux.ko 2024-04-04T06:43:53.188 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/appledisplay.ko 2024-04-04T06:43:53.188 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/emi26.ko 2024-04-04T06:43:53.188 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/emi62.ko 2024-04-04T06:43:53.189 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/ezusb.ko 2024-04-04T06:43:53.189 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/idmouse.ko 2024-04-04T06:43:53.189 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/iowarrior.ko 2024-04-04T06:43:53.189 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/isight_firmware.ko 2024-04-04T06:43:53.189 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/ldusb.ko 2024-04-04T06:43:53.189 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/legousbtower.ko 2024-04-04T06:43:53.189 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/sisusbvga 2024-04-04T06:43:53.189 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-04-04T06:43:53.189 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/trancevibrator.ko 2024-04-04T06:43:53.189 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/usb3503.ko 2024-04-04T06:43:53.189 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/usblcd.ko 2024-04-04T06:43:53.189 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/usbsevseg.ko 2024-04-04T06:43:53.189 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/uss720.ko 2024-04-04T06:43:53.189 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/yurex.ko 2024-04-04T06:43:53.190 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/phy 2024-04-04T06:43:53.190 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/phy/phy-generic.ko 2024-04-04T06:43:53.190 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial 2024-04-04T06:43:53.190 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/aircable.ko 2024-04-04T06:43:53.190 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ark3116.ko 2024-04-04T06:43:53.190 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/belkin_sa.ko 2024-04-04T06:43:53.190 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ch341.ko 2024-04-04T06:43:53.190 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/cp210x.ko 2024-04-04T06:43:53.190 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/cyberjack.ko 2024-04-04T06:43:53.190 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/cypress_m8.ko 2024-04-04T06:43:53.190 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/digi_acceleport.ko 2024-04-04T06:43:53.191 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/empeg.ko 2024-04-04T06:43:53.191 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ftdi_sio.ko 2024-04-04T06:43:53.191 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/garmin_gps.ko 2024-04-04T06:43:53.191 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/io_edgeport.ko 2024-04-04T06:43:53.191 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/io_ti.ko 2024-04-04T06:43:53.191 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ipaq.ko 2024-04-04T06:43:53.191 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ipw.ko 2024-04-04T06:43:53.191 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ir-usb.ko 2024-04-04T06:43:53.191 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-04-04T06:43:53.191 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/keyspan.ko 2024-04-04T06:43:53.191 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/keyspan_pda.ko 2024-04-04T06:43:53.191 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/kl5kusb105.ko 2024-04-04T06:43:53.191 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/kobil_sct.ko 2024-04-04T06:43:53.191 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/mct_u232.ko 2024-04-04T06:43:53.192 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/mos7720.ko 2024-04-04T06:43:53.192 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/mos7840.ko 2024-04-04T06:43:53.192 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/navman.ko 2024-04-04T06:43:53.192 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/omninet.ko 2024-04-04T06:43:53.192 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/opticon.ko 2024-04-04T06:43:53.192 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/option.ko 2024-04-04T06:43:53.192 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/oti6858.ko 2024-04-04T06:43:53.192 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/pl2303.ko 2024-04-04T06:43:53.192 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/qcaux.ko 2024-04-04T06:43:53.192 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/qcserial.ko 2024-04-04T06:43:53.192 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/quatech2.ko 2024-04-04T06:43:53.192 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/safe_serial.ko 2024-04-04T06:43:53.192 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/sierra.ko 2024-04-04T06:43:53.192 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/spcp8x5.ko 2024-04-04T06:43:53.193 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ssu100.ko 2024-04-04T06:43:53.193 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/symbolserial.ko 2024-04-04T06:43:53.193 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-04-04T06:43:53.193 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-04-04T06:43:53.193 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/usb_debug.ko 2024-04-04T06:43:53.193 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/usb_wwan.ko 2024-04-04T06:43:53.193 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/visor.ko 2024-04-04T06:43:53.193 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/whiteheat.ko 2024-04-04T06:43:53.193 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/xsens_mt.ko 2024-04-04T06:43:53.193 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage 2024-04-04T06:43:53.193 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/uas.ko 2024-04-04T06:43:53.193 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-alauda.ko 2024-04-04T06:43:53.193 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-cypress.ko 2024-04-04T06:43:53.193 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-datafab.ko 2024-04-04T06:43:53.193 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-04-04T06:43:53.194 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-freecom.ko 2024-04-04T06:43:53.194 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-isd200.ko 2024-04-04T06:43:53.194 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-04-04T06:43:53.194 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-karma.ko 2024-04-04T06:43:53.194 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-onetouch.ko 2024-04-04T06:43:53.194 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-realtek.ko 2024-04-04T06:43:53.194 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-sddr09.ko 2024-04-04T06:43:53.194 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-sddr55.ko 2024-04-04T06:43:53.194 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-usbat.ko 2024-04-04T06:43:53.194 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/usb-storage.ko 2024-04-04T06:43:53.194 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/usbip 2024-04-04T06:43:53.194 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/usbip/usbip-core.ko 2024-04-04T06:43:53.194 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/usbip/usbip-host.ko 2024-04-04T06:43:53.194 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-04-04T06:43:53.195 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vfio 2024-04-04T06:43:53.195 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vfio/pci 2024-04-04T06:43:53.195 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-04-04T06:43:53.195 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vfio/pci/vfio-pci.ko 2024-04-04T06:43:53.195 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vfio/vfio.ko 2024-04-04T06:43:53.195 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-04-04T06:43:53.195 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vhost 2024-04-04T06:43:53.195 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vhost/vhost.ko 2024-04-04T06:43:53.195 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vhost/vhost_iotlb.ko 2024-04-04T06:43:53.195 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vhost/vhost_net.ko 2024-04-04T06:43:53.195 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vhost/vhost_scsi.ko 2024-04-04T06:43:53.195 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video 2024-04-04T06:43:53.195 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video/backlight 2024-04-04T06:43:53.195 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video/backlight/apple_bl.ko 2024-04-04T06:43:53.195 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video/backlight/lcd.ko 2024-04-04T06:43:53.196 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video/backlight/platform_lcd.ko 2024-04-04T06:43:53.196 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio 2024-04-04T06:43:53.196 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio/virtio.ko 2024-04-04T06:43:53.196 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio/virtio_balloon.ko 2024-04-04T06:43:53.196 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio/virtio_mmio.ko 2024-04-04T06:43:53.196 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio/virtio_pci.ko 2024-04-04T06:43:53.196 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-04-04T06:43:53.196 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-04-04T06:43:53.196 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio/virtio_ring.ko 2024-04-04T06:43:53.196 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1 2024-04-04T06:43:53.196 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/masters 2024-04-04T06:43:53.196 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/masters/ds2482.ko 2024-04-04T06:43:53.196 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/masters/ds2490.ko 2024-04-04T06:43:53.196 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves 2024-04-04T06:43:53.196 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-04-04T06:43:53.197 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-04-04T06:43:53.197 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-04-04T06:43:53.197 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-04-04T06:43:53.197 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-04-04T06:43:53.197 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-04-04T06:43:53.197 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-04-04T06:43:53.197 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-04-04T06:43:53.197 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-04-04T06:43:53.197 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_smem.ko 2024-04-04T06:43:53.197 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_therm.ko 2024-04-04T06:43:53.197 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/wire.ko 2024-04-04T06:43:53.197 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog 2024-04-04T06:43:53.197 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/alim1535_wdt.ko 2024-04-04T06:43:53.197 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/alim7101_wdt.ko 2024-04-04T06:43:53.197 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/f71808e_wdt.ko 2024-04-04T06:43:53.198 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/hpwdt.ko 2024-04-04T06:43:53.198 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/i6300esb.ko 2024-04-04T06:43:53.198 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-04-04T06:43:53.198 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/iTCO_wdt.ko 2024-04-04T06:43:53.198 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/ib700wdt.ko 2024-04-04T06:43:53.198 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/ibmasr.ko 2024-04-04T06:43:53.198 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-04-04T06:43:53.198 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/it8712f_wdt.ko 2024-04-04T06:43:53.198 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/it87_wdt.ko 2024-04-04T06:43:53.198 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/machzwd.ko 2024-04-04T06:43:53.198 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/nv_tco.ko 2024-04-04T06:43:53.198 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/pcwd_pci.ko 2024-04-04T06:43:53.198 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/pcwd_usb.ko 2024-04-04T06:43:53.198 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-04-04T06:43:53.198 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/sch311x_wdt.ko 2024-04-04T06:43:53.199 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/softdog.ko 2024-04-04T06:43:53.199 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/sp5100_tco.ko 2024-04-04T06:43:53.199 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/via_wdt.ko 2024-04-04T06:43:53.199 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-04-04T06:43:53.199 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/w83877f_wdt.ko 2024-04-04T06:43:53.199 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/w83977f_wdt.ko 2024-04-04T06:43:53.199 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/wdt_pci.ko 2024-04-04T06:43:53.199 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/xen_wdt.ko 2024-04-04T06:43:53.199 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen 2024-04-04T06:43:53.199 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-acpi-processor.ko 2024-04-04T06:43:53.199 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-evtchn.ko 2024-04-04T06:43:53.199 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-gntalloc.ko 2024-04-04T06:43:53.199 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-gntdev.ko 2024-04-04T06:43:53.199 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-pciback 2024-04-04T06:43:53.200 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-04-04T06:43:53.200 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-privcmd.ko 2024-04-04T06:43:53.200 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xenfs 2024-04-04T06:43:53.200 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xenfs/xenfs.ko 2024-04-04T06:43:53.200 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs 2024-04-04T06:43:53.200 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/9p 2024-04-04T06:43:53.200 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/9p/9p.ko 2024-04-04T06:43:53.200 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/affs 2024-04-04T06:43:53.200 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/affs/affs.ko 2024-04-04T06:43:53.200 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/befs 2024-04-04T06:43:53.200 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/befs/befs.ko 2024-04-04T06:43:53.200 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/binfmt_misc.ko 2024-04-04T06:43:53.200 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/btrfs 2024-04-04T06:43:53.200 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/btrfs/btrfs.ko 2024-04-04T06:43:53.200 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/cachefiles 2024-04-04T06:43:53.201 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/cachefiles/cachefiles.ko 2024-04-04T06:43:53.201 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ceph 2024-04-04T06:43:53.201 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ceph/ceph.ko 2024-04-04T06:43:53.201 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/coda 2024-04-04T06:43:53.201 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/coda/coda.ko 2024-04-04T06:43:53.201 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/cramfs 2024-04-04T06:43:53.201 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/cramfs/cramfs.ko 2024-04-04T06:43:53.201 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/dlm 2024-04-04T06:43:53.201 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/dlm/dlm.ko 2024-04-04T06:43:53.201 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ecryptfs 2024-04-04T06:43:53.201 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ecryptfs/ecryptfs.ko 2024-04-04T06:43:53.201 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/f2fs 2024-04-04T06:43:53.201 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/f2fs/f2fs.ko 2024-04-04T06:43:53.201 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fat 2024-04-04T06:43:53.201 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fat/fat.ko 2024-04-04T06:43:53.202 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fat/msdos.ko 2024-04-04T06:43:53.202 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fat/vfat.ko 2024-04-04T06:43:53.202 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fuse 2024-04-04T06:43:53.202 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fuse/cuse.ko 2024-04-04T06:43:53.202 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fuse/fuse.ko 2024-04-04T06:43:53.202 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/gfs2 2024-04-04T06:43:53.202 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/gfs2/gfs2.ko 2024-04-04T06:43:53.202 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/hfs 2024-04-04T06:43:53.202 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/hfs/hfs.ko 2024-04-04T06:43:53.202 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/hfsplus 2024-04-04T06:43:53.202 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/hfsplus/hfsplus.ko 2024-04-04T06:43:53.202 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/isofs 2024-04-04T06:43:53.202 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/isofs/isofs.ko 2024-04-04T06:43:53.202 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/jfs 2024-04-04T06:43:53.203 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/jfs/jfs.ko 2024-04-04T06:43:53.203 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/lockd 2024-04-04T06:43:53.203 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/lockd/lockd.ko 2024-04-04T06:43:53.203 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/minix 2024-04-04T06:43:53.203 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/minix/minix.ko 2024-04-04T06:43:53.203 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/netfs 2024-04-04T06:43:53.203 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/netfs/netfs.ko 2024-04-04T06:43:53.203 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs 2024-04-04T06:43:53.203 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/blocklayout 2024-04-04T06:43:53.203 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-04-04T06:43:53.203 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/filelayout 2024-04-04T06:43:53.203 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-04-04T06:43:53.203 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/flexfilelayout 2024-04-04T06:43:53.204 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-04-04T06:43:53.204 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/nfs.ko 2024-04-04T06:43:53.205 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/nfsv3.ko 2024-04-04T06:43:53.205 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/nfsv4.ko 2024-04-04T06:43:53.205 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs_common 2024-04-04T06:43:53.205 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs_common/grace.ko 2024-04-04T06:43:53.205 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs_common/nfs_acl.ko 2024-04-04T06:43:53.205 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfsd 2024-04-04T06:43:53.206 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfsd/nfsd.ko 2024-04-04T06:43:53.206 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nilfs2 2024-04-04T06:43:53.206 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nilfs2/nilfs2.ko 2024-04-04T06:43:53.206 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls 2024-04-04T06:43:53.206 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-celtic.ko 2024-04-04T06:43:53.206 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-centeuro.ko 2024-04-04T06:43:53.206 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-croatian.ko 2024-04-04T06:43:53.206 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-cyrillic.ko 2024-04-04T06:43:53.206 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-gaelic.ko 2024-04-04T06:43:53.206 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-greek.ko 2024-04-04T06:43:53.206 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-iceland.ko 2024-04-04T06:43:53.206 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-inuit.ko 2024-04-04T06:43:53.206 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-roman.ko 2024-04-04T06:43:53.207 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-romanian.ko 2024-04-04T06:43:53.207 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-turkish.ko 2024-04-04T06:43:53.207 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp1250.ko 2024-04-04T06:43:53.207 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp1251.ko 2024-04-04T06:43:53.207 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp1255.ko 2024-04-04T06:43:53.207 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp737.ko 2024-04-04T06:43:53.207 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp775.ko 2024-04-04T06:43:53.207 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp850.ko 2024-04-04T06:43:53.207 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp852.ko 2024-04-04T06:43:53.207 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp855.ko 2024-04-04T06:43:53.207 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp857.ko 2024-04-04T06:43:53.207 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp860.ko 2024-04-04T06:43:53.207 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp861.ko 2024-04-04T06:43:53.208 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp862.ko 2024-04-04T06:43:53.208 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp863.ko 2024-04-04T06:43:53.208 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp864.ko 2024-04-04T06:43:53.208 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp865.ko 2024-04-04T06:43:53.208 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp866.ko 2024-04-04T06:43:53.208 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp869.ko 2024-04-04T06:43:53.208 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp874.ko 2024-04-04T06:43:53.208 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp932.ko 2024-04-04T06:43:53.208 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp936.ko 2024-04-04T06:43:53.208 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp949.ko 2024-04-04T06:43:53.208 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp950.ko 2024-04-04T06:43:53.208 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_euc-jp.ko 2024-04-04T06:43:53.208 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-1.ko 2024-04-04T06:43:53.208 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-13.ko 2024-04-04T06:43:53.208 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-14.ko 2024-04-04T06:43:53.209 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-15.ko 2024-04-04T06:43:53.209 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-2.ko 2024-04-04T06:43:53.209 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-3.ko 2024-04-04T06:43:53.209 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-4.ko 2024-04-04T06:43:53.209 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-5.ko 2024-04-04T06:43:53.209 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-6.ko 2024-04-04T06:43:53.209 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-7.ko 2024-04-04T06:43:53.209 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-9.ko 2024-04-04T06:43:53.209 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_koi8-r.ko 2024-04-04T06:43:53.209 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_koi8-ru.ko 2024-04-04T06:43:53.209 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_koi8-u.ko 2024-04-04T06:43:53.209 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_ucs2_utils.ko 2024-04-04T06:43:53.209 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_utf8.ko 2024-04-04T06:43:53.209 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2 2024-04-04T06:43:53.209 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/cluster 2024-04-04T06:43:53.210 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-04-04T06:43:53.210 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/dlm 2024-04-04T06:43:53.210 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-04-04T06:43:53.210 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/dlmfs 2024-04-04T06:43:53.210 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-04-04T06:43:53.210 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/ocfs2.ko 2024-04-04T06:43:53.210 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-04-04T06:43:53.210 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-04-04T06:43:53.210 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-04-04T06:43:53.210 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/overlayfs 2024-04-04T06:43:53.210 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/overlayfs/overlay.ko 2024-04-04T06:43:53.210 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/pstore 2024-04-04T06:43:53.210 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/pstore/ramoops.ko 2024-04-04T06:43:53.210 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/reiserfs 2024-04-04T06:43:53.210 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/reiserfs/reiserfs.ko 2024-04-04T06:43:53.211 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/romfs 2024-04-04T06:43:53.211 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/romfs/romfs.ko 2024-04-04T06:43:53.211 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/smb 2024-04-04T06:43:53.211 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/smb/client 2024-04-04T06:43:53.211 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/smb/client/cifs.ko 2024-04-04T06:43:53.211 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/smb/common 2024-04-04T06:43:53.211 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/smb/common/cifs_arc4.ko 2024-04-04T06:43:53.211 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/smb/common/cifs_md4.ko 2024-04-04T06:43:53.211 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/squashfs 2024-04-04T06:43:53.211 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/squashfs/squashfs.ko 2024-04-04T06:43:53.211 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/sysv 2024-04-04T06:43:53.211 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/sysv/sysv.ko 2024-04-04T06:43:53.211 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/udf 2024-04-04T06:43:53.211 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/udf/udf.ko 2024-04-04T06:43:53.211 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ufs 2024-04-04T06:43:53.212 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ufs/ufs.ko 2024-04-04T06:43:53.212 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/xfs 2024-04-04T06:43:53.212 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/xfs/xfs.ko 2024-04-04T06:43:53.212 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/kernel 2024-04-04T06:43:53.212 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/kernel/rcu 2024-04-04T06:43:53.212 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/kernel/rcu/rcutorture.ko 2024-04-04T06:43:53.212 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/kernel/torture.ko 2024-04-04T06:43:53.212 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/kernel/trace 2024-04-04T06:43:53.212 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-04-04T06:43:53.212 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib 2024-04-04T06:43:53.212 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/asn1_encoder.ko 2024-04-04T06:43:53.212 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/crc-itu-t.ko 2024-04-04T06:43:53.212 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/crc8.ko 2024-04-04T06:43:53.212 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/crypto 2024-04-04T06:43:53.212 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/crypto/libarc4.ko 2024-04-04T06:43:53.212 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/crypto/libdes.ko 2024-04-04T06:43:53.213 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/libcrc32c.ko 2024-04-04T06:43:53.213 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/lru_cache.ko 2024-04-04T06:43:53.213 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/lz4 2024-04-04T06:43:53.213 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/lz4/lz4_compress.ko 2024-04-04T06:43:53.213 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/lz4/lz4hc_compress.ko 2024-04-04T06:43:53.213 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/math 2024-04-04T06:43:53.213 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/math/cordic.ko 2024-04-04T06:43:53.213 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/raid6 2024-04-04T06:43:53.213 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/raid6/raid6_pq.ko 2024-04-04T06:43:53.213 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/reed_solomon 2024-04-04T06:43:53.213 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/reed_solomon/reed_solomon.ko 2024-04-04T06:43:53.213 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/ts_bm.ko 2024-04-04T06:43:53.213 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/ts_fsm.ko 2024-04-04T06:43:53.213 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/ts_kmp.ko 2024-04-04T06:43:53.213 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/zstd 2024-04-04T06:43:53.213 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/zstd/zstd_compress.ko 2024-04-04T06:43:53.214 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/mm 2024-04-04T06:43:53.214 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/mm/hwpoison-inject.ko 2024-04-04T06:43:53.214 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net 2024-04-04T06:43:53.214 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan 2024-04-04T06:43:53.214 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/6lowpan.ko 2024-04-04T06:43:53.214 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_dest.ko 2024-04-04T06:43:53.214 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_fragment.ko 2024-04-04T06:43:53.214 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_hop.ko 2024-04-04T06:43:53.214 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_ipv6.ko 2024-04-04T06:43:53.214 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_mobility.ko 2024-04-04T06:43:53.214 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_routing.ko 2024-04-04T06:43:53.214 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_udp.ko 2024-04-04T06:43:53.214 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/802 2024-04-04T06:43:53.214 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/802/garp.ko 2024-04-04T06:43:53.215 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/802/mrp.ko 2024-04-04T06:43:53.215 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/802/p8022.ko 2024-04-04T06:43:53.215 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/802/psnap.ko 2024-04-04T06:43:53.215 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/802/stp.ko 2024-04-04T06:43:53.215 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/8021q 2024-04-04T06:43:53.215 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/8021q/8021q.ko 2024-04-04T06:43:53.215 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/9p 2024-04-04T06:43:53.215 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/9p/9pnet.ko 2024-04-04T06:43:53.215 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/9p/9pnet_fd.ko 2024-04-04T06:43:53.215 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/9p/9pnet_rdma.ko 2024-04-04T06:43:53.215 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/9p/9pnet_virtio.ko 2024-04-04T06:43:53.215 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/batman-adv 2024-04-04T06:43:53.215 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/batman-adv/batman-adv.ko 2024-04-04T06:43:53.215 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge 2024-04-04T06:43:53.215 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/br_netfilter.ko 2024-04-04T06:43:53.215 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/bridge.ko 2024-04-04T06:43:53.216 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter 2024-04-04T06:43:53.216 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-04-04T06:43:53.216 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_among.ko 2024-04-04T06:43:53.216 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_arp.ko 2024-04-04T06:43:53.216 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-04-04T06:43:53.216 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-04-04T06:43:53.216 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_ip.ko 2024-04-04T06:43:53.216 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-04-04T06:43:53.216 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_limit.ko 2024-04-04T06:43:53.216 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_log.ko 2024-04-04T06:43:53.216 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_mark.ko 2024-04-04T06:43:53.216 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-04-04T06:43:53.216 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-04-04T06:43:53.216 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-04-04T06:43:53.216 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-04-04T06:43:53.216 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_snat.ko 2024-04-04T06:43:53.217 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_stp.ko 2024-04-04T06:43:53.217 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-04-04T06:43:53.217 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-04-04T06:43:53.217 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-04-04T06:43:53.217 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-04-04T06:43:53.217 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebtables.ko 2024-04-04T06:43:53.217 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-04-04T06:43:53.217 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-04-04T06:43:53.217 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-04-04T06:43:53.217 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ceph 2024-04-04T06:43:53.217 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ceph/libceph.ko 2024-04-04T06:43:53.217 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/core 2024-04-04T06:43:53.217 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/core/failover.ko 2024-04-04T06:43:53.217 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/core/pktgen.ko 2024-04-04T06:43:53.217 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dccp 2024-04-04T06:43:53.217 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dccp/dccp.ko 2024-04-04T06:43:53.218 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dccp/dccp_diag.ko 2024-04-04T06:43:53.218 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dccp/dccp_ipv4.ko 2024-04-04T06:43:53.218 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dccp/dccp_ipv6.ko 2024-04-04T06:43:53.218 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dns_resolver 2024-04-04T06:43:53.218 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dns_resolver/dns_resolver.ko 2024-04-04T06:43:53.218 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dsa 2024-04-04T06:43:53.218 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dsa/dsa_core.ko 2024-04-04T06:43:53.218 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dsa/tag_brcm.ko 2024-04-04T06:43:53.218 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dsa/tag_dsa.ko 2024-04-04T06:43:53.218 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dsa/tag_none.ko 2024-04-04T06:43:53.218 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dsa/tag_trailer.ko 2024-04-04T06:43:53.218 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ieee802154 2024-04-04T06:43:53.218 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ieee802154/6lowpan 2024-04-04T06:43:53.218 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-04-04T06:43:53.219 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ieee802154/ieee802154.ko 2024-04-04T06:43:53.219 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ieee802154/ieee802154_socket.ko 2024-04-04T06:43:53.219 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4 2024-04-04T06:43:53.219 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/ah4.ko 2024-04-04T06:43:53.219 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/esp4.ko 2024-04-04T06:43:53.219 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/fou.ko 2024-04-04T06:43:53.219 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/gre.ko 2024-04-04T06:43:53.219 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/inet_diag.ko 2024-04-04T06:43:53.219 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/ip_gre.ko 2024-04-04T06:43:53.219 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/ip_tunnel.ko 2024-04-04T06:43:53.219 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/ip_vti.ko 2024-04-04T06:43:53.219 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/ipcomp.ko 2024-04-04T06:43:53.219 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/ipip.ko 2024-04-04T06:43:53.219 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter 2024-04-04T06:43:53.219 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/arp_tables.ko 2024-04-04T06:43:53.220 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-04-04T06:43:53.220 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-04-04T06:43:53.220 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-04-04T06:43:53.220 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-04-04T06:43:53.220 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-04-04T06:43:53.220 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-04-04T06:43:53.220 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-04-04T06:43:53.220 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-04-04T06:43:53.220 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-04-04T06:43:53.220 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/iptable_security.ko 2024-04-04T06:43:53.220 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-04-04T06:43:53.220 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-04-04T06:43:53.220 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-04-04T06:43:53.220 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-04-04T06:43:53.221 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-04-04T06:43:53.221 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-04-04T06:43:53.221 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-04-04T06:43:53.221 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-04-04T06:43:53.221 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-04-04T06:43:53.221 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-04-04T06:43:53.221 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_bic.ko 2024-04-04T06:43:53.221 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_dctcp.ko 2024-04-04T06:43:53.221 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_diag.ko 2024-04-04T06:43:53.221 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_highspeed.ko 2024-04-04T06:43:53.221 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_htcp.ko 2024-04-04T06:43:53.221 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_hybla.ko 2024-04-04T06:43:53.221 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_illinois.ko 2024-04-04T06:43:53.221 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_lp.ko 2024-04-04T06:43:53.221 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_scalable.ko 2024-04-04T06:43:53.221 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_vegas.ko 2024-04-04T06:43:53.222 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_veno.ko 2024-04-04T06:43:53.222 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_westwood.ko 2024-04-04T06:43:53.222 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_yeah.ko 2024-04-04T06:43:53.222 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tunnel4.ko 2024-04-04T06:43:53.222 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/udp_diag.ko 2024-04-04T06:43:53.222 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/udp_tunnel.ko 2024-04-04T06:43:53.222 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/xfrm4_tunnel.ko 2024-04-04T06:43:53.222 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6 2024-04-04T06:43:53.222 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/ah6.ko 2024-04-04T06:43:53.222 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/esp6.ko 2024-04-04T06:43:53.222 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/fou6.ko 2024-04-04T06:43:53.222 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/ip6_tunnel.ko 2024-04-04T06:43:53.222 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-04-04T06:43:53.222 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/ip6_vti.ko 2024-04-04T06:43:53.223 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/ipcomp6.ko 2024-04-04T06:43:53.223 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter 2024-04-04T06:43:53.223 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-04-04T06:43:53.223 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-04-04T06:43:53.223 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-04-04T06:43:53.223 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-04-04T06:43:53.223 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-04-04T06:43:53.223 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-04-04T06:43:53.223 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-04-04T06:43:53.223 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-04-04T06:43:53.223 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-04-04T06:43:53.223 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-04-04T06:43:53.223 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-04-04T06:43:53.223 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-04-04T06:43:53.224 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-04-04T06:43:53.224 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-04-04T06:43:53.224 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-04-04T06:43:53.224 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-04-04T06:43:53.224 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-04-04T06:43:53.224 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-04-04T06:43:53.224 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-04-04T06:43:53.224 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-04-04T06:43:53.224 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-04-04T06:43:53.224 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-04-04T06:43:53.224 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-04-04T06:43:53.224 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-04-04T06:43:53.224 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/sit.ko 2024-04-04T06:43:53.224 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/tunnel6.ko 2024-04-04T06:43:53.224 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/xfrm6_tunnel.ko 2024-04-04T06:43:53.224 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/key 2024-04-04T06:43:53.225 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/key/af_key.ko 2024-04-04T06:43:53.225 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp 2024-04-04T06:43:53.225 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_core.ko 2024-04-04T06:43:53.225 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_debugfs.ko 2024-04-04T06:43:53.225 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_eth.ko 2024-04-04T06:43:53.225 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_ip.ko 2024-04-04T06:43:53.225 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_ip6.ko 2024-04-04T06:43:53.225 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_netlink.ko 2024-04-04T06:43:53.225 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_ppp.ko 2024-04-04T06:43:53.225 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/llc 2024-04-04T06:43:53.225 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/llc/llc.ko 2024-04-04T06:43:53.225 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/mac802154 2024-04-04T06:43:53.225 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/mac802154/mac802154.ko 2024-04-04T06:43:53.225 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/mpls 2024-04-04T06:43:53.225 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/mpls/mpls_gso.ko 2024-04-04T06:43:53.226 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter 2024-04-04T06:43:53.226 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset 2024-04-04T06:43:53.226 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set.ko 2024-04-04T06:43:53.226 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-04-04T06:43:53.226 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-04-04T06:43:53.226 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-04-04T06:43:53.226 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-04-04T06:43:53.226 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-04-04T06:43:53.226 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-04-04T06:43:53.226 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-04-04T06:43:53.226 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-04-04T06:43:53.226 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-04-04T06:43:53.226 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-04-04T06:43:53.227 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-04-04T06:43:53.227 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-04-04T06:43:53.227 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-04-04T06:43:53.227 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-04-04T06:43:53.227 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-04-04T06:43:53.227 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs 2024-04-04T06:43:53.227 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs.ko 2024-04-04T06:43:53.227 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-04-04T06:43:53.227 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-04-04T06:43:53.227 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-04-04T06:43:53.227 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-04-04T06:43:53.227 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-04-04T06:43:53.227 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-04-04T06:43:53.227 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-04-04T06:43:53.227 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-04-04T06:43:53.228 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-04-04T06:43:53.228 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-04-04T06:43:53.228 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-04-04T06:43:53.228 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-04-04T06:43:53.228 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-04-04T06:43:53.228 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conncount.ko 2024-04-04T06:43:53.228 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack.ko 2024-04-04T06:43:53.228 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-04-04T06:43:53.228 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-04-04T06:43:53.228 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-04-04T06:43:53.228 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_h323.ko 2024-04-04T06:43:53.228 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_irc.ko 2024-04-04T06:43:53.228 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-04-04T06:43:53.229 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-04-04T06:43:53.229 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-04-04T06:43:53.229 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_sane.ko 2024-04-04T06:43:53.229 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_sip.ko 2024-04-04T06:43:53.229 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-04-04T06:43:53.229 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-04-04T06:43:53.229 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_dup_netdev.ko 2024-04-04T06:43:53.229 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_flow_table.ko 2024-04-04T06:43:53.229 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_flow_table_inet.ko 2024-04-04T06:43:53.229 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_log_syslog.ko 2024-04-04T06:43:53.229 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_nat.ko 2024-04-04T06:43:53.229 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_nat_amanda.ko 2024-04-04T06:43:53.229 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_nat_ftp.ko 2024-04-04T06:43:53.229 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_nat_irc.ko 2024-04-04T06:43:53.229 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_nat_sip.ko 2024-04-04T06:43:53.229 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_nat_tftp.ko 2024-04-04T06:43:53.230 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_synproxy_core.ko 2024-04-04T06:43:53.230 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_tables.ko 2024-04-04T06:43:53.230 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nfnetlink.ko 2024-04-04T06:43:53.230 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nfnetlink_acct.ko 2024-04-04T06:43:53.230 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nfnetlink_log.ko 2024-04-04T06:43:53.230 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nfnetlink_osf.ko 2024-04-04T06:43:53.230 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nfnetlink_queue.ko 2024-04-04T06:43:53.230 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_chain_nat.ko 2024-04-04T06:43:53.230 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_compat.ko 2024-04-04T06:43:53.230 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_ct.ko 2024-04-04T06:43:53.230 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_dup_netdev.ko 2024-04-04T06:43:53.230 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_fib.ko 2024-04-04T06:43:53.230 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_fwd_netdev.ko 2024-04-04T06:43:53.231 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_hash.ko 2024-04-04T06:43:53.231 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_limit.ko 2024-04-04T06:43:53.231 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_log.ko 2024-04-04T06:43:53.231 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_masq.ko 2024-04-04T06:43:53.231 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_nat.ko 2024-04-04T06:43:53.231 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_numgen.ko 2024-04-04T06:43:53.231 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_queue.ko 2024-04-04T06:43:53.231 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_quota.ko 2024-04-04T06:43:53.231 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_redir.ko 2024-04-04T06:43:53.231 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_reject.ko 2024-04-04T06:43:53.231 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_reject_inet.ko 2024-04-04T06:43:53.231 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_socket.ko 2024-04-04T06:43:53.231 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_tunnel.ko 2024-04-04T06:43:53.231 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_AUDIT.ko 2024-04-04T06:43:53.232 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_CHECKSUM.ko 2024-04-04T06:43:53.232 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_CLASSIFY.ko 2024-04-04T06:43:53.232 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-04-04T06:43:53.232 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_CT.ko 2024-04-04T06:43:53.232 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_DSCP.ko 2024-04-04T06:43:53.232 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_HL.ko 2024-04-04T06:43:53.232 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_HMARK.ko 2024-04-04T06:43:53.232 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_IDLETIMER.ko 2024-04-04T06:43:53.232 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_LED.ko 2024-04-04T06:43:53.232 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_LOG.ko 2024-04-04T06:43:53.232 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_MASQUERADE.ko 2024-04-04T06:43:53.232 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_NETMAP.ko 2024-04-04T06:43:53.232 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_NFLOG.ko 2024-04-04T06:43:53.232 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_NFQUEUE.ko 2024-04-04T06:43:53.232 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_RATEEST.ko 2024-04-04T06:43:53.232 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_REDIRECT.ko 2024-04-04T06:43:53.233 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_SECMARK.ko 2024-04-04T06:43:53.233 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_TCPMSS.ko 2024-04-04T06:43:53.233 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-04-04T06:43:53.233 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_TEE.ko 2024-04-04T06:43:53.233 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_TPROXY.ko 2024-04-04T06:43:53.233 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_TRACE.ko 2024-04-04T06:43:53.233 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_addrtype.ko 2024-04-04T06:43:53.233 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_bpf.ko 2024-04-04T06:43:53.233 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_cgroup.ko 2024-04-04T06:43:53.233 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_cluster.ko 2024-04-04T06:43:53.233 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_comment.ko 2024-04-04T06:43:53.233 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_connbytes.ko 2024-04-04T06:43:53.233 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_connlabel.ko 2024-04-04T06:43:53.233 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_connlimit.ko 2024-04-04T06:43:53.233 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_connmark.ko 2024-04-04T06:43:53.233 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_conntrack.ko 2024-04-04T06:43:53.234 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_cpu.ko 2024-04-04T06:43:53.234 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_dccp.ko 2024-04-04T06:43:53.234 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_devgroup.ko 2024-04-04T06:43:53.234 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_dscp.ko 2024-04-04T06:43:53.234 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_ecn.ko 2024-04-04T06:43:53.234 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_esp.ko 2024-04-04T06:43:53.234 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_hashlimit.ko 2024-04-04T06:43:53.234 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_helper.ko 2024-04-04T06:43:53.234 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_hl.ko 2024-04-04T06:43:53.234 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_ipcomp.ko 2024-04-04T06:43:53.234 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_iprange.ko 2024-04-04T06:43:53.234 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_ipvs.ko 2024-04-04T06:43:53.234 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_l2tp.ko 2024-04-04T06:43:53.234 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_length.ko 2024-04-04T06:43:53.235 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_limit.ko 2024-04-04T06:43:53.235 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_mac.ko 2024-04-04T06:43:53.235 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_mark.ko 2024-04-04T06:43:53.235 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_multiport.ko 2024-04-04T06:43:53.235 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_nat.ko 2024-04-04T06:43:53.235 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_nfacct.ko 2024-04-04T06:43:53.235 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_osf.ko 2024-04-04T06:43:53.235 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_owner.ko 2024-04-04T06:43:53.235 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_physdev.ko 2024-04-04T06:43:53.235 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_pkttype.ko 2024-04-04T06:43:53.235 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_policy.ko 2024-04-04T06:43:53.235 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_quota.ko 2024-04-04T06:43:53.235 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_rateest.ko 2024-04-04T06:43:53.235 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_realm.ko 2024-04-04T06:43:53.235 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_recent.ko 2024-04-04T06:43:53.236 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_sctp.ko 2024-04-04T06:43:53.236 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_set.ko 2024-04-04T06:43:53.236 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_socket.ko 2024-04-04T06:43:53.236 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_state.ko 2024-04-04T06:43:53.236 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_statistic.ko 2024-04-04T06:43:53.236 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_string.ko 2024-04-04T06:43:53.236 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_tcpmss.ko 2024-04-04T06:43:53.236 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_time.ko 2024-04-04T06:43:53.236 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_u32.ko 2024-04-04T06:43:53.236 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netlink 2024-04-04T06:43:53.236 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netlink/netlink_diag.ko 2024-04-04T06:43:53.236 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/nsh 2024-04-04T06:43:53.236 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/nsh/nsh.ko 2024-04-04T06:43:53.236 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/openvswitch 2024-04-04T06:43:53.237 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/openvswitch/openvswitch.ko 2024-04-04T06:43:53.237 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/openvswitch/vport-geneve.ko 2024-04-04T06:43:53.237 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/openvswitch/vport-gre.ko 2024-04-04T06:43:53.237 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/openvswitch/vport-vxlan.ko 2024-04-04T06:43:53.237 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/packet 2024-04-04T06:43:53.237 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/packet/af_packet_diag.ko 2024-04-04T06:43:53.237 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/rds 2024-04-04T06:43:53.237 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/rds/rds.ko 2024-04-04T06:43:53.237 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/rds/rds_rdma.ko 2024-04-04T06:43:53.237 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/rds/rds_tcp.ko 2024-04-04T06:43:53.237 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched 2024-04-04T06:43:53.237 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_csum.ko 2024-04-04T06:43:53.237 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_gact.ko 2024-04-04T06:43:53.238 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_mirred.ko 2024-04-04T06:43:53.238 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_nat.ko 2024-04-04T06:43:53.238 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_pedit.ko 2024-04-04T06:43:53.238 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_police.ko 2024-04-04T06:43:53.238 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_simple.ko 2024-04-04T06:43:53.238 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_skbedit.ko 2024-04-04T06:43:53.238 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_vlan.ko 2024-04-04T06:43:53.238 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/cls_basic.ko 2024-04-04T06:43:53.238 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/cls_bpf.ko 2024-04-04T06:43:53.238 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/cls_flow.ko 2024-04-04T06:43:53.238 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/cls_fw.ko 2024-04-04T06:43:53.238 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/cls_route.ko 2024-04-04T06:43:53.238 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/cls_u32.ko 2024-04-04T06:43:53.239 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/em_cmp.ko 2024-04-04T06:43:53.239 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/em_ipset.ko 2024-04-04T06:43:53.239 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/em_meta.ko 2024-04-04T06:43:53.239 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/em_nbyte.ko 2024-04-04T06:43:53.239 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/em_text.ko 2024-04-04T06:43:53.239 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/em_u32.ko 2024-04-04T06:43:53.239 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_choke.ko 2024-04-04T06:43:53.239 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_codel.ko 2024-04-04T06:43:53.239 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_drr.ko 2024-04-04T06:43:53.239 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_fq.ko 2024-04-04T06:43:53.239 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_gred.ko 2024-04-04T06:43:53.239 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_hfsc.ko 2024-04-04T06:43:53.239 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_hhf.ko 2024-04-04T06:43:53.239 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_htb.ko 2024-04-04T06:43:53.240 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_ingress.ko 2024-04-04T06:43:53.240 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_mqprio.ko 2024-04-04T06:43:53.240 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_mqprio_lib.ko 2024-04-04T06:43:53.240 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_multiq.ko 2024-04-04T06:43:53.240 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_netem.ko 2024-04-04T06:43:53.240 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_pie.ko 2024-04-04T06:43:53.240 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_plug.ko 2024-04-04T06:43:53.240 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_prio.ko 2024-04-04T06:43:53.240 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_qfq.ko 2024-04-04T06:43:53.240 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_red.ko 2024-04-04T06:43:53.240 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_sfb.ko 2024-04-04T06:43:53.240 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_sfq.ko 2024-04-04T06:43:53.240 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_tbf.ko 2024-04-04T06:43:53.240 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_teql.ko 2024-04-04T06:43:53.241 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sctp 2024-04-04T06:43:53.241 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sctp/sctp.ko 2024-04-04T06:43:53.241 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sctp/sctp_diag.ko 2024-04-04T06:43:53.241 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc 2024-04-04T06:43:53.241 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc/auth_gss 2024-04-04T06:43:53.241 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-04-04T06:43:53.241 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-04-04T06:43:53.241 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc/sunrpc.ko 2024-04-04T06:43:53.241 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc/xprtrdma 2024-04-04T06:43:53.241 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-04-04T06:43:53.241 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/tipc 2024-04-04T06:43:53.241 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/tipc/diag.ko 2024-04-04T06:43:53.241 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/tipc/tipc.ko 2024-04-04T06:43:53.241 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/unix 2024-04-04T06:43:53.242 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/unix/unix_diag.ko 2024-04-04T06:43:53.242 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/vmw_vsock 2024-04-04T06:43:53.242 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-04-04T06:43:53.242 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-04-04T06:43:53.242 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/vmw_vsock/vsock.ko 2024-04-04T06:43:53.242 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/vmw_vsock/vsock_diag.ko 2024-04-04T06:43:53.242 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/vmw_vsock/vsock_loopback.ko 2024-04-04T06:43:53.242 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/xfrm 2024-04-04T06:43:53.242 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/xfrm/xfrm_ipcomp.ko 2024-04-04T06:43:53.242 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/security 2024-04-04T06:43:53.242 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/security/keys 2024-04-04T06:43:53.242 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/security/keys/encrypted-keys 2024-04-04T06:43:53.242 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-04-04T06:43:53.242 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/security/keys/trusted-keys 2024-04-04T06:43:53.243 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/security/keys/trusted-keys/trusted.ko 2024-04-04T06:43:53.243 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/virt 2024-04-04T06:43:53.243 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/virt/lib 2024-04-04T06:43:53.243 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/virt/lib/irqbypass.ko 2024-04-04T06:43:53.243 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.alias 2024-04-04T06:43:53.243 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.alias.bin 2024-04-04T06:43:53.243 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.builtin 2024-04-04T06:43:53.243 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.builtin.alias.bin 2024-04-04T06:43:53.243 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.builtin.bin 2024-04-04T06:43:53.243 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.builtin.modinfo 2024-04-04T06:43:53.243 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.dep 2024-04-04T06:43:53.243 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.dep.bin 2024-04-04T06:43:53.243 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.devname 2024-04-04T06:43:53.243 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.order 2024-04-04T06:43:53.244 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.softdep 2024-04-04T06:43:53.244 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.symbols 2024-04-04T06:43:53.244 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.symbols.bin 2024-04-04T06:43:53.244 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g1df0c7e8a235/vmlinuz 2024-04-04T06:43:53.247 DEBUG:teuthology.task.kernel:get_image_version: 6.8.0-g1df0c7e8a235 2024-04-04T06:43:53.248 DEBUG:teuthology.orchestra.run.smithi072:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-04-04T06:43:53.272 INFO:teuthology.orchestra.run.smithi072.stdout:postinstall scriptlet (using /bin/sh): 2024-04-04T06:43:53.272 INFO:teuthology.orchestra.run.smithi072.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-04-04T06:43:53.272 INFO:teuthology.orchestra.run.smithi072.stdout: /usr/bin/kernel-install add 6.8.0-g1df0c7e8a235 /lib/modules/6.8.0-g1df0c7e8a235/vmlinuz 2024-04-04T06:43:53.272 INFO:teuthology.orchestra.run.smithi072.stdout:fi 2024-04-04T06:43:53.272 INFO:teuthology.orchestra.run.smithi072.stdout:for file in vmlinuz System.map config; do 2024-04-04T06:43:53.272 INFO:teuthology.orchestra.run.smithi072.stdout: if ! cmp --silent "/lib/modules/6.8.0-g1df0c7e8a235/${file}" "/boot/${file}-6.8.0-g1df0c7e8a235"; then 2024-04-04T06:43:53.272 INFO:teuthology.orchestra.run.smithi072.stdout: cp "/lib/modules/6.8.0-g1df0c7e8a235/${file}" "/boot/${file}-6.8.0-g1df0c7e8a235" 2024-04-04T06:43:53.272 INFO:teuthology.orchestra.run.smithi072.stdout: fi 2024-04-04T06:43:53.272 INFO:teuthology.orchestra.run.smithi072.stdout:done 2024-04-04T06:43:53.273 INFO:teuthology.orchestra.run.smithi072.stdout:preuninstall scriptlet (using /bin/sh): 2024-04-04T06:43:53.273 INFO:teuthology.orchestra.run.smithi072.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2024-04-04T06:43:53.273 INFO:teuthology.orchestra.run.smithi072.stdout:new-kernel-pkg --remove 6.8.0-g1df0c7e8a235 --rminitrd --initrdfile=/boot/initramfs-6.8.0-g1df0c7e8a235.img 2024-04-04T06:43:53.273 INFO:teuthology.orchestra.run.smithi072.stdout:elif [ -x /usr/bin/kernel-install ]; then 2024-04-04T06:43:53.273 INFO:teuthology.orchestra.run.smithi072.stdout:kernel-install remove 6.8.0-g1df0c7e8a235 2024-04-04T06:43:53.273 INFO:teuthology.orchestra.run.smithi072.stdout:fi 2024-04-04T06:43:53.273 INFO:teuthology.orchestra.run.smithi072.stdout:postuninstall scriptlet (using /bin/sh): 2024-04-04T06:43:53.273 INFO:teuthology.orchestra.run.smithi072.stdout:if [ -x /sbin/update-bootloader ]; then 2024-04-04T06:43:53.273 INFO:teuthology.orchestra.run.smithi072.stdout:/sbin/update-bootloader --remove 6.8.0-g1df0c7e8a235 2024-04-04T06:43:53.273 INFO:teuthology.orchestra.run.smithi072.stdout:fi 2024-04-04T06:43:53.274 DEBUG:teuthology.orchestra.run.smithi072:> sudo rpm -qi grub2-tools 2024-04-04T06:43:53.351 INFO:teuthology.orchestra.run.smithi072.stdout:Name : grub2-tools 2024-04-04T06:43:53.351 INFO:teuthology.orchestra.run.smithi072.stdout:Epoch : 1 2024-04-04T06:43:53.351 INFO:teuthology.orchestra.run.smithi072.stdout:Version : 2.06 2024-04-04T06:43:53.351 INFO:teuthology.orchestra.run.smithi072.stdout:Release : 68.el9 2024-04-04T06:43:53.351 INFO:teuthology.orchestra.run.smithi072.stdout:Architecture: x86_64 2024-04-04T06:43:53.351 INFO:teuthology.orchestra.run.smithi072.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-04-04T06:43:53.352 INFO:teuthology.orchestra.run.smithi072.stdout:Group : Unspecified 2024-04-04T06:43:53.352 INFO:teuthology.orchestra.run.smithi072.stdout:Size : 8264254 2024-04-04T06:43:53.352 INFO:teuthology.orchestra.run.smithi072.stdout:License : GPLv3+ 2024-04-04T06:43:53.352 INFO:teuthology.orchestra.run.smithi072.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-04-04T06:43:53.352 INFO:teuthology.orchestra.run.smithi072.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-04-04T06:43:53.352 INFO:teuthology.orchestra.run.smithi072.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-04-04T06:43:53.352 INFO:teuthology.orchestra.run.smithi072.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-04-04T06:43:53.352 INFO:teuthology.orchestra.run.smithi072.stdout:Packager : builder@centos.org 2024-04-04T06:43:53.352 INFO:teuthology.orchestra.run.smithi072.stdout:Vendor : CentOS 2024-04-04T06:43:53.352 INFO:teuthology.orchestra.run.smithi072.stdout:URL : http://www.gnu.org/software/grub/ 2024-04-04T06:43:53.352 INFO:teuthology.orchestra.run.smithi072.stdout:Summary : Support tools for GRUB. 2024-04-04T06:43:53.352 INFO:teuthology.orchestra.run.smithi072.stdout:Description : 2024-04-04T06:43:53.352 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T06:43:53.352 INFO:teuthology.orchestra.run.smithi072.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-04-04T06:43:53.353 INFO:teuthology.orchestra.run.smithi072.stdout:customizable bootloader with modular architecture. It supports a rich 2024-04-04T06:43:53.353 INFO:teuthology.orchestra.run.smithi072.stdout:variety of kernel formats, file systems, computer architectures and 2024-04-04T06:43:53.353 INFO:teuthology.orchestra.run.smithi072.stdout:hardware devices. 2024-04-04T06:43:53.353 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T06:43:53.353 INFO:teuthology.orchestra.run.smithi072.stdout:This subpackage provides tools for support of all platforms. 2024-04-04T06:43:53.354 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-04-04T06:43:53.354 INFO:teuthology.task.kernel:Updating grub on smithi072 to boot 6.8.0-g1df0c7e8a235 2024-04-04T06:43:53.354 DEBUG:teuthology.orchestra.run.smithi072:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-04-04T06:43:53.961 INFO:teuthology.orchestra.run.smithi072.stderr:Generating grub configuration file ... 2024-04-04T06:43:55.521 INFO:teuthology.orchestra.run.smithi072.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-04-04T06:43:55.538 INFO:teuthology.orchestra.run.smithi072.stderr:done 2024-04-04T06:43:55.540 DEBUG:teuthology.orchestra.run.smithi072:> mktemp 2024-04-04T06:43:55.556 INFO:teuthology.orchestra.run.smithi072.stdout:/tmp/tmp.xzg9WmPurB 2024-04-04T06:43:55.557 DEBUG:teuthology.orchestra.run.smithi072:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.xzg9WmPurB 2024-04-04T06:43:55.629 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod 0666 /tmp/tmp.xzg9WmPurB 2024-04-04T06:43:55.769 DEBUG:teuthology.orchestra.remote:smithi072:/tmp/tmp.xzg9WmPurB is 6KB 2024-04-04T06:43:55.789 DEBUG:teuthology.orchestra.run.smithi072:> rm -fr /tmp/tmp.xzg9WmPurB 2024-04-04T06:43:55.804 DEBUG:teuthology.orchestra.run.smithi072:> sudo /bin/ls /boot/loader/entries || true 2024-04-04T06:43:55.868 INFO:teuthology.orchestra.run.smithi072.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-04-04T06:43:55.868 INFO:teuthology.orchestra.run.smithi072.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-04-04T06:43:55.868 INFO:teuthology.orchestra.run.smithi072.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-04-04T06:43:55.869 INFO:teuthology.orchestra.run.smithi072.stdout:15949e3c88704300882482eddfd7baae-6.8.0-g1df0c7e8a235.conf 2024-04-04T06:43:55.870 DEBUG:teuthology.orchestra.run.smithi072:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-6.8.0-g1df0c7e8a235 2024-04-04T06:43:56.035 DEBUG:teuthology.orchestra.run.smithi072:> sudo shutdown -r now 2024-04-04T06:44:26.038 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-04T06:44:26.039 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi072.front.sepia.ceph.com' 2024-04-04T06:44:26.040 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-04T06:44:44.451 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.72 2024-04-04T06:44:53.452 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi072.front.sepia.ceph.com' 2024-04-04T06:44:53.453 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-04T06:44:56.510 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.72 2024-04-04T06:45:08.511 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi072.front.sepia.ceph.com' 2024-04-04T06:45:08.512 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-04T06:46:08.516 DEBUG:teuthology.orchestra.remote:timed out 2024-04-04T06:46:23.517 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi072.front.sepia.ceph.com' 2024-04-04T06:46:23.519 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-04T06:46:23.926 DEBUG:teuthology.orchestra.run.smithi072:> true 2024-04-04T06:46:24.641 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi072.front.sepia.ceph.com' 2024-04-04T06:46:24.641 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.8.0-g1df0c7e8a235"... 2024-04-04T06:46:24.641 DEBUG:teuthology.orchestra.run.smithi072:> uname -r 2024-04-04T06:46:24.694 INFO:teuthology.orchestra.run.smithi072.stdout:6.8.0-g1df0c7e8a235 2024-04-04T06:46:24.694 DEBUG:teuthology.task.kernel:current kernel version is 6.8.0-g1df0c7e8a235 vs 6.8.0-g1df0c7e8a235 2024-04-04T06:46:24.695 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-04T06:46:24.695 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-04-04T06:46:25.696 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-04-04T06:46:25.696 DEBUG:teuthology.orchestra.run.smithi072:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-04T06:46:25.840 INFO:teuthology.orchestra.run.smithi072.stdout:ttyS1 2024-04-04T06:46:25.905 DEBUG:teuthology.parallel:result is None 2024-04-04T06:46:25.905 INFO:teuthology.run_tasks:Running task internal.base... 2024-04-04T06:46:25.921 INFO:teuthology.task.internal:Creating test directory... 2024-04-04T06:46:25.921 DEBUG:teuthology.orchestra.run.smithi072:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-04T06:46:25.929 DEBUG:teuthology.orchestra.run.smithi117:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-04T06:46:25.987 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-04-04T06:46:25.998 INFO:teuthology.run_tasks:Running task internal.archive... 2024-04-04T06:46:26.026 INFO:teuthology.task.internal:Creating archive directory... 2024-04-04T06:46:26.026 DEBUG:teuthology.orchestra.run.smithi072:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-04T06:46:26.033 DEBUG:teuthology.orchestra.run.smithi117:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-04T06:46:26.105 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-04-04T06:46:26.115 INFO:teuthology.task.internal:Enabling coredump saving... 2024-04-04T06:46:26.116 DEBUG:teuthology.orchestra.run.smithi072:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-04T06:46:26.123 DEBUG:teuthology.orchestra.run.smithi117:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-04T06:46:26.227 INFO:teuthology.orchestra.run.smithi072.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-04T06:46:26.230 INFO:teuthology.orchestra.run.smithi117.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-04T06:46:26.269 INFO:teuthology.orchestra.run.smithi072.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-04T06:46:26.273 INFO:teuthology.orchestra.run.smithi117.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-04T06:46:26.278 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-04-04T06:46:26.289 INFO:teuthology.task.internal:Configuring sudo... 2024-04-04T06:46:26.289 DEBUG:teuthology.orchestra.run.smithi072:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-04T06:46:26.295 DEBUG:teuthology.orchestra.run.smithi117:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-04T06:46:26.385 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-04-04T06:46:26.395 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-04-04T06:46:26.395 DEBUG:teuthology.orchestra.run.smithi072:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-04T06:46:26.400 DEBUG:teuthology.orchestra.run.smithi117:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-04T06:46:26.452 DEBUG:teuthology.orchestra.run.smithi072:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-04T06:46:26.529 DEBUG:teuthology.orchestra.run.smithi072:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-04T06:46:26.675 DEBUG:teuthology.orchestra.run.smithi072:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-04T06:46:26.760 DEBUG:teuthology.orchestra.run.smithi072:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-04T06:46:26.860 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-04-04T06:46:26.860 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-04T06:46:26.954 DEBUG:teuthology.orchestra.run.smithi117:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-04T06:46:27.042 DEBUG:teuthology.orchestra.run.smithi117:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-04T06:46:27.180 DEBUG:teuthology.orchestra.run.smithi117:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-04T06:46:27.267 DEBUG:teuthology.orchestra.run.smithi117:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-04T06:46:27.365 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-04-04T06:46:27.365 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-04T06:46:27.455 DEBUG:teuthology.orchestra.run.smithi072:> sudo service rsyslog restart 2024-04-04T06:46:27.463 DEBUG:teuthology.orchestra.run.smithi117:> sudo service rsyslog restart 2024-04-04T06:46:27.579 INFO:teuthology.orchestra.run.smithi072.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-04T06:46:27.625 INFO:teuthology.orchestra.run.smithi117.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-04T06:46:28.043 INFO:teuthology.run_tasks:Running task internal.timer... 2024-04-04T06:46:28.052 INFO:teuthology.task.internal:Starting timer... 2024-04-04T06:46:28.052 INFO:teuthology.run_tasks:Running task pcp... 2024-04-04T06:46:28.095 INFO:teuthology.run_tasks:Running task selinux... 2024-04-04T06:46:28.126 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0']} 2024-04-04T06:46:28.127 DEBUG:teuthology.orchestra.run.smithi072:> sudo service auditd rotate 2024-04-04T06:46:28.261 INFO:teuthology.orchestra.run.smithi072.stdout:Rotating logs: 2024-04-04T06:46:28.266 DEBUG:teuthology.orchestra.run.smithi117:> sudo service auditd rotate 2024-04-04T06:46:28.409 INFO:teuthology.orchestra.run.smithi117.stdout:Rotating logs: 2024-04-04T06:46:28.413 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-04-04T06:46:28.414 DEBUG:teuthology.orchestra.run.smithi072:> /usr/sbin/getenforce 2024-04-04T06:46:28.469 INFO:teuthology.orchestra.run.smithi072.stdout:Permissive 2024-04-04T06:46:28.469 DEBUG:teuthology.orchestra.run.smithi117:> /usr/sbin/getenforce 2024-04-04T06:46:28.526 INFO:teuthology.orchestra.run.smithi117.stdout:Permissive 2024-04-04T06:46:28.526 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi072.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi117.front.sepia.ceph.com': 'permissive'} 2024-04-04T06:46:28.527 DEBUG:teuthology.orchestra.run.smithi072:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-04T06:46:28.615 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-04T06:46:28.616 DEBUG:teuthology.orchestra.run.smithi117:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-04T06:46:28.696 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-04T06:46:28.697 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-04-04T06:46:28.697 DEBUG:teuthology.orchestra.run.smithi072:> sudo /usr/sbin/setenforce permissive 2024-04-04T06:46:28.810 DEBUG:teuthology.orchestra.run.smithi117:> sudo /usr/sbin/setenforce permissive 2024-04-04T06:46:28.907 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-04-04T06:46:28.920 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-04-04T06:46:28.925 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-04-04T06:46:29.048 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-04-04T06:46:29.065 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-04-04T06:46:29.066 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi072.front.sepia.ceph.com,smithi117.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-04-04T06:52:33.291 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi072.front.sepia.ceph.com'), Remote(name='ubuntu@smithi117.front.sepia.ceph.com')] 2024-04-04T06:52:33.292 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi072.front.sepia.ceph.com' 2024-04-04T06:52:33.293 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-04T06:52:33.437 DEBUG:teuthology.orchestra.run.smithi072:> true 2024-04-04T06:52:33.593 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi072.front.sepia.ceph.com' 2024-04-04T06:52:33.593 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi117.front.sepia.ceph.com' 2024-04-04T06:52:33.593 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-04T06:52:33.748 DEBUG:teuthology.orchestra.run.smithi117:> true 2024-04-04T06:52:33.897 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi117.front.sepia.ceph.com' 2024-04-04T06:52:33.898 INFO:teuthology.run_tasks:Running task clock... 2024-04-04T06:52:33.909 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-04-04T06:52:33.909 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-04T06:52:33.909 DEBUG:teuthology.orchestra.run.smithi072:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-04T06:52:33.917 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-04T06:52:33.917 DEBUG:teuthology.orchestra.run.smithi117:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-04T06:52:34.014 INFO:teuthology.orchestra.run.smithi117.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-04T06:52:34.015 INFO:teuthology.orchestra.run.smithi072.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-04T06:52:34.065 INFO:teuthology.orchestra.run.smithi117.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-04T06:52:34.067 INFO:teuthology.orchestra.run.smithi072.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-04T06:52:34.157 INFO:teuthology.orchestra.run.smithi117.stderr:sudo: ntpd: command not found 2024-04-04T06:52:34.163 INFO:teuthology.orchestra.run.smithi072.stderr:sudo: ntpd: command not found 2024-04-04T06:52:34.201 INFO:teuthology.orchestra.run.smithi117.stdout:506 Cannot talk to daemon 2024-04-04T06:52:34.209 INFO:teuthology.orchestra.run.smithi072.stdout:506 Cannot talk to daemon 2024-04-04T06:52:34.252 INFO:teuthology.orchestra.run.smithi117.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-04T06:52:34.260 INFO:teuthology.orchestra.run.smithi072.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-04T06:52:34.303 INFO:teuthology.orchestra.run.smithi117.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-04T06:52:34.314 INFO:teuthology.orchestra.run.smithi072.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-04T06:52:34.435 INFO:teuthology.orchestra.run.smithi117.stderr:bash: line 1: ntpq: command not found 2024-04-04T06:52:34.440 INFO:teuthology.orchestra.run.smithi072.stderr:bash: line 1: ntpq: command not found 2024-04-04T06:52:34.443 INFO:teuthology.orchestra.run.smithi117.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-04T06:52:34.443 INFO:teuthology.orchestra.run.smithi117.stdout:=============================================================================== 2024-04-04T06:52:34.444 INFO:teuthology.orchestra.run.smithi117.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-04T06:52:34.444 INFO:teuthology.orchestra.run.smithi117.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-04T06:52:34.444 INFO:teuthology.orchestra.run.smithi117.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-04T06:52:34.444 INFO:teuthology.orchestra.run.smithi117.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-04T06:52:34.449 INFO:teuthology.orchestra.run.smithi072.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-04T06:52:34.449 INFO:teuthology.orchestra.run.smithi072.stdout:=============================================================================== 2024-04-04T06:52:34.449 INFO:teuthology.orchestra.run.smithi072.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-04T06:52:34.449 INFO:teuthology.orchestra.run.smithi072.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-04T06:52:34.450 INFO:teuthology.orchestra.run.smithi072.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-04T06:52:34.450 INFO:teuthology.orchestra.run.smithi072.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-04T06:52:34.451 INFO:teuthology.run_tasks:Running task install... 2024-04-04T06:52:34.459 DEBUG:teuthology.task.install:project ceph 2024-04-04T06:52:34.459 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'addbc488dc763e752c640619b677f10e0da02c9f'}} 2024-04-04T06:52:34.460 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'addbc488dc763e752c640619b677f10e0da02c9f'} 2024-04-04T06:52:34.460 INFO:teuthology.task.install:Using flavor: default 2024-04-04T06:52:34.465 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-04-04T06:52:34.465 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-04-04T06:52:34.466 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'addbc488dc763e752c640619b677f10e0da02c9f', 'tag': None, 'wait_for_package': False} 2024-04-04T06:52:34.466 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=addbc488dc763e752c640619b677f10e0da02c9f 2024-04-04T06:52:34.469 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'addbc488dc763e752c640619b677f10e0da02c9f', 'tag': None, 'wait_for_package': False} 2024-04-04T06:52:34.469 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=addbc488dc763e752c640619b677f10e0da02c9f 2024-04-04T06:52:34.691 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240330.172700/addbc488dc763e752c640619b677f10e0da02c9f/centos/9/flavors/default/ 2024-04-04T06:52:34.692 INFO:teuthology.task.install.rpm:Package version is 19.0.0-2571.gaddbc488 2024-04-04T06:52:34.697 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240330.172700/addbc488dc763e752c640619b677f10e0da02c9f/centos/9/flavors/default/ 2024-04-04T06:52:34.697 INFO:teuthology.task.install.rpm:Package version is 19.0.0-2571.gaddbc488 2024-04-04T06:52:35.016 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240330.172700/addbc488dc763e752c640619b677f10e0da02c9f/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240330.172700/addbc488dc763e752c640619b677f10e0da02c9f/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240330.172700/addbc488dc763e752c640619b677f10e0da02c9f/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-04T06:52:35.016 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-04-04T06:52:35.016 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-04T06:52:35.054 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240330.172700/addbc488dc763e752c640619b677f10e0da02c9f/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240330.172700/addbc488dc763e752c640619b677f10e0da02c9f/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240330.172700/addbc488dc763e752c640619b677f10e0da02c9f/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-04T06:52:35.054 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-04-04T06:52:35.054 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-04T06:52:35.116 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-04-04T06:52:35.116 DEBUG:teuthology.orchestra.run.smithi072:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/addbc488dc763e752c640619b677f10e0da02c9f/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-04T06:52:35.155 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-04-04T06:52:35.155 DEBUG:teuthology.orchestra.run.smithi117:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/addbc488dc763e752c640619b677f10e0da02c9f/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-04T06:52:35.251 DEBUG:teuthology.orchestra.run.smithi072:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-04T06:52:35.294 DEBUG:teuthology.orchestra.run.smithi117:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-04T06:52:35.380 DEBUG:teuthology.orchestra.run.smithi072:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-04T06:52:35.423 DEBUG:teuthology.orchestra.run.smithi117:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-04T06:52:35.464 INFO:teuthology.orchestra.run.smithi072.stdout:check_obsoletes = 1 2024-04-04T06:52:35.468 DEBUG:teuthology.orchestra.run.smithi072:> sudo yum clean all 2024-04-04T06:52:35.510 INFO:teuthology.orchestra.run.smithi117.stdout:check_obsoletes = 1 2024-04-04T06:52:35.514 DEBUG:teuthology.orchestra.run.smithi117:> sudo yum clean all 2024-04-04T06:52:35.822 INFO:teuthology.orchestra.run.smithi072.stdout:74 files removed 2024-04-04T06:52:35.856 INFO:teuthology.orchestra.run.smithi117.stdout:74 files removed 2024-04-04T06:52:35.864 DEBUG:teuthology.orchestra.run.smithi072:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-04-04T06:52:35.894 DEBUG:teuthology.orchestra.run.smithi117:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-04-04T06:52:37.216 INFO:teuthology.orchestra.run.smithi072.stdout:ceph packages for x86_64 98 kB/s | 83 kB 00:00 2024-04-04T06:52:37.233 INFO:teuthology.orchestra.run.smithi117.stdout:ceph packages for x86_64 98 kB/s | 83 kB 00:00 2024-04-04T06:52:38.142 INFO:teuthology.orchestra.run.smithi072.stdout:ceph noarch packages 14 kB/s | 12 kB 00:00 2024-04-04T06:52:38.208 INFO:teuthology.orchestra.run.smithi117.stdout:ceph noarch packages 13 kB/s | 12 kB 00:00 2024-04-04T06:52:38.894 INFO:teuthology.orchestra.run.smithi072.stdout:ceph source packages 2.8 kB/s | 1.9 kB 00:00 2024-04-04T06:52:38.985 INFO:teuthology.orchestra.run.smithi117.stdout:ceph source packages 2.7 kB/s | 1.9 kB 00:00 2024-04-04T06:52:39.532 INFO:teuthology.orchestra.run.smithi072.stdout:CentOS-9 - AppStream 12 MB/s | 6.7 MB 00:00 2024-04-04T06:52:39.646 INFO:teuthology.orchestra.run.smithi117.stdout:CentOS-9 - AppStream 11 MB/s | 6.7 MB 00:00 2024-04-04T06:52:41.157 INFO:teuthology.orchestra.run.smithi072.stdout:CentOS-9 - BaseOS 6.3 MB/s | 2.0 MB 00:00 2024-04-04T06:52:41.297 INFO:teuthology.orchestra.run.smithi117.stdout:CentOS-9 - BaseOS 5.7 MB/s | 2.0 MB 00:00 2024-04-04T06:52:42.234 INFO:teuthology.orchestra.run.smithi117.stdout:CentOS Stream 9 - BaseOS 14 MB/s | 8.0 MB 00:00 2024-04-04T06:52:44.507 INFO:teuthology.orchestra.run.smithi072.stdout:CentOS Stream 9 - BaseOS 2.7 MB/s | 8.0 MB 00:02 2024-04-04T06:52:46.642 INFO:teuthology.orchestra.run.smithi072.stdout:CentOS Stream 9 - AppStream 21 MB/s | 19 MB 00:00 2024-04-04T06:52:51.037 INFO:teuthology.orchestra.run.smithi072.stdout:CentOS Stream 9 - CRB 11 MB/s | 6.1 MB 00:00 2024-04-04T06:52:52.698 INFO:teuthology.orchestra.run.smithi072.stdout:CentOS Stream 9 - Extras packages 48 kB/s | 16 kB 00:00 2024-04-04T06:52:57.268 INFO:teuthology.orchestra.run.smithi072.stdout:Extra Packages for Enterprise Linux 4.7 MB/s | 21 MB 00:04 2024-04-04T06:52:58.332 INFO:teuthology.orchestra.run.smithi117.stdout:CentOS Stream 9 - AppStream 1.3 MB/s | 19 MB 00:14 2024-04-04T06:53:03.060 INFO:teuthology.orchestra.run.smithi072.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-04-04T06:53:05.884 INFO:teuthology.orchestra.run.smithi072.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-04T06:53:05.886 INFO:teuthology.orchestra.run.smithi072.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-04T06:53:05.907 INFO:teuthology.orchestra.run.smithi072.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2024-04-04T06:53:05.909 INFO:teuthology.orchestra.run.smithi072.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-04-04T06:53:05.910 INFO:teuthology.orchestra.run.smithi072.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2024-04-04T06:53:05.912 INFO:teuthology.orchestra.run.smithi072.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2024-04-04T06:53:05.914 INFO:teuthology.orchestra.run.smithi072.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-04-04T06:53:05.918 INFO:teuthology.orchestra.run.smithi072.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2024-04-04T06:53:05.919 INFO:teuthology.orchestra.run.smithi072.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2024-04-04T06:53:06.007 INFO:teuthology.orchestra.run.smithi072.stdout:Dependencies resolved. 2024-04-04T06:53:06.045 INFO:teuthology.orchestra.run.smithi072.stdout:============================================================================================ 2024-04-04T06:53:06.045 INFO:teuthology.orchestra.run.smithi072.stdout: Package Arch Version Repository Size 2024-04-04T06:53:06.045 INFO:teuthology.orchestra.run.smithi072.stdout:============================================================================================ 2024-04-04T06:53:06.045 INFO:teuthology.orchestra.run.smithi072.stdout:Installing: 2024-04-04T06:53:06.045 INFO:teuthology.orchestra.run.smithi072.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2024-04-04T06:53:06.045 INFO:teuthology.orchestra.run.smithi072.stdout: ceph x86_64 2:19.0.0-2571.gaddbc488.el9 ceph 6.6 k 2024-04-04T06:53:06.046 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-base x86_64 2:19.0.0-2571.gaddbc488.el9 ceph 5.4 M 2024-04-04T06:53:06.046 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-fuse x86_64 2:19.0.0-2571.gaddbc488.el9 ceph 890 k 2024-04-04T06:53:06.046 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-2571.gaddbc488.el9 ceph 145 k 2024-04-04T06:53:06.046 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr x86_64 2:19.0.0-2571.gaddbc488.el9 ceph 1.5 M 2024-04-04T06:53:06.046 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-cephadm noarch 2:19.0.0-2571.gaddbc488.el9 ceph-noarch 141 k 2024-04-04T06:53:06.046 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-dashboard noarch 2:19.0.0-2571.gaddbc488.el9 ceph-noarch 3.5 M 2024-04-04T06:53:06.046 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-2571.gaddbc488.el9 ceph-noarch 7.4 M 2024-04-04T06:53:06.046 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-rook noarch 2:19.0.0-2571.gaddbc488.el9 ceph-noarch 49 k 2024-04-04T06:53:06.046 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-radosgw x86_64 2:19.0.0-2571.gaddbc488.el9 ceph 9.8 M 2024-04-04T06:53:06.046 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-test x86_64 2:19.0.0-2571.gaddbc488.el9 ceph 48 M 2024-04-04T06:53:06.046 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-volume noarch 2:19.0.0-2571.gaddbc488.el9 ceph-noarch 264 k 2024-04-04T06:53:06.047 INFO:teuthology.orchestra.run.smithi072.stdout: cephadm noarch 2:19.0.0-2571.gaddbc488.el9 ceph-noarch 762 k 2024-04-04T06:53:06.047 INFO:teuthology.orchestra.run.smithi072.stdout: cephfs-mirror x86_64 2:19.0.0-2571.gaddbc488.el9 ceph 225 k 2024-04-04T06:53:06.047 INFO:teuthology.orchestra.run.smithi072.stdout: cephfs-shell x86_64 2:19.0.0-2571.gaddbc488.el9 ceph 27 k 2024-04-04T06:53:06.047 INFO:teuthology.orchestra.run.smithi072.stdout: cephfs-top noarch 2:19.0.0-2571.gaddbc488.el9 ceph-noarch 18 k 2024-04-04T06:53:06.047 INFO:teuthology.orchestra.run.smithi072.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-04-04T06:53:06.047 INFO:teuthology.orchestra.run.smithi072.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2024-04-04T06:53:06.047 INFO:teuthology.orchestra.run.smithi072.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2024-04-04T06:53:06.047 INFO:teuthology.orchestra.run.smithi072.stdout: libcephfs-devel x86_64 2:19.0.0-2571.gaddbc488.el9 ceph 32 k 2024-04-04T06:53:06.047 INFO:teuthology.orchestra.run.smithi072.stdout: libcephfs2 x86_64 2:19.0.0-2571.gaddbc488.el9 ceph 746 k 2024-04-04T06:53:06.047 INFO:teuthology.orchestra.run.smithi072.stdout: librados-devel x86_64 2:19.0.0-2571.gaddbc488.el9 ceph 127 k 2024-04-04T06:53:06.047 INFO:teuthology.orchestra.run.smithi072.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2024-04-04T06:53:06.047 INFO:teuthology.orchestra.run.smithi072.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-04-04T06:53:06.047 INFO:teuthology.orchestra.run.smithi072.stdout: openssl-devel x86_64 1:3.0.7-27.el9 appstream 4.1 M 2024-04-04T06:53:06.048 INFO:teuthology.orchestra.run.smithi072.stdout: postgresql x86_64 13.14-1.el9 CentOS-AppStream 1.5 M 2024-04-04T06:53:06.048 INFO:teuthology.orchestra.run.smithi072.stdout: postgresql-contrib x86_64 13.14-1.el9 CentOS-AppStream 817 k 2024-04-04T06:53:06.048 INFO:teuthology.orchestra.run.smithi072.stdout: postgresql-server x86_64 13.14-1.el9 CentOS-AppStream 5.7 M 2024-04-04T06:53:06.048 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cephfs x86_64 2:19.0.0-2571.gaddbc488.el9 ceph 161 k 2024-04-04T06:53:06.048 INFO:teuthology.orchestra.run.smithi072.stdout: python3-rados x86_64 2:19.0.0-2571.gaddbc488.el9 ceph 320 k 2024-04-04T06:53:06.048 INFO:teuthology.orchestra.run.smithi072.stdout: python3-rbd x86_64 2:19.0.0-2571.gaddbc488.el9 ceph 298 k 2024-04-04T06:53:06.048 INFO:teuthology.orchestra.run.smithi072.stdout: python3-rgw x86_64 2:19.0.0-2571.gaddbc488.el9 ceph 99 k 2024-04-04T06:53:06.048 INFO:teuthology.orchestra.run.smithi072.stdout: rbd-fuse x86_64 2:19.0.0-2571.gaddbc488.el9 ceph 85 k 2024-04-04T06:53:06.048 INFO:teuthology.orchestra.run.smithi072.stdout: rbd-mirror x86_64 2:19.0.0-2571.gaddbc488.el9 ceph 3.1 M 2024-04-04T06:53:06.048 INFO:teuthology.orchestra.run.smithi072.stdout: rbd-nbd x86_64 2:19.0.0-2571.gaddbc488.el9 ceph 170 k 2024-04-04T06:53:06.048 INFO:teuthology.orchestra.run.smithi072.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-04-04T06:53:06.048 INFO:teuthology.orchestra.run.smithi072.stdout:Upgrading: 2024-04-04T06:53:06.049 INFO:teuthology.orchestra.run.smithi072.stdout: NetworkManager x86_64 1:1.47.2-1.el9 CentOS-BaseOS 2.3 M 2024-04-04T06:53:06.049 INFO:teuthology.orchestra.run.smithi072.stdout: NetworkManager-libnm x86_64 1:1.47.2-1.el9 CentOS-BaseOS 1.8 M 2024-04-04T06:53:06.049 INFO:teuthology.orchestra.run.smithi072.stdout: NetworkManager-team x86_64 1:1.47.2-1.el9 CentOS-BaseOS 41 k 2024-04-04T06:53:06.049 INFO:teuthology.orchestra.run.smithi072.stdout: NetworkManager-tui x86_64 1:1.47.2-1.el9 CentOS-BaseOS 247 k 2024-04-04T06:53:06.049 INFO:teuthology.orchestra.run.smithi072.stdout: acl x86_64 2.3.1-4.el9 baseos 71 k 2024-04-04T06:53:06.049 INFO:teuthology.orchestra.run.smithi072.stdout: elfutils-debuginfod-client x86_64 0.190-2.el9 baseos 36 k 2024-04-04T06:53:06.049 INFO:teuthology.orchestra.run.smithi072.stdout: elfutils-libelf x86_64 0.190-2.el9 baseos 192 k 2024-04-04T06:53:06.049 INFO:teuthology.orchestra.run.smithi072.stdout: elfutils-libs x86_64 0.190-2.el9 baseos 256 k 2024-04-04T06:53:06.049 INFO:teuthology.orchestra.run.smithi072.stdout: libacl x86_64 2.3.1-4.el9 baseos 23 k 2024-04-04T06:53:06.049 INFO:teuthology.orchestra.run.smithi072.stdout: libacl-devel x86_64 2.3.1-4.el9 appstream 74 k 2024-04-04T06:53:06.049 INFO:teuthology.orchestra.run.smithi072.stdout: libblkid x86_64 2.37.4-18.el9 baseos 108 k 2024-04-04T06:53:06.049 INFO:teuthology.orchestra.run.smithi072.stdout: libfdisk x86_64 2.37.4-18.el9 baseos 155 k 2024-04-04T06:53:06.049 INFO:teuthology.orchestra.run.smithi072.stdout: libmount x86_64 2.37.4-18.el9 baseos 136 k 2024-04-04T06:53:06.049 INFO:teuthology.orchestra.run.smithi072.stdout: librados2 x86_64 2:19.0.0-2571.gaddbc488.el9 ceph 3.4 M 2024-04-04T06:53:06.050 INFO:teuthology.orchestra.run.smithi072.stdout: librbd1 x86_64 2:19.0.0-2571.gaddbc488.el9 ceph 3.1 M 2024-04-04T06:53:06.050 INFO:teuthology.orchestra.run.smithi072.stdout: libsmartcols x86_64 2.37.4-18.el9 baseos 64 k 2024-04-04T06:53:06.050 INFO:teuthology.orchestra.run.smithi072.stdout: libuuid x86_64 2.37.4-18.el9 baseos 29 k 2024-04-04T06:53:06.050 INFO:teuthology.orchestra.run.smithi072.stdout: openssl x86_64 1:3.0.7-27.el9 baseos 1.2 M 2024-04-04T06:53:06.050 INFO:teuthology.orchestra.run.smithi072.stdout: openssl-libs x86_64 1:3.0.7-27.el9 baseos 2.2 M 2024-04-04T06:53:06.050 INFO:teuthology.orchestra.run.smithi072.stdout: util-linux x86_64 2.37.4-18.el9 baseos 2.3 M 2024-04-04T06:53:06.050 INFO:teuthology.orchestra.run.smithi072.stdout: util-linux-core x86_64 2.37.4-18.el9 baseos 465 k 2024-04-04T06:53:06.050 INFO:teuthology.orchestra.run.smithi072.stdout: util-linux-user x86_64 2.37.4-18.el9 baseos 31 k 2024-04-04T06:53:06.050 INFO:teuthology.orchestra.run.smithi072.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2024-04-04T06:53:06.050 INFO:teuthology.orchestra.run.smithi072.stdout: xfsprogs x86_64 6.3.0-1.el9 baseos 1.1 M 2024-04-04T06:53:06.050 INFO:teuthology.orchestra.run.smithi072.stdout:Installing dependencies: 2024-04-04T06:53:06.050 INFO:teuthology.orchestra.run.smithi072.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-04-04T06:53:06.051 INFO:teuthology.orchestra.run.smithi072.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2024-04-04T06:53:06.051 INFO:teuthology.orchestra.run.smithi072.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2024-04-04T06:53:06.051 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-common x86_64 2:19.0.0-2571.gaddbc488.el9 ceph 21 M 2024-04-04T06:53:06.051 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-grafana-dashboards noarch 2:19.0.0-2571.gaddbc488.el9 ceph-noarch 34 k 2024-04-04T06:53:06.051 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mds x86_64 2:19.0.0-2571.gaddbc488.el9 ceph 2.4 M 2024-04-04T06:53:06.051 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-modules-core noarch 2:19.0.0-2571.gaddbc488.el9 ceph-noarch 249 k 2024-04-04T06:53:06.051 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mon x86_64 2:19.0.0-2571.gaddbc488.el9 ceph 4.7 M 2024-04-04T06:53:06.051 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-osd x86_64 2:19.0.0-2571.gaddbc488.el9 ceph 17 M 2024-04-04T06:53:06.051 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-prometheus-alerts noarch 2:19.0.0-2571.gaddbc488.el9 ceph-noarch 16 k 2024-04-04T06:53:06.051 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-selinux x86_64 2:19.0.0-2571.gaddbc488.el9 ceph 25 k 2024-04-04T06:53:06.051 INFO:teuthology.orchestra.run.smithi072.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2024-04-04T06:53:06.051 INFO:teuthology.orchestra.run.smithi072.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2024-04-04T06:53:06.051 INFO:teuthology.orchestra.run.smithi072.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2024-04-04T06:53:06.052 INFO:teuthology.orchestra.run.smithi072.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2024-04-04T06:53:06.052 INFO:teuthology.orchestra.run.smithi072.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-04T06:53:06.052 INFO:teuthology.orchestra.run.smithi072.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-04-04T06:53:06.052 INFO:teuthology.orchestra.run.smithi072.stdout: jq x86_64 1.6-16.el9 baseos 187 k 2024-04-04T06:53:06.052 INFO:teuthology.orchestra.run.smithi072.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-04-04T06:53:06.052 INFO:teuthology.orchestra.run.smithi072.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-04-04T06:53:06.052 INFO:teuthology.orchestra.run.smithi072.stdout: libcephsqlite x86_64 2:19.0.0-2571.gaddbc488.el9 ceph 163 k 2024-04-04T06:53:06.052 INFO:teuthology.orchestra.run.smithi072.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-04T06:53:06.052 INFO:teuthology.orchestra.run.smithi072.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-04T06:53:06.052 INFO:teuthology.orchestra.run.smithi072.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2024-04-04T06:53:06.052 INFO:teuthology.orchestra.run.smithi072.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-04T06:53:06.052 INFO:teuthology.orchestra.run.smithi072.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2024-04-04T06:53:06.052 INFO:teuthology.orchestra.run.smithi072.stdout: libradosstriper1 x86_64 2:19.0.0-2571.gaddbc488.el9 ceph 500 k 2024-04-04T06:53:06.053 INFO:teuthology.orchestra.run.smithi072.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2024-04-04T06:53:06.053 INFO:teuthology.orchestra.run.smithi072.stdout: librgw2 x86_64 2:19.0.0-2571.gaddbc488.el9 ceph 5.1 M 2024-04-04T06:53:06.053 INFO:teuthology.orchestra.run.smithi072.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-04T06:53:06.053 INFO:teuthology.orchestra.run.smithi072.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2024-04-04T06:53:06.053 INFO:teuthology.orchestra.run.smithi072.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2024-04-04T06:53:06.053 INFO:teuthology.orchestra.run.smithi072.stdout: lua x86_64 5.4.4-4.el9 CentOS-AppStream 187 k 2024-04-04T06:53:06.053 INFO:teuthology.orchestra.run.smithi072.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-04-04T06:53:06.053 INFO:teuthology.orchestra.run.smithi072.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-04-04T06:53:06.053 INFO:teuthology.orchestra.run.smithi072.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2024-04-04T06:53:06.053 INFO:teuthology.orchestra.run.smithi072.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2024-04-04T06:53:06.053 INFO:teuthology.orchestra.run.smithi072.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2024-04-04T06:53:06.053 INFO:teuthology.orchestra.run.smithi072.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-04-04T06:53:06.053 INFO:teuthology.orchestra.run.smithi072.stdout: postgresql-private-libs x86_64 13.14-1.el9 CentOS-AppStream 132 k 2024-04-04T06:53:06.054 INFO:teuthology.orchestra.run.smithi072.stdout: protobuf x86_64 3.14.0-13.el9 CentOS-AppStream 1.0 M 2024-04-04T06:53:06.054 INFO:teuthology.orchestra.run.smithi072.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-04-04T06:53:06.054 INFO:teuthology.orchestra.run.smithi072.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-04T06:53:06.054 INFO:teuthology.orchestra.run.smithi072.stdout: python3-attrs noarch 20.3.0-7.el9 CentOS-AppStream 78 k 2024-04-04T06:53:06.054 INFO:teuthology.orchestra.run.smithi072.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2024-04-04T06:53:06.054 INFO:teuthology.orchestra.run.smithi072.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-04T06:53:06.054 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-04T06:53:06.054 INFO:teuthology.orchestra.run.smithi072.stdout: python3-ceph-argparse x86_64 2:19.0.0-2571.gaddbc488.el9 ceph 45 k 2024-04-04T06:53:06.054 INFO:teuthology.orchestra.run.smithi072.stdout: python3-ceph-common x86_64 2:19.0.0-2571.gaddbc488.el9 ceph 134 k 2024-04-04T06:53:06.054 INFO:teuthology.orchestra.run.smithi072.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-04T06:53:06.054 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2024-04-04T06:53:06.055 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-04T06:53:06.055 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-04T06:53:06.055 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-04-04T06:53:06.055 INFO:teuthology.orchestra.run.smithi072.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-04-04T06:53:06.055 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2024-04-04T06:53:06.055 INFO:teuthology.orchestra.run.smithi072.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-04-04T06:53:06.055 INFO:teuthology.orchestra.run.smithi072.stdout: python3-google-auth noarch 1:2.28.2-1.el9 epel 203 k 2024-04-04T06:53:06.055 INFO:teuthology.orchestra.run.smithi072.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-04-04T06:53:06.055 INFO:teuthology.orchestra.run.smithi072.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-04-04T06:53:06.055 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-04T06:53:06.055 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-04T06:53:06.055 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-04-04T06:53:06.055 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-04T06:53:06.056 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-04T06:53:06.056 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-04T06:53:06.056 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2024-04-04T06:53:06.056 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2024-04-04T06:53:06.056 INFO:teuthology.orchestra.run.smithi072.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-04T06:53:06.056 INFO:teuthology.orchestra.run.smithi072.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-04T06:53:06.056 INFO:teuthology.orchestra.run.smithi072.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2024-04-04T06:53:06.056 INFO:teuthology.orchestra.run.smithi072.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2024-04-04T06:53:06.056 INFO:teuthology.orchestra.run.smithi072.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-04T06:53:06.056 INFO:teuthology.orchestra.run.smithi072.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-04T06:53:06.056 INFO:teuthology.orchestra.run.smithi072.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2024-04-04T06:53:06.056 INFO:teuthology.orchestra.run.smithi072.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2024-04-04T06:53:06.056 INFO:teuthology.orchestra.run.smithi072.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2024-04-04T06:53:06.056 INFO:teuthology.orchestra.run.smithi072.stdout: python3-packaging noarch 20.9-5.el9 CentOS-AppStream 69 k 2024-04-04T06:53:06.057 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-04T06:53:06.057 INFO:teuthology.orchestra.run.smithi072.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2024-04-04T06:53:06.057 INFO:teuthology.orchestra.run.smithi072.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-04T06:53:06.057 INFO:teuthology.orchestra.run.smithi072.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2024-04-04T06:53:06.057 INFO:teuthology.orchestra.run.smithi072.stdout: python3-protobuf noarch 3.14.0-13.el9 CentOS-AppStream 238 k 2024-04-04T06:53:06.057 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-04T06:53:06.057 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2024-04-04T06:53:06.057 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2024-04-04T06:53:06.057 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2024-04-04T06:53:06.057 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-04-04T06:53:06.057 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2024-04-04T06:53:06.057 INFO:teuthology.orchestra.run.smithi072.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-04T06:53:06.057 INFO:teuthology.orchestra.run.smithi072.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-04T06:53:06.057 INFO:teuthology.orchestra.run.smithi072.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2024-04-04T06:53:06.058 INFO:teuthology.orchestra.run.smithi072.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-04T06:53:06.058 INFO:teuthology.orchestra.run.smithi072.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-04T06:53:06.058 INFO:teuthology.orchestra.run.smithi072.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2024-04-04T06:53:06.058 INFO:teuthology.orchestra.run.smithi072.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-04T06:53:06.058 INFO:teuthology.orchestra.run.smithi072.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2024-04-04T06:53:06.058 INFO:teuthology.orchestra.run.smithi072.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-04T06:53:06.058 INFO:teuthology.orchestra.run.smithi072.stdout: python3-urllib3 noarch 1.26.5-5.el9 CentOS-BaseOS 187 k 2024-04-04T06:53:06.058 INFO:teuthology.orchestra.run.smithi072.stdout: python3-wcwidth noarch 0.2.5-8.el9 CentOS-AppStream 41 k 2024-04-04T06:53:06.058 INFO:teuthology.orchestra.run.smithi072.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-04T06:53:06.058 INFO:teuthology.orchestra.run.smithi072.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-04T06:53:06.058 INFO:teuthology.orchestra.run.smithi072.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-04T06:53:06.058 INFO:teuthology.orchestra.run.smithi072.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-04T06:53:06.058 INFO:teuthology.orchestra.run.smithi072.stdout: qatlib x86_64 24.02.0-1.el9 CentOS-AppStream 220 k 2024-04-04T06:53:06.058 INFO:teuthology.orchestra.run.smithi072.stdout: qatzip-libs x86_64 1.2.0-1.el9 CentOS-AppStream 46 k 2024-04-04T06:53:06.059 INFO:teuthology.orchestra.run.smithi072.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-04T06:53:06.059 INFO:teuthology.orchestra.run.smithi072.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2024-04-04T06:53:06.059 INFO:teuthology.orchestra.run.smithi072.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-04T06:53:06.059 INFO:teuthology.orchestra.run.smithi072.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2024-04-04T06:53:06.059 INFO:teuthology.orchestra.run.smithi072.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2024-04-04T06:53:06.059 INFO:teuthology.orchestra.run.smithi072.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2024-04-04T06:53:06.059 INFO:teuthology.orchestra.run.smithi072.stdout:Installing weak dependencies: 2024-04-04T06:53:06.059 INFO:teuthology.orchestra.run.smithi072.stdout: qatlib-service x86_64 24.02.0-1.el9 CentOS-AppStream 35 k 2024-04-04T06:53:06.059 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T06:53:06.059 INFO:teuthology.orchestra.run.smithi072.stdout:Transaction Summary 2024-04-04T06:53:06.059 INFO:teuthology.orchestra.run.smithi072.stdout:============================================================================================ 2024-04-04T06:53:06.059 INFO:teuthology.orchestra.run.smithi072.stdout:Install 150 Packages 2024-04-04T06:53:06.059 INFO:teuthology.orchestra.run.smithi072.stdout:Upgrade 24 Packages 2024-04-04T06:53:06.059 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T06:53:06.060 INFO:teuthology.orchestra.run.smithi072.stdout:Total download size: 226 M 2024-04-04T06:53:06.060 INFO:teuthology.orchestra.run.smithi072.stdout:Downloading Packages: 2024-04-04T06:53:06.090 INFO:teuthology.orchestra.run.smithi117.stdout:CentOS Stream 9 - CRB 1.7 MB/s | 6.1 MB 00:03 2024-04-04T06:53:07.357 INFO:teuthology.orchestra.run.smithi072.stdout:(1/174): ceph-19.0.0-2571.gaddbc488.el9.x86_64. 18 kB/s | 6.6 kB 00:00 2024-04-04T06:53:07.632 INFO:teuthology.orchestra.run.smithi117.stdout:CentOS Stream 9 - Extras packages 75 kB/s | 16 kB 00:00 2024-04-04T06:53:08.118 INFO:teuthology.orchestra.run.smithi072.stdout:(2/174): ceph-fuse-19.0.0-2571.gaddbc488.el9.x8 1.1 MB/s | 890 kB 00:00 2024-04-04T06:53:08.291 INFO:teuthology.orchestra.run.smithi072.stdout:(3/174): ceph-immutable-object-cache-19.0.0-257 832 kB/s | 145 kB 00:00 2024-04-04T06:53:09.066 INFO:teuthology.orchestra.run.smithi072.stdout:(4/174): ceph-base-19.0.0-2571.gaddbc488.el9.x8 2.6 MB/s | 5.4 MB 00:02 2024-04-04T06:53:09.464 INFO:teuthology.orchestra.run.smithi117.stdout:Extra Packages for Enterprise Linux 13 MB/s | 21 MB 00:01 2024-04-04T06:53:09.483 INFO:teuthology.orchestra.run.smithi072.stdout:(5/174): ceph-mgr-19.0.0-2571.gaddbc488.el9.x86 3.6 MB/s | 1.5 MB 00:00 2024-04-04T06:53:09.892 INFO:teuthology.orchestra.run.smithi072.stdout:(6/174): ceph-mds-19.0.0-2571.gaddbc488.el9.x86 1.5 MB/s | 2.4 MB 00:01 2024-04-04T06:53:10.968 INFO:teuthology.orchestra.run.smithi072.stdout:(7/174): ceph-mon-19.0.0-2571.gaddbc488.el9.x86 3.2 MB/s | 4.7 MB 00:01 2024-04-04T06:53:13.619 INFO:teuthology.orchestra.run.smithi072.stdout:(8/174): ceph-radosgw-19.0.0-2571.gaddbc488.el9 3.7 MB/s | 9.8 MB 00:02 2024-04-04T06:53:13.710 INFO:teuthology.orchestra.run.smithi072.stdout:(9/174): ceph-selinux-19.0.0-2571.gaddbc488.el9 277 kB/s | 25 kB 00:00 2024-04-04T06:53:15.350 INFO:teuthology.orchestra.run.smithi117.stdout:lab-extras 27 kB/s | 1.7 kB 00:00 2024-04-04T06:53:16.619 INFO:teuthology.orchestra.run.smithi072.stdout:(10/174): ceph-common-19.0.0-2571.gaddbc488.el9 2.1 MB/s | 21 MB 00:09 2024-04-04T06:53:16.870 INFO:teuthology.orchestra.run.smithi072.stdout:(11/174): cephfs-mirror-19.0.0-2571.gaddbc488.e 903 kB/s | 225 kB 00:00 2024-04-04T06:53:16.987 INFO:teuthology.orchestra.run.smithi072.stdout:(12/174): cephfs-shell-19.0.0-2571.gaddbc488.el 233 kB/s | 27 kB 00:00 2024-04-04T06:53:17.137 INFO:teuthology.orchestra.run.smithi072.stdout:(13/174): libcephfs-devel-19.0.0-2571.gaddbc488 212 kB/s | 32 kB 00:00 2024-04-04T06:53:17.773 INFO:teuthology.orchestra.run.smithi072.stdout:(14/174): ceph-osd-19.0.0-2571.gaddbc488.el9.x8 2.1 MB/s | 17 MB 00:07 2024-04-04T06:53:17.815 INFO:teuthology.orchestra.run.smithi072.stdout:(15/174): libcephfs2-19.0.0-2571.gaddbc488.el9. 1.1 MB/s | 746 kB 00:00 2024-04-04T06:53:18.057 INFO:teuthology.orchestra.run.smithi072.stdout:(16/174): libcephsqlite-19.0.0-2571.gaddbc488.e 577 kB/s | 163 kB 00:00 2024-04-04T06:53:18.116 INFO:teuthology.orchestra.run.smithi072.stdout:(17/174): librados-devel-19.0.0-2571.gaddbc488. 422 kB/s | 127 kB 00:00 2024-04-04T06:53:18.124 INFO:teuthology.orchestra.run.smithi117.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-04T06:53:18.126 INFO:teuthology.orchestra.run.smithi117.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-04T06:53:18.147 INFO:teuthology.orchestra.run.smithi117.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2024-04-04T06:53:18.148 INFO:teuthology.orchestra.run.smithi117.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-04-04T06:53:18.150 INFO:teuthology.orchestra.run.smithi117.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2024-04-04T06:53:18.151 INFO:teuthology.orchestra.run.smithi117.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2024-04-04T06:53:18.153 INFO:teuthology.orchestra.run.smithi117.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-04-04T06:53:18.157 INFO:teuthology.orchestra.run.smithi117.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2024-04-04T06:53:18.158 INFO:teuthology.orchestra.run.smithi117.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2024-04-04T06:53:18.244 INFO:teuthology.orchestra.run.smithi117.stdout:Dependencies resolved. 2024-04-04T06:53:18.265 INFO:teuthology.orchestra.run.smithi117.stdout:============================================================================================ 2024-04-04T06:53:18.265 INFO:teuthology.orchestra.run.smithi117.stdout: Package Arch Version Repository Size 2024-04-04T06:53:18.265 INFO:teuthology.orchestra.run.smithi117.stdout:============================================================================================ 2024-04-04T06:53:18.266 INFO:teuthology.orchestra.run.smithi117.stdout:Installing: 2024-04-04T06:53:18.266 INFO:teuthology.orchestra.run.smithi117.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2024-04-04T06:53:18.266 INFO:teuthology.orchestra.run.smithi117.stdout: ceph x86_64 2:19.0.0-2571.gaddbc488.el9 ceph 6.6 k 2024-04-04T06:53:18.266 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-base x86_64 2:19.0.0-2571.gaddbc488.el9 ceph 5.4 M 2024-04-04T06:53:18.266 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-fuse x86_64 2:19.0.0-2571.gaddbc488.el9 ceph 890 k 2024-04-04T06:53:18.266 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-2571.gaddbc488.el9 ceph 145 k 2024-04-04T06:53:18.266 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr x86_64 2:19.0.0-2571.gaddbc488.el9 ceph 1.5 M 2024-04-04T06:53:18.266 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-cephadm noarch 2:19.0.0-2571.gaddbc488.el9 ceph-noarch 141 k 2024-04-04T06:53:18.266 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-dashboard noarch 2:19.0.0-2571.gaddbc488.el9 ceph-noarch 3.5 M 2024-04-04T06:53:18.266 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-2571.gaddbc488.el9 ceph-noarch 7.4 M 2024-04-04T06:53:18.266 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-rook noarch 2:19.0.0-2571.gaddbc488.el9 ceph-noarch 49 k 2024-04-04T06:53:18.266 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-radosgw x86_64 2:19.0.0-2571.gaddbc488.el9 ceph 9.8 M 2024-04-04T06:53:18.267 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-test x86_64 2:19.0.0-2571.gaddbc488.el9 ceph 48 M 2024-04-04T06:53:18.267 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-volume noarch 2:19.0.0-2571.gaddbc488.el9 ceph-noarch 264 k 2024-04-04T06:53:18.267 INFO:teuthology.orchestra.run.smithi117.stdout: cephadm noarch 2:19.0.0-2571.gaddbc488.el9 ceph-noarch 762 k 2024-04-04T06:53:18.267 INFO:teuthology.orchestra.run.smithi117.stdout: cephfs-mirror x86_64 2:19.0.0-2571.gaddbc488.el9 ceph 225 k 2024-04-04T06:53:18.267 INFO:teuthology.orchestra.run.smithi117.stdout: cephfs-shell x86_64 2:19.0.0-2571.gaddbc488.el9 ceph 27 k 2024-04-04T06:53:18.267 INFO:teuthology.orchestra.run.smithi117.stdout: cephfs-top noarch 2:19.0.0-2571.gaddbc488.el9 ceph-noarch 18 k 2024-04-04T06:53:18.267 INFO:teuthology.orchestra.run.smithi117.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-04-04T06:53:18.267 INFO:teuthology.orchestra.run.smithi117.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2024-04-04T06:53:18.267 INFO:teuthology.orchestra.run.smithi117.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2024-04-04T06:53:18.267 INFO:teuthology.orchestra.run.smithi117.stdout: libcephfs-devel x86_64 2:19.0.0-2571.gaddbc488.el9 ceph 32 k 2024-04-04T06:53:18.268 INFO:teuthology.orchestra.run.smithi117.stdout: libcephfs2 x86_64 2:19.0.0-2571.gaddbc488.el9 ceph 746 k 2024-04-04T06:53:18.268 INFO:teuthology.orchestra.run.smithi117.stdout: librados-devel x86_64 2:19.0.0-2571.gaddbc488.el9 ceph 127 k 2024-04-04T06:53:18.268 INFO:teuthology.orchestra.run.smithi117.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2024-04-04T06:53:18.268 INFO:teuthology.orchestra.run.smithi117.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-04-04T06:53:18.268 INFO:teuthology.orchestra.run.smithi117.stdout: openssl-devel x86_64 1:3.0.7-27.el9 appstream 4.1 M 2024-04-04T06:53:18.268 INFO:teuthology.orchestra.run.smithi117.stdout: postgresql x86_64 13.14-1.el9 CentOS-AppStream 1.5 M 2024-04-04T06:53:18.268 INFO:teuthology.orchestra.run.smithi117.stdout: postgresql-contrib x86_64 13.14-1.el9 CentOS-AppStream 817 k 2024-04-04T06:53:18.268 INFO:teuthology.orchestra.run.smithi117.stdout: postgresql-server x86_64 13.14-1.el9 CentOS-AppStream 5.7 M 2024-04-04T06:53:18.268 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cephfs x86_64 2:19.0.0-2571.gaddbc488.el9 ceph 161 k 2024-04-04T06:53:18.268 INFO:teuthology.orchestra.run.smithi117.stdout: python3-rados x86_64 2:19.0.0-2571.gaddbc488.el9 ceph 320 k 2024-04-04T06:53:18.268 INFO:teuthology.orchestra.run.smithi117.stdout: python3-rbd x86_64 2:19.0.0-2571.gaddbc488.el9 ceph 298 k 2024-04-04T06:53:18.268 INFO:teuthology.orchestra.run.smithi117.stdout: python3-rgw x86_64 2:19.0.0-2571.gaddbc488.el9 ceph 99 k 2024-04-04T06:53:18.269 INFO:teuthology.orchestra.run.smithi117.stdout: rbd-fuse x86_64 2:19.0.0-2571.gaddbc488.el9 ceph 85 k 2024-04-04T06:53:18.269 INFO:teuthology.orchestra.run.smithi117.stdout: rbd-mirror x86_64 2:19.0.0-2571.gaddbc488.el9 ceph 3.1 M 2024-04-04T06:53:18.269 INFO:teuthology.orchestra.run.smithi117.stdout: rbd-nbd x86_64 2:19.0.0-2571.gaddbc488.el9 ceph 170 k 2024-04-04T06:53:18.269 INFO:teuthology.orchestra.run.smithi117.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-04-04T06:53:18.269 INFO:teuthology.orchestra.run.smithi117.stdout:Upgrading: 2024-04-04T06:53:18.269 INFO:teuthology.orchestra.run.smithi117.stdout: NetworkManager x86_64 1:1.47.2-1.el9 CentOS-BaseOS 2.3 M 2024-04-04T06:53:18.269 INFO:teuthology.orchestra.run.smithi117.stdout: NetworkManager-libnm x86_64 1:1.47.2-1.el9 CentOS-BaseOS 1.8 M 2024-04-04T06:53:18.269 INFO:teuthology.orchestra.run.smithi117.stdout: NetworkManager-team x86_64 1:1.47.2-1.el9 CentOS-BaseOS 41 k 2024-04-04T06:53:18.269 INFO:teuthology.orchestra.run.smithi117.stdout: NetworkManager-tui x86_64 1:1.47.2-1.el9 CentOS-BaseOS 247 k 2024-04-04T06:53:18.269 INFO:teuthology.orchestra.run.smithi117.stdout: acl x86_64 2.3.1-4.el9 baseos 71 k 2024-04-04T06:53:18.269 INFO:teuthology.orchestra.run.smithi117.stdout: elfutils-debuginfod-client x86_64 0.190-2.el9 baseos 36 k 2024-04-04T06:53:18.269 INFO:teuthology.orchestra.run.smithi117.stdout: elfutils-libelf x86_64 0.190-2.el9 baseos 192 k 2024-04-04T06:53:18.269 INFO:teuthology.orchestra.run.smithi117.stdout: elfutils-libs x86_64 0.190-2.el9 baseos 256 k 2024-04-04T06:53:18.270 INFO:teuthology.orchestra.run.smithi117.stdout: libacl x86_64 2.3.1-4.el9 baseos 23 k 2024-04-04T06:53:18.270 INFO:teuthology.orchestra.run.smithi117.stdout: libacl-devel x86_64 2.3.1-4.el9 appstream 74 k 2024-04-04T06:53:18.270 INFO:teuthology.orchestra.run.smithi117.stdout: libblkid x86_64 2.37.4-18.el9 baseos 108 k 2024-04-04T06:53:18.270 INFO:teuthology.orchestra.run.smithi117.stdout: libfdisk x86_64 2.37.4-18.el9 baseos 155 k 2024-04-04T06:53:18.270 INFO:teuthology.orchestra.run.smithi117.stdout: libmount x86_64 2.37.4-18.el9 baseos 136 k 2024-04-04T06:53:18.270 INFO:teuthology.orchestra.run.smithi117.stdout: librados2 x86_64 2:19.0.0-2571.gaddbc488.el9 ceph 3.4 M 2024-04-04T06:53:18.270 INFO:teuthology.orchestra.run.smithi117.stdout: librbd1 x86_64 2:19.0.0-2571.gaddbc488.el9 ceph 3.1 M 2024-04-04T06:53:18.270 INFO:teuthology.orchestra.run.smithi117.stdout: libsmartcols x86_64 2.37.4-18.el9 baseos 64 k 2024-04-04T06:53:18.270 INFO:teuthology.orchestra.run.smithi117.stdout: libuuid x86_64 2.37.4-18.el9 baseos 29 k 2024-04-04T06:53:18.270 INFO:teuthology.orchestra.run.smithi117.stdout: openssl x86_64 1:3.0.7-27.el9 baseos 1.2 M 2024-04-04T06:53:18.270 INFO:teuthology.orchestra.run.smithi117.stdout: openssl-libs x86_64 1:3.0.7-27.el9 baseos 2.2 M 2024-04-04T06:53:18.270 INFO:teuthology.orchestra.run.smithi117.stdout: util-linux x86_64 2.37.4-18.el9 baseos 2.3 M 2024-04-04T06:53:18.271 INFO:teuthology.orchestra.run.smithi117.stdout: util-linux-core x86_64 2.37.4-18.el9 baseos 465 k 2024-04-04T06:53:18.271 INFO:teuthology.orchestra.run.smithi117.stdout: util-linux-user x86_64 2.37.4-18.el9 baseos 31 k 2024-04-04T06:53:18.271 INFO:teuthology.orchestra.run.smithi117.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2024-04-04T06:53:18.271 INFO:teuthology.orchestra.run.smithi117.stdout: xfsprogs x86_64 6.3.0-1.el9 baseos 1.1 M 2024-04-04T06:53:18.271 INFO:teuthology.orchestra.run.smithi117.stdout:Installing dependencies: 2024-04-04T06:53:18.271 INFO:teuthology.orchestra.run.smithi117.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-04-04T06:53:18.271 INFO:teuthology.orchestra.run.smithi117.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2024-04-04T06:53:18.271 INFO:teuthology.orchestra.run.smithi117.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2024-04-04T06:53:18.271 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-common x86_64 2:19.0.0-2571.gaddbc488.el9 ceph 21 M 2024-04-04T06:53:18.271 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-grafana-dashboards noarch 2:19.0.0-2571.gaddbc488.el9 ceph-noarch 34 k 2024-04-04T06:53:18.271 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mds x86_64 2:19.0.0-2571.gaddbc488.el9 ceph 2.4 M 2024-04-04T06:53:18.271 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-modules-core noarch 2:19.0.0-2571.gaddbc488.el9 ceph-noarch 249 k 2024-04-04T06:53:18.271 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mon x86_64 2:19.0.0-2571.gaddbc488.el9 ceph 4.7 M 2024-04-04T06:53:18.272 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-osd x86_64 2:19.0.0-2571.gaddbc488.el9 ceph 17 M 2024-04-04T06:53:18.272 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-prometheus-alerts noarch 2:19.0.0-2571.gaddbc488.el9 ceph-noarch 16 k 2024-04-04T06:53:18.272 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-selinux x86_64 2:19.0.0-2571.gaddbc488.el9 ceph 25 k 2024-04-04T06:53:18.272 INFO:teuthology.orchestra.run.smithi117.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2024-04-04T06:53:18.272 INFO:teuthology.orchestra.run.smithi117.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2024-04-04T06:53:18.272 INFO:teuthology.orchestra.run.smithi117.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2024-04-04T06:53:18.272 INFO:teuthology.orchestra.run.smithi117.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2024-04-04T06:53:18.272 INFO:teuthology.orchestra.run.smithi117.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-04T06:53:18.272 INFO:teuthology.orchestra.run.smithi117.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-04-04T06:53:18.272 INFO:teuthology.orchestra.run.smithi117.stdout: jq x86_64 1.6-16.el9 baseos 187 k 2024-04-04T06:53:18.273 INFO:teuthology.orchestra.run.smithi117.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-04-04T06:53:18.273 INFO:teuthology.orchestra.run.smithi117.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-04-04T06:53:18.273 INFO:teuthology.orchestra.run.smithi117.stdout: libcephsqlite x86_64 2:19.0.0-2571.gaddbc488.el9 ceph 163 k 2024-04-04T06:53:18.273 INFO:teuthology.orchestra.run.smithi117.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-04T06:53:18.273 INFO:teuthology.orchestra.run.smithi117.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-04T06:53:18.273 INFO:teuthology.orchestra.run.smithi117.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2024-04-04T06:53:18.273 INFO:teuthology.orchestra.run.smithi117.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-04T06:53:18.273 INFO:teuthology.orchestra.run.smithi117.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2024-04-04T06:53:18.273 INFO:teuthology.orchestra.run.smithi117.stdout: libradosstriper1 x86_64 2:19.0.0-2571.gaddbc488.el9 ceph 500 k 2024-04-04T06:53:18.274 INFO:teuthology.orchestra.run.smithi117.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2024-04-04T06:53:18.274 INFO:teuthology.orchestra.run.smithi117.stdout: librgw2 x86_64 2:19.0.0-2571.gaddbc488.el9 ceph 5.1 M 2024-04-04T06:53:18.274 INFO:teuthology.orchestra.run.smithi117.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-04T06:53:18.274 INFO:teuthology.orchestra.run.smithi117.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2024-04-04T06:53:18.274 INFO:teuthology.orchestra.run.smithi117.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2024-04-04T06:53:18.274 INFO:teuthology.orchestra.run.smithi117.stdout: lua x86_64 5.4.4-4.el9 CentOS-AppStream 187 k 2024-04-04T06:53:18.274 INFO:teuthology.orchestra.run.smithi117.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-04-04T06:53:18.274 INFO:teuthology.orchestra.run.smithi117.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-04-04T06:53:18.274 INFO:teuthology.orchestra.run.smithi117.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2024-04-04T06:53:18.274 INFO:teuthology.orchestra.run.smithi117.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2024-04-04T06:53:18.274 INFO:teuthology.orchestra.run.smithi117.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2024-04-04T06:53:18.274 INFO:teuthology.orchestra.run.smithi117.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-04-04T06:53:18.274 INFO:teuthology.orchestra.run.smithi117.stdout: postgresql-private-libs x86_64 13.14-1.el9 CentOS-AppStream 132 k 2024-04-04T06:53:18.275 INFO:teuthology.orchestra.run.smithi117.stdout: protobuf x86_64 3.14.0-13.el9 CentOS-AppStream 1.0 M 2024-04-04T06:53:18.275 INFO:teuthology.orchestra.run.smithi117.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-04-04T06:53:18.275 INFO:teuthology.orchestra.run.smithi117.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-04T06:53:18.275 INFO:teuthology.orchestra.run.smithi117.stdout: python3-attrs noarch 20.3.0-7.el9 CentOS-AppStream 78 k 2024-04-04T06:53:18.275 INFO:teuthology.orchestra.run.smithi117.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2024-04-04T06:53:18.275 INFO:teuthology.orchestra.run.smithi117.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-04T06:53:18.275 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-04T06:53:18.275 INFO:teuthology.orchestra.run.smithi117.stdout: python3-ceph-argparse x86_64 2:19.0.0-2571.gaddbc488.el9 ceph 45 k 2024-04-04T06:53:18.275 INFO:teuthology.orchestra.run.smithi117.stdout: python3-ceph-common x86_64 2:19.0.0-2571.gaddbc488.el9 ceph 134 k 2024-04-04T06:53:18.275 INFO:teuthology.orchestra.run.smithi117.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-04T06:53:18.275 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2024-04-04T06:53:18.275 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-04T06:53:18.276 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-04T06:53:18.276 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-04-04T06:53:18.276 INFO:teuthology.orchestra.run.smithi117.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-04-04T06:53:18.276 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2024-04-04T06:53:18.276 INFO:teuthology.orchestra.run.smithi117.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-04-04T06:53:18.276 INFO:teuthology.orchestra.run.smithi117.stdout: python3-google-auth noarch 1:2.28.2-1.el9 epel 203 k 2024-04-04T06:53:18.276 INFO:teuthology.orchestra.run.smithi117.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-04-04T06:53:18.276 INFO:teuthology.orchestra.run.smithi117.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-04-04T06:53:18.276 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-04T06:53:18.276 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-04T06:53:18.276 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-04-04T06:53:18.276 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-04T06:53:18.276 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-04T06:53:18.277 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-04T06:53:18.277 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2024-04-04T06:53:18.277 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2024-04-04T06:53:18.277 INFO:teuthology.orchestra.run.smithi117.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-04T06:53:18.277 INFO:teuthology.orchestra.run.smithi117.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-04T06:53:18.277 INFO:teuthology.orchestra.run.smithi117.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2024-04-04T06:53:18.277 INFO:teuthology.orchestra.run.smithi117.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2024-04-04T06:53:18.277 INFO:teuthology.orchestra.run.smithi117.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-04T06:53:18.277 INFO:teuthology.orchestra.run.smithi117.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-04T06:53:18.277 INFO:teuthology.orchestra.run.smithi117.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2024-04-04T06:53:18.277 INFO:teuthology.orchestra.run.smithi117.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2024-04-04T06:53:18.277 INFO:teuthology.orchestra.run.smithi117.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2024-04-04T06:53:18.277 INFO:teuthology.orchestra.run.smithi117.stdout: python3-packaging noarch 20.9-5.el9 CentOS-AppStream 69 k 2024-04-04T06:53:18.278 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-04T06:53:18.278 INFO:teuthology.orchestra.run.smithi117.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2024-04-04T06:53:18.278 INFO:teuthology.orchestra.run.smithi117.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-04T06:53:18.278 INFO:teuthology.orchestra.run.smithi117.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2024-04-04T06:53:18.278 INFO:teuthology.orchestra.run.smithi117.stdout: python3-protobuf noarch 3.14.0-13.el9 CentOS-AppStream 238 k 2024-04-04T06:53:18.278 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-04T06:53:18.278 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2024-04-04T06:53:18.278 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2024-04-04T06:53:18.278 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2024-04-04T06:53:18.278 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-04-04T06:53:18.278 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2024-04-04T06:53:18.278 INFO:teuthology.orchestra.run.smithi117.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-04T06:53:18.278 INFO:teuthology.orchestra.run.smithi117.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-04T06:53:18.278 INFO:teuthology.orchestra.run.smithi117.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2024-04-04T06:53:18.279 INFO:teuthology.orchestra.run.smithi117.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-04T06:53:18.279 INFO:teuthology.orchestra.run.smithi117.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-04T06:53:18.279 INFO:teuthology.orchestra.run.smithi117.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2024-04-04T06:53:18.279 INFO:teuthology.orchestra.run.smithi117.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-04T06:53:18.279 INFO:teuthology.orchestra.run.smithi117.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2024-04-04T06:53:18.279 INFO:teuthology.orchestra.run.smithi117.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-04T06:53:18.279 INFO:teuthology.orchestra.run.smithi117.stdout: python3-urllib3 noarch 1.26.5-5.el9 CentOS-BaseOS 187 k 2024-04-04T06:53:18.279 INFO:teuthology.orchestra.run.smithi117.stdout: python3-wcwidth noarch 0.2.5-8.el9 CentOS-AppStream 41 k 2024-04-04T06:53:18.279 INFO:teuthology.orchestra.run.smithi117.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-04T06:53:18.279 INFO:teuthology.orchestra.run.smithi117.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-04T06:53:18.279 INFO:teuthology.orchestra.run.smithi117.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-04T06:53:18.279 INFO:teuthology.orchestra.run.smithi117.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-04T06:53:18.279 INFO:teuthology.orchestra.run.smithi117.stdout: qatlib x86_64 24.02.0-1.el9 CentOS-AppStream 220 k 2024-04-04T06:53:18.280 INFO:teuthology.orchestra.run.smithi117.stdout: qatzip-libs x86_64 1.2.0-1.el9 CentOS-AppStream 46 k 2024-04-04T06:53:18.280 INFO:teuthology.orchestra.run.smithi117.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-04T06:53:18.280 INFO:teuthology.orchestra.run.smithi117.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2024-04-04T06:53:18.280 INFO:teuthology.orchestra.run.smithi117.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-04T06:53:18.280 INFO:teuthology.orchestra.run.smithi117.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2024-04-04T06:53:18.280 INFO:teuthology.orchestra.run.smithi117.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2024-04-04T06:53:18.280 INFO:teuthology.orchestra.run.smithi117.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2024-04-04T06:53:18.280 INFO:teuthology.orchestra.run.smithi117.stdout:Installing weak dependencies: 2024-04-04T06:53:18.280 INFO:teuthology.orchestra.run.smithi117.stdout: qatlib-service x86_64 24.02.0-1.el9 CentOS-AppStream 35 k 2024-04-04T06:53:18.280 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-04T06:53:18.280 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction Summary 2024-04-04T06:53:18.280 INFO:teuthology.orchestra.run.smithi117.stdout:============================================================================================ 2024-04-04T06:53:18.280 INFO:teuthology.orchestra.run.smithi117.stdout:Install 150 Packages 2024-04-04T06:53:18.280 INFO:teuthology.orchestra.run.smithi117.stdout:Upgrade 24 Packages 2024-04-04T06:53:18.281 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-04T06:53:18.281 INFO:teuthology.orchestra.run.smithi117.stdout:Total download size: 226 M 2024-04-04T06:53:18.281 INFO:teuthology.orchestra.run.smithi117.stdout:Downloading Packages: 2024-04-04T06:53:18.308 INFO:teuthology.orchestra.run.smithi072.stdout:(18/174): libradosstriper1-19.0.0-2571.gaddbc48 2.0 MB/s | 500 kB 00:00 2024-04-04T06:53:18.434 INFO:teuthology.orchestra.run.smithi072.stdout:(19/174): python3-ceph-argparse-19.0.0-2571.gad 361 kB/s | 45 kB 00:00 2024-04-04T06:53:18.534 INFO:teuthology.orchestra.run.smithi072.stdout:(20/174): python3-ceph-common-19.0.0-2571.gaddb 1.3 MB/s | 134 kB 00:00 2024-04-04T06:53:18.643 INFO:teuthology.orchestra.run.smithi072.stdout:(21/174): python3-cephfs-19.0.0-2571.gaddbc488. 1.5 MB/s | 161 kB 00:00 2024-04-04T06:53:18.894 INFO:teuthology.orchestra.run.smithi072.stdout:(22/174): python3-rados-19.0.0-2571.gaddbc488.e 1.3 MB/s | 320 kB 00:00 2024-04-04T06:53:19.111 INFO:teuthology.orchestra.run.smithi072.stdout:(23/174): python3-rbd-19.0.0-2571.gaddbc488.el9 1.3 MB/s | 298 kB 00:00 2024-04-04T06:53:19.203 INFO:teuthology.orchestra.run.smithi072.stdout:(24/174): python3-rgw-19.0.0-2571.gaddbc488.el9 1.1 MB/s | 99 kB 00:00 2024-04-04T06:53:19.312 INFO:teuthology.orchestra.run.smithi072.stdout:(25/174): rbd-fuse-19.0.0-2571.gaddbc488.el9.x8 790 kB/s | 85 kB 00:00 2024-04-04T06:53:19.535 INFO:teuthology.orchestra.run.smithi117.stdout:(1/174): ceph-19.0.0-2571.gaddbc488.el9.x86_64. 17 kB/s | 6.6 kB 00:00 2024-04-04T06:53:20.596 INFO:teuthology.orchestra.run.smithi072.stdout:(26/174): librgw2-19.0.0-2571.gaddbc488.el9.x86 2.1 MB/s | 5.1 MB 00:02 2024-04-04T06:53:20.713 INFO:teuthology.orchestra.run.smithi072.stdout:(27/174): rbd-nbd-19.0.0-2571.gaddbc488.el9.x86 1.4 MB/s | 170 kB 00:00 2024-04-04T06:53:20.851 INFO:teuthology.orchestra.run.smithi117.stdout:(2/174): ceph-fuse-19.0.0-2571.gaddbc488.el9.x8 676 kB/s | 890 kB 00:01 2024-04-04T06:53:20.897 INFO:teuthology.orchestra.run.smithi072.stdout:(28/174): rbd-mirror-19.0.0-2571.gaddbc488.el9. 1.9 MB/s | 3.1 MB 00:01 2024-04-04T06:53:20.924 INFO:teuthology.orchestra.run.smithi072.stdout:(29/174): ceph-grafana-dashboards-19.0.0-2571.g 162 kB/s | 34 kB 00:00 2024-04-04T06:53:21.068 INFO:teuthology.orchestra.run.smithi117.stdout:(3/174): ceph-immutable-object-cache-19.0.0-257 669 kB/s | 145 kB 00:00 2024-04-04T06:53:21.116 INFO:teuthology.orchestra.run.smithi072.stdout:(30/174): ceph-mgr-cephadm-19.0.0-2571.gaddbc48 649 kB/s | 141 kB 00:00 2024-04-04T06:53:22.584 INFO:teuthology.orchestra.run.smithi072.stdout:(31/174): ceph-mgr-dashboard-19.0.0-2571.gaddbc 2.1 MB/s | 3.5 MB 00:01 2024-04-04T06:53:22.792 INFO:teuthology.orchestra.run.smithi072.stdout:(32/174): ceph-mgr-modules-core-19.0.0-2571.gad 1.2 MB/s | 249 kB 00:00 2024-04-04T06:53:22.910 INFO:teuthology.orchestra.run.smithi072.stdout:(33/174): ceph-mgr-rook-19.0.0-2571.gaddbc488.e 425 kB/s | 49 kB 00:00 2024-04-04T06:53:23.027 INFO:teuthology.orchestra.run.smithi072.stdout:(34/174): ceph-prometheus-alerts-19.0.0-2571.ga 141 kB/s | 16 kB 00:00 2024-04-04T06:53:23.218 INFO:teuthology.orchestra.run.smithi117.stdout:(4/174): ceph-base-19.0.0-2571.gaddbc488.el9.x8 1.3 MB/s | 5.4 MB 00:04 2024-04-04T06:53:23.427 INFO:teuthology.orchestra.run.smithi072.stdout:(35/174): ceph-volume-19.0.0-2571.gaddbc488.el9 661 kB/s | 264 kB 00:00 2024-04-04T06:53:23.876 INFO:teuthology.orchestra.run.smithi117.stdout:(5/174): ceph-mds-19.0.0-2571.gaddbc488.el9.x86 861 kB/s | 2.4 MB 00:02 2024-04-04T06:53:23.920 INFO:teuthology.orchestra.run.smithi072.stdout:(36/174): cephadm-19.0.0-2571.gaddbc488.el9.noa 1.5 MB/s | 762 kB 00:00 2024-04-04T06:53:24.054 INFO:teuthology.orchestra.run.smithi072.stdout:(37/174): cephfs-top-19.0.0-2571.gaddbc488.el9. 137 kB/s | 18 kB 00:00 2024-04-04T06:53:24.101 INFO:teuthology.orchestra.run.smithi117.stdout:(6/174): ceph-mgr-19.0.0-2571.gaddbc488.el9.x86 1.7 MB/s | 1.5 MB 00:00 2024-04-04T06:53:24.246 INFO:teuthology.orchestra.run.smithi072.stdout:(38/174): automake-1.16.2-8.el9.noarch.rpm 3.4 MB/s | 662 kB 00:00 2024-04-04T06:53:24.313 INFO:teuthology.orchestra.run.smithi072.stdout:(39/174): bison-3.7.4-5.el9.x86_64.rpm 14 MB/s | 920 kB 00:00 2024-04-04T06:53:24.355 INFO:teuthology.orchestra.run.smithi072.stdout:(40/174): boost-program-options-1.75.0-8.el9.x8 2.5 MB/s | 106 kB 00:00 2024-04-04T06:53:24.431 INFO:teuthology.orchestra.run.smithi072.stdout:(41/174): flex-2.6.4-9.el9.x86_64.rpm 4.0 MB/s | 307 kB 00:00 2024-04-04T06:53:24.473 INFO:teuthology.orchestra.run.smithi072.stdout:(42/174): flexiblas-3.0.4-8.el9.x86_64.rpm 769 kB/s | 32 kB 00:00 2024-04-04T06:53:24.510 INFO:teuthology.orchestra.run.smithi117.stdout:(7/174): ceph-common-19.0.0-2571.gaddbc488.el9. 3.8 MB/s | 21 MB 00:05 2024-04-04T06:53:24.600 INFO:teuthology.orchestra.run.smithi072.stdout:(43/174): flexiblas-netlib-3.0.4-8.el9.x86_64.r 24 MB/s | 3.0 MB 00:00 2024-04-04T06:53:24.634 INFO:teuthology.orchestra.run.smithi072.stdout:(44/174): flexiblas-openblas-openmp-3.0.4-8.el9 524 kB/s | 17 kB 00:00 2024-04-04T06:53:24.668 INFO:teuthology.orchestra.run.smithi072.stdout:(45/174): libaio-devel-0.3.111-13.el9.x86_64.rp 305 kB/s | 10 kB 00:00 2024-04-04T06:53:24.719 INFO:teuthology.orchestra.run.smithi072.stdout:(46/174): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.1 MB/s | 159 kB 00:00 2024-04-04T06:53:24.752 INFO:teuthology.orchestra.run.smithi072.stdout:(47/174): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.3 MB/s | 44 kB 00:00 2024-04-04T06:53:24.936 INFO:teuthology.orchestra.run.smithi072.stdout:(48/174): ceph-mgr-diskprediction-local-19.0.0- 1.9 MB/s | 7.4 MB 00:03 2024-04-04T06:53:24.987 INFO:teuthology.orchestra.run.smithi072.stdout:(49/174): librdkafka-1.6.1-102.el9.x86_64.rpm 2.8 MB/s | 661 kB 00:00 2024-04-04T06:53:25.037 INFO:teuthology.orchestra.run.smithi072.stdout:(50/174): libtool-2.4.6-45.el9.x86_64.rpm 6.0 MB/s | 578 kB 00:00 2024-04-04T06:53:25.063 INFO:teuthology.orchestra.run.smithi072.stdout:(51/174): libzstd-devel-1.5.1-2.el9.x86_64.rpm 661 kB/s | 46 kB 00:00 2024-04-04T06:53:25.097 INFO:teuthology.orchestra.run.smithi072.stdout:(52/174): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.8 MB/s | 282 kB 00:00 2024-04-04T06:53:25.131 INFO:teuthology.orchestra.run.smithi072.stdout:(53/174): lua-5.4.4-4.el9.x86_64.rpm 2.8 MB/s | 187 kB 00:00 2024-04-04T06:53:25.165 INFO:teuthology.orchestra.run.smithi072.stdout:(54/174): oniguruma-6.9.6-1.el9.5.x86_64.rpm 3.3 MB/s | 217 kB 00:00 2024-04-04T06:53:25.190 INFO:teuthology.orchestra.run.smithi072.stdout:(55/174): openblas-0.3.21-2.el9.x86_64.rpm 605 kB/s | 34 kB 00:00 2024-04-04T06:53:25.349 INFO:teuthology.orchestra.run.smithi072.stdout:(56/174): openblas-openmp-0.3.21-2.el9.x86_64.r 26 MB/s | 4.7 MB 00:00 2024-04-04T06:53:25.401 INFO:teuthology.orchestra.run.smithi072.stdout:(57/174): postgresql-13.14-1.el9.x86_64.rpm 7.9 MB/s | 1.5 MB 00:00 2024-04-04T06:53:25.452 INFO:teuthology.orchestra.run.smithi072.stdout:(58/174): postgresql-contrib-13.14-1.el9.x86_64 7.9 MB/s | 817 kB 00:00 2024-04-04T06:53:25.477 INFO:teuthology.orchestra.run.smithi072.stdout:(59/174): postgresql-private-libs-13.14-1.el9.x 1.9 MB/s | 132 kB 00:00 2024-04-04T06:53:25.712 INFO:teuthology.orchestra.run.smithi072.stdout:(60/174): postgresql-server-13.14-1.el9.x86_64. 22 MB/s | 5.7 MB 00:00 2024-04-04T06:53:25.727 INFO:teuthology.orchestra.run.smithi117.stdout:(8/174): ceph-radosgw-19.0.0-2571.gaddbc488.el9 8.1 MB/s | 9.8 MB 00:01 2024-04-04T06:53:25.753 INFO:teuthology.orchestra.run.smithi072.stdout:(61/174): protobuf-3.14.0-13.el9.x86_64.rpm 3.9 MB/s | 1.0 MB 00:00 2024-04-04T06:53:25.777 INFO:teuthology.orchestra.run.smithi117.stdout:(9/174): ceph-selinux-19.0.0-2571.gaddbc488.el9 516 kB/s | 25 kB 00:00 2024-04-04T06:53:25.812 INFO:teuthology.orchestra.run.smithi072.stdout:(62/174): python3-attrs-20.3.0-7.el9.noarch.rpm 1.3 MB/s | 78 kB 00:00 2024-04-04T06:53:25.988 INFO:teuthology.orchestra.run.smithi072.stdout:(63/174): python3-babel-2.9.1-2.el9.noarch.rpm 25 MB/s | 5.8 MB 00:00 2024-04-04T06:53:26.013 INFO:teuthology.orchestra.run.smithi072.stdout:(64/174): python3-jsonpatch-1.21-16.el9.noarch. 133 kB/s | 24 kB 00:00 2024-04-04T06:53:26.055 INFO:teuthology.orchestra.run.smithi072.stdout:(65/174): python3-jsonpointer-2.0-4.el9.noarch. 446 kB/s | 18 kB 00:00 2024-04-04T06:53:26.081 INFO:teuthology.orchestra.run.smithi072.stdout:(66/174): python3-mako-1.1.4-6.el9.noarch.rpm 2.1 MB/s | 144 kB 00:00 2024-04-04T06:53:26.123 INFO:teuthology.orchestra.run.smithi072.stdout:(67/174): python3-markupsafe-1.1.1-12.el9.x86_6 774 kB/s | 32 kB 00:00 2024-04-04T06:53:26.290 INFO:teuthology.orchestra.run.smithi072.stdout:(68/174): python3-numpy-1.20.1-5.el9.x86_64.rpm 23 MB/s | 4.8 MB 00:00 2024-04-04T06:53:26.315 INFO:teuthology.orchestra.run.smithi072.stdout:(69/174): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.2 MB/s | 217 kB 00:00 2024-04-04T06:53:26.358 INFO:teuthology.orchestra.run.smithi072.stdout:(70/174): python3-packaging-20.9-5.el9.noarch.r 1.6 MB/s | 69 kB 00:00 2024-04-04T06:53:26.392 INFO:teuthology.orchestra.run.smithi072.stdout:(71/174): python3-oauthlib-3.1.1-5.el9.noarch.r 2.3 MB/s | 174 kB 00:00 2024-04-04T06:53:26.417 INFO:teuthology.orchestra.run.smithi072.stdout:(72/174): python3-prettytable-0.7.2-27.el9.noar 733 kB/s | 41 kB 00:00 2024-04-04T06:53:26.451 INFO:teuthology.orchestra.run.smithi072.stdout:(73/174): python3-protobuf-3.14.0-13.el9.noarch 4.0 MB/s | 238 kB 00:00 2024-04-04T06:53:26.478 INFO:teuthology.orchestra.run.smithi072.stdout:(74/174): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.2 MB/s | 132 kB 00:00 2024-04-04T06:53:26.587 INFO:teuthology.orchestra.run.smithi072.stdout:(75/174): python3-pyasn1-modules-0.4.8-6.el9.no 1.5 MB/s | 211 kB 00:00 2024-04-04T06:53:26.613 INFO:teuthology.orchestra.run.smithi072.stdout:(76/174): python3-pytz-2021.1-5.el9.noarch.rpm 359 kB/s | 47 kB 00:00 2024-04-04T06:53:26.638 INFO:teuthology.orchestra.run.smithi072.stdout:(77/174): python3-requests-oauthlib-1.3.0-12.el 862 kB/s | 43 kB 00:00 2024-04-04T06:53:27.494 INFO:teuthology.orchestra.run.smithi117.stdout:(10/174): ceph-mon-19.0.0-2571.gaddbc488.el9.x8 1.3 MB/s | 4.7 MB 00:03 2024-04-04T06:53:27.539 INFO:teuthology.orchestra.run.smithi072.stdout:(78/174): ceph-test-19.0.0-2571.gaddbc488.el9.x 3.4 MB/s | 48 MB 00:13 2024-04-04T06:53:27.669 INFO:teuthology.orchestra.run.smithi117.stdout:(11/174): cephfs-mirror-19.0.0-2571.gaddbc488.e 1.3 MB/s | 225 kB 00:00 2024-04-04T06:53:27.736 INFO:teuthology.orchestra.run.smithi117.stdout:(12/174): cephfs-shell-19.0.0-2571.gaddbc488.el 414 kB/s | 27 kB 00:00 2024-04-04T06:53:27.803 INFO:teuthology.orchestra.run.smithi117.stdout:(13/174): libcephfs-devel-19.0.0-2571.gaddbc488 490 kB/s | 32 kB 00:00 2024-04-04T06:53:27.865 INFO:teuthology.orchestra.run.smithi072.stdout:(79/174): python3-scipy-1.6.2-8.el9.x86_64.rpm 13 MB/s | 16 MB 00:01 2024-04-04T06:53:27.881 INFO:teuthology.orchestra.run.smithi072.stdout:(80/174): python3-toml-0.10.2-6.el9.noarch.rpm 31 kB/s | 39 kB 00:01 2024-04-04T06:53:27.907 INFO:teuthology.orchestra.run.smithi072.stdout:(81/174): python3-wcwidth-0.2.5-8.el9.noarch.rp 116 kB/s | 41 kB 00:00 2024-04-04T06:53:27.950 INFO:teuthology.orchestra.run.smithi072.stdout:(82/174): qatlib-service-24.02.0-1.el9.x86_64.r 531 kB/s | 35 kB 00:00 2024-04-04T06:53:27.983 INFO:teuthology.orchestra.run.smithi072.stdout:(83/174): qatlib-24.02.0-1.el9.x86_64.rpm 2.2 MB/s | 220 kB 00:00 2024-04-04T06:53:28.075 INFO:teuthology.orchestra.run.smithi072.stdout:(84/174): qatzip-libs-1.2.0-1.el9.x86_64.rpm 276 kB/s | 46 kB 00:00 2024-04-04T06:53:28.109 INFO:teuthology.orchestra.run.smithi072.stdout:(85/174): socat-1.7.4.1-5.el9.x86_64.rpm 1.9 MB/s | 300 kB 00:00 2024-04-04T06:53:28.126 INFO:teuthology.orchestra.run.smithi072.stdout:(86/174): uuid-1.6.2-55.el9.x86_64.rpm 398 kB/s | 56 kB 00:00 2024-04-04T06:53:28.193 INFO:teuthology.orchestra.run.smithi072.stdout:(87/174): xmlstarlet-1.6.1-20.el9.x86_64.rpm 947 kB/s | 63 kB 00:00 2024-04-04T06:53:28.210 INFO:teuthology.orchestra.run.smithi072.stdout:(88/174): zlib-devel-1.2.11-40.el9.x86_64.rpm 529 kB/s | 44 kB 00:00 2024-04-04T06:53:28.211 INFO:teuthology.orchestra.run.smithi117.stdout:(14/174): libcephfs2-19.0.0-2571.gaddbc488.el9. 1.8 MB/s | 746 kB 00:00 2024-04-04T06:53:28.237 INFO:teuthology.orchestra.run.smithi072.stdout:(89/174): fuse-2.9.9-15.el9.x86_64.rpm 715 kB/s | 79 kB 00:00 2024-04-04T06:53:28.320 INFO:teuthology.orchestra.run.smithi117.stdout:(15/174): libcephsqlite-19.0.0-2571.gaddbc488.e 1.5 MB/s | 163 kB 00:00 2024-04-04T06:53:28.421 INFO:teuthology.orchestra.run.smithi072.stdout:(90/174): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.0 MB/s | 241 kB 00:00 2024-04-04T06:53:28.428 INFO:teuthology.orchestra.run.smithi117.stdout:(16/174): librados-devel-19.0.0-2571.gaddbc488. 1.2 MB/s | 127 kB 00:00 2024-04-04T06:53:28.447 INFO:teuthology.orchestra.run.smithi072.stdout:(91/174): python3-ply-3.11-14.el9.noarch.rpm 496 kB/s | 103 kB 00:00 2024-04-04T06:53:28.505 INFO:teuthology.orchestra.run.smithi072.stdout:(92/174): python3-cryptography-36.0.1-4.el9.x86 4.3 MB/s | 1.1 MB 00:00 2024-04-04T06:53:28.539 INFO:teuthology.orchestra.run.smithi072.stdout:(93/174): python3-urllib3-1.26.5-5.el9.noarch.r 2.2 MB/s | 187 kB 00:00 2024-04-04T06:53:28.565 INFO:teuthology.orchestra.run.smithi072.stdout:(94/174): python3-pycparser-2.20-6.el9.noarch.r 1.1 MB/s | 124 kB 00:00 2024-04-04T06:53:28.657 INFO:teuthology.orchestra.run.smithi072.stdout:(95/174): jq-1.6-16.el9.x86_64.rpm 1.2 MB/s | 187 kB 00:00 2024-04-04T06:53:28.699 INFO:teuthology.orchestra.run.smithi072.stdout:(96/174): python3-requests-2.25.1-8.el9.noarch. 3.0 MB/s | 125 kB 00:00 2024-04-04T06:53:28.712 INFO:teuthology.orchestra.run.smithi117.stdout:(17/174): libradosstriper1-19.0.0-2571.gaddbc48 1.7 MB/s | 500 kB 00:00 2024-04-04T06:53:28.733 INFO:teuthology.orchestra.run.smithi072.stdout:(97/174): libquadmath-11.4.1-3.el9.x86_64.rpm 1.1 MB/s | 195 kB 00:00 2024-04-04T06:53:28.759 INFO:teuthology.orchestra.run.smithi072.stdout:(98/174): elfutils-libelf-devel-0.190-2.el9.x86 369 kB/s | 21 kB 00:00 2024-04-04T06:53:28.784 INFO:teuthology.orchestra.run.smithi072.stdout:(99/174): libuuid-devel-2.37.4-18.el9.x86_64.rp 510 kB/s | 25 kB 00:00 2024-04-04T06:53:28.835 INFO:teuthology.orchestra.run.smithi072.stdout:(100/174): libgfortran-11.4.1-3.el9.x86_64.rpm 2.7 MB/s | 803 kB 00:00 2024-04-04T06:53:28.868 INFO:teuthology.orchestra.run.smithi072.stdout:(101/174): python3-devel-3.9.17-2.el9.x86_64.rp 2.9 MB/s | 245 kB 00:00 2024-04-04T06:53:28.902 INFO:teuthology.orchestra.run.smithi072.stdout:(102/174): python3-jinja2-2.11.3-5.el9.noarch.r 3.6 MB/s | 248 kB 00:00 2024-04-04T06:53:28.936 INFO:teuthology.orchestra.run.smithi072.stdout:(103/174): xfsprogs-devel-6.3.0-1.el9.x86_64.rp 1.4 MB/s | 94 kB 00:00 2024-04-04T06:53:28.970 INFO:teuthology.orchestra.run.smithi072.stdout:(104/174): lua-devel-5.4.4-4.el9.x86_64.rpm 336 kB/s | 22 kB 00:00 2024-04-04T06:53:29.054 INFO:teuthology.orchestra.run.smithi072.stdout:(105/174): protobuf-compiler-3.14.0-13.el9.x86_ 7.2 MB/s | 863 kB 00:00 2024-04-04T06:53:29.223 INFO:teuthology.orchestra.run.smithi072.stdout:(106/174): openssl-devel-3.0.7-27.el9.x86_64.rp 8.9 MB/s | 4.1 MB 00:00 2024-04-04T06:53:29.390 INFO:teuthology.orchestra.run.smithi072.stdout:(107/174): grpc-data-1.46.7-10.el9.noarch.rpm 190 kB/s | 19 kB 00:00 2024-04-04T06:53:29.432 INFO:teuthology.orchestra.run.smithi072.stdout:(108/174): abseil-cpp-20211102.0-3.el9.x86_64.r 1.2 MB/s | 548 kB 00:00 2024-04-04T06:53:29.508 INFO:teuthology.orchestra.run.smithi072.stdout:(109/174): libarrow-doc-9.0.0-10.el9.noarch.rpm 411 kB/s | 26 kB 00:00 2024-04-04T06:53:29.633 INFO:teuthology.orchestra.run.smithi072.stdout:(110/174): libarrow-9.0.0-10.el9.x86_64.rpm 18 MB/s | 4.4 MB 00:00 2024-04-04T06:53:29.659 INFO:teuthology.orchestra.run.smithi072.stdout:(111/174): liboath-2.6.7-2.el9.x86_64.rpm 331 kB/s | 49 kB 00:00 2024-04-04T06:53:29.684 INFO:teuthology.orchestra.run.smithi072.stdout:(112/174): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-04-04T06:53:29.718 INFO:teuthology.orchestra.run.smithi072.stdout:(113/174): luarocks-3.9.2-1.el9.noarch.rpm 2.6 MB/s | 151 kB 00:00 2024-04-04T06:53:29.769 INFO:teuthology.orchestra.run.smithi072.stdout:(114/174): parquet-libs-9.0.0-10.el9.x86_64.rpm 10 MB/s | 838 kB 00:00 2024-04-04T06:53:29.802 INFO:teuthology.orchestra.run.smithi072.stdout:(115/174): python3-asyncssh-2.13.2-5.el9.noarch 7.0 MB/s | 548 kB 00:00 2024-04-04T06:53:29.828 INFO:teuthology.orchestra.run.smithi072.stdout:(116/174): python3-bcrypt-3.2.2-1.el9.x86_64.rp 813 kB/s | 43 kB 00:00 2024-04-04T06:53:29.853 INFO:teuthology.orchestra.run.smithi072.stdout:(117/174): python3-cachetools-4.2.4-1.el9.noarc 645 kB/s | 32 kB 00:00 2024-04-04T06:53:29.871 INFO:teuthology.orchestra.run.smithi117.stdout:(18/174): ceph-test-19.0.0-2571.gaddbc488.el9.x 12 MB/s | 48 MB 00:04 2024-04-04T06:53:29.879 INFO:teuthology.orchestra.run.smithi072.stdout:(118/174): python3-certifi-2021.10.8-2.el9.noar 301 kB/s | 15 kB 00:00 2024-04-04T06:53:29.921 INFO:teuthology.orchestra.run.smithi072.stdout:(119/174): python3-cheroot-8.6.0-4.el9.noarch.r 2.5 MB/s | 172 kB 00:00 2024-04-04T06:53:29.929 INFO:teuthology.orchestra.run.smithi117.stdout:(19/174): python3-ceph-argparse-19.0.0-2571.gad 789 kB/s | 45 kB 00:00 2024-04-04T06:53:29.955 INFO:teuthology.orchestra.run.smithi072.stdout:(120/174): gperftools-libs-2.9.1-2.el9.x86_64.r 369 kB/s | 309 kB 00:00 2024-04-04T06:53:29.988 INFO:teuthology.orchestra.run.smithi117.stdout:(20/174): python3-ceph-common-19.0.0-2571.gaddb 2.3 MB/s | 134 kB 00:00 2024-04-04T06:53:29.988 INFO:teuthology.orchestra.run.smithi072.stdout:(121/174): python3-cherrypy-18.6.1-2.el9.noarch 3.2 MB/s | 358 kB 00:00 2024-04-04T06:53:30.032 INFO:teuthology.orchestra.run.smithi072.stdout:(122/174): python3-cmd2-2.4.2-2.el9.noarch.rpm 2.8 MB/s | 303 kB 00:00 2024-04-04T06:53:30.055 INFO:teuthology.orchestra.run.smithi117.stdout:(21/174): python3-cephfs-19.0.0-2571.gaddbc488. 2.4 MB/s | 161 kB 00:00 2024-04-04T06:53:30.058 INFO:teuthology.orchestra.run.smithi072.stdout:(123/174): python3-colorama-0.4.4-12.el9.noarch 542 kB/s | 35 kB 00:00 2024-04-04T06:53:30.083 INFO:teuthology.orchestra.run.smithi072.stdout:(124/174): python3-google-auth-2.28.2-1.el9.noa 2.2 MB/s | 203 kB 00:00 2024-04-04T06:53:30.130 INFO:teuthology.orchestra.run.smithi117.stdout:(22/174): python3-rados-19.0.0-2571.gaddbc488.e 4.2 MB/s | 320 kB 00:00 2024-04-04T06:53:30.176 INFO:teuthology.orchestra.run.smithi072.stdout:(125/174): python3-grpcio-1.46.7-10.el9.x86_64. 15 MB/s | 2.0 MB 00:00 2024-04-04T06:53:30.197 INFO:teuthology.orchestra.run.smithi117.stdout:(23/174): python3-rbd-19.0.0-2571.gaddbc488.el9 4.4 MB/s | 298 kB 00:00 2024-04-04T06:53:30.202 INFO:teuthology.orchestra.run.smithi072.stdout:(126/174): python3-grpcio-tools-1.46.7-10.el9.x 1.3 MB/s | 144 kB 00:00 2024-04-04T06:53:30.226 INFO:teuthology.orchestra.run.smithi072.stdout:(127/174): python3-jaraco-8.2.1-3.el9.noarch.rp 81 kB/s | 11 kB 00:00 2024-04-04T06:53:30.252 INFO:teuthology.orchestra.run.smithi072.stdout:(128/174): python3-jaraco-classes-3.2.1-5.el9.n 239 kB/s | 18 kB 00:00 2024-04-04T06:53:30.255 INFO:teuthology.orchestra.run.smithi117.stdout:(24/174): python3-rgw-19.0.0-2571.gaddbc488.el9 1.7 MB/s | 99 kB 00:00 2024-04-04T06:53:30.277 INFO:teuthology.orchestra.run.smithi072.stdout:(129/174): python3-jaraco-collections-3.0.0-8.e 468 kB/s | 23 kB 00:00 2024-04-04T06:53:30.303 INFO:teuthology.orchestra.run.smithi072.stdout:(130/174): python3-jaraco-functools-3.5.0-2.el9 260 kB/s | 19 kB 00:00 2024-04-04T06:53:30.314 INFO:teuthology.orchestra.run.smithi117.stdout:(25/174): rbd-fuse-19.0.0-2571.gaddbc488.el9.x8 1.4 MB/s | 85 kB 00:00 2024-04-04T06:53:30.328 INFO:teuthology.orchestra.run.smithi072.stdout:(131/174): python3-jaraco-text-3.2.0-6.el9.noar 263 kB/s | 20 kB 00:00 2024-04-04T06:53:30.387 INFO:teuthology.orchestra.run.smithi072.stdout:(132/174): python3-kubernetes-26.1.0-2.el9.noar 12 MB/s | 1.0 MB 00:00 2024-04-04T06:53:30.412 INFO:teuthology.orchestra.run.smithi072.stdout:(133/174): python3-logutils-0.3.5-21.el9.noarch 429 kB/s | 46 kB 00:00 2024-04-04T06:53:30.438 INFO:teuthology.orchestra.run.smithi072.stdout:(134/174): python3-more-itertools-8.12.0-2.el9. 797 kB/s | 79 kB 00:00 2024-04-04T06:53:30.513 INFO:teuthology.orchestra.run.smithi072.stdout:(135/174): python3-natsort-7.1.1-5.el9.noarch.r 583 kB/s | 58 kB 00:00 2024-04-04T06:53:30.539 INFO:teuthology.orchestra.run.smithi072.stdout:(136/174): python3-pecan-1.4.2-3.el9.noarch.rpm 2.1 MB/s | 272 kB 00:00 2024-04-04T06:53:30.564 INFO:teuthology.orchestra.run.smithi072.stdout:(137/174): python3-portend-3.1.0-2.el9.noarch.r 134 kB/s | 16 kB 00:00 2024-04-04T06:53:30.590 INFO:teuthology.orchestra.run.smithi072.stdout:(138/174): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.8 MB/s | 90 kB 00:00 2024-04-04T06:53:30.615 INFO:teuthology.orchestra.run.smithi072.stdout:(139/174): python3-pyperclip-1.8.2-2.el9.noarch 379 kB/s | 28 kB 00:00 2024-04-04T06:53:30.642 INFO:teuthology.orchestra.run.smithi072.stdout:(140/174): python3-repoze-lru-0.7-16.el9.noarch 406 kB/s | 31 kB 00:00 2024-04-04T06:53:30.656 INFO:teuthology.orchestra.run.smithi117.stdout:(26/174): rbd-mirror-19.0.0-2571.gaddbc488.el9. 9.1 MB/s | 3.1 MB 00:00 2024-04-04T06:53:30.676 INFO:teuthology.orchestra.run.smithi072.stdout:(141/174): python3-routes-2.5.1-5.el9.noarch.rp 3.1 MB/s | 188 kB 00:00 2024-04-04T06:53:30.710 INFO:teuthology.orchestra.run.smithi072.stdout:(142/174): python3-rsa-4.9-2.el9.noarch.rpm 637 kB/s | 59 kB 00:00 2024-04-04T06:53:30.723 INFO:teuthology.orchestra.run.smithi117.stdout:(27/174): rbd-nbd-19.0.0-2571.gaddbc488.el9.x86 2.5 MB/s | 170 kB 00:00 2024-04-04T06:53:30.743 INFO:teuthology.orchestra.run.smithi072.stdout:(143/174): python3-tempora-5.0.0-2.el9.noarch.r 364 kB/s | 36 kB 00:00 2024-04-04T06:53:30.777 INFO:teuthology.orchestra.run.smithi072.stdout:(144/174): python3-typing-extensions-4.4.0-2.el 773 kB/s | 51 kB 00:00 2024-04-04T06:53:30.811 INFO:teuthology.orchestra.run.smithi072.stdout:(145/174): python3-webob-1.8.7-6.el9.noarch.rpm 2.3 MB/s | 230 kB 00:00 2024-04-04T06:53:30.831 INFO:teuthology.orchestra.run.smithi117.stdout:(28/174): librgw2-19.0.0-2571.gaddbc488.el9.x86 2.4 MB/s | 5.1 MB 00:02 2024-04-04T06:53:30.845 INFO:teuthology.orchestra.run.smithi072.stdout:(146/174): python3-websocket-client-1.2.3-2.el9 917 kB/s | 90 kB 00:00 2024-04-04T06:53:30.848 INFO:teuthology.orchestra.run.smithi117.stdout:(29/174): ceph-grafana-dashboards-19.0.0-2571.g 273 kB/s | 34 kB 00:00 2024-04-04T06:53:30.887 INFO:teuthology.orchestra.run.smithi072.stdout:(147/174): python3-werkzeug-2.0.3-3.el9.1.noarc 5.7 MB/s | 427 kB 00:00 2024-04-04T06:53:30.912 INFO:teuthology.orchestra.run.smithi072.stdout:(148/174): python3-zc-lockfile-2.0-10.el9.noarc 202 kB/s | 20 kB 00:00 2024-04-04T06:53:30.946 INFO:teuthology.orchestra.run.smithi072.stdout:(149/174): re2-20211101-3.el9.x86_64.rpm 2.0 MB/s | 192 kB 00:00 2024-04-04T06:53:30.996 INFO:teuthology.orchestra.run.smithi117.stdout:(30/174): ceph-mgr-cephadm-19.0.0-2571.gaddbc48 864 kB/s | 141 kB 00:00 2024-04-04T06:53:31.113 INFO:teuthology.orchestra.run.smithi072.stdout:(150/174): thrift-0.15.0-2.el9.x86_64.rpm 8.0 MB/s | 1.6 MB 00:00 2024-04-04T06:53:31.265 INFO:teuthology.orchestra.run.smithi117.stdout:(31/174): ceph-mgr-dashboard-19.0.0-2571.gaddbc 8.5 MB/s | 3.5 MB 00:00 2024-04-04T06:53:31.314 INFO:teuthology.orchestra.run.smithi072.stdout:(151/174): NetworkManager-1.47.2-1.el9.x86_64.r 11 MB/s | 2.3 MB 00:00 2024-04-04T06:53:31.332 INFO:teuthology.orchestra.run.smithi117.stdout:(32/174): ceph-mgr-modules-core-19.0.0-2571.gad 3.7 MB/s | 249 kB 00:00 2024-04-04T06:53:31.441 INFO:teuthology.orchestra.run.smithi117.stdout:(33/174): ceph-mgr-rook-19.0.0-2571.gaddbc488.e 458 kB/s | 49 kB 00:00 2024-04-04T06:53:31.516 INFO:teuthology.orchestra.run.smithi117.stdout:(34/174): ceph-prometheus-alerts-19.0.0-2571.ga 222 kB/s | 16 kB 00:00 2024-04-04T06:53:31.573 INFO:teuthology.orchestra.run.smithi072.stdout:(152/174): NetworkManager-libnm-1.47.2-1.el9.x8 7.1 MB/s | 1.8 MB 00:00 2024-04-04T06:53:31.625 INFO:teuthology.orchestra.run.smithi117.stdout:(35/174): ceph-volume-19.0.0-2571.gaddbc488.el9 2.4 MB/s | 264 kB 00:00 2024-04-04T06:53:31.775 INFO:teuthology.orchestra.run.smithi117.stdout:(36/174): cephadm-19.0.0-2571.gaddbc488.el9.noa 5.0 MB/s | 762 kB 00:00 2024-04-04T06:53:31.850 INFO:teuthology.orchestra.run.smithi117.stdout:(37/174): cephfs-top-19.0.0-2571.gaddbc488.el9. 246 kB/s | 18 kB 00:00 2024-04-04T06:53:31.984 INFO:teuthology.orchestra.run.smithi072.stdout:(153/174): NetworkManager-team-1.47.2-1.el9.x86 100 kB/s | 41 kB 00:00 2024-04-04T06:53:32.096 INFO:teuthology.orchestra.run.smithi072.stdout:(154/174): librbd1-19.0.0-2571.gaddbc488.el9.x8 2.7 MB/s | 3.1 MB 00:01 2024-04-04T06:53:32.129 INFO:teuthology.orchestra.run.smithi072.stdout:(155/174): NetworkManager-tui-1.47.2-1.el9.x86_ 1.7 MB/s | 247 kB 00:00 2024-04-04T06:53:32.142 INFO:teuthology.orchestra.run.smithi117.stdout:(38/174): automake-1.16.2-8.el9.noarch.rpm 2.2 MB/s | 662 kB 00:00 2024-04-04T06:53:32.171 INFO:teuthology.orchestra.run.smithi072.stdout:(156/174): xfsdump-3.1.12-4.el9.x86_64.rpm 4.3 MB/s | 321 kB 00:00 2024-04-04T06:53:32.215 INFO:teuthology.orchestra.run.smithi072.stdout:(157/174): acl-2.3.1-4.el9.x86_64.rpm 859 kB/s | 71 kB 00:00 2024-04-04T06:53:32.240 INFO:teuthology.orchestra.run.smithi072.stdout:(158/174): elfutils-debuginfod-client-0.190-2.e 537 kB/s | 36 kB 00:00 2024-04-04T06:53:32.284 INFO:teuthology.orchestra.run.smithi117.stdout:(39/174): bison-3.7.4-5.el9.x86_64.rpm 6.4 MB/s | 920 kB 00:00 2024-04-04T06:53:32.326 INFO:teuthology.orchestra.run.smithi117.stdout:(40/174): boost-program-options-1.75.0-8.el9.x8 2.5 MB/s | 106 kB 00:00 2024-04-04T06:53:32.359 INFO:teuthology.orchestra.run.smithi072.stdout:(159/174): librados2-19.0.0-2571.gaddbc488.el9. 2.4 MB/s | 3.4 MB 00:01 2024-04-04T06:53:32.376 INFO:teuthology.orchestra.run.smithi117.stdout:(41/174): flex-2.6.4-9.el9.x86_64.rpm 6.1 MB/s | 307 kB 00:00 2024-04-04T06:53:32.384 INFO:teuthology.orchestra.run.smithi072.stdout:(160/174): elfutils-libelf-0.190-2.el9.x86_64.r 1.1 MB/s | 192 kB 00:00 2024-04-04T06:53:32.410 INFO:teuthology.orchestra.run.smithi117.stdout:(42/174): flexiblas-3.0.4-8.el9.x86_64.rpm 970 kB/s | 32 kB 00:00 2024-04-04T06:53:32.418 INFO:teuthology.orchestra.run.smithi072.stdout:(161/174): elfutils-libs-0.190-2.el9.x86_64.rpm 1.4 MB/s | 256 kB 00:00 2024-04-04T06:53:32.444 INFO:teuthology.orchestra.run.smithi072.stdout:(162/174): libacl-2.3.1-4.el9.x86_64.rpm 275 kB/s | 23 kB 00:00 2024-04-04T06:53:32.478 INFO:teuthology.orchestra.run.smithi072.stdout:(163/174): libblkid-2.37.4-18.el9.x86_64.rpm 1.1 MB/s | 108 kB 00:00 2024-04-04T06:53:32.511 INFO:teuthology.orchestra.run.smithi072.stdout:(164/174): libfdisk-2.37.4-18.el9.x86_64.rpm 1.6 MB/s | 155 kB 00:00 2024-04-04T06:53:32.545 INFO:teuthology.orchestra.run.smithi072.stdout:(165/174): libsmartcols-2.37.4-18.el9.x86_64.rp 959 kB/s | 64 kB 00:00 2024-04-04T06:53:32.571 INFO:teuthology.orchestra.run.smithi072.stdout:(166/174): libmount-2.37.4-18.el9.x86_64.rpm 1.1 MB/s | 136 kB 00:00 2024-04-04T06:53:32.594 INFO:teuthology.orchestra.run.smithi117.stdout:(43/174): flexiblas-netlib-3.0.4-8.el9.x86_64.r 16 MB/s | 3.0 MB 00:00 2024-04-04T06:53:32.596 INFO:teuthology.orchestra.run.smithi072.stdout:(167/174): libuuid-2.37.4-18.el9.x86_64.rpm 343 kB/s | 29 kB 00:00 2024-04-04T06:53:32.627 INFO:teuthology.orchestra.run.smithi117.stdout:(44/174): flexiblas-openblas-openmp-3.0.4-8.el9 529 kB/s | 17 kB 00:00 2024-04-04T06:53:32.665 INFO:teuthology.orchestra.run.smithi117.stdout:(45/174): libaio-devel-0.3.111-13.el9.x86_64.rp 310 kB/s | 10 kB 00:00 2024-04-04T06:53:32.697 INFO:teuthology.orchestra.run.smithi072.stdout:(168/174): openssl-3.0.7-27.el9.x86_64.rpm 8.1 MB/s | 1.2 MB 00:00 2024-04-04T06:53:32.711 INFO:teuthology.orchestra.run.smithi117.stdout:(46/174): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.1 MB/s | 159 kB 00:00 2024-04-04T06:53:32.756 INFO:teuthology.orchestra.run.smithi072.stdout:(169/174): util-linux-core-2.37.4-18.el9.x86_64 7.9 MB/s | 465 kB 00:00 2024-04-04T06:53:32.762 INFO:teuthology.orchestra.run.smithi117.stdout:(47/174): librabbitmq-0.11.0-7.el9.x86_64.rpm 897 kB/s | 44 kB 00:00 2024-04-04T06:53:32.829 INFO:teuthology.orchestra.run.smithi117.stdout:(48/174): librdkafka-1.6.1-102.el9.x86_64.rpm 9.8 MB/s | 661 kB 00:00 2024-04-04T06:53:32.839 INFO:teuthology.orchestra.run.smithi072.stdout:(170/174): openssl-libs-3.0.7-27.el9.x86_64.rpm 8.9 MB/s | 2.2 MB 00:00 2024-04-04T06:53:32.873 INFO:teuthology.orchestra.run.smithi072.stdout:(171/174): util-linux-user-2.37.4-18.el9.x86_64 267 kB/s | 31 kB 00:00 2024-04-04T06:53:32.887 INFO:teuthology.orchestra.run.smithi117.stdout:(49/174): libtool-2.4.6-45.el9.x86_64.rpm 9.9 MB/s | 578 kB 00:00 2024-04-04T06:53:32.930 INFO:teuthology.orchestra.run.smithi117.stdout:(50/174): libzstd-devel-1.5.1-2.el9.x86_64.rpm 1.1 MB/s | 46 kB 00:00 2024-04-04T06:53:32.949 INFO:teuthology.orchestra.run.smithi072.stdout:(172/174): util-linux-2.37.4-18.el9.x86_64.rpm 6.5 MB/s | 2.3 MB 00:00 2024-04-04T06:53:32.974 INFO:teuthology.orchestra.run.smithi072.stdout:(173/174): libacl-devel-2.3.1-4.el9.x86_64.rpm 746 kB/s | 74 kB 00:00 2024-04-04T06:53:32.988 INFO:teuthology.orchestra.run.smithi117.stdout:(51/174): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.8 MB/s | 282 kB 00:00 2024-04-04T06:53:33.033 INFO:teuthology.orchestra.run.smithi072.stdout:(174/174): xfsprogs-6.3.0-1.el9.x86_64.rpm 5.6 MB/s | 1.1 MB 00:00 2024-04-04T06:53:33.043 INFO:teuthology.orchestra.run.smithi072.stdout:-------------------------------------------------------------------------------- 2024-04-04T06:53:33.044 INFO:teuthology.orchestra.run.smithi072.stdout:Total 8.4 MB/s | 226 MB 00:26 2024-04-04T06:53:33.055 INFO:teuthology.orchestra.run.smithi117.stdout:(52/174): lua-5.4.4-4.el9.x86_64.rpm 2.8 MB/s | 187 kB 00:00 2024-04-04T06:53:33.139 INFO:teuthology.orchestra.run.smithi117.stdout:(53/174): oniguruma-6.9.6-1.el9.5.x86_64.rpm 2.6 MB/s | 217 kB 00:00 2024-04-04T06:53:33.324 INFO:teuthology.orchestra.run.smithi117.stdout:(54/174): ceph-mgr-diskprediction-local-19.0.0- 3.2 MB/s | 7.4 MB 00:02 2024-04-04T06:53:33.356 INFO:teuthology.orchestra.run.smithi117.stdout:(55/174): openblas-0.3.21-2.el9.x86_64.rpm 158 kB/s | 34 kB 00:00 2024-04-04T06:53:33.807 INFO:teuthology.orchestra.run.smithi117.stdout:(56/174): openblas-openmp-0.3.21-2.el9.x86_64.r 9.8 MB/s | 4.7 MB 00:00 2024-04-04T06:53:33.848 INFO:teuthology.orchestra.run.smithi117.stdout:(57/174): postgresql-13.14-1.el9.x86_64.rpm 3.1 MB/s | 1.5 MB 00:00 2024-04-04T06:53:33.940 INFO:teuthology.orchestra.run.smithi117.stdout:(58/174): postgresql-contrib-13.14-1.el9.x86_64 6.0 MB/s | 817 kB 00:00 2024-04-04T06:53:33.965 INFO:teuthology.orchestra.run.smithi117.stdout:(59/174): postgresql-private-libs-13.14-1.el9.x 1.1 MB/s | 132 kB 00:00 2024-04-04T06:53:34.196 INFO:teuthology.orchestra.run.smithi072.stdout:Running transaction check 2024-04-04T06:53:34.416 INFO:teuthology.orchestra.run.smithi117.stdout:(60/174): postgresql-server-13.14-1.el9.x86_64. 12 MB/s | 5.7 MB 00:00 2024-04-04T06:53:34.478 INFO:teuthology.orchestra.run.smithi117.stdout:(61/174): protobuf-3.14.0-13.el9.x86_64.rpm 2.0 MB/s | 1.0 MB 00:00 2024-04-04T06:53:34.503 INFO:teuthology.orchestra.run.smithi117.stdout:(62/174): python3-attrs-20.3.0-7.el9.noarch.rpm 1.0 MB/s | 78 kB 00:00 2024-04-04T06:53:34.573 INFO:teuthology.orchestra.run.smithi072.stdout:Transaction check succeeded. 2024-04-04T06:53:34.574 INFO:teuthology.orchestra.run.smithi072.stdout:Running transaction test 2024-04-04T06:53:34.683 INFO:teuthology.orchestra.run.smithi117.stdout:(63/174): python3-jsonpatch-1.21-16.el9.noarch. 134 kB/s | 24 kB 00:00 2024-04-04T06:53:34.791 INFO:teuthology.orchestra.run.smithi117.stdout:(64/174): python3-babel-2.9.1-2.el9.noarch.rpm 19 MB/s | 5.8 MB 00:00 2024-04-04T06:53:34.817 INFO:teuthology.orchestra.run.smithi117.stdout:(65/174): python3-jsonpointer-2.0-4.el9.noarch. 138 kB/s | 18 kB 00:00 2024-04-04T06:53:34.842 INFO:teuthology.orchestra.run.smithi117.stdout:(66/174): python3-mako-1.1.4-6.el9.noarch.rpm 2.8 MB/s | 144 kB 00:00 2024-04-04T06:53:34.867 INFO:teuthology.orchestra.run.smithi117.stdout:(67/174): python3-markupsafe-1.1.1-12.el9.x86_6 659 kB/s | 32 kB 00:00 2024-04-04T06:53:35.101 INFO:teuthology.orchestra.run.smithi117.stdout:(68/174): python3-numpy-1.20.1-5.el9.x86_64.rpm 19 MB/s | 4.8 MB 00:00 2024-04-04T06:53:35.126 INFO:teuthology.orchestra.run.smithi117.stdout:(69/174): python3-numpy-f2py-1.20.1-5.el9.x86_6 847 kB/s | 217 kB 00:00 2024-04-04T06:53:35.152 INFO:teuthology.orchestra.run.smithi117.stdout:(70/174): python3-oauthlib-3.1.1-5.el9.noarch.r 3.5 MB/s | 174 kB 00:00 2024-04-04T06:53:35.177 INFO:teuthology.orchestra.run.smithi117.stdout:(71/174): python3-packaging-20.9-5.el9.noarch.r 1.4 MB/s | 69 kB 00:00 2024-04-04T06:53:35.202 INFO:teuthology.orchestra.run.smithi117.stdout:(72/174): python3-prettytable-0.7.2-27.el9.noar 844 kB/s | 41 kB 00:00 2024-04-04T06:53:35.228 INFO:teuthology.orchestra.run.smithi117.stdout:(73/174): python3-protobuf-3.14.0-13.el9.noarch 4.7 MB/s | 238 kB 00:00 2024-04-04T06:53:35.253 INFO:teuthology.orchestra.run.smithi117.stdout:(74/174): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.7 MB/s | 132 kB 00:00 2024-04-04T06:53:35.287 INFO:teuthology.orchestra.run.smithi117.stdout:(75/174): python3-pyasn1-modules-0.4.8-6.el9.no 3.6 MB/s | 211 kB 00:00 2024-04-04T06:53:35.312 INFO:teuthology.orchestra.run.smithi117.stdout:(76/174): python3-pytz-2021.1-5.el9.noarch.rpm 844 kB/s | 47 kB 00:00 2024-04-04T06:53:35.337 INFO:teuthology.orchestra.run.smithi117.stdout:(77/174): python3-requests-oauthlib-1.3.0-12.el 873 kB/s | 43 kB 00:00 2024-04-04T06:53:35.554 INFO:teuthology.orchestra.run.smithi117.stdout:(78/174): python3-toml-0.10.2-6.el9.noarch.rpm 181 kB/s | 39 kB 00:00 2024-04-04T06:53:35.888 INFO:teuthology.orchestra.run.smithi117.stdout:(79/174): python3-scipy-1.6.2-8.el9.x86_64.rpm 27 MB/s | 16 MB 00:00 2024-04-04T06:53:35.913 INFO:teuthology.orchestra.run.smithi117.stdout:(80/174): python3-wcwidth-0.2.5-8.el9.noarch.rp 119 kB/s | 41 kB 00:00 2024-04-04T06:53:35.946 INFO:teuthology.orchestra.run.smithi117.stdout:(81/174): qatlib-service-24.02.0-1.el9.x86_64.r 1.1 MB/s | 35 kB 00:00 2024-04-04T06:53:35.972 INFO:teuthology.orchestra.run.smithi117.stdout:(82/174): qatlib-24.02.0-1.el9.x86_64.rpm 3.7 MB/s | 220 kB 00:00 2024-04-04T06:53:36.005 INFO:teuthology.orchestra.run.smithi117.stdout:(83/174): qatzip-libs-1.2.0-1.el9.x86_64.rpm 825 kB/s | 46 kB 00:00 2024-04-04T06:53:36.039 INFO:teuthology.orchestra.run.smithi117.stdout:(84/174): socat-1.7.4.1-5.el9.x86_64.rpm 4.5 MB/s | 300 kB 00:00 2024-04-04T06:53:36.064 INFO:teuthology.orchestra.run.smithi117.stdout:(85/174): uuid-1.6.2-55.el9.x86_64.rpm 1.0 MB/s | 56 kB 00:00 2024-04-04T06:53:36.081 INFO:teuthology.orchestra.run.smithi117.stdout:(86/174): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.5 MB/s | 63 kB 00:00 2024-04-04T06:53:36.115 INFO:teuthology.orchestra.run.smithi117.stdout:(87/174): zlib-devel-1.2.11-40.el9.x86_64.rpm 901 kB/s | 44 kB 00:00 2024-04-04T06:53:36.140 INFO:teuthology.orchestra.run.smithi117.stdout:(88/174): fuse-2.9.9-15.el9.x86_64.rpm 1.3 MB/s | 79 kB 00:00 2024-04-04T06:53:36.203 INFO:teuthology.orchestra.run.smithi117.stdout:(89/174): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.7 MB/s | 241 kB 00:00 2024-04-04T06:53:36.266 INFO:teuthology.orchestra.run.smithi117.stdout:(90/174): python3-cryptography-36.0.1-4.el9.x86 9.3 MB/s | 1.1 MB 00:00 2024-04-04T06:53:36.291 INFO:teuthology.orchestra.run.smithi117.stdout:(91/174): python3-ply-3.11-14.el9.noarch.rpm 1.3 MB/s | 103 kB 00:00 2024-04-04T06:53:36.316 INFO:teuthology.orchestra.run.smithi117.stdout:(92/174): python3-pycparser-2.20-6.el9.noarch.r 2.5 MB/s | 124 kB 00:00 2024-04-04T06:53:36.350 INFO:teuthology.orchestra.run.smithi117.stdout:(93/174): python3-urllib3-1.26.5-5.el9.noarch.r 3.2 MB/s | 187 kB 00:00 2024-04-04T06:53:36.558 INFO:teuthology.orchestra.run.smithi117.stdout:(94/174): jq-1.6-16.el9.x86_64.rpm 782 kB/s | 187 kB 00:00 2024-04-04T06:53:36.659 INFO:teuthology.orchestra.run.smithi117.stdout:(95/174): libquadmath-11.4.1-3.el9.x86_64.rpm 1.9 MB/s | 195 kB 00:00 2024-04-04T06:53:36.701 INFO:teuthology.orchestra.run.smithi117.stdout:(96/174): libgfortran-11.4.1-3.el9.x86_64.rpm 2.2 MB/s | 803 kB 00:00 2024-04-04T06:53:36.726 INFO:teuthology.orchestra.run.smithi117.stdout:(97/174): python3-requests-2.25.1-8.el9.noarch. 1.9 MB/s | 125 kB 00:00 2024-04-04T06:53:37.216 INFO:teuthology.orchestra.run.smithi072.stdout:Transaction test succeeded. 2024-04-04T06:53:37.217 INFO:teuthology.orchestra.run.smithi072.stdout:Running transaction 2024-04-04T06:53:37.360 INFO:teuthology.orchestra.run.smithi117.stdout:(98/174): elfutils-libelf-devel-0.190-2.el9.x86 33 kB/s | 21 kB 00:00 2024-04-04T06:53:37.410 INFO:teuthology.orchestra.run.smithi117.stdout:(99/174): libuuid-devel-2.37.4-18.el9.x86_64.rp 37 kB/s | 25 kB 00:00 2024-04-04T06:53:38.443 INFO:teuthology.orchestra.run.smithi117.stdout:(100/174): python3-devel-3.9.17-2.el9.x86_64.rp 238 kB/s | 245 kB 00:01 2024-04-04T06:53:39.560 INFO:teuthology.orchestra.run.smithi117.stdout:(101/174): python3-jinja2-2.11.3-5.el9.noarch.r 222 kB/s | 248 kB 00:01 2024-04-04T06:53:40.327 INFO:teuthology.orchestra.run.smithi117.stdout:(102/174): ceph-osd-19.0.0-2571.gaddbc488.el9.x 1.0 MB/s | 17 MB 00:16 2024-04-04T06:53:40.452 INFO:teuthology.orchestra.run.smithi117.stdout:(103/174): xfsprogs-devel-6.3.0-1.el9.x86_64.rp 105 kB/s | 94 kB 00:00 2024-04-04T06:53:41.044 INFO:teuthology.orchestra.run.smithi117.stdout:(104/174): lua-devel-5.4.4-4.el9.x86_64.rpm 31 kB/s | 22 kB 00:00 2024-04-04T06:53:42.253 INFO:teuthology.orchestra.run.smithi117.stdout:(105/174): protobuf-compiler-3.14.0-13.el9.x86_ 480 kB/s | 863 kB 00:01 2024-04-04T06:53:43.078 INFO:teuthology.orchestra.run.smithi117.stdout:(106/174): abseil-cpp-20211102.0-3.el9.x86_64.r 270 kB/s | 548 kB 00:02 2024-04-04T06:53:43.203 INFO:teuthology.orchestra.run.smithi117.stdout:(107/174): grpc-data-1.46.7-10.el9.noarch.rpm 156 kB/s | 19 kB 00:00 2024-04-04T06:53:43.553 INFO:teuthology.orchestra.run.smithi117.stdout:(108/174): gperftools-libs-2.9.1-2.el9.x86_64.r 238 kB/s | 309 kB 00:01 2024-04-04T06:53:43.670 INFO:teuthology.orchestra.run.smithi117.stdout:(109/174): libarrow-doc-9.0.0-10.el9.noarch.rpm 223 kB/s | 26 kB 00:00 2024-04-04T06:53:43.779 INFO:teuthology.orchestra.run.smithi117.stdout:(110/174): openssl-devel-3.0.7-27.el9.x86_64.rp 659 kB/s | 4.1 MB 00:06 2024-04-04T06:53:43.896 INFO:teuthology.orchestra.run.smithi117.stdout:(111/174): liboath-2.6.7-2.el9.x86_64.rpm 216 kB/s | 49 kB 00:00 2024-04-04T06:53:44.271 INFO:teuthology.orchestra.run.smithi117.stdout:(112/174): libunwind-1.6.2-1.el9.x86_64.rpm 137 kB/s | 67 kB 00:00 2024-04-04T06:53:44.480 INFO:teuthology.orchestra.run.smithi117.stdout:(113/174): luarocks-3.9.2-1.el9.noarch.rpm 259 kB/s | 151 kB 00:00 2024-04-04T06:53:44.619 INFO:teuthology.orchestra.run.smithi072.stdout: Preparing : 1/1 2024-04-04T06:53:44.754 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : openssl-libs-1:3.0.7-27.el9.x86_64 1/198 2024-04-04T06:53:44.794 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : libuuid-2.37.4-18.el9.x86_64 2/198 2024-04-04T06:53:44.832 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : libblkid-2.37.4-18.el9.x86_64 3/198 2024-04-04T06:53:44.876 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: libblkid-2.37.4-18.el9.x86_64 3/198 2024-04-04T06:53:44.962 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 4/198 2024-04-04T06:53:45.060 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 5/198 2024-04-04T06:53:45.110 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/198 2024-04-04T06:53:45.142 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 7/198 2024-04-04T06:53:45.237 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 8/198 2024-04-04T06:53:45.651 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 9/198 2024-04-04T06:53:45.777 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : librados2-2:19.0.0-2571.gaddbc488.el9.x86_64 10/198 2024-04-04T06:53:45.947 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: librados2-2:19.0.0-2571.gaddbc488.el9.x86_64 10/198 2024-04-04T06:53:45.975 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libcephfs2-2:19.0.0-2571.gaddbc488.el9.x86_64 11/198 2024-04-04T06:53:46.078 INFO:teuthology.orchestra.run.smithi117.stdout:(114/174): python3-asyncssh-2.13.2-5.el9.noarch 343 kB/s | 548 kB 00:01 2024-04-04T06:53:46.100 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: libcephfs2-2:19.0.0-2571.gaddbc488.el9.x86_64 11/198 2024-04-04T06:53:46.134 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-rados-2:19.0.0-2571.gaddbc488.el9.x86_64 12/198 2024-04-04T06:53:46.209 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 13/198 2024-04-04T06:53:46.487 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : elfutils-libelf-0.190-2.el9.x86_64 14/198 2024-04-04T06:53:46.505 INFO:teuthology.orchestra.run.smithi117.stdout:(115/174): python3-bcrypt-3.2.2-1.el9.x86_64.rp 102 kB/s | 43 kB 00:00 2024-04-04T06:53:46.553 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : postgresql-13.14-1.el9.x86_64 15/198 2024-04-04T06:53:46.580 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libcephsqlite-2:19.0.0-2571.gaddbc488.el9.x86_64 16/198 2024-04-04T06:53:46.754 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: libcephsqlite-2:19.0.0-2571.gaddbc488.el9.x86_64 16/198 2024-04-04T06:53:46.782 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libradosstriper1-2:19.0.0-2571.gaddbc488.el9.x86 17/198 2024-04-04T06:53:46.880 INFO:teuthology.orchestra.run.smithi117.stdout:(116/174): parquet-libs-9.0.0-10.el9.x86_64.rpm 321 kB/s | 838 kB 00:02 2024-04-04T06:53:46.880 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: libradosstriper1-2:19.0.0-2571.gaddbc488.el9.x86 17/198 2024-04-04T06:53:46.897 INFO:teuthology.orchestra.run.smithi117.stdout:(117/174): python3-cachetools-4.2.4-1.el9.noarc 82 kB/s | 32 kB 00:00 2024-04-04T06:53:46.926 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : libmount-2.37.4-18.el9.x86_64 18/198 2024-04-04T06:53:46.952 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 19/198 2024-04-04T06:53:47.005 INFO:teuthology.orchestra.run.smithi117.stdout:(118/174): python3-certifi-2021.10.8-2.el9.noar 120 kB/s | 15 kB 00:00 2024-04-04T06:53:47.018 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 19/198 2024-04-04T06:53:47.298 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 20/198 2024-04-04T06:53:47.347 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 20/198 2024-04-04T06:53:47.381 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : libsmartcols-2.37.4-18.el9.x86_64 21/198 2024-04-04T06:53:47.422 INFO:teuthology.orchestra.run.smithi117.stdout:(119/174): python3-cheroot-8.6.0-4.el9.noarch.r 327 kB/s | 172 kB 00:00 2024-04-04T06:53:47.977 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 22/198 2024-04-04T06:53:48.044 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : NetworkManager-libnm-1:1.47.2-1.el9.x86_64 23/198 2024-04-04T06:53:48.133 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.2-1.el9.x86_64 23/198 2024-04-04T06:53:48.173 INFO:teuthology.orchestra.run.smithi117.stdout:(120/174): python3-cmd2-2.4.2-2.el9.noarch.rpm 405 kB/s | 303 kB 00:00 2024-04-04T06:53:48.289 INFO:teuthology.orchestra.run.smithi117.stdout:(121/174): python3-colorama-0.4.4-12.el9.noarch 305 kB/s | 35 kB 00:00 2024-04-04T06:53:48.385 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: NetworkManager-1:1.47.2-1.el9.x86_64 24/198 2024-04-04T06:53:48.432 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : NetworkManager-1:1.47.2-1.el9.x86_64 24/198 2024-04-04T06:53:48.539 INFO:teuthology.orchestra.run.smithi117.stdout:(122/174): python3-cherrypy-18.6.1-2.el9.noarch 234 kB/s | 358 kB 00:01 2024-04-04T06:53:48.759 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: NetworkManager-1:1.47.2-1.el9.x86_64 24/198 2024-04-04T06:53:48.773 INFO:teuthology.orchestra.run.smithi117.stdout:(123/174): python3-google-auth-2.28.2-1.el9.noa 420 kB/s | 203 kB 00:00 2024-04-04T06:53:48.956 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : re2-1:20211101-3.el9.x86_64 25/198 2024-04-04T06:53:49.084 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 26/198 2024-04-04T06:53:49.124 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 27/198 2024-04-04T06:53:49.152 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : liboath-2.6.7-2.el9.x86_64 28/198 2024-04-04T06:53:49.173 INFO:teuthology.orchestra.run.smithi117.stdout:(124/174): python3-grpcio-tools-1.46.7-10.el9.x 362 kB/s | 144 kB 00:00 2024-04-04T06:53:49.223 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 29/198 2024-04-04T06:53:49.290 INFO:teuthology.orchestra.run.smithi117.stdout:(125/174): python3-jaraco-8.2.1-3.el9.noarch.rp 92 kB/s | 11 kB 00:00 2024-04-04T06:53:49.331 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 30/198 2024-04-04T06:53:49.393 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 31/198 2024-04-04T06:53:49.407 INFO:teuthology.orchestra.run.smithi117.stdout:(126/174): python3-jaraco-classes-3.2.1-5.el9.n 152 kB/s | 18 kB 00:00 2024-04-04T06:53:49.445 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 32/198 2024-04-04T06:53:49.541 INFO:teuthology.orchestra.run.smithi117.stdout:(127/174): python3-jaraco-collections-3.0.0-8.e 174 kB/s | 23 kB 00:00 2024-04-04T06:53:49.545 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 33/198 2024-04-04T06:53:49.594 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 34/198 2024-04-04T06:53:49.649 INFO:teuthology.orchestra.run.smithi117.stdout:(128/174): python3-jaraco-functools-3.5.0-2.el9 180 kB/s | 19 kB 00:00 2024-04-04T06:53:49.657 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 35/198 2024-04-04T06:53:49.708 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 36/198 2024-04-04T06:53:49.750 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : lua-5.4.4-4.el9.x86_64 37/198 2024-04-04T06:53:49.766 INFO:teuthology.orchestra.run.smithi117.stdout:(129/174): python3-jaraco-text-3.2.0-6.el9.noar 170 kB/s | 20 kB 00:00 2024-04-04T06:53:49.869 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 38/198 2024-04-04T06:53:49.906 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-ceph-common-2:19.0.0-2571.gaddbc488.el9. 39/198 2024-04-04T06:53:49.958 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-ceph-argparse-2:19.0.0-2571.gaddbc488.el 40/198 2024-04-04T06:53:49.988 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-cephfs-2:19.0.0-2571.gaddbc488.el9.x86_6 41/198 2024-04-04T06:53:50.104 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 42/198 2024-04-04T06:53:50.169 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : luarocks-3.9.2-1.el9.noarch 43/198 2024-04-04T06:53:50.267 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 44/198 2024-04-04T06:53:50.449 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 45/198 2024-04-04T06:53:50.515 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 46/198 2024-04-04T06:53:51.211 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-rsa-4.9-2.el9.noarch 47/198 2024-04-04T06:53:51.315 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 48/198 2024-04-04T06:53:51.461 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 49/198 2024-04-04T06:53:51.538 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : util-linux-core-2.37.4-18.el9.x86_64 50/198 2024-04-04T06:53:51.569 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: util-linux-core-2.37.4-18.el9.x86_64 50/198 2024-04-04T06:53:51.618 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 51/198 2024-04-04T06:53:51.691 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : elfutils-libs-0.190-2.el9.x86_64 52/198 2024-04-04T06:53:51.753 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : librados-devel-2:19.0.0-2571.gaddbc488.el9.x86_6 53/198 2024-04-04T06:53:51.791 INFO:teuthology.orchestra.run.smithi117.stdout:(130/174): libarrow-9.0.0-10.el9.x86_64.rpm 527 kB/s | 4.4 MB 00:08 2024-04-04T06:53:51.799 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 54/198 2024-04-04T06:53:51.908 INFO:teuthology.orchestra.run.smithi117.stdout:(131/174): python3-kubernetes-26.1.0-2.el9.noar 488 kB/s | 1.0 MB 00:02 2024-04-04T06:53:51.950 INFO:teuthology.orchestra.run.smithi117.stdout:(132/174): python3-logutils-0.3.5-21.el9.noarch 293 kB/s | 46 kB 00:00 2024-04-04T06:53:52.100 INFO:teuthology.orchestra.run.smithi117.stdout:(133/174): python3-natsort-7.1.1-5.el9.noarch.r 386 kB/s | 58 kB 00:00 2024-04-04T06:53:52.159 INFO:teuthology.orchestra.run.smithi117.stdout:(134/174): python3-more-itertools-8.12.0-2.el9. 315 kB/s | 79 kB 00:00 2024-04-04T06:53:52.226 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : libfdisk-2.37.4-18.el9.x86_64 55/198 2024-04-04T06:53:52.309 INFO:teuthology.orchestra.run.smithi117.stdout:(135/174): python3-portend-3.1.0-2.el9.noarch.r 110 kB/s | 16 kB 00:00 2024-04-04T06:53:52.424 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : util-linux-2.37.4-18.el9.x86_64 56/198 2024-04-04T06:53:52.516 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : xfsprogs-6.3.0-1.el9.x86_64 57/198 2024-04-04T06:53:52.543 INFO:teuthology.orchestra.run.smithi117.stdout:(136/174): python3-pyOpenSSL-21.0.0-1.el9.noarc 386 kB/s | 90 kB 00:00 2024-04-04T06:53:52.576 INFO:teuthology.orchestra.run.smithi117.stdout:(137/174): python3-pecan-1.4.2-3.el9.noarch.rpm 573 kB/s | 272 kB 00:00 2024-04-04T06:53:52.585 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 58/198 2024-04-04T06:53:52.660 INFO:teuthology.orchestra.run.smithi117.stdout:(138/174): python3-pyperclip-1.8.2-2.el9.noarch 243 kB/s | 28 kB 00:00 2024-04-04T06:53:52.694 INFO:teuthology.orchestra.run.smithi117.stdout:(139/174): python3-repoze-lru-0.7-16.el9.noarch 264 kB/s | 31 kB 00:00 2024-04-04T06:53:52.800 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 59/198 2024-04-04T06:53:52.811 INFO:teuthology.orchestra.run.smithi117.stdout:(140/174): python3-rsa-4.9-2.el9.noarch.rpm 509 kB/s | 59 kB 00:00 2024-04-04T06:53:52.858 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : openssl-1:3.0.7-27.el9.x86_64 60/198 2024-04-04T06:53:52.928 INFO:teuthology.orchestra.run.smithi117.stdout:(141/174): python3-tempora-5.0.0-2.el9.noarch.r 308 kB/s | 36 kB 00:00 2024-04-04T06:53:52.930 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 61/198 2024-04-04T06:53:53.030 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 62/198 2024-04-04T06:53:53.053 INFO:teuthology.orchestra.run.smithi117.stdout:(142/174): python3-typing-extensions-4.4.0-2.el 409 kB/s | 51 kB 00:00 2024-04-04T06:53:53.068 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 63/198 2024-04-04T06:53:53.081 INFO:teuthology.orchestra.run.smithi117.stdout:(143/174): python3-routes-2.5.1-5.el9.noarch.rp 449 kB/s | 188 kB 00:00 2024-04-04T06:53:53.108 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 64/198 2024-04-04T06:53:53.178 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 65/198 2024-04-04T06:53:53.227 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 66/198 2024-04-04T06:53:53.290 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 67/198 2024-04-04T06:53:53.306 INFO:teuthology.orchestra.run.smithi117.stdout:(144/174): python3-websocket-client-1.2.3-2.el9 400 kB/s | 90 kB 00:00 2024-04-04T06:53:53.349 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 68/198 2024-04-04T06:53:53.464 INFO:teuthology.orchestra.run.smithi117.stdout:(145/174): python3-webob-1.8.7-6.el9.noarch.rpm 559 kB/s | 230 kB 00:00 2024-04-04T06:53:53.536 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 69/198 2024-04-04T06:53:53.582 INFO:teuthology.orchestra.run.smithi117.stdout:(146/174): python3-zc-lockfile-2.0-10.el9.noarc 171 kB/s | 20 kB 00:00 2024-04-04T06:53:53.595 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 70/198 2024-04-04T06:53:53.645 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 71/198 2024-04-04T06:53:53.703 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 72/198 2024-04-04T06:53:53.844 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 73/198 2024-04-04T06:53:53.885 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-google-auth-1:2.28.2-1.el9.noarch 74/198 2024-04-04T06:53:53.907 INFO:teuthology.orchestra.run.smithi117.stdout:(147/174): re2-20211101-3.el9.x86_64.rpm 590 kB/s | 192 kB 00:00 2024-04-04T06:53:53.964 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 75/198 2024-04-04T06:53:53.999 INFO:teuthology.orchestra.run.smithi117.stdout:(148/174): python3-grpcio-1.46.7-10.el9.x86_64. 382 kB/s | 2.0 MB 00:05 2024-04-04T06:53:54.003 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 76/198 2024-04-04T06:53:54.038 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 77/198 2024-04-04T06:53:54.157 INFO:teuthology.orchestra.run.smithi117.stdout:(149/174): python3-werkzeug-2.0.3-3.el9.1.noarc 502 kB/s | 427 kB 00:00 2024-04-04T06:53:54.199 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 78/198 2024-04-04T06:53:54.380 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 79/198 2024-04-04T06:53:54.522 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 80/198 2024-04-04T06:53:54.572 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 81/198 2024-04-04T06:53:54.643 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-ply-3.11-14.el9.noarch 82/198 2024-04-04T06:53:54.717 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 83/198 2024-04-04T06:53:54.774 INFO:teuthology.orchestra.run.smithi117.stdout:(150/174): librados2-19.0.0-2571.gaddbc488.el9. 4.4 MB/s | 3.4 MB 00:00 2024-04-04T06:53:54.974 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 84/198 2024-04-04T06:53:54.983 INFO:teuthology.orchestra.run.smithi117.stdout:(151/174): NetworkManager-1.47.2-1.el9.x86_64.r 11 MB/s | 2.3 MB 00:00 2024-04-04T06:53:55.032 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 85/198 2024-04-04T06:53:55.192 INFO:teuthology.orchestra.run.smithi117.stdout:(152/174): NetworkManager-libnm-1.47.2-1.el9.x8 8.8 MB/s | 1.8 MB 00:00 2024-04-04T06:53:55.202 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 86/198 2024-04-04T06:53:55.254 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 87/198 2024-04-04T06:53:55.292 INFO:teuthology.orchestra.run.smithi117.stdout:(153/174): NetworkManager-team-1.47.2-1.el9.x86 413 kB/s | 41 kB 00:00 2024-04-04T06:53:55.297 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 88/198 2024-04-04T06:53:55.336 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : fuse-2.9.9-15.el9.x86_64 89/198 2024-04-04T06:53:55.367 INFO:teuthology.orchestra.run.smithi117.stdout:(154/174): NetworkManager-tui-1.47.2-1.el9.x86_ 3.3 MB/s | 247 kB 00:00 2024-04-04T06:53:55.386 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 90/198 2024-04-04T06:53:55.434 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 91/198 2024-04-04T06:53:55.467 INFO:teuthology.orchestra.run.smithi117.stdout:(155/174): xfsdump-3.1.12-4.el9.x86_64.rpm 3.2 MB/s | 321 kB 00:00 2024-04-04T06:53:55.511 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : uuid-1.6.2-55.el9.x86_64 92/198 2024-04-04T06:53:55.570 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 93/198 2024-04-04T06:53:55.620 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 94/198 2024-04-04T06:53:55.651 INFO:teuthology.orchestra.run.smithi117.stdout:(156/174): acl-2.3.1-4.el9.x86_64.rpm 391 kB/s | 71 kB 00:00 2024-04-04T06:53:55.726 INFO:teuthology.orchestra.run.smithi117.stdout:(157/174): elfutils-debuginfod-client-0.190-2.e 489 kB/s | 36 kB 00:00 2024-04-04T06:53:55.757 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 95/198 2024-04-04T06:53:55.808 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 96/198 2024-04-04T06:53:55.852 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 97/198 2024-04-04T06:53:55.876 INFO:teuthology.orchestra.run.smithi117.stdout:(158/174): elfutils-libelf-0.190-2.el9.x86_64.r 1.3 MB/s | 192 kB 00:00 2024-04-04T06:53:55.922 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 98/198 2024-04-04T06:53:55.943 INFO:teuthology.orchestra.run.smithi117.stdout:(159/174): librbd1-19.0.0-2571.gaddbc488.el9.x8 1.8 MB/s | 3.1 MB 00:01 2024-04-04T06:53:55.967 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 99/198 2024-04-04T06:53:56.002 INFO:teuthology.orchestra.run.smithi117.stdout:(160/174): elfutils-libs-0.190-2.el9.x86_64.rpm 2.0 MB/s | 256 kB 00:00 2024-04-04T06:53:56.086 INFO:teuthology.orchestra.run.smithi117.stdout:(161/174): libacl-2.3.1-4.el9.x86_64.rpm 163 kB/s | 23 kB 00:00 2024-04-04T06:53:56.111 INFO:teuthology.orchestra.run.smithi117.stdout:(162/174): libblkid-2.37.4-18.el9.x86_64.rpm 1.0 MB/s | 108 kB 00:00 2024-04-04T06:53:56.113 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 100/198 2024-04-04T06:53:56.195 INFO:teuthology.orchestra.run.smithi117.stdout:(163/174): libfdisk-2.37.4-18.el9.x86_64.rpm 1.4 MB/s | 155 kB 00:00 2024-04-04T06:53:56.233 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 101/198 2024-04-04T06:53:56.278 INFO:teuthology.orchestra.run.smithi117.stdout:(164/174): libsmartcols-2.37.4-18.el9.x86_64.rp 771 kB/s | 64 kB 00:00 2024-04-04T06:53:56.290 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 102/198 2024-04-04T06:53:56.303 INFO:teuthology.orchestra.run.smithi117.stdout:(165/174): libmount-2.37.4-18.el9.x86_64.rpm 708 kB/s | 136 kB 00:00 2024-04-04T06:53:56.326 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 103/198 2024-04-04T06:53:56.354 INFO:teuthology.orchestra.run.smithi117.stdout:(166/174): libuuid-2.37.4-18.el9.x86_64.rpm 385 kB/s | 29 kB 00:00 2024-04-04T06:53:56.409 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 104/198 2024-04-04T06:53:56.562 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-packaging-20.9-5.el9.noarch 105/198 2024-04-04T06:53:56.629 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 106/198 2024-04-04T06:53:56.929 INFO:teuthology.orchestra.run.smithi117.stdout:(167/174): openssl-3.0.7-27.el9.x86_64.rpm 1.9 MB/s | 1.2 MB 00:00 2024-04-04T06:53:57.054 INFO:teuthology.orchestra.run.smithi117.stdout:(168/174): openssl-libs-3.0.7-27.el9.x86_64.rpm 3.1 MB/s | 2.2 MB 00:00 2024-04-04T06:53:57.204 INFO:teuthology.orchestra.run.smithi117.stdout:(169/174): util-linux-core-2.37.4-18.el9.x86_64 3.0 MB/s | 465 kB 00:00 2024-04-04T06:53:57.288 INFO:teuthology.orchestra.run.smithi117.stdout:(170/174): util-linux-user-2.37.4-18.el9.x86_64 377 kB/s | 31 kB 00:00 2024-04-04T06:53:57.530 INFO:teuthology.orchestra.run.smithi117.stdout:(171/174): xfsprogs-6.3.0-1.el9.x86_64.rpm 4.5 MB/s | 1.1 MB 00:00 2024-04-04T06:53:57.610 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 107/198 2024-04-04T06:53:57.630 INFO:teuthology.orchestra.run.smithi117.stdout:(172/174): util-linux-2.37.4-18.el9.x86_64.rpm 3.3 MB/s | 2.3 MB 00:00 2024-04-04T06:53:57.675 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 108/198 2024-04-04T06:53:57.709 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 109/198 2024-04-04T06:53:57.779 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 110/198 2024-04-04T06:53:57.805 INFO:teuthology.orchestra.run.smithi117.stdout:(173/174): thrift-0.15.0-2.el9.x86_64.rpm 416 kB/s | 1.6 MB 00:03 2024-04-04T06:53:57.901 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 111/198 2024-04-04T06:53:57.945 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 112/198 2024-04-04T06:53:58.181 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : openblas-0.3.21-2.el9.x86_64 113/198 2024-04-04T06:53:58.211 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 114/198 2024-04-04T06:53:58.312 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 115/198 2024-04-04T06:53:58.372 INFO:teuthology.orchestra.run.smithi117.stdout:(174/174): libacl-devel-2.3.1-4.el9.x86_64.rpm 88 kB/s | 74 kB 00:00 2024-04-04T06:53:58.380 INFO:teuthology.orchestra.run.smithi117.stdout:-------------------------------------------------------------------------------- 2024-04-04T06:53:58.380 INFO:teuthology.orchestra.run.smithi117.stdout:Total 5.6 MB/s | 226 MB 00:40 2024-04-04T06:53:59.111 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 116/198 2024-04-04T06:53:59.256 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 117/198 2024-04-04T06:53:59.548 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction check 2024-04-04T06:53:59.922 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction check succeeded. 2024-04-04T06:53:59.922 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction test 2024-04-04T06:54:00.766 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 118/198 2024-04-04T06:54:00.881 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 119/198 2024-04-04T06:54:00.928 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 120/198 2024-04-04T06:54:00.968 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : jq-1.6-16.el9.x86_64 121/198 2024-04-04T06:54:01.013 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 122/198 2024-04-04T06:54:01.401 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 123/198 2024-04-04T06:54:01.435 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : librbd1-2:19.0.0-2571.gaddbc488.el9.x86_64 124/198 2024-04-04T06:54:01.556 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: librbd1-2:19.0.0-2571.gaddbc488.el9.x86_64 124/198 2024-04-04T06:54:01.592 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-rbd-2:19.0.0-2571.gaddbc488.el9.x86_64 125/198 2024-04-04T06:54:01.661 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 126/198 2024-04-04T06:54:02.187 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 127/198 2024-04-04T06:54:02.217 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : librgw2-2:19.0.0-2571.gaddbc488.el9.x86_64 128/198 2024-04-04T06:54:02.248 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction test succeeded. 2024-04-04T06:54:02.249 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction 2024-04-04T06:54:02.308 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: librgw2-2:19.0.0-2571.gaddbc488.el9.x86_64 128/198 2024-04-04T06:54:02.337 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-rgw-2:19.0.0-2571.gaddbc488.el9.x86_64 129/198 2024-04-04T06:54:05.091 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-common-2:19.0.0-2571.gaddbc488.el9.x86_64 130/198 2024-04-04T06:54:05.140 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-common-2:19.0.0-2571.gaddbc488.el9.x86_64 130/198 2024-04-04T06:54:05.772 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-common-2:19.0.0-2571.gaddbc488.el9.x86_64 130/198 2024-04-04T06:54:05.823 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-base-2:19.0.0-2571.gaddbc488.el9.x86_64 131/198 2024-04-04T06:54:05.980 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-base-2:19.0.0-2571.gaddbc488.el9.x86_64 131/198 2024-04-04T06:54:05.980 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-04T06:54:05.980 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-04T06:54:05.980 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T06:54:06.016 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-selinux-2:19.0.0-2571.gaddbc488.el9.x86_64 132/198 2024-04-04T06:54:09.538 INFO:teuthology.orchestra.run.smithi117.stdout: Preparing : 1/1 2024-04-04T06:54:09.636 INFO:teuthology.orchestra.run.smithi117.stdout: Upgrading : openssl-libs-1:3.0.7-27.el9.x86_64 1/198 2024-04-04T06:54:09.697 INFO:teuthology.orchestra.run.smithi117.stdout: Upgrading : libuuid-2.37.4-18.el9.x86_64 2/198 2024-04-04T06:54:09.739 INFO:teuthology.orchestra.run.smithi117.stdout: Upgrading : libblkid-2.37.4-18.el9.x86_64 3/198 2024-04-04T06:54:09.781 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: libblkid-2.37.4-18.el9.x86_64 3/198 2024-04-04T06:54:09.858 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 4/198 2024-04-04T06:54:09.956 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 5/198 2024-04-04T06:54:10.005 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/198 2024-04-04T06:54:10.038 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 7/198 2024-04-04T06:54:10.123 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 8/198 2024-04-04T06:54:10.529 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 9/198 2024-04-04T06:54:10.572 INFO:teuthology.orchestra.run.smithi117.stdout: Upgrading : librados2-2:19.0.0-2571.gaddbc488.el9.x86_64 10/198 2024-04-04T06:54:10.722 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: librados2-2:19.0.0-2571.gaddbc488.el9.x86_64 10/198 2024-04-04T06:54:10.748 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libcephfs2-2:19.0.0-2571.gaddbc488.el9.x86_64 11/198 2024-04-04T06:54:10.893 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: libcephfs2-2:19.0.0-2571.gaddbc488.el9.x86_64 11/198 2024-04-04T06:54:10.921 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-rados-2:19.0.0-2571.gaddbc488.el9.x86_64 12/198 2024-04-04T06:54:10.991 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 13/198 2024-04-04T06:54:11.292 INFO:teuthology.orchestra.run.smithi117.stdout: Upgrading : elfutils-libelf-0.190-2.el9.x86_64 14/198 2024-04-04T06:54:11.343 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : postgresql-13.14-1.el9.x86_64 15/198 2024-04-04T06:54:11.369 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libcephsqlite-2:19.0.0-2571.gaddbc488.el9.x86_64 16/198 2024-04-04T06:54:11.505 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: libcephsqlite-2:19.0.0-2571.gaddbc488.el9.x86_64 16/198 2024-04-04T06:54:11.537 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libradosstriper1-2:19.0.0-2571.gaddbc488.el9.x86 17/198 2024-04-04T06:54:11.643 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: libradosstriper1-2:19.0.0-2571.gaddbc488.el9.x86 17/198 2024-04-04T06:54:11.688 INFO:teuthology.orchestra.run.smithi117.stdout: Upgrading : libmount-2.37.4-18.el9.x86_64 18/198 2024-04-04T06:54:11.714 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 19/198 2024-04-04T06:54:11.773 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 19/198 2024-04-04T06:54:12.101 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 20/198 2024-04-04T06:54:12.153 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 20/198 2024-04-04T06:54:12.205 INFO:teuthology.orchestra.run.smithi117.stdout: Upgrading : libsmartcols-2.37.4-18.el9.x86_64 21/198 2024-04-04T06:54:12.685 INFO:teuthology.orchestra.run.smithi117.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 22/198 2024-04-04T06:54:12.779 INFO:teuthology.orchestra.run.smithi117.stdout: Upgrading : NetworkManager-libnm-1:1.47.2-1.el9.x86_64 23/198 2024-04-04T06:54:12.869 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.2-1.el9.x86_64 23/198 2024-04-04T06:54:13.054 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: NetworkManager-1:1.47.2-1.el9.x86_64 24/198 2024-04-04T06:54:13.169 INFO:teuthology.orchestra.run.smithi117.stdout: Upgrading : NetworkManager-1:1.47.2-1.el9.x86_64 24/198 2024-04-04T06:54:13.506 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: NetworkManager-1:1.47.2-1.el9.x86_64 24/198 2024-04-04T06:54:13.691 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : re2-1:20211101-3.el9.x86_64 25/198 2024-04-04T06:54:13.823 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 26/198 2024-04-04T06:54:13.883 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 27/198 2024-04-04T06:54:14.228 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : liboath-2.6.7-2.el9.x86_64 28/198 2024-04-04T06:54:14.305 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 29/198 2024-04-04T06:54:14.474 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 30/198 2024-04-04T06:54:14.567 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 31/198 2024-04-04T06:54:14.621 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 32/198 2024-04-04T06:54:14.713 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 33/198 2024-04-04T06:54:14.763 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 34/198 2024-04-04T06:54:14.817 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 35/198 2024-04-04T06:54:14.864 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 36/198 2024-04-04T06:54:14.897 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : lua-5.4.4-4.el9.x86_64 37/198 2024-04-04T06:54:15.032 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 38/198 2024-04-04T06:54:15.077 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-ceph-common-2:19.0.0-2571.gaddbc488.el9. 39/198 2024-04-04T06:54:15.128 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-ceph-argparse-2:19.0.0-2571.gaddbc488.el 40/198 2024-04-04T06:54:15.159 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-cephfs-2:19.0.0-2571.gaddbc488.el9.x86_6 41/198 2024-04-04T06:54:15.272 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 42/198 2024-04-04T06:54:15.326 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : luarocks-3.9.2-1.el9.noarch 43/198 2024-04-04T06:54:15.424 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 44/198 2024-04-04T06:54:15.586 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 45/198 2024-04-04T06:54:15.652 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 46/198 2024-04-04T06:54:16.286 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-rsa-4.9-2.el9.noarch 47/198 2024-04-04T06:54:16.377 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 48/198 2024-04-04T06:54:16.503 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 49/198 2024-04-04T06:54:16.571 INFO:teuthology.orchestra.run.smithi117.stdout: Upgrading : util-linux-core-2.37.4-18.el9.x86_64 50/198 2024-04-04T06:54:16.598 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: util-linux-core-2.37.4-18.el9.x86_64 50/198 2024-04-04T06:54:16.685 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 51/198 2024-04-04T06:54:16.784 INFO:teuthology.orchestra.run.smithi117.stdout: Upgrading : elfutils-libs-0.190-2.el9.x86_64 52/198 2024-04-04T06:54:16.845 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : librados-devel-2:19.0.0-2571.gaddbc488.el9.x86_6 53/198 2024-04-04T06:54:16.888 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 54/198 2024-04-04T06:54:17.316 INFO:teuthology.orchestra.run.smithi117.stdout: Upgrading : libfdisk-2.37.4-18.el9.x86_64 55/198 2024-04-04T06:54:17.579 INFO:teuthology.orchestra.run.smithi117.stdout: Upgrading : util-linux-2.37.4-18.el9.x86_64 56/198 2024-04-04T06:54:17.652 INFO:teuthology.orchestra.run.smithi117.stdout: Upgrading : xfsprogs-6.3.0-1.el9.x86_64 57/198 2024-04-04T06:54:17.723 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 58/198 2024-04-04T06:54:17.918 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 59/198 2024-04-04T06:54:17.980 INFO:teuthology.orchestra.run.smithi117.stdout: Upgrading : openssl-1:3.0.7-27.el9.x86_64 60/198 2024-04-04T06:54:18.056 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 61/198 2024-04-04T06:54:18.151 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 62/198 2024-04-04T06:54:18.205 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 63/198 2024-04-04T06:54:18.245 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 64/198 2024-04-04T06:54:18.314 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 65/198 2024-04-04T06:54:18.353 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 66/198 2024-04-04T06:54:18.442 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 67/198 2024-04-04T06:54:18.510 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 68/198 2024-04-04T06:54:18.707 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 69/198 2024-04-04T06:54:18.758 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 70/198 2024-04-04T06:54:18.797 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 71/198 2024-04-04T06:54:18.856 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 72/198 2024-04-04T06:54:18.984 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 73/198 2024-04-04T06:54:19.029 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-google-auth-1:2.28.2-1.el9.noarch 74/198 2024-04-04T06:54:19.075 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 75/198 2024-04-04T06:54:19.111 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 76/198 2024-04-04T06:54:19.144 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 77/198 2024-04-04T06:54:19.320 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 78/198 2024-04-04T06:54:19.497 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 79/198 2024-04-04T06:54:19.669 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 80/198 2024-04-04T06:54:19.721 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 81/198 2024-04-04T06:54:19.786 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-ply-3.11-14.el9.noarch 82/198 2024-04-04T06:54:19.871 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 83/198 2024-04-04T06:54:20.115 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 84/198 2024-04-04T06:54:20.168 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 85/198 2024-04-04T06:54:20.359 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 86/198 2024-04-04T06:54:20.408 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 87/198 2024-04-04T06:54:20.457 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 88/198 2024-04-04T06:54:20.487 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : fuse-2.9.9-15.el9.x86_64 89/198 2024-04-04T06:54:20.528 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 90/198 2024-04-04T06:54:20.573 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 91/198 2024-04-04T06:54:20.641 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : uuid-1.6.2-55.el9.x86_64 92/198 2024-04-04T06:54:20.721 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 93/198 2024-04-04T06:54:20.776 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 94/198 2024-04-04T06:54:20.917 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 95/198 2024-04-04T06:54:20.954 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 96/198 2024-04-04T06:54:20.996 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 97/198 2024-04-04T06:54:21.063 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 98/198 2024-04-04T06:54:21.107 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 99/198 2024-04-04T06:54:21.253 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 100/198 2024-04-04T06:54:21.368 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 101/198 2024-04-04T06:54:21.420 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 102/198 2024-04-04T06:54:21.456 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 103/198 2024-04-04T06:54:21.511 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 104/198 2024-04-04T06:54:21.657 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-packaging-20.9-5.el9.noarch 105/198 2024-04-04T06:54:21.730 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 106/198 2024-04-04T06:54:22.015 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-selinux-2:19.0.0-2571.gaddbc488.el9.x86_64 132/198 2024-04-04T06:54:22.016 INFO:teuthology.orchestra.run.smithi072.stdout:skipping the directory /sys 2024-04-04T06:54:22.016 INFO:teuthology.orchestra.run.smithi072.stdout:skipping the directory /proc 2024-04-04T06:54:22.016 INFO:teuthology.orchestra.run.smithi072.stdout:skipping the directory /mnt 2024-04-04T06:54:22.016 INFO:teuthology.orchestra.run.smithi072.stdout:skipping the directory /var/tmp 2024-04-04T06:54:22.016 INFO:teuthology.orchestra.run.smithi072.stdout:skipping the directory /home 2024-04-04T06:54:22.016 INFO:teuthology.orchestra.run.smithi072.stdout:skipping the directory /root 2024-04-04T06:54:22.016 INFO:teuthology.orchestra.run.smithi072.stdout:skipping the directory /tmp 2024-04-04T06:54:22.016 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T06:54:22.262 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-volume-2:19.0.0-2571.gaddbc488.el9.noarch 133/198 2024-04-04T06:54:22.309 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-volume-2:19.0.0-2571.gaddbc488.el9.noarch 133/198 2024-04-04T06:54:22.309 INFO:teuthology.orchestra.run.smithi072.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-04T06:54:22.309 INFO:teuthology.orchestra.run.smithi072.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-04-04T06:54:22.309 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T06:54:22.685 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 107/198 2024-04-04T06:54:22.746 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 108/198 2024-04-04T06:54:22.780 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 109/198 2024-04-04T06:54:22.836 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 110/198 2024-04-04T06:54:22.948 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 111/198 2024-04-04T06:54:23.014 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 112/198 2024-04-04T06:54:23.246 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : openblas-0.3.21-2.el9.x86_64 113/198 2024-04-04T06:54:23.277 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 114/198 2024-04-04T06:54:23.370 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 115/198 2024-04-04T06:54:23.970 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-osd-2:19.0.0-2571.gaddbc488.el9.x86_64 134/198 2024-04-04T06:54:24.072 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-osd-2:19.0.0-2571.gaddbc488.el9.x86_64 134/198 2024-04-04T06:54:24.072 INFO:teuthology.orchestra.run.smithi072.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-04T06:54:24.072 INFO:teuthology.orchestra.run.smithi072.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-04T06:54:24.072 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-04T06:54:24.072 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-04T06:54:24.073 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T06:54:24.168 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 116/198 2024-04-04T06:54:24.305 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 117/198 2024-04-04T06:54:24.337 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-mds-2:19.0.0-2571.gaddbc488.el9.x86_64 135/198 2024-04-04T06:54:24.409 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-mds-2:19.0.0-2571.gaddbc488.el9.x86_64 135/198 2024-04-04T06:54:24.409 INFO:teuthology.orchestra.run.smithi072.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-04T06:54:24.409 INFO:teuthology.orchestra.run.smithi072.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-04T06:54:24.409 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-04T06:54:24.409 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-04T06:54:24.409 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T06:54:24.906 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-mon-2:19.0.0-2571.gaddbc488.el9.x86_64 136/198 2024-04-04T06:54:24.988 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-mon-2:19.0.0-2571.gaddbc488.el9.x86_64 136/198 2024-04-04T06:54:24.989 INFO:teuthology.orchestra.run.smithi072.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-04T06:54:24.989 INFO:teuthology.orchestra.run.smithi072.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-04T06:54:24.989 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-04T06:54:24.989 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-04T06:54:24.989 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T06:54:25.125 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : automake-1.16.2-8.el9.noarch 137/198 2024-04-04T06:54:25.753 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: cephadm-2:19.0.0-2571.gaddbc488.el9.noarch 138/198 2024-04-04T06:54:25.791 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : cephadm-2:19.0.0-2571.gaddbc488.el9.noarch 138/198 2024-04-04T06:54:25.817 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 118/198 2024-04-04T06:54:25.846 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-2571.gaddbc488.e 139/198 2024-04-04T06:54:25.931 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 119/198 2024-04-04T06:54:25.955 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-2571.gaddbc488. 140/198 2024-04-04T06:54:25.970 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 120/198 2024-04-04T06:54:25.997 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-2571.gaddbc488.el9.noa 141/198 2024-04-04T06:54:26.000 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : jq-1.6-16.el9.x86_64 121/198 2024-04-04T06:54:26.040 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 122/198 2024-04-04T06:54:26.422 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 123/198 2024-04-04T06:54:26.464 INFO:teuthology.orchestra.run.smithi117.stdout: Upgrading : librbd1-2:19.0.0-2571.gaddbc488.el9.x86_64 124/198 2024-04-04T06:54:26.584 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: librbd1-2:19.0.0-2571.gaddbc488.el9.x86_64 124/198 2024-04-04T06:54:26.620 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-rbd-2:19.0.0-2571.gaddbc488.el9.x86_64 125/198 2024-04-04T06:54:26.688 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 126/198 2024-04-04T06:54:27.205 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 127/198 2024-04-04T06:54:27.234 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : librgw2-2:19.0.0-2571.gaddbc488.el9.x86_64 128/198 2024-04-04T06:54:27.307 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: librgw2-2:19.0.0-2571.gaddbc488.el9.x86_64 128/198 2024-04-04T06:54:27.308 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-2571.gaddbc488.el9.noa 141/198 2024-04-04T06:54:27.336 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-rgw-2:19.0.0-2571.gaddbc488.el9.x86_64 129/198 2024-04-04T06:54:27.358 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-2571.gaddbc488.el9.n 142/198 2024-04-04T06:54:28.453 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-2571.gaddbc488.el9.n 142/198 2024-04-04T06:54:28.492 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-2571.gadd 143/198 2024-04-04T06:54:28.633 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-2571.gadd 143/198 2024-04-04T06:54:28.818 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-2571.gaddbc488.el 144/198 2024-04-04T06:54:28.856 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-mgr-2:19.0.0-2571.gaddbc488.el9.x86_64 145/198 2024-04-04T06:54:28.950 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-mgr-2:19.0.0-2571.gaddbc488.el9.x86_64 145/198 2024-04-04T06:54:28.950 INFO:teuthology.orchestra.run.smithi072.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-04T06:54:28.951 INFO:teuthology.orchestra.run.smithi072.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-04T06:54:28.951 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-04T06:54:28.951 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-04T06:54:28.951 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T06:54:29.008 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-mgr-rook-2:19.0.0-2571.gaddbc488.el9.noarch 146/198 2024-04-04T06:54:29.044 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-2571.gaddbc488.el9.noarch 146/198 2024-04-04T06:54:29.138 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-2:19.0.0-2571.gaddbc488.el9.x86_64 147/198 2024-04-04T06:54:29.913 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-common-2:19.0.0-2571.gaddbc488.el9.x86_64 130/198 2024-04-04T06:54:29.957 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-common-2:19.0.0-2571.gaddbc488.el9.x86_64 130/198 2024-04-04T06:54:30.150 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libtool-2.4.6-45.el9.x86_64 148/198 2024-04-04T06:54:30.187 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-radosgw-2:19.0.0-2571.gaddbc488.el9.x86_64 149/198 2024-04-04T06:54:30.255 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-2571.gaddbc488.el9.x86_64 149/198 2024-04-04T06:54:30.255 INFO:teuthology.orchestra.run.smithi072.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-04T06:54:30.255 INFO:teuthology.orchestra.run.smithi072.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-04T06:54:30.255 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-04T06:54:30.255 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-04T06:54:30.255 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T06:54:30.298 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-2571.gaddbc 150/198 2024-04-04T06:54:30.393 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-2571.gaddbc 150/198 2024-04-04T06:54:30.393 INFO:teuthology.orchestra.run.smithi072.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-04T06:54:30.393 INFO:teuthology.orchestra.run.smithi072.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-04T06:54:30.393 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T06:54:30.466 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : cephfs-mirror-2:19.0.0-2571.gaddbc488.el9.x86_64 151/198 2024-04-04T06:54:30.569 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-2571.gaddbc488.el9.x86_64 151/198 2024-04-04T06:54:30.569 INFO:teuthology.orchestra.run.smithi072.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-04T06:54:30.569 INFO:teuthology.orchestra.run.smithi072.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-04-04T06:54:30.569 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-04T06:54:30.570 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-04T06:54:30.570 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T06:54:30.587 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-common-2:19.0.0-2571.gaddbc488.el9.x86_64 130/198 2024-04-04T06:54:30.635 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-base-2:19.0.0-2571.gaddbc488.el9.x86_64 131/198 2024-04-04T06:54:30.805 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-base-2:19.0.0-2571.gaddbc488.el9.x86_64 131/198 2024-04-04T06:54:30.805 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-04T06:54:30.805 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-04T06:54:30.805 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-04T06:54:30.853 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-selinux-2:19.0.0-2571.gaddbc488.el9.x86_64 132/198 2024-04-04T06:54:30.968 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : rbd-mirror-2:19.0.0-2571.gaddbc488.el9.x86_64 152/198 2024-04-04T06:54:31.067 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: rbd-mirror-2:19.0.0-2571.gaddbc488.el9.x86_64 152/198 2024-04-04T06:54:31.068 INFO:teuthology.orchestra.run.smithi072.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-04T06:54:31.068 INFO:teuthology.orchestra.run.smithi072.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-04T06:54:31.068 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-04T06:54:31.069 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-04T06:54:31.069 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T06:54:35.914 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-test-2:19.0.0-2571.gaddbc488.el9.x86_64 153/198 2024-04-04T06:54:35.968 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : rbd-fuse-2:19.0.0-2571.gaddbc488.el9.x86_64 154/198 2024-04-04T06:54:36.004 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : rbd-nbd-2:19.0.0-2571.gaddbc488.el9.x86_64 155/198 2024-04-04T06:54:36.068 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 156/198 2024-04-04T06:54:36.345 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : cephfs-shell-2:19.0.0-2571.gaddbc488.el9.x86_64 157/198 2024-04-04T06:54:36.491 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 158/198 2024-04-04T06:54:36.546 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-fuse-2:19.0.0-2571.gaddbc488.el9.x86_64 159/198 2024-04-04T06:54:36.634 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 160/198 2024-04-04T06:54:36.692 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 161/198 2024-04-04T06:54:36.739 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : util-linux-user-2.37.4-18.el9.x86_64 162/198 2024-04-04T06:54:36.784 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libcephfs-devel-2:19.0.0-2571.gaddbc488.el9.x86_ 163/198 2024-04-04T06:54:36.828 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : elfutils-debuginfod-client-0.190-2.el9.x86_64 164/198 2024-04-04T06:54:36.888 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : NetworkManager-team-1:1.47.2-1.el9.x86_64 165/198 2024-04-04T06:54:36.983 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : NetworkManager-tui-1:1.47.2-1.el9.x86_64 166/198 2024-04-04T06:54:37.107 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 167/198 2024-04-04T06:54:37.141 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 168/198 2024-04-04T06:54:38.088 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 169/198 2024-04-04T06:54:38.139 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 169/198 2024-04-04T06:54:38.204 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 169/198 2024-04-04T06:54:39.542 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : cephfs-top-2:19.0.0-2571.gaddbc488.el9.noarch 170/198 2024-04-04T06:54:39.875 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : openssl-devel-1:3.0.7-27.el9.x86_64 171/198 2024-04-04T06:54:39.958 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 172/198 2024-04-04T06:54:40.100 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : flex-2.6.4-9.el9.x86_64 173/198 2024-04-04T06:54:40.149 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : bison-3.7.4-5.el9.x86_64 174/198 2024-04-04T06:54:40.182 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 175/198 2024-04-04T06:54:40.234 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 176/198 2024-04-04T06:54:40.277 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 177/198 2024-04-04T06:54:40.277 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 178/198 2024-04-04T06:54:40.430 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 178/198 2024-04-04T06:54:40.481 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 179/198 2024-04-04T06:54:40.481 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 180/198 2024-04-04T06:54:40.620 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 180/198 2024-04-04T06:54:40.666 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 181/198 2024-04-04T06:54:40.721 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : xfsprogs-5.19.0-4.el9.x86_64 182/198 2024-04-04T06:54:40.763 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 183/198 2024-04-04T06:54:40.796 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 184/198 2024-04-04T06:54:40.881 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : util-linux-user-2.37.4-15.el9.x86_64 185/198 2024-04-04T06:54:40.974 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : util-linux-2.37.4-15.el9.x86_64 186/198 2024-04-04T06:54:41.032 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : util-linux-core-2.37.4-15.el9.x86_64 187/198 2024-04-04T06:54:41.107 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : libfdisk-2.37.4-15.el9.x86_64 188/198 2024-04-04T06:54:41.149 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : libmount-2.37.4-15.el9.x86_64 189/198 2024-04-04T06:54:41.183 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : libblkid-2.37.4-15.el9.x86_64 190/198 2024-04-04T06:54:41.217 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 191/198 2024-04-04T06:54:41.253 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-04-04T06:54:41.253 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-04-04T06:54:41.553 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-04-04T06:54:41.553 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 193/198 2024-04-04T06:54:41.693 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 193/198 2024-04-04T06:54:41.752 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : libuuid-2.37.4-15.el9.x86_64 194/198 2024-04-04T06:54:41.790 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : libsmartcols-2.37.4-15.el9.x86_64 195/198 2024-04-04T06:54:41.835 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 196/198 2024-04-04T06:54:41.876 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 197/198 2024-04-04T06:54:41.996 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 198/198 2024-04-04T06:54:42.242 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: elfutils-libelf-0.189-3.el9.x86_64 198/198 2024-04-04T06:54:42.242 INFO:teuthology.orchestra.run.smithi072.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-04-04T06:54:42.242 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T06:54:43.448 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-selinux-2:19.0.0-2571.gaddbc488.el9.x86_64 132/198 2024-04-04T06:54:43.449 INFO:teuthology.orchestra.run.smithi117.stdout:skipping the directory /sys 2024-04-04T06:54:43.449 INFO:teuthology.orchestra.run.smithi117.stdout:skipping the directory /proc 2024-04-04T06:54:43.449 INFO:teuthology.orchestra.run.smithi117.stdout:skipping the directory /mnt 2024-04-04T06:54:43.449 INFO:teuthology.orchestra.run.smithi117.stdout:skipping the directory /var/tmp 2024-04-04T06:54:43.449 INFO:teuthology.orchestra.run.smithi117.stdout:skipping the directory /home 2024-04-04T06:54:43.449 INFO:teuthology.orchestra.run.smithi117.stdout:skipping the directory /root 2024-04-04T06:54:43.449 INFO:teuthology.orchestra.run.smithi117.stdout:skipping the directory /tmp 2024-04-04T06:54:43.449 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-04T06:54:43.649 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-volume-2:19.0.0-2571.gaddbc488.el9.noarch 133/198 2024-04-04T06:54:43.690 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-volume-2:19.0.0-2571.gaddbc488.el9.noarch 133/198 2024-04-04T06:54:43.690 INFO:teuthology.orchestra.run.smithi117.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-04T06:54:43.690 INFO:teuthology.orchestra.run.smithi117.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-04-04T06:54:43.691 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-04T06:54:45.260 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-osd-2:19.0.0-2571.gaddbc488.el9.x86_64 134/198 2024-04-04T06:54:45.336 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-osd-2:19.0.0-2571.gaddbc488.el9.x86_64 134/198 2024-04-04T06:54:45.336 INFO:teuthology.orchestra.run.smithi117.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-04T06:54:45.336 INFO:teuthology.orchestra.run.smithi117.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-04T06:54:45.336 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-04T06:54:45.336 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-04T06:54:45.336 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-04T06:54:45.585 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-mds-2:19.0.0-2571.gaddbc488.el9.x86_64 135/198 2024-04-04T06:54:45.654 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-mds-2:19.0.0-2571.gaddbc488.el9.x86_64 135/198 2024-04-04T06:54:45.654 INFO:teuthology.orchestra.run.smithi117.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-04T06:54:45.654 INFO:teuthology.orchestra.run.smithi117.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-04T06:54:45.654 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-04T06:54:45.654 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-04T06:54:45.654 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-04T06:54:46.128 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-mon-2:19.0.0-2571.gaddbc488.el9.x86_64 136/198 2024-04-04T06:54:46.199 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-mon-2:19.0.0-2571.gaddbc488.el9.x86_64 136/198 2024-04-04T06:54:46.199 INFO:teuthology.orchestra.run.smithi117.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-04T06:54:46.200 INFO:teuthology.orchestra.run.smithi117.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-04T06:54:46.200 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-04T06:54:46.200 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-04T06:54:46.200 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-04T06:54:46.321 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : automake-1.16.2-8.el9.noarch 137/198 2024-04-04T06:54:46.925 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: cephadm-2:19.0.0-2571.gaddbc488.el9.noarch 138/198 2024-04-04T06:54:46.963 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : cephadm-2:19.0.0-2571.gaddbc488.el9.noarch 138/198 2024-04-04T06:54:47.014 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-2571.gaddbc488.e 139/198 2024-04-04T06:54:47.149 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-2571.gaddbc488. 140/198 2024-04-04T06:54:47.193 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-2571.gaddbc488.el9.noa 141/198 2024-04-04T06:54:48.493 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-2571.gaddbc488.el9.noa 141/198 2024-04-04T06:54:48.536 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-2571.gaddbc488.el9.n 142/198 2024-04-04T06:54:49.628 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-2571.gaddbc488.el9.n 142/198 2024-04-04T06:54:49.661 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-2571.gadd 143/198 2024-04-04T06:54:49.805 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-2571.gadd 143/198 2024-04-04T06:54:49.976 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-2571.gaddbc488.el 144/198 2024-04-04T06:54:50.013 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-mgr-2:19.0.0-2571.gaddbc488.el9.x86_64 145/198 2024-04-04T06:54:50.089 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-mgr-2:19.0.0-2571.gaddbc488.el9.x86_64 145/198 2024-04-04T06:54:50.089 INFO:teuthology.orchestra.run.smithi117.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-04T06:54:50.089 INFO:teuthology.orchestra.run.smithi117.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-04T06:54:50.090 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-04T06:54:50.090 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-04T06:54:50.090 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-04T06:54:50.147 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-mgr-rook-2:19.0.0-2571.gaddbc488.el9.noarch 146/198 2024-04-04T06:54:50.182 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-2571.gaddbc488.el9.noarch 146/198 2024-04-04T06:54:50.274 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-2:19.0.0-2571.gaddbc488.el9.x86_64 147/198 2024-04-04T06:54:51.245 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libtool-2.4.6-45.el9.x86_64 148/198 2024-04-04T06:54:51.274 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-radosgw-2:19.0.0-2571.gaddbc488.el9.x86_64 149/198 2024-04-04T06:54:51.349 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-2571.gaddbc488.el9.x86_64 149/198 2024-04-04T06:54:51.349 INFO:teuthology.orchestra.run.smithi117.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-04T06:54:51.349 INFO:teuthology.orchestra.run.smithi117.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-04T06:54:51.349 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-04T06:54:51.349 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-04T06:54:51.349 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-04T06:54:51.400 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-2571.gaddbc 150/198 2024-04-04T06:54:51.485 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-2571.gaddbc 150/198 2024-04-04T06:54:51.485 INFO:teuthology.orchestra.run.smithi117.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-04T06:54:51.485 INFO:teuthology.orchestra.run.smithi117.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-04T06:54:51.485 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-04T06:54:51.559 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : cephfs-mirror-2:19.0.0-2571.gaddbc488.el9.x86_64 151/198 2024-04-04T06:54:51.656 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-2571.gaddbc488.el9.x86_64 151/198 2024-04-04T06:54:51.656 INFO:teuthology.orchestra.run.smithi117.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-04T06:54:51.656 INFO:teuthology.orchestra.run.smithi117.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-04-04T06:54:51.656 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-04T06:54:51.657 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-04T06:54:51.657 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-04T06:54:51.831 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-2:19.0.0-2571.gaddbc488.el9.x86_64 1/198 2024-04-04T06:54:51.831 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-base-2:19.0.0-2571.gaddbc488.el9.x86_64 2/198 2024-04-04T06:54:51.831 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-common-2:19.0.0-2571.gaddbc488.el9.x86_64 3/198 2024-04-04T06:54:51.831 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-fuse-2:19.0.0-2571.gaddbc488.el9.x86_64 4/198 2024-04-04T06:54:51.831 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-2571.gaddbc 5/198 2024-04-04T06:54:51.831 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-mds-2:19.0.0-2571.gaddbc488.el9.x86_64 6/198 2024-04-04T06:54:51.831 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-mgr-2:19.0.0-2571.gaddbc488.el9.x86_64 7/198 2024-04-04T06:54:51.831 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-mon-2:19.0.0-2571.gaddbc488.el9.x86_64 8/198 2024-04-04T06:54:51.831 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-osd-2:19.0.0-2571.gaddbc488.el9.x86_64 9/198 2024-04-04T06:54:51.831 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-radosgw-2:19.0.0-2571.gaddbc488.el9.x86_64 10/198 2024-04-04T06:54:51.831 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-selinux-2:19.0.0-2571.gaddbc488.el9.x86_64 11/198 2024-04-04T06:54:51.832 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-test-2:19.0.0-2571.gaddbc488.el9.x86_64 12/198 2024-04-04T06:54:51.832 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : cephfs-mirror-2:19.0.0-2571.gaddbc488.el9.x86_64 13/198 2024-04-04T06:54:51.832 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : cephfs-shell-2:19.0.0-2571.gaddbc488.el9.x86_64 14/198 2024-04-04T06:54:51.832 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libcephfs-devel-2:19.0.0-2571.gaddbc488.el9.x86_ 15/198 2024-04-04T06:54:51.832 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libcephfs2-2:19.0.0-2571.gaddbc488.el9.x86_64 16/198 2024-04-04T06:54:51.832 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libcephsqlite-2:19.0.0-2571.gaddbc488.el9.x86_64 17/198 2024-04-04T06:54:51.832 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : librados-devel-2:19.0.0-2571.gaddbc488.el9.x86_6 18/198 2024-04-04T06:54:51.832 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libradosstriper1-2:19.0.0-2571.gaddbc488.el9.x86 19/198 2024-04-04T06:54:51.832 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : librgw2-2:19.0.0-2571.gaddbc488.el9.x86_64 20/198 2024-04-04T06:54:51.832 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-ceph-argparse-2:19.0.0-2571.gaddbc488.el 21/198 2024-04-04T06:54:51.832 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-ceph-common-2:19.0.0-2571.gaddbc488.el9. 22/198 2024-04-04T06:54:51.832 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-cephfs-2:19.0.0-2571.gaddbc488.el9.x86_6 23/198 2024-04-04T06:54:51.832 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-rados-2:19.0.0-2571.gaddbc488.el9.x86_64 24/198 2024-04-04T06:54:51.832 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-rbd-2:19.0.0-2571.gaddbc488.el9.x86_64 25/198 2024-04-04T06:54:51.832 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-rgw-2:19.0.0-2571.gaddbc488.el9.x86_64 26/198 2024-04-04T06:54:51.832 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : rbd-fuse-2:19.0.0-2571.gaddbc488.el9.x86_64 27/198 2024-04-04T06:54:51.833 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : rbd-mirror-2:19.0.0-2571.gaddbc488.el9.x86_64 28/198 2024-04-04T06:54:51.833 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : rbd-nbd-2:19.0.0-2571.gaddbc488.el9.x86_64 29/198 2024-04-04T06:54:51.833 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-2571.gaddbc488. 30/198 2024-04-04T06:54:51.833 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-2571.gaddbc488.el9.noa 31/198 2024-04-04T06:54:51.847 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-2571.gaddbc488.el9.n 32/198 2024-04-04T06:54:51.847 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-2571.gadd 33/198 2024-04-04T06:54:51.848 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-2571.gaddbc488.el 34/198 2024-04-04T06:54:51.848 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-mgr-rook-2:19.0.0-2571.gaddbc488.el9.noarch 35/198 2024-04-04T06:54:51.848 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-2571.gaddbc488.e 36/198 2024-04-04T06:54:51.848 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-volume-2:19.0.0-2571.gaddbc488.el9.noarch 37/198 2024-04-04T06:54:51.848 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : cephadm-2:19.0.0-2571.gaddbc488.el9.noarch 38/198 2024-04-04T06:54:51.848 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : cephfs-top-2:19.0.0-2571.gaddbc488.el9.noarch 39/198 2024-04-04T06:54:51.848 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : automake-1.16.2-8.el9.noarch 40/198 2024-04-04T06:54:51.848 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : bison-3.7.4-5.el9.x86_64 41/198 2024-04-04T06:54:51.848 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 42/198 2024-04-04T06:54:51.848 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : flex-2.6.4-9.el9.x86_64 43/198 2024-04-04T06:54:51.848 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 44/198 2024-04-04T06:54:51.848 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 45/198 2024-04-04T06:54:51.848 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 46/198 2024-04-04T06:54:51.848 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 47/198 2024-04-04T06:54:51.849 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 48/198 2024-04-04T06:54:51.849 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 49/198 2024-04-04T06:54:51.849 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 50/198 2024-04-04T06:54:51.849 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 51/198 2024-04-04T06:54:51.849 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 52/198 2024-04-04T06:54:51.849 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 53/198 2024-04-04T06:54:51.849 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : lua-5.4.4-4.el9.x86_64 54/198 2024-04-04T06:54:51.849 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 55/198 2024-04-04T06:54:51.849 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 56/198 2024-04-04T06:54:51.849 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 57/198 2024-04-04T06:54:51.849 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : postgresql-13.14-1.el9.x86_64 58/198 2024-04-04T06:54:51.849 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 59/198 2024-04-04T06:54:51.849 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 60/198 2024-04-04T06:54:51.849 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 61/198 2024-04-04T06:54:51.850 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 62/198 2024-04-04T06:54:51.850 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 63/198 2024-04-04T06:54:51.850 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 64/198 2024-04-04T06:54:51.850 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 65/198 2024-04-04T06:54:51.850 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 66/198 2024-04-04T06:54:51.850 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 67/198 2024-04-04T06:54:51.850 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 68/198 2024-04-04T06:54:51.850 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 69/198 2024-04-04T06:54:51.850 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 70/198 2024-04-04T06:54:51.850 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 71/198 2024-04-04T06:54:51.850 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 72/198 2024-04-04T06:54:51.850 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 73/198 2024-04-04T06:54:51.850 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 74/198 2024-04-04T06:54:51.850 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 75/198 2024-04-04T06:54:51.851 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 76/198 2024-04-04T06:54:51.851 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 77/198 2024-04-04T06:54:51.851 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 78/198 2024-04-04T06:54:51.851 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 79/198 2024-04-04T06:54:51.851 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 80/198 2024-04-04T06:54:51.851 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 81/198 2024-04-04T06:54:51.851 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 82/198 2024-04-04T06:54:51.851 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 83/198 2024-04-04T06:54:51.851 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 84/198 2024-04-04T06:54:51.851 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 85/198 2024-04-04T06:54:51.851 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 86/198 2024-04-04T06:54:51.851 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 87/198 2024-04-04T06:54:51.851 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 88/198 2024-04-04T06:54:51.851 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 89/198 2024-04-04T06:54:51.851 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 90/198 2024-04-04T06:54:51.852 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 91/198 2024-04-04T06:54:51.852 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-ply-3.11-14.el9.noarch 92/198 2024-04-04T06:54:51.852 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 93/198 2024-04-04T06:54:51.852 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 94/198 2024-04-04T06:54:51.852 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : jq-1.6-16.el9.x86_64 95/198 2024-04-04T06:54:51.852 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 96/198 2024-04-04T06:54:51.852 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 97/198 2024-04-04T06:54:51.852 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 98/198 2024-04-04T06:54:51.852 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 99/198 2024-04-04T06:54:51.852 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 100/198 2024-04-04T06:54:51.852 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : openssl-devel-1:3.0.7-27.el9.x86_64 101/198 2024-04-04T06:54:51.852 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 102/198 2024-04-04T06:54:51.852 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 103/198 2024-04-04T06:54:51.852 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 104/198 2024-04-04T06:54:51.853 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/198 2024-04-04T06:54:51.853 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/198 2024-04-04T06:54:51.853 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/198 2024-04-04T06:54:51.853 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 108/198 2024-04-04T06:54:51.853 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/198 2024-04-04T06:54:51.853 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 110/198 2024-04-04T06:54:51.853 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 111/198 2024-04-04T06:54:51.853 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/198 2024-04-04T06:54:51.853 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/198 2024-04-04T06:54:51.853 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 114/198 2024-04-04T06:54:51.853 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 115/198 2024-04-04T06:54:51.853 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/198 2024-04-04T06:54:51.853 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/198 2024-04-04T06:54:51.853 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/198 2024-04-04T06:54:51.853 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 119/198 2024-04-04T06:54:51.853 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/198 2024-04-04T06:54:51.854 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/198 2024-04-04T06:54:51.854 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/198 2024-04-04T06:54:51.854 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 123/198 2024-04-04T06:54:51.854 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-google-auth-1:2.28.2-1.el9.noarch 124/198 2024-04-04T06:54:51.854 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 125/198 2024-04-04T06:54:51.854 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 126/198 2024-04-04T06:54:51.854 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 127/198 2024-04-04T06:54:51.854 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 128/198 2024-04-04T06:54:51.854 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 129/198 2024-04-04T06:54:51.854 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 130/198 2024-04-04T06:54:51.854 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 131/198 2024-04-04T06:54:51.854 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 132/198 2024-04-04T06:54:51.854 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 133/198 2024-04-04T06:54:51.854 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 134/198 2024-04-04T06:54:51.855 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 135/198 2024-04-04T06:54:51.855 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 136/198 2024-04-04T06:54:51.855 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 137/198 2024-04-04T06:54:51.855 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 138/198 2024-04-04T06:54:51.855 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 139/198 2024-04-04T06:54:51.855 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 140/198 2024-04-04T06:54:51.855 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 141/198 2024-04-04T06:54:51.855 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 142/198 2024-04-04T06:54:51.855 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 143/198 2024-04-04T06:54:51.855 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 144/198 2024-04-04T06:54:51.855 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 145/198 2024-04-04T06:54:51.855 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 146/198 2024-04-04T06:54:51.855 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 147/198 2024-04-04T06:54:51.855 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 148/198 2024-04-04T06:54:51.855 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : re2-1:20211101-3.el9.x86_64 149/198 2024-04-04T06:54:51.855 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 150/198 2024-04-04T06:54:51.856 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : librados2-2:19.0.0-2571.gaddbc488.el9.x86_64 151/198 2024-04-04T06:54:51.856 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 152/198 2024-04-04T06:54:51.856 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : librbd1-2:19.0.0-2571.gaddbc488.el9.x86_64 153/198 2024-04-04T06:54:51.856 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 154/198 2024-04-04T06:54:51.856 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : NetworkManager-1:1.47.2-1.el9.x86_64 155/198 2024-04-04T06:54:51.856 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 156/198 2024-04-04T06:54:51.856 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : NetworkManager-libnm-1:1.47.2-1.el9.x86_64 157/198 2024-04-04T06:54:51.856 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 158/198 2024-04-04T06:54:51.856 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : NetworkManager-team-1:1.47.2-1.el9.x86_64 159/198 2024-04-04T06:54:51.856 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 160/198 2024-04-04T06:54:51.856 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : NetworkManager-tui-1:1.47.2-1.el9.x86_64 161/198 2024-04-04T06:54:51.856 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 162/198 2024-04-04T06:54:51.856 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 163/198 2024-04-04T06:54:51.856 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 164/198 2024-04-04T06:54:51.856 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : acl-2.3.1-4.el9.x86_64 165/198 2024-04-04T06:54:51.857 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : acl-2.3.1-3.el9.x86_64 166/198 2024-04-04T06:54:51.857 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 167/198 2024-04-04T06:54:51.857 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 168/198 2024-04-04T06:54:51.857 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 169/198 2024-04-04T06:54:51.857 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 170/198 2024-04-04T06:54:51.857 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 171/198 2024-04-04T06:54:51.857 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 172/198 2024-04-04T06:54:51.857 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 173/198 2024-04-04T06:54:51.857 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 174/198 2024-04-04T06:54:51.857 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libblkid-2.37.4-18.el9.x86_64 175/198 2024-04-04T06:54:51.857 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libblkid-2.37.4-15.el9.x86_64 176/198 2024-04-04T06:54:51.857 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libfdisk-2.37.4-18.el9.x86_64 177/198 2024-04-04T06:54:51.857 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libfdisk-2.37.4-15.el9.x86_64 178/198 2024-04-04T06:54:51.857 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libmount-2.37.4-18.el9.x86_64 179/198 2024-04-04T06:54:51.857 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libmount-2.37.4-15.el9.x86_64 180/198 2024-04-04T06:54:51.857 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libsmartcols-2.37.4-18.el9.x86_64 181/198 2024-04-04T06:54:51.858 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libsmartcols-2.37.4-15.el9.x86_64 182/198 2024-04-04T06:54:51.858 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libuuid-2.37.4-18.el9.x86_64 183/198 2024-04-04T06:54:51.858 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libuuid-2.37.4-15.el9.x86_64 184/198 2024-04-04T06:54:51.858 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 185/198 2024-04-04T06:54:51.858 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 186/198 2024-04-04T06:54:51.858 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 187/198 2024-04-04T06:54:51.858 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 188/198 2024-04-04T06:54:51.858 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : util-linux-2.37.4-18.el9.x86_64 189/198 2024-04-04T06:54:51.858 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : util-linux-2.37.4-15.el9.x86_64 190/198 2024-04-04T06:54:51.858 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : util-linux-core-2.37.4-18.el9.x86_64 191/198 2024-04-04T06:54:51.858 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : util-linux-core-2.37.4-15.el9.x86_64 192/198 2024-04-04T06:54:51.858 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : util-linux-user-2.37.4-18.el9.x86_64 193/198 2024-04-04T06:54:51.858 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : util-linux-user-2.37.4-15.el9.x86_64 194/198 2024-04-04T06:54:51.858 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 195/198 2024-04-04T06:54:51.858 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : xfsprogs-5.19.0-4.el9.x86_64 196/198 2024-04-04T06:54:51.859 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 197/198 2024-04-04T06:54:52.035 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : rbd-mirror-2:19.0.0-2571.gaddbc488.el9.x86_64 152/198 2024-04-04T06:54:52.115 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: rbd-mirror-2:19.0.0-2571.gaddbc488.el9.x86_64 152/198 2024-04-04T06:54:52.115 INFO:teuthology.orchestra.run.smithi117.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-04T06:54:52.115 INFO:teuthology.orchestra.run.smithi117.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-04T06:54:52.115 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-04T06:54:52.116 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-04T06:54:52.116 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-04T06:54:54.419 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 198/198 2024-04-04T06:54:54.420 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T06:54:54.420 INFO:teuthology.orchestra.run.smithi072.stdout:Upgraded: 2024-04-04T06:54:54.420 INFO:teuthology.orchestra.run.smithi072.stdout: NetworkManager-1:1.47.2-1.el9.x86_64 2024-04-04T06:54:54.420 INFO:teuthology.orchestra.run.smithi072.stdout: NetworkManager-libnm-1:1.47.2-1.el9.x86_64 2024-04-04T06:54:54.420 INFO:teuthology.orchestra.run.smithi072.stdout: NetworkManager-team-1:1.47.2-1.el9.x86_64 2024-04-04T06:54:54.420 INFO:teuthology.orchestra.run.smithi072.stdout: NetworkManager-tui-1:1.47.2-1.el9.x86_64 2024-04-04T06:54:54.420 INFO:teuthology.orchestra.run.smithi072.stdout: acl-2.3.1-4.el9.x86_64 2024-04-04T06:54:54.420 INFO:teuthology.orchestra.run.smithi072.stdout: elfutils-debuginfod-client-0.190-2.el9.x86_64 2024-04-04T06:54:54.420 INFO:teuthology.orchestra.run.smithi072.stdout: elfutils-libelf-0.190-2.el9.x86_64 2024-04-04T06:54:54.420 INFO:teuthology.orchestra.run.smithi072.stdout: elfutils-libs-0.190-2.el9.x86_64 2024-04-04T06:54:54.420 INFO:teuthology.orchestra.run.smithi072.stdout: libacl-2.3.1-4.el9.x86_64 2024-04-04T06:54:54.421 INFO:teuthology.orchestra.run.smithi072.stdout: libacl-devel-2.3.1-4.el9.x86_64 2024-04-04T06:54:54.421 INFO:teuthology.orchestra.run.smithi072.stdout: libblkid-2.37.4-18.el9.x86_64 2024-04-04T06:54:54.421 INFO:teuthology.orchestra.run.smithi072.stdout: libfdisk-2.37.4-18.el9.x86_64 2024-04-04T06:54:54.421 INFO:teuthology.orchestra.run.smithi072.stdout: libmount-2.37.4-18.el9.x86_64 2024-04-04T06:54:54.421 INFO:teuthology.orchestra.run.smithi072.stdout: librados2-2:19.0.0-2571.gaddbc488.el9.x86_64 2024-04-04T06:54:54.421 INFO:teuthology.orchestra.run.smithi072.stdout: librbd1-2:19.0.0-2571.gaddbc488.el9.x86_64 2024-04-04T06:54:54.421 INFO:teuthology.orchestra.run.smithi072.stdout: libsmartcols-2.37.4-18.el9.x86_64 2024-04-04T06:54:54.421 INFO:teuthology.orchestra.run.smithi072.stdout: libuuid-2.37.4-18.el9.x86_64 2024-04-04T06:54:54.421 INFO:teuthology.orchestra.run.smithi072.stdout: openssl-1:3.0.7-27.el9.x86_64 2024-04-04T06:54:54.421 INFO:teuthology.orchestra.run.smithi072.stdout: openssl-libs-1:3.0.7-27.el9.x86_64 2024-04-04T06:54:54.421 INFO:teuthology.orchestra.run.smithi072.stdout: util-linux-2.37.4-18.el9.x86_64 2024-04-04T06:54:54.421 INFO:teuthology.orchestra.run.smithi072.stdout: util-linux-core-2.37.4-18.el9.x86_64 2024-04-04T06:54:54.421 INFO:teuthology.orchestra.run.smithi072.stdout: util-linux-user-2.37.4-18.el9.x86_64 2024-04-04T06:54:54.421 INFO:teuthology.orchestra.run.smithi072.stdout: xfsdump-3.1.12-4.el9.x86_64 2024-04-04T06:54:54.421 INFO:teuthology.orchestra.run.smithi072.stdout: xfsprogs-6.3.0-1.el9.x86_64 2024-04-04T06:54:54.421 INFO:teuthology.orchestra.run.smithi072.stdout:Installed: 2024-04-04T06:54:54.422 INFO:teuthology.orchestra.run.smithi072.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-04-04T06:54:54.422 INFO:teuthology.orchestra.run.smithi072.stdout: automake-1.16.2-8.el9.noarch 2024-04-04T06:54:54.422 INFO:teuthology.orchestra.run.smithi072.stdout: bison-3.7.4-5.el9.x86_64 2024-04-04T06:54:54.422 INFO:teuthology.orchestra.run.smithi072.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-04T06:54:54.422 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-2:19.0.0-2571.gaddbc488.el9.x86_64 2024-04-04T06:54:54.422 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-base-2:19.0.0-2571.gaddbc488.el9.x86_64 2024-04-04T06:54:54.422 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-common-2:19.0.0-2571.gaddbc488.el9.x86_64 2024-04-04T06:54:54.422 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-fuse-2:19.0.0-2571.gaddbc488.el9.x86_64 2024-04-04T06:54:54.422 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-grafana-dashboards-2:19.0.0-2571.gaddbc488.el9.noarch 2024-04-04T06:54:54.422 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-immutable-object-cache-2:19.0.0-2571.gaddbc488.el9.x86_64 2024-04-04T06:54:54.422 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mds-2:19.0.0-2571.gaddbc488.el9.x86_64 2024-04-04T06:54:54.422 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-2:19.0.0-2571.gaddbc488.el9.x86_64 2024-04-04T06:54:54.422 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-cephadm-2:19.0.0-2571.gaddbc488.el9.noarch 2024-04-04T06:54:54.422 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-dashboard-2:19.0.0-2571.gaddbc488.el9.noarch 2024-04-04T06:54:54.423 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-diskprediction-local-2:19.0.0-2571.gaddbc488.el9.noarch 2024-04-04T06:54:54.423 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-modules-core-2:19.0.0-2571.gaddbc488.el9.noarch 2024-04-04T06:54:54.423 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-rook-2:19.0.0-2571.gaddbc488.el9.noarch 2024-04-04T06:54:54.423 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mon-2:19.0.0-2571.gaddbc488.el9.x86_64 2024-04-04T06:54:54.423 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-osd-2:19.0.0-2571.gaddbc488.el9.x86_64 2024-04-04T06:54:54.423 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-prometheus-alerts-2:19.0.0-2571.gaddbc488.el9.noarch 2024-04-04T06:54:54.423 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-radosgw-2:19.0.0-2571.gaddbc488.el9.x86_64 2024-04-04T06:54:54.423 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-selinux-2:19.0.0-2571.gaddbc488.el9.x86_64 2024-04-04T06:54:54.423 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-test-2:19.0.0-2571.gaddbc488.el9.x86_64 2024-04-04T06:54:54.423 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-volume-2:19.0.0-2571.gaddbc488.el9.noarch 2024-04-04T06:54:54.423 INFO:teuthology.orchestra.run.smithi072.stdout: cephadm-2:19.0.0-2571.gaddbc488.el9.noarch 2024-04-04T06:54:54.423 INFO:teuthology.orchestra.run.smithi072.stdout: cephfs-mirror-2:19.0.0-2571.gaddbc488.el9.x86_64 2024-04-04T06:54:54.423 INFO:teuthology.orchestra.run.smithi072.stdout: cephfs-shell-2:19.0.0-2571.gaddbc488.el9.x86_64 2024-04-04T06:54:54.423 INFO:teuthology.orchestra.run.smithi072.stdout: cephfs-top-2:19.0.0-2571.gaddbc488.el9.noarch 2024-04-04T06:54:54.424 INFO:teuthology.orchestra.run.smithi072.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-04-04T06:54:54.424 INFO:teuthology.orchestra.run.smithi072.stdout: flex-2.6.4-9.el9.x86_64 2024-04-04T06:54:54.424 INFO:teuthology.orchestra.run.smithi072.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-04T06:54:54.424 INFO:teuthology.orchestra.run.smithi072.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-04T06:54:54.424 INFO:teuthology.orchestra.run.smithi072.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-04T06:54:54.424 INFO:teuthology.orchestra.run.smithi072.stdout: fuse-2.9.9-15.el9.x86_64 2024-04-04T06:54:54.424 INFO:teuthology.orchestra.run.smithi072.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-04T06:54:54.424 INFO:teuthology.orchestra.run.smithi072.stdout: grpc-data-1.46.7-10.el9.noarch 2024-04-04T06:54:54.424 INFO:teuthology.orchestra.run.smithi072.stdout: jq-1.6-16.el9.x86_64 2024-04-04T06:54:54.424 INFO:teuthology.orchestra.run.smithi072.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-04-04T06:54:54.424 INFO:teuthology.orchestra.run.smithi072.stdout: libarrow-9.0.0-10.el9.x86_64 2024-04-04T06:54:54.424 INFO:teuthology.orchestra.run.smithi072.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-04-04T06:54:54.424 INFO:teuthology.orchestra.run.smithi072.stdout: libcephfs-devel-2:19.0.0-2571.gaddbc488.el9.x86_64 2024-04-04T06:54:54.424 INFO:teuthology.orchestra.run.smithi072.stdout: libcephfs2-2:19.0.0-2571.gaddbc488.el9.x86_64 2024-04-04T06:54:54.424 INFO:teuthology.orchestra.run.smithi072.stdout: libcephsqlite-2:19.0.0-2571.gaddbc488.el9.x86_64 2024-04-04T06:54:54.425 INFO:teuthology.orchestra.run.smithi072.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-04T06:54:54.425 INFO:teuthology.orchestra.run.smithi072.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-04T06:54:54.425 INFO:teuthology.orchestra.run.smithi072.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-04T06:54:54.425 INFO:teuthology.orchestra.run.smithi072.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-04T06:54:54.425 INFO:teuthology.orchestra.run.smithi072.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-04T06:54:54.425 INFO:teuthology.orchestra.run.smithi072.stdout: librados-devel-2:19.0.0-2571.gaddbc488.el9.x86_64 2024-04-04T06:54:54.425 INFO:teuthology.orchestra.run.smithi072.stdout: libradosstriper1-2:19.0.0-2571.gaddbc488.el9.x86_64 2024-04-04T06:54:54.425 INFO:teuthology.orchestra.run.smithi072.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-04T06:54:54.425 INFO:teuthology.orchestra.run.smithi072.stdout: librgw2-2:19.0.0-2571.gaddbc488.el9.x86_64 2024-04-04T06:54:54.425 INFO:teuthology.orchestra.run.smithi072.stdout: libtool-2.4.6-45.el9.x86_64 2024-04-04T06:54:54.425 INFO:teuthology.orchestra.run.smithi072.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-04T06:54:54.425 INFO:teuthology.orchestra.run.smithi072.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-04-04T06:54:54.426 INFO:teuthology.orchestra.run.smithi072.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-04-04T06:54:54.426 INFO:teuthology.orchestra.run.smithi072.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-04T06:54:54.426 INFO:teuthology.orchestra.run.smithi072.stdout: lua-5.4.4-4.el9.x86_64 2024-04-04T06:54:54.426 INFO:teuthology.orchestra.run.smithi072.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-04-04T06:54:54.426 INFO:teuthology.orchestra.run.smithi072.stdout: luarocks-3.9.2-1.el9.noarch 2024-04-04T06:54:54.426 INFO:teuthology.orchestra.run.smithi072.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-04-04T06:54:54.426 INFO:teuthology.orchestra.run.smithi072.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-04T06:54:54.426 INFO:teuthology.orchestra.run.smithi072.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-04T06:54:54.426 INFO:teuthology.orchestra.run.smithi072.stdout: openssl-devel-1:3.0.7-27.el9.x86_64 2024-04-04T06:54:54.426 INFO:teuthology.orchestra.run.smithi072.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-04-04T06:54:54.426 INFO:teuthology.orchestra.run.smithi072.stdout: postgresql-13.14-1.el9.x86_64 2024-04-04T06:54:54.426 INFO:teuthology.orchestra.run.smithi072.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-04-04T06:54:54.426 INFO:teuthology.orchestra.run.smithi072.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-04-04T06:54:54.427 INFO:teuthology.orchestra.run.smithi072.stdout: postgresql-server-13.14-1.el9.x86_64 2024-04-04T06:54:54.427 INFO:teuthology.orchestra.run.smithi072.stdout: protobuf-3.14.0-13.el9.x86_64 2024-04-04T06:54:54.427 INFO:teuthology.orchestra.run.smithi072.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-04-04T06:54:54.427 INFO:teuthology.orchestra.run.smithi072.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-04T06:54:54.427 INFO:teuthology.orchestra.run.smithi072.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-04-04T06:54:54.427 INFO:teuthology.orchestra.run.smithi072.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-04T06:54:54.427 INFO:teuthology.orchestra.run.smithi072.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-04T06:54:54.427 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-04T06:54:54.427 INFO:teuthology.orchestra.run.smithi072.stdout: python3-ceph-argparse-2:19.0.0-2571.gaddbc488.el9.x86_64 2024-04-04T06:54:54.427 INFO:teuthology.orchestra.run.smithi072.stdout: python3-ceph-common-2:19.0.0-2571.gaddbc488.el9.x86_64 2024-04-04T06:54:54.428 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cephfs-2:19.0.0-2571.gaddbc488.el9.x86_64 2024-04-04T06:54:54.428 INFO:teuthology.orchestra.run.smithi072.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-04T06:54:54.428 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-04T06:54:54.428 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-04T06:54:54.428 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-04T06:54:54.428 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-04-04T06:54:54.428 INFO:teuthology.orchestra.run.smithi072.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-04-04T06:54:54.428 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-04T06:54:54.428 INFO:teuthology.orchestra.run.smithi072.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-04-04T06:54:54.428 INFO:teuthology.orchestra.run.smithi072.stdout: python3-google-auth-1:2.28.2-1.el9.noarch 2024-04-04T06:54:54.428 INFO:teuthology.orchestra.run.smithi072.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-04-04T06:54:54.428 INFO:teuthology.orchestra.run.smithi072.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-04-04T06:54:54.429 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-04T06:54:54.429 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-04T06:54:54.429 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-04T06:54:54.429 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-04T06:54:54.429 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-04T06:54:54.429 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-04T06:54:54.429 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-04T06:54:54.429 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-04T06:54:54.429 INFO:teuthology.orchestra.run.smithi072.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-04T06:54:54.429 INFO:teuthology.orchestra.run.smithi072.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-04T06:54:54.429 INFO:teuthology.orchestra.run.smithi072.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-04T06:54:54.429 INFO:teuthology.orchestra.run.smithi072.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-04T06:54:54.429 INFO:teuthology.orchestra.run.smithi072.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-04T06:54:54.429 INFO:teuthology.orchestra.run.smithi072.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-04T06:54:54.429 INFO:teuthology.orchestra.run.smithi072.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-04T06:54:54.430 INFO:teuthology.orchestra.run.smithi072.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-04T06:54:54.430 INFO:teuthology.orchestra.run.smithi072.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-04T06:54:54.430 INFO:teuthology.orchestra.run.smithi072.stdout: python3-packaging-20.9-5.el9.noarch 2024-04-04T06:54:54.430 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-04T06:54:54.430 INFO:teuthology.orchestra.run.smithi072.stdout: python3-ply-3.11-14.el9.noarch 2024-04-04T06:54:54.430 INFO:teuthology.orchestra.run.smithi072.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-04T06:54:54.430 INFO:teuthology.orchestra.run.smithi072.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-04T06:54:54.430 INFO:teuthology.orchestra.run.smithi072.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-04-04T06:54:54.430 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-04T06:54:54.430 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-04T06:54:54.430 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-04T06:54:54.430 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-04T06:54:54.430 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-04-04T06:54:54.430 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-04T06:54:54.431 INFO:teuthology.orchestra.run.smithi072.stdout: python3-rados-2:19.0.0-2571.gaddbc488.el9.x86_64 2024-04-04T06:54:54.431 INFO:teuthology.orchestra.run.smithi072.stdout: python3-rbd-2:19.0.0-2571.gaddbc488.el9.x86_64 2024-04-04T06:54:54.431 INFO:teuthology.orchestra.run.smithi072.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-04T06:54:54.431 INFO:teuthology.orchestra.run.smithi072.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-04T06:54:54.431 INFO:teuthology.orchestra.run.smithi072.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-04T06:54:54.431 INFO:teuthology.orchestra.run.smithi072.stdout: python3-rgw-2:19.0.0-2571.gaddbc488.el9.x86_64 2024-04-04T06:54:54.431 INFO:teuthology.orchestra.run.smithi072.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-04T06:54:54.431 INFO:teuthology.orchestra.run.smithi072.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-04T06:54:54.431 INFO:teuthology.orchestra.run.smithi072.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-04T06:54:54.431 INFO:teuthology.orchestra.run.smithi072.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-04T06:54:54.431 INFO:teuthology.orchestra.run.smithi072.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-04T06:54:54.431 INFO:teuthology.orchestra.run.smithi072.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-04T06:54:54.431 INFO:teuthology.orchestra.run.smithi072.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-04T06:54:54.431 INFO:teuthology.orchestra.run.smithi072.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-04-04T06:54:54.431 INFO:teuthology.orchestra.run.smithi072.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-04T06:54:54.432 INFO:teuthology.orchestra.run.smithi072.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-04T06:54:54.432 INFO:teuthology.orchestra.run.smithi072.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-04T06:54:54.432 INFO:teuthology.orchestra.run.smithi072.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-04T06:54:54.432 INFO:teuthology.orchestra.run.smithi072.stdout: qatlib-24.02.0-1.el9.x86_64 2024-04-04T06:54:54.432 INFO:teuthology.orchestra.run.smithi072.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-04-04T06:54:54.432 INFO:teuthology.orchestra.run.smithi072.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-04-04T06:54:54.432 INFO:teuthology.orchestra.run.smithi072.stdout: rbd-fuse-2:19.0.0-2571.gaddbc488.el9.x86_64 2024-04-04T06:54:54.432 INFO:teuthology.orchestra.run.smithi072.stdout: rbd-mirror-2:19.0.0-2571.gaddbc488.el9.x86_64 2024-04-04T06:54:54.432 INFO:teuthology.orchestra.run.smithi072.stdout: rbd-nbd-2:19.0.0-2571.gaddbc488.el9.x86_64 2024-04-04T06:54:54.432 INFO:teuthology.orchestra.run.smithi072.stdout: re2-1:20211101-3.el9.x86_64 2024-04-04T06:54:54.432 INFO:teuthology.orchestra.run.smithi072.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-04T06:54:54.432 INFO:teuthology.orchestra.run.smithi072.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-04T06:54:54.432 INFO:teuthology.orchestra.run.smithi072.stdout: uuid-1.6.2-55.el9.x86_64 2024-04-04T06:54:54.432 INFO:teuthology.orchestra.run.smithi072.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-04-04T06:54:54.432 INFO:teuthology.orchestra.run.smithi072.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-04T06:54:54.433 INFO:teuthology.orchestra.run.smithi072.stdout: zlib-devel-1.2.11-40.el9.x86_64 2024-04-04T06:54:54.433 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T06:54:54.433 INFO:teuthology.orchestra.run.smithi072.stdout:Complete! 2024-04-04T06:54:55.268 DEBUG:teuthology.parallel:result is None 2024-04-04T06:54:56.948 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-test-2:19.0.0-2571.gaddbc488.el9.x86_64 153/198 2024-04-04T06:54:56.992 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : rbd-fuse-2:19.0.0-2571.gaddbc488.el9.x86_64 154/198 2024-04-04T06:54:57.029 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : rbd-nbd-2:19.0.0-2571.gaddbc488.el9.x86_64 155/198 2024-04-04T06:54:57.067 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 156/198 2024-04-04T06:54:57.325 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : cephfs-shell-2:19.0.0-2571.gaddbc488.el9.x86_64 157/198 2024-04-04T06:54:57.444 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 158/198 2024-04-04T06:54:57.499 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-fuse-2:19.0.0-2571.gaddbc488.el9.x86_64 159/198 2024-04-04T06:54:57.553 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 160/198 2024-04-04T06:54:57.616 INFO:teuthology.orchestra.run.smithi117.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 161/198 2024-04-04T06:54:57.653 INFO:teuthology.orchestra.run.smithi117.stdout: Upgrading : util-linux-user-2.37.4-18.el9.x86_64 162/198 2024-04-04T06:54:57.688 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libcephfs-devel-2:19.0.0-2571.gaddbc488.el9.x86_ 163/198 2024-04-04T06:54:57.732 INFO:teuthology.orchestra.run.smithi117.stdout: Upgrading : elfutils-debuginfod-client-0.190-2.el9.x86_64 164/198 2024-04-04T06:54:57.785 INFO:teuthology.orchestra.run.smithi117.stdout: Upgrading : NetworkManager-team-1:1.47.2-1.el9.x86_64 165/198 2024-04-04T06:54:57.871 INFO:teuthology.orchestra.run.smithi117.stdout: Upgrading : NetworkManager-tui-1:1.47.2-1.el9.x86_64 166/198 2024-04-04T06:54:57.979 INFO:teuthology.orchestra.run.smithi117.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 167/198 2024-04-04T06:54:58.041 INFO:teuthology.orchestra.run.smithi117.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 168/198 2024-04-04T06:54:58.895 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 169/198 2024-04-04T06:54:58.949 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 169/198 2024-04-04T06:54:59.013 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 169/198 2024-04-04T06:55:00.326 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : cephfs-top-2:19.0.0-2571.gaddbc488.el9.noarch 170/198 2024-04-04T06:55:00.427 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : openssl-devel-1:3.0.7-27.el9.x86_64 171/198 2024-04-04T06:55:00.475 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 172/198 2024-04-04T06:55:00.612 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : flex-2.6.4-9.el9.x86_64 173/198 2024-04-04T06:55:00.654 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : bison-3.7.4-5.el9.x86_64 174/198 2024-04-04T06:55:00.688 INFO:teuthology.orchestra.run.smithi117.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 175/198 2024-04-04T06:55:00.722 INFO:teuthology.orchestra.run.smithi117.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 176/198 2024-04-04T06:55:00.764 INFO:teuthology.orchestra.run.smithi117.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 177/198 2024-04-04T06:55:00.764 INFO:teuthology.orchestra.run.smithi117.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 178/198 2024-04-04T06:55:00.934 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 178/198 2024-04-04T06:55:00.984 INFO:teuthology.orchestra.run.smithi117.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 179/198 2024-04-04T06:55:00.985 INFO:teuthology.orchestra.run.smithi117.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 180/198 2024-04-04T06:55:01.122 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 180/198 2024-04-04T06:55:01.167 INFO:teuthology.orchestra.run.smithi117.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 181/198 2024-04-04T06:55:01.212 INFO:teuthology.orchestra.run.smithi117.stdout: Cleanup : xfsprogs-5.19.0-4.el9.x86_64 182/198 2024-04-04T06:55:01.246 INFO:teuthology.orchestra.run.smithi117.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 183/198 2024-04-04T06:55:01.278 INFO:teuthology.orchestra.run.smithi117.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 184/198 2024-04-04T06:55:01.345 INFO:teuthology.orchestra.run.smithi117.stdout: Cleanup : util-linux-user-2.37.4-15.el9.x86_64 185/198 2024-04-04T06:55:01.418 INFO:teuthology.orchestra.run.smithi117.stdout: Cleanup : util-linux-2.37.4-15.el9.x86_64 186/198 2024-04-04T06:55:01.483 INFO:teuthology.orchestra.run.smithi117.stdout: Cleanup : util-linux-core-2.37.4-15.el9.x86_64 187/198 2024-04-04T06:55:01.516 INFO:teuthology.orchestra.run.smithi117.stdout: Cleanup : libfdisk-2.37.4-15.el9.x86_64 188/198 2024-04-04T06:55:01.550 INFO:teuthology.orchestra.run.smithi117.stdout: Cleanup : libmount-2.37.4-15.el9.x86_64 189/198 2024-04-04T06:55:01.584 INFO:teuthology.orchestra.run.smithi117.stdout: Cleanup : libblkid-2.37.4-15.el9.x86_64 190/198 2024-04-04T06:55:01.617 INFO:teuthology.orchestra.run.smithi117.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 191/198 2024-04-04T06:55:01.652 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-04-04T06:55:01.653 INFO:teuthology.orchestra.run.smithi117.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-04-04T06:55:01.984 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-04-04T06:55:01.985 INFO:teuthology.orchestra.run.smithi117.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 193/198 2024-04-04T06:55:02.131 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 193/198 2024-04-04T06:55:02.183 INFO:teuthology.orchestra.run.smithi117.stdout: Cleanup : libuuid-2.37.4-15.el9.x86_64 194/198 2024-04-04T06:55:02.220 INFO:teuthology.orchestra.run.smithi117.stdout: Cleanup : libsmartcols-2.37.4-15.el9.x86_64 195/198 2024-04-04T06:55:02.256 INFO:teuthology.orchestra.run.smithi117.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 196/198 2024-04-04T06:55:02.296 INFO:teuthology.orchestra.run.smithi117.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 197/198 2024-04-04T06:55:02.416 INFO:teuthology.orchestra.run.smithi117.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 198/198 2024-04-04T06:55:02.663 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: elfutils-libelf-0.189-3.el9.x86_64 198/198 2024-04-04T06:55:02.663 INFO:teuthology.orchestra.run.smithi117.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-04-04T06:55:02.663 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-04T06:55:07.945 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-2:19.0.0-2571.gaddbc488.el9.x86_64 1/198 2024-04-04T06:55:07.945 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-base-2:19.0.0-2571.gaddbc488.el9.x86_64 2/198 2024-04-04T06:55:07.945 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-common-2:19.0.0-2571.gaddbc488.el9.x86_64 3/198 2024-04-04T06:55:07.945 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-fuse-2:19.0.0-2571.gaddbc488.el9.x86_64 4/198 2024-04-04T06:55:07.945 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-2571.gaddbc 5/198 2024-04-04T06:55:07.945 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-mds-2:19.0.0-2571.gaddbc488.el9.x86_64 6/198 2024-04-04T06:55:07.945 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-mgr-2:19.0.0-2571.gaddbc488.el9.x86_64 7/198 2024-04-04T06:55:07.945 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-mon-2:19.0.0-2571.gaddbc488.el9.x86_64 8/198 2024-04-04T06:55:07.945 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-osd-2:19.0.0-2571.gaddbc488.el9.x86_64 9/198 2024-04-04T06:55:07.945 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-radosgw-2:19.0.0-2571.gaddbc488.el9.x86_64 10/198 2024-04-04T06:55:07.945 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-selinux-2:19.0.0-2571.gaddbc488.el9.x86_64 11/198 2024-04-04T06:55:07.946 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-test-2:19.0.0-2571.gaddbc488.el9.x86_64 12/198 2024-04-04T06:55:07.946 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : cephfs-mirror-2:19.0.0-2571.gaddbc488.el9.x86_64 13/198 2024-04-04T06:55:07.946 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : cephfs-shell-2:19.0.0-2571.gaddbc488.el9.x86_64 14/198 2024-04-04T06:55:07.946 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libcephfs-devel-2:19.0.0-2571.gaddbc488.el9.x86_ 15/198 2024-04-04T06:55:07.946 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libcephfs2-2:19.0.0-2571.gaddbc488.el9.x86_64 16/198 2024-04-04T06:55:07.946 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libcephsqlite-2:19.0.0-2571.gaddbc488.el9.x86_64 17/198 2024-04-04T06:55:07.946 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : librados-devel-2:19.0.0-2571.gaddbc488.el9.x86_6 18/198 2024-04-04T06:55:07.946 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libradosstriper1-2:19.0.0-2571.gaddbc488.el9.x86 19/198 2024-04-04T06:55:07.946 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : librgw2-2:19.0.0-2571.gaddbc488.el9.x86_64 20/198 2024-04-04T06:55:07.946 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-ceph-argparse-2:19.0.0-2571.gaddbc488.el 21/198 2024-04-04T06:55:07.946 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-ceph-common-2:19.0.0-2571.gaddbc488.el9. 22/198 2024-04-04T06:55:07.946 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-cephfs-2:19.0.0-2571.gaddbc488.el9.x86_6 23/198 2024-04-04T06:55:07.946 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-rados-2:19.0.0-2571.gaddbc488.el9.x86_64 24/198 2024-04-04T06:55:07.946 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-rbd-2:19.0.0-2571.gaddbc488.el9.x86_64 25/198 2024-04-04T06:55:07.962 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-rgw-2:19.0.0-2571.gaddbc488.el9.x86_64 26/198 2024-04-04T06:55:07.962 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : rbd-fuse-2:19.0.0-2571.gaddbc488.el9.x86_64 27/198 2024-04-04T06:55:07.962 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : rbd-mirror-2:19.0.0-2571.gaddbc488.el9.x86_64 28/198 2024-04-04T06:55:07.962 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : rbd-nbd-2:19.0.0-2571.gaddbc488.el9.x86_64 29/198 2024-04-04T06:55:07.962 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-2571.gaddbc488. 30/198 2024-04-04T06:55:07.962 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-2571.gaddbc488.el9.noa 31/198 2024-04-04T06:55:07.963 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-2571.gaddbc488.el9.n 32/198 2024-04-04T06:55:07.963 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-2571.gadd 33/198 2024-04-04T06:55:07.963 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-2571.gaddbc488.el 34/198 2024-04-04T06:55:07.963 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-mgr-rook-2:19.0.0-2571.gaddbc488.el9.noarch 35/198 2024-04-04T06:55:07.963 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-2571.gaddbc488.e 36/198 2024-04-04T06:55:07.963 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-volume-2:19.0.0-2571.gaddbc488.el9.noarch 37/198 2024-04-04T06:55:07.963 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : cephadm-2:19.0.0-2571.gaddbc488.el9.noarch 38/198 2024-04-04T06:55:07.963 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : cephfs-top-2:19.0.0-2571.gaddbc488.el9.noarch 39/198 2024-04-04T06:55:07.963 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : automake-1.16.2-8.el9.noarch 40/198 2024-04-04T06:55:07.963 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : bison-3.7.4-5.el9.x86_64 41/198 2024-04-04T06:55:07.963 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 42/198 2024-04-04T06:55:07.963 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : flex-2.6.4-9.el9.x86_64 43/198 2024-04-04T06:55:07.963 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 44/198 2024-04-04T06:55:07.964 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 45/198 2024-04-04T06:55:07.964 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 46/198 2024-04-04T06:55:07.964 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 47/198 2024-04-04T06:55:07.964 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 48/198 2024-04-04T06:55:07.964 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 49/198 2024-04-04T06:55:07.964 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 50/198 2024-04-04T06:55:07.964 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 51/198 2024-04-04T06:55:07.964 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 52/198 2024-04-04T06:55:07.964 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 53/198 2024-04-04T06:55:07.964 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : lua-5.4.4-4.el9.x86_64 54/198 2024-04-04T06:55:07.964 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 55/198 2024-04-04T06:55:07.964 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 56/198 2024-04-04T06:55:07.964 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 57/198 2024-04-04T06:55:07.964 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : postgresql-13.14-1.el9.x86_64 58/198 2024-04-04T06:55:07.965 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 59/198 2024-04-04T06:55:07.965 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 60/198 2024-04-04T06:55:07.965 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 61/198 2024-04-04T06:55:07.965 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 62/198 2024-04-04T06:55:07.965 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 63/198 2024-04-04T06:55:07.965 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 64/198 2024-04-04T06:55:07.965 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 65/198 2024-04-04T06:55:07.965 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 66/198 2024-04-04T06:55:07.965 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 67/198 2024-04-04T06:55:07.965 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 68/198 2024-04-04T06:55:07.965 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 69/198 2024-04-04T06:55:07.965 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 70/198 2024-04-04T06:55:07.965 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 71/198 2024-04-04T06:55:07.965 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 72/198 2024-04-04T06:55:07.966 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 73/198 2024-04-04T06:55:07.966 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 74/198 2024-04-04T06:55:07.966 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 75/198 2024-04-04T06:55:07.966 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 76/198 2024-04-04T06:55:07.966 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 77/198 2024-04-04T06:55:07.966 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 78/198 2024-04-04T06:55:07.966 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 79/198 2024-04-04T06:55:07.966 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 80/198 2024-04-04T06:55:07.966 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 81/198 2024-04-04T06:55:07.966 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 82/198 2024-04-04T06:55:07.966 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 83/198 2024-04-04T06:55:07.966 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 84/198 2024-04-04T06:55:07.966 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 85/198 2024-04-04T06:55:07.966 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 86/198 2024-04-04T06:55:07.967 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 87/198 2024-04-04T06:55:07.967 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 88/198 2024-04-04T06:55:07.967 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 89/198 2024-04-04T06:55:07.967 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 90/198 2024-04-04T06:55:07.967 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 91/198 2024-04-04T06:55:07.967 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-ply-3.11-14.el9.noarch 92/198 2024-04-04T06:55:07.967 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 93/198 2024-04-04T06:55:07.967 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 94/198 2024-04-04T06:55:07.967 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : jq-1.6-16.el9.x86_64 95/198 2024-04-04T06:55:07.967 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 96/198 2024-04-04T06:55:07.967 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 97/198 2024-04-04T06:55:07.967 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 98/198 2024-04-04T06:55:07.967 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 99/198 2024-04-04T06:55:07.967 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 100/198 2024-04-04T06:55:07.968 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : openssl-devel-1:3.0.7-27.el9.x86_64 101/198 2024-04-04T06:55:07.968 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 102/198 2024-04-04T06:55:07.968 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 103/198 2024-04-04T06:55:07.968 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 104/198 2024-04-04T06:55:07.968 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/198 2024-04-04T06:55:07.968 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/198 2024-04-04T06:55:07.968 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/198 2024-04-04T06:55:07.968 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 108/198 2024-04-04T06:55:07.968 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/198 2024-04-04T06:55:07.968 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 110/198 2024-04-04T06:55:07.968 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 111/198 2024-04-04T06:55:07.968 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/198 2024-04-04T06:55:07.968 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/198 2024-04-04T06:55:07.968 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 114/198 2024-04-04T06:55:07.969 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 115/198 2024-04-04T06:55:07.969 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/198 2024-04-04T06:55:07.969 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/198 2024-04-04T06:55:07.969 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/198 2024-04-04T06:55:07.969 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 119/198 2024-04-04T06:55:07.969 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/198 2024-04-04T06:55:07.969 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/198 2024-04-04T06:55:07.969 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/198 2024-04-04T06:55:07.969 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 123/198 2024-04-04T06:55:07.969 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-google-auth-1:2.28.2-1.el9.noarch 124/198 2024-04-04T06:55:07.969 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 125/198 2024-04-04T06:55:07.969 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 126/198 2024-04-04T06:55:07.969 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 127/198 2024-04-04T06:55:07.969 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 128/198 2024-04-04T06:55:07.970 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 129/198 2024-04-04T06:55:07.970 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 130/198 2024-04-04T06:55:07.970 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 131/198 2024-04-04T06:55:07.970 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 132/198 2024-04-04T06:55:07.970 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 133/198 2024-04-04T06:55:07.970 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 134/198 2024-04-04T06:55:07.970 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 135/198 2024-04-04T06:55:07.970 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 136/198 2024-04-04T06:55:07.970 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 137/198 2024-04-04T06:55:07.970 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 138/198 2024-04-04T06:55:07.970 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 139/198 2024-04-04T06:55:07.970 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 140/198 2024-04-04T06:55:07.970 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 141/198 2024-04-04T06:55:07.970 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 142/198 2024-04-04T06:55:07.971 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 143/198 2024-04-04T06:55:07.971 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 144/198 2024-04-04T06:55:07.971 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 145/198 2024-04-04T06:55:07.971 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 146/198 2024-04-04T06:55:07.971 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 147/198 2024-04-04T06:55:07.971 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 148/198 2024-04-04T06:55:07.971 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : re2-1:20211101-3.el9.x86_64 149/198 2024-04-04T06:55:07.971 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 150/198 2024-04-04T06:55:07.971 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : librados2-2:19.0.0-2571.gaddbc488.el9.x86_64 151/198 2024-04-04T06:55:07.971 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 152/198 2024-04-04T06:55:07.971 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : librbd1-2:19.0.0-2571.gaddbc488.el9.x86_64 153/198 2024-04-04T06:55:07.971 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 154/198 2024-04-04T06:55:07.971 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : NetworkManager-1:1.47.2-1.el9.x86_64 155/198 2024-04-04T06:55:07.972 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 156/198 2024-04-04T06:55:07.972 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : NetworkManager-libnm-1:1.47.2-1.el9.x86_64 157/198 2024-04-04T06:55:07.972 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 158/198 2024-04-04T06:55:07.972 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : NetworkManager-team-1:1.47.2-1.el9.x86_64 159/198 2024-04-04T06:55:07.972 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 160/198 2024-04-04T06:55:07.972 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : NetworkManager-tui-1:1.47.2-1.el9.x86_64 161/198 2024-04-04T06:55:07.972 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 162/198 2024-04-04T06:55:07.972 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 163/198 2024-04-04T06:55:07.972 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 164/198 2024-04-04T06:55:07.972 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : acl-2.3.1-4.el9.x86_64 165/198 2024-04-04T06:55:07.972 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : acl-2.3.1-3.el9.x86_64 166/198 2024-04-04T06:55:07.972 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 167/198 2024-04-04T06:55:07.972 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 168/198 2024-04-04T06:55:07.972 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 169/198 2024-04-04T06:55:07.972 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 170/198 2024-04-04T06:55:07.973 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 171/198 2024-04-04T06:55:07.973 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 172/198 2024-04-04T06:55:07.973 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 173/198 2024-04-04T06:55:07.973 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 174/198 2024-04-04T06:55:07.973 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libblkid-2.37.4-18.el9.x86_64 175/198 2024-04-04T06:55:07.973 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libblkid-2.37.4-15.el9.x86_64 176/198 2024-04-04T06:55:07.973 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libfdisk-2.37.4-18.el9.x86_64 177/198 2024-04-04T06:55:07.973 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libfdisk-2.37.4-15.el9.x86_64 178/198 2024-04-04T06:55:07.973 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libmount-2.37.4-18.el9.x86_64 179/198 2024-04-04T06:55:07.973 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libmount-2.37.4-15.el9.x86_64 180/198 2024-04-04T06:55:07.973 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libsmartcols-2.37.4-18.el9.x86_64 181/198 2024-04-04T06:55:07.973 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libsmartcols-2.37.4-15.el9.x86_64 182/198 2024-04-04T06:55:07.973 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libuuid-2.37.4-18.el9.x86_64 183/198 2024-04-04T06:55:07.973 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libuuid-2.37.4-15.el9.x86_64 184/198 2024-04-04T06:55:07.974 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 185/198 2024-04-04T06:55:07.974 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 186/198 2024-04-04T06:55:07.974 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 187/198 2024-04-04T06:55:07.974 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 188/198 2024-04-04T06:55:07.974 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : util-linux-2.37.4-18.el9.x86_64 189/198 2024-04-04T06:55:07.974 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : util-linux-2.37.4-15.el9.x86_64 190/198 2024-04-04T06:55:07.974 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : util-linux-core-2.37.4-18.el9.x86_64 191/198 2024-04-04T06:55:07.974 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : util-linux-core-2.37.4-15.el9.x86_64 192/198 2024-04-04T06:55:07.974 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : util-linux-user-2.37.4-18.el9.x86_64 193/198 2024-04-04T06:55:07.974 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : util-linux-user-2.37.4-15.el9.x86_64 194/198 2024-04-04T06:55:07.974 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 195/198 2024-04-04T06:55:07.974 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : xfsprogs-5.19.0-4.el9.x86_64 196/198 2024-04-04T06:55:07.974 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 197/198 2024-04-04T06:55:10.553 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 198/198 2024-04-04T06:55:10.553 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-04T06:55:10.553 INFO:teuthology.orchestra.run.smithi117.stdout:Upgraded: 2024-04-04T06:55:10.553 INFO:teuthology.orchestra.run.smithi117.stdout: NetworkManager-1:1.47.2-1.el9.x86_64 2024-04-04T06:55:10.553 INFO:teuthology.orchestra.run.smithi117.stdout: NetworkManager-libnm-1:1.47.2-1.el9.x86_64 2024-04-04T06:55:10.553 INFO:teuthology.orchestra.run.smithi117.stdout: NetworkManager-team-1:1.47.2-1.el9.x86_64 2024-04-04T06:55:10.553 INFO:teuthology.orchestra.run.smithi117.stdout: NetworkManager-tui-1:1.47.2-1.el9.x86_64 2024-04-04T06:55:10.553 INFO:teuthology.orchestra.run.smithi117.stdout: acl-2.3.1-4.el9.x86_64 2024-04-04T06:55:10.553 INFO:teuthology.orchestra.run.smithi117.stdout: elfutils-debuginfod-client-0.190-2.el9.x86_64 2024-04-04T06:55:10.553 INFO:teuthology.orchestra.run.smithi117.stdout: elfutils-libelf-0.190-2.el9.x86_64 2024-04-04T06:55:10.553 INFO:teuthology.orchestra.run.smithi117.stdout: elfutils-libs-0.190-2.el9.x86_64 2024-04-04T06:55:10.554 INFO:teuthology.orchestra.run.smithi117.stdout: libacl-2.3.1-4.el9.x86_64 2024-04-04T06:55:10.554 INFO:teuthology.orchestra.run.smithi117.stdout: libacl-devel-2.3.1-4.el9.x86_64 2024-04-04T06:55:10.554 INFO:teuthology.orchestra.run.smithi117.stdout: libblkid-2.37.4-18.el9.x86_64 2024-04-04T06:55:10.554 INFO:teuthology.orchestra.run.smithi117.stdout: libfdisk-2.37.4-18.el9.x86_64 2024-04-04T06:55:10.554 INFO:teuthology.orchestra.run.smithi117.stdout: libmount-2.37.4-18.el9.x86_64 2024-04-04T06:55:10.554 INFO:teuthology.orchestra.run.smithi117.stdout: librados2-2:19.0.0-2571.gaddbc488.el9.x86_64 2024-04-04T06:55:10.554 INFO:teuthology.orchestra.run.smithi117.stdout: librbd1-2:19.0.0-2571.gaddbc488.el9.x86_64 2024-04-04T06:55:10.554 INFO:teuthology.orchestra.run.smithi117.stdout: libsmartcols-2.37.4-18.el9.x86_64 2024-04-04T06:55:10.554 INFO:teuthology.orchestra.run.smithi117.stdout: libuuid-2.37.4-18.el9.x86_64 2024-04-04T06:55:10.554 INFO:teuthology.orchestra.run.smithi117.stdout: openssl-1:3.0.7-27.el9.x86_64 2024-04-04T06:55:10.554 INFO:teuthology.orchestra.run.smithi117.stdout: openssl-libs-1:3.0.7-27.el9.x86_64 2024-04-04T06:55:10.554 INFO:teuthology.orchestra.run.smithi117.stdout: util-linux-2.37.4-18.el9.x86_64 2024-04-04T06:55:10.555 INFO:teuthology.orchestra.run.smithi117.stdout: util-linux-core-2.37.4-18.el9.x86_64 2024-04-04T06:55:10.555 INFO:teuthology.orchestra.run.smithi117.stdout: util-linux-user-2.37.4-18.el9.x86_64 2024-04-04T06:55:10.555 INFO:teuthology.orchestra.run.smithi117.stdout: xfsdump-3.1.12-4.el9.x86_64 2024-04-04T06:55:10.555 INFO:teuthology.orchestra.run.smithi117.stdout: xfsprogs-6.3.0-1.el9.x86_64 2024-04-04T06:55:10.555 INFO:teuthology.orchestra.run.smithi117.stdout:Installed: 2024-04-04T06:55:10.555 INFO:teuthology.orchestra.run.smithi117.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-04-04T06:55:10.555 INFO:teuthology.orchestra.run.smithi117.stdout: automake-1.16.2-8.el9.noarch 2024-04-04T06:55:10.555 INFO:teuthology.orchestra.run.smithi117.stdout: bison-3.7.4-5.el9.x86_64 2024-04-04T06:55:10.555 INFO:teuthology.orchestra.run.smithi117.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-04T06:55:10.555 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-2:19.0.0-2571.gaddbc488.el9.x86_64 2024-04-04T06:55:10.555 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-base-2:19.0.0-2571.gaddbc488.el9.x86_64 2024-04-04T06:55:10.555 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-common-2:19.0.0-2571.gaddbc488.el9.x86_64 2024-04-04T06:55:10.555 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-fuse-2:19.0.0-2571.gaddbc488.el9.x86_64 2024-04-04T06:55:10.555 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-grafana-dashboards-2:19.0.0-2571.gaddbc488.el9.noarch 2024-04-04T06:55:10.555 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-immutable-object-cache-2:19.0.0-2571.gaddbc488.el9.x86_64 2024-04-04T06:55:10.556 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mds-2:19.0.0-2571.gaddbc488.el9.x86_64 2024-04-04T06:55:10.556 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-2:19.0.0-2571.gaddbc488.el9.x86_64 2024-04-04T06:55:10.556 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-cephadm-2:19.0.0-2571.gaddbc488.el9.noarch 2024-04-04T06:55:10.556 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-dashboard-2:19.0.0-2571.gaddbc488.el9.noarch 2024-04-04T06:55:10.556 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-diskprediction-local-2:19.0.0-2571.gaddbc488.el9.noarch 2024-04-04T06:55:10.556 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-modules-core-2:19.0.0-2571.gaddbc488.el9.noarch 2024-04-04T06:55:10.556 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-rook-2:19.0.0-2571.gaddbc488.el9.noarch 2024-04-04T06:55:10.556 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mon-2:19.0.0-2571.gaddbc488.el9.x86_64 2024-04-04T06:55:10.556 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-osd-2:19.0.0-2571.gaddbc488.el9.x86_64 2024-04-04T06:55:10.556 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-prometheus-alerts-2:19.0.0-2571.gaddbc488.el9.noarch 2024-04-04T06:55:10.556 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-radosgw-2:19.0.0-2571.gaddbc488.el9.x86_64 2024-04-04T06:55:10.556 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-selinux-2:19.0.0-2571.gaddbc488.el9.x86_64 2024-04-04T06:55:10.556 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-test-2:19.0.0-2571.gaddbc488.el9.x86_64 2024-04-04T06:55:10.556 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-volume-2:19.0.0-2571.gaddbc488.el9.noarch 2024-04-04T06:55:10.557 INFO:teuthology.orchestra.run.smithi117.stdout: cephadm-2:19.0.0-2571.gaddbc488.el9.noarch 2024-04-04T06:55:10.557 INFO:teuthology.orchestra.run.smithi117.stdout: cephfs-mirror-2:19.0.0-2571.gaddbc488.el9.x86_64 2024-04-04T06:55:10.557 INFO:teuthology.orchestra.run.smithi117.stdout: cephfs-shell-2:19.0.0-2571.gaddbc488.el9.x86_64 2024-04-04T06:55:10.557 INFO:teuthology.orchestra.run.smithi117.stdout: cephfs-top-2:19.0.0-2571.gaddbc488.el9.noarch 2024-04-04T06:55:10.557 INFO:teuthology.orchestra.run.smithi117.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-04-04T06:55:10.557 INFO:teuthology.orchestra.run.smithi117.stdout: flex-2.6.4-9.el9.x86_64 2024-04-04T06:55:10.557 INFO:teuthology.orchestra.run.smithi117.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-04T06:55:10.557 INFO:teuthology.orchestra.run.smithi117.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-04T06:55:10.557 INFO:teuthology.orchestra.run.smithi117.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-04T06:55:10.557 INFO:teuthology.orchestra.run.smithi117.stdout: fuse-2.9.9-15.el9.x86_64 2024-04-04T06:55:10.557 INFO:teuthology.orchestra.run.smithi117.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-04T06:55:10.557 INFO:teuthology.orchestra.run.smithi117.stdout: grpc-data-1.46.7-10.el9.noarch 2024-04-04T06:55:10.557 INFO:teuthology.orchestra.run.smithi117.stdout: jq-1.6-16.el9.x86_64 2024-04-04T06:55:10.557 INFO:teuthology.orchestra.run.smithi117.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-04-04T06:55:10.557 INFO:teuthology.orchestra.run.smithi117.stdout: libarrow-9.0.0-10.el9.x86_64 2024-04-04T06:55:10.558 INFO:teuthology.orchestra.run.smithi117.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-04-04T06:55:10.558 INFO:teuthology.orchestra.run.smithi117.stdout: libcephfs-devel-2:19.0.0-2571.gaddbc488.el9.x86_64 2024-04-04T06:55:10.558 INFO:teuthology.orchestra.run.smithi117.stdout: libcephfs2-2:19.0.0-2571.gaddbc488.el9.x86_64 2024-04-04T06:55:10.558 INFO:teuthology.orchestra.run.smithi117.stdout: libcephsqlite-2:19.0.0-2571.gaddbc488.el9.x86_64 2024-04-04T06:55:10.558 INFO:teuthology.orchestra.run.smithi117.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-04T06:55:10.558 INFO:teuthology.orchestra.run.smithi117.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-04T06:55:10.558 INFO:teuthology.orchestra.run.smithi117.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-04T06:55:10.558 INFO:teuthology.orchestra.run.smithi117.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-04T06:55:10.558 INFO:teuthology.orchestra.run.smithi117.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-04T06:55:10.558 INFO:teuthology.orchestra.run.smithi117.stdout: librados-devel-2:19.0.0-2571.gaddbc488.el9.x86_64 2024-04-04T06:55:10.558 INFO:teuthology.orchestra.run.smithi117.stdout: libradosstriper1-2:19.0.0-2571.gaddbc488.el9.x86_64 2024-04-04T06:55:10.558 INFO:teuthology.orchestra.run.smithi117.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-04T06:55:10.558 INFO:teuthology.orchestra.run.smithi117.stdout: librgw2-2:19.0.0-2571.gaddbc488.el9.x86_64 2024-04-04T06:55:10.558 INFO:teuthology.orchestra.run.smithi117.stdout: libtool-2.4.6-45.el9.x86_64 2024-04-04T06:55:10.559 INFO:teuthology.orchestra.run.smithi117.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-04T06:55:10.559 INFO:teuthology.orchestra.run.smithi117.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-04-04T06:55:10.559 INFO:teuthology.orchestra.run.smithi117.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-04-04T06:55:10.559 INFO:teuthology.orchestra.run.smithi117.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-04T06:55:10.559 INFO:teuthology.orchestra.run.smithi117.stdout: lua-5.4.4-4.el9.x86_64 2024-04-04T06:55:10.559 INFO:teuthology.orchestra.run.smithi117.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-04-04T06:55:10.559 INFO:teuthology.orchestra.run.smithi117.stdout: luarocks-3.9.2-1.el9.noarch 2024-04-04T06:55:10.559 INFO:teuthology.orchestra.run.smithi117.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-04-04T06:55:10.559 INFO:teuthology.orchestra.run.smithi117.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-04T06:55:10.559 INFO:teuthology.orchestra.run.smithi117.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-04T06:55:10.559 INFO:teuthology.orchestra.run.smithi117.stdout: openssl-devel-1:3.0.7-27.el9.x86_64 2024-04-04T06:55:10.559 INFO:teuthology.orchestra.run.smithi117.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-04-04T06:55:10.559 INFO:teuthology.orchestra.run.smithi117.stdout: postgresql-13.14-1.el9.x86_64 2024-04-04T06:55:10.559 INFO:teuthology.orchestra.run.smithi117.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-04-04T06:55:10.559 INFO:teuthology.orchestra.run.smithi117.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-04-04T06:55:10.560 INFO:teuthology.orchestra.run.smithi117.stdout: postgresql-server-13.14-1.el9.x86_64 2024-04-04T06:55:10.560 INFO:teuthology.orchestra.run.smithi117.stdout: protobuf-3.14.0-13.el9.x86_64 2024-04-04T06:55:10.560 INFO:teuthology.orchestra.run.smithi117.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-04-04T06:55:10.560 INFO:teuthology.orchestra.run.smithi117.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-04T06:55:10.560 INFO:teuthology.orchestra.run.smithi117.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-04-04T06:55:10.560 INFO:teuthology.orchestra.run.smithi117.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-04T06:55:10.560 INFO:teuthology.orchestra.run.smithi117.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-04T06:55:10.560 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-04T06:55:10.560 INFO:teuthology.orchestra.run.smithi117.stdout: python3-ceph-argparse-2:19.0.0-2571.gaddbc488.el9.x86_64 2024-04-04T06:55:10.560 INFO:teuthology.orchestra.run.smithi117.stdout: python3-ceph-common-2:19.0.0-2571.gaddbc488.el9.x86_64 2024-04-04T06:55:10.560 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cephfs-2:19.0.0-2571.gaddbc488.el9.x86_64 2024-04-04T06:55:10.560 INFO:teuthology.orchestra.run.smithi117.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-04T06:55:10.560 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-04T06:55:10.560 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-04T06:55:10.561 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-04T06:55:10.561 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-04-04T06:55:10.561 INFO:teuthology.orchestra.run.smithi117.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-04-04T06:55:10.561 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-04T06:55:10.561 INFO:teuthology.orchestra.run.smithi117.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-04-04T06:55:10.561 INFO:teuthology.orchestra.run.smithi117.stdout: python3-google-auth-1:2.28.2-1.el9.noarch 2024-04-04T06:55:10.561 INFO:teuthology.orchestra.run.smithi117.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-04-04T06:55:10.561 INFO:teuthology.orchestra.run.smithi117.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-04-04T06:55:10.561 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-04T06:55:10.561 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-04T06:55:10.561 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-04T06:55:10.561 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-04T06:55:10.561 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-04T06:55:10.561 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-04T06:55:10.561 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-04T06:55:10.562 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-04T06:55:10.562 INFO:teuthology.orchestra.run.smithi117.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-04T06:55:10.562 INFO:teuthology.orchestra.run.smithi117.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-04T06:55:10.562 INFO:teuthology.orchestra.run.smithi117.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-04T06:55:10.562 INFO:teuthology.orchestra.run.smithi117.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-04T06:55:10.562 INFO:teuthology.orchestra.run.smithi117.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-04T06:55:10.562 INFO:teuthology.orchestra.run.smithi117.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-04T06:55:10.562 INFO:teuthology.orchestra.run.smithi117.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-04T06:55:10.562 INFO:teuthology.orchestra.run.smithi117.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-04T06:55:10.562 INFO:teuthology.orchestra.run.smithi117.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-04T06:55:10.562 INFO:teuthology.orchestra.run.smithi117.stdout: python3-packaging-20.9-5.el9.noarch 2024-04-04T06:55:10.562 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-04T06:55:10.562 INFO:teuthology.orchestra.run.smithi117.stdout: python3-ply-3.11-14.el9.noarch 2024-04-04T06:55:10.562 INFO:teuthology.orchestra.run.smithi117.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-04T06:55:10.563 INFO:teuthology.orchestra.run.smithi117.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-04T06:55:10.563 INFO:teuthology.orchestra.run.smithi117.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-04-04T06:55:10.563 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-04T06:55:10.563 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-04T06:55:10.563 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-04T06:55:10.563 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-04T06:55:10.563 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-04-04T06:55:10.563 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-04T06:55:10.563 INFO:teuthology.orchestra.run.smithi117.stdout: python3-rados-2:19.0.0-2571.gaddbc488.el9.x86_64 2024-04-04T06:55:10.563 INFO:teuthology.orchestra.run.smithi117.stdout: python3-rbd-2:19.0.0-2571.gaddbc488.el9.x86_64 2024-04-04T06:55:10.563 INFO:teuthology.orchestra.run.smithi117.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-04T06:55:10.563 INFO:teuthology.orchestra.run.smithi117.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-04T06:55:10.563 INFO:teuthology.orchestra.run.smithi117.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-04T06:55:10.563 INFO:teuthology.orchestra.run.smithi117.stdout: python3-rgw-2:19.0.0-2571.gaddbc488.el9.x86_64 2024-04-04T06:55:10.564 INFO:teuthology.orchestra.run.smithi117.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-04T06:55:10.564 INFO:teuthology.orchestra.run.smithi117.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-04T06:55:10.564 INFO:teuthology.orchestra.run.smithi117.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-04T06:55:10.564 INFO:teuthology.orchestra.run.smithi117.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-04T06:55:10.564 INFO:teuthology.orchestra.run.smithi117.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-04T06:55:10.564 INFO:teuthology.orchestra.run.smithi117.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-04T06:55:10.564 INFO:teuthology.orchestra.run.smithi117.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-04T06:55:10.564 INFO:teuthology.orchestra.run.smithi117.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-04-04T06:55:10.564 INFO:teuthology.orchestra.run.smithi117.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-04T06:55:10.564 INFO:teuthology.orchestra.run.smithi117.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-04T06:55:10.564 INFO:teuthology.orchestra.run.smithi117.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-04T06:55:10.564 INFO:teuthology.orchestra.run.smithi117.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-04T06:55:10.564 INFO:teuthology.orchestra.run.smithi117.stdout: qatlib-24.02.0-1.el9.x86_64 2024-04-04T06:55:10.564 INFO:teuthology.orchestra.run.smithi117.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-04-04T06:55:10.565 INFO:teuthology.orchestra.run.smithi117.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-04-04T06:55:10.565 INFO:teuthology.orchestra.run.smithi117.stdout: rbd-fuse-2:19.0.0-2571.gaddbc488.el9.x86_64 2024-04-04T06:55:10.565 INFO:teuthology.orchestra.run.smithi117.stdout: rbd-mirror-2:19.0.0-2571.gaddbc488.el9.x86_64 2024-04-04T06:55:10.565 INFO:teuthology.orchestra.run.smithi117.stdout: rbd-nbd-2:19.0.0-2571.gaddbc488.el9.x86_64 2024-04-04T06:55:10.565 INFO:teuthology.orchestra.run.smithi117.stdout: re2-1:20211101-3.el9.x86_64 2024-04-04T06:55:10.565 INFO:teuthology.orchestra.run.smithi117.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-04T06:55:10.565 INFO:teuthology.orchestra.run.smithi117.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-04T06:55:10.565 INFO:teuthology.orchestra.run.smithi117.stdout: uuid-1.6.2-55.el9.x86_64 2024-04-04T06:55:10.565 INFO:teuthology.orchestra.run.smithi117.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-04-04T06:55:10.565 INFO:teuthology.orchestra.run.smithi117.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-04T06:55:10.565 INFO:teuthology.orchestra.run.smithi117.stdout: zlib-devel-1.2.11-40.el9.x86_64 2024-04-04T06:55:10.565 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-04T06:55:10.566 INFO:teuthology.orchestra.run.smithi117.stdout:Complete! 2024-04-04T06:55:11.206 DEBUG:teuthology.parallel:result is None 2024-04-04T06:55:11.207 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=addbc488dc763e752c640619b677f10e0da02c9f 2024-04-04T06:55:11.349 DEBUG:teuthology.orchestra.run.smithi072:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-04T06:55:11.418 INFO:teuthology.orchestra.run.smithi072.stdout:19.0.0-2571.gaddbc488.el9 2024-04-04T06:55:11.418 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2571.gaddbc488.el9 2024-04-04T06:55:11.418 INFO:teuthology.task.install:The correct ceph version 19.0.0-2571.gaddbc488 is installed. 2024-04-04T06:55:11.420 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=addbc488dc763e752c640619b677f10e0da02c9f 2024-04-04T06:55:11.566 DEBUG:teuthology.orchestra.run.smithi117:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-04T06:55:11.640 INFO:teuthology.orchestra.run.smithi117.stdout:19.0.0-2571.gaddbc488.el9 2024-04-04T06:55:11.641 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2571.gaddbc488.el9 2024-04-04T06:55:11.641 INFO:teuthology.task.install:The correct ceph version 19.0.0-2571.gaddbc488 is installed. 2024-04-04T06:55:11.642 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-04-04T06:55:11.642 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-04-04T06:55:11.642 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-04T06:55:11.744 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-04-04T06:55:11.744 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-04T06:55:11.830 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-04-04T06:55:11.830 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-04-04T06:55:11.830 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd of=/usr/bin/daemon-helper 2024-04-04T06:55:11.924 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-04T06:55:12.019 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-04-04T06:55:12.019 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd of=/usr/bin/daemon-helper 2024-04-04T06:55:12.095 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-04T06:55:12.207 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-04-04T06:55:12.208 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-04-04T06:55:12.208 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-04T06:55:12.296 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-04T06:55:12.423 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-04-04T06:55:12.423 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-04T06:55:12.501 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-04T06:55:12.610 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-04-04T06:55:12.610 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-04-04T06:55:12.610 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd of=/usr/bin/stdin-killer 2024-04-04T06:55:12.695 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-04T06:55:12.819 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-04-04T06:55:12.819 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd of=/usr/bin/stdin-killer 2024-04-04T06:55:12.894 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-04T06:55:13.007 INFO:teuthology.run_tasks:Running task ceph... 2024-04-04T06:55:13.087 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-04-04T06:55:13.088 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod 777 /var/log/ceph 2024-04-04T06:55:13.095 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod 777 /var/log/ceph 2024-04-04T06:55:13.172 INFO:tasks.ceph:Disabling ceph logrotate... 2024-04-04T06:55:13.172 DEBUG:teuthology.orchestra.run.smithi072:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-04T06:55:13.178 DEBUG:teuthology.orchestra.run.smithi117:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-04T06:55:13.255 INFO:tasks.ceph:Creating extra log directories... 2024-04-04T06:55:13.255 DEBUG:teuthology.orchestra.run.smithi072:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-04T06:55:13.262 DEBUG:teuthology.orchestra.run.smithi117:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-04T06:55:13.338 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-04-04T06:55:13.338 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-04-04T06:55:13.338 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-04-04T06:55:13.338 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-04-04T06:55:13.338 DEBUG:teuthology.orchestra.run.smithi072:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-04-04T06:55:13.388 DEBUG:teuthology.orchestra.run.smithi072:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-04-04T06:55:13.631 DEBUG:teuthology.orchestra.run.smithi072:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-04-04T06:55:13.711 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-04-04T06:55:13.711 DEBUG:teuthology.orchestra.run.smithi117:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-04-04T06:55:13.748 DEBUG:teuthology.orchestra.run.smithi117:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-04-04T06:55:13.947 DEBUG:teuthology.orchestra.run.smithi117:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-04-04T06:55:14.025 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-04-04T06:55:14.025 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-04-04T06:55:14.025 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/vshankar-2024-04-04_05:15:36-fs-wip-vshankar-testing-20240330.172700-testing-default-smithi/7639251', 'branch': 'wip-vshankar-testing-20240330.172700', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v2 tasks/xfstests-dev}', 'email': 'vshankar@redhat.com', 'first_in_suite': False, 'job_id': '7639251', 'kernel': {'flavor': 'default', 'kdb': True, 'sha1': '1df0c7e8a2354c42d738e5454ba83ea7332deac2'}, 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'mgrmodules': {'sequential': [{'print': 'Enabling mgr modules'}]}, 'name': 'vshankar-2024-04-04_05:15:36-fs-wip-vshankar-testing-20240330.172700-testing-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-vshankar-testing-20240330.172700'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability'], 'sha1': 'addbc488dc763e752c640619b677f10e0da02c9f'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'addbc488dc763e752c640619b677f10e0da02c9f'}}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'subvolume_version': 2, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-vshankar-testing-20240330.172700', 'sha1': 'addbc488dc763e752c640619b677f10e0da02c9f'}}, 'owner': 'scheduled_vshankar@teuthology', 'priority': 70, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 3016, 'sha1': 'addbc488dc763e752c640619b677f10e0da02c9f', 'sleep_before_teardown': 0, 'subset': '140/1024', 'suite': 'fs', 'suite_branch': 'wip-vshankar-testing-20240330.172700', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_addbc488dc763e752c640619b677f10e0da02c9f/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': 'addbc488dc763e752c640619b677f10e0da02c9f', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi072.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNyoLAhm8l/R+XlpFbOmSXJ4Ep2sWnsqC8v6f/EvOACZZpwj04Qalk/kmjSY8NiD6jDfxucO/cjNqiibFLwf2m4=', 'smithi117.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBC9MY64edoooXrlHPxmwqyICoctoOA4oPvQjsOEt2C6W3tr8whFb1S8ljKLqFie0K7EABOLhpoib8EKMl7RUd2g='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'flavor': 'default', 'kdb': True, 'sha1': '1df0c7e8a2354c42d738e5454ba83ea7332deac2'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'addbc488dc763e752c640619b677f10e0da02c9f'}}, {'ceph': {'create_rbd_pool': False, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability'], 'sha1': 'addbc488dc763e752c640619b677f10e0da02c9f', 'cluster': 'ceph'}}, {'sequential': ['mgrmodules']}, {'ceph-fuse': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.tests_from_xfstests_dev']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': 'd7d6e60867cadf19fbfd7655a551ae7d58060757', 'timestamp': '2024-04-04_05:15:36', 'tube': 'smithi', 'user': 'vshankar', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-04-04T06:55:14.025 DEBUG:teuthology.orchestra.run.smithi072:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-04T06:55:14.033 DEBUG:teuthology.orchestra.run.smithi117:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-04T06:55:14.080 DEBUG:teuthology.orchestra.run.smithi072:> sudo install -d -m0777 -- /var/run/ceph 2024-04-04T06:55:14.087 DEBUG:teuthology.orchestra.run.smithi117:> sudo install -d -m0777 -- /var/run/ceph 2024-04-04T06:55:14.187 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-04-04T06:55:14.187 DEBUG:teuthology.orchestra.run.smithi072:> dd if=/scratch_devs of=/dev/stdout 2024-04-04T06:55:14.241 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-04T06:55:14.241 DEBUG:teuthology.orchestra.run.smithi072:> stat /dev/vg_nvme/lv_1 2024-04-04T06:55:14.291 INFO:teuthology.orchestra.run.smithi072.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-04T06:55:14.291 INFO:teuthology.orchestra.run.smithi072.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-04T06:55:14.291 INFO:teuthology.orchestra.run.smithi072.stdout:Device: 5h/5d Inode: 631 Links: 1 2024-04-04T06:55:14.291 INFO:teuthology.orchestra.run.smithi072.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-04T06:55:14.291 INFO:teuthology.orchestra.run.smithi072.stdout:Context: system_u:object_r:device_t:s0 2024-04-04T06:55:14.291 INFO:teuthology.orchestra.run.smithi072.stdout:Access: 2024-04-04 06:54:42.723620042 +0000 2024-04-04T06:55:14.291 INFO:teuthology.orchestra.run.smithi072.stdout:Modify: 2024-04-04 06:52:01.669089841 +0000 2024-04-04T06:55:14.291 INFO:teuthology.orchestra.run.smithi072.stdout:Change: 2024-04-04 06:52:01.669089841 +0000 2024-04-04T06:55:14.292 INFO:teuthology.orchestra.run.smithi072.stdout: Birth: 2024-04-04 06:52:01.669089841 +0000 2024-04-04T06:55:14.292 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-04T06:55:14.376 INFO:teuthology.orchestra.run.smithi072.stderr:1+0 records in 2024-04-04T06:55:14.376 INFO:teuthology.orchestra.run.smithi072.stderr:1+0 records out 2024-04-04T06:55:14.376 INFO:teuthology.orchestra.run.smithi072.stderr:512 bytes copied, 0.000365643 s, 1.4 MB/s 2024-04-04T06:55:14.380 DEBUG:teuthology.orchestra.run.smithi072:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-04T06:55:14.433 DEBUG:teuthology.orchestra.run.smithi072:> stat /dev/vg_nvme/lv_2 2024-04-04T06:55:14.482 INFO:teuthology.orchestra.run.smithi072.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-04T06:55:14.482 INFO:teuthology.orchestra.run.smithi072.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-04T06:55:14.482 INFO:teuthology.orchestra.run.smithi072.stdout:Device: 5h/5d Inode: 648 Links: 1 2024-04-04T06:55:14.482 INFO:teuthology.orchestra.run.smithi072.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-04T06:55:14.482 INFO:teuthology.orchestra.run.smithi072.stdout:Context: system_u:object_r:device_t:s0 2024-04-04T06:55:14.482 INFO:teuthology.orchestra.run.smithi072.stdout:Access: 2024-04-04 06:54:42.724620021 +0000 2024-04-04T06:55:14.482 INFO:teuthology.orchestra.run.smithi072.stdout:Modify: 2024-04-04 06:52:02.239077949 +0000 2024-04-04T06:55:14.482 INFO:teuthology.orchestra.run.smithi072.stdout:Change: 2024-04-04 06:52:02.239077949 +0000 2024-04-04T06:55:14.482 INFO:teuthology.orchestra.run.smithi072.stdout: Birth: 2024-04-04 06:52:02.239077949 +0000 2024-04-04T06:55:14.482 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-04T06:55:14.564 INFO:teuthology.orchestra.run.smithi072.stderr:1+0 records in 2024-04-04T06:55:14.564 INFO:teuthology.orchestra.run.smithi072.stderr:1+0 records out 2024-04-04T06:55:14.564 INFO:teuthology.orchestra.run.smithi072.stderr:512 bytes copied, 0.000317504 s, 1.6 MB/s 2024-04-04T06:55:14.568 DEBUG:teuthology.orchestra.run.smithi072:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-04T06:55:14.621 DEBUG:teuthology.orchestra.run.smithi072:> stat /dev/vg_nvme/lv_3 2024-04-04T06:55:14.668 INFO:teuthology.orchestra.run.smithi072.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-04T06:55:14.668 INFO:teuthology.orchestra.run.smithi072.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-04T06:55:14.668 INFO:teuthology.orchestra.run.smithi072.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-04-04T06:55:14.668 INFO:teuthology.orchestra.run.smithi072.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-04T06:55:14.668 INFO:teuthology.orchestra.run.smithi072.stdout:Context: system_u:object_r:device_t:s0 2024-04-04T06:55:14.668 INFO:teuthology.orchestra.run.smithi072.stdout:Access: 2024-04-04 06:54:42.724620021 +0000 2024-04-04T06:55:14.668 INFO:teuthology.orchestra.run.smithi072.stdout:Modify: 2024-04-04 06:52:02.803066181 +0000 2024-04-04T06:55:14.669 INFO:teuthology.orchestra.run.smithi072.stdout:Change: 2024-04-04 06:52:02.803066181 +0000 2024-04-04T06:55:14.669 INFO:teuthology.orchestra.run.smithi072.stdout: Birth: 2024-04-04 06:52:02.803066181 +0000 2024-04-04T06:55:14.669 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-04T06:55:14.747 INFO:teuthology.orchestra.run.smithi072.stderr:1+0 records in 2024-04-04T06:55:14.747 INFO:teuthology.orchestra.run.smithi072.stderr:1+0 records out 2024-04-04T06:55:14.747 INFO:teuthology.orchestra.run.smithi072.stderr:512 bytes copied, 0.000337302 s, 1.5 MB/s 2024-04-04T06:55:14.750 DEBUG:teuthology.orchestra.run.smithi072:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-04T06:55:14.800 DEBUG:teuthology.orchestra.run.smithi072:> stat /dev/vg_nvme/lv_4 2024-04-04T06:55:14.846 INFO:teuthology.orchestra.run.smithi072.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-04T06:55:14.846 INFO:teuthology.orchestra.run.smithi072.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-04T06:55:14.846 INFO:teuthology.orchestra.run.smithi072.stdout:Device: 5h/5d Inode: 689 Links: 1 2024-04-04T06:55:14.847 INFO:teuthology.orchestra.run.smithi072.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-04T06:55:14.847 INFO:teuthology.orchestra.run.smithi072.stdout:Context: system_u:object_r:device_t:s0 2024-04-04T06:55:14.847 INFO:teuthology.orchestra.run.smithi072.stdout:Access: 2024-04-04 06:54:42.725620000 +0000 2024-04-04T06:55:14.847 INFO:teuthology.orchestra.run.smithi072.stdout:Modify: 2024-04-04 06:52:03.394053851 +0000 2024-04-04T06:55:14.847 INFO:teuthology.orchestra.run.smithi072.stdout:Change: 2024-04-04 06:52:03.394053851 +0000 2024-04-04T06:55:14.847 INFO:teuthology.orchestra.run.smithi072.stdout: Birth: 2024-04-04 06:52:03.394053851 +0000 2024-04-04T06:55:14.847 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-04T06:55:14.980 INFO:teuthology.orchestra.run.smithi072.stderr:1+0 records in 2024-04-04T06:55:14.980 INFO:teuthology.orchestra.run.smithi072.stderr:1+0 records out 2024-04-04T06:55:14.980 INFO:teuthology.orchestra.run.smithi072.stderr:512 bytes copied, 0.000479566 s, 1.1 MB/s 2024-04-04T06:55:14.984 DEBUG:teuthology.orchestra.run.smithi072:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-04T06:55:15.041 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-04T06:55:15.041 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-04-04T06:55:15.041 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/scratch_devs of=/dev/stdout 2024-04-04T06:55:15.097 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-04T06:55:15.097 DEBUG:teuthology.orchestra.run.smithi117:> stat /dev/vg_nvme/lv_1 2024-04-04T06:55:15.145 INFO:teuthology.orchestra.run.smithi117.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-04T06:55:15.145 INFO:teuthology.orchestra.run.smithi117.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-04T06:55:15.145 INFO:teuthology.orchestra.run.smithi117.stdout:Device: 5h/5d Inode: 633 Links: 1 2024-04-04T06:55:15.145 INFO:teuthology.orchestra.run.smithi117.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-04T06:55:15.145 INFO:teuthology.orchestra.run.smithi117.stdout:Context: system_u:object_r:device_t:s0 2024-04-04T06:55:15.145 INFO:teuthology.orchestra.run.smithi117.stdout:Access: 2024-04-04 06:55:03.112913807 +0000 2024-04-04T06:55:15.146 INFO:teuthology.orchestra.run.smithi117.stdout:Modify: 2024-04-04 06:51:52.417012010 +0000 2024-04-04T06:55:15.146 INFO:teuthology.orchestra.run.smithi117.stdout:Change: 2024-04-04 06:51:52.417012010 +0000 2024-04-04T06:55:15.146 INFO:teuthology.orchestra.run.smithi117.stdout: Birth: 2024-04-04 06:51:52.417012010 +0000 2024-04-04T06:55:15.146 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-04T06:55:15.231 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records in 2024-04-04T06:55:15.231 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records out 2024-04-04T06:55:15.231 INFO:teuthology.orchestra.run.smithi117.stderr:512 bytes copied, 0.000589303 s, 869 kB/s 2024-04-04T06:55:15.235 DEBUG:teuthology.orchestra.run.smithi117:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-04T06:55:15.288 DEBUG:teuthology.orchestra.run.smithi117:> stat /dev/vg_nvme/lv_2 2024-04-04T06:55:15.332 INFO:teuthology.orchestra.run.smithi117.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-04T06:55:15.332 INFO:teuthology.orchestra.run.smithi117.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-04T06:55:15.332 INFO:teuthology.orchestra.run.smithi117.stdout:Device: 5h/5d Inode: 653 Links: 1 2024-04-04T06:55:15.332 INFO:teuthology.orchestra.run.smithi117.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-04T06:55:15.332 INFO:teuthology.orchestra.run.smithi117.stdout:Context: system_u:object_r:device_t:s0 2024-04-04T06:55:15.332 INFO:teuthology.orchestra.run.smithi117.stdout:Access: 2024-04-04 06:55:03.113913787 +0000 2024-04-04T06:55:15.332 INFO:teuthology.orchestra.run.smithi117.stdout:Modify: 2024-04-04 06:51:52.960001182 +0000 2024-04-04T06:55:15.332 INFO:teuthology.orchestra.run.smithi117.stdout:Change: 2024-04-04 06:51:52.960001182 +0000 2024-04-04T06:55:15.332 INFO:teuthology.orchestra.run.smithi117.stdout: Birth: 2024-04-04 06:51:52.960001182 +0000 2024-04-04T06:55:15.332 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-04T06:55:15.461 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records in 2024-04-04T06:55:15.461 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records out 2024-04-04T06:55:15.461 INFO:teuthology.orchestra.run.smithi117.stderr:512 bytes copied, 0.000331922 s, 1.5 MB/s 2024-04-04T06:55:15.465 DEBUG:teuthology.orchestra.run.smithi117:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-04T06:55:15.519 DEBUG:teuthology.orchestra.run.smithi117:> stat /dev/vg_nvme/lv_3 2024-04-04T06:55:15.566 INFO:teuthology.orchestra.run.smithi117.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-04T06:55:15.566 INFO:teuthology.orchestra.run.smithi117.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-04T06:55:15.566 INFO:teuthology.orchestra.run.smithi117.stdout:Device: 5h/5d Inode: 669 Links: 1 2024-04-04T06:55:15.566 INFO:teuthology.orchestra.run.smithi117.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-04T06:55:15.566 INFO:teuthology.orchestra.run.smithi117.stdout:Context: system_u:object_r:device_t:s0 2024-04-04T06:55:15.566 INFO:teuthology.orchestra.run.smithi117.stdout:Access: 2024-04-04 06:55:03.114913767 +0000 2024-04-04T06:55:15.566 INFO:teuthology.orchestra.run.smithi117.stdout:Modify: 2024-04-04 06:51:53.522989954 +0000 2024-04-04T06:55:15.566 INFO:teuthology.orchestra.run.smithi117.stdout:Change: 2024-04-04 06:51:53.522989954 +0000 2024-04-04T06:55:15.567 INFO:teuthology.orchestra.run.smithi117.stdout: Birth: 2024-04-04 06:51:53.522989954 +0000 2024-04-04T06:55:15.567 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-04T06:55:15.680 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records in 2024-04-04T06:55:15.680 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records out 2024-04-04T06:55:15.680 INFO:teuthology.orchestra.run.smithi117.stderr:512 bytes copied, 0.000336921 s, 1.5 MB/s 2024-04-04T06:55:15.684 DEBUG:teuthology.orchestra.run.smithi117:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-04T06:55:15.734 DEBUG:teuthology.orchestra.run.smithi117:> stat /dev/vg_nvme/lv_4 2024-04-04T06:55:15.779 INFO:teuthology.orchestra.run.smithi117.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-04T06:55:15.779 INFO:teuthology.orchestra.run.smithi117.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-04T06:55:15.779 INFO:teuthology.orchestra.run.smithi117.stdout:Device: 5h/5d Inode: 688 Links: 1 2024-04-04T06:55:15.779 INFO:teuthology.orchestra.run.smithi117.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-04T06:55:15.780 INFO:teuthology.orchestra.run.smithi117.stdout:Context: system_u:object_r:device_t:s0 2024-04-04T06:55:15.780 INFO:teuthology.orchestra.run.smithi117.stdout:Access: 2024-04-04 06:55:03.114913767 +0000 2024-04-04T06:55:15.780 INFO:teuthology.orchestra.run.smithi117.stdout:Modify: 2024-04-04 06:51:54.051979405 +0000 2024-04-04T06:55:15.780 INFO:teuthology.orchestra.run.smithi117.stdout:Change: 2024-04-04 06:51:54.051979405 +0000 2024-04-04T06:55:15.780 INFO:teuthology.orchestra.run.smithi117.stdout: Birth: 2024-04-04 06:51:54.051979405 +0000 2024-04-04T06:55:15.780 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-04T06:55:15.911 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records in 2024-04-04T06:55:15.911 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records out 2024-04-04T06:55:15.911 INFO:teuthology.orchestra.run.smithi117.stderr:512 bytes copied, 0.000356321 s, 1.4 MB/s 2024-04-04T06:55:15.915 DEBUG:teuthology.orchestra.run.smithi117:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-04T06:55:15.971 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-04T06:55:15.971 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi072.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi117.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-04-04T06:55:15.971 INFO:tasks.ceph:Generating config... 2024-04-04T06:55:15.972 INFO:tasks.ceph:[client] client mount timeout = 600 2024-04-04T06:55:15.972 INFO:tasks.ceph:[client] debug client = 20 2024-04-04T06:55:15.972 INFO:tasks.ceph:[client] debug ms = 1 2024-04-04T06:55:15.972 INFO:tasks.ceph:[client] pid file = 2024-04-04T06:55:15.972 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-04-04T06:55:15.972 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-04-04T06:55:15.972 INFO:tasks.ceph:[mds] debug mds = 20 2024-04-04T06:55:15.972 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-04-04T06:55:15.973 INFO:tasks.ceph:[mds] debug ms = 1 2024-04-04T06:55:15.973 INFO:tasks.ceph:[mds] mds debug frag = True 2024-04-04T06:55:15.973 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-04-04T06:55:15.973 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-04-04T06:55:15.973 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-04-04T06:55:15.973 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-04-04T06:55:15.973 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-04-04T06:55:15.973 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-04-04T06:55:15.973 INFO:tasks.ceph:[mgr] debug client = 20 2024-04-04T06:55:15.973 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-04-04T06:55:15.973 INFO:tasks.ceph:[mgr] debug ms = 1 2024-04-04T06:55:15.973 INFO:tasks.ceph:[mon] debug mon = 20 2024-04-04T06:55:15.973 INFO:tasks.ceph:[mon] debug ms = 1 2024-04-04T06:55:15.973 INFO:tasks.ceph:[mon] debug paxos = 20 2024-04-04T06:55:15.974 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-04-04T06:55:15.974 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-04-04T06:55:15.974 INFO:tasks.ceph:[osd] bdev async discard = True 2024-04-04T06:55:15.974 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-04-04T06:55:15.974 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-04-04T06:55:15.974 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-04-04T06:55:15.974 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-04-04T06:55:15.974 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-04-04T06:55:15.974 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-04-04T06:55:15.974 INFO:tasks.ceph:[osd] debug ms = 1 2024-04-04T06:55:15.974 INFO:tasks.ceph:[osd] debug osd = 20 2024-04-04T06:55:15.974 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-04-04T06:55:15.974 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-04-04T06:55:15.974 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-04-04T06:55:15.974 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-04-04T06:55:15.975 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-04-04T06:55:15.975 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-04-04T06:55:15.975 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-04-04T06:55:15.975 INFO:tasks.ceph:Setting up mon.a... 2024-04-04T06:55:15.975 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-04-04T06:55:16.120 INFO:teuthology.orchestra.run.smithi072.stdout:creating /etc/ceph/ceph.keyring 2024-04-04T06:55:16.128 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-04-04T06:55:16.256 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-04T06:55:16.343 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.72'), ('mon.b', '172.21.15.117'), ('mon.c', '[v2:172.21.15.117:3301,v1:172.21.15.117:6790]')] 2024-04-04T06:55:16.344 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.72,172.21.15.117,[v2:172.21.15.117:3301,v1:172.21.15.117:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-04-04T06:55:16.345 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-04-04T06:55:16.345 DEBUG:teuthology.orchestra.run.smithi072:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-04-04T06:55:16.395 DEBUG:teuthology.orchestra.run.smithi072:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.72 --add b 172.21.15.117 --addv c '[v2:172.21.15.117:3301,v1:172.21.15.117:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-04-04T06:55:16.545 INFO:teuthology.orchestra.run.smithi072.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-04-04T06:55:16.545 INFO:teuthology.orchestra.run.smithi072.stdout:monmaptool: generated fsid 6708bac2-4f50-49b5-87a9-c390fd333eb3 2024-04-04T06:55:16.545 INFO:teuthology.orchestra.run.smithi072.stdout:setting min_mon_release = quincy 2024-04-04T06:55:16.545 INFO:teuthology.orchestra.run.smithi072.stdout:epoch 0 2024-04-04T06:55:16.546 INFO:teuthology.orchestra.run.smithi072.stdout:fsid 6708bac2-4f50-49b5-87a9-c390fd333eb3 2024-04-04T06:55:16.546 INFO:teuthology.orchestra.run.smithi072.stdout:last_changed 2024-04-04T06:55:16.548161+0000 2024-04-04T06:55:16.546 INFO:teuthology.orchestra.run.smithi072.stdout:created 2024-04-04T06:55:16.548161+0000 2024-04-04T06:55:16.546 INFO:teuthology.orchestra.run.smithi072.stdout:min_mon_release 17 (quincy) 2024-04-04T06:55:16.546 INFO:teuthology.orchestra.run.smithi072.stdout:election_strategy: 1 2024-04-04T06:55:16.546 INFO:teuthology.orchestra.run.smithi072.stdout:0: [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] mon.a 2024-04-04T06:55:16.546 INFO:teuthology.orchestra.run.smithi072.stdout:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-04-04T06:55:16.546 INFO:teuthology.orchestra.run.smithi072.stdout:2: [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] mon.c 2024-04-04T06:55:16.546 INFO:teuthology.orchestra.run.smithi072.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-04-04T06:55:16.548 DEBUG:teuthology.orchestra.run.smithi072:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-04-04T06:55:16.598 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 6708bac2-4f50-49b5-87a9-c390fd333eb3... 2024-04-04T06:55:16.599 DEBUG:teuthology.orchestra.run.smithi072:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-04T06:55:16.604 DEBUG:teuthology.orchestra.run.smithi117:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-04T06:55:16.761 INFO:teuthology.orchestra.run.smithi072.stdout:[global] 2024-04-04T06:55:16.762 INFO:teuthology.orchestra.run.smithi072.stdout: chdir = "" 2024-04-04T06:55:16.762 INFO:teuthology.orchestra.run.smithi072.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-04T06:55:16.762 INFO:teuthology.orchestra.run.smithi072.stdout: auth supported = cephx 2024-04-04T06:55:16.762 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T06:55:16.762 INFO:teuthology.orchestra.run.smithi072.stdout: filestore xattr use omap = true 2024-04-04T06:55:16.762 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T06:55:16.762 INFO:teuthology.orchestra.run.smithi072.stdout: mon clock drift allowed = 1.000 2024-04-04T06:55:16.762 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T06:55:16.762 INFO:teuthology.orchestra.run.smithi072.stdout: osd crush chooseleaf type = 0 2024-04-04T06:55:16.762 INFO:teuthology.orchestra.run.smithi072.stdout: auth debug = true 2024-04-04T06:55:16.762 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T06:55:16.762 INFO:teuthology.orchestra.run.smithi072.stdout: ms die on old message = true 2024-04-04T06:55:16.762 INFO:teuthology.orchestra.run.smithi072.stdout: ms die on bug = true 2024-04-04T06:55:16.762 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T06:55:16.763 INFO:teuthology.orchestra.run.smithi072.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-04T06:55:16.763 INFO:teuthology.orchestra.run.smithi072.stdout: mon pg warn max object skew = 0 2024-04-04T06:55:16.763 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T06:55:16.763 INFO:teuthology.orchestra.run.smithi072.stdout: # disable pg_autoscaler by default for new pools 2024-04-04T06:55:16.763 INFO:teuthology.orchestra.run.smithi072.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-04T06:55:16.763 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T06:55:16.763 INFO:teuthology.orchestra.run.smithi072.stdout: osd pool default size = 2 2024-04-04T06:55:16.763 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T06:55:16.763 INFO:teuthology.orchestra.run.smithi072.stdout: mon osd allow primary affinity = true 2024-04-04T06:55:16.763 INFO:teuthology.orchestra.run.smithi072.stdout: mon osd allow pg remap = true 2024-04-04T06:55:16.763 INFO:teuthology.orchestra.run.smithi072.stdout: mon warn on legacy crush tunables = false 2024-04-04T06:55:16.763 INFO:teuthology.orchestra.run.smithi072.stdout: mon warn on crush straw calc version zero = false 2024-04-04T06:55:16.763 INFO:teuthology.orchestra.run.smithi072.stdout: mon warn on no sortbitwise = false 2024-04-04T06:55:16.763 INFO:teuthology.orchestra.run.smithi072.stdout: mon warn on osd down out interval zero = false 2024-04-04T06:55:16.764 INFO:teuthology.orchestra.run.smithi072.stdout: mon warn on too few osds = false 2024-04-04T06:55:16.764 INFO:teuthology.orchestra.run.smithi072.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-04T06:55:16.764 INFO:teuthology.orchestra.run.smithi072.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-04T06:55:16.764 INFO:teuthology.orchestra.run.smithi072.stdout: mon_allow_pool_size_one = true 2024-04-04T06:55:16.764 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T06:55:16.764 INFO:teuthology.orchestra.run.smithi072.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-04T06:55:16.764 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T06:55:16.764 INFO:teuthology.orchestra.run.smithi072.stdout: osd default data pool replay window = 5 2024-04-04T06:55:16.764 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T06:55:16.764 INFO:teuthology.orchestra.run.smithi072.stdout: mon allow pool delete = true 2024-04-04T06:55:16.764 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T06:55:16.764 INFO:teuthology.orchestra.run.smithi072.stdout: mon cluster log file level = debug 2024-04-04T06:55:16.764 INFO:teuthology.orchestra.run.smithi072.stdout: debug asserts on shutdown = true 2024-04-04T06:55:16.764 INFO:teuthology.orchestra.run.smithi072.stdout: mon health detail to clog = false 2024-04-04T06:55:16.764 INFO:teuthology.orchestra.run.smithi072.stdout: mon host = "172.21.15.72,172.21.15.117,[v2:172.21.15.117:3301,v1:172.21.15.117:6790]" 2024-04-04T06:55:16.764 INFO:teuthology.orchestra.run.smithi072.stdout: fsid = 6708bac2-4f50-49b5-87a9-c390fd333eb3 2024-04-04T06:55:16.764 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T06:55:16.765 INFO:teuthology.orchestra.run.smithi072.stdout:[osd] 2024-04-04T06:55:16.765 INFO:teuthology.orchestra.run.smithi072.stdout: osd journal size = 100 2024-04-04T06:55:16.765 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T06:55:16.765 INFO:teuthology.orchestra.run.smithi072.stdout: osd scrub load threshold = 5.0 2024-04-04T06:55:16.765 INFO:teuthology.orchestra.run.smithi072.stdout: osd scrub max interval = 600 2024-04-04T06:55:16.765 INFO:teuthology.orchestra.run.smithi072.stdout: osd mclock profile = high_recovery_ops 2024-04-04T06:55:16.765 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T06:55:16.765 INFO:teuthology.orchestra.run.smithi072.stdout: osd recover clone overlap = true 2024-04-04T06:55:16.765 INFO:teuthology.orchestra.run.smithi072.stdout: osd recovery max chunk = 1048576 2024-04-04T06:55:16.765 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T06:55:16.765 INFO:teuthology.orchestra.run.smithi072.stdout: osd debug shutdown = true 2024-04-04T06:55:16.765 INFO:teuthology.orchestra.run.smithi072.stdout: osd debug op order = true 2024-04-04T06:55:16.765 INFO:teuthology.orchestra.run.smithi072.stdout: osd debug verify stray on activate = true 2024-04-04T06:55:16.765 INFO:teuthology.orchestra.run.smithi072.stdout: osd debug trim objects = true 2024-04-04T06:55:16.765 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T06:55:16.765 INFO:teuthology.orchestra.run.smithi072.stdout: osd open classes on start = true 2024-04-04T06:55:16.766 INFO:teuthology.orchestra.run.smithi072.stdout: osd debug pg log writeout = true 2024-04-04T06:55:16.766 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T06:55:16.766 INFO:teuthology.orchestra.run.smithi072.stdout: osd deep scrub update digest min age = 30 2024-04-04T06:55:16.766 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T06:55:16.766 INFO:teuthology.orchestra.run.smithi072.stdout: osd map max advance = 10 2024-04-04T06:55:16.766 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T06:55:16.766 INFO:teuthology.orchestra.run.smithi072.stdout: journal zero on create = true 2024-04-04T06:55:16.766 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T06:55:16.766 INFO:teuthology.orchestra.run.smithi072.stdout: filestore ondisk finisher threads = 3 2024-04-04T06:55:16.766 INFO:teuthology.orchestra.run.smithi072.stdout: filestore apply finisher threads = 3 2024-04-04T06:55:16.766 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T06:55:16.766 INFO:teuthology.orchestra.run.smithi072.stdout: bdev debug aio = true 2024-04-04T06:55:16.766 INFO:teuthology.orchestra.run.smithi072.stdout: osd debug misdirected ops = true 2024-04-04T06:55:16.767 INFO:teuthology.orchestra.run.smithi072.stdout: bdev async discard = True 2024-04-04T06:55:16.767 INFO:teuthology.orchestra.run.smithi072.stdout: bdev enable discard = True 2024-04-04T06:55:16.767 INFO:teuthology.orchestra.run.smithi072.stdout: bluestore allocator = bitmap 2024-04-04T06:55:16.767 INFO:teuthology.orchestra.run.smithi072.stdout: bluestore block size = 96636764160 2024-04-04T06:55:16.767 INFO:teuthology.orchestra.run.smithi072.stdout: bluestore fsck on mount = True 2024-04-04T06:55:16.767 INFO:teuthology.orchestra.run.smithi072.stdout: debug bluefs = 1/20 2024-04-04T06:55:16.767 INFO:teuthology.orchestra.run.smithi072.stdout: debug bluestore = 1/20 2024-04-04T06:55:16.767 INFO:teuthology.orchestra.run.smithi072.stdout: debug ms = 1 2024-04-04T06:55:16.767 INFO:teuthology.orchestra.run.smithi072.stdout: debug osd = 20 2024-04-04T06:55:16.767 INFO:teuthology.orchestra.run.smithi072.stdout: debug rocksdb = 4/10 2024-04-04T06:55:16.767 INFO:teuthology.orchestra.run.smithi072.stdout: mon osd backfillfull_ratio = 0.85 2024-04-04T06:55:16.767 INFO:teuthology.orchestra.run.smithi072.stdout: mon osd full ratio = 0.9 2024-04-04T06:55:16.767 INFO:teuthology.orchestra.run.smithi072.stdout: mon osd nearfull ratio = 0.8 2024-04-04T06:55:16.767 INFO:teuthology.orchestra.run.smithi072.stdout: osd failsafe full ratio = 0.95 2024-04-04T06:55:16.768 INFO:teuthology.orchestra.run.smithi072.stdout: osd objectstore = bluestore 2024-04-04T06:55:16.768 INFO:teuthology.orchestra.run.smithi072.stdout: osd op complaint time = 180 2024-04-04T06:55:16.768 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T06:55:16.768 INFO:teuthology.orchestra.run.smithi072.stdout:[mgr] 2024-04-04T06:55:16.768 INFO:teuthology.orchestra.run.smithi072.stdout: debug ms = 1 2024-04-04T06:55:16.768 INFO:teuthology.orchestra.run.smithi072.stdout: debug mgr = 20 2024-04-04T06:55:16.768 INFO:teuthology.orchestra.run.smithi072.stdout: debug mon = 20 2024-04-04T06:55:16.768 INFO:teuthology.orchestra.run.smithi072.stdout: debug auth = 20 2024-04-04T06:55:16.768 INFO:teuthology.orchestra.run.smithi072.stdout: mon reweight min pgs per osd = 4 2024-04-04T06:55:16.768 INFO:teuthology.orchestra.run.smithi072.stdout: mon reweight min bytes per osd = 10 2024-04-04T06:55:16.768 INFO:teuthology.orchestra.run.smithi072.stdout: mgr/telemetry/nag = false 2024-04-04T06:55:16.768 INFO:teuthology.orchestra.run.smithi072.stdout: debug client = 20 2024-04-04T06:55:16.768 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T06:55:16.768 INFO:teuthology.orchestra.run.smithi072.stdout:[mon] 2024-04-04T06:55:16.768 INFO:teuthology.orchestra.run.smithi072.stdout: debug ms = 1 2024-04-04T06:55:16.768 INFO:teuthology.orchestra.run.smithi072.stdout: debug mon = 20 2024-04-04T06:55:16.769 INFO:teuthology.orchestra.run.smithi072.stdout: debug paxos = 20 2024-04-04T06:55:16.769 INFO:teuthology.orchestra.run.smithi072.stdout: debug auth = 20 2024-04-04T06:55:16.769 INFO:teuthology.orchestra.run.smithi072.stdout: mon data avail warn = 5 2024-04-04T06:55:16.769 INFO:teuthology.orchestra.run.smithi072.stdout: mon mgr mkfs grace = 240 2024-04-04T06:55:16.769 INFO:teuthology.orchestra.run.smithi072.stdout: mon reweight min pgs per osd = 4 2024-04-04T06:55:16.769 INFO:teuthology.orchestra.run.smithi072.stdout: mon osd reporter subtree level = osd 2024-04-04T06:55:16.769 INFO:teuthology.orchestra.run.smithi072.stdout: mon osd prime pg temp = true 2024-04-04T06:55:16.769 INFO:teuthology.orchestra.run.smithi072.stdout: mon reweight min bytes per osd = 10 2024-04-04T06:55:16.769 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T06:55:16.769 INFO:teuthology.orchestra.run.smithi072.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-04T06:55:16.769 INFO:teuthology.orchestra.run.smithi072.stdout: auth mon ticket ttl = 660 # 11m 2024-04-04T06:55:16.769 INFO:teuthology.orchestra.run.smithi072.stdout: auth service ticket ttl = 240 # 4m 2024-04-04T06:55:16.769 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T06:55:16.769 INFO:teuthology.orchestra.run.smithi072.stdout: # don't complain about insecure global_id in the test suite 2024-04-04T06:55:16.769 INFO:teuthology.orchestra.run.smithi072.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-04T06:55:16.770 INFO:teuthology.orchestra.run.smithi072.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-04T06:55:16.770 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T06:55:16.770 INFO:teuthology.orchestra.run.smithi072.stdout: # 1m isn't quite enough 2024-04-04T06:55:16.770 INFO:teuthology.orchestra.run.smithi072.stdout: mon_down_mkfs_grace = 2m 2024-04-04T06:55:16.770 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T06:55:16.770 INFO:teuthology.orchestra.run.smithi072.stdout: mon_warn_on_filestore_osds = false 2024-04-04T06:55:16.770 INFO:teuthology.orchestra.run.smithi072.stdout: mon down mkfs grace = 300 2024-04-04T06:55:16.770 INFO:teuthology.orchestra.run.smithi072.stdout: mon op complaint time = 120 2024-04-04T06:55:16.770 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T06:55:16.770 INFO:teuthology.orchestra.run.smithi072.stdout:[client] 2024-04-04T06:55:16.770 INFO:teuthology.orchestra.run.smithi072.stdout: rgw cache enabled = true 2024-04-04T06:55:16.770 INFO:teuthology.orchestra.run.smithi072.stdout: rgw enable ops log = true 2024-04-04T06:55:16.770 INFO:teuthology.orchestra.run.smithi072.stdout: rgw enable usage log = true 2024-04-04T06:55:16.770 INFO:teuthology.orchestra.run.smithi072.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-04T06:55:16.770 INFO:teuthology.orchestra.run.smithi072.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-04T06:55:16.771 INFO:teuthology.orchestra.run.smithi072.stdout: client mount timeout = 600 2024-04-04T06:55:16.771 INFO:teuthology.orchestra.run.smithi072.stdout: debug client = 20 2024-04-04T06:55:16.771 INFO:teuthology.orchestra.run.smithi072.stdout: debug ms = 1 2024-04-04T06:55:16.771 INFO:teuthology.orchestra.run.smithi072.stdout: pid file = "" 2024-04-04T06:55:16.771 INFO:teuthology.orchestra.run.smithi072.stdout: rados mon op timeout = 900 2024-04-04T06:55:16.771 INFO:teuthology.orchestra.run.smithi072.stdout: rados osd op timeout = 900 2024-04-04T06:55:16.771 INFO:teuthology.orchestra.run.smithi072.stdout:[mon.a] 2024-04-04T06:55:16.771 INFO:teuthology.orchestra.run.smithi072.stdout:[mon.b] 2024-04-04T06:55:16.771 INFO:teuthology.orchestra.run.smithi072.stdout:[mon.c] 2024-04-04T06:55:16.771 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.a] 2024-04-04T06:55:16.771 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.c] 2024-04-04T06:55:16.771 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.b] 2024-04-04T06:55:16.771 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.d] 2024-04-04T06:55:16.771 INFO:teuthology.orchestra.run.smithi072.stdout:[mds] 2024-04-04T06:55:16.771 INFO:teuthology.orchestra.run.smithi072.stdout: debug mds = 20 2024-04-04T06:55:16.771 INFO:teuthology.orchestra.run.smithi072.stdout: debug mds balancer = 20 2024-04-04T06:55:16.772 INFO:teuthology.orchestra.run.smithi072.stdout: debug ms = 1 2024-04-04T06:55:16.772 INFO:teuthology.orchestra.run.smithi072.stdout: mds debug frag = True 2024-04-04T06:55:16.772 INFO:teuthology.orchestra.run.smithi072.stdout: mds debug scatterstat = True 2024-04-04T06:55:16.772 INFO:teuthology.orchestra.run.smithi072.stdout: mds op complaint time = 180 2024-04-04T06:55:16.772 INFO:teuthology.orchestra.run.smithi072.stdout: mds verify scatter = True 2024-04-04T06:55:16.772 INFO:teuthology.orchestra.run.smithi072.stdout: osd op complaint time = 180 2024-04-04T06:55:16.772 INFO:teuthology.orchestra.run.smithi072.stdout: rados mon op timeout = 900 2024-04-04T06:55:16.772 INFO:teuthology.orchestra.run.smithi072.stdout: rados osd op timeout = 900 2024-04-04T06:55:16.776 INFO:teuthology.orchestra.run.smithi117.stdout:[global] 2024-04-04T06:55:16.776 INFO:teuthology.orchestra.run.smithi117.stdout: chdir = "" 2024-04-04T06:55:16.776 INFO:teuthology.orchestra.run.smithi117.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-04T06:55:16.776 INFO:teuthology.orchestra.run.smithi117.stdout: auth supported = cephx 2024-04-04T06:55:16.776 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-04T06:55:16.776 INFO:teuthology.orchestra.run.smithi117.stdout: filestore xattr use omap = true 2024-04-04T06:55:16.776 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-04T06:55:16.776 INFO:teuthology.orchestra.run.smithi117.stdout: mon clock drift allowed = 1.000 2024-04-04T06:55:16.776 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-04T06:55:16.776 INFO:teuthology.orchestra.run.smithi117.stdout: osd crush chooseleaf type = 0 2024-04-04T06:55:16.777 INFO:teuthology.orchestra.run.smithi117.stdout: auth debug = true 2024-04-04T06:55:16.777 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-04T06:55:16.777 INFO:teuthology.orchestra.run.smithi117.stdout: ms die on old message = true 2024-04-04T06:55:16.777 INFO:teuthology.orchestra.run.smithi117.stdout: ms die on bug = true 2024-04-04T06:55:16.777 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-04T06:55:16.777 INFO:teuthology.orchestra.run.smithi117.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-04T06:55:16.777 INFO:teuthology.orchestra.run.smithi117.stdout: mon pg warn max object skew = 0 2024-04-04T06:55:16.777 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-04T06:55:16.777 INFO:teuthology.orchestra.run.smithi117.stdout: # disable pg_autoscaler by default for new pools 2024-04-04T06:55:16.777 INFO:teuthology.orchestra.run.smithi117.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-04T06:55:16.777 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-04T06:55:16.777 INFO:teuthology.orchestra.run.smithi117.stdout: osd pool default size = 2 2024-04-04T06:55:16.777 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-04T06:55:16.777 INFO:teuthology.orchestra.run.smithi117.stdout: mon osd allow primary affinity = true 2024-04-04T06:55:16.777 INFO:teuthology.orchestra.run.smithi117.stdout: mon osd allow pg remap = true 2024-04-04T06:55:16.777 INFO:teuthology.orchestra.run.smithi117.stdout: mon warn on legacy crush tunables = false 2024-04-04T06:55:16.778 INFO:teuthology.orchestra.run.smithi117.stdout: mon warn on crush straw calc version zero = false 2024-04-04T06:55:16.778 INFO:teuthology.orchestra.run.smithi117.stdout: mon warn on no sortbitwise = false 2024-04-04T06:55:16.778 INFO:teuthology.orchestra.run.smithi117.stdout: mon warn on osd down out interval zero = false 2024-04-04T06:55:16.778 INFO:teuthology.orchestra.run.smithi117.stdout: mon warn on too few osds = false 2024-04-04T06:55:16.778 INFO:teuthology.orchestra.run.smithi117.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-04T06:55:16.778 INFO:teuthology.orchestra.run.smithi117.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-04T06:55:16.778 INFO:teuthology.orchestra.run.smithi117.stdout: mon_allow_pool_size_one = true 2024-04-04T06:55:16.778 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-04T06:55:16.778 INFO:teuthology.orchestra.run.smithi117.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-04T06:55:16.778 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-04T06:55:16.778 INFO:teuthology.orchestra.run.smithi117.stdout: osd default data pool replay window = 5 2024-04-04T06:55:16.778 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-04T06:55:16.778 INFO:teuthology.orchestra.run.smithi117.stdout: mon allow pool delete = true 2024-04-04T06:55:16.779 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-04T06:55:16.779 INFO:teuthology.orchestra.run.smithi117.stdout: mon cluster log file level = debug 2024-04-04T06:55:16.779 INFO:teuthology.orchestra.run.smithi117.stdout: debug asserts on shutdown = true 2024-04-04T06:55:16.779 INFO:teuthology.orchestra.run.smithi117.stdout: mon health detail to clog = false 2024-04-04T06:55:16.779 INFO:teuthology.orchestra.run.smithi117.stdout: mon host = "172.21.15.72,172.21.15.117,[v2:172.21.15.117:3301,v1:172.21.15.117:6790]" 2024-04-04T06:55:16.779 INFO:teuthology.orchestra.run.smithi117.stdout: fsid = 6708bac2-4f50-49b5-87a9-c390fd333eb3 2024-04-04T06:55:16.779 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-04T06:55:16.779 INFO:teuthology.orchestra.run.smithi117.stdout:[osd] 2024-04-04T06:55:16.779 INFO:teuthology.orchestra.run.smithi117.stdout: osd journal size = 100 2024-04-04T06:55:16.779 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-04T06:55:16.779 INFO:teuthology.orchestra.run.smithi117.stdout: osd scrub load threshold = 5.0 2024-04-04T06:55:16.779 INFO:teuthology.orchestra.run.smithi117.stdout: osd scrub max interval = 600 2024-04-04T06:55:16.779 INFO:teuthology.orchestra.run.smithi117.stdout: osd mclock profile = high_recovery_ops 2024-04-04T06:55:16.779 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-04T06:55:16.779 INFO:teuthology.orchestra.run.smithi117.stdout: osd recover clone overlap = true 2024-04-04T06:55:16.779 INFO:teuthology.orchestra.run.smithi117.stdout: osd recovery max chunk = 1048576 2024-04-04T06:55:16.779 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-04T06:55:16.780 INFO:teuthology.orchestra.run.smithi117.stdout: osd debug shutdown = true 2024-04-04T06:55:16.780 INFO:teuthology.orchestra.run.smithi117.stdout: osd debug op order = true 2024-04-04T06:55:16.780 INFO:teuthology.orchestra.run.smithi117.stdout: osd debug verify stray on activate = true 2024-04-04T06:55:16.780 INFO:teuthology.orchestra.run.smithi117.stdout: osd debug trim objects = true 2024-04-04T06:55:16.780 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-04T06:55:16.780 INFO:teuthology.orchestra.run.smithi117.stdout: osd open classes on start = true 2024-04-04T06:55:16.780 INFO:teuthology.orchestra.run.smithi117.stdout: osd debug pg log writeout = true 2024-04-04T06:55:16.780 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-04T06:55:16.780 INFO:teuthology.orchestra.run.smithi117.stdout: osd deep scrub update digest min age = 30 2024-04-04T06:55:16.780 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-04T06:55:16.780 INFO:teuthology.orchestra.run.smithi117.stdout: osd map max advance = 10 2024-04-04T06:55:16.780 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-04T06:55:16.780 INFO:teuthology.orchestra.run.smithi117.stdout: journal zero on create = true 2024-04-04T06:55:16.780 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-04T06:55:16.780 INFO:teuthology.orchestra.run.smithi117.stdout: filestore ondisk finisher threads = 3 2024-04-04T06:55:16.780 INFO:teuthology.orchestra.run.smithi117.stdout: filestore apply finisher threads = 3 2024-04-04T06:55:16.781 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-04T06:55:16.781 INFO:teuthology.orchestra.run.smithi117.stdout: bdev debug aio = true 2024-04-04T06:55:16.781 INFO:teuthology.orchestra.run.smithi117.stdout: osd debug misdirected ops = true 2024-04-04T06:55:16.781 INFO:teuthology.orchestra.run.smithi117.stdout: bdev async discard = True 2024-04-04T06:55:16.781 INFO:teuthology.orchestra.run.smithi117.stdout: bdev enable discard = True 2024-04-04T06:55:16.781 INFO:teuthology.orchestra.run.smithi117.stdout: bluestore allocator = bitmap 2024-04-04T06:55:16.781 INFO:teuthology.orchestra.run.smithi117.stdout: bluestore block size = 96636764160 2024-04-04T06:55:16.781 INFO:teuthology.orchestra.run.smithi117.stdout: bluestore fsck on mount = True 2024-04-04T06:55:16.781 INFO:teuthology.orchestra.run.smithi117.stdout: debug bluefs = 1/20 2024-04-04T06:55:16.781 INFO:teuthology.orchestra.run.smithi117.stdout: debug bluestore = 1/20 2024-04-04T06:55:16.781 INFO:teuthology.orchestra.run.smithi117.stdout: debug ms = 1 2024-04-04T06:55:16.781 INFO:teuthology.orchestra.run.smithi117.stdout: debug osd = 20 2024-04-04T06:55:16.781 INFO:teuthology.orchestra.run.smithi117.stdout: debug rocksdb = 4/10 2024-04-04T06:55:16.781 INFO:teuthology.orchestra.run.smithi117.stdout: mon osd backfillfull_ratio = 0.85 2024-04-04T06:55:16.781 INFO:teuthology.orchestra.run.smithi117.stdout: mon osd full ratio = 0.9 2024-04-04T06:55:16.781 INFO:teuthology.orchestra.run.smithi117.stdout: mon osd nearfull ratio = 0.8 2024-04-04T06:55:16.782 INFO:teuthology.orchestra.run.smithi117.stdout: osd failsafe full ratio = 0.95 2024-04-04T06:55:16.782 INFO:teuthology.orchestra.run.smithi117.stdout: osd objectstore = bluestore 2024-04-04T06:55:16.782 INFO:teuthology.orchestra.run.smithi117.stdout: osd op complaint time = 180 2024-04-04T06:55:16.782 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-04T06:55:16.782 INFO:teuthology.orchestra.run.smithi117.stdout:[mgr] 2024-04-04T06:55:16.782 INFO:teuthology.orchestra.run.smithi117.stdout: debug ms = 1 2024-04-04T06:55:16.782 INFO:teuthology.orchestra.run.smithi117.stdout: debug mgr = 20 2024-04-04T06:55:16.782 INFO:teuthology.orchestra.run.smithi117.stdout: debug mon = 20 2024-04-04T06:55:16.782 INFO:teuthology.orchestra.run.smithi117.stdout: debug auth = 20 2024-04-04T06:55:16.782 INFO:teuthology.orchestra.run.smithi117.stdout: mon reweight min pgs per osd = 4 2024-04-04T06:55:16.782 INFO:teuthology.orchestra.run.smithi117.stdout: mon reweight min bytes per osd = 10 2024-04-04T06:55:16.782 INFO:teuthology.orchestra.run.smithi117.stdout: mgr/telemetry/nag = false 2024-04-04T06:55:16.782 INFO:teuthology.orchestra.run.smithi117.stdout: debug client = 20 2024-04-04T06:55:16.782 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-04T06:55:16.782 INFO:teuthology.orchestra.run.smithi117.stdout:[mon] 2024-04-04T06:55:16.783 INFO:teuthology.orchestra.run.smithi117.stdout: debug ms = 1 2024-04-04T06:55:16.783 INFO:teuthology.orchestra.run.smithi117.stdout: debug mon = 20 2024-04-04T06:55:16.783 INFO:teuthology.orchestra.run.smithi117.stdout: debug paxos = 20 2024-04-04T06:55:16.783 INFO:teuthology.orchestra.run.smithi117.stdout: debug auth = 20 2024-04-04T06:55:16.783 INFO:teuthology.orchestra.run.smithi117.stdout: mon data avail warn = 5 2024-04-04T06:55:16.783 INFO:teuthology.orchestra.run.smithi117.stdout: mon mgr mkfs grace = 240 2024-04-04T06:55:16.783 INFO:teuthology.orchestra.run.smithi117.stdout: mon reweight min pgs per osd = 4 2024-04-04T06:55:16.783 INFO:teuthology.orchestra.run.smithi117.stdout: mon osd reporter subtree level = osd 2024-04-04T06:55:16.783 INFO:teuthology.orchestra.run.smithi117.stdout: mon osd prime pg temp = true 2024-04-04T06:55:16.783 INFO:teuthology.orchestra.run.smithi117.stdout: mon reweight min bytes per osd = 10 2024-04-04T06:55:16.783 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-04T06:55:16.783 INFO:teuthology.orchestra.run.smithi117.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-04T06:55:16.783 INFO:teuthology.orchestra.run.smithi117.stdout: auth mon ticket ttl = 660 # 11m 2024-04-04T06:55:16.783 INFO:teuthology.orchestra.run.smithi117.stdout: auth service ticket ttl = 240 # 4m 2024-04-04T06:55:16.783 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-04T06:55:16.784 INFO:teuthology.orchestra.run.smithi117.stdout: # don't complain about insecure global_id in the test suite 2024-04-04T06:55:16.784 INFO:teuthology.orchestra.run.smithi117.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-04T06:55:16.784 INFO:teuthology.orchestra.run.smithi117.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-04T06:55:16.784 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-04T06:55:16.784 INFO:teuthology.orchestra.run.smithi117.stdout: # 1m isn't quite enough 2024-04-04T06:55:16.784 INFO:teuthology.orchestra.run.smithi117.stdout: mon_down_mkfs_grace = 2m 2024-04-04T06:55:16.784 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-04T06:55:16.784 INFO:teuthology.orchestra.run.smithi117.stdout: mon_warn_on_filestore_osds = false 2024-04-04T06:55:16.784 INFO:teuthology.orchestra.run.smithi117.stdout: mon down mkfs grace = 300 2024-04-04T06:55:16.784 INFO:teuthology.orchestra.run.smithi117.stdout: mon op complaint time = 120 2024-04-04T06:55:16.784 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-04T06:55:16.784 INFO:teuthology.orchestra.run.smithi117.stdout:[client] 2024-04-04T06:55:16.784 INFO:teuthology.orchestra.run.smithi117.stdout: rgw cache enabled = true 2024-04-04T06:55:16.784 INFO:teuthology.orchestra.run.smithi117.stdout: rgw enable ops log = true 2024-04-04T06:55:16.784 INFO:teuthology.orchestra.run.smithi117.stdout: rgw enable usage log = true 2024-04-04T06:55:16.784 INFO:teuthology.orchestra.run.smithi117.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-04T06:55:16.784 INFO:teuthology.orchestra.run.smithi117.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-04T06:55:16.785 INFO:teuthology.orchestra.run.smithi117.stdout: client mount timeout = 600 2024-04-04T06:55:16.785 INFO:teuthology.orchestra.run.smithi117.stdout: debug client = 20 2024-04-04T06:55:16.785 INFO:teuthology.orchestra.run.smithi117.stdout: debug ms = 1 2024-04-04T06:55:16.785 INFO:teuthology.orchestra.run.smithi117.stdout: pid file = "" 2024-04-04T06:55:16.785 INFO:teuthology.orchestra.run.smithi117.stdout: rados mon op timeout = 900 2024-04-04T06:55:16.785 INFO:teuthology.orchestra.run.smithi117.stdout: rados osd op timeout = 900 2024-04-04T06:55:16.785 INFO:teuthology.orchestra.run.smithi117.stdout:[mon.a] 2024-04-04T06:55:16.785 INFO:teuthology.orchestra.run.smithi117.stdout:[mon.b] 2024-04-04T06:55:16.785 INFO:teuthology.orchestra.run.smithi117.stdout:[mon.c] 2024-04-04T06:55:16.785 INFO:teuthology.orchestra.run.smithi117.stdout:[mds.a] 2024-04-04T06:55:16.785 INFO:teuthology.orchestra.run.smithi117.stdout:[mds.c] 2024-04-04T06:55:16.785 INFO:teuthology.orchestra.run.smithi117.stdout:[mds.b] 2024-04-04T06:55:16.785 INFO:teuthology.orchestra.run.smithi117.stdout:[mds.d] 2024-04-04T06:55:16.785 INFO:teuthology.orchestra.run.smithi117.stdout:[mds] 2024-04-04T06:55:16.785 INFO:teuthology.orchestra.run.smithi117.stdout: debug mds = 20 2024-04-04T06:55:16.786 INFO:teuthology.orchestra.run.smithi117.stdout: debug mds balancer = 20 2024-04-04T06:55:16.786 INFO:teuthology.orchestra.run.smithi117.stdout: debug ms = 1 2024-04-04T06:55:16.786 INFO:teuthology.orchestra.run.smithi117.stdout: mds debug frag = True 2024-04-04T06:55:16.786 INFO:teuthology.orchestra.run.smithi117.stdout: mds debug scatterstat = True 2024-04-04T06:55:16.786 INFO:teuthology.orchestra.run.smithi117.stdout: mds op complaint time = 180 2024-04-04T06:55:16.786 INFO:teuthology.orchestra.run.smithi117.stdout: mds verify scatter = True 2024-04-04T06:55:16.786 INFO:teuthology.orchestra.run.smithi117.stdout: osd op complaint time = 180 2024-04-04T06:55:16.786 INFO:teuthology.orchestra.run.smithi117.stdout: rados mon op timeout = 900 2024-04-04T06:55:16.786 INFO:teuthology.orchestra.run.smithi117.stdout: rados osd op timeout = 900 2024-04-04T06:55:16.818 INFO:tasks.ceph:Creating admin key on mon.a... 2024-04-04T06:55:16.818 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-04-04T06:55:16.961 INFO:tasks.ceph:Copying monmap to all nodes... 2024-04-04T06:55:16.961 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-04-04T06:55:16.961 DEBUG:teuthology.orchestra.run.smithi072:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-04-04T06:55:17.007 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-04-04T06:55:17.007 DEBUG:teuthology.orchestra.run.smithi072:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-04-04T06:55:17.100 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi072.front.sepia.ceph.com 2024-04-04T06:55:17.100 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-04-04T06:55:17.100 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-04T06:55:17.100 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-04T06:55:17.237 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-04-04T06:55:17.237 DEBUG:teuthology.orchestra.run.smithi072:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-04T06:55:17.333 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi117.front.sepia.ceph.com 2024-04-04T06:55:17.333 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-04-04T06:55:17.333 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-04T06:55:17.333 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-04T06:55:17.485 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-04-04T06:55:17.485 DEBUG:teuthology.orchestra.run.smithi117:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-04T06:55:17.581 INFO:tasks.ceph:Setting up mon nodes... 2024-04-04T06:55:17.581 INFO:tasks.ceph:Setting up mgr nodes... 2024-04-04T06:55:17.581 DEBUG:teuthology.orchestra.run.smithi072:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-04-04T06:55:17.758 INFO:teuthology.orchestra.run.smithi072.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-04-04T06:55:17.768 DEBUG:teuthology.orchestra.run.smithi117:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-04-04T06:55:17.951 INFO:teuthology.orchestra.run.smithi117.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-04-04T06:55:17.961 INFO:tasks.ceph:Setting up mds nodes... 2024-04-04T06:55:17.961 DEBUG:teuthology.orchestra.run.smithi072:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-04-04T06:55:18.144 INFO:teuthology.orchestra.run.smithi072.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-04-04T06:55:18.153 DEBUG:teuthology.orchestra.run.smithi072:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-04-04T06:55:18.236 DEBUG:teuthology.orchestra.run.smithi072:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-04-04T06:55:18.397 INFO:teuthology.orchestra.run.smithi072.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-04-04T06:55:18.406 DEBUG:teuthology.orchestra.run.smithi072:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-04-04T06:55:18.498 DEBUG:teuthology.orchestra.run.smithi117:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-04-04T06:55:18.683 INFO:teuthology.orchestra.run.smithi117.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-04-04T06:55:18.692 DEBUG:teuthology.orchestra.run.smithi117:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-04-04T06:55:18.779 DEBUG:teuthology.orchestra.run.smithi117:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-04-04T06:55:18.956 INFO:teuthology.orchestra.run.smithi117.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-04-04T06:55:18.965 DEBUG:teuthology.orchestra.run.smithi117:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-04-04T06:55:19.059 INFO:tasks.ceph_client:Setting up client nodes... 2024-04-04T06:55:19.060 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-04-04T06:55:19.187 INFO:teuthology.orchestra.run.smithi072.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-04-04T06:55:19.245 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2024-04-04T06:55:19.369 INFO:teuthology.orchestra.run.smithi072.stdout:creating /etc/ceph/ceph.client.2.keyring 2024-04-04T06:55:19.421 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-04-04T06:55:19.553 INFO:teuthology.orchestra.run.smithi117.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-04-04T06:55:19.609 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2024-04-04T06:55:19.734 INFO:teuthology.orchestra.run.smithi117.stdout:creating /etc/ceph/ceph.client.3.keyring 2024-04-04T06:55:19.790 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-04-04T06:55:19.790 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi072.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi117.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-04-04T06:55:19.790 DEBUG:teuthology.orchestra.run.smithi072:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-04-04T06:55:19.889 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-04T06:55:19.889 INFO:tasks.ceph:role: osd.0 2024-04-04T06:55:19.889 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi072.front.sepia.ceph.com 2024-04-04T06:55:19.889 DEBUG:teuthology.orchestra.run.smithi072:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-04T06:55:19.986 INFO:teuthology.orchestra.run.smithi072.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-04T06:55:19.986 INFO:teuthology.orchestra.run.smithi072.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-04T06:55:19.986 INFO:teuthology.orchestra.run.smithi072.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-04T06:55:19.986 INFO:teuthology.orchestra.run.smithi072.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-04T06:55:19.986 INFO:teuthology.orchestra.run.smithi072.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-04T06:55:19.986 INFO:teuthology.orchestra.run.smithi072.stdout: = sunit=0 swidth=0 blks 2024-04-04T06:55:19.986 INFO:teuthology.orchestra.run.smithi072.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-04T06:55:19.987 INFO:teuthology.orchestra.run.smithi072.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-04T06:55:19.987 INFO:teuthology.orchestra.run.smithi072.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-04T06:55:19.987 INFO:teuthology.orchestra.run.smithi072.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-04T06:55:20.486 INFO:teuthology.orchestra.run.smithi072.stdout:Discarding blocks...Done. 2024-04-04T06:55:20.495 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi072.front.sepia.ceph.com -o noatime 2024-04-04T06:55:20.495 DEBUG:teuthology.orchestra.run.smithi072:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-04-04T06:55:20.693 DEBUG:teuthology.orchestra.run.smithi072:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-04-04T06:55:20.792 DEBUG:teuthology.orchestra.run.smithi072:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-04-04T06:55:20.884 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-04T06:55:20.885 INFO:tasks.ceph:role: osd.1 2024-04-04T06:55:20.885 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi072.front.sepia.ceph.com 2024-04-04T06:55:20.885 DEBUG:teuthology.orchestra.run.smithi072:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-04T06:55:20.981 INFO:teuthology.orchestra.run.smithi072.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-04T06:55:20.981 INFO:teuthology.orchestra.run.smithi072.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-04T06:55:20.981 INFO:teuthology.orchestra.run.smithi072.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-04T06:55:20.981 INFO:teuthology.orchestra.run.smithi072.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-04T06:55:20.981 INFO:teuthology.orchestra.run.smithi072.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-04T06:55:20.981 INFO:teuthology.orchestra.run.smithi072.stdout: = sunit=0 swidth=0 blks 2024-04-04T06:55:20.981 INFO:teuthology.orchestra.run.smithi072.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-04T06:55:20.981 INFO:teuthology.orchestra.run.smithi072.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-04T06:55:20.981 INFO:teuthology.orchestra.run.smithi072.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-04T06:55:20.981 INFO:teuthology.orchestra.run.smithi072.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-04T06:55:21.449 INFO:teuthology.orchestra.run.smithi072.stdout:Discarding blocks...Done. 2024-04-04T06:55:21.456 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi072.front.sepia.ceph.com -o noatime 2024-04-04T06:55:21.456 DEBUG:teuthology.orchestra.run.smithi072:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-04-04T06:55:21.599 DEBUG:teuthology.orchestra.run.smithi072:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-04-04T06:55:21.687 DEBUG:teuthology.orchestra.run.smithi072:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-04-04T06:55:21.779 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-04T06:55:21.779 INFO:tasks.ceph:role: osd.2 2024-04-04T06:55:21.779 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi072.front.sepia.ceph.com 2024-04-04T06:55:21.779 DEBUG:teuthology.orchestra.run.smithi072:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-04T06:55:21.876 INFO:teuthology.orchestra.run.smithi072.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-04T06:55:21.876 INFO:teuthology.orchestra.run.smithi072.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-04T06:55:21.876 INFO:teuthology.orchestra.run.smithi072.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-04T06:55:21.876 INFO:teuthology.orchestra.run.smithi072.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-04T06:55:21.876 INFO:teuthology.orchestra.run.smithi072.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-04T06:55:21.877 INFO:teuthology.orchestra.run.smithi072.stdout: = sunit=0 swidth=0 blks 2024-04-04T06:55:21.877 INFO:teuthology.orchestra.run.smithi072.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-04T06:55:21.877 INFO:teuthology.orchestra.run.smithi072.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-04T06:55:21.877 INFO:teuthology.orchestra.run.smithi072.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-04T06:55:21.877 INFO:teuthology.orchestra.run.smithi072.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-04T06:55:22.404 INFO:teuthology.orchestra.run.smithi072.stdout:Discarding blocks...Done. 2024-04-04T06:55:22.410 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi072.front.sepia.ceph.com -o noatime 2024-04-04T06:55:22.410 DEBUG:teuthology.orchestra.run.smithi072:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-04-04T06:55:22.607 DEBUG:teuthology.orchestra.run.smithi072:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-04-04T06:55:22.706 DEBUG:teuthology.orchestra.run.smithi072:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-04-04T06:55:22.799 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-04T06:55:22.799 INFO:tasks.ceph:role: osd.3 2024-04-04T06:55:22.800 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi072.front.sepia.ceph.com 2024-04-04T06:55:22.800 DEBUG:teuthology.orchestra.run.smithi072:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-04T06:55:22.892 INFO:teuthology.orchestra.run.smithi072.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-04T06:55:22.892 INFO:teuthology.orchestra.run.smithi072.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-04T06:55:22.892 INFO:teuthology.orchestra.run.smithi072.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-04T06:55:22.892 INFO:teuthology.orchestra.run.smithi072.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-04T06:55:22.892 INFO:teuthology.orchestra.run.smithi072.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-04T06:55:22.892 INFO:teuthology.orchestra.run.smithi072.stdout: = sunit=0 swidth=0 blks 2024-04-04T06:55:22.892 INFO:teuthology.orchestra.run.smithi072.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-04T06:55:22.892 INFO:teuthology.orchestra.run.smithi072.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-04T06:55:22.892 INFO:teuthology.orchestra.run.smithi072.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-04T06:55:22.893 INFO:teuthology.orchestra.run.smithi072.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-04T06:55:23.357 INFO:teuthology.orchestra.run.smithi072.stdout:Discarding blocks...Done. 2024-04-04T06:55:23.363 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi072.front.sepia.ceph.com -o noatime 2024-04-04T06:55:23.363 DEBUG:teuthology.orchestra.run.smithi072:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-04-04T06:55:23.510 DEBUG:teuthology.orchestra.run.smithi072:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-04-04T06:55:23.605 DEBUG:teuthology.orchestra.run.smithi072:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-04T06:55:23.744 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:55:23.746+0000 7f7027019640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-04-04T06:55:23.745 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:55:23.746+0000 7f7027019640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-04-04T06:55:23.745 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:55:23.746+0000 7f7027019640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-04T06:55:23.745 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:55:23.746+0000 7f7027019640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-04T06:55:23.745 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:55:23.746+0000 7f7027019640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-04T06:55:23.754 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:55:23.756+0000 7f7027019640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-04-04T06:55:26.697 DEBUG:teuthology.orchestra.run.smithi072:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-04-04T06:55:26.791 DEBUG:teuthology.orchestra.run.smithi072:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-04T06:55:26.924 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:55:26.926+0000 7fb6b0a24640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-04-04T06:55:26.925 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:55:26.927+0000 7fb6b0a24640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-04-04T06:55:26.925 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:55:26.927+0000 7fb6b0a24640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-04T06:55:26.925 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:55:26.927+0000 7fb6b0a24640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-04T06:55:26.925 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:55:26.927+0000 7fb6b0a24640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-04T06:55:26.927 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:55:26.929+0000 7fb6b0a24640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-04-04T06:55:30.098 DEBUG:teuthology.orchestra.run.smithi072:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-04-04T06:55:30.197 DEBUG:teuthology.orchestra.run.smithi072:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-04T06:55:30.327 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:55:30.329+0000 7f23b2c0c640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-04-04T06:55:30.328 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:55:30.329+0000 7f23b2c0c640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-04-04T06:55:30.328 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:55:30.329+0000 7f23b2c0c640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-04T06:55:30.328 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:55:30.329+0000 7f23b2c0c640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-04T06:55:30.328 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:55:30.329+0000 7f23b2c0c640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-04T06:55:30.329 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:55:30.331+0000 7f23b2c0c640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-04-04T06:55:33.241 DEBUG:teuthology.orchestra.run.smithi072:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-04-04T06:55:33.337 DEBUG:teuthology.orchestra.run.smithi072:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-04T06:55:33.474 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:55:33.475+0000 7ff47ceb5640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-04-04T06:55:33.474 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:55:33.475+0000 7ff47ceb5640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-04-04T06:55:33.474 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:55:33.475+0000 7ff47ceb5640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-04T06:55:33.474 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:55:33.475+0000 7ff47ceb5640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-04T06:55:33.474 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:55:33.475+0000 7ff47ceb5640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-04T06:55:33.476 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:55:33.478+0000 7ff47ceb5640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-04-04T06:55:36.654 DEBUG:teuthology.orchestra.run.smithi072:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-04-04T06:55:36.735 DEBUG:teuthology.orchestra.run.smithi117:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-04-04T06:55:36.834 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-04T06:55:36.834 INFO:tasks.ceph:role: osd.4 2024-04-04T06:55:36.834 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi117.front.sepia.ceph.com 2024-04-04T06:55:36.834 DEBUG:teuthology.orchestra.run.smithi117:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-04T06:55:36.932 INFO:teuthology.orchestra.run.smithi117.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-04T06:55:36.932 INFO:teuthology.orchestra.run.smithi117.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-04T06:55:36.932 INFO:teuthology.orchestra.run.smithi117.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-04T06:55:36.932 INFO:teuthology.orchestra.run.smithi117.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-04T06:55:36.932 INFO:teuthology.orchestra.run.smithi117.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-04T06:55:36.932 INFO:teuthology.orchestra.run.smithi117.stdout: = sunit=0 swidth=0 blks 2024-04-04T06:55:36.932 INFO:teuthology.orchestra.run.smithi117.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-04T06:55:36.932 INFO:teuthology.orchestra.run.smithi117.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-04T06:55:36.932 INFO:teuthology.orchestra.run.smithi117.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-04T06:55:36.933 INFO:teuthology.orchestra.run.smithi117.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-04T06:55:37.431 INFO:teuthology.orchestra.run.smithi117.stdout:Discarding blocks...Done. 2024-04-04T06:55:37.438 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi117.front.sepia.ceph.com -o noatime 2024-04-04T06:55:37.438 DEBUG:teuthology.orchestra.run.smithi117:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-04-04T06:55:37.616 DEBUG:teuthology.orchestra.run.smithi117:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-04-04T06:55:37.725 DEBUG:teuthology.orchestra.run.smithi117:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-04-04T06:55:37.806 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-04T06:55:37.806 INFO:tasks.ceph:role: osd.5 2024-04-04T06:55:37.806 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi117.front.sepia.ceph.com 2024-04-04T06:55:37.806 DEBUG:teuthology.orchestra.run.smithi117:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-04T06:55:37.889 INFO:teuthology.orchestra.run.smithi117.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-04T06:55:37.889 INFO:teuthology.orchestra.run.smithi117.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-04T06:55:37.889 INFO:teuthology.orchestra.run.smithi117.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-04T06:55:37.889 INFO:teuthology.orchestra.run.smithi117.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-04T06:55:37.889 INFO:teuthology.orchestra.run.smithi117.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-04T06:55:37.889 INFO:teuthology.orchestra.run.smithi117.stdout: = sunit=0 swidth=0 blks 2024-04-04T06:55:37.889 INFO:teuthology.orchestra.run.smithi117.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-04T06:55:37.889 INFO:teuthology.orchestra.run.smithi117.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-04T06:55:37.889 INFO:teuthology.orchestra.run.smithi117.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-04T06:55:37.889 INFO:teuthology.orchestra.run.smithi117.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-04T06:55:38.361 INFO:teuthology.orchestra.run.smithi117.stdout:Discarding blocks...Done. 2024-04-04T06:55:38.368 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi117.front.sepia.ceph.com -o noatime 2024-04-04T06:55:38.369 DEBUG:teuthology.orchestra.run.smithi117:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-04-04T06:55:38.505 DEBUG:teuthology.orchestra.run.smithi117:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-04-04T06:55:38.595 DEBUG:teuthology.orchestra.run.smithi117:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-04-04T06:55:38.680 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-04T06:55:38.680 INFO:tasks.ceph:role: osd.6 2024-04-04T06:55:38.680 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi117.front.sepia.ceph.com 2024-04-04T06:55:38.680 DEBUG:teuthology.orchestra.run.smithi117:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-04T06:55:38.771 INFO:teuthology.orchestra.run.smithi117.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-04T06:55:38.771 INFO:teuthology.orchestra.run.smithi117.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-04T06:55:38.771 INFO:teuthology.orchestra.run.smithi117.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-04T06:55:38.771 INFO:teuthology.orchestra.run.smithi117.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-04T06:55:38.771 INFO:teuthology.orchestra.run.smithi117.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-04T06:55:38.771 INFO:teuthology.orchestra.run.smithi117.stdout: = sunit=0 swidth=0 blks 2024-04-04T06:55:38.771 INFO:teuthology.orchestra.run.smithi117.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-04T06:55:38.771 INFO:teuthology.orchestra.run.smithi117.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-04T06:55:38.772 INFO:teuthology.orchestra.run.smithi117.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-04T06:55:38.772 INFO:teuthology.orchestra.run.smithi117.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-04T06:55:39.284 INFO:teuthology.orchestra.run.smithi117.stdout:Discarding blocks...Done. 2024-04-04T06:55:39.291 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi117.front.sepia.ceph.com -o noatime 2024-04-04T06:55:39.291 DEBUG:teuthology.orchestra.run.smithi117:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-04-04T06:55:39.465 DEBUG:teuthology.orchestra.run.smithi117:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-04-04T06:55:39.566 DEBUG:teuthology.orchestra.run.smithi117:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-04-04T06:55:39.662 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-04T06:55:39.662 INFO:tasks.ceph:role: osd.7 2024-04-04T06:55:39.662 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi117.front.sepia.ceph.com 2024-04-04T06:55:39.662 DEBUG:teuthology.orchestra.run.smithi117:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-04T06:55:39.758 INFO:teuthology.orchestra.run.smithi117.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-04T06:55:39.758 INFO:teuthology.orchestra.run.smithi117.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-04T06:55:39.758 INFO:teuthology.orchestra.run.smithi117.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-04T06:55:39.758 INFO:teuthology.orchestra.run.smithi117.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-04T06:55:39.758 INFO:teuthology.orchestra.run.smithi117.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-04T06:55:39.758 INFO:teuthology.orchestra.run.smithi117.stdout: = sunit=0 swidth=0 blks 2024-04-04T06:55:39.758 INFO:teuthology.orchestra.run.smithi117.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-04T06:55:39.758 INFO:teuthology.orchestra.run.smithi117.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-04T06:55:39.758 INFO:teuthology.orchestra.run.smithi117.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-04T06:55:39.758 INFO:teuthology.orchestra.run.smithi117.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-04T06:55:40.218 INFO:teuthology.orchestra.run.smithi117.stdout:Discarding blocks...Done. 2024-04-04T06:55:40.226 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi117.front.sepia.ceph.com -o noatime 2024-04-04T06:55:40.226 DEBUG:teuthology.orchestra.run.smithi117:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-04-04T06:55:40.366 DEBUG:teuthology.orchestra.run.smithi117:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-04-04T06:55:40.462 DEBUG:teuthology.orchestra.run.smithi117:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-04T06:55:40.631 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:55:40.633+0000 7f3d9c00e640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-04-04T06:55:40.634 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:55:40.637+0000 7f3d9c00e640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-04-04T06:55:40.635 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:55:40.637+0000 7f3d9c00e640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-04T06:55:40.635 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:55:40.637+0000 7f3d9c00e640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-04T06:55:40.635 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:55:40.637+0000 7f3d9c00e640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-04T06:55:40.639 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:55:40.642+0000 7f3d9c00e640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-04-04T06:55:43.554 DEBUG:teuthology.orchestra.run.smithi117:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-04-04T06:55:43.648 DEBUG:teuthology.orchestra.run.smithi117:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-04T06:55:43.783 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:55:43.785+0000 7f2472b11640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-04-04T06:55:43.784 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:55:43.786+0000 7f2472b11640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-04-04T06:55:43.784 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:55:43.786+0000 7f2472b11640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-04T06:55:43.784 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:55:43.786+0000 7f2472b11640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-04T06:55:43.784 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:55:43.786+0000 7f2472b11640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-04T06:55:43.785 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:55:43.788+0000 7f2472b11640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-04-04T06:55:44.027 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T06:55:44.035 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T06:55:46.955 DEBUG:teuthology.orchestra.run.smithi117:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-04-04T06:55:47.051 DEBUG:teuthology.orchestra.run.smithi117:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-04T06:55:47.187 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:55:47.189+0000 7f3ab9a0d640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-04-04T06:55:47.187 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:55:47.190+0000 7f3ab9a0d640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-04-04T06:55:47.188 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:55:47.190+0000 7f3ab9a0d640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-04T06:55:47.188 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:55:47.190+0000 7f3ab9a0d640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-04T06:55:47.188 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:55:47.190+0000 7f3ab9a0d640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-04T06:55:47.189 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:55:47.192+0000 7f3ab9a0d640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-04-04T06:55:50.105 DEBUG:teuthology.orchestra.run.smithi117:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-04-04T06:55:50.203 DEBUG:teuthology.orchestra.run.smithi117:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-04T06:55:50.339 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:55:50.341+0000 7f82d2336640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-04-04T06:55:50.340 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:55:50.341+0000 7f82d2336640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-04-04T06:55:50.340 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:55:50.341+0000 7f82d2336640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-04T06:55:50.340 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:55:50.341+0000 7f82d2336640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-04T06:55:50.340 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:55:50.342+0000 7f82d2336640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-04T06:55:50.342 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:55:50.343+0000 7f82d2336640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-04-04T06:55:53.290 DEBUG:teuthology.orchestra.run.smithi117:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-04-04T06:55:53.382 INFO:tasks.ceph:Reading keys from all nodes... 2024-04-04T06:55:53.383 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-04-04T06:55:53.383 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-04-04T06:55:53.479 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-04-04T06:55:53.480 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-04-04T06:55:53.567 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-04-04T06:55:53.568 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-04-04T06:55:53.706 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-04-04T06:55:53.706 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-04-04T06:55:53.797 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-04-04T06:55:53.797 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-04-04T06:55:53.894 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-04-04T06:55:53.895 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-04-04T06:55:53.987 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-04-04T06:55:53.987 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-04-04T06:55:54.082 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-04-04T06:55:54.082 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-04-04T06:55:54.178 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-04-04T06:55:54.178 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-04-04T06:55:54.270 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-04-04T06:55:54.271 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-04-04T06:55:54.364 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-04-04T06:55:54.364 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-04-04T06:55:54.502 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-04-04T06:55:54.502 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-04-04T06:55:54.592 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-04-04T06:55:54.592 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-04-04T06:55:54.730 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-04-04T06:55:54.730 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-04-04T06:55:54.826 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-04-04T06:55:54.826 DEBUG:teuthology.orchestra.run.smithi072:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-04-04T06:55:54.883 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-04-04T06:55:54.883 DEBUG:teuthology.orchestra.run.smithi072:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2024-04-04T06:55:54.933 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-04-04T06:55:54.934 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-04-04T06:55:54.990 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-04-04T06:55:54.990 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2024-04-04T06:55:55.041 INFO:tasks.ceph:Adding keys to all mons... 2024-04-04T06:55:55.041 DEBUG:teuthology.orchestra.run.smithi072:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-04T06:55:55.048 DEBUG:teuthology.orchestra.run.smithi117:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-04T06:55:55.135 INFO:teuthology.orchestra.run.smithi072.stdout:[mgr.y] 2024-04-04T06:55:55.135 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQDVTg5my1hdLRAAH9HxUr+diI1AKFLWTO1tNw== 2024-04-04T06:55:55.135 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.a] 2024-04-04T06:55:55.135 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQDWTg5mbG7JCBAAKz9JsETvc6Baa0PlUPpirw== 2024-04-04T06:55:55.136 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.c] 2024-04-04T06:55:55.136 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQDWTg5mS7LjFxAAmVDMhZMWarW6yI/MUaSpfw== 2024-04-04T06:55:55.136 INFO:teuthology.orchestra.run.smithi072.stdout:[osd.0] 2024-04-04T06:55:55.136 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQDbTg5mEfaILBAA6lk1NZHPLGJFcWt1l7nXhA== 2024-04-04T06:55:55.136 INFO:teuthology.orchestra.run.smithi072.stdout:[osd.1] 2024-04-04T06:55:55.136 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQDeTg5mT4lHNxAA1Vl42CqiPiu4imhU++h7JQ== 2024-04-04T06:55:55.136 INFO:teuthology.orchestra.run.smithi072.stdout:[osd.2] 2024-04-04T06:55:55.136 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQDiTg5mYPGrExAA9hkjzTpeXU7zbi6+/TQdeQ== 2024-04-04T06:55:55.136 INFO:teuthology.orchestra.run.smithi072.stdout:[osd.3] 2024-04-04T06:55:55.136 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQDlTg5mnsRkHBAAyx5Gr6Wd3zxT+OHQdrWArw== 2024-04-04T06:55:55.136 INFO:teuthology.orchestra.run.smithi072.stdout:[mgr.x] 2024-04-04T06:55:55.136 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQDVTg5mtSXaOBAAZJpJzPhQazxoTD6q4qxdog== 2024-04-04T06:55:55.136 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.b] 2024-04-04T06:55:55.137 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQDWTg5mfhrkKBAAPtjPJrv0eeKXkIaALC/fjg== 2024-04-04T06:55:55.137 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.d] 2024-04-04T06:55:55.137 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQDWTg5mdU4vORAAFE04AtIguVlsGytmUcD9rA== 2024-04-04T06:55:55.137 INFO:teuthology.orchestra.run.smithi072.stdout:[osd.4] 2024-04-04T06:55:55.137 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQDsTg5mp8jJJRAAnn8Sr4jnelNVHlo1bDGUrw== 2024-04-04T06:55:55.137 INFO:teuthology.orchestra.run.smithi072.stdout:[osd.5] 2024-04-04T06:55:55.137 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQDvTg5mTuLbLhAAKRgSpIUa4KRF1sonWacj3g== 2024-04-04T06:55:55.137 INFO:teuthology.orchestra.run.smithi072.stdout:[osd.6] 2024-04-04T06:55:55.137 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQDzTg5m0k9SCxAA0IJtySvK7sR+FiJbVWYjPA== 2024-04-04T06:55:55.137 INFO:teuthology.orchestra.run.smithi072.stdout:[osd.7] 2024-04-04T06:55:55.137 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQD2Tg5m4PRnFBAAYUoiTxqshpXqsWnDCKLsjQ== 2024-04-04T06:55:55.137 INFO:teuthology.orchestra.run.smithi072.stdout:[client.0] 2024-04-04T06:55:55.137 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQDXTg5mRJVYCxAA4YRQHdGOPQqDB4fp2kieUw== 2024-04-04T06:55:55.137 INFO:teuthology.orchestra.run.smithi072.stdout:[client.2] 2024-04-04T06:55:55.137 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQDXTg5m2MwpFhAA+TAowiuln4S4BvSJOcYAXg== 2024-04-04T06:55:55.137 INFO:teuthology.orchestra.run.smithi072.stdout:[client.1] 2024-04-04T06:55:55.137 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQDXTg5mZHMkIRAALRQ8KXH7kiVqbY2ksTWAMg== 2024-04-04T06:55:55.138 INFO:teuthology.orchestra.run.smithi072.stdout:[client.3] 2024-04-04T06:55:55.138 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQDXTg5m1Uv7KxAAdTgSlAt2V2fXX5tCRwy/Yw== 2024-04-04T06:55:55.138 INFO:teuthology.orchestra.run.smithi117.stdout:[mgr.y] 2024-04-04T06:55:55.138 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQDVTg5my1hdLRAAH9HxUr+diI1AKFLWTO1tNw== 2024-04-04T06:55:55.138 INFO:teuthology.orchestra.run.smithi117.stdout:[mds.a] 2024-04-04T06:55:55.138 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQDWTg5mbG7JCBAAKz9JsETvc6Baa0PlUPpirw== 2024-04-04T06:55:55.138 INFO:teuthology.orchestra.run.smithi117.stdout:[mds.c] 2024-04-04T06:55:55.138 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQDWTg5mS7LjFxAAmVDMhZMWarW6yI/MUaSpfw== 2024-04-04T06:55:55.139 INFO:teuthology.orchestra.run.smithi117.stdout:[osd.0] 2024-04-04T06:55:55.139 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQDbTg5mEfaILBAA6lk1NZHPLGJFcWt1l7nXhA== 2024-04-04T06:55:55.139 INFO:teuthology.orchestra.run.smithi117.stdout:[osd.1] 2024-04-04T06:55:55.139 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQDeTg5mT4lHNxAA1Vl42CqiPiu4imhU++h7JQ== 2024-04-04T06:55:55.139 INFO:teuthology.orchestra.run.smithi117.stdout:[osd.2] 2024-04-04T06:55:55.139 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQDiTg5mYPGrExAA9hkjzTpeXU7zbi6+/TQdeQ== 2024-04-04T06:55:55.139 INFO:teuthology.orchestra.run.smithi117.stdout:[osd.3] 2024-04-04T06:55:55.139 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQDlTg5mnsRkHBAAyx5Gr6Wd3zxT+OHQdrWArw== 2024-04-04T06:55:55.139 INFO:teuthology.orchestra.run.smithi117.stdout:[mgr.x] 2024-04-04T06:55:55.139 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQDVTg5mtSXaOBAAZJpJzPhQazxoTD6q4qxdog== 2024-04-04T06:55:55.139 INFO:teuthology.orchestra.run.smithi117.stdout:[mds.b] 2024-04-04T06:55:55.139 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQDWTg5mfhrkKBAAPtjPJrv0eeKXkIaALC/fjg== 2024-04-04T06:55:55.139 INFO:teuthology.orchestra.run.smithi117.stdout:[mds.d] 2024-04-04T06:55:55.139 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQDWTg5mdU4vORAAFE04AtIguVlsGytmUcD9rA== 2024-04-04T06:55:55.139 INFO:teuthology.orchestra.run.smithi117.stdout:[osd.4] 2024-04-04T06:55:55.139 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQDsTg5mp8jJJRAAnn8Sr4jnelNVHlo1bDGUrw== 2024-04-04T06:55:55.139 INFO:teuthology.orchestra.run.smithi117.stdout:[osd.5] 2024-04-04T06:55:55.140 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQDvTg5mTuLbLhAAKRgSpIUa4KRF1sonWacj3g== 2024-04-04T06:55:55.140 INFO:teuthology.orchestra.run.smithi117.stdout:[osd.6] 2024-04-04T06:55:55.140 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQDzTg5m0k9SCxAA0IJtySvK7sR+FiJbVWYjPA== 2024-04-04T06:55:55.140 INFO:teuthology.orchestra.run.smithi117.stdout:[osd.7] 2024-04-04T06:55:55.140 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQD2Tg5m4PRnFBAAYUoiTxqshpXqsWnDCKLsjQ== 2024-04-04T06:55:55.140 INFO:teuthology.orchestra.run.smithi117.stdout:[client.0] 2024-04-04T06:55:55.140 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQDXTg5mRJVYCxAA4YRQHdGOPQqDB4fp2kieUw== 2024-04-04T06:55:55.140 INFO:teuthology.orchestra.run.smithi117.stdout:[client.2] 2024-04-04T06:55:55.140 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQDXTg5m2MwpFhAA+TAowiuln4S4BvSJOcYAXg== 2024-04-04T06:55:55.140 INFO:teuthology.orchestra.run.smithi117.stdout:[client.1] 2024-04-04T06:55:55.140 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQDXTg5mZHMkIRAALRQ8KXH7kiVqbY2ksTWAMg== 2024-04-04T06:55:55.140 INFO:teuthology.orchestra.run.smithi117.stdout:[client.3] 2024-04-04T06:55:55.140 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQDXTg5m1Uv7KxAAdTgSlAt2V2fXX5tCRwy/Yw== 2024-04-04T06:55:55.142 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-04T06:55:55.151 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-04T06:55:55.297 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-04T06:55:55.304 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-04T06:55:55.444 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-04T06:55:55.449 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-04T06:55:55.591 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-04T06:55:55.598 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-04T06:55:55.733 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-04T06:55:55.738 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-04T06:55:55.880 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-04T06:55:55.887 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-04T06:55:56.029 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-04T06:55:56.035 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-04T06:55:56.177 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-04T06:55:56.184 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-04T06:55:56.327 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-04T06:55:56.334 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-04T06:55:56.477 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-04T06:55:56.483 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-04T06:55:56.630 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-04T06:55:56.635 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-04T06:55:56.777 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-04T06:55:56.782 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-04T06:55:56.921 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-04T06:55:56.928 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-04T06:55:57.064 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-04T06:55:57.069 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-04T06:55:57.208 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-04T06:55:57.215 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-04T06:55:57.363 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-04T06:55:57.370 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-04T06:55:57.507 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-04T06:55:57.514 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-04T06:55:57.652 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-04T06:55:57.659 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-04T06:55:57.800 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-04-04T06:55:57.800 DEBUG:teuthology.orchestra.run.smithi072:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-04-04T06:55:57.884 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-04T06:55:58.030 DEBUG:teuthology.orchestra.run.smithi072:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-04-04T06:55:58.114 DEBUG:teuthology.orchestra.run.smithi117:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-04-04T06:55:58.214 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-04T06:55:58.371 DEBUG:teuthology.orchestra.run.smithi117:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-04-04T06:55:58.453 DEBUG:teuthology.orchestra.run.smithi117:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-04-04T06:55:58.546 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-04T06:55:58.696 DEBUG:teuthology.orchestra.run.smithi117:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-04-04T06:55:58.780 DEBUG:teuthology.orchestra.run.smithi072:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-04T06:55:58.787 DEBUG:teuthology.orchestra.run.smithi117:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-04T06:55:58.837 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-04-04T06:55:58.837 INFO:tasks.ceph.mon.a:Restarting daemon 2024-04-04T06:55:58.837 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-04-04T06:55:58.842 INFO:tasks.ceph.mon.a:Started 2024-04-04T06:55:58.842 INFO:tasks.ceph.mon.b:Restarting daemon 2024-04-04T06:55:58.842 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-04-04T06:55:58.848 INFO:tasks.ceph.mon.b:Started 2024-04-04T06:55:58.848 INFO:tasks.ceph.mon.c:Restarting daemon 2024-04-04T06:55:58.848 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-04-04T06:55:58.854 INFO:tasks.ceph.mon.c:Started 2024-04-04T06:55:58.854 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-04-04T06:55:58.854 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-04-04T06:55:58.854 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-04-04T06:55:58.861 INFO:tasks.ceph.mgr.y:Started 2024-04-04T06:55:58.861 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-04-04T06:55:58.861 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-04-04T06:55:58.866 INFO:tasks.ceph.mgr.x:Started 2024-04-04T06:55:58.866 INFO:tasks.ceph:Setting crush tunables to default 2024-04-04T06:55:58.867 DEBUG:teuthology.orchestra.run.smithi072:> sudo ceph --cluster ceph osd crush tunables default 2024-04-04T06:55:59.043 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:55:59.044+0000 7fccc9200640 1 Processor -- start 2024-04-04T06:55:59.043 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:55:59.045+0000 7fccc9200640 1 -- start start 2024-04-04T06:55:59.044 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:55:59.046+0000 7fccc9200640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fccc406dc90 0x7fccc40cfa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:55:59.044 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:55:59.046+0000 7fccc9200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fccc40cff40 0x7fccc40d0340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:55:59.044 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:55:59.046+0000 7fccc9200640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fccc4145ef0 con 0x7fccc4145b10 2024-04-04T06:55:59.044 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:55:59.046+0000 7fccc9200640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fccc40cea10 con 0x7fccc406dc90 2024-04-04T06:55:59.045 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:55:59.046+0000 7fccc9200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fccc406e310 con 0x7fccc40cff40 2024-04-04T06:55:59.046 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:55:59.046+0000 7fccc1400640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fccc406dc90 0x7fccc40cfa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:55:59.046 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:55:59.046+0000 7fccc1400640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fccc406dc90 0x7fccc40cfa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.72:57138/0 (socket says 172.21.15.72:57138) 2024-04-04T06:55:59.046 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:55:59.047+0000 7fccc1400640 1 -- 172.21.15.72:0/1743202794 learned_addr learned my addr 172.21.15.72:0/1743202794 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:55:59.046 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:55:59.047+0000 7fccc2800640 1 --2- 172.21.15.72:0/1743202794 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fccc40cff40 0x7fccc40d0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:55:59.046 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:55:59.047+0000 7fccc1400640 1 -- 172.21.15.72:0/1743202794 >> v2:172.21.15.117:3300/0 conn(0x7fccc406dc90 msgr2=0x7fccc40cfa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-04T06:55:59.046 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:55:59.047+0000 7fccc1400640 1 -- 172.21.15.72:0/1743202794 >> v2:172.21.15.117:3300/0 conn(0x7fccc406dc90 msgr2=0x7fccc40cfa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-04T06:55:59.046 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:55:59.047+0000 7fccc1400640 1 --2- 172.21.15.72:0/1743202794 >> v2:172.21.15.117:3300/0 conn(0x7fccc406dc90 0x7fccc40cfa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-04T06:55:59.046 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:55:59.047+0000 7fccc1400640 1 --2- 172.21.15.72:0/1743202794 >> v2:172.21.15.117:3300/0 conn(0x7fccc406dc90 0x7fccc40cfa00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-04T06:55:59.046 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:55:59.047+0000 7fccc2800640 1 -- 172.21.15.72:0/1743202794 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fccc40cff40 msgr2=0x7fccc40d0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-04T06:55:59.046 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:55:59.047+0000 7fccc2800640 1 -- 172.21.15.72:0/1743202794 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fccc40cff40 msgr2=0x7fccc40d0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-04T06:55:59.046 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:55:59.047+0000 7fccc2800640 1 --2- 172.21.15.72:0/1743202794 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fccc40cff40 0x7fccc40d0340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-04T06:55:59.047 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:55:59.047+0000 7fccc2800640 1 --2- 172.21.15.72:0/1743202794 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fccc40cff40 0x7fccc40d0340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-04T06:55:59.247 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:55:59.248+0000 7fccc1400640 1 --2- 172.21.15.72:0/1743202794 >> v2:172.21.15.117:3300/0 conn(0x7fccc406dc90 0x7fccc40cfa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:55:59.248 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:55:59.248+0000 7fccc2800640 1 --2- 172.21.15.72:0/1743202794 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fccc40cff40 0x7fccc40d0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:55:59.248 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:55:59.249+0000 7fccc1400640 1 -- 172.21.15.72:0/1743202794 >> v2:172.21.15.117:3300/0 conn(0x7fccc406dc90 msgr2=0x7fccc40cfa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-04T06:55:59.248 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:55:59.249+0000 7fccc1400640 1 -- 172.21.15.72:0/1743202794 >> v2:172.21.15.117:3300/0 conn(0x7fccc406dc90 msgr2=0x7fccc40cfa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-04T06:55:59.248 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:55:59.249+0000 7fccc1400640 1 --2- 172.21.15.72:0/1743202794 >> v2:172.21.15.117:3300/0 conn(0x7fccc406dc90 0x7fccc40cfa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-04T06:55:59.248 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:55:59.249+0000 7fccc1400640 1 --2- 172.21.15.72:0/1743202794 >> v2:172.21.15.117:3300/0 conn(0x7fccc406dc90 0x7fccc40cfa00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-04T06:55:59.249 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:55:59.250+0000 7fccc2800640 1 -- 172.21.15.72:0/1743202794 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fccc40cff40 msgr2=0x7fccc40d0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-04T06:55:59.249 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:55:59.250+0000 7fccc2800640 1 -- 172.21.15.72:0/1743202794 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fccc40cff40 msgr2=0x7fccc40d0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-04T06:55:59.249 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:55:59.250+0000 7fccc2800640 1 --2- 172.21.15.72:0/1743202794 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fccc40cff40 0x7fccc40d0340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-04T06:55:59.249 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:55:59.250+0000 7fccc2800640 1 --2- 172.21.15.72:0/1743202794 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fccc40cff40 0x7fccc40d0340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-04T06:55:59.649 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:55:59.651+0000 7fccc1400640 1 --2- 172.21.15.72:0/1743202794 >> v2:172.21.15.117:3300/0 conn(0x7fccc406dc90 0x7fccc40cfa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:55:59.649 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:55:59.651+0000 7fccc2800640 1 --2- 172.21.15.72:0/1743202794 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fccc40cff40 0x7fccc40d0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:55:59.649 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:55:59.651+0000 7fccc1400640 1 -- 172.21.15.72:0/1743202794 >> v2:172.21.15.117:3300/0 conn(0x7fccc406dc90 msgr2=0x7fccc40cfa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-04T06:55:59.650 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:55:59.651+0000 7fccc1400640 1 -- 172.21.15.72:0/1743202794 >> v2:172.21.15.117:3300/0 conn(0x7fccc406dc90 msgr2=0x7fccc40cfa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-04T06:55:59.650 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:55:59.651+0000 7fccc1400640 1 --2- 172.21.15.72:0/1743202794 >> v2:172.21.15.117:3300/0 conn(0x7fccc406dc90 0x7fccc40cfa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-04T06:55:59.650 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:55:59.651+0000 7fccc1400640 1 --2- 172.21.15.72:0/1743202794 >> v2:172.21.15.117:3300/0 conn(0x7fccc406dc90 0x7fccc40cfa00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-04T06:55:59.650 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:55:59.651+0000 7fccc2800640 1 -- 172.21.15.72:0/1743202794 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fccc40cff40 msgr2=0x7fccc40d0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-04T06:55:59.650 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:55:59.651+0000 7fccc2800640 1 -- 172.21.15.72:0/1743202794 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fccc40cff40 msgr2=0x7fccc40d0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-04T06:55:59.650 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:55:59.651+0000 7fccc2800640 1 --2- 172.21.15.72:0/1743202794 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fccc40cff40 0x7fccc40d0340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-04T06:55:59.650 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:55:59.651+0000 7fccc2800640 1 --2- 172.21.15.72:0/1743202794 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fccc40cff40 0x7fccc40d0340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-04T06:56:00.452 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:00.452+0000 7fccc2800640 1 --2- 172.21.15.72:0/1743202794 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fccc40cff40 0x7fccc40d0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:00.452 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:00.452+0000 7fccc1400640 1 --2- 172.21.15.72:0/1743202794 >> v2:172.21.15.117:3300/0 conn(0x7fccc406dc90 0x7fccc40cfa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:00.453 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:00.452+0000 7fccc2800640 1 -- 172.21.15.72:0/1743202794 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fccc40cff40 msgr2=0x7fccc40d0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-04T06:56:00.453 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:00.452+0000 7fccc2800640 1 -- 172.21.15.72:0/1743202794 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fccc40cff40 msgr2=0x7fccc40d0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-04T06:56:00.453 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:00.452+0000 7fccc2800640 1 --2- 172.21.15.72:0/1743202794 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fccc40cff40 0x7fccc40d0340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-04T06:56:00.453 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:00.453+0000 7fccc2800640 1 --2- 172.21.15.72:0/1743202794 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fccc40cff40 0x7fccc40d0340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-04T06:56:00.453 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:00.453+0000 7fccc1400640 1 -- 172.21.15.72:0/1743202794 >> v2:172.21.15.117:3300/0 conn(0x7fccc406dc90 msgr2=0x7fccc40cfa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-04T06:56:00.453 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:00.453+0000 7fccc1400640 1 -- 172.21.15.72:0/1743202794 >> v2:172.21.15.117:3300/0 conn(0x7fccc406dc90 msgr2=0x7fccc40cfa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-04T06:56:00.453 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:00.453+0000 7fccc1400640 1 --2- 172.21.15.72:0/1743202794 >> v2:172.21.15.117:3300/0 conn(0x7fccc406dc90 0x7fccc40cfa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-04T06:56:00.453 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:00.453+0000 7fccc1400640 1 --2- 172.21.15.72:0/1743202794 >> v2:172.21.15.117:3300/0 conn(0x7fccc406dc90 0x7fccc40cfa00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-04T06:56:02.045 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:02.046+0000 7fccbb400640 1 -- 172.21.15.72:0/1743202794 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fccc40cff40 msgr2=0x7fccc40d0340 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-04T06:56:02.045 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:02.046+0000 7fccbb400640 1 --2- 172.21.15.72:0/1743202794 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fccc40cff40 0x7fccc40d0340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:02.045 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:02.046+0000 7fccbb400640 1 -- 172.21.15.72:0/1743202794 >> v2:172.21.15.117:3300/0 conn(0x7fccc406dc90 msgr2=0x7fccc40cfa00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-04T06:56:02.045 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:02.046+0000 7fccbb400640 1 --2- 172.21.15.72:0/1743202794 >> v2:172.21.15.117:3300/0 conn(0x7fccc406dc90 0x7fccc40cfa00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:02.045 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:02.046+0000 7fccbb400640 1 -- 172.21.15.72:0/1743202794 >> v1:172.21.15.117:6789/0 conn(0x7fccc4145b10 legacy=0x7fccc406d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:02.045 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:02.046+0000 7fccbb400640 1 --2- 172.21.15.72:0/1743202794 >> v2:172.21.15.72:3300/0 conn(0x7fcca4007350 0x7fcca40097f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:02.045 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:02.046+0000 7fccbb400640 1 -- 172.21.15.72:0/1743202794 --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fccc40cec40 con 0x7fcca40036e0 2024-04-04T06:56:02.045 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:02.046+0000 7fccbb400640 1 -- 172.21.15.72:0/1743202794 --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7fccc406e310 con 0x7fcca4007350 2024-04-04T06:56:02.046 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:02.046+0000 7fccc1400640 1 --2- 172.21.15.72:0/1743202794 >> v2:172.21.15.72:3300/0 conn(0x7fcca4007350 0x7fcca40097f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:02.046 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:02.046+0000 7fccc1400640 1 -- 172.21.15.72:0/1743202794 >> v2:172.21.15.72:3300/0 conn(0x7fcca4007350 msgr2=0x7fcca40097f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-04T06:56:02.046 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:02.046+0000 7fccc1400640 1 -- 172.21.15.72:0/1743202794 >> v2:172.21.15.72:3300/0 conn(0x7fcca4007350 msgr2=0x7fcca40097f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-04T06:56:02.046 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:02.046+0000 7fccc1400640 1 --2- 172.21.15.72:0/1743202794 >> v2:172.21.15.72:3300/0 conn(0x7fcca4007350 0x7fcca40097f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-04T06:56:02.046 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:02.046+0000 7fccc1400640 1 --2- 172.21.15.72:0/1743202794 >> v2:172.21.15.72:3300/0 conn(0x7fcca4007350 0x7fcca40097f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-04T06:56:02.247 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:02.248+0000 7fccc1400640 1 --2- 172.21.15.72:0/1743202794 >> v2:172.21.15.72:3300/0 conn(0x7fcca4007350 0x7fcca40097f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:02.248 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:02.248+0000 7fccc1400640 1 -- 172.21.15.72:0/1743202794 >> v2:172.21.15.72:3300/0 conn(0x7fcca4007350 msgr2=0x7fcca40097f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-04T06:56:02.248 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:02.248+0000 7fccc1400640 1 -- 172.21.15.72:0/1743202794 >> v2:172.21.15.72:3300/0 conn(0x7fcca4007350 msgr2=0x7fcca40097f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-04T06:56:02.248 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:02.248+0000 7fccc1400640 1 --2- 172.21.15.72:0/1743202794 >> v2:172.21.15.72:3300/0 conn(0x7fcca4007350 0x7fcca40097f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-04T06:56:02.248 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:02.248+0000 7fccc1400640 1 --2- 172.21.15.72:0/1743202794 >> v2:172.21.15.72:3300/0 conn(0x7fcca4007350 0x7fcca40097f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-04T06:56:02.649 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:02.649+0000 7fccc1400640 1 --2- 172.21.15.72:0/1743202794 >> v2:172.21.15.72:3300/0 conn(0x7fcca4007350 0x7fcca40097f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:02.649 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:02.649+0000 7fccc1400640 1 -- 172.21.15.72:0/1743202794 >> v2:172.21.15.72:3300/0 conn(0x7fcca4007350 msgr2=0x7fcca40097f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-04T06:56:02.650 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:02.650+0000 7fccc1400640 1 -- 172.21.15.72:0/1743202794 >> v2:172.21.15.72:3300/0 conn(0x7fcca4007350 msgr2=0x7fcca40097f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-04T06:56:02.650 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:02.650+0000 7fccc1400640 1 --2- 172.21.15.72:0/1743202794 >> v2:172.21.15.72:3300/0 conn(0x7fcca4007350 0x7fcca40097f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-04T06:56:02.650 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:02.650+0000 7fccc1400640 1 --2- 172.21.15.72:0/1743202794 >> v2:172.21.15.72:3300/0 conn(0x7fcca4007350 0x7fcca40097f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-04T06:56:03.451 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:03.452+0000 7fccc1400640 1 --2- 172.21.15.72:0/1743202794 >> v2:172.21.15.72:3300/0 conn(0x7fcca4007350 0x7fcca40097f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:03.451 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:03.453+0000 7fccc1400640 1 -- 172.21.15.72:0/1743202794 >> v2:172.21.15.72:3300/0 conn(0x7fcca4007350 msgr2=0x7fcca40097f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-04T06:56:03.451 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:03.453+0000 7fccc1400640 1 -- 172.21.15.72:0/1743202794 >> v2:172.21.15.72:3300/0 conn(0x7fcca4007350 msgr2=0x7fcca40097f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-04T06:56:03.451 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:03.453+0000 7fccc1400640 1 --2- 172.21.15.72:0/1743202794 >> v2:172.21.15.72:3300/0 conn(0x7fcca4007350 0x7fcca40097f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-04T06:56:03.451 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:03.453+0000 7fccc1400640 1 --2- 172.21.15.72:0/1743202794 >> v2:172.21.15.72:3300/0 conn(0x7fcca4007350 0x7fcca40097f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-04T06:56:04.317 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:04.319+0000 7fccc0a00640 1 -- 172.21.15.72:0/1743202794 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1029182116 0 0) 0x7fccc40cec40 con 0x7fcca40036e0 2024-04-04T06:56:04.317 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:04.319+0000 7fccc0a00640 1 -- 172.21.15.72:0/1743202794 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcca8003520 con 0x7fcca40036e0 2024-04-04T06:56:04.319 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:04.320+0000 7fccc0a00640 1 -- 172.21.15.72:0/1743202794 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3224435254 0 0) 0x7fcca8003520 con 0x7fcca40036e0 2024-04-04T06:56:04.319 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:04.320+0000 7fccc0a00640 1 -- 172.21.15.72:0/1743202794 >> v2:172.21.15.72:3300/0 conn(0x7fcca4007350 msgr2=0x7fcca40097f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-04T06:56:04.319 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:04.320+0000 7fccc0a00640 1 --2- 172.21.15.72:0/1743202794 >> v2:172.21.15.72:3300/0 conn(0x7fcca4007350 0x7fcca40097f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:04.319 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:04.320+0000 7fccc0a00640 1 -- 172.21.15.72:0/1743202794 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcca400afc0 con 0x7fcca40036e0 2024-04-04T06:56:04.319 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:04.320+0000 7fccc0a00640 1 -- 172.21.15.72:0/1743202794 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2465650867 0 0) 0x7fccb4001710 con 0x7fcca40036e0 2024-04-04T06:56:04.319 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:04.320+0000 7fccc0a00640 1 -- 172.21.15.72:0/1743202794 >> v1:172.21.15.72:6789/0 conn(0x7fcca40036e0 legacy=0x7fcca4005b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:04.319 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:04.320+0000 7fccc2800640 1 -- 172.21.15.72:0/1743202794 reap_dead start 2024-04-04T06:56:04.320 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:04.320+0000 7fccc0a00640 1 --2- 172.21.15.72:0/1743202794 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcca8003a00 0x7fcca8003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:04.320 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:04.320+0000 7fccc0a00640 1 --2- 172.21.15.72:0/1743202794 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcca8004800 0x7fcca8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:04.320 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:04.320+0000 7fccc0a00640 1 --2- 172.21.15.72:0/1743202794 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcca80053c0 0x7fcca800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:04.320 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:04.321+0000 7fccc0a00640 1 -- 172.21.15.72:0/1743202794 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fccc406e310 con 0x7fcca8004800 2024-04-04T06:56:04.320 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:04.321+0000 7fccc0a00640 1 -- 172.21.15.72:0/1743202794 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fcca800c280 con 0x7fcca8003a00 2024-04-04T06:56:04.320 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:04.321+0000 7fccc0a00640 1 -- 172.21.15.72:0/1743202794 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fcca800c480 con 0x7fcca80053c0 2024-04-04T06:56:04.321 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:04.322+0000 7fccc1e00640 1 --2- 172.21.15.72:0/1743202794 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcca8003a00 0x7fcca8003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:04.321 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:04.322+0000 7fccc2800640 1 --2- 172.21.15.72:0/1743202794 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcca80053c0 0x7fcca800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:04.321 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:04.322+0000 7fccc1400640 1 --2- 172.21.15.72:0/1743202794 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcca8004800 0x7fcca8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:04.321 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:04.323+0000 7fccc1e00640 1 -- 172.21.15.72:0/1743202794 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcca80053c0 msgr2=0x7fcca800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:56:04.321 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:04.323+0000 7fccc1e00640 1 --2- 172.21.15.72:0/1743202794 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcca80053c0 0x7fcca800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:04.321 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:04.323+0000 7fccc1e00640 1 -- 172.21.15.72:0/1743202794 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcca8004800 msgr2=0x7fcca8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:56:04.322 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:04.323+0000 7fccc1e00640 1 --2- 172.21.15.72:0/1743202794 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcca8004800 0x7fcca8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:04.322 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:04.323+0000 7fccc1e00640 1 -- 172.21.15.72:0/1743202794 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcca8003520 con 0x7fcca8003a00 2024-04-04T06:56:04.324 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:04.326+0000 7fccc1e00640 1 --2- 172.21.15.72:0/1743202794 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcca8003a00 0x7fcca8003e00 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fccb4007f30 tx=0x7fcca8005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f536de36f5962e90 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:04.325 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:04.327+0000 7fccc0a00640 1 -- 172.21.15.72:0/1743202794 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccb4007b80 con 0x7fcca8003a00 2024-04-04T06:56:04.325 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:04.327+0000 7fccc0a00640 1 -- 172.21.15.72:0/1743202794 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fccb4030070 con 0x7fcca8003a00 2024-04-04T06:56:04.325 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:04.327+0000 7fccc0a00640 1 -- 172.21.15.72:0/1743202794 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccb402c6e0 con 0x7fcca8003a00 2024-04-04T06:56:04.327 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:04.328+0000 7fccc9200640 1 -- 172.21.15.72:0/1743202794 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcca8003a00 msgr2=0x7fcca8003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:04.327 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:04.328+0000 7fccc9200640 1 --2- 172.21.15.72:0/1743202794 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcca8003a00 0x7fcca8003e00 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fccb4007f30 tx=0x7fcca8005830 comp rx=0 tx=0).stop 2024-04-04T06:56:04.327 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:04.328+0000 7fccc9200640 1 -- 172.21.15.72:0/1743202794 shutdown_connections 2024-04-04T06:56:04.327 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:04.328+0000 7fccc9200640 1 --2- 172.21.15.72:0/1743202794 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcca80053c0 0x7fcca800b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:04.327 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:04.328+0000 7fccc9200640 1 --2- 172.21.15.72:0/1743202794 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcca8004800 0x7fcca8004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:04.327 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:04.328+0000 7fccc9200640 1 --2- 172.21.15.72:0/1743202794 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcca8003a00 0x7fcca8003e00 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:04.327 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:04.328+0000 7fccc9200640 1 -- 172.21.15.72:0/1743202794 >> 172.21.15.72:0/1743202794 conn(0x7fccc406b470 msgr2=0x7fccc406b850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:56:04.327 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:04.328+0000 7fccc9200640 1 -- 172.21.15.72:0/1743202794 shutdown_connections 2024-04-04T06:56:04.327 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:04.328+0000 7fccc9200640 1 -- 172.21.15.72:0/1743202794 wait complete. 2024-04-04T06:56:04.329 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:04.331+0000 7fccc9200640 1 Processor -- start 2024-04-04T06:56:04.329 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:04.331+0000 7fccc9200640 1 -- start start 2024-04-04T06:56:04.331 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:04.332+0000 7fccc9200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcca8003a00 0x7fccc4138cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:04.331 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:04.332+0000 7fccc9200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcca8004800 0x7fccc413abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:04.331 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:04.332+0000 7fccc9200640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcca80053c0 0x7fccc40b1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:04.331 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:04.332+0000 7fccc9200640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fccc40cf4e0 con 0x7fcca80053c0 2024-04-04T06:56:04.331 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:04.332+0000 7fccc9200640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fccc40cf200 con 0x7fcca8003a00 2024-04-04T06:56:04.332 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:04.332+0000 7fccc9200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fccc40cfa00 con 0x7fcca8004800 2024-04-04T06:56:04.332 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:04.333+0000 7fccc2800640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcca80053c0 0x7fccc40b1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:04.332 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:04.333+0000 7fccc2800640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcca80053c0 0x7fccc40b1ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42798/0 (socket says 172.21.15.72:42798) 2024-04-04T06:56:04.332 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:04.333+0000 7fccc2800640 1 -- 172.21.15.72:0/3221211709 learned_addr learned my addr 172.21.15.72:0/3221211709 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:56:04.332 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:04.333+0000 7fccc1400640 1 --2- 172.21.15.72:0/3221211709 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcca8004800 0x7fccc413abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:04.332 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:04.333+0000 7fccc1e00640 1 --2- 172.21.15.72:0/3221211709 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcca8003a00 0x7fccc4138cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:04.333 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:04.333+0000 7fccc2800640 1 -- 172.21.15.72:0/3221211709 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcca8004800 msgr2=0x7fccc413abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:04.333 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:04.333+0000 7fccc2800640 1 --2- 172.21.15.72:0/3221211709 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcca8004800 0x7fccc413abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:04.333 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:04.333+0000 7fccc2800640 1 -- 172.21.15.72:0/3221211709 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcca8003a00 msgr2=0x7fccc4138cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:04.333 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:04.333+0000 7fccc2800640 1 --2- 172.21.15.72:0/3221211709 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcca8003a00 0x7fccc4138cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:04.333 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:04.333+0000 7fccc2800640 1 -- 172.21.15.72:0/3221211709 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccc40b2640 con 0x7fcca80053c0 2024-04-04T06:56:04.333 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:04.334+0000 7fccc2800640 1 --2- 172.21.15.72:0/3221211709 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcca80053c0 0x7fccc40b1ed0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fccbc009610 tx=0x7fccbc015700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:04.334 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:04.334+0000 7fccba000640 1 -- 172.21.15.72:0/3221211709 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccbc01b070 con 0x7fcca80053c0 2024-04-04T06:56:04.334 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:04.334+0000 7fccba000640 1 -- 172.21.15.72:0/3221211709 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fccbc020460 con 0x7fcca80053c0 2024-04-04T06:56:04.334 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:04.334+0000 7fccc9200640 1 -- 172.21.15.72:0/3221211709 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fccc4139e10 con 0x7fcca80053c0 2024-04-04T06:56:04.334 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:04.334+0000 7fccba000640 1 -- 172.21.15.72:0/3221211709 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccbc020850 con 0x7fcca80053c0 2024-04-04T06:56:04.334 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:04.334+0000 7fccc9200640 1 -- 172.21.15.72:0/3221211709 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fccc413a3d0 con 0x7fcca80053c0 2024-04-04T06:56:04.334 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:04.335+0000 7fccba000640 1 -- 172.21.15.72:0/3221211709 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fccbc005d10 con 0x7fcca80053c0 2024-04-04T06:56:04.334 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:04.335+0000 7fccba000640 1 -- 172.21.15.72:0/3221211709 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fccbc017940 con 0x7fcca80053c0 2024-04-04T06:56:04.334 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:04.336+0000 7fccc9200640 1 -- 172.21.15.72:0/3221211709 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fccc4075730 con 0x7fcca80053c0 2024-04-04T06:56:04.337 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:04.339+0000 7fccba000640 1 -- 172.21.15.72:0/3221211709 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7fccbc010050 con 0x7fcca80053c0 2024-04-04T06:56:04.412 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:04.414+0000 7fccc9200640 1 -- 172.21.15.72:0/3221211709 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7fccc40b1cb0 con 0x7fcca80053c0 2024-04-04T06:56:04.416 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:04.418+0000 7fccba000640 1 -- 172.21.15.72:0/3221211709 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7fccbc017410 con 0x7fcca80053c0 2024-04-04T06:56:04.417 INFO:teuthology.orchestra.run.smithi072.stderr:adjusted tunables profile to default 2024-04-04T06:56:04.418 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:04.419+0000 7fccc9200640 1 -- 172.21.15.72:0/3221211709 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcca80053c0 msgr2=0x7fccc40b1ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:04.419 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:04.419+0000 7fccc9200640 1 --2- 172.21.15.72:0/3221211709 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcca80053c0 0x7fccc40b1ed0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fccbc009610 tx=0x7fccbc015700 comp rx=0 tx=0).stop 2024-04-04T06:56:04.419 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:04.420+0000 7fccc9200640 1 -- 172.21.15.72:0/3221211709 shutdown_connections 2024-04-04T06:56:04.419 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:04.420+0000 7fccc9200640 1 --2- 172.21.15.72:0/3221211709 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcca80053c0 0x7fccc40b1ed0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:04.419 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:04.420+0000 7fccc9200640 1 --2- 172.21.15.72:0/3221211709 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcca8004800 0x7fccc413abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:04.419 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:04.420+0000 7fccc9200640 1 --2- 172.21.15.72:0/3221211709 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcca8003a00 0x7fccc4138cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:04.419 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:04.420+0000 7fccc9200640 1 -- 172.21.15.72:0/3221211709 >> 172.21.15.72:0/3221211709 conn(0x7fccc406b470 msgr2=0x7fccc41428b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:56:04.419 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:04.420+0000 7fccc9200640 1 -- 172.21.15.72:0/3221211709 shutdown_connections 2024-04-04T06:56:04.419 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:04.420+0000 7fccc9200640 1 -- 172.21.15.72:0/3221211709 wait complete. 2024-04-04T06:56:04.436 INFO:tasks.ceph:check_enable_crimson: False 2024-04-04T06:56:04.436 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-04-04T06:56:04.436 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-04-04T06:56:04.436 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-04-04T06:56:04.514 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-04-04T06:56:04.514 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-04-04T06:56:04.636 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-04-04T06:56:04.636 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-04-04T06:56:04.756 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-04-04T06:56:04.756 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-04-04T06:56:04.878 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-04-04T06:56:04.878 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-04-04T06:56:04.914 INFO:tasks.ceph.mgr.y.smithi072.stderr:2024-04-04T06:56:04.916+0000 7fa15020d040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-04T06:56:04.975 INFO:tasks.ceph.mgr.y.smithi072.stderr:2024-04-04T06:56:04.977+0000 7fa15020d040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-04T06:56:04.981 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-04-04T06:56:04.981 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-04-04T06:56:05.064 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-04-04T06:56:05.064 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-04-04T06:56:05.139 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-04-04T06:56:05.139 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-04-04T06:56:05.262 DEBUG:teuthology.orchestra.run.smithi117:> sudo ceph --cluster ceph osd new 7c345991-5af8-4dc6-a481-28610c40e128 0 2024-04-04T06:56:05.502 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:05.503+0000 7fe612200640 1 Processor -- start 2024-04-04T06:56:05.502 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:05.503+0000 7fe612200640 1 -- start start 2024-04-04T06:56:05.504 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:05.505+0000 7fe612200640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fe60c145b10 0x7fe60c06d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:05.504 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:05.505+0000 7fe612200640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe60c06dac0 0x7fe60c0cfa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:05.504 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:05.505+0000 7fe612200640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe60c145ef0 con 0x7fe60c0cff40 2024-04-04T06:56:05.504 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:05.505+0000 7fe612200640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7fe60c0cea10 con 0x7fe60c06dac0 2024-04-04T06:56:05.504 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:05.505+0000 7fe612200640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fe60c06e310 con 0x7fe60c145b10 2024-04-04T06:56:05.504 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:05.505+0000 7fe60b400640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fe60c145b10 0x7fe60c06d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:05.504 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:05.505+0000 7fe60be00640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7fe60c0cff40 0x7fe60c15fe90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:50202/0 (socket says 172.21.15.117:50202) 2024-04-04T06:56:05.504 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:05.505+0000 7fe60be00640 1 -- 172.21.15.117:0/1302347668 learned_addr learned my addr 172.21.15.117:0/1302347668 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-04-04T06:56:05.505 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:05.505+0000 7fe60aa00640 1 --2- 172.21.15.117:0/1302347668 >> v2:172.21.15.72:3300/0 conn(0x7fe60c06dac0 0x7fe60c0cfa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:05.505 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:05.506+0000 7fe60b400640 1 -- 172.21.15.117:0/1302347668 >> v2:172.21.15.72:3300/0 conn(0x7fe60c06dac0 msgr2=0x7fe60c0cfa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:56:05.505 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:05.506+0000 7fe60b400640 1 --2- 172.21.15.117:0/1302347668 >> v2:172.21.15.72:3300/0 conn(0x7fe60c06dac0 0x7fe60c0cfa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:05.505 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:05.506+0000 7fe60b400640 1 -- 172.21.15.117:0/1302347668 >> v1:172.21.15.117:6789/0 conn(0x7fe60c0cff40 legacy=0x7fe60c15fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:05.505 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:05.506+0000 7fe60b400640 1 -- 172.21.15.117:0/1302347668 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe60c0cec40 con 0x7fe60c145b10 2024-04-04T06:56:05.505 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:05.506+0000 7fe60a000640 1 -- 172.21.15.117:0/1302347668 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2246397216 0 0) 0x7fe60c145ef0 con 0x7fe60c0cff40 2024-04-04T06:56:05.507 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:05.507+0000 7fe60b400640 1 --2- 172.21.15.117:0/1302347668 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe60c145b10 0x7fe60c06d580 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fe60c06c350 tx=0x7fe5fc02b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=53b4730a0908bb59 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:05.507 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:05.507+0000 7fe60a000640 1 -- 172.21.15.117:0/1302347668 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5fc0315a0 con 0x7fe60c145b10 2024-04-04T06:56:05.507 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:05.507+0000 7fe60a000640 1 -- 172.21.15.117:0/1302347668 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5fc037070 con 0x7fe60c145b10 2024-04-04T06:56:05.507 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:05.507+0000 7fe60a000640 1 -- 172.21.15.117:0/1302347668 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5fc031960 con 0x7fe60c145b10 2024-04-04T06:56:05.507 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:05.508+0000 7fe612200640 1 -- 172.21.15.117:0/1302347668 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe60c145b10 msgr2=0x7fe60c06d580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:05.507 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:05.508+0000 7fe612200640 1 --2- 172.21.15.117:0/1302347668 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe60c145b10 0x7fe60c06d580 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fe60c06c350 tx=0x7fe5fc02b840 comp rx=0 tx=0).stop 2024-04-04T06:56:05.507 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:05.508+0000 7fe612200640 1 -- 172.21.15.117:0/1302347668 shutdown_connections 2024-04-04T06:56:05.507 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:05.508+0000 7fe612200640 1 --2- 172.21.15.117:0/1302347668 >> v2:172.21.15.72:3300/0 conn(0x7fe60c06dac0 0x7fe60c0cfa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:05.507 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:05.508+0000 7fe612200640 1 --2- 172.21.15.117:0/1302347668 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe60c145b10 0x7fe60c06d580 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:05.507 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:05.508+0000 7fe612200640 1 -- 172.21.15.117:0/1302347668 >> 172.21.15.117:0/1302347668 conn(0x7fe60c06b470 msgr2=0x7fe60c06b850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:56:05.507 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:05.508+0000 7fe612200640 1 -- 172.21.15.117:0/1302347668 shutdown_connections 2024-04-04T06:56:05.507 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:05.508+0000 7fe612200640 1 -- 172.21.15.117:0/1302347668 wait complete. 2024-04-04T06:56:05.508 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:05.510+0000 7fe612200640 1 Processor -- start 2024-04-04T06:56:05.508 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:05.510+0000 7fe612200640 1 -- start start 2024-04-04T06:56:05.511 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:05.511+0000 7fe612200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe60c06dac0 0x7fe60c131050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:05.511 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:05.511+0000 7fe612200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe60c0cff40 0x7fe60c1344d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:05.511 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:05.511+0000 7fe612200640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe60c145b10 0x7fe60c159790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:05.511 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:05.511+0000 7fe612200640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fe60c0cf4e0 con 0x7fe60c145b10 2024-04-04T06:56:05.511 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:05.511+0000 7fe612200640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fe60c0cf200 con 0x7fe60c0cff40 2024-04-04T06:56:05.511 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:05.511+0000 7fe612200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fe60c06df70 con 0x7fe60c06dac0 2024-04-04T06:56:05.511 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:05.511+0000 7fe60aa00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe60c0cff40 0x7fe60c1344d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:05.511 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:05.511+0000 7fe60b400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe60c06dac0 0x7fe60c131050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:05.511 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:05.511+0000 7fe60aa00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe60c0cff40 0x7fe60c1344d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:58378/0 (socket says 172.21.15.117:58378) 2024-04-04T06:56:05.511 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:05.511+0000 7fe60aa00640 1 -- 172.21.15.117:0/1622334199 learned_addr learned my addr 172.21.15.117:0/1622334199 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-04T06:56:05.511 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:05.511+0000 7fe60be00640 1 --2- 172.21.15.117:0/1622334199 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe60c145b10 0x7fe60c159790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:05.511 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:05.511+0000 7fe60aa00640 1 -- 172.21.15.117:0/1622334199 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe60c06dac0 msgr2=0x7fe60c131050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:05.512 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:05.511+0000 7fe60aa00640 1 --2- 172.21.15.117:0/1622334199 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe60c06dac0 0x7fe60c131050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:05.512 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:05.511+0000 7fe60aa00640 1 -- 172.21.15.117:0/1622334199 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe60c145b10 msgr2=0x7fe60c159790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:05.512 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:05.511+0000 7fe60aa00640 1 --2- 172.21.15.117:0/1622334199 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe60c145b10 0x7fe60c159790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:05.512 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:05.511+0000 7fe60aa00640 1 -- 172.21.15.117:0/1622334199 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe60c134b90 con 0x7fe60c0cff40 2024-04-04T06:56:05.512 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:05.511+0000 7fe60be00640 1 --2- 172.21.15.117:0/1622334199 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe60c145b10 0x7fe60c159790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-04T06:56:05.512 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:05.512+0000 7fe60aa00640 1 --2- 172.21.15.117:0/1622334199 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe60c0cff40 0x7fe60c1344d0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fe5f800d800 tx=0x7fe5f800dcc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:05.512 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:05.512+0000 7fe603400640 1 -- 172.21.15.117:0/1622334199 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5f800b6c0 con 0x7fe60c0cff40 2024-04-04T06:56:05.512 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:05.512+0000 7fe603400640 1 -- 172.21.15.117:0/1622334199 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5f8019070 con 0x7fe60c0cff40 2024-04-04T06:56:05.512 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:05.512+0000 7fe612200640 1 -- 172.21.15.117:0/1622334199 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe60c134e70 con 0x7fe60c0cff40 2024-04-04T06:56:05.512 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:05.512+0000 7fe603400640 1 -- 172.21.15.117:0/1622334199 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5f800ba60 con 0x7fe60c0cff40 2024-04-04T06:56:05.512 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:05.512+0000 7fe612200640 1 -- 172.21.15.117:0/1622334199 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe60c135430 con 0x7fe60c0cff40 2024-04-04T06:56:05.512 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:05.512+0000 7fe603400640 1 -- 172.21.15.117:0/1622334199 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fe5f800bc00 con 0x7fe60c0cff40 2024-04-04T06:56:05.512 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:05.512+0000 7fe603400640 1 -- 172.21.15.117:0/1622334199 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7fe5f8003d20 con 0x7fe60c0cff40 2024-04-04T06:56:05.513 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:05.513+0000 7fe612200640 1 -- 172.21.15.117:0/1622334199 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe60c0ce650 con 0x7fe60c0cff40 2024-04-04T06:56:05.517 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:05.518+0000 7fe603400640 1 -- 172.21.15.117:0/1622334199 <== mon.1 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7fe60c0ce650 con 0x7fe60c0cff40 2024-04-04T06:56:05.596 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:05.597+0000 7fe612200640 1 -- 172.21.15.117:0/1622334199 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd new", "uuid": "7c345991-5af8-4dc6-a481-28610c40e128", "id": 0} v 0) -- 0x7fe60c0d0c00 con 0x7fe60c0cff40 2024-04-04T06:56:05.596 INFO:tasks.ceph.mgr.y.smithi072.stderr:2024-04-04T06:56:05.598+0000 7fa15020d040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-04T06:56:05.603 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:05.604+0000 7fe603400640 1 -- 172.21.15.117:0/1622334199 <== mon.1 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "7c345991-5af8-4dc6-a481-28610c40e128", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7fe5f8023020 con 0x7fe60c0cff40 2024-04-04T06:56:05.603 INFO:teuthology.orchestra.run.smithi117.stdout:0 2024-04-04T06:56:05.605 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:05.606+0000 7fe612200640 1 -- 172.21.15.117:0/1622334199 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe60c0cff40 msgr2=0x7fe60c1344d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:05.605 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:05.606+0000 7fe612200640 1 --2- 172.21.15.117:0/1622334199 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe60c0cff40 0x7fe60c1344d0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fe5f800d800 tx=0x7fe5f800dcc0 comp rx=0 tx=0).stop 2024-04-04T06:56:05.605 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:05.606+0000 7fe612200640 1 -- 172.21.15.117:0/1622334199 shutdown_connections 2024-04-04T06:56:05.605 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:05.606+0000 7fe612200640 1 --2- 172.21.15.117:0/1622334199 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe60c145b10 0x7fe60c159790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:05.605 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:05.606+0000 7fe612200640 1 --2- 172.21.15.117:0/1622334199 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe60c0cff40 0x7fe60c1344d0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:05.605 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:05.606+0000 7fe612200640 1 --2- 172.21.15.117:0/1622334199 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe60c06dac0 0x7fe60c131050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:05.605 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:05.606+0000 7fe612200640 1 -- 172.21.15.117:0/1622334199 >> 172.21.15.117:0/1622334199 conn(0x7fe60c06b470 msgr2=0x7fe60c0b2ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:56:05.605 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:05.606+0000 7fe612200640 1 -- 172.21.15.117:0/1622334199 shutdown_connections 2024-04-04T06:56:05.605 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:05.606+0000 7fe612200640 1 -- 172.21.15.117:0/1622334199 wait complete. 2024-04-04T06:56:05.623 DEBUG:teuthology.orchestra.run.smithi117:> sudo ceph --cluster ceph osd new 1b3f7ab2-a56c-488d-a89a-1f3572361c95 1 2024-04-04T06:56:05.624 INFO:tasks.ceph.mgr.x.smithi117.stderr:2024-04-04T06:56:05.625+0000 7f088ce45040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-04T06:56:05.660 INFO:tasks.ceph.mgr.y.smithi072.stderr:2024-04-04T06:56:05.662+0000 7fa15020d040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-04T06:56:05.689 INFO:tasks.ceph.mgr.x.smithi117.stderr:2024-04-04T06:56:05.691+0000 7f088ce45040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-04T06:56:05.709 INFO:tasks.ceph.mgr.y.smithi072.stderr:2024-04-04T06:56:05.711+0000 7fa15020d040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-04T06:56:05.769 INFO:tasks.ceph.mgr.y.smithi072.stderr:2024-04-04T06:56:05.771+0000 7fa15020d040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-04T06:56:05.814 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:05.815+0000 7f505e400640 1 Processor -- start 2024-04-04T06:56:05.814 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:05.815+0000 7f505e400640 1 -- start start 2024-04-04T06:56:05.816 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:05.816+0000 7f505e400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f50580ae760 0x7f50580aefd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:05.816 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:05.817+0000 7f505e400640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f505806e9e0 con 0x7f50580ad870 2024-04-04T06:56:05.816 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:05.817+0000 7f505e400640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50580b3d70 con 0x7f505815e270 2024-04-04T06:56:05.816 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:05.817+0000 7f505e400640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f505806ec60 con 0x7f50580ae760 2024-04-04T06:56:05.816 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:05.817+0000 7f5057e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f50580ae760 0x7f50580aefd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:05.816 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:05.817+0000 7f505d000640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f505815e270 0x7f50580b3660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:50216/0 (socket says 172.21.15.117:50216) 2024-04-04T06:56:05.816 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:05.817+0000 7f505d000640 1 -- 172.21.15.117:0/324606389 learned_addr learned my addr 172.21.15.117:0/324606389 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-04-04T06:56:05.816 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:05.817+0000 7f5057e00640 1 -- 172.21.15.117:0/324606389 >> v1:172.21.15.117:6789/0 conn(0x7f505815e270 legacy=0x7f50580b3660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:05.816 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:05.817+0000 7f5057e00640 1 -- 172.21.15.117:0/324606389 >> v1:172.21.15.72:6789/0 conn(0x7f50580ad870 legacy=0x7f505806fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:56:05.817 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:05.817+0000 7f5057e00640 1 -- 172.21.15.117:0/324606389 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f505806ef40 con 0x7f50580ae760 2024-04-04T06:56:05.817 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:05.817+0000 7f5057400640 1 -- 172.21.15.117:0/324606389 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3258639688 0 0) 0x7f50580b3d70 con 0x7f505815e270 2024-04-04T06:56:05.817 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:05.818+0000 7f5057e00640 1 --2- 172.21.15.117:0/324606389 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f50580ae760 0x7f50580aefd0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f50440097d0 tx=0x7f504402b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f357bc71bcce9ab3 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:05.817 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:05.819+0000 7f5057400640 1 -- 172.21.15.117:0/324606389 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5044035020 con 0x7f50580ae760 2024-04-04T06:56:05.817 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:05.819+0000 7f5057400640 1 -- 172.21.15.117:0/324606389 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5044031800 con 0x7f50580ae760 2024-04-04T06:56:05.818 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:05.819+0000 7f5057400640 1 -- 172.21.15.117:0/324606389 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5044031bd0 con 0x7f50580ae760 2024-04-04T06:56:05.818 INFO:tasks.ceph.mgr.y.smithi072.stderr:2024-04-04T06:56:05.819+0000 7fa15020d040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-04T06:56:05.819 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:05.819+0000 7f505e400640 1 -- 172.21.15.117:0/324606389 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f50580ae760 msgr2=0x7f50580aefd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:05.819 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:05.819+0000 7f505e400640 1 --2- 172.21.15.117:0/324606389 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f50580ae760 0x7f50580aefd0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f50440097d0 tx=0x7f504402b8a0 comp rx=0 tx=0).stop 2024-04-04T06:56:05.819 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:05.819+0000 7f505e400640 1 -- 172.21.15.117:0/324606389 shutdown_connections 2024-04-04T06:56:05.819 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:05.819+0000 7f505e400640 1 --2- 172.21.15.117:0/324606389 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f50580ae760 0x7f50580aefd0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:05.819 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:05.819+0000 7f505e400640 1 -- 172.21.15.117:0/324606389 >> 172.21.15.117:0/324606389 conn(0x7f50580b2360 msgr2=0x7f50580b2740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:56:05.819 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:05.819+0000 7f505e400640 1 -- 172.21.15.117:0/324606389 shutdown_connections 2024-04-04T06:56:05.819 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:05.819+0000 7f505e400640 1 -- 172.21.15.117:0/324606389 wait complete. 2024-04-04T06:56:05.820 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:05.821+0000 7f505e400640 1 Processor -- start 2024-04-04T06:56:05.820 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:05.821+0000 7f505e400640 1 -- start start 2024-04-04T06:56:05.821 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:05.822+0000 7f505e400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f50580ad870 0x7f5058145290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:05.821 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:05.822+0000 7f505e400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f50580ae760 0x7f5058148780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:05.821 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:05.822+0000 7f505e400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f505815e270 0x7f50580aec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:05.821 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:05.822+0000 7f505e400640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f505815e650 con 0x7f505815e270 2024-04-04T06:56:05.821 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:05.822+0000 7f505e400640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f505806f500 con 0x7f50580ad870 2024-04-04T06:56:05.821 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:05.822+0000 7f505e400640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f50580b5960 con 0x7f50580ae760 2024-04-04T06:56:05.821 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:05.822+0000 7f5057e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f50580ae760 0x7f5058148780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:05.821 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:05.822+0000 7f505d000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f50580ad870 0x7f5058145290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:05.822 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:05.822+0000 7f5057e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f50580ae760 0x7f5058148780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.117:59504/0 (socket says 172.21.15.117:59504) 2024-04-04T06:56:05.822 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:05.822+0000 7f5057e00640 1 -- 172.21.15.117:0/3464491043 learned_addr learned my addr 172.21.15.117:0/3464491043 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-04T06:56:05.823 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:05.823+0000 7f505da00640 1 --2- 172.21.15.117:0/3464491043 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f505815e270 0x7f50580aec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:05.823 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:05.823+0000 7f505d000640 1 -- 172.21.15.117:0/3464491043 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f50580ae760 msgr2=0x7f5058148780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:05.823 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:05.823+0000 7f505d000640 1 --2- 172.21.15.117:0/3464491043 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f50580ae760 0x7f5058148780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:05.824 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:05.823+0000 7f505d000640 1 -- 172.21.15.117:0/3464491043 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f505815e270 msgr2=0x7f50580aec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:05.824 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:05.823+0000 7f505d000640 1 --2- 172.21.15.117:0/3464491043 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f505815e270 0x7f50580aec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:05.824 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:05.823+0000 7f505d000640 1 -- 172.21.15.117:0/3464491043 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5058155d10 con 0x7f50580ad870 2024-04-04T06:56:05.824 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:05.823+0000 7f505d000640 1 --2- 172.21.15.117:0/3464491043 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f50580ad870 0x7f5058145290 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f504c00c410 tx=0x7f504c00c8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:05.824 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:05.823+0000 7f5054c00640 1 -- 172.21.15.117:0/3464491043 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f504c0074e0 con 0x7f50580ad870 2024-04-04T06:56:05.824 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:05.824+0000 7f5054c00640 1 -- 172.21.15.117:0/3464491043 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f504c0047e0 con 0x7f50580ad870 2024-04-04T06:56:05.824 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:05.824+0000 7f505e400640 1 -- 172.21.15.117:0/3464491043 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5058148cc0 con 0x7f50580ad870 2024-04-04T06:56:05.824 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:05.824+0000 7f5054c00640 1 -- 172.21.15.117:0/3464491043 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f504c004bd0 con 0x7f50580ad870 2024-04-04T06:56:05.824 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:05.824+0000 7f505e400640 1 -- 172.21.15.117:0/3464491043 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50581553e0 con 0x7f50580ad870 2024-04-04T06:56:05.824 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:05.824+0000 7f5054c00640 1 -- 172.21.15.117:0/3464491043 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f504c011070 con 0x7f50580ad870 2024-04-04T06:56:05.824 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:05.824+0000 7f5054c00640 1 -- 172.21.15.117:0/3464491043 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7f504c013770 con 0x7f50580ad870 2024-04-04T06:56:05.824 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:05.825+0000 7f505e400640 1 -- 172.21.15.117:0/3464491043 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50580685a0 con 0x7f50580ad870 2024-04-04T06:56:05.825 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:05.827+0000 7f5054c00640 1 -- 172.21.15.117:0/3464491043 <== mon.1 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f504c004dc0 con 0x7f50580ad870 2024-04-04T06:56:05.904 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:05.905+0000 7f505e400640 1 -- 172.21.15.117:0/3464491043 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd new", "uuid": "1b3f7ab2-a56c-488d-a89a-1f3572361c95", "id": 1} v 0) -- 0x7f5058071f30 con 0x7f50580ad870 2024-04-04T06:56:05.912 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:05.913+0000 7f5054c00640 1 -- 172.21.15.117:0/3464491043 <== mon.1 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "1b3f7ab2-a56c-488d-a89a-1f3572361c95", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7f504c013970 con 0x7f50580ad870 2024-04-04T06:56:05.912 INFO:teuthology.orchestra.run.smithi117.stdout:1 2024-04-04T06:56:05.914 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:05.914+0000 7f505e400640 1 -- 172.21.15.117:0/3464491043 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f50580ad870 msgr2=0x7f5058145290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:05.915 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:05.914+0000 7f505e400640 1 --2- 172.21.15.117:0/3464491043 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f50580ad870 0x7f5058145290 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f504c00c410 tx=0x7f504c00c8d0 comp rx=0 tx=0).stop 2024-04-04T06:56:05.915 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:05.915+0000 7f505e400640 1 -- 172.21.15.117:0/3464491043 shutdown_connections 2024-04-04T06:56:05.915 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:05.915+0000 7f505e400640 1 --2- 172.21.15.117:0/3464491043 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f505815e270 0x7f50580aec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:05.915 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:05.915+0000 7f505e400640 1 --2- 172.21.15.117:0/3464491043 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f50580ae760 0x7f5058148780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:05.915 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:05.915+0000 7f505e400640 1 --2- 172.21.15.117:0/3464491043 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f50580ad870 0x7f5058145290 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:05.915 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:05.915+0000 7f505e400640 1 -- 172.21.15.117:0/3464491043 >> 172.21.15.117:0/3464491043 conn(0x7f50580b2360 msgr2=0x7f50580b0640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:56:05.915 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:05.915+0000 7f505e400640 1 -- 172.21.15.117:0/3464491043 shutdown_connections 2024-04-04T06:56:05.915 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:05.915+0000 7f505e400640 1 -- 172.21.15.117:0/3464491043 wait complete. 2024-04-04T06:56:05.929 DEBUG:teuthology.orchestra.run.smithi117:> sudo ceph --cluster ceph osd new fc9aa512-53df-40d7-ba04-3e6b7dcd1e34 2 2024-04-04T06:56:05.948 INFO:tasks.ceph.mgr.y.smithi072.stderr:2024-04-04T06:56:05.949+0000 7fa15020d040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-04T06:56:06.025 INFO:tasks.ceph.mgr.y.smithi072.stderr:2024-04-04T06:56:06.027+0000 7fa15020d040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-04T06:56:06.077 INFO:tasks.ceph.mgr.y.smithi072.stderr:2024-04-04T06:56:06.079+0000 7fa15020d040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-04T06:56:06.118 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.119+0000 7f615b400640 1 Processor -- start 2024-04-04T06:56:06.118 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.119+0000 7f615b400640 1 -- start start 2024-04-04T06:56:06.119 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.120+0000 7f615b400640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f615415e6c0 0x7f61540b6390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:06.119 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.121+0000 7f615b400640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61540d3100 con 0x7f61540b68d0 2024-04-04T06:56:06.119 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.121+0000 7f615b400640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61540d33e0 con 0x7f61540d2b20 2024-04-04T06:56:06.120 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.121+0000 7f615b400640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f615415eaa0 con 0x7f615415e6c0 2024-04-04T06:56:06.120 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.121+0000 7f6159400640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f61540d2b20 0x7f61540b7520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:50226/0 (socket says 172.21.15.117:50226) 2024-04-04T06:56:06.120 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.121+0000 7f6159400640 1 -- 172.21.15.117:0/3749470871 learned_addr learned my addr 172.21.15.117:0/3749470871 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-04-04T06:56:06.122 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.121+0000 7f6158a00640 1 --2- 172.21.15.117:0/3749470871 >> v2:172.21.15.72:3300/0 conn(0x7f615415e6c0 0x7f61540b6390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:06.122 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.121+0000 7f6153400640 1 -- 172.21.15.117:0/3749470871 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3506745881 0 0) 0x7f61540d33e0 con 0x7f61540d2b20 2024-04-04T06:56:06.122 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.121+0000 7f6153400640 1 -- 172.21.15.117:0/3749470871 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f613c003520 con 0x7f61540d2b20 2024-04-04T06:56:06.122 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.122+0000 7f6153400640 1 -- 172.21.15.117:0/3749470871 <== mon.1 v1:172.21.15.117:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 990094711 0 0) 0x7f613c003520 con 0x7f61540d2b20 2024-04-04T06:56:06.122 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.122+0000 7f6153400640 1 -- 172.21.15.117:0/3749470871 >> v2:172.21.15.72:3300/0 conn(0x7f615415e6c0 msgr2=0x7f61540b6390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:56:06.122 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.122+0000 7f6153400640 1 --2- 172.21.15.117:0/3749470871 >> v2:172.21.15.72:3300/0 conn(0x7f615415e6c0 0x7f61540b6390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:06.122 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.122+0000 7f6153400640 1 -- 172.21.15.117:0/3749470871 >> v1:172.21.15.72:6789/0 conn(0x7f61540b68d0 legacy=0x7f61540d2410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:06.122 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.122+0000 7f6153400640 1 -- 172.21.15.117:0/3749470871 --> v1:172.21.15.117:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61540d36c0 con 0x7f61540d2b20 2024-04-04T06:56:06.122 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.122+0000 7f6153400640 1 -- 172.21.15.117:0/3749470871 <== mon.1 v1:172.21.15.117:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2465650867 0 0) 0x7f614c0019f0 con 0x7f61540d2b20 2024-04-04T06:56:06.123 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.122+0000 7f6153400640 1 -- 172.21.15.117:0/3749470871 >> v1:172.21.15.117:6789/0 conn(0x7f61540d2b20 legacy=0x7f61540b7520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:06.123 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.122+0000 7f6153400640 1 --2- 172.21.15.117:0/3749470871 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f613c003a00 0x7f613c003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:06.123 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.122+0000 7f6153400640 1 --2- 172.21.15.117:0/3749470871 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f613c004800 0x7f613c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:06.123 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.122+0000 7f6153400640 1 --2- 172.21.15.117:0/3749470871 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f613c0051c0 0x7f613c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:06.123 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.122+0000 7f6153400640 1 -- 172.21.15.117:0/3749470871 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f615415eaa0 con 0x7f613c0051c0 2024-04-04T06:56:06.123 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.122+0000 7f6153400640 1 -- 172.21.15.117:0/3749470871 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f613c00c0c0 con 0x7f613c003a00 2024-04-04T06:56:06.123 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.122+0000 7f6153400640 1 -- 172.21.15.117:0/3749470871 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f613c00c2c0 con 0x7f613c004800 2024-04-04T06:56:06.123 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.122+0000 7f6158a00640 1 --2- 172.21.15.117:0/3749470871 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f613c003a00 0x7f613c003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:06.123 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.122+0000 7f6153e00640 1 --2- 172.21.15.117:0/3749470871 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f613c004800 0x7f613c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:06.123 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.122+0000 7f6159400640 1 --2- 172.21.15.117:0/3749470871 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f613c0051c0 0x7f613c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:06.123 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.123+0000 7f6158a00640 1 -- 172.21.15.117:0/3749470871 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f613c004800 msgr2=0x7f613c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:56:06.123 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.123+0000 7f6158a00640 1 --2- 172.21.15.117:0/3749470871 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f613c004800 0x7f613c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:06.123 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.123+0000 7f6158a00640 1 -- 172.21.15.117:0/3749470871 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f613c0051c0 msgr2=0x7f613c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:56:06.123 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.123+0000 7f6158a00640 1 --2- 172.21.15.117:0/3749470871 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f613c0051c0 0x7f613c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:06.124 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.123+0000 7f6158a00640 1 -- 172.21.15.117:0/3749470871 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f613c003520 con 0x7f613c003a00 2024-04-04T06:56:06.124 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.123+0000 7f6159400640 1 -- 172.21.15.117:0/3749470871 reap_dead start 2024-04-04T06:56:06.125 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.124+0000 7f6158a00640 1 --2- 172.21.15.117:0/3749470871 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f613c003a00 0x7f613c003e20 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f6148009ac0 tx=0x7f613c005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fc6d553dea3d32fc server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:06.125 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.124+0000 7f6153400640 1 -- 172.21.15.117:0/3749470871 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6148039070 con 0x7f613c003a00 2024-04-04T06:56:06.125 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.124+0000 7f6153400640 1 -- 172.21.15.117:0/3749470871 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f614802c6b0 con 0x7f613c003a00 2024-04-04T06:56:06.125 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.124+0000 7f6153400640 1 -- 172.21.15.117:0/3749470871 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6148009690 con 0x7f613c003a00 2024-04-04T06:56:06.125 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.124+0000 7f615b400640 1 -- 172.21.15.117:0/3749470871 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f613c003a00 msgr2=0x7f613c003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:06.125 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.124+0000 7f615b400640 1 --2- 172.21.15.117:0/3749470871 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f613c003a00 0x7f613c003e20 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f6148009ac0 tx=0x7f613c005830 comp rx=0 tx=0).stop 2024-04-04T06:56:06.125 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.125+0000 7f615b400640 1 -- 172.21.15.117:0/3749470871 shutdown_connections 2024-04-04T06:56:06.125 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.125+0000 7f615b400640 1 --2- 172.21.15.117:0/3749470871 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f613c003a00 0x7f613c003e20 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:06.125 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.125+0000 7f615b400640 1 -- 172.21.15.117:0/3749470871 >> 172.21.15.117:0/3749470871 conn(0x7f6154071e80 msgr2=0x7f6154072290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:56:06.126 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.125+0000 7f615b400640 1 -- 172.21.15.117:0/3749470871 shutdown_connections 2024-04-04T06:56:06.126 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.125+0000 7f615b400640 1 -- 172.21.15.117:0/3749470871 wait complete. 2024-04-04T06:56:06.126 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.126+0000 7f615b400640 1 Processor -- start 2024-04-04T06:56:06.126 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.126+0000 7f615b400640 1 -- start start 2024-04-04T06:56:06.128 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.127+0000 7f615b400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f613c003a00 0x7f61540cddc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:06.128 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.127+0000 7f615b400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6154154c80 0x7f6154150e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:06.128 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.127+0000 7f615b400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6154160c70 0x7f61541610f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:06.128 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.127+0000 7f615b400640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f61540b6390 con 0x7f613c003a00 2024-04-04T06:56:06.128 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.127+0000 7f615b400640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f61540d3c80 con 0x7f6154160c70 2024-04-04T06:56:06.128 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.127+0000 7f615b400640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f61540b6510 con 0x7f6154154c80 2024-04-04T06:56:06.128 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.127+0000 7f6153e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6154154c80 0x7f6154150e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:06.128 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.128+0000 7f6159400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6154160c70 0x7f61541610f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:06.128 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.128+0000 7f6153e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6154154c80 0x7f6154150e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.117:59518/0 (socket says 172.21.15.117:59518) 2024-04-04T06:56:06.128 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.128+0000 7f6153e00640 1 -- 172.21.15.117:0/1117605420 learned_addr learned my addr 172.21.15.117:0/1117605420 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-04T06:56:06.128 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.128+0000 7f6158a00640 1 --2- 172.21.15.117:0/1117605420 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f613c003a00 0x7f61540cddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:06.129 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.128+0000 7f6153e00640 1 -- 172.21.15.117:0/1117605420 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6154160c70 msgr2=0x7f61541610f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:06.129 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.128+0000 7f6153e00640 1 --2- 172.21.15.117:0/1117605420 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6154160c70 0x7f61541610f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:06.129 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.128+0000 7f6153e00640 1 -- 172.21.15.117:0/1117605420 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f613c003a00 msgr2=0x7f61540cddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:06.129 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.128+0000 7f6153e00640 1 --2- 172.21.15.117:0/1117605420 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f613c003a00 0x7f61540cddc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:06.129 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.128+0000 7f6153e00640 1 -- 172.21.15.117:0/1117605420 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61541553d0 con 0x7f6154154c80 2024-04-04T06:56:06.129 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.128+0000 7f6153e00640 1 --2- 172.21.15.117:0/1117605420 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6154154c80 0x7f6154150e70 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f614000f570 tx=0x7f614000fa30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:06.129 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.128+0000 7f6150c00640 1 -- 172.21.15.117:0/1117605420 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61400052e0 con 0x7f6154154c80 2024-04-04T06:56:06.129 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.128+0000 7f6150c00640 1 -- 172.21.15.117:0/1117605420 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6140018070 con 0x7f6154154c80 2024-04-04T06:56:06.129 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.128+0000 7f6150c00640 1 -- 172.21.15.117:0/1117605420 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6140003830 con 0x7f6154154c80 2024-04-04T06:56:06.129 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.129+0000 7f615b400640 1 -- 172.21.15.117:0/1117605420 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6154155100 con 0x7f6154154c80 2024-04-04T06:56:06.129 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.129+0000 7f615b400640 1 -- 172.21.15.117:0/1117605420 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f6154153f70 con 0x7f6154154c80 2024-04-04T06:56:06.129 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.129+0000 7f6150c00640 1 -- 172.21.15.117:0/1117605420 <== mon.2 v2:172.21.15.117:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f61400039d0 con 0x7f6154154c80 2024-04-04T06:56:06.129 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.129+0000 7f6150c00640 1 -- 172.21.15.117:0/1117605420 <== mon.2 v2:172.21.15.117:3301/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7f6140003cc0 con 0x7f6154154c80 2024-04-04T06:56:06.130 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.130+0000 7f615b400640 1 -- 172.21.15.117:0/1117605420 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6154075730 con 0x7f6154154c80 2024-04-04T06:56:06.131 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.133+0000 7f6150c00640 1 -- 172.21.15.117:0/1117605420 <== mon.2 v2:172.21.15.117:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f614001d460 con 0x7f6154154c80 2024-04-04T06:56:06.137 INFO:tasks.ceph.mgr.y.smithi072.stderr:2024-04-04T06:56:06.138+0000 7fa15020d040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-04T06:56:06.191 INFO:tasks.ceph.mgr.y.smithi072.stderr:2024-04-04T06:56:06.192+0000 7fa15020d040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-04T06:56:06.210 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.211+0000 7f615b400640 1 -- 172.21.15.117:0/1117605420 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "osd new", "uuid": "fc9aa512-53df-40d7-ba04-3e6b7dcd1e34", "id": 2} v 0) -- 0x7f61540cac50 con 0x7f6154154c80 2024-04-04T06:56:06.217 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.218+0000 7f6150c00640 1 -- 172.21.15.117:0/1117605420 <== mon.2 v2:172.21.15.117:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "fc9aa512-53df-40d7-ba04-3e6b7dcd1e34", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7f614001d720 con 0x7f6154154c80 2024-04-04T06:56:06.217 INFO:teuthology.orchestra.run.smithi117.stdout:2 2024-04-04T06:56:06.219 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.220+0000 7f615b400640 1 -- 172.21.15.117:0/1117605420 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6154154c80 msgr2=0x7f6154150e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:06.219 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.220+0000 7f615b400640 1 --2- 172.21.15.117:0/1117605420 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6154154c80 0x7f6154150e70 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f614000f570 tx=0x7f614000fa30 comp rx=0 tx=0).stop 2024-04-04T06:56:06.219 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.220+0000 7f615b400640 1 -- 172.21.15.117:0/1117605420 shutdown_connections 2024-04-04T06:56:06.219 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.220+0000 7f615b400640 1 --2- 172.21.15.117:0/1117605420 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6154160c70 0x7f61541610f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:06.219 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.220+0000 7f615b400640 1 --2- 172.21.15.117:0/1117605420 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6154154c80 0x7f6154150e70 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:06.219 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.220+0000 7f615b400640 1 --2- 172.21.15.117:0/1117605420 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f613c003a00 0x7f61540cddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:06.219 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.220+0000 7f615b400640 1 -- 172.21.15.117:0/1117605420 >> 172.21.15.117:0/1117605420 conn(0x7f6154071e80 msgr2=0x7f615415d750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:56:06.219 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.220+0000 7f615b400640 1 -- 172.21.15.117:0/1117605420 shutdown_connections 2024-04-04T06:56:06.219 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.220+0000 7f615b400640 1 -- 172.21.15.117:0/1117605420 wait complete. 2024-04-04T06:56:06.236 DEBUG:teuthology.orchestra.run.smithi117:> sudo ceph --cluster ceph osd new b4f63eed-dc5b-4aba-bb50-de46eb41492b 3 2024-04-04T06:56:06.362 INFO:tasks.ceph.mgr.x.smithi117.stderr:2024-04-04T06:56:06.363+0000 7f088ce45040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-04T06:56:06.427 INFO:tasks.ceph.mgr.x.smithi117.stderr:2024-04-04T06:56:06.429+0000 7f088ce45040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-04T06:56:06.432 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.433+0000 7f436dc00640 1 Processor -- start 2024-04-04T06:56:06.432 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.433+0000 7f436dc00640 1 -- start start 2024-04-04T06:56:06.434 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.434+0000 7f436dc00640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f436815e670 0x7f43680d22e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:06.434 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.434+0000 7f436dc00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f43680ba010 0x7f43680cf030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:06.434 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.434+0000 7f436dc00640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43680b83a0 con 0x7f43680d2820 2024-04-04T06:56:06.434 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.434+0000 7f436dc00640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f43680d2cc0 con 0x7f436815e670 2024-04-04T06:56:06.434 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.434+0000 7f436dc00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f43680d2fa0 con 0x7f43680ba010 2024-04-04T06:56:06.434 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.435+0000 7f4366000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f43680ba010 0x7f43680cf030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:06.434 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.435+0000 7f4366000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f43680ba010 0x7f43680cf030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.117:59534/0 (socket says 172.21.15.117:59534) 2024-04-04T06:56:06.434 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.435+0000 7f4366000640 1 -- 172.21.15.117:0/2060462215 learned_addr learned my addr 172.21.15.117:0/2060462215 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-04T06:56:06.434 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.435+0000 7f4366a00640 1 --2- 172.21.15.117:0/2060462215 >> v2:172.21.15.72:3300/0 conn(0x7f436815e670 0x7f43680d22e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:06.435 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.435+0000 7f4366000640 1 -- 172.21.15.117:0/2060462215 >> v2:172.21.15.72:3300/0 conn(0x7f436815e670 msgr2=0x7f43680d22e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:56:06.435 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.435+0000 7f4366000640 1 --2- 172.21.15.117:0/2060462215 >> v2:172.21.15.72:3300/0 conn(0x7f436815e670 0x7f43680d22e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:06.435 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.435+0000 7f4366000640 1 -- 172.21.15.117:0/2060462215 >> v1:172.21.15.72:6789/0 conn(0x7f43680d2820 legacy=0x7f4368071a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:56:06.435 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.435+0000 7f4366000640 1 -- 172.21.15.117:0/2060462215 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43680d3280 con 0x7f43680ba010 2024-04-04T06:56:06.436 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.436+0000 7f4366000640 1 --2- 172.21.15.117:0/2060462215 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f43680ba010 0x7f43680cf030 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f4354009870 tx=0x7f435402b860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bb2d8d2eea6ca9c6 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:06.436 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.436+0000 7f4365600640 1 -- 172.21.15.117:0/2060462215 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43540317c0 con 0x7f43680ba010 2024-04-04T06:56:06.436 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.436+0000 7f4365600640 1 -- 172.21.15.117:0/2060462215 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4354037070 con 0x7f43680ba010 2024-04-04T06:56:06.436 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.436+0000 7f4365600640 1 -- 172.21.15.117:0/2060462215 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4354031b80 con 0x7f43680ba010 2024-04-04T06:56:06.436 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.437+0000 7f436dc00640 1 -- 172.21.15.117:0/2060462215 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f43680ba010 msgr2=0x7f43680cf030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:06.436 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.437+0000 7f436dc00640 1 --2- 172.21.15.117:0/2060462215 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f43680ba010 0x7f43680cf030 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f4354009870 tx=0x7f435402b860 comp rx=0 tx=0).stop 2024-04-04T06:56:06.436 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.437+0000 7f436dc00640 1 -- 172.21.15.117:0/2060462215 shutdown_connections 2024-04-04T06:56:06.436 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.437+0000 7f436dc00640 1 --2- 172.21.15.117:0/2060462215 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f43680ba010 0x7f43680cf030 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:06.436 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.437+0000 7f436dc00640 1 --2- 172.21.15.117:0/2060462215 >> v2:172.21.15.72:3300/0 conn(0x7f436815e670 0x7f43680d22e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:06.437 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.437+0000 7f436dc00640 1 -- 172.21.15.117:0/2060462215 >> 172.21.15.117:0/2060462215 conn(0x7f436806baa0 msgr2=0x7f43680d0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:56:06.437 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.437+0000 7f436dc00640 1 -- 172.21.15.117:0/2060462215 shutdown_connections 2024-04-04T06:56:06.437 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.437+0000 7f436dc00640 1 -- 172.21.15.117:0/2060462215 wait complete. 2024-04-04T06:56:06.437 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.439+0000 7f436dc00640 1 Processor -- start 2024-04-04T06:56:06.437 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.439+0000 7f436dc00640 1 -- start start 2024-04-04T06:56:06.440 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.440+0000 7f436dc00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f43680d2820 0x7f4368153fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:06.440 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.440+0000 7f436dc00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f436815e670 0x7f4368158f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:06.440 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.440+0000 7f436dc00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4368154710 0x7f4368160630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:06.440 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.440+0000 7f436dc00640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f43680d3ee0 con 0x7f4368154710 2024-04-04T06:56:06.440 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.440+0000 7f436dc00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f43680d3d60 con 0x7f43680d2820 2024-04-04T06:56:06.440 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.440+0000 7f436dc00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f43680cf570 con 0x7f436815e670 2024-04-04T06:56:06.440 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.440+0000 7f4366a00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f43680d2820 0x7f4368153fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:06.440 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.440+0000 7f4366000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f436815e670 0x7f4368158f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:06.441 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.440+0000 7f4366a00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f43680d2820 0x7f4368153fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:58416/0 (socket says 172.21.15.117:58416) 2024-04-04T06:56:06.441 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.440+0000 7f4366a00640 1 -- 172.21.15.117:0/1221812671 learned_addr learned my addr 172.21.15.117:0/1221812671 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-04T06:56:06.441 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.440+0000 7f4367400640 1 --2- 172.21.15.117:0/1221812671 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4368154710 0x7f4368160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:06.441 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.440+0000 7f4366000640 1 -- 172.21.15.117:0/1221812671 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f43680d2820 msgr2=0x7f4368153fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:06.441 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.440+0000 7f4366000640 1 --2- 172.21.15.117:0/1221812671 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f43680d2820 0x7f4368153fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:06.441 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.440+0000 7f4366000640 1 -- 172.21.15.117:0/1221812671 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4368154710 msgr2=0x7f4368160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:06.441 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.440+0000 7f4366000640 1 --2- 172.21.15.117:0/1221812671 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4368154710 0x7f4368160630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:06.441 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.440+0000 7f4366000640 1 -- 172.21.15.117:0/1221812671 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43680c7e80 con 0x7f436815e670 2024-04-04T06:56:06.441 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.441+0000 7f4366000640 1 --2- 172.21.15.117:0/1221812671 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f436815e670 0x7f4368158f80 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f4354033000 tx=0x7f43540046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:06.441 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.441+0000 7f435ea00640 1 -- 172.21.15.117:0/1221812671 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4354032860 con 0x7f436815e670 2024-04-04T06:56:06.441 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.441+0000 7f435ea00640 1 -- 172.21.15.117:0/1221812671 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4354032a20 con 0x7f436815e670 2024-04-04T06:56:06.441 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.441+0000 7f435ea00640 1 -- 172.21.15.117:0/1221812671 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4354032e10 con 0x7f436815e670 2024-04-04T06:56:06.441 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.441+0000 7f436dc00640 1 -- 172.21.15.117:0/1221812671 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43680c8160 con 0x7f436815e670 2024-04-04T06:56:06.441 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.441+0000 7f436dc00640 1 -- 172.21.15.117:0/1221812671 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f43680c8720 con 0x7f436815e670 2024-04-04T06:56:06.441 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.441+0000 7f435ea00640 1 -- 172.21.15.117:0/1221812671 <== mon.2 v2:172.21.15.117:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f435404c060 con 0x7f436815e670 2024-04-04T06:56:06.441 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.441+0000 7f435ea00640 1 -- 172.21.15.117:0/1221812671 <== mon.2 v2:172.21.15.117:3301/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7f435404ec20 con 0x7f436815e670 2024-04-04T06:56:06.442 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.442+0000 7f436dc00640 1 -- 172.21.15.117:0/1221812671 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43680685a0 con 0x7f436815e670 2024-04-04T06:56:06.443 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.444+0000 7f435ea00640 1 -- 172.21.15.117:0/1221812671 <== mon.2 v2:172.21.15.117:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f4354040070 con 0x7f436815e670 2024-04-04T06:56:06.481 INFO:tasks.ceph.mgr.x.smithi117.stderr:2024-04-04T06:56:06.482+0000 7f088ce45040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-04T06:56:06.522 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.523+0000 7f436dc00640 1 -- 172.21.15.117:0/1221812671 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "osd new", "uuid": "b4f63eed-dc5b-4aba-bb50-de46eb41492b", "id": 3} v 0) -- 0x7f43680b3830 con 0x7f436815e670 2024-04-04T06:56:06.528 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.529+0000 7f435ea00640 1 -- 172.21.15.117:0/1221812671 <== mon.2 v2:172.21.15.117:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b4f63eed-dc5b-4aba-bb50-de46eb41492b", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7f435404e790 con 0x7f436815e670 2024-04-04T06:56:06.528 INFO:teuthology.orchestra.run.smithi117.stdout:3 2024-04-04T06:56:06.530 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.531+0000 7f436dc00640 1 -- 172.21.15.117:0/1221812671 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f436815e670 msgr2=0x7f4368158f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:06.530 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.531+0000 7f436dc00640 1 --2- 172.21.15.117:0/1221812671 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f436815e670 0x7f4368158f80 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f4354033000 tx=0x7f43540046c0 comp rx=0 tx=0).stop 2024-04-04T06:56:06.530 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.531+0000 7f436dc00640 1 -- 172.21.15.117:0/1221812671 shutdown_connections 2024-04-04T06:56:06.530 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.531+0000 7f436dc00640 1 --2- 172.21.15.117:0/1221812671 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4368154710 0x7f4368160630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:06.530 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.531+0000 7f436dc00640 1 --2- 172.21.15.117:0/1221812671 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f436815e670 0x7f4368158f80 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:06.530 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.531+0000 7f436dc00640 1 --2- 172.21.15.117:0/1221812671 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f43680d2820 0x7f4368153fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:06.530 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.531+0000 7f436dc00640 1 -- 172.21.15.117:0/1221812671 >> 172.21.15.117:0/1221812671 conn(0x7f436806baa0 msgr2=0x7f43680b3c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:56:06.530 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.531+0000 7f436dc00640 1 -- 172.21.15.117:0/1221812671 shutdown_connections 2024-04-04T06:56:06.530 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.531+0000 7f436dc00640 1 -- 172.21.15.117:0/1221812671 wait complete. 2024-04-04T06:56:06.545 DEBUG:teuthology.orchestra.run.smithi117:> sudo ceph --cluster ceph osd new 9e985ef8-d711-4172-9286-c54e560895d8 4 2024-04-04T06:56:06.545 INFO:tasks.ceph.mgr.x.smithi117.stderr:2024-04-04T06:56:06.547+0000 7f088ce45040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-04T06:56:06.598 INFO:tasks.ceph.mgr.x.smithi117.stderr:2024-04-04T06:56:06.599+0000 7f088ce45040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-04T06:56:06.640 INFO:tasks.ceph.mgr.y.smithi072.stderr:2024-04-04T06:56:06.642+0000 7fa15020d040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-04T06:56:06.722 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.723+0000 7f7835600640 1 Processor -- start 2024-04-04T06:56:06.722 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.723+0000 7f7835600640 1 -- start start 2024-04-04T06:56:06.723 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.725+0000 7f7835600640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f7830145b10 0x7f783006d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:06.724 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.725+0000 7f7835600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f78300d0110 0x7f7830071430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:06.724 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.725+0000 7f7835600640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7830145ef0 con 0x7f783006dac0 2024-04-04T06:56:06.724 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.725+0000 7f7835600640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f78300cea10 con 0x7f7830145b10 2024-04-04T06:56:06.724 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.725+0000 7f7835600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f783006e310 con 0x7f78300d0110 2024-04-04T06:56:06.724 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.725+0000 7f782e000640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f783006dac0 0x7f78300cfa00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:50238/0 (socket says 172.21.15.117:50238) 2024-04-04T06:56:06.724 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.725+0000 7f782e000640 1 -- 172.21.15.117:0/1304888102 learned_addr learned my addr 172.21.15.117:0/1304888102 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-04-04T06:56:06.724 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.725+0000 7f782f400640 1 --2- 172.21.15.117:0/1304888102 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f78300d0110 0x7f7830071430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:06.725 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.725+0000 7f782ea00640 1 --2- 172.21.15.117:0/1304888102 >> v2:172.21.15.72:3300/0 conn(0x7f7830145b10 0x7f783006d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:06.725 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.726+0000 7f782d600640 1 -- 172.21.15.117:0/1304888102 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3187461796 0 0) 0x7f7830145ef0 con 0x7f783006dac0 2024-04-04T06:56:06.725 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.726+0000 7f782d600640 1 -- 172.21.15.117:0/1304888102 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7814003520 con 0x7f783006dac0 2024-04-04T06:56:06.725 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.726+0000 7f782f400640 1 -- 172.21.15.117:0/1304888102 >> v2:172.21.15.72:3300/0 conn(0x7f7830145b10 msgr2=0x7f783006d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:56:06.725 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.726+0000 7f782f400640 1 --2- 172.21.15.117:0/1304888102 >> v2:172.21.15.72:3300/0 conn(0x7f7830145b10 0x7f783006d580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:06.725 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.726+0000 7f782f400640 1 -- 172.21.15.117:0/1304888102 >> v1:172.21.15.117:6789/0 conn(0x7f783006dac0 legacy=0x7f78300cfa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:06.725 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.726+0000 7f782f400640 1 -- 172.21.15.117:0/1304888102 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78300cec40 con 0x7f78300d0110 2024-04-04T06:56:06.725 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.726+0000 7f782ea00640 1 --2- 172.21.15.117:0/1304888102 >> v2:172.21.15.72:3300/0 conn(0x7f7830145b10 0x7f783006d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-04T06:56:06.726 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.727+0000 7f782f400640 1 --2- 172.21.15.117:0/1304888102 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f78300d0110 0x7f7830071430 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f783006e490 tx=0x7f782802be00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f0994ccdfea1667a server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:06.726 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.728+0000 7f782d600640 1 -- 172.21.15.117:0/1304888102 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7828039070 con 0x7f78300d0110 2024-04-04T06:56:06.726 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.728+0000 7f782d600640 1 -- 172.21.15.117:0/1304888102 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f782802cbb0 con 0x7f78300d0110 2024-04-04T06:56:06.726 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.728+0000 7f782d600640 1 -- 172.21.15.117:0/1304888102 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7828034440 con 0x7f78300d0110 2024-04-04T06:56:06.727 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.728+0000 7f7835600640 1 -- 172.21.15.117:0/1304888102 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f78300d0110 msgr2=0x7f7830071430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:06.727 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.728+0000 7f7835600640 1 --2- 172.21.15.117:0/1304888102 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f78300d0110 0x7f7830071430 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f783006e490 tx=0x7f782802be00 comp rx=0 tx=0).stop 2024-04-04T06:56:06.727 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.728+0000 7f7835600640 1 -- 172.21.15.117:0/1304888102 shutdown_connections 2024-04-04T06:56:06.727 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.728+0000 7f7835600640 1 --2- 172.21.15.117:0/1304888102 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f78300d0110 0x7f7830071430 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:06.728 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.728+0000 7f7835600640 1 --2- 172.21.15.117:0/1304888102 >> v2:172.21.15.72:3300/0 conn(0x7f7830145b10 0x7f783006d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:06.728 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.728+0000 7f7835600640 1 -- 172.21.15.117:0/1304888102 >> 172.21.15.117:0/1304888102 conn(0x7f783006b470 msgr2=0x7f783006b850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:56:06.728 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.728+0000 7f7835600640 1 -- 172.21.15.117:0/1304888102 shutdown_connections 2024-04-04T06:56:06.728 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.728+0000 7f7835600640 1 -- 172.21.15.117:0/1304888102 wait complete. 2024-04-04T06:56:06.728 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.730+0000 7f7835600640 1 Processor -- start 2024-04-04T06:56:06.729 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.730+0000 7f7835600640 1 -- start start 2024-04-04T06:56:06.731 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.731+0000 7f7835600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f783006dac0 0x7f7830159c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:06.731 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.731+0000 7f7835600640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f78300d0110 0x7f78301e6900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:06.731 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.731+0000 7f7835600640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7830145b10 0x7f78301e6e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:06.731 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.731+0000 7f7835600640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f78300cf4e0 con 0x7f78300d0110 2024-04-04T06:56:06.731 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.731+0000 7f7835600640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f78300cf200 con 0x7f7830145b10 2024-04-04T06:56:06.731 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.731+0000 7f7835600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f783006df70 con 0x7f783006dac0 2024-04-04T06:56:06.731 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.731+0000 7f782ea00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f783006dac0 0x7f7830159c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:06.731 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.731+0000 7f782ea00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f783006dac0 0x7f7830159c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.117:59552/0 (socket says 172.21.15.117:59552) 2024-04-04T06:56:06.731 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.731+0000 7f782ea00640 1 -- 172.21.15.117:0/491698031 learned_addr learned my addr 172.21.15.117:0/491698031 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-04T06:56:06.732 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.731+0000 7f782f400640 1 --2- 172.21.15.117:0/491698031 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7830145b10 0x7f78301e6e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:06.732 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.732+0000 7f782e000640 1 --2- 172.21.15.117:0/491698031 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f78300d0110 0x7f78301e6900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:06.732 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.732+0000 7f782ea00640 1 -- 172.21.15.117:0/491698031 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7830145b10 msgr2=0x7f78301e6e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:06.732 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.732+0000 7f782ea00640 1 --2- 172.21.15.117:0/491698031 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7830145b10 0x7f78301e6e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:06.732 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.732+0000 7f782ea00640 1 -- 172.21.15.117:0/491698031 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f78300d0110 msgr2=0x7f78301e6900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:06.732 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.732+0000 7f782ea00640 1 --2- 172.21.15.117:0/491698031 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f78300d0110 0x7f78301e6900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:06.732 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.732+0000 7f782ea00640 1 -- 172.21.15.117:0/491698031 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78300b14e0 con 0x7f783006dac0 2024-04-04T06:56:06.732 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.732+0000 7f782e000640 1 --2- 172.21.15.117:0/491698031 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f78300d0110 0x7f78301e6900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-04T06:56:06.732 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.732+0000 7f782ea00640 1 --2- 172.21.15.117:0/491698031 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f783006dac0 0x7f7830159c90 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f782000d7d0 tx=0x7f782000dc90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:06.732 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.732+0000 7f7826a00640 1 -- 172.21.15.117:0/491698031 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7820004030 con 0x7f783006dac0 2024-04-04T06:56:06.732 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.732+0000 7f7826a00640 1 -- 172.21.15.117:0/491698031 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78200041d0 con 0x7f783006dac0 2024-04-04T06:56:06.732 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.732+0000 7f7835600640 1 -- 172.21.15.117:0/491698031 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78301e4bf0 con 0x7f783006dac0 2024-04-04T06:56:06.732 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.732+0000 7f7826a00640 1 -- 172.21.15.117:0/491698031 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78200096a0 con 0x7f783006dac0 2024-04-04T06:56:06.732 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.732+0000 7f7835600640 1 -- 172.21.15.117:0/491698031 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f78301e51b0 con 0x7f783006dac0 2024-04-04T06:56:06.733 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.733+0000 7f7826a00640 1 -- 172.21.15.117:0/491698031 <== mon.2 v2:172.21.15.117:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f7820009840 con 0x7f783006dac0 2024-04-04T06:56:06.733 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.733+0000 7f7826a00640 1 -- 172.21.15.117:0/491698031 <== mon.2 v2:172.21.15.117:3301/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7f7820009b30 con 0x7f783006dac0 2024-04-04T06:56:06.733 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.734+0000 7f7835600640 1 -- 172.21.15.117:0/491698031 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7830144350 con 0x7f783006dac0 2024-04-04T06:56:06.734 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.736+0000 7f7826a00640 1 -- 172.21.15.117:0/491698031 <== mon.2 v2:172.21.15.117:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f7830144350 con 0x7f783006dac0 2024-04-04T06:56:06.736 INFO:tasks.ceph.mgr.x.smithi117.stderr:2024-04-04T06:56:06.737+0000 7f088ce45040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-04T06:56:06.798 INFO:tasks.ceph.mgr.y.smithi072.stderr:2024-04-04T06:56:06.800+0000 7fa15020d040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-04T06:56:06.813 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.814+0000 7f7835600640 1 -- 172.21.15.117:0/491698031 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "osd new", "uuid": "9e985ef8-d711-4172-9286-c54e560895d8", "id": 4} v 0) -- 0x7f7830144b80 con 0x7f783006dac0 2024-04-04T06:56:06.817 INFO:tasks.ceph.mgr.x.smithi117.stderr:2024-04-04T06:56:06.818+0000 7f088ce45040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-04T06:56:06.823 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.824+0000 7f7826a00640 1 -- 172.21.15.117:0/491698031 <== mon.2 v2:172.21.15.117:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "9e985ef8-d711-4172-9286-c54e560895d8", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7f7830144b80 con 0x7f783006dac0 2024-04-04T06:56:06.823 INFO:teuthology.orchestra.run.smithi117.stdout:4 2024-04-04T06:56:06.824 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.825+0000 7f7835600640 1 -- 172.21.15.117:0/491698031 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f783006dac0 msgr2=0x7f7830159c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:06.825 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.825+0000 7f7835600640 1 --2- 172.21.15.117:0/491698031 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f783006dac0 0x7f7830159c90 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f782000d7d0 tx=0x7f782000dc90 comp rx=0 tx=0).stop 2024-04-04T06:56:06.825 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.826+0000 7f7835600640 1 -- 172.21.15.117:0/491698031 shutdown_connections 2024-04-04T06:56:06.825 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.826+0000 7f7835600640 1 --2- 172.21.15.117:0/491698031 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7830145b10 0x7f78301e6e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:06.825 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.826+0000 7f7835600640 1 --2- 172.21.15.117:0/491698031 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f78300d0110 0x7f78301e6900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:06.825 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.826+0000 7f7835600640 1 --2- 172.21.15.117:0/491698031 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f783006dac0 0x7f7830159c90 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:06.825 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.826+0000 7f7835600640 1 -- 172.21.15.117:0/491698031 >> 172.21.15.117:0/491698031 conn(0x7f783006b470 msgr2=0x7f78300b4320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:56:06.825 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.826+0000 7f7835600640 1 -- 172.21.15.117:0/491698031 shutdown_connections 2024-04-04T06:56:06.825 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:06.826+0000 7f7835600640 1 -- 172.21.15.117:0/491698031 wait complete. 2024-04-04T06:56:06.840 DEBUG:teuthology.orchestra.run.smithi117:> sudo ceph --cluster ceph osd new 3e9f082b-8d7d-455f-8a96-66d0b4857125 5 2024-04-04T06:56:06.874 INFO:tasks.ceph.mgr.x.smithi117.stderr:2024-04-04T06:56:06.875+0000 7f088ce45040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-04T06:56:06.934 INFO:tasks.ceph.mgr.y.smithi072.stderr:2024-04-04T06:56:06.936+0000 7fa15020d040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-04T06:56:06.936 INFO:tasks.ceph.mgr.x.smithi117.stderr:2024-04-04T06:56:06.938+0000 7f088ce45040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-04T06:56:06.986 INFO:tasks.ceph.mgr.y.smithi072.stderr:2024-04-04T06:56:06.987+0000 7fa15020d040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-04T06:56:06.993 INFO:tasks.ceph.mgr.x.smithi117.stderr:2024-04-04T06:56:06.994+0000 7f088ce45040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-04T06:56:07.016 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.018+0000 7f57e3200640 1 Processor -- start 2024-04-04T06:56:07.017 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.018+0000 7f57e3200640 1 -- start start 2024-04-04T06:56:07.018 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.019+0000 7f57e3200640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f57dc15e7e0 0x7f57dc0c5c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:07.018 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.019+0000 7f57e3200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f57dc0744d0 0x7f57dc074940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:07.018 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.019+0000 7f57e3200640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f57dc0cf5d0 con 0x7f57dc0cf1f0 2024-04-04T06:56:07.019 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.019+0000 7f57e3200640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f57dc074e80 con 0x7f57dc15e7e0 2024-04-04T06:56:07.019 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.019+0000 7f57e3200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f57dc161e60 con 0x7f57dc0744d0 2024-04-04T06:56:07.019 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.020+0000 7f57e2800640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f57dc0744d0 0x7f57dc074940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:07.019 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.020+0000 7f57e1400640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f57dc15e7e0 0x7f57dc0c5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:07.019 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.020+0000 7f57e1400640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f57dc15e7e0 0x7f57dc0c5c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:58426/0 (socket says 172.21.15.117:58426) 2024-04-04T06:56:07.019 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.020+0000 7f57e2800640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f57dc0744d0 0x7f57dc074940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.117:59554/0 (socket says 172.21.15.117:59554) 2024-04-04T06:56:07.019 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.020+0000 7f57e1400640 1 -- 172.21.15.117:0/945412245 learned_addr learned my addr 172.21.15.117:0/945412245 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-04T06:56:07.019 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.020+0000 7f57e1400640 1 -- 172.21.15.117:0/945412245 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f57dc0744d0 msgr2=0x7f57dc074940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:56:07.020 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.020+0000 7f57e1400640 1 --2- 172.21.15.117:0/945412245 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f57dc0744d0 0x7f57dc074940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:07.020 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.020+0000 7f57e1400640 1 -- 172.21.15.117:0/945412245 >> v1:172.21.15.72:6789/0 conn(0x7f57dc0cf1f0 legacy=0x7f57dc0c76b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:07.020 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.020+0000 7f57e1400640 1 -- 172.21.15.117:0/945412245 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57dc15edf0 con 0x7f57dc15e7e0 2024-04-04T06:56:07.020 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.021+0000 7f57e1400640 1 --2- 172.21.15.117:0/945412245 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f57dc15e7e0 0x7f57dc0c5c60 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f57cc009870 tx=0x7f57cc02b8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6d1e13eaeee4bb1a server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:07.021 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.021+0000 7f57e0a00640 1 -- 172.21.15.117:0/945412245 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57cc035020 con 0x7f57dc15e7e0 2024-04-04T06:56:07.021 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.021+0000 7f57e0a00640 1 -- 172.21.15.117:0/945412245 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57cc031640 con 0x7f57dc15e7e0 2024-04-04T06:56:07.021 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.021+0000 7f57e0a00640 1 -- 172.21.15.117:0/945412245 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57cc02d040 con 0x7f57dc15e7e0 2024-04-04T06:56:07.021 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.022+0000 7f57e3200640 1 -- 172.21.15.117:0/945412245 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f57dc15e7e0 msgr2=0x7f57dc0c5c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:07.021 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.022+0000 7f57e3200640 1 --2- 172.21.15.117:0/945412245 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f57dc15e7e0 0x7f57dc0c5c60 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f57cc009870 tx=0x7f57cc02b8f0 comp rx=0 tx=0).stop 2024-04-04T06:56:07.021 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.022+0000 7f57e3200640 1 -- 172.21.15.117:0/945412245 shutdown_connections 2024-04-04T06:56:07.021 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.022+0000 7f57e3200640 1 --2- 172.21.15.117:0/945412245 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f57dc0744d0 0x7f57dc074940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:07.021 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.022+0000 7f57e3200640 1 --2- 172.21.15.117:0/945412245 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f57dc15e7e0 0x7f57dc0c5c60 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:07.021 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.022+0000 7f57e3200640 1 -- 172.21.15.117:0/945412245 >> 172.21.15.117:0/945412245 conn(0x7f57dc0cd840 msgr2=0x7f57dc0cdc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:56:07.022 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.022+0000 7f57e3200640 1 -- 172.21.15.117:0/945412245 shutdown_connections 2024-04-04T06:56:07.022 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.022+0000 7f57e3200640 1 -- 172.21.15.117:0/945412245 wait complete. 2024-04-04T06:56:07.022 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.024+0000 7f57e3200640 1 Processor -- start 2024-04-04T06:56:07.023 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.024+0000 7f57e3200640 1 -- start start 2024-04-04T06:56:07.024 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.025+0000 7f57e3200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f57dc0744d0 0x7f57dc0add40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:07.024 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.025+0000 7f57e3200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f57dc0cf1f0 0x7f57dc161220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:07.024 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.025+0000 7f57e3200640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f57dc15e7e0 0x7f57dc146700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:07.024 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.025+0000 7f57e3200640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f57dc15f690 con 0x7f57dc15e7e0 2024-04-04T06:56:07.024 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.025+0000 7f57e3200640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f57dc15f3b0 con 0x7f57dc0744d0 2024-04-04T06:56:07.024 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.025+0000 7f57e3200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f57dc0c61a0 con 0x7f57dc0cf1f0 2024-04-04T06:56:07.024 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.025+0000 7f57e1400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f57dc0cf1f0 0x7f57dc161220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:07.024 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.025+0000 7f57e1400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f57dc0cf1f0 0x7f57dc161220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.117:59560/0 (socket says 172.21.15.117:59560) 2024-04-04T06:56:07.024 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.025+0000 7f57e1400640 1 -- 172.21.15.117:0/3701271233 learned_addr learned my addr 172.21.15.117:0/3701271233 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-04T06:56:07.024 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.025+0000 7f57e1e00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f57dc0744d0 0x7f57dc0add40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:07.025 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.025+0000 7f57e2800640 1 --2- 172.21.15.117:0/3701271233 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f57dc15e7e0 0x7f57dc146700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:07.026 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.026+0000 7f57e1400640 1 -- 172.21.15.117:0/3701271233 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f57dc0744d0 msgr2=0x7f57dc0add40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:07.026 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.026+0000 7f57e1400640 1 --2- 172.21.15.117:0/3701271233 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f57dc0744d0 0x7f57dc0add40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:07.026 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.026+0000 7f57e1400640 1 -- 172.21.15.117:0/3701271233 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f57dc15e7e0 msgr2=0x7f57dc146700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:07.026 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.026+0000 7f57e1400640 1 --2- 172.21.15.117:0/3701271233 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f57dc15e7e0 0x7f57dc146700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:07.026 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.026+0000 7f57e1400640 1 -- 172.21.15.117:0/3701271233 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57dc15b450 con 0x7f57dc0cf1f0 2024-04-04T06:56:07.026 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.026+0000 7f57e2800640 1 --2- 172.21.15.117:0/3701271233 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f57dc15e7e0 0x7f57dc146700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-04T06:56:07.026 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.026+0000 7f57e1400640 1 --2- 172.21.15.117:0/3701271233 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f57dc0cf1f0 0x7f57dc161220 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f57cc000c00 tx=0x7f57cc0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:07.026 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.026+0000 7f57d6000640 1 -- 172.21.15.117:0/3701271233 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57cc040070 con 0x7f57dc0cf1f0 2024-04-04T06:56:07.026 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.026+0000 7f57d6000640 1 -- 172.21.15.117:0/3701271233 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57cc0399f0 con 0x7f57dc0cf1f0 2024-04-04T06:56:07.026 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.026+0000 7f57e3200640 1 -- 172.21.15.117:0/3701271233 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57dc15b730 con 0x7f57dc0cf1f0 2024-04-04T06:56:07.026 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.026+0000 7f57d6000640 1 -- 172.21.15.117:0/3701271233 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57cc035040 con 0x7f57dc0cf1f0 2024-04-04T06:56:07.026 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.026+0000 7f57e3200640 1 -- 172.21.15.117:0/3701271233 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f57dc146c40 con 0x7f57dc0cf1f0 2024-04-04T06:56:07.026 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.027+0000 7f57d6000640 1 -- 172.21.15.117:0/3701271233 <== mon.2 v2:172.21.15.117:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f57cc04b060 con 0x7f57dc0cf1f0 2024-04-04T06:56:07.026 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.027+0000 7f57d6000640 1 -- 172.21.15.117:0/3701271233 <== mon.2 v2:172.21.15.117:3301/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7f57cc03a9a0 con 0x7f57dc0cf1f0 2024-04-04T06:56:07.027 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.027+0000 7f57e3200640 1 -- 172.21.15.117:0/3701271233 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f57dc0685a0 con 0x7f57dc0cf1f0 2024-04-04T06:56:07.028 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.030+0000 7f57d6000640 1 -- 172.21.15.117:0/3701271233 <== mon.2 v2:172.21.15.117:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f57cc03ac80 con 0x7f57dc0cf1f0 2024-04-04T06:56:07.108 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.109+0000 7f57e3200640 1 -- 172.21.15.117:0/3701271233 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "osd new", "uuid": "3e9f082b-8d7d-455f-8a96-66d0b4857125", "id": 5} v 0) -- 0x7f57dc067a00 con 0x7f57dc0cf1f0 2024-04-04T06:56:07.112 INFO:tasks.ceph.mgr.y.smithi072.stderr:2024-04-04T06:56:07.114+0000 7fa15020d040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-04T06:56:07.119 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.120+0000 7f57d6000640 1 -- 172.21.15.117:0/3701271233 <== mon.2 v2:172.21.15.117:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "3e9f082b-8d7d-455f-8a96-66d0b4857125", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7f57cc03a420 con 0x7f57dc0cf1f0 2024-04-04T06:56:07.119 INFO:teuthology.orchestra.run.smithi117.stdout:5 2024-04-04T06:56:07.120 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.121+0000 7f57e3200640 1 -- 172.21.15.117:0/3701271233 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f57dc0cf1f0 msgr2=0x7f57dc161220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:07.120 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.121+0000 7f57e3200640 1 --2- 172.21.15.117:0/3701271233 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f57dc0cf1f0 0x7f57dc161220 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f57cc000c00 tx=0x7f57cc0046c0 comp rx=0 tx=0).stop 2024-04-04T06:56:07.121 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.121+0000 7f57e3200640 1 -- 172.21.15.117:0/3701271233 shutdown_connections 2024-04-04T06:56:07.121 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.121+0000 7f57e3200640 1 --2- 172.21.15.117:0/3701271233 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f57dc15e7e0 0x7f57dc146700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:07.121 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.121+0000 7f57e3200640 1 --2- 172.21.15.117:0/3701271233 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f57dc0cf1f0 0x7f57dc161220 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:07.121 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.121+0000 7f57e3200640 1 --2- 172.21.15.117:0/3701271233 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f57dc0744d0 0x7f57dc0add40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:07.121 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.121+0000 7f57e3200640 1 -- 172.21.15.117:0/3701271233 >> 172.21.15.117:0/3701271233 conn(0x7f57dc0cd840 msgr2=0x7f57dc0c7390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:56:07.121 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.122+0000 7f57e3200640 1 -- 172.21.15.117:0/3701271233 shutdown_connections 2024-04-04T06:56:07.121 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.122+0000 7f57e3200640 1 -- 172.21.15.117:0/3701271233 wait complete. 2024-04-04T06:56:07.137 DEBUG:teuthology.orchestra.run.smithi117:> sudo ceph --cluster ceph osd new bcdafa9f-a870-4398-a38d-ab7697676473 6 2024-04-04T06:56:07.220 INFO:tasks.ceph.mgr.y.smithi072.stderr:2024-04-04T06:56:07.222+0000 7fa15020d040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-04T06:56:07.371 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.372+0000 7fe2e5600640 1 Processor -- start 2024-04-04T06:56:07.371 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.372+0000 7fe2e5600640 1 -- start start 2024-04-04T06:56:07.373 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.373+0000 7fe2e5600640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe2e015c180 0x7fe2e00cf0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:07.373 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.373+0000 7fe2e5600640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fe2e00cf630 0x7fe2e015ed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:07.373 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.373+0000 7fe2e5600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe2e015f2a0 0x7fe2e00b2b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:07.373 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.374+0000 7fe2e5600640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7fe2e015fad0 con 0x7fe2e015c180 2024-04-04T06:56:07.373 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.374+0000 7fe2e5600640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fe2e0162b80 con 0x7fe2e00cf630 2024-04-04T06:56:07.373 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.374+0000 7fe2e5600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fe2e015c560 con 0x7fe2e015f2a0 2024-04-04T06:56:07.374 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.374+0000 7fe2e4c00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe2e015f2a0 0x7fe2e00b2b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:07.374 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.374+0000 7fe2df400640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fe2e00cf630 0x7fe2e015ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:07.374 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.374+0000 7fe2df400640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fe2e00cf630 0x7fe2e015ed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:58450/0 (socket says 172.21.15.117:58450) 2024-04-04T06:56:07.374 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.374+0000 7fe2df400640 1 -- 172.21.15.117:0/485332861 learned_addr learned my addr 172.21.15.117:0/485332861 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-04T06:56:07.374 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.374+0000 7fe2e4c00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe2e015f2a0 0x7fe2e00b2b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.117:59566/0 (socket says 172.21.15.117:59566) 2024-04-04T06:56:07.374 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.374+0000 7fe2dfe00640 1 --2- 172.21.15.117:0/485332861 >> v2:172.21.15.72:3300/0 conn(0x7fe2e015c180 0x7fe2e00cf0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:07.374 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.374+0000 7fe2df400640 1 -- 172.21.15.117:0/485332861 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe2e015f2a0 msgr2=0x7fe2e00b2b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:56:07.374 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.374+0000 7fe2df400640 1 --2- 172.21.15.117:0/485332861 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe2e015f2a0 0x7fe2e00b2b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:07.374 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.374+0000 7fe2df400640 1 -- 172.21.15.117:0/485332861 >> v2:172.21.15.72:3300/0 conn(0x7fe2e015c180 msgr2=0x7fe2e00cf0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:56:07.374 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.374+0000 7fe2df400640 1 --2- 172.21.15.117:0/485332861 >> v2:172.21.15.72:3300/0 conn(0x7fe2e015c180 0x7fe2e00cf0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:07.374 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.374+0000 7fe2df400640 1 -- 172.21.15.117:0/485332861 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2e0163010 con 0x7fe2e00cf630 2024-04-04T06:56:07.374 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.374+0000 7fe2e4c00640 1 --2- 172.21.15.117:0/485332861 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe2e015f2a0 0x7fe2e00b2b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-04T06:56:07.376 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.375+0000 7fe2df400640 1 --2- 172.21.15.117:0/485332861 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe2e00cf630 0x7fe2e015ed60 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fe2e00d0730 tx=0x7fe2cc02b880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=319e1e7ec15083e8 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:07.376 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.376+0000 7fe2dea00640 1 -- 172.21.15.117:0/485332861 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2cc02e070 con 0x7fe2e00cf630 2024-04-04T06:56:07.376 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.376+0000 7fe2dea00640 1 -- 172.21.15.117:0/485332861 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2cc037070 con 0x7fe2e00cf630 2024-04-04T06:56:07.376 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.376+0000 7fe2dea00640 1 -- 172.21.15.117:0/485332861 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2cc031a00 con 0x7fe2e00cf630 2024-04-04T06:56:07.376 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.376+0000 7fe2e5600640 1 -- 172.21.15.117:0/485332861 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe2e00cf630 msgr2=0x7fe2e015ed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:07.376 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.376+0000 7fe2e5600640 1 --2- 172.21.15.117:0/485332861 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe2e00cf630 0x7fe2e015ed60 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fe2e00d0730 tx=0x7fe2cc02b880 comp rx=0 tx=0).stop 2024-04-04T06:56:07.376 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.376+0000 7fe2e5600640 1 -- 172.21.15.117:0/485332861 shutdown_connections 2024-04-04T06:56:07.376 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.376+0000 7fe2e5600640 1 --2- 172.21.15.117:0/485332861 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe2e015f2a0 0x7fe2e00b2b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:07.376 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.376+0000 7fe2e5600640 1 --2- 172.21.15.117:0/485332861 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe2e00cf630 0x7fe2e015ed60 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:07.376 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.376+0000 7fe2e5600640 1 --2- 172.21.15.117:0/485332861 >> v2:172.21.15.72:3300/0 conn(0x7fe2e015c180 0x7fe2e00cf0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:07.377 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.376+0000 7fe2e5600640 1 -- 172.21.15.117:0/485332861 >> 172.21.15.117:0/485332861 conn(0x7fe2e006b890 msgr2=0x7fe2e006bca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:56:07.377 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.376+0000 7fe2e5600640 1 -- 172.21.15.117:0/485332861 shutdown_connections 2024-04-04T06:56:07.377 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.376+0000 7fe2e5600640 1 -- 172.21.15.117:0/485332861 wait complete. 2024-04-04T06:56:07.377 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.378+0000 7fe2e5600640 1 Processor -- start 2024-04-04T06:56:07.377 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.378+0000 7fe2e5600640 1 -- start start 2024-04-04T06:56:07.383 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.379+0000 7fe2e5600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe2e00cf630 0x7fe2e00c7250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:07.383 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.379+0000 7fe2e5600640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe2e015c180 0x7fe2e00cd5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:07.383 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.379+0000 7fe2e5600640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe2e015f2a0 0x7fe2e0156e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:07.384 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.379+0000 7fe2e5600640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fe2e0162810 con 0x7fe2e015f2a0 2024-04-04T06:56:07.384 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.379+0000 7fe2e5600640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fe2e0162530 con 0x7fe2e015c180 2024-04-04T06:56:07.384 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.379+0000 7fe2e5600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fe2e015f730 con 0x7fe2e00cf630 2024-04-04T06:56:07.384 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.379+0000 7fe2df400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe2e015c180 0x7fe2e00cd5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:07.384 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.379+0000 7fe2df400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe2e015c180 0x7fe2e00cd5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:58466/0 (socket says 172.21.15.117:58466) 2024-04-04T06:56:07.384 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.379+0000 7fe2df400640 1 -- 172.21.15.117:0/492348783 learned_addr learned my addr 172.21.15.117:0/492348783 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-04T06:56:07.384 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.379+0000 7fe2dfe00640 1 --2- 172.21.15.117:0/492348783 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe2e00cf630 0x7fe2e00c7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:07.384 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.380+0000 7fe2e4c00640 1 --2- 172.21.15.117:0/492348783 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe2e015f2a0 0x7fe2e0156e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:07.384 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.380+0000 7fe2dfe00640 1 -- 172.21.15.117:0/492348783 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe2e015c180 msgr2=0x7fe2e00cd5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:07.384 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.380+0000 7fe2dfe00640 1 --2- 172.21.15.117:0/492348783 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe2e015c180 0x7fe2e00cd5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:07.384 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.380+0000 7fe2dfe00640 1 -- 172.21.15.117:0/492348783 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe2e015f2a0 msgr2=0x7fe2e0156e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:07.384 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.380+0000 7fe2dfe00640 1 --2- 172.21.15.117:0/492348783 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe2e015f2a0 0x7fe2e0156e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:07.384 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.380+0000 7fe2dfe00640 1 -- 172.21.15.117:0/492348783 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2e00cdb20 con 0x7fe2e00cf630 2024-04-04T06:56:07.385 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.380+0000 7fe2df400640 1 --2- 172.21.15.117:0/492348783 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe2e015c180 0x7fe2e00cd5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-04T06:56:07.385 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.380+0000 7fe2dfe00640 1 --2- 172.21.15.117:0/492348783 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe2e00cf630 0x7fe2e00c7250 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fe2d000d550 tx=0x7fe2d000da10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:07.385 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.380+0000 7fe2d7e00640 1 -- 172.21.15.117:0/492348783 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2d0018020 con 0x7fe2e00cf630 2024-04-04T06:56:07.385 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.381+0000 7fe2d7e00640 1 -- 172.21.15.117:0/492348783 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2d0014620 con 0x7fe2e00cf630 2024-04-04T06:56:07.385 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.381+0000 7fe2d7e00640 1 -- 172.21.15.117:0/492348783 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2d0014a10 con 0x7fe2e00cf630 2024-04-04T06:56:07.385 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.381+0000 7fe2e5600640 1 -- 172.21.15.117:0/492348783 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2e00cc540 con 0x7fe2e00cf630 2024-04-04T06:56:07.385 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.381+0000 7fe2e5600640 1 -- 172.21.15.117:0/492348783 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2e00ccb00 con 0x7fe2e00cf630 2024-04-04T06:56:07.385 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.381+0000 7fe2d7e00640 1 -- 172.21.15.117:0/492348783 <== mon.2 v2:172.21.15.117:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fe2d001b020 con 0x7fe2e00cf630 2024-04-04T06:56:07.385 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.381+0000 7fe2d7e00640 1 -- 172.21.15.117:0/492348783 <== mon.2 v2:172.21.15.117:3301/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7fe2d001d9f0 con 0x7fe2e00cf630 2024-04-04T06:56:07.385 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.382+0000 7fe2e5600640 1 -- 172.21.15.117:0/492348783 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2e00685a0 con 0x7fe2e00cf630 2024-04-04T06:56:07.385 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.384+0000 7fe2d7e00640 1 -- 172.21.15.117:0/492348783 <== mon.2 v2:172.21.15.117:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7fe2d0022020 con 0x7fe2e00cf630 2024-04-04T06:56:07.395 INFO:tasks.ceph.mgr.y.smithi072.stderr:2024-04-04T06:56:07.396+0000 7fa15020d040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-04T06:56:07.444 INFO:tasks.ceph.mgr.y.smithi072.stderr:2024-04-04T06:56:07.445+0000 7fa15020d040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-04T06:56:07.462 INFO:tasks.ceph.mgr.x.smithi117.stderr:2024-04-04T06:56:07.463+0000 7f088ce45040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-04T06:56:07.462 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.463+0000 7fe2e5600640 1 -- 172.21.15.117:0/492348783 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "osd new", "uuid": "bcdafa9f-a870-4398-a38d-ab7697676473", "id": 6} v 0) -- 0x7fe2e00d1f90 con 0x7fe2e00cf630 2024-04-04T06:56:07.474 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.475+0000 7fe2d7e00640 1 -- 172.21.15.117:0/492348783 <== mon.2 v2:172.21.15.117:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "bcdafa9f-a870-4398-a38d-ab7697676473", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7fe2d001d400 con 0x7fe2e00cf630 2024-04-04T06:56:07.474 INFO:teuthology.orchestra.run.smithi117.stdout:6 2024-04-04T06:56:07.475 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.476+0000 7fe2e5600640 1 -- 172.21.15.117:0/492348783 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe2e00cf630 msgr2=0x7fe2e00c7250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:07.475 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.476+0000 7fe2e5600640 1 --2- 172.21.15.117:0/492348783 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe2e00cf630 0x7fe2e00c7250 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fe2d000d550 tx=0x7fe2d000da10 comp rx=0 tx=0).stop 2024-04-04T06:56:07.475 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.476+0000 7fe2e5600640 1 -- 172.21.15.117:0/492348783 shutdown_connections 2024-04-04T06:56:07.475 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.476+0000 7fe2e5600640 1 --2- 172.21.15.117:0/492348783 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe2e015f2a0 0x7fe2e0156e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:07.475 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.476+0000 7fe2e5600640 1 --2- 172.21.15.117:0/492348783 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe2e015c180 0x7fe2e00cd5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:07.476 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.476+0000 7fe2e5600640 1 --2- 172.21.15.117:0/492348783 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe2e00cf630 0x7fe2e00c7250 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:07.476 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.476+0000 7fe2e5600640 1 -- 172.21.15.117:0/492348783 >> 172.21.15.117:0/492348783 conn(0x7fe2e006b890 msgr2=0x7fe2e0160060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:56:07.476 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.477+0000 7fe2e5600640 1 -- 172.21.15.117:0/492348783 shutdown_connections 2024-04-04T06:56:07.476 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.477+0000 7fe2e5600640 1 -- 172.21.15.117:0/492348783 wait complete. 2024-04-04T06:56:07.492 DEBUG:teuthology.orchestra.run.smithi117:> sudo ceph --cluster ceph osd new b68ec562-ff35-4d2d-a733-c896f8920cfb 7 2024-04-04T06:56:07.616 INFO:tasks.ceph.mgr.y.smithi072.stderr:2024-04-04T06:56:07.617+0000 7fa15020d040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-04T06:56:07.630 INFO:tasks.ceph.mgr.x.smithi117.stderr:2024-04-04T06:56:07.631+0000 7f088ce45040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-04T06:56:07.672 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.673+0000 7feab8a00640 1 Processor -- start 2024-04-04T06:56:07.672 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.673+0000 7feab8a00640 1 -- start start 2024-04-04T06:56:07.674 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.674+0000 7feab8a00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feab415c180 0x7feab40cf0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:07.674 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.675+0000 7feab8a00640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7feab415f470 0x7feab40b2b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:07.674 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.675+0000 7feab8a00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feab415c560 con 0x7feab40cf630 2024-04-04T06:56:07.674 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.675+0000 7feab8a00640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7feab40cfab0 con 0x7feab415f470 2024-04-04T06:56:07.674 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.675+0000 7feab8a00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7feab415fad0 con 0x7feab415c180 2024-04-04T06:56:07.675 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.675+0000 7feab2800640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feab415c180 0x7feab40cf0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:07.675 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.675+0000 7feab1e00640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7feab40cf630 0x7feab415ed60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:50246/0 (socket says 172.21.15.117:50246) 2024-04-04T06:56:07.675 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.675+0000 7feab1e00640 1 -- 172.21.15.117:0/2899717464 learned_addr learned my addr 172.21.15.117:0/2899717464 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-04-04T06:56:07.675 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.675+0000 7feab3200640 1 --2- 172.21.15.117:0/2899717464 >> v2:172.21.15.72:3300/0 conn(0x7feab415f470 0x7feab40b2b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:07.675 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.675+0000 7feab2800640 1 -- 172.21.15.117:0/2899717464 >> v2:172.21.15.72:3300/0 conn(0x7feab415f470 msgr2=0x7feab40b2b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:56:07.675 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.675+0000 7feab2800640 1 --2- 172.21.15.117:0/2899717464 >> v2:172.21.15.72:3300/0 conn(0x7feab415f470 0x7feab40b2b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:07.675 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.675+0000 7feab2800640 1 -- 172.21.15.117:0/2899717464 >> v1:172.21.15.117:6789/0 conn(0x7feab40cf630 legacy=0x7feab415ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:07.675 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.675+0000 7feab2800640 1 -- 172.21.15.117:0/2899717464 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feab4163010 con 0x7feab415c180 2024-04-04T06:56:07.675 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.675+0000 7feab1400640 1 -- 172.21.15.117:0/2899717464 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1767847111 0 0) 0x7feab415c560 con 0x7feab40cf630 2024-04-04T06:56:07.675 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.675+0000 7feab3200640 1 --2- 172.21.15.117:0/2899717464 >> v2:172.21.15.72:3300/0 conn(0x7feab415f470 0x7feab40b2b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-04T06:56:07.676 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.676+0000 7feab2800640 1 --2- 172.21.15.117:0/2899717464 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feab415c180 0x7feab40cf0f0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7feaa40097a0 tx=0x7feaa402b820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=408ec1dc3678e669 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:07.677 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.677+0000 7feab1400640 1 -- 172.21.15.117:0/2899717464 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feaa4031780 con 0x7feab415c180 2024-04-04T06:56:07.677 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.677+0000 7feab1400640 1 -- 172.21.15.117:0/2899717464 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feaa4037070 con 0x7feab415c180 2024-04-04T06:56:07.677 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.677+0000 7feab1400640 1 -- 172.21.15.117:0/2899717464 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feaa4031b40 con 0x7feab415c180 2024-04-04T06:56:07.677 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.678+0000 7feab8a00640 1 -- 172.21.15.117:0/2899717464 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feab415c180 msgr2=0x7feab40cf0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:07.677 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.678+0000 7feab8a00640 1 --2- 172.21.15.117:0/2899717464 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feab415c180 0x7feab40cf0f0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7feaa40097a0 tx=0x7feaa402b820 comp rx=0 tx=0).stop 2024-04-04T06:56:07.677 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.678+0000 7feab8a00640 1 -- 172.21.15.117:0/2899717464 shutdown_connections 2024-04-04T06:56:07.677 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.678+0000 7feab8a00640 1 --2- 172.21.15.117:0/2899717464 >> v2:172.21.15.72:3300/0 conn(0x7feab415f470 0x7feab40b2b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:07.677 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.678+0000 7feab8a00640 1 --2- 172.21.15.117:0/2899717464 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feab415c180 0x7feab40cf0f0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:07.677 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.678+0000 7feab8a00640 1 -- 172.21.15.117:0/2899717464 >> 172.21.15.117:0/2899717464 conn(0x7feab406b890 msgr2=0x7feab406bca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:56:07.677 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.678+0000 7feab8a00640 1 -- 172.21.15.117:0/2899717464 shutdown_connections 2024-04-04T06:56:07.677 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.678+0000 7feab8a00640 1 -- 172.21.15.117:0/2899717464 wait complete. 2024-04-04T06:56:07.679 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.680+0000 7feab8a00640 1 Processor -- start 2024-04-04T06:56:07.679 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.681+0000 7feab8a00640 1 -- start start 2024-04-04T06:56:07.682 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.682+0000 7feab8a00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feab40cf630 0x7feab40c7060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:07.682 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.682+0000 7feab8a00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feab415c180 0x7feab4151210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:07.682 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.682+0000 7feab8a00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feab415f470 0x7feab40ca6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:07.682 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.682+0000 7feab8a00640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7feab4162530 con 0x7feab415f470 2024-04-04T06:56:07.682 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.682+0000 7feab8a00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7feab4162b80 con 0x7feab415c180 2024-04-04T06:56:07.682 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.682+0000 7feab8a00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7feab4162810 con 0x7feab40cf630 2024-04-04T06:56:07.682 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.682+0000 7feab2800640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feab40cf630 0x7feab40c7060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:07.682 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.682+0000 7feab1e00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feab415c180 0x7feab4151210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:07.682 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.682+0000 7feab2800640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feab40cf630 0x7feab40c7060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.117:59602/0 (socket says 172.21.15.117:59602) 2024-04-04T06:56:07.682 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.682+0000 7feab2800640 1 -- 172.21.15.117:0/175685978 learned_addr learned my addr 172.21.15.117:0/175685978 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-04T06:56:07.683 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.683+0000 7feab3200640 1 --2- 172.21.15.117:0/175685978 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feab415f470 0x7feab40ca6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:07.683 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.683+0000 7feab2800640 1 -- 172.21.15.117:0/175685978 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feab415c180 msgr2=0x7feab4151210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:07.683 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.683+0000 7feab2800640 1 --2- 172.21.15.117:0/175685978 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feab415c180 0x7feab4151210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:07.683 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.683+0000 7feab2800640 1 -- 172.21.15.117:0/175685978 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feab415f470 msgr2=0x7feab40ca6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:07.683 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.683+0000 7feab2800640 1 --2- 172.21.15.117:0/175685978 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feab415f470 0x7feab40ca6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:07.683 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.683+0000 7feab2800640 1 -- 172.21.15.117:0/175685978 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feab4151910 con 0x7feab40cf630 2024-04-04T06:56:07.683 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.683+0000 7feab3200640 1 --2- 172.21.15.117:0/175685978 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feab415f470 0x7feab40ca6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-04T06:56:07.683 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.683+0000 7feab2800640 1 --2- 172.21.15.117:0/175685978 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feab40cf630 0x7feab40c7060 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7feaa40098c0 tx=0x7feaa40046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:07.683 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.683+0000 7feaaaa00640 1 -- 172.21.15.117:0/175685978 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feaa4032820 con 0x7feab40cf630 2024-04-04T06:56:07.683 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.683+0000 7feaaaa00640 1 -- 172.21.15.117:0/175685978 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feaa40329c0 con 0x7feab40cf630 2024-04-04T06:56:07.683 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.683+0000 7feaaaa00640 1 -- 172.21.15.117:0/175685978 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feaa4032db0 con 0x7feab40cf630 2024-04-04T06:56:07.683 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.683+0000 7feab8a00640 1 -- 172.21.15.117:0/175685978 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feab4152d70 con 0x7feab40cf630 2024-04-04T06:56:07.684 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.684+0000 7feab8a00640 1 -- 172.21.15.117:0/175685978 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7feab41532f0 con 0x7feab40cf630 2024-04-04T06:56:07.684 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.684+0000 7feaaaa00640 1 -- 172.21.15.117:0/175685978 <== mon.2 v2:172.21.15.117:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7feaa404e7d0 con 0x7feab40cf630 2024-04-04T06:56:07.684 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.684+0000 7feaaaa00640 1 -- 172.21.15.117:0/175685978 <== mon.2 v2:172.21.15.117:3301/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7feaa4045400 con 0x7feab40cf630 2024-04-04T06:56:07.684 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.685+0000 7feab8a00640 1 -- 172.21.15.117:0/175685978 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feab40685a0 con 0x7feab40cf630 2024-04-04T06:56:07.685 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.687+0000 7feaaaa00640 1 -- 172.21.15.117:0/175685978 <== mon.2 v2:172.21.15.117:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7feab4151910 con 0x7feab40cf630 2024-04-04T06:56:07.764 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.765+0000 7feab8a00640 1 -- 172.21.15.117:0/175685978 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "osd new", "uuid": "b68ec562-ff35-4d2d-a733-c896f8920cfb", "id": 7} v 0) -- 0x7feab406be10 con 0x7feab40cf630 2024-04-04T06:56:07.775 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.776+0000 7feaaaa00640 1 -- 172.21.15.117:0/175685978 <== mon.2 v2:172.21.15.117:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b68ec562-ff35-4d2d-a733-c896f8920cfb", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7feaa4040070 con 0x7feab40cf630 2024-04-04T06:56:07.775 INFO:teuthology.orchestra.run.smithi117.stdout:7 2024-04-04T06:56:07.776 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.777+0000 7feab8a00640 1 -- 172.21.15.117:0/175685978 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feab40cf630 msgr2=0x7feab40c7060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:07.777 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.777+0000 7feab8a00640 1 --2- 172.21.15.117:0/175685978 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feab40cf630 0x7feab40c7060 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7feaa40098c0 tx=0x7feaa40046c0 comp rx=0 tx=0).stop 2024-04-04T06:56:07.777 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.778+0000 7feab8a00640 1 -- 172.21.15.117:0/175685978 shutdown_connections 2024-04-04T06:56:07.777 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.778+0000 7feab8a00640 1 --2- 172.21.15.117:0/175685978 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feab415f470 0x7feab40ca6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:07.777 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.778+0000 7feab8a00640 1 --2- 172.21.15.117:0/175685978 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feab415c180 0x7feab4151210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:07.777 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.778+0000 7feab8a00640 1 --2- 172.21.15.117:0/175685978 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feab40cf630 0x7feab40c7060 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:07.777 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.778+0000 7feab8a00640 1 -- 172.21.15.117:0/175685978 >> 172.21.15.117:0/175685978 conn(0x7feab406b890 msgr2=0x7feab41618d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:56:07.777 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.778+0000 7feab8a00640 1 -- 172.21.15.117:0/175685978 shutdown_connections 2024-04-04T06:56:07.777 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:07.778+0000 7feab8a00640 1 -- 172.21.15.117:0/175685978 wait complete. 2024-04-04T06:56:07.780 INFO:tasks.ceph.mgr.x.smithi117.stderr:2024-04-04T06:56:07.782+0000 7f088ce45040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-04T06:56:07.793 INFO:tasks.ceph.osd.0:Restarting daemon 2024-04-04T06:56:07.793 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-04-04T06:56:07.800 INFO:tasks.ceph.osd.0:Started 2024-04-04T06:56:07.801 INFO:tasks.ceph.osd.1:Restarting daemon 2024-04-04T06:56:07.801 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-04-04T06:56:07.807 INFO:tasks.ceph.osd.1:Started 2024-04-04T06:56:07.807 INFO:tasks.ceph.osd.2:Restarting daemon 2024-04-04T06:56:07.808 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-04-04T06:56:07.812 INFO:tasks.ceph.osd.2:Started 2024-04-04T06:56:07.812 INFO:tasks.ceph.osd.3:Restarting daemon 2024-04-04T06:56:07.812 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-04-04T06:56:07.817 INFO:tasks.ceph.osd.3:Started 2024-04-04T06:56:07.817 INFO:tasks.ceph.osd.4:Restarting daemon 2024-04-04T06:56:07.817 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-04-04T06:56:07.824 INFO:tasks.ceph.osd.4:Started 2024-04-04T06:56:07.825 INFO:tasks.ceph.osd.5:Restarting daemon 2024-04-04T06:56:07.825 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-04-04T06:56:07.831 INFO:tasks.ceph.osd.5:Started 2024-04-04T06:56:07.831 INFO:tasks.ceph.osd.6:Restarting daemon 2024-04-04T06:56:07.832 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-04-04T06:56:07.836 INFO:tasks.ceph.osd.6:Started 2024-04-04T06:56:07.837 INFO:tasks.ceph.osd.7:Restarting daemon 2024-04-04T06:56:07.837 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-04-04T06:56:07.837 INFO:tasks.ceph.mgr.x.smithi117.stderr:2024-04-04T06:56:07.838+0000 7f088ce45040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-04T06:56:07.842 INFO:tasks.ceph.osd.7:Started 2024-04-04T06:56:07.842 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-04T06:56:07.996 INFO:tasks.ceph.mgr.x.smithi117.stderr:2024-04-04T06:56:07.998+0000 7f088ce45040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-04T06:56:08.065 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:08.067+0000 7f1efec00640 1 Processor -- start 2024-04-04T06:56:08.065 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:08.067+0000 7f1efec00640 1 -- start start 2024-04-04T06:56:08.067 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:08.068+0000 7f1efec00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f1ef80d1740 0x7f1ef80cf5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:08.067 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:08.068+0000 7f1efec00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1ef81620c0 0x7f1ef8162520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:08.067 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:08.068+0000 7f1efec00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1ef8162a60 con 0x7f1ef815e490 2024-04-04T06:56:08.067 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:08.068+0000 7f1efec00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f1ef815ee90 con 0x7f1ef80d1740 2024-04-04T06:56:08.067 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:08.068+0000 7f1efec00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f1ef8162ff0 con 0x7f1ef81620c0 2024-04-04T06:56:08.067 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:08.068+0000 7f1efe200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1ef81620c0 0x7f1ef8162520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:08.067 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:08.068+0000 7f1efce00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f1ef80d1740 0x7f1ef80cf5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:08.067 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:08.068+0000 7f1efd800640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f1ef815e490 0x7f1ef80d1030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.72:57590/0 (socket says 172.21.15.72:57590) 2024-04-04T06:56:08.067 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:08.068+0000 7f1efd800640 1 -- 172.21.15.72:0/1360485567 learned_addr learned my addr 172.21.15.72:0/1360485567 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-04-04T06:56:08.068 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:08.069+0000 7f1ef7e00640 1 -- 172.21.15.72:0/1360485567 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2749752948 0 0) 0x7f1ef8162a60 con 0x7f1ef815e490 2024-04-04T06:56:08.068 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:08.069+0000 7f1ef7e00640 1 -- 172.21.15.72:0/1360485567 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1ee0003520 con 0x7f1ef815e490 2024-04-04T06:56:08.068 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:08.069+0000 7f1efe200640 1 -- 172.21.15.72:0/1360485567 >> v2:172.21.15.117:3300/0 conn(0x7f1ef80d1740 msgr2=0x7f1ef80cf5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:56:08.068 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:08.069+0000 7f1efe200640 1 --2- 172.21.15.72:0/1360485567 >> v2:172.21.15.117:3300/0 conn(0x7f1ef80d1740 0x7f1ef80cf5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:08.069 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:08.069+0000 7f1efe200640 1 -- 172.21.15.72:0/1360485567 >> v1:172.21.15.117:6789/0 conn(0x7f1ef815e490 legacy=0x7f1ef80d1030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:08.069 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:08.069+0000 7f1efe200640 1 -- 172.21.15.72:0/1360485567 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ef8162d10 con 0x7f1ef81620c0 2024-04-04T06:56:08.069 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:08.069+0000 7f1efce00640 1 --2- 172.21.15.72:0/1360485567 >> v2:172.21.15.117:3300/0 conn(0x7f1ef80d1740 0x7f1ef80cf5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-04T06:56:08.069 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:08.070+0000 7f1efe200640 1 --2- 172.21.15.72:0/1360485567 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1ef81620c0 0x7f1ef8162520 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f1ef0009d90 tx=0x7f1ef002beb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f45872e7e463042 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:08.069 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:08.070+0000 7f1ef7e00640 1 -- 172.21.15.72:0/1360485567 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ef0039070 con 0x7f1ef81620c0 2024-04-04T06:56:08.069 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:08.070+0000 7f1ef7e00640 1 -- 172.21.15.72:0/1360485567 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ef002cc60 con 0x7f1ef81620c0 2024-04-04T06:56:08.069 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:08.070+0000 7f1ef7e00640 1 -- 172.21.15.72:0/1360485567 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ef0034660 con 0x7f1ef81620c0 2024-04-04T06:56:08.070 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:08.071+0000 7f1efec00640 1 -- 172.21.15.72:0/1360485567 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1ef81620c0 msgr2=0x7f1ef8162520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:08.070 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:08.071+0000 7f1efec00640 1 --2- 172.21.15.72:0/1360485567 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1ef81620c0 0x7f1ef8162520 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f1ef0009d90 tx=0x7f1ef002beb0 comp rx=0 tx=0).stop 2024-04-04T06:56:08.070 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:08.071+0000 7f1efec00640 1 -- 172.21.15.72:0/1360485567 shutdown_connections 2024-04-04T06:56:08.070 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:08.071+0000 7f1efec00640 1 --2- 172.21.15.72:0/1360485567 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1ef81620c0 0x7f1ef8162520 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:08.070 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:08.071+0000 7f1efec00640 1 --2- 172.21.15.72:0/1360485567 >> v2:172.21.15.117:3300/0 conn(0x7f1ef80d1740 0x7f1ef80cf5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:08.070 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:08.071+0000 7f1efec00640 1 -- 172.21.15.72:0/1360485567 >> 172.21.15.72:0/1360485567 conn(0x7f1ef806b890 msgr2=0x7f1ef806bca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:56:08.070 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:08.071+0000 7f1efec00640 1 -- 172.21.15.72:0/1360485567 shutdown_connections 2024-04-04T06:56:08.070 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:08.071+0000 7f1efec00640 1 -- 172.21.15.72:0/1360485567 wait complete. 2024-04-04T06:56:08.071 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:08.072+0000 7f1efec00640 1 Processor -- start 2024-04-04T06:56:08.071 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:08.072+0000 7f1efec00640 1 -- start start 2024-04-04T06:56:08.072 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:08.073+0000 7f1efec00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1ef80d1740 0x7f1ef80c9a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:08.072 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:08.073+0000 7f1efec00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1ef815e490 0x7f1ef80c9fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:08.072 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:08.073+0000 7f1efec00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1ef81620c0 0x7f1ef81540c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:08.072 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:08.073+0000 7f1efec00640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f1ef80cf080 con 0x7f1ef81620c0 2024-04-04T06:56:08.072 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:08.073+0000 7f1efec00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f1ef80ceda0 con 0x7f1ef80d1740 2024-04-04T06:56:08.072 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:08.073+0000 7f1efec00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f1ef815e870 con 0x7f1ef815e490 2024-04-04T06:56:08.073 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:08.074+0000 7f1efe200640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1ef81620c0 0x7f1ef81540c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:08.074 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:08.074+0000 7f1efce00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1ef815e490 0x7f1ef80c9fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:08.074 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:08.074+0000 7f1efd800640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1ef80d1740 0x7f1ef80c9a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:08.074 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:08.074+0000 7f1efe200640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1ef81620c0 0x7f1ef81540c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42828/0 (socket says 172.21.15.72:42828) 2024-04-04T06:56:08.074 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:08.074+0000 7f1efe200640 1 -- 172.21.15.72:0/4043859716 learned_addr learned my addr 172.21.15.72:0/4043859716 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:56:08.074 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:08.074+0000 7f1efce00640 1 -- 172.21.15.72:0/4043859716 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1ef80d1740 msgr2=0x7f1ef80c9a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:08.074 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:08.074+0000 7f1efce00640 1 --2- 172.21.15.72:0/4043859716 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1ef80d1740 0x7f1ef80c9a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:08.074 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:08.074+0000 7f1efce00640 1 -- 172.21.15.72:0/4043859716 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1ef81620c0 msgr2=0x7f1ef81540c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:08.074 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:08.074+0000 7f1efce00640 1 --2- 172.21.15.72:0/4043859716 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1ef81620c0 0x7f1ef81540c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:08.074 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:08.074+0000 7f1efce00640 1 -- 172.21.15.72:0/4043859716 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ef80ccb80 con 0x7f1ef815e490 2024-04-04T06:56:08.074 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:08.074+0000 7f1efe200640 1 --2- 172.21.15.72:0/4043859716 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1ef81620c0 0x7f1ef81540c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-04T06:56:08.074 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:08.074+0000 7f1efce00640 1 --2- 172.21.15.72:0/4043859716 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1ef815e490 0x7f1ef80c9fd0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f1ee400e900 tx=0x7f1ee400edc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:08.074 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:08.075+0000 7f1ef5600640 1 -- 172.21.15.72:0/4043859716 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ee4017070 con 0x7f1ef815e490 2024-04-04T06:56:08.074 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:08.075+0000 7f1ef5600640 1 -- 172.21.15.72:0/4043859716 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ee400ca00 con 0x7f1ef815e490 2024-04-04T06:56:08.074 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:08.075+0000 7f1ef5600640 1 -- 172.21.15.72:0/4043859716 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ee400cdf0 con 0x7f1ef815e490 2024-04-04T06:56:08.075 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:08.075+0000 7f1efec00640 1 -- 172.21.15.72:0/4043859716 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ef8152a90 con 0x7f1ef815e490 2024-04-04T06:56:08.075 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:08.075+0000 7f1efec00640 1 -- 172.21.15.72:0/4043859716 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ef80cd100 con 0x7f1ef815e490 2024-04-04T06:56:08.075 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:08.075+0000 7f1ef5600640 1 -- 172.21.15.72:0/4043859716 <== mon.2 v2:172.21.15.117:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f1ee401a070 con 0x7f1ef815e490 2024-04-04T06:56:08.075 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:08.075+0000 7f1ef5600640 1 -- 172.21.15.72:0/4043859716 <== mon.2 v2:172.21.15.117:3301/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f1ee4006020 con 0x7f1ef815e490 2024-04-04T06:56:08.075 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:08.076+0000 7f1efec00640 1 -- 172.21.15.72:0/4043859716 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ef80756c0 con 0x7f1ef815e490 2024-04-04T06:56:08.076 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:08.078+0000 7f1ef5600640 1 -- 172.21.15.72:0/4043859716 <== mon.2 v2:172.21.15.117:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f1ee40092e0 con 0x7f1ef815e490 2024-04-04T06:56:08.120 INFO:tasks.ceph.mgr.x.smithi117.stderr:2024-04-04T06:56:08.121+0000 7f088ce45040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-04T06:56:08.141 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:08.142+0000 7f1efec00640 1 -- 172.21.15.72:0/4043859716 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1ef80ce5f0 con 0x7f1ef815e490 2024-04-04T06:56:08.141 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:08.143+0000 7f1ef5600640 1 -- 172.21.15.72:0/4043859716 <== mon.2 v2:172.21.15.117:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f1ee40064d0 con 0x7f1ef815e490 2024-04-04T06:56:08.142 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T06:56:08.142 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":10,"fsid":"6708bac2-4f50-49b5-87a9-c390fd333eb3","created":"2024-04-04T06:56:04.282498+0000","modified":"2024-04-04T06:56:07.768593+0000","last_up_change":"0.000000","last_in_change":"2024-04-04T06:56:07.768593+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"7c345991-5af8-4dc6-a481-28610c40e128","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"1b3f7ab2-a56c-488d-a89a-1f3572361c95","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"fc9aa512-53df-40d7-ba04-3e6b7dcd1e34","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"b4f63eed-dc5b-4aba-bb50-de46eb41492b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"9e985ef8-d711-4172-9286-c54e560895d8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"3e9f082b-8d7d-455f-8a96-66d0b4857125","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"bcdafa9f-a870-4398-a38d-ab7697676473","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"b68ec562-ff35-4d2d-a733-c896f8920cfb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-04T06:56:08.143 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:08.144+0000 7f1efec00640 1 -- 172.21.15.72:0/4043859716 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1ef815e490 msgr2=0x7f1ef80c9fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:08.143 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:08.144+0000 7f1efec00640 1 --2- 172.21.15.72:0/4043859716 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1ef815e490 0x7f1ef80c9fd0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f1ee400e900 tx=0x7f1ee400edc0 comp rx=0 tx=0).stop 2024-04-04T06:56:08.143 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:08.144+0000 7f1efec00640 1 -- 172.21.15.72:0/4043859716 shutdown_connections 2024-04-04T06:56:08.143 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:08.144+0000 7f1efec00640 1 --2- 172.21.15.72:0/4043859716 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1ef81620c0 0x7f1ef81540c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:08.143 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:08.144+0000 7f1efec00640 1 --2- 172.21.15.72:0/4043859716 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1ef815e490 0x7f1ef80c9fd0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:08.143 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:08.144+0000 7f1efec00640 1 --2- 172.21.15.72:0/4043859716 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1ef80d1740 0x7f1ef80c9a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:08.143 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:08.144+0000 7f1efec00640 1 -- 172.21.15.72:0/4043859716 >> 172.21.15.72:0/4043859716 conn(0x7f1ef806b890 msgr2=0x7f1ef80b8c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:56:08.143 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:08.144+0000 7f1efec00640 1 -- 172.21.15.72:0/4043859716 shutdown_connections 2024-04-04T06:56:08.144 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:08.145+0000 7f1efec00640 1 -- 172.21.15.72:0/4043859716 wait complete. 2024-04-04T06:56:08.159 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-04-04T06:56:08.159 INFO:tasks.ceph:Waiting for OSDs to come up 2024-04-04T06:56:08.297 INFO:tasks.ceph.mgr.x.smithi117.stderr:2024-04-04T06:56:08.298+0000 7f088ce45040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-04T06:56:08.348 INFO:tasks.ceph.mgr.x.smithi117.stderr:2024-04-04T06:56:08.349+0000 7f088ce45040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-04T06:56:08.498 INFO:tasks.ceph.osd.1.smithi072.stderr:2024-04-04T06:56:08.500+0000 7fa43aa1f640 -1 Falling back to public interface 2024-04-04T06:56:08.506 INFO:tasks.ceph.osd.5.smithi117.stderr:2024-04-04T06:56:08.507+0000 7f145220e640 -1 Falling back to public interface 2024-04-04T06:56:08.511 INFO:tasks.ceph.osd.2.smithi072.stderr:2024-04-04T06:56:08.512+0000 7f7525414640 -1 Falling back to public interface 2024-04-04T06:56:08.521 INFO:tasks.ceph.mgr.x.smithi117.stderr:2024-04-04T06:56:08.522+0000 7f088ce45040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-04T06:56:08.522 INFO:tasks.ceph.osd.6.smithi117.stderr:2024-04-04T06:56:08.523+0000 7fb93951d640 -1 Falling back to public interface 2024-04-04T06:56:08.528 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-04T06:56:08.530+0000 7f4e6a58c640 -1 Falling back to public interface 2024-04-04T06:56:08.528 INFO:tasks.ceph.osd.3.smithi072.stderr:2024-04-04T06:56:08.530+0000 7f0d6b16d640 -1 Falling back to public interface 2024-04-04T06:56:08.550 INFO:tasks.ceph.osd.7.smithi117.stderr:2024-04-04T06:56:08.551+0000 7f302c2f9640 -1 Falling back to public interface 2024-04-04T06:56:08.566 INFO:tasks.ceph.osd.4.smithi117.stderr:2024-04-04T06:56:08.567+0000 7f2491abf640 -1 Falling back to public interface 2024-04-04T06:56:08.834 INFO:tasks.ceph.mgr.y.smithi072.stderr:2024-04-04T06:56:08.836+0000 7fa15020d040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-04T06:56:08.965 DEBUG:teuthology.orchestra.run.smithi072:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-04T06:56:09.124 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:09.126+0000 7f8297000640 1 Processor -- start 2024-04-04T06:56:09.124 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:09.126+0000 7f8297000640 1 -- start start 2024-04-04T06:56:09.126 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:09.127+0000 7f8297000640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f82900d1320 0x7f82900d25a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:09.126 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:09.127+0000 7f8297000640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82900d2c30 con 0x7f82900cff70 2024-04-04T06:56:09.126 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:09.127+0000 7f8297000640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82900d2f10 con 0x7f8290161b20 2024-04-04T06:56:09.126 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:09.127+0000 7f8297000640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f82900b3f70 con 0x7f82900d1320 2024-04-04T06:56:09.126 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:09.127+0000 7f8296600640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f82900cff70 0x7f82900b4400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:37466/0 (socket says 172.21.15.72:37466) 2024-04-04T06:56:09.126 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:09.127+0000 7f8296600640 1 -- 172.21.15.72:0/3715257507 learned_addr learned my addr 172.21.15.72:0/3715257507 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-04-04T06:56:09.126 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:09.128+0000 7f8295200640 1 --2- 172.21.15.72:0/3715257507 >> v2:172.21.15.117:3300/0 conn(0x7f82900d1320 0x7f82900d25a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:09.128 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:09.128+0000 7f828fe00640 1 -- 172.21.15.72:0/3715257507 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 240035038 0 0) 0x7f82900d2c30 con 0x7f82900cff70 2024-04-04T06:56:09.128 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:09.128+0000 7f828fe00640 1 -- 172.21.15.72:0/3715257507 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8278003520 con 0x7f82900cff70 2024-04-04T06:56:09.128 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:09.128+0000 7f828fe00640 1 -- 172.21.15.72:0/3715257507 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2183483755 0 0) 0x7f8278003520 con 0x7f82900cff70 2024-04-04T06:56:09.128 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:09.128+0000 7f828fe00640 1 -- 172.21.15.72:0/3715257507 >> v2:172.21.15.117:3300/0 conn(0x7f82900d1320 msgr2=0x7f82900d25a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:56:09.128 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:09.128+0000 7f828fe00640 1 --2- 172.21.15.72:0/3715257507 >> v2:172.21.15.117:3300/0 conn(0x7f82900d1320 0x7f82900d25a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:09.128 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:09.128+0000 7f828fe00640 1 -- 172.21.15.72:0/3715257507 >> v1:172.21.15.117:6789/0 conn(0x7f8290161b20 legacy=0x7f82900d0c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:09.129 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:09.128+0000 7f828fe00640 1 -- 172.21.15.72:0/3715257507 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82900d31f0 con 0x7f82900cff70 2024-04-04T06:56:09.129 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:09.128+0000 7f828fe00640 1 -- 172.21.15.72:0/3715257507 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2465650867 0 0) 0x7f82880019f0 con 0x7f82900cff70 2024-04-04T06:56:09.129 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:09.128+0000 7f828fe00640 1 -- 172.21.15.72:0/3715257507 >> v1:172.21.15.72:6789/0 conn(0x7f82900cff70 legacy=0x7f82900b4400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:09.129 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:09.128+0000 7f828fe00640 1 --2- 172.21.15.72:0/3715257507 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8278003a00 0x7f8278003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:09.129 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:09.128+0000 7f828fe00640 1 --2- 172.21.15.72:0/3715257507 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8278004800 0x7f8278004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:09.129 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:09.128+0000 7f828fe00640 1 --2- 172.21.15.72:0/3715257507 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f82780051c0 0x7f827800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:09.129 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:09.128+0000 7f828fe00640 1 -- 172.21.15.72:0/3715257507 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f82900b3f70 con 0x7f8278003a00 2024-04-04T06:56:09.129 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:09.128+0000 7f828fe00640 1 -- 172.21.15.72:0/3715257507 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f827800c0c0 con 0x7f82780051c0 2024-04-04T06:56:09.129 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:09.128+0000 7f828fe00640 1 -- 172.21.15.72:0/3715257507 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f827800c2c0 con 0x7f8278004800 2024-04-04T06:56:09.129 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:09.129+0000 7f8295c00640 1 --2- 172.21.15.72:0/3715257507 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8278003a00 0x7f8278003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:09.129 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:09.129+0000 7f8296600640 1 --2- 172.21.15.72:0/3715257507 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f82780051c0 0x7f827800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:09.129 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:09.129+0000 7f8295200640 1 --2- 172.21.15.72:0/3715257507 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8278004800 0x7f8278004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:09.129 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:09.129+0000 7f8295c00640 1 -- 172.21.15.72:0/3715257507 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8278004800 msgr2=0x7f8278004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:56:09.129 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:09.129+0000 7f8295c00640 1 --2- 172.21.15.72:0/3715257507 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8278004800 0x7f8278004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:09.129 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:09.129+0000 7f8295c00640 1 -- 172.21.15.72:0/3715257507 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f82780051c0 msgr2=0x7f827800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:56:09.130 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:09.129+0000 7f8295c00640 1 --2- 172.21.15.72:0/3715257507 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f82780051c0 0x7f827800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:09.130 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:09.129+0000 7f8295c00640 1 -- 172.21.15.72:0/3715257507 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8278003520 con 0x7f8278003a00 2024-04-04T06:56:09.130 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:09.129+0000 7f8296600640 1 --2- 172.21.15.72:0/3715257507 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f82780051c0 0x7f827800b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-04T06:56:09.130 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:09.129+0000 7f8295200640 1 --2- 172.21.15.72:0/3715257507 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8278004800 0x7f8278004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-04T06:56:09.130 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:09.129+0000 7f8296600640 1 -- 172.21.15.72:0/3715257507 reap_dead start 2024-04-04T06:56:09.131 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:09.130+0000 7f8295c00640 1 --2- 172.21.15.72:0/3715257507 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8278003a00 0x7f8278003e20 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f8284001750 tx=0x7f8278005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91b66bbef7e04338 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:09.131 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:09.130+0000 7f828fe00640 1 -- 172.21.15.72:0/3715257507 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8284001370 con 0x7f8278003a00 2024-04-04T06:56:09.131 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:09.130+0000 7f828fe00640 1 -- 172.21.15.72:0/3715257507 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82840052d0 con 0x7f8278003a00 2024-04-04T06:56:09.131 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:09.130+0000 7f828fe00640 1 -- 172.21.15.72:0/3715257507 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8284003830 con 0x7f8278003a00 2024-04-04T06:56:09.131 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:09.131+0000 7f8297000640 1 -- 172.21.15.72:0/3715257507 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8278003a00 msgr2=0x7f8278003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:09.131 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:09.131+0000 7f8297000640 1 --2- 172.21.15.72:0/3715257507 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8278003a00 0x7f8278003e20 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f8284001750 tx=0x7f8278005830 comp rx=0 tx=0).stop 2024-04-04T06:56:09.132 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:09.131+0000 7f8297000640 1 -- 172.21.15.72:0/3715257507 shutdown_connections 2024-04-04T06:56:09.132 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:09.131+0000 7f8297000640 1 --2- 172.21.15.72:0/3715257507 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8278003a00 0x7f8278003e20 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:09.132 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:09.131+0000 7f8297000640 1 -- 172.21.15.72:0/3715257507 >> 172.21.15.72:0/3715257507 conn(0x7f829009d530 msgr2=0x7f82900d4200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:56:09.132 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:09.131+0000 7f8297000640 1 -- 172.21.15.72:0/3715257507 shutdown_connections 2024-04-04T06:56:09.132 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:09.131+0000 7f8297000640 1 -- 172.21.15.72:0/3715257507 wait complete. 2024-04-04T06:56:09.132 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:09.133+0000 7f8297000640 1 Processor -- start 2024-04-04T06:56:09.132 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:09.133+0000 7f8297000640 1 -- start start 2024-04-04T06:56:09.134 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:09.134+0000 7f8297000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8278003a00 0x7f82900cd2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:09.134 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:09.134+0000 7f8297000640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8290151670 0x7f82900cb550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:09.134 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:09.134+0000 7f8297000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f82900cba90 0x7f829009f5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:09.134 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:09.134+0000 7f8297000640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f8290161f00 con 0x7f8290151670 2024-04-04T06:56:09.134 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:09.134+0000 7f8297000640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f82900d03e0 con 0x7f8278003a00 2024-04-04T06:56:09.134 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:09.134+0000 7f8297000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f82900cd7f0 con 0x7f82900cba90 2024-04-04T06:56:09.135 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:09.134+0000 7f8295200640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8290151670 0x7f82900cb550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:09.135 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:09.134+0000 7f8295200640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8290151670 0x7f82900cb550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42852/0 (socket says 172.21.15.72:42852) 2024-04-04T06:56:09.135 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:09.134+0000 7f8295200640 1 -- 172.21.15.72:0/649812183 learned_addr learned my addr 172.21.15.72:0/649812183 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:56:09.135 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:09.134+0000 7f8295c00640 1 --2- 172.21.15.72:0/649812183 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8278003a00 0x7f82900cd2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:09.135 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:09.134+0000 7f8296600640 1 --2- 172.21.15.72:0/649812183 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f82900cba90 0x7f829009f5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:09.135 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:09.134+0000 7f8295200640 1 -- 172.21.15.72:0/649812183 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f82900cba90 msgr2=0x7f829009f5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:09.135 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:09.134+0000 7f8295200640 1 --2- 172.21.15.72:0/649812183 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f82900cba90 0x7f829009f5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:09.135 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:09.134+0000 7f8295200640 1 -- 172.21.15.72:0/649812183 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8278003a00 msgr2=0x7f82900cd2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:09.135 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:09.134+0000 7f8295200640 1 --2- 172.21.15.72:0/649812183 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8278003a00 0x7f82900cd2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:09.135 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:09.134+0000 7f8295200640 1 -- 172.21.15.72:0/649812183 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82900cc210 con 0x7f8290151670 2024-04-04T06:56:09.135 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:09.135+0000 7f8295200640 1 --2- 172.21.15.72:0/649812183 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8290151670 0x7f82900cb550 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f827c011bd0 tx=0x7f827c00f610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:09.135 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:09.135+0000 7f828d600640 1 -- 172.21.15.72:0/649812183 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f827c009690 con 0x7f8290151670 2024-04-04T06:56:09.135 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:09.135+0000 7f828d600640 1 -- 172.21.15.72:0/649812183 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f827c011cc0 con 0x7f8290151670 2024-04-04T06:56:09.135 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:09.135+0000 7f8297000640 1 -- 172.21.15.72:0/649812183 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82900cc4f0 con 0x7f8290151670 2024-04-04T06:56:09.135 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:09.135+0000 7f828d600640 1 -- 172.21.15.72:0/649812183 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f827c014660 con 0x7f8290151670 2024-04-04T06:56:09.136 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:09.135+0000 7f8297000640 1 -- 172.21.15.72:0/649812183 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82900ccab0 con 0x7f8290151670 2024-04-04T06:56:09.136 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:09.135+0000 7f828d600640 1 -- 172.21.15.72:0/649812183 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f827c012040 con 0x7f8290151670 2024-04-04T06:56:09.136 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:09.136+0000 7f828d600640 1 -- 172.21.15.72:0/649812183 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f827c01d5e0 con 0x7f8290151670 2024-04-04T06:56:09.136 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:09.136+0000 7f8297000640 1 -- 172.21.15.72:0/649812183 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f829004f950 con 0x7f8290151670 2024-04-04T06:56:09.139 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:09.141+0000 7f828d600640 1 -- 172.21.15.72:0/649812183 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f827c019030 con 0x7f8290151670 2024-04-04T06:56:09.170 INFO:tasks.ceph.mgr.y.smithi072.stderr:2024-04-04T06:56:09.172+0000 7fa15020d040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-04T06:56:09.205 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:09.207+0000 7f8297000640 1 -- 172.21.15.72:0/649812183 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f829006d470 con 0x7f8290151670 2024-04-04T06:56:09.206 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:09.208+0000 7f828d600640 1 -- 172.21.15.72:0/649812183 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f827c01d880 con 0x7f8290151670 2024-04-04T06:56:09.207 INFO:teuthology.misc.health.smithi072.stdout: 2024-04-04T06:56:09.207 INFO:teuthology.misc.health.smithi072.stdout:{"epoch":10,"fsid":"6708bac2-4f50-49b5-87a9-c390fd333eb3","created":"2024-04-04T06:56:04.282498+0000","modified":"2024-04-04T06:56:07.768593+0000","last_up_change":"0.000000","last_in_change":"2024-04-04T06:56:07.768593+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"7c345991-5af8-4dc6-a481-28610c40e128","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"1b3f7ab2-a56c-488d-a89a-1f3572361c95","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"fc9aa512-53df-40d7-ba04-3e6b7dcd1e34","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"b4f63eed-dc5b-4aba-bb50-de46eb41492b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"9e985ef8-d711-4172-9286-c54e560895d8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"3e9f082b-8d7d-455f-8a96-66d0b4857125","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"bcdafa9f-a870-4398-a38d-ab7697676473","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"b68ec562-ff35-4d2d-a733-c896f8920cfb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-04T06:56:09.208 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:09.209+0000 7f8297000640 1 -- 172.21.15.72:0/649812183 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8290151670 msgr2=0x7f82900cb550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:09.208 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:09.209+0000 7f8297000640 1 --2- 172.21.15.72:0/649812183 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8290151670 0x7f82900cb550 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f827c011bd0 tx=0x7f827c00f610 comp rx=0 tx=0).stop 2024-04-04T06:56:09.208 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:09.209+0000 7f8297000640 1 -- 172.21.15.72:0/649812183 shutdown_connections 2024-04-04T06:56:09.208 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:09.209+0000 7f8297000640 1 --2- 172.21.15.72:0/649812183 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f82900cba90 0x7f829009f5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:09.208 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:09.209+0000 7f8297000640 1 --2- 172.21.15.72:0/649812183 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8290151670 0x7f82900cb550 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:09.208 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:09.209+0000 7f8297000640 1 --2- 172.21.15.72:0/649812183 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8278003a00 0x7f82900cd2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:09.208 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:09.209+0000 7f8297000640 1 -- 172.21.15.72:0/649812183 >> 172.21.15.72:0/649812183 conn(0x7f829009d530 msgr2=0x7f829006c270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:56:09.208 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:09.210+0000 7f8297000640 1 -- 172.21.15.72:0/649812183 shutdown_connections 2024-04-04T06:56:09.208 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:09.210+0000 7f8297000640 1 -- 172.21.15.72:0/649812183 wait complete. 2024-04-04T06:56:09.220 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-04-04T06:56:09.232 INFO:tasks.ceph.mgr.y.smithi072.stderr:2024-04-04T06:56:09.234+0000 7fa15020d040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-04T06:56:09.362 INFO:tasks.ceph.mgr.y.smithi072.stderr:2024-04-04T06:56:09.364+0000 7fa15020d040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-04T06:56:09.652 INFO:tasks.ceph.mgr.x.smithi117.stderr:2024-04-04T06:56:09.653+0000 7f088ce45040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-04T06:56:09.962 INFO:tasks.ceph.mgr.x.smithi117.stderr:2024-04-04T06:56:09.963+0000 7f088ce45040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-04T06:56:10.022 INFO:tasks.ceph.mgr.x.smithi117.stderr:2024-04-04T06:56:10.023+0000 7f088ce45040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-04T06:56:10.149 INFO:tasks.ceph.mgr.x.smithi117.stderr:2024-04-04T06:56:10.150+0000 7f088ce45040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-04T06:56:10.404 INFO:tasks.ceph.mgr.y.smithi072.stderr:2024-04-04T06:56:10.405+0000 7fa0f0800640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-04-04T06:56:10.404 INFO:tasks.ceph.mgr.y.smithi072.stderr:2024-04-04T06:56:10.405+0000 7fa0f0800640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-04-04T06:56:11.825 INFO:tasks.ceph.osd.5.smithi117.stderr:2024-04-04T06:56:11.826+0000 7f145220e640 -1 osd.5 0 log_to_monitors true 2024-04-04T06:56:11.883 INFO:tasks.ceph.osd.4.smithi117.stderr:2024-04-04T06:56:11.884+0000 7f2491abf640 -1 osd.4 0 log_to_monitors true 2024-04-04T06:56:12.081 INFO:tasks.ceph.osd.6.smithi117.stderr:2024-04-04T06:56:12.082+0000 7fb93951d640 -1 osd.6 0 log_to_monitors true 2024-04-04T06:56:12.098 INFO:tasks.ceph.osd.3.smithi072.stderr:2024-04-04T06:56:12.100+0000 7f0d6b16d640 -1 osd.3 0 log_to_monitors true 2024-04-04T06:56:12.147 INFO:tasks.ceph.osd.7.smithi117.stderr:2024-04-04T06:56:12.149+0000 7f302c2f9640 -1 osd.7 0 log_to_monitors true 2024-04-04T06:56:12.279 INFO:tasks.ceph.osd.1.smithi072.stderr:2024-04-04T06:56:12.281+0000 7fa43aa1f640 -1 osd.1 0 log_to_monitors true 2024-04-04T06:56:12.331 INFO:tasks.ceph.osd.2.smithi072.stderr:2024-04-04T06:56:12.333+0000 7f7525414640 -1 osd.2 0 log_to_monitors true 2024-04-04T06:56:12.344 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-04T06:56:12.346+0000 7f4e6a58c640 -1 osd.0 0 log_to_monitors true 2024-04-04T06:56:14.185 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T06:56:14.190 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T06:56:15.711 INFO:tasks.ceph.osd.3.smithi072.stderr:2024-04-04T06:56:15.712+0000 7f0d66000640 -1 osd.3 0 waiting for initial osdmap 2024-04-04T06:56:15.718 INFO:tasks.ceph.osd.3.smithi072.stderr:2024-04-04T06:56:15.719+0000 7f0d5c000640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-04T06:56:15.722 INFO:tasks.ceph.osd.5.smithi117.stderr:2024-04-04T06:56:15.724+0000 7f144cc00640 -1 osd.5 0 waiting for initial osdmap 2024-04-04T06:56:15.724 INFO:tasks.ceph.osd.7.smithi117.stderr:2024-04-04T06:56:15.726+0000 7f3027c00640 -1 osd.7 0 waiting for initial osdmap 2024-04-04T06:56:15.730 INFO:tasks.ceph.osd.5.smithi117.stderr:2024-04-04T06:56:15.731+0000 7f1442c00640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-04T06:56:15.732 INFO:tasks.ceph.osd.7.smithi117.stderr:2024-04-04T06:56:15.733+0000 7f301d200640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-04T06:56:15.738 INFO:tasks.ceph.osd.1.smithi072.stderr:2024-04-04T06:56:15.740+0000 7fa435400640 -1 osd.1 0 waiting for initial osdmap 2024-04-04T06:56:15.740 INFO:tasks.ceph.osd.2.smithi072.stderr:2024-04-04T06:56:15.742+0000 7f751fc00640 -1 osd.2 0 waiting for initial osdmap 2024-04-04T06:56:15.747 INFO:tasks.ceph.osd.2.smithi072.stderr:2024-04-04T06:56:15.749+0000 7f7515c00640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-04T06:56:15.747 INFO:tasks.ceph.osd.1.smithi072.stderr:2024-04-04T06:56:15.748+0000 7fa42b400640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-04T06:56:15.751 INFO:tasks.ceph.osd.4.smithi117.stderr:2024-04-04T06:56:15.752+0000 7f248d400640 -1 osd.4 0 waiting for initial osdmap 2024-04-04T06:56:15.757 INFO:tasks.ceph.osd.4.smithi117.stderr:2024-04-04T06:56:15.759+0000 7f2482a00640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-04T06:56:15.768 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-04T06:56:15.770+0000 7f4e65400640 -1 osd.0 0 waiting for initial osdmap 2024-04-04T06:56:15.778 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-04T06:56:15.779+0000 7f4e5b400640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-04T06:56:15.782 INFO:tasks.ceph.osd.6.smithi117.stderr:2024-04-04T06:56:15.783+0000 7fb934e00640 -1 osd.6 0 waiting for initial osdmap 2024-04-04T06:56:15.790 INFO:tasks.ceph.osd.6.smithi117.stderr:2024-04-04T06:56:15.791+0000 7fb92a400640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-04T06:56:16.026 DEBUG:teuthology.orchestra.run.smithi072:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-04T06:56:16.208 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:16.210+0000 7f2b68e00640 1 Processor -- start 2024-04-04T06:56:16.208 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:16.210+0000 7f2b68e00640 1 -- start start 2024-04-04T06:56:16.210 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:16.211+0000 7f2b68e00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f2b64145be0 0x7f2b640ce180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:16.210 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:16.211+0000 7f2b68e00640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f2b6406dab0 0x7f2b6415c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:16.211 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:16.211+0000 7f2b68e00640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2b640b3280 con 0x7f2b640cca10 2024-04-04T06:56:16.211 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:16.211+0000 7f2b68e00640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f2b640b3030 con 0x7f2b6406dab0 2024-04-04T06:56:16.211 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:16.211+0000 7f2b68e00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f2b640b3560 con 0x7f2b64145be0 2024-04-04T06:56:16.211 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:16.212+0000 7f2b62800640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f2b6406dab0 0x7f2b6415c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:16.211 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:16.212+0000 7f2b5be00640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f2b640cca10 0x7f2b6406d3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:56300/0 (socket says 172.21.15.72:56300) 2024-04-04T06:56:16.211 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:16.212+0000 7f2b5be00640 1 -- 172.21.15.72:0/212992128 learned_addr learned my addr 172.21.15.72:0/212992128 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-04-04T06:56:16.211 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:16.212+0000 7f2b61e00640 1 --2- 172.21.15.72:0/212992128 >> v2:172.21.15.117:3300/0 conn(0x7f2b64145be0 0x7f2b640ce180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:16.211 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:16.212+0000 7f2b62800640 1 -- 172.21.15.72:0/212992128 >> v2:172.21.15.117:3300/0 conn(0x7f2b64145be0 msgr2=0x7f2b640ce180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:56:16.211 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:16.212+0000 7f2b62800640 1 --2- 172.21.15.72:0/212992128 >> v2:172.21.15.117:3300/0 conn(0x7f2b64145be0 0x7f2b640ce180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:16.211 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:16.212+0000 7f2b62800640 1 -- 172.21.15.72:0/212992128 >> v1:172.21.15.72:6789/0 conn(0x7f2b640cca10 legacy=0x7f2b6406d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:16.211 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:16.212+0000 7f2b62800640 1 -- 172.21.15.72:0/212992128 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b640b3840 con 0x7f2b6406dab0 2024-04-04T06:56:16.212 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:16.213+0000 7f2b62800640 1 --2- 172.21.15.72:0/212992128 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2b6406dab0 0x7f2b6415c7c0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f2b6406c040 tx=0x7f2b5c02be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=754ee9d64a7a1c14 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:16.212 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:16.213+0000 7f2b61400640 1 -- 172.21.15.72:0/212992128 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b5c039070 con 0x7f2b6406dab0 2024-04-04T06:56:16.212 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:16.213+0000 7f2b61400640 1 -- 172.21.15.72:0/212992128 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b5c02cbf0 con 0x7f2b6406dab0 2024-04-04T06:56:16.212 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:16.213+0000 7f2b61400640 1 -- 172.21.15.72:0/212992128 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b5c034440 con 0x7f2b6406dab0 2024-04-04T06:56:16.213 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:16.214+0000 7f2b68e00640 1 -- 172.21.15.72:0/212992128 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2b6406dab0 msgr2=0x7f2b6415c7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:16.213 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:16.214+0000 7f2b68e00640 1 --2- 172.21.15.72:0/212992128 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2b6406dab0 0x7f2b6415c7c0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f2b6406c040 tx=0x7f2b5c02be40 comp rx=0 tx=0).stop 2024-04-04T06:56:16.213 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:16.214+0000 7f2b68e00640 1 -- 172.21.15.72:0/212992128 shutdown_connections 2024-04-04T06:56:16.213 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:16.214+0000 7f2b68e00640 1 --2- 172.21.15.72:0/212992128 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2b6406dab0 0x7f2b6415c7c0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:16.213 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:16.214+0000 7f2b68e00640 1 --2- 172.21.15.72:0/212992128 >> v2:172.21.15.117:3300/0 conn(0x7f2b64145be0 0x7f2b640ce180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:16.213 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:16.214+0000 7f2b68e00640 1 -- 172.21.15.72:0/212992128 >> 172.21.15.72:0/212992128 conn(0x7f2b6406eca0 msgr2=0x7f2b6406b540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:56:16.213 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:16.214+0000 7f2b68e00640 1 -- 172.21.15.72:0/212992128 shutdown_connections 2024-04-04T06:56:16.213 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:16.214+0000 7f2b68e00640 1 -- 172.21.15.72:0/212992128 wait complete. 2024-04-04T06:56:16.214 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:16.216+0000 7f2b68e00640 1 Processor -- start 2024-04-04T06:56:16.214 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:16.216+0000 7f2b68e00640 1 -- start start 2024-04-04T06:56:16.217 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:16.217+0000 7f2b68e00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2b6406dab0 0x7f2b640721f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:16.217 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:16.217+0000 7f2b68e00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2b640cca10 0x7f2b6413aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:16.217 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:16.217+0000 7f2b68e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2b64145be0 0x7f2b6415c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:16.217 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:16.217+0000 7f2b68e00640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f2b6415fff0 con 0x7f2b6406dab0 2024-04-04T06:56:16.217 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:16.217+0000 7f2b68e00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f2b640b3e00 con 0x7f2b640cca10 2024-04-04T06:56:16.217 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:16.217+0000 7f2b68e00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f2b64160170 con 0x7f2b64145be0 2024-04-04T06:56:16.217 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:16.217+0000 7f2b61e00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2b6406dab0 0x7f2b640721f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:16.217 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:16.217+0000 7f2b61e00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2b6406dab0 0x7f2b640721f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43794/0 (socket says 172.21.15.72:43794) 2024-04-04T06:56:16.217 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:16.217+0000 7f2b61e00640 1 -- 172.21.15.72:0/4276144847 learned_addr learned my addr 172.21.15.72:0/4276144847 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:56:16.217 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:16.218+0000 7f2b5be00640 1 --2- 172.21.15.72:0/4276144847 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2b640cca10 0x7f2b6413aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:16.217 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:16.218+0000 7f2b61e00640 1 -- 172.21.15.72:0/4276144847 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2b64145be0 msgr2=0x7f2b6415c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:16.217 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:16.218+0000 7f2b61e00640 1 --2- 172.21.15.72:0/4276144847 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2b64145be0 0x7f2b6415c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:16.217 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:16.218+0000 7f2b61e00640 1 -- 172.21.15.72:0/4276144847 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2b640cca10 msgr2=0x7f2b6413aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:16.217 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:16.218+0000 7f2b61e00640 1 --2- 172.21.15.72:0/4276144847 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2b640cca10 0x7f2b6413aa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:16.218 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:16.218+0000 7f2b61e00640 1 -- 172.21.15.72:0/4276144847 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b64072730 con 0x7f2b6406dab0 2024-04-04T06:56:16.218 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:16.218+0000 7f2b5be00640 1 --2- 172.21.15.72:0/4276144847 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2b640cca10 0x7f2b6413aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-04T06:56:16.218 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:16.218+0000 7f2b61e00640 1 --2- 172.21.15.72:0/4276144847 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2b6406dab0 0x7f2b640721f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f2b5400d620 tx=0x7f2b5400dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:16.218 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:16.218+0000 7f2b5a000640 1 -- 172.21.15.72:0/4276144847 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b5400b620 con 0x7f2b6406dab0 2024-04-04T06:56:16.218 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:16.218+0000 7f2b5a000640 1 -- 172.21.15.72:0/4276144847 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b54019070 con 0x7f2b6406dab0 2024-04-04T06:56:16.218 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:16.218+0000 7f2b5a000640 1 -- 172.21.15.72:0/4276144847 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b5400ba00 con 0x7f2b6406dab0 2024-04-04T06:56:16.218 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:16.218+0000 7f2b68e00640 1 -- 172.21.15.72:0/4276144847 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b640729d0 con 0x7f2b6406dab0 2024-04-04T06:56:16.218 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:16.218+0000 7f2b68e00640 1 -- 172.21.15.72:0/4276144847 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b640ada60 con 0x7f2b6406dab0 2024-04-04T06:56:16.219 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:16.219+0000 7f2b68e00640 1 -- 172.21.15.72:0/4276144847 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b64068fb0 con 0x7f2b6406dab0 2024-04-04T06:56:16.219 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:16.220+0000 7f2b5a000640 1 -- 172.21.15.72:0/4276144847 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) ==== 90984+0+0 (secure 0 0 0) 0x7f2b5400bba0 con 0x7f2b6406dab0 2024-04-04T06:56:16.219 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:16.221+0000 7f2b5a000640 1 --2- 172.21.15.72:0/4276144847 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f2b4006c860 0x7f2b4006ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:16.219 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:16.221+0000 7f2b5a000640 1 -- 172.21.15.72:0/4276144847 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 2231+0+0 (secure 0 0 0) 0x7f2b5408b010 con 0x7f2b6406dab0 2024-04-04T06:56:16.219 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:16.221+0000 7f2b5be00640 1 --2- 172.21.15.72:0/4276144847 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f2b4006c860 0x7f2b4006ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:16.220 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:16.222+0000 7f2b5be00640 1 --2- 172.21.15.72:0/4276144847 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f2b4006c860 0x7f2b4006ed20 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f2b6415b600 tx=0x7f2b4c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:16.225 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:16.226+0000 7f2b5a000640 1 -- 172.21.15.72:0/4276144847 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f2b5405a340 con 0x7f2b6406dab0 2024-04-04T06:56:16.413 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:16.414+0000 7f2b68e00640 1 -- 172.21.15.72:0/4276144847 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2b641420b0 con 0x7f2b6406dab0 2024-04-04T06:56:16.414 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:16.416+0000 7f2b5a000640 1 -- 172.21.15.72:0/4276144847 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) ==== 74+0+7058 (secure 0 0 0) 0x7f2b54059c40 con 0x7f2b6406dab0 2024-04-04T06:56:16.414 INFO:teuthology.misc.health.smithi072.stdout: 2024-04-04T06:56:16.415 INFO:teuthology.misc.health.smithi072.stdout:{"epoch":12,"fsid":"6708bac2-4f50-49b5-87a9-c390fd333eb3","created":"2024-04-04T06:56:04.282498+0000","modified":"2024-04-04T06:56:13.410681+0000","last_up_change":"0.000000","last_in_change":"2024-04-04T06:56:07.768593+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"7c345991-5af8-4dc6-a481-28610c40e128","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"1b3f7ab2-a56c-488d-a89a-1f3572361c95","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"fc9aa512-53df-40d7-ba04-3e6b7dcd1e34","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"b4f63eed-dc5b-4aba-bb50-de46eb41492b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"9e985ef8-d711-4172-9286-c54e560895d8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"3e9f082b-8d7d-455f-8a96-66d0b4857125","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"bcdafa9f-a870-4398-a38d-ab7697676473","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"b68ec562-ff35-4d2d-a733-c896f8920cfb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-04T06:56:16.417 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:16.418+0000 7f2b68e00640 1 -- 172.21.15.72:0/4276144847 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f2b4006c860 msgr2=0x7f2b4006ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:16.417 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:16.418+0000 7f2b68e00640 1 --2- 172.21.15.72:0/4276144847 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f2b4006c860 0x7f2b4006ed20 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f2b6415b600 tx=0x7f2b4c009040 comp rx=0 tx=0).stop 2024-04-04T06:56:16.417 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:16.418+0000 7f2b68e00640 1 -- 172.21.15.72:0/4276144847 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2b6406dab0 msgr2=0x7f2b640721f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:16.417 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:16.418+0000 7f2b68e00640 1 --2- 172.21.15.72:0/4276144847 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2b6406dab0 0x7f2b640721f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f2b5400d620 tx=0x7f2b5400dae0 comp rx=0 tx=0).stop 2024-04-04T06:56:16.417 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:16.418+0000 7f2b68e00640 1 -- 172.21.15.72:0/4276144847 shutdown_connections 2024-04-04T06:56:16.417 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:16.418+0000 7f2b68e00640 1 --2- 172.21.15.72:0/4276144847 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f2b4006c860 0x7f2b4006ed20 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:16.417 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:16.418+0000 7f2b68e00640 1 --2- 172.21.15.72:0/4276144847 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2b64145be0 0x7f2b6415c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:16.417 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:16.418+0000 7f2b68e00640 1 --2- 172.21.15.72:0/4276144847 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2b640cca10 0x7f2b6413aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:16.417 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:16.418+0000 7f2b68e00640 1 --2- 172.21.15.72:0/4276144847 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2b6406dab0 0x7f2b640721f0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:16.417 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:16.418+0000 7f2b68e00640 1 -- 172.21.15.72:0/4276144847 >> 172.21.15.72:0/4276144847 conn(0x7f2b6406eca0 msgr2=0x7f2b6415a8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:56:16.418 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:16.419+0000 7f2b68e00640 1 -- 172.21.15.72:0/4276144847 shutdown_connections 2024-04-04T06:56:16.418 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:16.419+0000 7f2b68e00640 1 -- 172.21.15.72:0/4276144847 wait complete. 2024-04-04T06:56:16.431 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-04-04T06:56:23.237 DEBUG:teuthology.orchestra.run.smithi072:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-04T06:56:23.420 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:23.421+0000 7fdd07000640 1 Processor -- start 2024-04-04T06:56:23.420 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:23.421+0000 7fdd07000640 1 -- start start 2024-04-04T06:56:23.422 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:23.423+0000 7fdd07000640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fdd00154f80 0x7fdd00155360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:23.422 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:23.423+0000 7fdd07000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdd0006e610 0x7fdd0006ea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:23.422 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:23.423+0000 7fdd07000640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd000af710 con 0x7fdd00071200 2024-04-04T06:56:23.422 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:23.423+0000 7fdd07000640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7fdd0015f4b0 con 0x7fdd00154f80 2024-04-04T06:56:23.422 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:23.423+0000 7fdd07000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fdd0015f790 con 0x7fdd0006e610 2024-04-04T06:56:23.422 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:23.423+0000 7fdd05c00640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fdd00154f80 0x7fdd00155360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:23.422 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:23.423+0000 7fdd06600640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fdd00071200 0x7fdd000ce0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:39928/0 (socket says 172.21.15.72:39928) 2024-04-04T06:56:23.422 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:23.423+0000 7fdd06600640 1 -- 172.21.15.72:0/1325646986 learned_addr learned my addr 172.21.15.72:0/1325646986 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-04-04T06:56:23.422 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:23.424+0000 7fdd05200640 1 --2- 172.21.15.72:0/1325646986 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdd0006e610 0x7fdd0006ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:23.423 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:23.424+0000 7fdcffe00640 1 -- 172.21.15.72:0/1325646986 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 98363162 0 0) 0x7fdd000af710 con 0x7fdd00071200 2024-04-04T06:56:23.423 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:23.424+0000 7fdcffe00640 1 -- 172.21.15.72:0/1325646986 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdce8003520 con 0x7fdd00071200 2024-04-04T06:56:23.423 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:23.424+0000 7fdd05c00640 1 -- 172.21.15.72:0/1325646986 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdd0006e610 msgr2=0x7fdd0006ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:56:23.423 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:23.424+0000 7fdd05c00640 1 --2- 172.21.15.72:0/1325646986 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdd0006e610 0x7fdd0006ea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:23.424 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:23.424+0000 7fdd05c00640 1 -- 172.21.15.72:0/1325646986 >> v1:172.21.15.72:6789/0 conn(0x7fdd00071200 legacy=0x7fdd000ce0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:23.424 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:23.424+0000 7fdd05c00640 1 -- 172.21.15.72:0/1325646986 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd0006db30 con 0x7fdd00154f80 2024-04-04T06:56:23.424 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:23.424+0000 7fdd05200640 1 --2- 172.21.15.72:0/1325646986 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdd0006e610 0x7fdd0006ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-04T06:56:23.424 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:23.425+0000 7fdd05c00640 1 --2- 172.21.15.72:0/1325646986 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdd00154f80 0x7fdd00155360 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fdcf40097a0 tx=0x7fdcf402b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f055f64d75e6a390 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:23.425 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:23.425+0000 7fdcffe00640 1 -- 172.21.15.72:0/1325646986 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcf4035020 con 0x7fdd00154f80 2024-04-04T06:56:23.425 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:23.425+0000 7fdcffe00640 1 -- 172.21.15.72:0/1325646986 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdcf4031810 con 0x7fdd00154f80 2024-04-04T06:56:23.425 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:23.425+0000 7fdcffe00640 1 -- 172.21.15.72:0/1325646986 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcf4031be0 con 0x7fdd00154f80 2024-04-04T06:56:23.425 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:23.426+0000 7fdd07000640 1 -- 172.21.15.72:0/1325646986 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdd00154f80 msgr2=0x7fdd00155360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:23.425 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:23.426+0000 7fdd07000640 1 --2- 172.21.15.72:0/1325646986 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdd00154f80 0x7fdd00155360 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fdcf40097a0 tx=0x7fdcf402b8b0 comp rx=0 tx=0).stop 2024-04-04T06:56:23.425 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:23.426+0000 7fdd07000640 1 -- 172.21.15.72:0/1325646986 shutdown_connections 2024-04-04T06:56:23.425 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:23.426+0000 7fdd07000640 1 --2- 172.21.15.72:0/1325646986 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdd0006e610 0x7fdd0006ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:23.425 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:23.426+0000 7fdd07000640 1 --2- 172.21.15.72:0/1325646986 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdd00154f80 0x7fdd00155360 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:23.426 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:23.426+0000 7fdd07000640 1 -- 172.21.15.72:0/1325646986 >> 172.21.15.72:0/1325646986 conn(0x7fdd000b19d0 msgr2=0x7fdd000b1db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:56:23.426 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:23.426+0000 7fdd07000640 1 -- 172.21.15.72:0/1325646986 shutdown_connections 2024-04-04T06:56:23.426 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:23.426+0000 7fdd07000640 1 -- 172.21.15.72:0/1325646986 wait complete. 2024-04-04T06:56:23.426 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:23.428+0000 7fdd07000640 1 Processor -- start 2024-04-04T06:56:23.426 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:23.428+0000 7fdd07000640 1 -- start start 2024-04-04T06:56:23.429 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:23.429+0000 7fdd07000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdd0006e610 0x7fdd000cbf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:23.429 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:23.429+0000 7fdd07000640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdd00071200 0x7fdd000adde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:23.429 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:23.429+0000 7fdd07000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdd00154f80 0x7fdd000ae320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:23.429 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:23.429+0000 7fdd07000640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fdd000ce7d0 con 0x7fdd00071200 2024-04-04T06:56:23.429 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:23.429+0000 7fdd07000640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fdd0006e0f0 con 0x7fdd0006e610 2024-04-04T06:56:23.429 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:23.429+0000 7fdd07000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fdd000ce950 con 0x7fdd00154f80 2024-04-04T06:56:23.429 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:23.429+0000 7fdd05200640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdd00071200 0x7fdd000adde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:23.429 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:23.429+0000 7fdd05200640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdd00071200 0x7fdd000adde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:52732/0 (socket says 172.21.15.72:52732) 2024-04-04T06:56:23.429 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:23.429+0000 7fdd05200640 1 -- 172.21.15.72:0/402258467 learned_addr learned my addr 172.21.15.72:0/402258467 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:56:23.429 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:23.429+0000 7fdd06600640 1 --2- 172.21.15.72:0/402258467 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdd00154f80 0x7fdd000ae320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:23.429 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:23.429+0000 7fdd05c00640 1 --2- 172.21.15.72:0/402258467 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdd0006e610 0x7fdd000cbf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:23.429 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:23.430+0000 7fdd05200640 1 -- 172.21.15.72:0/402258467 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdd00154f80 msgr2=0x7fdd000ae320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:23.430 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:23.430+0000 7fdd05200640 1 --2- 172.21.15.72:0/402258467 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdd00154f80 0x7fdd000ae320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:23.430 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:23.430+0000 7fdd05200640 1 -- 172.21.15.72:0/402258467 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdd0006e610 msgr2=0x7fdd000cbf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:23.430 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:23.430+0000 7fdd05200640 1 --2- 172.21.15.72:0/402258467 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdd0006e610 0x7fdd000cbf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:23.430 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:23.430+0000 7fdd05200640 1 -- 172.21.15.72:0/402258467 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd001594e0 con 0x7fdd00071200 2024-04-04T06:56:23.430 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:23.430+0000 7fdd05200640 1 --2- 172.21.15.72:0/402258467 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdd00071200 0x7fdd000adde0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fdcec00e810 tx=0x7fdcec00ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:23.430 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:23.430+0000 7fdcfd600640 1 -- 172.21.15.72:0/402258467 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcec00f040 con 0x7fdd00071200 2024-04-04T06:56:23.430 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:23.430+0000 7fdcfd600640 1 -- 172.21.15.72:0/402258467 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdcec004030 con 0x7fdd00071200 2024-04-04T06:56:23.430 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:23.430+0000 7fdd07000640 1 -- 172.21.15.72:0/402258467 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd001597c0 con 0x7fdd00071200 2024-04-04T06:56:23.430 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:23.430+0000 7fdcfd600640 1 -- 172.21.15.72:0/402258467 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcec004400 con 0x7fdd00071200 2024-04-04T06:56:23.430 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:23.430+0000 7fdd07000640 1 -- 172.21.15.72:0/402258467 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd000cc470 con 0x7fdd00071200 2024-04-04T06:56:23.431 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:23.431+0000 7fdd07000640 1 -- 172.21.15.72:0/402258467 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd0004f950 con 0x7fdd00071200 2024-04-04T06:56:23.431 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:23.432+0000 7fdcfd600640 1 -- 172.21.15.72:0/402258467 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fdcec00c6d0 con 0x7fdd00071200 2024-04-04T06:56:23.432 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:23.433+0000 7fdcfd600640 1 --2- 172.21.15.72:0/402258467 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fdce006c8f0 0x7fdce006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:23.432 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:23.433+0000 7fdcfd600640 1 -- 172.21.15.72:0/402258467 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7fdcec08b660 con 0x7fdd00071200 2024-04-04T06:56:23.432 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:23.433+0000 7fdd05c00640 1 --2- 172.21.15.72:0/402258467 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fdce006c8f0 0x7fdce006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:23.432 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:23.434+0000 7fdd05c00640 1 --2- 172.21.15.72:0/402258467 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fdce006c8f0 0x7fdce006edb0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fdcf4036000 tx=0x7fdcf403c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:23.437 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:23.439+0000 7fdcfd600640 1 -- 172.21.15.72:0/402258467 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fdcec017020 con 0x7fdd00071200 2024-04-04T06:56:23.641 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:23.642+0000 7fdd07000640 1 -- 172.21.15.72:0/402258467 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fdd000ce130 con 0x7fdd00071200 2024-04-04T06:56:23.643 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:23.645+0000 7fdcfd600640 1 -- 172.21.15.72:0/402258467 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) ==== 74+0+12860 (secure 0 0 0) 0x7fdcec059d40 con 0x7fdd00071200 2024-04-04T06:56:23.643 INFO:teuthology.misc.health.smithi072.stdout: 2024-04-04T06:56:23.644 INFO:teuthology.misc.health.smithi072.stdout:{"epoch":16,"fsid":"6708bac2-4f50-49b5-87a9-c390fd333eb3","created":"2024-04-04T06:56:04.282498+0000","modified":"2024-04-04T06:56:19.770560+0000","last_up_change":"2024-04-04T06:56:16.716089+0000","last_in_change":"2024-04-04T06:56:07.768593+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-04T06:56:17.421685+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7c345991-5af8-4dc6-a481-28610c40e128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":3889813953},{"type":"v1","addr":"172.21.15.72:6818","nonce":3889813953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":3889813953},{"type":"v1","addr":"172.21.15.72:6821","nonce":3889813953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":3889813953},{"type":"v1","addr":"172.21.15.72:6826","nonce":3889813953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":3889813953},{"type":"v1","addr":"172.21.15.72:6823","nonce":3889813953}]},"public_addr":"172.21.15.72:6818/3889813953","cluster_addr":"172.21.15.72:6821/3889813953","heartbeat_back_addr":"172.21.15.72:6826/3889813953","heartbeat_front_addr":"172.21.15.72:6823/3889813953","state":["exists","up"]},{"osd":1,"uuid":"1b3f7ab2-a56c-488d-a89a-1f3572361c95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":3101663154},{"type":"v1","addr":"172.21.15.72:6801","nonce":3101663154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":3101663154},{"type":"v1","addr":"172.21.15.72:6803","nonce":3101663154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":3101663154},{"type":"v1","addr":"172.21.15.72:6807","nonce":3101663154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":3101663154},{"type":"v1","addr":"172.21.15.72:6805","nonce":3101663154}]},"public_addr":"172.21.15.72:6801/3101663154","cluster_addr":"172.21.15.72:6803/3101663154","heartbeat_back_addr":"172.21.15.72:6807/3101663154","heartbeat_front_addr":"172.21.15.72:6805/3101663154","state":["exists","up"]},{"osd":2,"uuid":"fc9aa512-53df-40d7-ba04-3e6b7dcd1e34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":235374192},{"type":"v1","addr":"172.21.15.72:6809","nonce":235374192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":235374192},{"type":"v1","addr":"172.21.15.72:6811","nonce":235374192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":235374192},{"type":"v1","addr":"172.21.15.72:6815","nonce":235374192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":235374192},{"type":"v1","addr":"172.21.15.72:6813","nonce":235374192}]},"public_addr":"172.21.15.72:6809/235374192","cluster_addr":"172.21.15.72:6811/235374192","heartbeat_back_addr":"172.21.15.72:6815/235374192","heartbeat_front_addr":"172.21.15.72:6813/235374192","state":["exists","up"]},{"osd":3,"uuid":"b4f63eed-dc5b-4aba-bb50-de46eb41492b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6817","nonce":2806631742},{"type":"v1","addr":"172.21.15.72:6819","nonce":2806631742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":2806631742},{"type":"v1","addr":"172.21.15.72:6827","nonce":2806631742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":2806631742},{"type":"v1","addr":"172.21.15.72:6831","nonce":2806631742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":2806631742},{"type":"v1","addr":"172.21.15.72:6829","nonce":2806631742}]},"public_addr":"172.21.15.72:6819/2806631742","cluster_addr":"172.21.15.72:6827/2806631742","heartbeat_back_addr":"172.21.15.72:6831/2806631742","heartbeat_front_addr":"172.21.15.72:6829/2806631742","state":["exists","up"]},{"osd":4,"uuid":"9e985ef8-d711-4172-9286-c54e560895d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":4293536423},{"type":"v1","addr":"172.21.15.117:6825","nonce":4293536423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":4293536423},{"type":"v1","addr":"172.21.15.117:6827","nonce":4293536423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":4293536423},{"type":"v1","addr":"172.21.15.117:6831","nonce":4293536423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":4293536423},{"type":"v1","addr":"172.21.15.117:6829","nonce":4293536423}]},"public_addr":"172.21.15.117:6825/4293536423","cluster_addr":"172.21.15.117:6827/4293536423","heartbeat_back_addr":"172.21.15.117:6831/4293536423","heartbeat_front_addr":"172.21.15.117:6829/4293536423","state":["exists","up"]},{"osd":5,"uuid":"3e9f082b-8d7d-455f-8a96-66d0b4857125","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":684971679},{"type":"v1","addr":"172.21.15.117:6801","nonce":684971679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":684971679},{"type":"v1","addr":"172.21.15.117:6803","nonce":684971679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":684971679},{"type":"v1","addr":"172.21.15.117:6807","nonce":684971679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":684971679},{"type":"v1","addr":"172.21.15.117:6805","nonce":684971679}]},"public_addr":"172.21.15.117:6801/684971679","cluster_addr":"172.21.15.117:6803/684971679","heartbeat_back_addr":"172.21.15.117:6807/684971679","heartbeat_front_addr":"172.21.15.117:6805/684971679","state":["exists","up"]},{"osd":6,"uuid":"bcdafa9f-a870-4398-a38d-ab7697676473","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":2781186528},{"type":"v1","addr":"172.21.15.117:6809","nonce":2781186528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":2781186528},{"type":"v1","addr":"172.21.15.117:6811","nonce":2781186528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":2781186528},{"type":"v1","addr":"172.21.15.117:6815","nonce":2781186528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":2781186528},{"type":"v1","addr":"172.21.15.117:6813","nonce":2781186528}]},"public_addr":"172.21.15.117:6809/2781186528","cluster_addr":"172.21.15.117:6811/2781186528","heartbeat_back_addr":"172.21.15.117:6815/2781186528","heartbeat_front_addr":"172.21.15.117:6813/2781186528","state":["exists","up"]},{"osd":7,"uuid":"b68ec562-ff35-4d2d-a733-c896f8920cfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":617469882},{"type":"v1","addr":"172.21.15.117:6817","nonce":617469882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":617469882},{"type":"v1","addr":"172.21.15.117:6819","nonce":617469882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":617469882},{"type":"v1","addr":"172.21.15.117:6823","nonce":617469882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":617469882},{"type":"v1","addr":"172.21.15.117:6821","nonce":617469882}]},"public_addr":"172.21.15.117:6817/617469882","cluster_addr":"172.21.15.117:6819/617469882","heartbeat_back_addr":"172.21.15.117:6823/617469882","heartbeat_front_addr":"172.21.15.117:6821/617469882","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.347700+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.296619+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.361345+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.093323+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:12.857605+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:12.816090+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.083163+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.121639+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-04T06:56:23.646 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:23.647+0000 7fdd07000640 1 -- 172.21.15.72:0/402258467 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fdce006c8f0 msgr2=0x7fdce006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:23.646 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:23.647+0000 7fdd07000640 1 --2- 172.21.15.72:0/402258467 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fdce006c8f0 0x7fdce006edb0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fdcf4036000 tx=0x7fdcf403c040 comp rx=0 tx=0).stop 2024-04-04T06:56:23.646 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:23.647+0000 7fdd07000640 1 -- 172.21.15.72:0/402258467 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdd00071200 msgr2=0x7fdd000adde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:23.646 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:23.647+0000 7fdd07000640 1 --2- 172.21.15.72:0/402258467 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdd00071200 0x7fdd000adde0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fdcec00e810 tx=0x7fdcec00ecd0 comp rx=0 tx=0).stop 2024-04-04T06:56:23.646 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:23.647+0000 7fdd07000640 1 -- 172.21.15.72:0/402258467 shutdown_connections 2024-04-04T06:56:23.646 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:23.647+0000 7fdd07000640 1 --2- 172.21.15.72:0/402258467 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fdce006c8f0 0x7fdce006edb0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:23.647 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:23.647+0000 7fdd07000640 1 --2- 172.21.15.72:0/402258467 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdd00154f80 0x7fdd000ae320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:23.647 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:23.647+0000 7fdd07000640 1 --2- 172.21.15.72:0/402258467 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdd00071200 0x7fdd000adde0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:23.647 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:23.647+0000 7fdd07000640 1 --2- 172.21.15.72:0/402258467 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdd0006e610 0x7fdd000cbf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:23.647 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:23.647+0000 7fdd07000640 1 -- 172.21.15.72:0/402258467 >> 172.21.15.72:0/402258467 conn(0x7fdd000b19d0 msgr2=0x7fdd00158520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:56:23.647 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:23.648+0000 7fdd07000640 1 -- 172.21.15.72:0/402258467 shutdown_connections 2024-04-04T06:56:23.647 INFO:teuthology.misc.health.smithi072.stderr:2024-04-04T06:56:23.648+0000 7fdd07000640 1 -- 172.21.15.72:0/402258467 wait complete. 2024-04-04T06:56:23.660 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-04-04T06:56:23.660 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-04-04T06:56:23.661 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-04T06:56:23.661 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-04T06:56:23.666 INFO:tasks.ceph.mds.a:Started 2024-04-04T06:56:23.666 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-04T06:56:23.666 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-04T06:56:23.673 INFO:tasks.ceph.mds.c:Started 2024-04-04T06:56:23.673 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-04T06:56:23.673 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-04T06:56:23.681 INFO:tasks.ceph.mds.b:Started 2024-04-04T06:56:23.681 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-04T06:56:23.681 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-04T06:56:23.688 INFO:tasks.ceph.mds.d:Started 2024-04-04T06:56:23.688 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-04-04T06:56:23.689 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-04T06:56:23.821 INFO:tasks.ceph.mds.a.smithi072.stdout:starting mds.a at 2024-04-04T06:56:23.836 INFO:tasks.ceph.mds.c.smithi072.stdout:starting mds.c at 2024-04-04T06:56:23.845 INFO:tasks.ceph.mds.b.smithi117.stdout:starting mds.b at 2024-04-04T06:56:23.846 INFO:tasks.ceph.mds.d.smithi117.stdout:starting mds.d at 2024-04-04T06:56:23.875 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:23.876+0000 7f9b31000640 1 Processor -- start 2024-04-04T06:56:23.875 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:23.876+0000 7f9b31000640 1 -- start start 2024-04-04T06:56:23.876 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:23.878+0000 7f9b31000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9b2c0b9d10 0x7f9b2c0cf0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:23.876 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:23.878+0000 7f9b31000640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f9b2c0cf620 0x7f9b2c0d2d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:23.876 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:23.878+0000 7f9b31000640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b2c06cd30 con 0x7f9b2c15e590 2024-04-04T06:56:23.877 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:23.878+0000 7f9b31000640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f9b2c0cfa90 con 0x7f9b2c0cf620 2024-04-04T06:56:23.877 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:23.878+0000 7f9b31000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f9b2c06d010 con 0x7f9b2c0b9d10 2024-04-04T06:56:23.877 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:23.878+0000 7f9b2a800640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f9b2c0cf620 0x7f9b2c0d2d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:23.877 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:23.878+0000 7f9b29e00640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f9b2c15e590 0x7f9b2c06c430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.72:50286/0 (socket says 172.21.15.72:50286) 2024-04-04T06:56:23.877 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:23.878+0000 7f9b29e00640 1 -- 172.21.15.72:0/3337906830 learned_addr learned my addr 172.21.15.72:0/3337906830 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-04-04T06:56:23.877 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:23.878+0000 7f9b23e00640 1 --2- 172.21.15.72:0/3337906830 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9b2c0b9d10 0x7f9b2c0cf0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:23.877 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:23.878+0000 7f9b29400640 1 -- 172.21.15.72:0/3337906830 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1297405804 0 0) 0x7f9b2c06cd30 con 0x7f9b2c15e590 2024-04-04T06:56:23.878 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:23.878+0000 7f9b29400640 1 -- 172.21.15.72:0/3337906830 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9b10003520 con 0x7f9b2c15e590 2024-04-04T06:56:23.878 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:23.878+0000 7f9b23e00640 1 -- 172.21.15.72:0/3337906830 >> v2:172.21.15.72:3300/0 conn(0x7f9b2c0cf620 msgr2=0x7f9b2c0d2d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:56:23.878 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:23.878+0000 7f9b23e00640 1 --2- 172.21.15.72:0/3337906830 >> v2:172.21.15.72:3300/0 conn(0x7f9b2c0cf620 0x7f9b2c0d2d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:23.878 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:23.878+0000 7f9b23e00640 1 -- 172.21.15.72:0/3337906830 >> v1:172.21.15.117:6789/0 conn(0x7f9b2c15e590 legacy=0x7f9b2c06c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:23.878 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:23.878+0000 7f9b23e00640 1 -- 172.21.15.72:0/3337906830 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b2c06d2f0 con 0x7f9b2c0b9d10 2024-04-04T06:56:23.878 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:23.878+0000 7f9b2a800640 1 --2- 172.21.15.72:0/3337906830 >> v2:172.21.15.72:3300/0 conn(0x7f9b2c0cf620 0x7f9b2c0d2d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-04T06:56:23.879 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:23.879+0000 7f9b23e00640 1 --2- 172.21.15.72:0/3337906830 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9b2c0b9d10 0x7f9b2c0cf0e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f9b140097a0 tx=0x7f9b1402b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=22cb56fe9c4c080e server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:23.879 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:23.880+0000 7f9b29400640 1 -- 172.21.15.72:0/3337906830 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b14035020 con 0x7f9b2c0b9d10 2024-04-04T06:56:23.879 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:23.880+0000 7f9b29400640 1 -- 172.21.15.72:0/3337906830 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b14031810 con 0x7f9b2c0b9d10 2024-04-04T06:56:23.879 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:23.880+0000 7f9b29400640 1 -- 172.21.15.72:0/3337906830 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b14031be0 con 0x7f9b2c0b9d10 2024-04-04T06:56:23.879 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:23.880+0000 7f9b31000640 1 -- 172.21.15.72:0/3337906830 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9b2c0b9d10 msgr2=0x7f9b2c0cf0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:23.880 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:23.880+0000 7f9b31000640 1 --2- 172.21.15.72:0/3337906830 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9b2c0b9d10 0x7f9b2c0cf0e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f9b140097a0 tx=0x7f9b1402b8b0 comp rx=0 tx=0).stop 2024-04-04T06:56:23.880 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:23.881+0000 7f9b31000640 1 -- 172.21.15.72:0/3337906830 shutdown_connections 2024-04-04T06:56:23.880 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:23.881+0000 7f9b31000640 1 --2- 172.21.15.72:0/3337906830 >> v2:172.21.15.72:3300/0 conn(0x7f9b2c0cf620 0x7f9b2c0d2d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:23.880 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:23.881+0000 7f9b31000640 1 --2- 172.21.15.72:0/3337906830 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9b2c0b9d10 0x7f9b2c0cf0e0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:23.880 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:23.881+0000 7f9b31000640 1 -- 172.21.15.72:0/3337906830 >> 172.21.15.72:0/3337906830 conn(0x7f9b2c0d0f70 msgr2=0x7f9b2c0d1380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:56:23.880 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:23.881+0000 7f9b31000640 1 -- 172.21.15.72:0/3337906830 shutdown_connections 2024-04-04T06:56:23.880 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:23.881+0000 7f9b31000640 1 -- 172.21.15.72:0/3337906830 wait complete. 2024-04-04T06:56:23.881 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:23.882+0000 7f9b31000640 1 Processor -- start 2024-04-04T06:56:23.881 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:23.882+0000 7f9b31000640 1 -- start start 2024-04-04T06:56:23.883 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:23.883+0000 7f9b31000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9b2c0b9d10 0x7f9b2c1f8420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:23.883 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:23.883+0000 7f9b31000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9b2c0cf620 0x7f9b2c1583a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:23.883 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:23.883+0000 7f9b31000640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9b2c15e590 0x7f9b2c0b5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:23.884 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:23.883+0000 7f9b31000640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f9b2c0d3250 con 0x7f9b2c15e590 2024-04-04T06:56:23.884 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:23.883+0000 7f9b31000640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f9b2c15e970 con 0x7f9b2c0cf620 2024-04-04T06:56:23.884 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:23.883+0000 7f9b31000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f9b2c0d33d0 con 0x7f9b2c0b9d10 2024-04-04T06:56:23.884 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:23.883+0000 7f9b2a800640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9b2c15e590 0x7f9b2c0b5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:23.884 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:23.884+0000 7f9b2a800640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9b2c15e590 0x7f9b2c0b5ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:52806/0 (socket says 172.21.15.72:52806) 2024-04-04T06:56:23.884 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:23.884+0000 7f9b2a800640 1 -- 172.21.15.72:0/3064979323 learned_addr learned my addr 172.21.15.72:0/3064979323 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:56:23.884 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:23.884+0000 7f9b29e00640 1 --2- 172.21.15.72:0/3064979323 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9b2c0b9d10 0x7f9b2c1f8420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:23.884 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:23.884+0000 7f9b23e00640 1 --2- 172.21.15.72:0/3064979323 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9b2c0cf620 0x7f9b2c1583a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:23.884 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:23.884+0000 7f9b2a800640 1 -- 172.21.15.72:0/3064979323 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9b2c0b9d10 msgr2=0x7f9b2c1f8420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:23.884 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:23.884+0000 7f9b2a800640 1 --2- 172.21.15.72:0/3064979323 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9b2c0b9d10 0x7f9b2c1f8420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:23.884 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:23.884+0000 7f9b2a800640 1 -- 172.21.15.72:0/3064979323 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9b2c0cf620 msgr2=0x7f9b2c1583a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:23.884 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:23.884+0000 7f9b2a800640 1 --2- 172.21.15.72:0/3064979323 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9b2c0cf620 0x7f9b2c1583a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:23.884 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:23.884+0000 7f9b2a800640 1 -- 172.21.15.72:0/3064979323 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b2c1f8960 con 0x7f9b2c15e590 2024-04-04T06:56:23.884 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:23.884+0000 7f9b23e00640 1 --2- 172.21.15.72:0/3064979323 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9b2c0cf620 0x7f9b2c1583a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-04T06:56:23.884 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:23.884+0000 7f9b29e00640 1 --2- 172.21.15.72:0/3064979323 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9b2c0b9d10 0x7f9b2c1f8420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-04T06:56:23.885 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:23.884+0000 7f9b2a800640 1 --2- 172.21.15.72:0/3064979323 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9b2c15e590 0x7f9b2c0b5ad0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f9b2400efc0 tx=0x7f9b24009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:23.885 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:23.884+0000 7f9b22000640 1 -- 172.21.15.72:0/3064979323 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b24018030 con 0x7f9b2c15e590 2024-04-04T06:56:23.885 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:23.884+0000 7f9b22000640 1 -- 172.21.15.72:0/3064979323 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b2400cde0 con 0x7f9b2c15e590 2024-04-04T06:56:23.885 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:23.884+0000 7f9b22000640 1 -- 172.21.15.72:0/3064979323 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b24003bb0 con 0x7f9b2c15e590 2024-04-04T06:56:23.885 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:23.885+0000 7f9b31000640 1 -- 172.21.15.72:0/3064979323 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b2c1588e0 con 0x7f9b2c15e590 2024-04-04T06:56:23.885 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:23.885+0000 7f9b31000640 1 -- 172.21.15.72:0/3064979323 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b2c0cbc30 con 0x7f9b2c15e590 2024-04-04T06:56:23.885 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:23.886+0000 7f9b31000640 1 -- 172.21.15.72:0/3064979323 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b2c075840 con 0x7f9b2c15e590 2024-04-04T06:56:23.885 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:23.887+0000 7f9b22000640 1 -- 172.21.15.72:0/3064979323 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9b24005d10 con 0x7f9b2c15e590 2024-04-04T06:56:23.886 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:23.888+0000 7f9b22000640 1 --2- 172.21.15.72:0/3064979323 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f9b0806c8f0 0x7f9b0806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:23.887 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:23.888+0000 7f9b22000640 1 -- 172.21.15.72:0/3064979323 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f9b2408c280 con 0x7f9b2c15e590 2024-04-04T06:56:23.887 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:23.888+0000 7f9b29e00640 1 --2- 172.21.15.72:0/3064979323 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f9b0806c8f0 0x7f9b0806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:23.887 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:23.889+0000 7f9b29e00640 1 --2- 172.21.15.72:0/3064979323 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f9b0806c8f0 0x7f9b0806edb0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f9b1c000f60 tx=0x7f9b1c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:23.891 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:23.893+0000 7f9b22000640 1 -- 172.21.15.72:0/3064979323 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f9b24022070 con 0x7f9b2c15e590 2024-04-04T06:56:24.093 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:24.095+0000 7f9b31000640 1 -- 172.21.15.72:0/3064979323 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9b2c0ce6a0 con 0x7f9b2c15e590 2024-04-04T06:56:24.094 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:24.096+0000 7f9b22000640 1 -- 172.21.15.72:0/3064979323 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) ==== 74+0+12860 (secure 0 0 0) 0x7f9b2c1f8960 con 0x7f9b2c15e590 2024-04-04T06:56:24.095 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T06:56:24.095 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":16,"fsid":"6708bac2-4f50-49b5-87a9-c390fd333eb3","created":"2024-04-04T06:56:04.282498+0000","modified":"2024-04-04T06:56:19.770560+0000","last_up_change":"2024-04-04T06:56:16.716089+0000","last_in_change":"2024-04-04T06:56:07.768593+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-04T06:56:17.421685+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7c345991-5af8-4dc6-a481-28610c40e128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":3889813953},{"type":"v1","addr":"172.21.15.72:6818","nonce":3889813953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":3889813953},{"type":"v1","addr":"172.21.15.72:6821","nonce":3889813953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":3889813953},{"type":"v1","addr":"172.21.15.72:6826","nonce":3889813953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":3889813953},{"type":"v1","addr":"172.21.15.72:6823","nonce":3889813953}]},"public_addr":"172.21.15.72:6818/3889813953","cluster_addr":"172.21.15.72:6821/3889813953","heartbeat_back_addr":"172.21.15.72:6826/3889813953","heartbeat_front_addr":"172.21.15.72:6823/3889813953","state":["exists","up"]},{"osd":1,"uuid":"1b3f7ab2-a56c-488d-a89a-1f3572361c95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":3101663154},{"type":"v1","addr":"172.21.15.72:6801","nonce":3101663154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":3101663154},{"type":"v1","addr":"172.21.15.72:6803","nonce":3101663154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":3101663154},{"type":"v1","addr":"172.21.15.72:6807","nonce":3101663154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":3101663154},{"type":"v1","addr":"172.21.15.72:6805","nonce":3101663154}]},"public_addr":"172.21.15.72:6801/3101663154","cluster_addr":"172.21.15.72:6803/3101663154","heartbeat_back_addr":"172.21.15.72:6807/3101663154","heartbeat_front_addr":"172.21.15.72:6805/3101663154","state":["exists","up"]},{"osd":2,"uuid":"fc9aa512-53df-40d7-ba04-3e6b7dcd1e34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":235374192},{"type":"v1","addr":"172.21.15.72:6809","nonce":235374192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":235374192},{"type":"v1","addr":"172.21.15.72:6811","nonce":235374192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":235374192},{"type":"v1","addr":"172.21.15.72:6815","nonce":235374192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":235374192},{"type":"v1","addr":"172.21.15.72:6813","nonce":235374192}]},"public_addr":"172.21.15.72:6809/235374192","cluster_addr":"172.21.15.72:6811/235374192","heartbeat_back_addr":"172.21.15.72:6815/235374192","heartbeat_front_addr":"172.21.15.72:6813/235374192","state":["exists","up"]},{"osd":3,"uuid":"b4f63eed-dc5b-4aba-bb50-de46eb41492b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6817","nonce":2806631742},{"type":"v1","addr":"172.21.15.72:6819","nonce":2806631742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":2806631742},{"type":"v1","addr":"172.21.15.72:6827","nonce":2806631742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":2806631742},{"type":"v1","addr":"172.21.15.72:6831","nonce":2806631742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":2806631742},{"type":"v1","addr":"172.21.15.72:6829","nonce":2806631742}]},"public_addr":"172.21.15.72:6819/2806631742","cluster_addr":"172.21.15.72:6827/2806631742","heartbeat_back_addr":"172.21.15.72:6831/2806631742","heartbeat_front_addr":"172.21.15.72:6829/2806631742","state":["exists","up"]},{"osd":4,"uuid":"9e985ef8-d711-4172-9286-c54e560895d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":4293536423},{"type":"v1","addr":"172.21.15.117:6825","nonce":4293536423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":4293536423},{"type":"v1","addr":"172.21.15.117:6827","nonce":4293536423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":4293536423},{"type":"v1","addr":"172.21.15.117:6831","nonce":4293536423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":4293536423},{"type":"v1","addr":"172.21.15.117:6829","nonce":4293536423}]},"public_addr":"172.21.15.117:6825/4293536423","cluster_addr":"172.21.15.117:6827/4293536423","heartbeat_back_addr":"172.21.15.117:6831/4293536423","heartbeat_front_addr":"172.21.15.117:6829/4293536423","state":["exists","up"]},{"osd":5,"uuid":"3e9f082b-8d7d-455f-8a96-66d0b4857125","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":684971679},{"type":"v1","addr":"172.21.15.117:6801","nonce":684971679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":684971679},{"type":"v1","addr":"172.21.15.117:6803","nonce":684971679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":684971679},{"type":"v1","addr":"172.21.15.117:6807","nonce":684971679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":684971679},{"type":"v1","addr":"172.21.15.117:6805","nonce":684971679}]},"public_addr":"172.21.15.117:6801/684971679","cluster_addr":"172.21.15.117:6803/684971679","heartbeat_back_addr":"172.21.15.117:6807/684971679","heartbeat_front_addr":"172.21.15.117:6805/684971679","state":["exists","up"]},{"osd":6,"uuid":"bcdafa9f-a870-4398-a38d-ab7697676473","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":2781186528},{"type":"v1","addr":"172.21.15.117:6809","nonce":2781186528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":2781186528},{"type":"v1","addr":"172.21.15.117:6811","nonce":2781186528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":2781186528},{"type":"v1","addr":"172.21.15.117:6815","nonce":2781186528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":2781186528},{"type":"v1","addr":"172.21.15.117:6813","nonce":2781186528}]},"public_addr":"172.21.15.117:6809/2781186528","cluster_addr":"172.21.15.117:6811/2781186528","heartbeat_back_addr":"172.21.15.117:6815/2781186528","heartbeat_front_addr":"172.21.15.117:6813/2781186528","state":["exists","up"]},{"osd":7,"uuid":"b68ec562-ff35-4d2d-a733-c896f8920cfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":617469882},{"type":"v1","addr":"172.21.15.117:6817","nonce":617469882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":617469882},{"type":"v1","addr":"172.21.15.117:6819","nonce":617469882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":617469882},{"type":"v1","addr":"172.21.15.117:6823","nonce":617469882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":617469882},{"type":"v1","addr":"172.21.15.117:6821","nonce":617469882}]},"public_addr":"172.21.15.117:6817/617469882","cluster_addr":"172.21.15.117:6819/617469882","heartbeat_back_addr":"172.21.15.117:6823/617469882","heartbeat_front_addr":"172.21.15.117:6821/617469882","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.347700+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.296619+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.361345+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.093323+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:12.857605+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:12.816090+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.083163+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.121639+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-04T06:56:24.097 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:24.099+0000 7f9b31000640 1 -- 172.21.15.72:0/3064979323 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f9b0806c8f0 msgr2=0x7f9b0806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:24.098 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:24.099+0000 7f9b31000640 1 --2- 172.21.15.72:0/3064979323 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f9b0806c8f0 0x7f9b0806edb0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f9b1c000f60 tx=0x7f9b1c009040 comp rx=0 tx=0).stop 2024-04-04T06:56:24.098 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:24.099+0000 7f9b31000640 1 -- 172.21.15.72:0/3064979323 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9b2c15e590 msgr2=0x7f9b2c0b5ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:24.098 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:24.099+0000 7f9b31000640 1 --2- 172.21.15.72:0/3064979323 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9b2c15e590 0x7f9b2c0b5ad0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f9b2400efc0 tx=0x7f9b24009f90 comp rx=0 tx=0).stop 2024-04-04T06:56:24.098 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:24.099+0000 7f9b31000640 1 -- 172.21.15.72:0/3064979323 shutdown_connections 2024-04-04T06:56:24.098 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:24.099+0000 7f9b31000640 1 --2- 172.21.15.72:0/3064979323 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f9b0806c8f0 0x7f9b0806edb0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:24.098 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:24.099+0000 7f9b31000640 1 --2- 172.21.15.72:0/3064979323 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9b2c15e590 0x7f9b2c0b5ad0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:24.098 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:24.099+0000 7f9b31000640 1 --2- 172.21.15.72:0/3064979323 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9b2c0cf620 0x7f9b2c1583a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:24.098 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:24.099+0000 7f9b31000640 1 --2- 172.21.15.72:0/3064979323 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9b2c0b9d10 0x7f9b2c1f8420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:24.098 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:24.099+0000 7f9b31000640 1 -- 172.21.15.72:0/3064979323 >> 172.21.15.72:0/3064979323 conn(0x7f9b2c0d0f70 msgr2=0x7f9b2c0b8cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:56:24.098 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:24.099+0000 7f9b31000640 1 -- 172.21.15.72:0/3064979323 shutdown_connections 2024-04-04T06:56:24.098 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:24.099+0000 7f9b31000640 1 -- 172.21.15.72:0/3064979323 wait complete. 2024-04-04T06:56:24.116 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-04T06:56:17.421685+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-04T06:56:24.116 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-04T06:56:24.328 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:24.329+0000 7fb24c400640 1 Processor -- start 2024-04-04T06:56:24.328 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:24.330+0000 7fb24c400640 1 -- start start 2024-04-04T06:56:24.330 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:24.331+0000 7fb24c400640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fb244161b70 0x7fb2440b9ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:24.330 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:24.331+0000 7fb24c400640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb2440d26d0 0x7fb2440cf0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:24.331 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:24.331+0000 7fb24c400640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2440d2e70 con 0x7fb2440cf610 2024-04-04T06:56:24.331 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:24.331+0000 7fb24c400640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7fb2440cfa60 con 0x7fb2440d26d0 2024-04-04T06:56:24.331 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:24.331+0000 7fb24c400640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fb2440d3150 con 0x7fb244161b70 2024-04-04T06:56:24.331 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:24.331+0000 7fb249000640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb2440d26d0 0x7fb2440cf0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:24.331 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:24.331+0000 7fb249000640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb2440d26d0 0x7fb2440cf0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:52818/0 (socket says 172.21.15.72:52818) 2024-04-04T06:56:24.331 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:24.331+0000 7fb249000640 1 -- 172.21.15.72:0/2032361100 learned_addr learned my addr 172.21.15.72:0/2032361100 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:56:24.331 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:24.332+0000 7fb249000640 1 -- 172.21.15.72:0/2032361100 >> v2:172.21.15.117:3300/0 conn(0x7fb244161b70 msgr2=0x7fb2440b9ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:56:24.331 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:24.332+0000 7fb249000640 1 --2- 172.21.15.72:0/2032361100 >> v2:172.21.15.117:3300/0 conn(0x7fb244161b70 0x7fb2440b9ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:24.331 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:24.332+0000 7fb249000640 1 -- 172.21.15.72:0/2032361100 >> v1:172.21.15.117:6789/0 conn(0x7fb2440cf610 legacy=0x7fb2440d4290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:56:24.331 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:24.332+0000 7fb249000640 1 -- 172.21.15.72:0/2032361100 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2440d3430 con 0x7fb2440d26d0 2024-04-04T06:56:24.333 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:24.333+0000 7fb249000640 1 --2- 172.21.15.72:0/2032361100 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb2440d26d0 0x7fb2440cf0d0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fb2440b5ff0 tx=0x7fb23002be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4df02eed6f726fb2 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:24.333 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:24.333+0000 7fb243e00640 1 -- 172.21.15.72:0/2032361100 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb23002c9f0 con 0x7fb2440d26d0 2024-04-04T06:56:24.333 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:24.333+0000 7fb243e00640 1 -- 172.21.15.72:0/2032361100 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb23002cb90 con 0x7fb2440d26d0 2024-04-04T06:56:24.333 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:24.333+0000 7fb243e00640 1 -- 172.21.15.72:0/2032361100 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2300343f0 con 0x7fb2440d26d0 2024-04-04T06:56:24.333 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:24.334+0000 7fb24c400640 1 -- 172.21.15.72:0/2032361100 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb2440d26d0 msgr2=0x7fb2440cf0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:24.333 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:24.334+0000 7fb24c400640 1 --2- 172.21.15.72:0/2032361100 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb2440d26d0 0x7fb2440cf0d0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fb2440b5ff0 tx=0x7fb23002be50 comp rx=0 tx=0).stop 2024-04-04T06:56:24.333 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:24.334+0000 7fb24c400640 1 -- 172.21.15.72:0/2032361100 shutdown_connections 2024-04-04T06:56:24.333 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:24.334+0000 7fb24c400640 1 --2- 172.21.15.72:0/2032361100 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb2440d26d0 0x7fb2440cf0d0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:24.333 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:24.334+0000 7fb24c400640 1 --2- 172.21.15.72:0/2032361100 >> v2:172.21.15.117:3300/0 conn(0x7fb244161b70 0x7fb2440b9ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:24.333 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:24.334+0000 7fb24c400640 1 -- 172.21.15.72:0/2032361100 >> 172.21.15.72:0/2032361100 conn(0x7fb244071eb0 msgr2=0x7fb2440722c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:56:24.333 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:24.334+0000 7fb24c400640 1 -- 172.21.15.72:0/2032361100 shutdown_connections 2024-04-04T06:56:24.333 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:24.334+0000 7fb24c400640 1 -- 172.21.15.72:0/2032361100 wait complete. 2024-04-04T06:56:24.335 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:24.336+0000 7fb24c400640 1 Processor -- start 2024-04-04T06:56:24.335 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:24.337+0000 7fb24c400640 1 -- start start 2024-04-04T06:56:24.337 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:24.338+0000 7fb24c400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb2440cf610 0x7fb2441f74d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:24.338 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:24.338+0000 7fb24c400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb2440d26d0 0x7fb2440cd160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:24.338 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:24.338+0000 7fb24c400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb244161b70 0x7fb2440cd6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:24.338 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:24.338+0000 7fb24c400640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fb2440d2b60 con 0x7fb244161b70 2024-04-04T06:56:24.338 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:24.338+0000 7fb24c400640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fb2440d39f0 con 0x7fb2440cf610 2024-04-04T06:56:24.338 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:24.338+0000 7fb24c400640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fb2440d3f10 con 0x7fb2440d26d0 2024-04-04T06:56:24.338 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:24.338+0000 7fb24a400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb244161b70 0x7fb2440cd6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:24.338 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:24.338+0000 7fb24a400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb244161b70 0x7fb2440cd6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:52826/0 (socket says 172.21.15.72:52826) 2024-04-04T06:56:24.338 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:24.338+0000 7fb24a400640 1 -- 172.21.15.72:0/1351708993 learned_addr learned my addr 172.21.15.72:0/1351708993 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:56:24.338 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:24.338+0000 7fb249a00640 1 --2- 172.21.15.72:0/1351708993 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb2440cf610 0x7fb2441f74d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:24.338 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:24.338+0000 7fb249000640 1 --2- 172.21.15.72:0/1351708993 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb2440d26d0 0x7fb2440cd160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:24.338 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:24.338+0000 7fb24a400640 1 -- 172.21.15.72:0/1351708993 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb2440d26d0 msgr2=0x7fb2440cd160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:24.339 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:24.338+0000 7fb24a400640 1 --2- 172.21.15.72:0/1351708993 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb2440d26d0 0x7fb2440cd160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:24.339 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:24.338+0000 7fb24a400640 1 -- 172.21.15.72:0/1351708993 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb2440cf610 msgr2=0x7fb2441f74d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:24.339 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:24.338+0000 7fb24a400640 1 --2- 172.21.15.72:0/1351708993 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb2440cf610 0x7fb2441f74d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:24.339 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:24.338+0000 7fb24a400640 1 -- 172.21.15.72:0/1351708993 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb244152c90 con 0x7fb244161b70 2024-04-04T06:56:24.339 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:24.338+0000 7fb249a00640 1 --2- 172.21.15.72:0/1351708993 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb2440cf610 0x7fb2441f74d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-04T06:56:24.339 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:24.339+0000 7fb24a400640 1 --2- 172.21.15.72:0/1351708993 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb244161b70 0x7fb2440cd6a0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fb23c00c410 tx=0x7fb23c00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:24.339 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:24.339+0000 7fb241600640 1 -- 172.21.15.72:0/1351708993 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb23c017070 con 0x7fb244161b70 2024-04-04T06:56:24.339 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:24.339+0000 7fb241600640 1 -- 172.21.15.72:0/1351708993 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb23c005230 con 0x7fb244161b70 2024-04-04T06:56:24.339 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:24.339+0000 7fb241600640 1 -- 172.21.15.72:0/1351708993 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb23c011590 con 0x7fb244161b70 2024-04-04T06:56:24.339 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:24.339+0000 7fb24c400640 1 -- 172.21.15.72:0/1351708993 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb244156de0 con 0x7fb244161b70 2024-04-04T06:56:24.339 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:24.339+0000 7fb24c400640 1 -- 172.21.15.72:0/1351708993 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb244154810 con 0x7fb244161b70 2024-04-04T06:56:24.340 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:24.340+0000 7fb24c400640 1 -- 172.21.15.72:0/1351708993 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb244075730 con 0x7fb244161b70 2024-04-04T06:56:24.340 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:24.341+0000 7fb241600640 1 -- 172.21.15.72:0/1351708993 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb23c01a070 con 0x7fb244161b70 2024-04-04T06:56:24.340 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:24.342+0000 7fb241600640 1 --2- 172.21.15.72:0/1351708993 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fb22406c8f0 0x7fb22406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:24.340 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:24.342+0000 7fb241600640 1 -- 172.21.15.72:0/1351708993 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7fb23c08aae0 con 0x7fb244161b70 2024-04-04T06:56:24.341 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:24.342+0000 7fb249a00640 1 --2- 172.21.15.72:0/1351708993 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fb22406c8f0 0x7fb22406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:24.341 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:24.343+0000 7fb249a00640 1 --2- 172.21.15.72:0/1351708993 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fb22406c8f0 0x7fb22406edb0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fb23400a870 tx=0x7fb234008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:24.346 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:24.347+0000 7fb241600640 1 -- 172.21.15.72:0/1351708993 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fb23c0591c0 con 0x7fb244161b70 2024-04-04T06:56:24.547 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:24.549+0000 7fb24c400640 1 -- 172.21.15.72:0/1351708993 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fb244154a50 con 0x7fb244161b70 2024-04-04T06:56:24.548 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:24.549+0000 7fb241600640 1 -- 172.21.15.72:0/1351708993 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) ==== 93+0+10 (secure 0 0 0) 0x7fb23c058ac0 con 0x7fb244161b70 2024-04-04T06:56:24.548 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 1 2024-04-04T06:56:24.551 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:24.552+0000 7fb24c400640 1 -- 172.21.15.72:0/1351708993 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fb22406c8f0 msgr2=0x7fb22406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:24.551 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:24.552+0000 7fb24c400640 1 --2- 172.21.15.72:0/1351708993 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fb22406c8f0 0x7fb22406edb0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fb23400a870 tx=0x7fb234008040 comp rx=0 tx=0).stop 2024-04-04T06:56:24.551 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:24.552+0000 7fb24c400640 1 -- 172.21.15.72:0/1351708993 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb244161b70 msgr2=0x7fb2440cd6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:24.551 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:24.552+0000 7fb24c400640 1 --2- 172.21.15.72:0/1351708993 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb244161b70 0x7fb2440cd6a0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fb23c00c410 tx=0x7fb23c00c8d0 comp rx=0 tx=0).stop 2024-04-04T06:56:24.551 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:24.552+0000 7fb24c400640 1 -- 172.21.15.72:0/1351708993 shutdown_connections 2024-04-04T06:56:24.551 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:24.552+0000 7fb24c400640 1 --2- 172.21.15.72:0/1351708993 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fb22406c8f0 0x7fb22406edb0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:24.551 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:24.552+0000 7fb24c400640 1 --2- 172.21.15.72:0/1351708993 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb244161b70 0x7fb2440cd6a0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:24.551 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:24.552+0000 7fb24c400640 1 --2- 172.21.15.72:0/1351708993 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb2440d26d0 0x7fb2440cd160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:24.551 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:24.552+0000 7fb24c400640 1 --2- 172.21.15.72:0/1351708993 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb2440cf610 0x7fb2441f74d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:24.551 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:24.552+0000 7fb24c400640 1 -- 172.21.15.72:0/1351708993 >> 172.21.15.72:0/1351708993 conn(0x7fb244071eb0 msgr2=0x7fb244160ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:56:24.551 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:24.552+0000 7fb24c400640 1 -- 172.21.15.72:0/1351708993 shutdown_connections 2024-04-04T06:56:24.551 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:24.552+0000 7fb24c400640 1 -- 172.21.15.72:0/1351708993 wait complete. 2024-04-04T06:56:24.569 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-04T06:56:24.772 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:24.773+0000 7fd32e600640 1 Processor -- start 2024-04-04T06:56:24.772 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:24.773+0000 7fd32e600640 1 -- start start 2024-04-04T06:56:24.773 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:24.774+0000 7fd32e600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd3280b4e40 0x7fd3280c6840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:24.773 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:24.774+0000 7fd32e600640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd32815e590 con 0x7fd328158390 2024-04-04T06:56:24.773 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:24.774+0000 7fd32e600640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd3280c6e90 con 0x7fd328158770 2024-04-04T06:56:24.773 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:24.774+0000 7fd32e600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fd32815e830 con 0x7fd3280b4e40 2024-04-04T06:56:24.773 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:24.775+0000 7fd327400640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fd328158390 0x7fd3280b4730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:39952/0 (socket says 172.21.15.72:39952) 2024-04-04T06:56:24.773 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:24.775+0000 7fd327400640 1 -- 172.21.15.72:0/50630227 learned_addr learned my addr 172.21.15.72:0/50630227 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-04-04T06:56:24.776 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:24.775+0000 7fd326000640 1 -- 172.21.15.72:0/50630227 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4122422496 0 0) 0x7fd32815e590 con 0x7fd328158390 2024-04-04T06:56:24.776 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:24.775+0000 7fd326000640 1 -- 172.21.15.72:0/50630227 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd30c003520 con 0x7fd328158390 2024-04-04T06:56:24.776 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:24.775+0000 7fd326a00640 1 --2- 172.21.15.72:0/50630227 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd3280b4e40 0x7fd3280c6840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:24.776 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:24.775+0000 7fd326000640 1 -- 172.21.15.72:0/50630227 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3108223161 0 0) 0x7fd30c003520 con 0x7fd328158390 2024-04-04T06:56:24.776 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:24.776+0000 7fd326000640 1 -- 172.21.15.72:0/50630227 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd3280b4e40 msgr2=0x7fd3280c6840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:56:24.776 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:24.776+0000 7fd326000640 1 --2- 172.21.15.72:0/50630227 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd3280b4e40 0x7fd3280c6840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:24.776 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:24.776+0000 7fd326000640 1 -- 172.21.15.72:0/50630227 >> v1:172.21.15.117:6789/0 conn(0x7fd328158770 legacy=0x7fd3280cc8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:24.776 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:24.776+0000 7fd326000640 1 -- 172.21.15.72:0/50630227 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd32815eb10 con 0x7fd328158390 2024-04-04T06:56:24.776 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:24.776+0000 7fd326000640 1 -- 172.21.15.72:0/50630227 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2465650867 0 0) 0x7fd3180019f0 con 0x7fd328158390 2024-04-04T06:56:24.777 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:24.776+0000 7fd326000640 1 -- 172.21.15.72:0/50630227 >> v1:172.21.15.72:6789/0 conn(0x7fd328158390 legacy=0x7fd3280b4730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:24.777 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:24.776+0000 7fd326000640 1 --2- 172.21.15.72:0/50630227 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd30c0039e0 0x7fd30c003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:24.777 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:24.776+0000 7fd326000640 1 --2- 172.21.15.72:0/50630227 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd30c004800 0x7fd30c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:24.777 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:24.776+0000 7fd326000640 1 --2- 172.21.15.72:0/50630227 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd3280b4e40 0x7fd30c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:24.777 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:24.776+0000 7fd326000640 1 -- 172.21.15.72:0/50630227 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fd32815e830 con 0x7fd30c004800 2024-04-04T06:56:24.777 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:24.776+0000 7fd326000640 1 -- 172.21.15.72:0/50630227 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fd30c00bad0 con 0x7fd30c0039e0 2024-04-04T06:56:24.777 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:24.776+0000 7fd326000640 1 -- 172.21.15.72:0/50630227 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fd30c00bcd0 con 0x7fd3280b4e40 2024-04-04T06:56:24.777 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:24.776+0000 7fd326a00640 1 --2- 172.21.15.72:0/50630227 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd30c004800 0x7fd30c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:24.777 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:24.776+0000 7fd327400640 1 --2- 172.21.15.72:0/50630227 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd30c0039e0 0x7fd30c003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:24.777 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:24.776+0000 7fd327e00640 1 --2- 172.21.15.72:0/50630227 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd3280b4e40 0x7fd30c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:24.777 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:24.776+0000 7fd326a00640 1 -- 172.21.15.72:0/50630227 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd3280b4e40 msgr2=0x7fd30c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:56:24.777 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:24.776+0000 7fd326a00640 1 --2- 172.21.15.72:0/50630227 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd3280b4e40 0x7fd30c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:24.777 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:24.777+0000 7fd326a00640 1 -- 172.21.15.72:0/50630227 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd30c0039e0 msgr2=0x7fd30c003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:56:24.777 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:24.777+0000 7fd326a00640 1 --2- 172.21.15.72:0/50630227 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd30c0039e0 0x7fd30c003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:24.777 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:24.777+0000 7fd326a00640 1 -- 172.21.15.72:0/50630227 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd30c003520 con 0x7fd30c004800 2024-04-04T06:56:24.778 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:24.777+0000 7fd327400640 1 --2- 172.21.15.72:0/50630227 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd30c0039e0 0x7fd30c003e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-04T06:56:24.778 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:24.778+0000 7fd326a00640 1 --2- 172.21.15.72:0/50630227 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd30c004800 0x7fd30c004c80 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fd314009650 tx=0x7fd30c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7aeece25bcbceb3 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:24.779 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:24.778+0000 7fd326000640 1 -- 172.21.15.72:0/50630227 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd31403b070 con 0x7fd30c004800 2024-04-04T06:56:24.779 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:24.778+0000 7fd326000640 1 -- 172.21.15.72:0/50630227 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd31402e890 con 0x7fd30c004800 2024-04-04T06:56:24.779 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:24.778+0000 7fd326000640 1 -- 172.21.15.72:0/50630227 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd314009690 con 0x7fd30c004800 2024-04-04T06:56:24.779 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:24.778+0000 7fd32e600640 1 -- 172.21.15.72:0/50630227 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd30c004800 msgr2=0x7fd30c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:24.779 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:24.778+0000 7fd32e600640 1 --2- 172.21.15.72:0/50630227 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd30c004800 0x7fd30c004c80 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fd314009650 tx=0x7fd30c005830 comp rx=0 tx=0).stop 2024-04-04T06:56:24.779 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:24.778+0000 7fd327e00640 1 -- 172.21.15.72:0/50630227 reap_dead start 2024-04-04T06:56:24.779 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:24.779+0000 7fd32e600640 1 -- 172.21.15.72:0/50630227 shutdown_connections 2024-04-04T06:56:24.780 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:24.779+0000 7fd32e600640 1 -- 172.21.15.72:0/50630227 >> 172.21.15.72:0/50630227 conn(0x7fd32806b470 msgr2=0x7fd32806b880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:56:24.780 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:24.779+0000 7fd32e600640 1 -- 172.21.15.72:0/50630227 shutdown_connections 2024-04-04T06:56:24.780 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:24.779+0000 7fd32e600640 1 -- 172.21.15.72:0/50630227 wait complete. 2024-04-04T06:56:24.780 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:24.780+0000 7fd32e600640 1 Processor -- start 2024-04-04T06:56:24.780 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:24.780+0000 7fd32e600640 1 -- start start 2024-04-04T06:56:24.781 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:24.781+0000 7fd32e600640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd30c004800 0x7fd3280727d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:24.781 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:24.781+0000 7fd32e600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd3280c7f60 0x7fd3280c83c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:24.782 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:24.781+0000 7fd32e600640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd328156170 0x7fd3281565d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:24.782 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:24.781+0000 7fd32e600640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fd32815f490 con 0x7fd30c004800 2024-04-04T06:56:24.782 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:24.781+0000 7fd32e600640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fd32815f310 con 0x7fd328156170 2024-04-04T06:56:24.782 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:24.781+0000 7fd32e600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fd3280c6840 con 0x7fd3280c7f60 2024-04-04T06:56:24.782 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:24.782+0000 7fd327400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd30c004800 0x7fd3280727d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:24.782 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:24.782+0000 7fd327400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd30c004800 0x7fd3280727d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:52856/0 (socket says 172.21.15.72:52856) 2024-04-04T06:56:24.782 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:24.782+0000 7fd327400640 1 -- 172.21.15.72:0/348479658 learned_addr learned my addr 172.21.15.72:0/348479658 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:56:24.782 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:24.782+0000 7fd327e00640 1 --2- 172.21.15.72:0/348479658 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd328156170 0x7fd3281565d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:24.782 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:24.782+0000 7fd327400640 1 -- 172.21.15.72:0/348479658 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd3280c7f60 msgr2=0x7fd3280c83c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:24.782 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:24.782+0000 7fd327400640 1 --2- 172.21.15.72:0/348479658 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd3280c7f60 0x7fd3280c83c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:24.782 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:24.782+0000 7fd327400640 1 -- 172.21.15.72:0/348479658 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd328156170 msgr2=0x7fd3281565d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:24.782 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:24.782+0000 7fd327400640 1 --2- 172.21.15.72:0/348479658 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd328156170 0x7fd3281565d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:24.782 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:24.782+0000 7fd327400640 1 -- 172.21.15.72:0/348479658 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3280c8b40 con 0x7fd30c004800 2024-04-04T06:56:24.783 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:24.782+0000 7fd327400640 1 --2- 172.21.15.72:0/348479658 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd30c004800 0x7fd3280727d0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fd318001330 tx=0x7fd31800e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:24.783 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:24.782+0000 7fd31f400640 1 -- 172.21.15.72:0/348479658 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd318013420 con 0x7fd30c004800 2024-04-04T06:56:24.783 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:24.782+0000 7fd31f400640 1 -- 172.21.15.72:0/348479658 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd318018070 con 0x7fd30c004800 2024-04-04T06:56:24.783 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:24.783+0000 7fd31f400640 1 -- 172.21.15.72:0/348479658 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3180137e0 con 0x7fd30c004800 2024-04-04T06:56:24.783 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:24.783+0000 7fd32e600640 1 -- 172.21.15.72:0/348479658 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3280c8e20 con 0x7fd30c004800 2024-04-04T06:56:24.783 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:24.783+0000 7fd32e600640 1 -- 172.21.15.72:0/348479658 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3280c93e0 con 0x7fd30c004800 2024-04-04T06:56:24.783 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:24.784+0000 7fd32e600640 1 -- 172.21.15.72:0/348479658 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd328075840 con 0x7fd30c004800 2024-04-04T06:56:24.783 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:24.785+0000 7fd31f400640 1 -- 172.21.15.72:0/348479658 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd318013980 con 0x7fd30c004800 2024-04-04T06:56:24.784 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:24.785+0000 7fd31f400640 1 --2- 172.21.15.72:0/348479658 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fd30806c8f0 0x7fd30806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:24.784 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:24.786+0000 7fd31f400640 1 -- 172.21.15.72:0/348479658 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7fd31808c090 con 0x7fd30c004800 2024-04-04T06:56:24.784 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:24.786+0000 7fd326a00640 1 --2- 172.21.15.72:0/348479658 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fd30806c8f0 0x7fd30806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:24.785 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:24.787+0000 7fd326a00640 1 --2- 172.21.15.72:0/348479658 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fd30806c8f0 0x7fd30806edb0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fd314038000 tx=0x7fd314030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:24.789 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:24.790+0000 7fd31f400640 1 -- 172.21.15.72:0/348479658 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fd31805a770 con 0x7fd30c004800 2024-04-04T06:56:25.033 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:25.035+0000 7fd32e600640 1 -- 172.21.15.72:0/348479658 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd3280b6230 con 0x7fd30c004800 2024-04-04T06:56:25.034 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:25.036+0000 7fd31f400640 1 -- 172.21.15.72:0/348479658 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+3870 (secure 0 0 0) 0x7fd31805a070 con 0x7fd30c004800 2024-04-04T06:56:25.034 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T06:56:25.035 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6834/3570831137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":3570831137},{"type":"v1","addr":"172.21.15.117:6834","nonce":3570831137}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4238,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/1683311500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6833","nonce":1683311500},{"type":"v1","addr":"172.21.15.117:6835","nonce":1683311500}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6835/4150347227","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":4150347227},{"type":"v1","addr":"172.21.15.72:6835","nonce":4150347227}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6837/2958027127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6836","nonce":2958027127},{"type":"v1","addr":"172.21.15.72:6837","nonce":2958027127}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-04-04T06:56:25.035 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 3 2024-04-04T06:56:25.037 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:25.038+0000 7fd32e600640 1 -- 172.21.15.72:0/348479658 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fd30806c8f0 msgr2=0x7fd30806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:25.037 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:25.038+0000 7fd32e600640 1 --2- 172.21.15.72:0/348479658 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fd30806c8f0 0x7fd30806edb0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fd314038000 tx=0x7fd314030000 comp rx=0 tx=0).stop 2024-04-04T06:56:25.037 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:25.038+0000 7fd32e600640 1 -- 172.21.15.72:0/348479658 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd30c004800 msgr2=0x7fd3280727d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:25.037 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:25.038+0000 7fd32e600640 1 --2- 172.21.15.72:0/348479658 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd30c004800 0x7fd3280727d0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fd318001330 tx=0x7fd31800e530 comp rx=0 tx=0).stop 2024-04-04T06:56:25.037 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:25.038+0000 7fd32e600640 1 -- 172.21.15.72:0/348479658 shutdown_connections 2024-04-04T06:56:25.037 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:25.038+0000 7fd32e600640 1 --2- 172.21.15.72:0/348479658 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fd30806c8f0 0x7fd30806edb0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:25.037 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:25.038+0000 7fd32e600640 1 --2- 172.21.15.72:0/348479658 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd328156170 0x7fd3281565d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:25.038 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:25.038+0000 7fd32e600640 1 --2- 172.21.15.72:0/348479658 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd3280c7f60 0x7fd3280c83c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:25.038 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:25.038+0000 7fd32e600640 1 --2- 172.21.15.72:0/348479658 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd30c004800 0x7fd3280727d0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:25.038 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:25.039+0000 7fd32e600640 1 -- 172.21.15.72:0/348479658 >> 172.21.15.72:0/348479658 conn(0x7fd32806b470 msgr2=0x7fd3280d06d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:56:25.038 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:25.039+0000 7fd32e600640 1 -- 172.21.15.72:0/348479658 shutdown_connections 2024-04-04T06:56:25.038 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:25.039+0000 7fd32e600640 1 -- 172.21.15.72:0/348479658 wait complete. 2024-04-04T06:56:25.053 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-04T06:56:25.256 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:25.257+0000 7f0773e00640 1 Processor -- start 2024-04-04T06:56:25.256 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:25.257+0000 7f0773e00640 1 -- start start 2024-04-04T06:56:25.258 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:25.259+0000 7f0773e00640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f076c15e6d0 0x7f076c06c580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:25.258 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:25.259+0000 7f0773e00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f076c0d1510 0x7f076c06cac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:25.258 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:25.259+0000 7f0773e00640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f076c0b4930 con 0x7f076c0d1bf0 2024-04-04T06:56:25.258 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:25.259+0000 7f0773e00640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f076c0cfcc0 con 0x7f076c15e6d0 2024-04-04T06:56:25.258 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:25.259+0000 7f0773e00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f076c0cff10 con 0x7f076c0d1510 2024-04-04T06:56:25.258 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:25.259+0000 7f0771e00640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f076c0d1bf0 0x7f076c070f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:39958/0 (socket says 172.21.15.72:39958) 2024-04-04T06:56:25.259 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:25.259+0000 7f0771400640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f076c15e6d0 0x7f076c06c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:25.259 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:25.259+0000 7f0771e00640 1 -- 172.21.15.72:0/3828212747 learned_addr learned my addr 172.21.15.72:0/3828212747 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-04-04T06:56:25.259 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:25.259+0000 7f0770a00640 1 --2- 172.21.15.72:0/3828212747 >> v2:172.21.15.117:3300/0 conn(0x7f076c0d1510 0x7f076c06cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:25.259 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:25.260+0000 7f076be00640 1 -- 172.21.15.72:0/3828212747 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2528022472 0 0) 0x7f076c0b4930 con 0x7f076c0d1bf0 2024-04-04T06:56:25.259 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:25.260+0000 7f0771400640 1 -- 172.21.15.72:0/3828212747 >> v2:172.21.15.117:3300/0 conn(0x7f076c0d1510 msgr2=0x7f076c06cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:56:25.259 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:25.260+0000 7f0771400640 1 --2- 172.21.15.72:0/3828212747 >> v2:172.21.15.117:3300/0 conn(0x7f076c0d1510 0x7f076c06cac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:25.259 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:25.260+0000 7f0771400640 1 -- 172.21.15.72:0/3828212747 >> v1:172.21.15.72:6789/0 conn(0x7f076c0d1bf0 legacy=0x7f076c070f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:25.259 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:25.260+0000 7f0771400640 1 -- 172.21.15.72:0/3828212747 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f076c0d01f0 con 0x7f076c15e6d0 2024-04-04T06:56:25.260 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:25.261+0000 7f0771400640 1 --2- 172.21.15.72:0/3828212747 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f076c15e6d0 0x7f076c06c580 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f076c06f0d0 tx=0x7f076002bdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee8ea035713976cd server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:25.260 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:25.261+0000 7f076be00640 1 -- 172.21.15.72:0/3828212747 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0760039070 con 0x7f076c15e6d0 2024-04-04T06:56:25.260 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:25.261+0000 7f076be00640 1 -- 172.21.15.72:0/3828212747 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f076002cb60 con 0x7f076c15e6d0 2024-04-04T06:56:25.260 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:25.261+0000 7f076be00640 1 -- 172.21.15.72:0/3828212747 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0760034440 con 0x7f076c15e6d0 2024-04-04T06:56:25.261 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:25.261+0000 7f0773e00640 1 -- 172.21.15.72:0/3828212747 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f076c15e6d0 msgr2=0x7f076c06c580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:25.261 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:25.261+0000 7f0773e00640 1 --2- 172.21.15.72:0/3828212747 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f076c15e6d0 0x7f076c06c580 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f076c06f0d0 tx=0x7f076002bdb0 comp rx=0 tx=0).stop 2024-04-04T06:56:25.261 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:25.262+0000 7f0773e00640 1 -- 172.21.15.72:0/3828212747 shutdown_connections 2024-04-04T06:56:25.261 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:25.262+0000 7f0773e00640 1 --2- 172.21.15.72:0/3828212747 >> v2:172.21.15.117:3300/0 conn(0x7f076c0d1510 0x7f076c06cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:25.261 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:25.262+0000 7f0773e00640 1 --2- 172.21.15.72:0/3828212747 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f076c15e6d0 0x7f076c06c580 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:25.261 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:25.262+0000 7f0773e00640 1 -- 172.21.15.72:0/3828212747 >> 172.21.15.72:0/3828212747 conn(0x7f076c0d2180 msgr2=0x7f076c0d2560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:56:25.261 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:25.262+0000 7f0773e00640 1 -- 172.21.15.72:0/3828212747 shutdown_connections 2024-04-04T06:56:25.261 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:25.262+0000 7f0773e00640 1 -- 172.21.15.72:0/3828212747 wait complete. 2024-04-04T06:56:25.261 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:25.263+0000 7f0773e00640 1 Processor -- start 2024-04-04T06:56:25.262 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:25.263+0000 7f0773e00640 1 -- start start 2024-04-04T06:56:25.264 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:25.264+0000 7f0773e00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f076c0d1510 0x7f076c0b6970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:25.264 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:25.264+0000 7f0773e00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f076c0d1bf0 0x7f076c1555a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:25.264 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:25.264+0000 7f0773e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f076c15e6d0 0x7f076c155ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:25.264 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:25.264+0000 7f0773e00640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f076c0d0a90 con 0x7f076c0d1bf0 2024-04-04T06:56:25.264 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:25.264+0000 7f0773e00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f076c0d07b0 con 0x7f076c0d1510 2024-04-04T06:56:25.264 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:25.264+0000 7f0773e00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f076c0d0fb0 con 0x7f076c15e6d0 2024-04-04T06:56:25.264 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:25.264+0000 7f0770a00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f076c0d1bf0 0x7f076c1555a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:25.264 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:25.265+0000 7f0770a00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f076c0d1bf0 0x7f076c1555a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:52872/0 (socket says 172.21.15.72:52872) 2024-04-04T06:56:25.264 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:25.265+0000 7f0770a00640 1 -- 172.21.15.72:0/3997008785 learned_addr learned my addr 172.21.15.72:0/3997008785 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:56:25.264 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:25.265+0000 7f0771400640 1 --2- 172.21.15.72:0/3997008785 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f076c0d1510 0x7f076c0b6970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:25.264 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:25.265+0000 7f0770a00640 1 -- 172.21.15.72:0/3997008785 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f076c15e6d0 msgr2=0x7f076c155ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:25.265 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:25.265+0000 7f0770a00640 1 --2- 172.21.15.72:0/3997008785 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f076c15e6d0 0x7f076c155ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:25.265 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:25.265+0000 7f0770a00640 1 -- 172.21.15.72:0/3997008785 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f076c0d1510 msgr2=0x7f076c0b6970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:25.265 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:25.265+0000 7f0770a00640 1 --2- 172.21.15.72:0/3997008785 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f076c0d1510 0x7f076c0b6970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:25.265 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:25.265+0000 7f0770a00640 1 -- 172.21.15.72:0/3997008785 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f076c0b58d0 con 0x7f076c0d1bf0 2024-04-04T06:56:25.265 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:25.265+0000 7f0771400640 1 --2- 172.21.15.72:0/3997008785 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f076c0d1510 0x7f076c0b6970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-04T06:56:25.265 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:25.265+0000 7f0770a00640 1 --2- 172.21.15.72:0/3997008785 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f076c0d1bf0 0x7f076c1555a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f075800d800 tx=0x7f075800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:25.265 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:25.265+0000 7f0769600640 1 -- 172.21.15.72:0/3997008785 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f075800b6c0 con 0x7f076c0d1bf0 2024-04-04T06:56:25.265 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:25.265+0000 7f0769600640 1 -- 172.21.15.72:0/3997008785 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0758019070 con 0x7f076c0d1bf0 2024-04-04T06:56:25.265 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:25.265+0000 7f0773e00640 1 -- 172.21.15.72:0/3997008785 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f076c0b5bb0 con 0x7f076c0d1bf0 2024-04-04T06:56:25.265 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:25.265+0000 7f0769600640 1 -- 172.21.15.72:0/3997008785 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f075800ba80 con 0x7f076c0d1bf0 2024-04-04T06:56:25.265 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:25.266+0000 7f0773e00640 1 -- 172.21.15.72:0/3997008785 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f076c0b6170 con 0x7f076c0d1bf0 2024-04-04T06:56:25.266 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:25.266+0000 7f0773e00640 1 -- 172.21.15.72:0/3997008785 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f076c0b4770 con 0x7f076c0d1bf0 2024-04-04T06:56:25.266 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:25.267+0000 7f0769600640 1 -- 172.21.15.72:0/3997008785 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f075800bc20 con 0x7f076c0d1bf0 2024-04-04T06:56:25.267 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:25.268+0000 7f0769600640 1 --2- 172.21.15.72:0/3997008785 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f074c06c8f0 0x7f074c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:25.267 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:25.268+0000 7f0769600640 1 -- 172.21.15.72:0/3997008785 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f075808bd90 con 0x7f076c0d1bf0 2024-04-04T06:56:25.267 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:25.268+0000 7f0771400640 1 --2- 172.21.15.72:0/3997008785 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f074c06c8f0 0x7f074c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:25.267 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:25.269+0000 7f0771400640 1 --2- 172.21.15.72:0/3997008785 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f074c06c8f0 0x7f074c06edb0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f0760036000 tx=0x7f0760030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:25.271 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:25.273+0000 7f0769600640 1 -- 172.21.15.72:0/3997008785 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f076c0b4770 con 0x7f076c0d1bf0 2024-04-04T06:56:25.475 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:25.477+0000 7f0773e00640 1 -- 172.21.15.72:0/3997008785 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f076c075840 con 0x7f076c0d1bf0 2024-04-04T06:56:25.477 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:25.479+0000 7f0769600640 1 -- 172.21.15.72:0/3997008785 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) ==== 74+0+12860 (secure 0 0 0) 0x7f075801c360 con 0x7f076c0d1bf0 2024-04-04T06:56:25.478 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T06:56:25.478 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":16,"fsid":"6708bac2-4f50-49b5-87a9-c390fd333eb3","created":"2024-04-04T06:56:04.282498+0000","modified":"2024-04-04T06:56:19.770560+0000","last_up_change":"2024-04-04T06:56:16.716089+0000","last_in_change":"2024-04-04T06:56:07.768593+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-04T06:56:17.421685+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7c345991-5af8-4dc6-a481-28610c40e128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":3889813953},{"type":"v1","addr":"172.21.15.72:6818","nonce":3889813953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":3889813953},{"type":"v1","addr":"172.21.15.72:6821","nonce":3889813953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":3889813953},{"type":"v1","addr":"172.21.15.72:6826","nonce":3889813953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":3889813953},{"type":"v1","addr":"172.21.15.72:6823","nonce":3889813953}]},"public_addr":"172.21.15.72:6818/3889813953","cluster_addr":"172.21.15.72:6821/3889813953","heartbeat_back_addr":"172.21.15.72:6826/3889813953","heartbeat_front_addr":"172.21.15.72:6823/3889813953","state":["exists","up"]},{"osd":1,"uuid":"1b3f7ab2-a56c-488d-a89a-1f3572361c95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":3101663154},{"type":"v1","addr":"172.21.15.72:6801","nonce":3101663154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":3101663154},{"type":"v1","addr":"172.21.15.72:6803","nonce":3101663154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":3101663154},{"type":"v1","addr":"172.21.15.72:6807","nonce":3101663154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":3101663154},{"type":"v1","addr":"172.21.15.72:6805","nonce":3101663154}]},"public_addr":"172.21.15.72:6801/3101663154","cluster_addr":"172.21.15.72:6803/3101663154","heartbeat_back_addr":"172.21.15.72:6807/3101663154","heartbeat_front_addr":"172.21.15.72:6805/3101663154","state":["exists","up"]},{"osd":2,"uuid":"fc9aa512-53df-40d7-ba04-3e6b7dcd1e34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":235374192},{"type":"v1","addr":"172.21.15.72:6809","nonce":235374192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":235374192},{"type":"v1","addr":"172.21.15.72:6811","nonce":235374192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":235374192},{"type":"v1","addr":"172.21.15.72:6815","nonce":235374192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":235374192},{"type":"v1","addr":"172.21.15.72:6813","nonce":235374192}]},"public_addr":"172.21.15.72:6809/235374192","cluster_addr":"172.21.15.72:6811/235374192","heartbeat_back_addr":"172.21.15.72:6815/235374192","heartbeat_front_addr":"172.21.15.72:6813/235374192","state":["exists","up"]},{"osd":3,"uuid":"b4f63eed-dc5b-4aba-bb50-de46eb41492b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6817","nonce":2806631742},{"type":"v1","addr":"172.21.15.72:6819","nonce":2806631742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":2806631742},{"type":"v1","addr":"172.21.15.72:6827","nonce":2806631742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":2806631742},{"type":"v1","addr":"172.21.15.72:6831","nonce":2806631742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":2806631742},{"type":"v1","addr":"172.21.15.72:6829","nonce":2806631742}]},"public_addr":"172.21.15.72:6819/2806631742","cluster_addr":"172.21.15.72:6827/2806631742","heartbeat_back_addr":"172.21.15.72:6831/2806631742","heartbeat_front_addr":"172.21.15.72:6829/2806631742","state":["exists","up"]},{"osd":4,"uuid":"9e985ef8-d711-4172-9286-c54e560895d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":4293536423},{"type":"v1","addr":"172.21.15.117:6825","nonce":4293536423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":4293536423},{"type":"v1","addr":"172.21.15.117:6827","nonce":4293536423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":4293536423},{"type":"v1","addr":"172.21.15.117:6831","nonce":4293536423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":4293536423},{"type":"v1","addr":"172.21.15.117:6829","nonce":4293536423}]},"public_addr":"172.21.15.117:6825/4293536423","cluster_addr":"172.21.15.117:6827/4293536423","heartbeat_back_addr":"172.21.15.117:6831/4293536423","heartbeat_front_addr":"172.21.15.117:6829/4293536423","state":["exists","up"]},{"osd":5,"uuid":"3e9f082b-8d7d-455f-8a96-66d0b4857125","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":684971679},{"type":"v1","addr":"172.21.15.117:6801","nonce":684971679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":684971679},{"type":"v1","addr":"172.21.15.117:6803","nonce":684971679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":684971679},{"type":"v1","addr":"172.21.15.117:6807","nonce":684971679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":684971679},{"type":"v1","addr":"172.21.15.117:6805","nonce":684971679}]},"public_addr":"172.21.15.117:6801/684971679","cluster_addr":"172.21.15.117:6803/684971679","heartbeat_back_addr":"172.21.15.117:6807/684971679","heartbeat_front_addr":"172.21.15.117:6805/684971679","state":["exists","up"]},{"osd":6,"uuid":"bcdafa9f-a870-4398-a38d-ab7697676473","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":2781186528},{"type":"v1","addr":"172.21.15.117:6809","nonce":2781186528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":2781186528},{"type":"v1","addr":"172.21.15.117:6811","nonce":2781186528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":2781186528},{"type":"v1","addr":"172.21.15.117:6815","nonce":2781186528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":2781186528},{"type":"v1","addr":"172.21.15.117:6813","nonce":2781186528}]},"public_addr":"172.21.15.117:6809/2781186528","cluster_addr":"172.21.15.117:6811/2781186528","heartbeat_back_addr":"172.21.15.117:6815/2781186528","heartbeat_front_addr":"172.21.15.117:6813/2781186528","state":["exists","up"]},{"osd":7,"uuid":"b68ec562-ff35-4d2d-a733-c896f8920cfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":617469882},{"type":"v1","addr":"172.21.15.117:6817","nonce":617469882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":617469882},{"type":"v1","addr":"172.21.15.117:6819","nonce":617469882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":617469882},{"type":"v1","addr":"172.21.15.117:6823","nonce":617469882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":617469882},{"type":"v1","addr":"172.21.15.117:6821","nonce":617469882}]},"public_addr":"172.21.15.117:6817/617469882","cluster_addr":"172.21.15.117:6819/617469882","heartbeat_back_addr":"172.21.15.117:6823/617469882","heartbeat_front_addr":"172.21.15.117:6821/617469882","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.347700+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.296619+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.361345+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.093323+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:12.857605+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:12.816090+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.083163+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.121639+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-04T06:56:25.481 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:25.482+0000 7f0773e00640 1 -- 172.21.15.72:0/3997008785 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f074c06c8f0 msgr2=0x7f074c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:25.481 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:25.482+0000 7f0773e00640 1 --2- 172.21.15.72:0/3997008785 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f074c06c8f0 0x7f074c06edb0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f0760036000 tx=0x7f0760030000 comp rx=0 tx=0).stop 2024-04-04T06:56:25.481 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:25.482+0000 7f0773e00640 1 -- 172.21.15.72:0/3997008785 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f076c0d1bf0 msgr2=0x7f076c1555a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:25.481 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:25.482+0000 7f0773e00640 1 --2- 172.21.15.72:0/3997008785 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f076c0d1bf0 0x7f076c1555a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f075800d800 tx=0x7f075800dcc0 comp rx=0 tx=0).stop 2024-04-04T06:56:25.481 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:25.482+0000 7f0773e00640 1 -- 172.21.15.72:0/3997008785 shutdown_connections 2024-04-04T06:56:25.481 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:25.482+0000 7f0773e00640 1 --2- 172.21.15.72:0/3997008785 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f074c06c8f0 0x7f074c06edb0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:25.481 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:25.482+0000 7f0773e00640 1 --2- 172.21.15.72:0/3997008785 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f076c15e6d0 0x7f076c155ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:25.481 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:25.482+0000 7f0773e00640 1 --2- 172.21.15.72:0/3997008785 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f076c0d1bf0 0x7f076c1555a0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:25.481 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:25.482+0000 7f0773e00640 1 --2- 172.21.15.72:0/3997008785 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f076c0d1510 0x7f076c0b6970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:25.482 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:25.482+0000 7f0773e00640 1 -- 172.21.15.72:0/3997008785 >> 172.21.15.72:0/3997008785 conn(0x7f076c0d2180 msgr2=0x7f076c15b5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:56:25.482 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:25.482+0000 7f0773e00640 1 -- 172.21.15.72:0/3997008785 shutdown_connections 2024-04-04T06:56:25.482 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:25.482+0000 7f0773e00640 1 -- 172.21.15.72:0/3997008785 wait complete. 2024-04-04T06:56:25.499 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-04T06:56:17.421685+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-04T06:56:25.499 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-04T06:56:25.709 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:25.710+0000 7f75d9000640 1 Processor -- start 2024-04-04T06:56:25.709 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:25.710+0000 7f75d9000640 1 -- start start 2024-04-04T06:56:25.711 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:25.712+0000 7f75d9000640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f75d4148610 0x7f75d4071800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:25.711 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:25.712+0000 7f75d9000640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f75d4071d40 0x7f75d40d0140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:25.711 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:25.712+0000 7f75d9000640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f75d4162d10 con 0x7f75d41489f0 2024-04-04T06:56:25.711 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:25.712+0000 7f75d9000640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f75d4162ff0 con 0x7f75d4071d40 2024-04-04T06:56:25.712 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:25.712+0000 7f75d9000640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f75d41632d0 con 0x7f75d4148610 2024-04-04T06:56:25.712 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:25.712+0000 7f75d2a00640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f75d4071d40 0x7f75d40d0140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:25.712 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:25.712+0000 7f75d2a00640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f75d4071d40 0x7f75d40d0140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:52884/0 (socket says 172.21.15.72:52884) 2024-04-04T06:56:25.712 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:25.712+0000 7f75d2a00640 1 -- 172.21.15.72:0/2340834450 learned_addr learned my addr 172.21.15.72:0/2340834450 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:56:25.712 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:25.713+0000 7f75d3400640 1 --2- 172.21.15.72:0/2340834450 >> v2:172.21.15.117:3300/0 conn(0x7f75d4148610 0x7f75d4071800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:25.712 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:25.713+0000 7f75d2a00640 1 -- 172.21.15.72:0/2340834450 >> v2:172.21.15.117:3300/0 conn(0x7f75d4148610 msgr2=0x7f75d4071800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:56:25.712 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:25.713+0000 7f75d2a00640 1 --2- 172.21.15.72:0/2340834450 >> v2:172.21.15.117:3300/0 conn(0x7f75d4148610 0x7f75d4071800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:25.712 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:25.713+0000 7f75d2a00640 1 -- 172.21.15.72:0/2340834450 >> v1:172.21.15.117:6789/0 conn(0x7f75d41489f0 legacy=0x7f75d406d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:56:25.712 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:25.713+0000 7f75d2a00640 1 -- 172.21.15.72:0/2340834450 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75d41635b0 con 0x7f75d4071d40 2024-04-04T06:56:25.712 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:25.713+0000 7f75d3400640 1 --2- 172.21.15.72:0/2340834450 >> v2:172.21.15.117:3300/0 conn(0x7f75d4148610 0x7f75d4071800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-04T06:56:25.714 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:25.714+0000 7f75d2a00640 1 --2- 172.21.15.72:0/2340834450 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f75d4071d40 0x7f75d40d0140 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f75d40737c0 tx=0x7f75bc02b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=489cc63d36c4591 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:25.714 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:25.714+0000 7f75d2000640 1 -- 172.21.15.72:0/2340834450 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75bc02e070 con 0x7f75d4071d40 2024-04-04T06:56:25.714 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:25.714+0000 7f75d2000640 1 -- 172.21.15.72:0/2340834450 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75bc037070 con 0x7f75d4071d40 2024-04-04T06:56:25.714 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:25.714+0000 7f75d2000640 1 -- 172.21.15.72:0/2340834450 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75bc031a00 con 0x7f75d4071d40 2024-04-04T06:56:25.714 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:25.715+0000 7f75d9000640 1 -- 172.21.15.72:0/2340834450 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f75d4071d40 msgr2=0x7f75d40d0140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:25.714 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:25.715+0000 7f75d9000640 1 --2- 172.21.15.72:0/2340834450 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f75d4071d40 0x7f75d40d0140 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f75d40737c0 tx=0x7f75bc02b880 comp rx=0 tx=0).stop 2024-04-04T06:56:25.714 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:25.715+0000 7f75d9000640 1 -- 172.21.15.72:0/2340834450 shutdown_connections 2024-04-04T06:56:25.714 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:25.715+0000 7f75d9000640 1 --2- 172.21.15.72:0/2340834450 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f75d4071d40 0x7f75d40d0140 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:25.714 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:25.715+0000 7f75d9000640 1 --2- 172.21.15.72:0/2340834450 >> v2:172.21.15.117:3300/0 conn(0x7f75d4148610 0x7f75d4071800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:25.714 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:25.715+0000 7f75d9000640 1 -- 172.21.15.72:0/2340834450 >> 172.21.15.72:0/2340834450 conn(0x7f75d406b890 msgr2=0x7f75d406bca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:56:25.714 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:25.715+0000 7f75d9000640 1 -- 172.21.15.72:0/2340834450 shutdown_connections 2024-04-04T06:56:25.714 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:25.715+0000 7f75d9000640 1 -- 172.21.15.72:0/2340834450 wait complete. 2024-04-04T06:56:25.715 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:25.717+0000 7f75d9000640 1 Processor -- start 2024-04-04T06:56:25.716 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:25.717+0000 7f75d9000640 1 -- start start 2024-04-04T06:56:25.718 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:25.718+0000 7f75d9000640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f75d4148610 0x7f75d40ce840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:25.718 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:25.718+0000 7f75d9000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f75d41489f0 0x7f75d41f9260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:25.718 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:25.718+0000 7f75d9000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75d41f97a0 0x7f75d40b0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:25.718 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:25.718+0000 7f75d9000640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f75d4146da0 con 0x7f75d4148610 2024-04-04T06:56:25.719 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:25.718+0000 7f75d9000640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f75d40714c0 con 0x7f75d41489f0 2024-04-04T06:56:25.719 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:25.718+0000 7f75d9000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f75d4146f20 con 0x7f75d41f97a0 2024-04-04T06:56:25.719 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:25.719+0000 7f75d3400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f75d4148610 0x7f75d40ce840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:25.719 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:25.719+0000 7f75d3400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f75d4148610 0x7f75d40ce840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:52900/0 (socket says 172.21.15.72:52900) 2024-04-04T06:56:25.719 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:25.719+0000 7f75d3400640 1 -- 172.21.15.72:0/3287083280 learned_addr learned my addr 172.21.15.72:0/3287083280 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:56:25.719 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:25.719+0000 7f75d3400640 1 -- 172.21.15.72:0/3287083280 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75d41f97a0 msgr2=0x7f75d40b0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:25.719 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:25.719+0000 7f75d2a00640 1 --2- 172.21.15.72:0/3287083280 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f75d41489f0 0x7f75d41f9260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:25.719 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:25.719+0000 7f75d3400640 1 --2- 172.21.15.72:0/3287083280 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75d41f97a0 0x7f75d40b0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:25.719 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:25.719+0000 7f75d3400640 1 -- 172.21.15.72:0/3287083280 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f75d41489f0 msgr2=0x7f75d41f9260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:25.719 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:25.719+0000 7f75d3400640 1 --2- 172.21.15.72:0/3287083280 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f75d41489f0 0x7f75d41f9260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:25.719 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:25.719+0000 7f75d3400640 1 -- 172.21.15.72:0/3287083280 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75d40afb20 con 0x7f75d4148610 2024-04-04T06:56:25.719 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:25.719+0000 7f75d3400640 1 --2- 172.21.15.72:0/3287083280 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f75d4148610 0x7f75d40ce840 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f75c400c7f0 tx=0x7f75c400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:25.719 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:25.720+0000 7f75cb400640 1 -- 172.21.15.72:0/3287083280 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75c4015070 con 0x7f75d4148610 2024-04-04T06:56:25.720 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:25.720+0000 7f75cb400640 1 -- 172.21.15.72:0/3287083280 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75c4007a30 con 0x7f75d4148610 2024-04-04T06:56:25.720 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:25.720+0000 7f75d9000640 1 -- 172.21.15.72:0/3287083280 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75d40afe00 con 0x7f75d4148610 2024-04-04T06:56:25.720 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:25.720+0000 7f75cb400640 1 -- 172.21.15.72:0/3287083280 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75c4007e00 con 0x7f75d4148610 2024-04-04T06:56:25.720 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:25.720+0000 7f75d9000640 1 -- 172.21.15.72:0/3287083280 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75d40b06a0 con 0x7f75d4148610 2024-04-04T06:56:25.720 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:25.721+0000 7f75d9000640 1 -- 172.21.15.72:0/3287083280 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75d40b01f0 con 0x7f75d4148610 2024-04-04T06:56:25.720 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:25.722+0000 7f75cb400640 1 -- 172.21.15.72:0/3287083280 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f75c4018070 con 0x7f75d4148610 2024-04-04T06:56:25.721 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:25.723+0000 7f75cb400640 1 --2- 172.21.15.72:0/3287083280 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f75b006c920 0x7f75b006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:25.721 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:25.723+0000 7f75cb400640 1 -- 172.21.15.72:0/3287083280 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f75c408b880 con 0x7f75d4148610 2024-04-04T06:56:25.721 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:25.723+0000 7f75d2a00640 1 --2- 172.21.15.72:0/3287083280 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f75b006c920 0x7f75b006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:25.722 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:25.724+0000 7f75d2a00640 1 --2- 172.21.15.72:0/3287083280 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f75b006c920 0x7f75b006ede0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f75bc036000 tx=0x7f75bc008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:25.725 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:25.727+0000 7f75cb400640 1 -- 172.21.15.72:0/3287083280 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f75c4059f60 con 0x7f75d4148610 2024-04-04T06:56:25.922 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:25.924+0000 7f75d9000640 1 -- 172.21.15.72:0/3287083280 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f75d40756c0 con 0x7f75d4148610 2024-04-04T06:56:25.923 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:25.925+0000 7f75cb400640 1 -- 172.21.15.72:0/3287083280 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) ==== 93+0+10 (secure 0 0 0) 0x7f75c4059860 con 0x7f75d4148610 2024-04-04T06:56:25.923 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 1 2024-04-04T06:56:25.926 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:25.927+0000 7f75d9000640 1 -- 172.21.15.72:0/3287083280 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f75b006c920 msgr2=0x7f75b006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:25.926 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:25.927+0000 7f75d9000640 1 --2- 172.21.15.72:0/3287083280 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f75b006c920 0x7f75b006ede0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f75bc036000 tx=0x7f75bc008030 comp rx=0 tx=0).stop 2024-04-04T06:56:25.926 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:25.927+0000 7f75d9000640 1 -- 172.21.15.72:0/3287083280 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f75d4148610 msgr2=0x7f75d40ce840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:25.926 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:25.927+0000 7f75d9000640 1 --2- 172.21.15.72:0/3287083280 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f75d4148610 0x7f75d40ce840 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f75c400c7f0 tx=0x7f75c400cbf0 comp rx=0 tx=0).stop 2024-04-04T06:56:25.926 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:25.927+0000 7f75d9000640 1 -- 172.21.15.72:0/3287083280 shutdown_connections 2024-04-04T06:56:25.927 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:25.927+0000 7f75d9000640 1 --2- 172.21.15.72:0/3287083280 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f75b006c920 0x7f75b006ede0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:25.927 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:25.927+0000 7f75d9000640 1 --2- 172.21.15.72:0/3287083280 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75d41f97a0 0x7f75d40b0bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:25.927 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:25.927+0000 7f75d9000640 1 --2- 172.21.15.72:0/3287083280 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f75d41489f0 0x7f75d41f9260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:25.927 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:25.927+0000 7f75d9000640 1 --2- 172.21.15.72:0/3287083280 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f75d4148610 0x7f75d40ce840 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:25.927 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:25.927+0000 7f75d9000640 1 -- 172.21.15.72:0/3287083280 >> 172.21.15.72:0/3287083280 conn(0x7f75d406b890 msgr2=0x7f75d4163da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:56:25.927 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:25.928+0000 7f75d9000640 1 -- 172.21.15.72:0/3287083280 shutdown_connections 2024-04-04T06:56:25.927 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:25.928+0000 7f75d9000640 1 -- 172.21.15.72:0/3287083280 wait complete. 2024-04-04T06:56:25.945 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-04T06:56:26.137 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:26.139+0000 7f258a600640 1 Processor -- start 2024-04-04T06:56:26.138 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:26.139+0000 7f258a600640 1 -- start start 2024-04-04T06:56:26.139 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:26.140+0000 7f258a600640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f25840cd1e0 0x7f2584071610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:26.139 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:26.140+0000 7f258a600640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f25840b3f50 con 0x7f258406eee0 2024-04-04T06:56:26.139 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:26.140+0000 7f258a600640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f25840b4230 con 0x7f2584073570 2024-04-04T06:56:26.139 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:26.140+0000 7f258a600640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f2584073950 con 0x7f25840cd1e0 2024-04-04T06:56:26.139 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:26.141+0000 7f2583e00640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f25840cd1e0 0x7f2584071610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:26.139 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:26.141+0000 7f2582a00640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f258406eee0 0x7f25840ccad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:39962/0 (socket says 172.21.15.72:39962) 2024-04-04T06:56:26.140 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:26.141+0000 7f2582a00640 1 -- 172.21.15.72:0/124238455 learned_addr learned my addr 172.21.15.72:0/124238455 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-04-04T06:56:26.140 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:26.141+0000 7f2583e00640 1 -- 172.21.15.72:0/124238455 >> v1:172.21.15.117:6789/0 conn(0x7f2584073570 legacy=0x7f25840b3700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:56:26.140 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:26.141+0000 7f2583e00640 1 -- 172.21.15.72:0/124238455 >> v1:172.21.15.72:6789/0 conn(0x7f258406eee0 legacy=0x7f25840ccad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:26.140 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:26.141+0000 7f2583e00640 1 -- 172.21.15.72:0/124238455 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25840b4510 con 0x7f25840cd1e0 2024-04-04T06:56:26.141 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:26.141+0000 7f2582000640 1 -- 172.21.15.72:0/124238455 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1531039709 0 0) 0x7f25840b3f50 con 0x7f258406eee0 2024-04-04T06:56:26.141 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:26.142+0000 7f2583e00640 1 --2- 172.21.15.72:0/124238455 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f25840cd1e0 0x7f2584071610 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f257c009d90 tx=0x7f257c02bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3f704136c7feded server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:26.142 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:26.142+0000 7f2582000640 1 -- 172.21.15.72:0/124238455 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f257c039070 con 0x7f25840cd1e0 2024-04-04T06:56:26.142 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:26.142+0000 7f2582000640 1 -- 172.21.15.72:0/124238455 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f257c02cd00 con 0x7f25840cd1e0 2024-04-04T06:56:26.142 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:26.142+0000 7f2582000640 1 -- 172.21.15.72:0/124238455 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f257c034660 con 0x7f25840cd1e0 2024-04-04T06:56:26.142 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:26.143+0000 7f258a600640 1 -- 172.21.15.72:0/124238455 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f25840cd1e0 msgr2=0x7f2584071610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:26.142 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:26.143+0000 7f258a600640 1 --2- 172.21.15.72:0/124238455 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f25840cd1e0 0x7f2584071610 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f257c009d90 tx=0x7f257c02bf50 comp rx=0 tx=0).stop 2024-04-04T06:56:26.142 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:26.143+0000 7f258a600640 1 -- 172.21.15.72:0/124238455 shutdown_connections 2024-04-04T06:56:26.142 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:26.143+0000 7f258a600640 1 --2- 172.21.15.72:0/124238455 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f25840cd1e0 0x7f2584071610 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:26.142 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:26.143+0000 7f258a600640 1 -- 172.21.15.72:0/124238455 >> 172.21.15.72:0/124238455 conn(0x7f258406b470 msgr2=0x7f258406b880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:56:26.142 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:26.143+0000 7f258a600640 1 -- 172.21.15.72:0/124238455 shutdown_connections 2024-04-04T06:56:26.143 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:26.143+0000 7f258a600640 1 -- 172.21.15.72:0/124238455 wait complete. 2024-04-04T06:56:26.143 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:26.145+0000 7f258a600640 1 Processor -- start 2024-04-04T06:56:26.143 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:26.145+0000 7f258a600640 1 -- start start 2024-04-04T06:56:26.145 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:26.146+0000 7f258a600640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f258406eee0 0x7f25841f1cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:26.145 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:26.146+0000 7f258a600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2584073570 0x7f258415c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:26.145 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:26.146+0000 7f258a600640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f25840cd1e0 0x7f258415ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:26.145 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:26.146+0000 7f258a600640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f25840cb9b0 con 0x7f25840cd1e0 2024-04-04T06:56:26.145 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:26.146+0000 7f258a600640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f25840cb520 con 0x7f258406eee0 2024-04-04T06:56:26.145 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:26.146+0000 7f258a600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f25840cbb30 con 0x7f2584073570 2024-04-04T06:56:26.145 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:26.146+0000 7f2583e00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f25840cd1e0 0x7f258415ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:26.146 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:26.146+0000 7f2583e00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f25840cd1e0 0x7f258415ce80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:52918/0 (socket says 172.21.15.72:52918) 2024-04-04T06:56:26.146 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:26.146+0000 7f2583e00640 1 -- 172.21.15.72:0/2664626975 learned_addr learned my addr 172.21.15.72:0/2664626975 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:56:26.146 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:26.147+0000 7f2582a00640 1 --2- 172.21.15.72:0/2664626975 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2584073570 0x7f258415c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:26.146 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:26.147+0000 7f2583400640 1 --2- 172.21.15.72:0/2664626975 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f258406eee0 0x7f25841f1cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:26.146 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:26.147+0000 7f2583e00640 1 -- 172.21.15.72:0/2664626975 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2584073570 msgr2=0x7f258415c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:26.146 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:26.147+0000 7f2583e00640 1 --2- 172.21.15.72:0/2664626975 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2584073570 0x7f258415c940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:26.146 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:26.147+0000 7f2583e00640 1 -- 172.21.15.72:0/2664626975 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f258406eee0 msgr2=0x7f25841f1cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:26.146 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:26.147+0000 7f2583e00640 1 --2- 172.21.15.72:0/2664626975 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f258406eee0 0x7f25841f1cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:26.146 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:26.147+0000 7f2583e00640 1 -- 172.21.15.72:0/2664626975 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f258415e9c0 con 0x7f25840cd1e0 2024-04-04T06:56:26.147 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:26.147+0000 7f2583e00640 1 --2- 172.21.15.72:0/2664626975 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f25840cd1e0 0x7f258415ce80 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f257c009d90 tx=0x7f257c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:26.147 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:26.147+0000 7f257b400640 1 -- 172.21.15.72:0/2664626975 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f257c044020 con 0x7f25840cd1e0 2024-04-04T06:56:26.147 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:26.147+0000 7f257b400640 1 -- 172.21.15.72:0/2664626975 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f257c03f470 con 0x7f25840cd1e0 2024-04-04T06:56:26.147 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:26.147+0000 7f257b400640 1 -- 172.21.15.72:0/2664626975 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f257c039040 con 0x7f25840cd1e0 2024-04-04T06:56:26.147 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:26.147+0000 7f258a600640 1 -- 172.21.15.72:0/2664626975 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f258415eca0 con 0x7f25840cd1e0 2024-04-04T06:56:26.148 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:26.147+0000 7f258a600640 1 -- 172.21.15.72:0/2664626975 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25840c3dd0 con 0x7f25840cd1e0 2024-04-04T06:56:26.148 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:26.149+0000 7f258a600640 1 -- 172.21.15.72:0/2664626975 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f25840c6eb0 con 0x7f25840cd1e0 2024-04-04T06:56:26.148 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:26.149+0000 7f257b400640 1 -- 172.21.15.72:0/2664626975 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f257c047020 con 0x7f25840cd1e0 2024-04-04T06:56:26.148 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:26.150+0000 7f257b400640 1 --2- 172.21.15.72:0/2664626975 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f256406c8f0 0x7f256406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:26.149 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:26.150+0000 7f257b400640 1 -- 172.21.15.72:0/2664626975 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f257c0ae470 con 0x7f25840cd1e0 2024-04-04T06:56:26.149 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:26.151+0000 7f2583400640 1 --2- 172.21.15.72:0/2664626975 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f256406c8f0 0x7f256406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:26.149 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:26.151+0000 7f2583400640 1 --2- 172.21.15.72:0/2664626975 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f256406c8f0 0x7f256406edb0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f2574003d90 tx=0x7f2574009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:26.153 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:26.155+0000 7f257b400640 1 -- 172.21.15.72:0/2664626975 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f25840c6eb0 con 0x7f25840cd1e0 2024-04-04T06:56:26.361 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:26.362+0000 7f258a600640 1 -- 172.21.15.72:0/2664626975 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f25840b3c30 con 0x7f25840cd1e0 2024-04-04T06:56:26.361 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:26.363+0000 7f257b400640 1 -- 172.21.15.72:0/2664626975 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v16) ==== 84+0+65 (secure 0 0 0) 0x7f25840b3c30 con 0x7f25840cd1e0 2024-04-04T06:56:26.361 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T06:56:26.361 INFO:teuthology.orchestra.run.smithi072.stdout:[ 2024-04-04T06:56:26.362 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-04T06:56:26.362 INFO:teuthology.orchestra.run.smithi072.stdout: "poolnum": 1, 2024-04-04T06:56:26.362 INFO:teuthology.orchestra.run.smithi072.stdout: "poolname": ".mgr" 2024-04-04T06:56:26.362 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-04T06:56:26.362 INFO:teuthology.orchestra.run.smithi072.stdout:] 2024-04-04T06:56:26.364 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:26.365+0000 7f258a600640 1 -- 172.21.15.72:0/2664626975 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f256406c8f0 msgr2=0x7f256406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:26.364 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:26.365+0000 7f258a600640 1 --2- 172.21.15.72:0/2664626975 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f256406c8f0 0x7f256406edb0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f2574003d90 tx=0x7f2574009040 comp rx=0 tx=0).stop 2024-04-04T06:56:26.364 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:26.365+0000 7f258a600640 1 -- 172.21.15.72:0/2664626975 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f25840cd1e0 msgr2=0x7f258415ce80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:26.364 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:26.365+0000 7f258a600640 1 --2- 172.21.15.72:0/2664626975 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f25840cd1e0 0x7f258415ce80 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f257c009d90 tx=0x7f257c004a40 comp rx=0 tx=0).stop 2024-04-04T06:56:26.364 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:26.365+0000 7f258a600640 1 -- 172.21.15.72:0/2664626975 shutdown_connections 2024-04-04T06:56:26.364 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:26.365+0000 7f258a600640 1 --2- 172.21.15.72:0/2664626975 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f256406c8f0 0x7f256406edb0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:26.364 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:26.365+0000 7f258a600640 1 --2- 172.21.15.72:0/2664626975 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f25840cd1e0 0x7f258415ce80 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:26.364 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:26.365+0000 7f258a600640 1 --2- 172.21.15.72:0/2664626975 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2584073570 0x7f258415c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:26.364 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:26.365+0000 7f258a600640 1 --2- 172.21.15.72:0/2664626975 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f258406eee0 0x7f25841f1cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:26.365 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:26.365+0000 7f258a600640 1 -- 172.21.15.72:0/2664626975 >> 172.21.15.72:0/2664626975 conn(0x7f258406b470 msgr2=0x7f25840cc740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:56:26.365 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:26.365+0000 7f258a600640 1 -- 172.21.15.72:0/2664626975 shutdown_connections 2024-04-04T06:56:26.365 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:26.366+0000 7f258a600640 1 -- 172.21.15.72:0/2664626975 wait complete. 2024-04-04T06:56:26.381 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-04T06:56:26.381 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-04T06:56:26.587 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:26.588+0000 7f8cc3a00640 1 Processor -- start 2024-04-04T06:56:26.587 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:26.589+0000 7f8cc3a00640 1 -- start start 2024-04-04T06:56:26.589 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:26.590+0000 7f8cc3a00640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8cbc15b230 0x7f8cbc0d00c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:26.590 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:26.590+0000 7f8cc3a00640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8cbc0c5c00 con 0x7f8cbc0d0600 2024-04-04T06:56:26.590 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:26.590+0000 7f8cc3a00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8cbc15b980 con 0x7f8cbc0c5700 2024-04-04T06:56:26.590 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:26.590+0000 7f8cc3a00640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f8cbc15c2b0 con 0x7f8cbc15b230 2024-04-04T06:56:26.590 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:26.590+0000 7f8cb3e00640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f8cbc0d0600 0x7f8cbc0c4ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:39966/0 (socket says 172.21.15.72:39966) 2024-04-04T06:56:26.590 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:26.590+0000 7f8cb3e00640 1 -- 172.21.15.72:0/1857618649 learned_addr learned my addr 172.21.15.72:0/1857618649 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-04-04T06:56:26.590 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:26.591+0000 7f8cc1000640 1 --2- 172.21.15.72:0/1857618649 >> v2:172.21.15.72:3300/0 conn(0x7f8cbc15b230 0x7f8cbc0d00c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:26.590 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:26.591+0000 7f8cbbe00640 1 -- 172.21.15.72:0/1857618649 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1147233720 0 0) 0x7f8cbc0c5c00 con 0x7f8cbc0d0600 2024-04-04T06:56:26.590 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:26.591+0000 7f8cc1000640 1 -- 172.21.15.72:0/1857618649 >> v1:172.21.15.117:6789/0 conn(0x7f8cbc0c5700 legacy=0x7f8cbc0b3540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:56:26.590 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:26.591+0000 7f8cc1000640 1 -- 172.21.15.72:0/1857618649 >> v1:172.21.15.72:6789/0 conn(0x7f8cbc0d0600 legacy=0x7f8cbc0c4ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:26.590 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:26.591+0000 7f8cc1000640 1 -- 172.21.15.72:0/1857618649 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cbc15bc60 con 0x7f8cbc15b230 2024-04-04T06:56:26.592 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:26.592+0000 7f8cc1000640 1 --2- 172.21.15.72:0/1857618649 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8cbc15b230 0x7f8cbc0d00c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f8cac0097a0 tx=0x7f8cac02b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbf6e93b2ebbabb2 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:26.592 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:26.592+0000 7f8cbbe00640 1 -- 172.21.15.72:0/1857618649 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cac034070 con 0x7f8cbc15b230 2024-04-04T06:56:26.592 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:26.592+0000 7f8cbbe00640 1 -- 172.21.15.72:0/1857618649 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8cac030610 con 0x7f8cbc15b230 2024-04-04T06:56:26.592 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:26.592+0000 7f8cbbe00640 1 -- 172.21.15.72:0/1857618649 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cac0309e0 con 0x7f8cbc15b230 2024-04-04T06:56:26.592 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:26.593+0000 7f8cc3a00640 1 -- 172.21.15.72:0/1857618649 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8cbc15b230 msgr2=0x7f8cbc0d00c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:26.592 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:26.593+0000 7f8cc3a00640 1 --2- 172.21.15.72:0/1857618649 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8cbc15b230 0x7f8cbc0d00c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f8cac0097a0 tx=0x7f8cac02b960 comp rx=0 tx=0).stop 2024-04-04T06:56:26.592 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:26.593+0000 7f8cc3a00640 1 -- 172.21.15.72:0/1857618649 shutdown_connections 2024-04-04T06:56:26.592 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:26.593+0000 7f8cc3a00640 1 --2- 172.21.15.72:0/1857618649 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8cbc15b230 0x7f8cbc0d00c0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:26.592 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:26.593+0000 7f8cc3a00640 1 -- 172.21.15.72:0/1857618649 >> 172.21.15.72:0/1857618649 conn(0x7f8cbc06b470 msgr2=0x7f8cbc06b880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:56:26.592 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:26.593+0000 7f8cc3a00640 1 -- 172.21.15.72:0/1857618649 shutdown_connections 2024-04-04T06:56:26.592 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:26.593+0000 7f8cc3a00640 1 -- 172.21.15.72:0/1857618649 wait complete. 2024-04-04T06:56:26.593 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:26.595+0000 7f8cc3a00640 1 Processor -- start 2024-04-04T06:56:26.593 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:26.595+0000 7f8cc3a00640 1 -- start start 2024-04-04T06:56:26.595 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:26.596+0000 7f8cc3a00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8cbc0c5700 0x7f8cbc0adde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:26.596 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:26.596+0000 7f8cc3a00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8cbc0d0600 0x7f8cbc166ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:26.596 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:26.596+0000 7f8cc3a00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8cbc15b230 0x7f8cbc167410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:26.596 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:26.596+0000 7f8cc3a00640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f8cbc0cf040 con 0x7f8cbc0d0600 2024-04-04T06:56:26.596 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:26.596+0000 7f8cc3a00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f8cbc0d0a00 con 0x7f8cbc15b230 2024-04-04T06:56:26.596 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:26.596+0000 7f8cc3a00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f8cbc15b610 con 0x7f8cbc0c5700 2024-04-04T06:56:26.596 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:26.596+0000 7f8cb3e00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8cbc0d0600 0x7f8cbc166ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:26.596 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:26.596+0000 7f8cb3e00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8cbc0d0600 0x7f8cbc166ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:52938/0 (socket says 172.21.15.72:52938) 2024-04-04T06:56:26.596 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:26.596+0000 7f8cb3e00640 1 -- 172.21.15.72:0/136763330 learned_addr learned my addr 172.21.15.72:0/136763330 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:56:26.596 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:26.596+0000 7f8cc1000640 1 --2- 172.21.15.72:0/136763330 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8cbc0c5700 0x7f8cbc0adde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:26.596 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:26.596+0000 7f8cb3e00640 1 -- 172.21.15.72:0/136763330 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8cbc0c5700 msgr2=0x7f8cbc0adde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:26.596 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:26.596+0000 7f8cb3e00640 1 --2- 172.21.15.72:0/136763330 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8cbc0c5700 0x7f8cbc0adde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:26.596 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:26.596+0000 7f8cb3e00640 1 -- 172.21.15.72:0/136763330 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8cbc15b230 msgr2=0x7f8cbc167410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:26.596 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:26.596+0000 7f8cb3e00640 1 --2- 172.21.15.72:0/136763330 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8cbc15b230 0x7f8cbc167410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:26.596 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:26.596+0000 7f8cb3e00640 1 -- 172.21.15.72:0/136763330 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cbc15c970 con 0x7f8cbc0d0600 2024-04-04T06:56:26.596 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:26.597+0000 7f8cb3e00640 1 --2- 172.21.15.72:0/136763330 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8cbc0d0600 0x7f8cbc166ed0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f8ca400c4a0 tx=0x7f8ca400c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:26.597 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:26.597+0000 7f8cb9600640 1 -- 172.21.15.72:0/136763330 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ca4018070 con 0x7f8cbc0d0600 2024-04-04T06:56:26.597 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:26.597+0000 7f8cb9600640 1 -- 172.21.15.72:0/136763330 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ca40074e0 con 0x7f8cbc0d0600 2024-04-04T06:56:26.597 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:26.597+0000 7f8cb9600640 1 -- 172.21.15.72:0/136763330 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ca4004a20 con 0x7f8cbc0d0600 2024-04-04T06:56:26.597 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:26.597+0000 7f8cc3a00640 1 -- 172.21.15.72:0/136763330 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8cbc15cc50 con 0x7f8cbc0d0600 2024-04-04T06:56:26.597 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:26.597+0000 7f8cc3a00640 1 -- 172.21.15.72:0/136763330 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8cbc15d210 con 0x7f8cbc0d0600 2024-04-04T06:56:26.597 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:26.598+0000 7f8cc3a00640 1 -- 172.21.15.72:0/136763330 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8cbc075840 con 0x7f8cbc0d0600 2024-04-04T06:56:26.597 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:26.599+0000 7f8cb9600640 1 -- 172.21.15.72:0/136763330 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8ca401b070 con 0x7f8cbc0d0600 2024-04-04T06:56:26.599 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:26.600+0000 7f8cb9600640 1 --2- 172.21.15.72:0/136763330 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f8c9806c8f0 0x7f8c9806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:26.599 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:26.600+0000 7f8cb9600640 1 -- 172.21.15.72:0/136763330 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f8ca408ac00 con 0x7f8cbc0d0600 2024-04-04T06:56:26.599 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:26.600+0000 7f8cc1000640 1 --2- 172.21.15.72:0/136763330 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f8c9806c8f0 0x7f8c9806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:26.599 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:26.601+0000 7f8cc1000640 1 --2- 172.21.15.72:0/136763330 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f8c9806c8f0 0x7f8c9806edb0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f8cac036000 tx=0x7f8cac03b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:26.603 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:26.605+0000 7f8cb9600640 1 -- 172.21.15.72:0/136763330 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f8ca40592e0 con 0x7f8cbc0d0600 2024-04-04T06:56:26.805 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:26.806+0000 7f8cc3a00640 1 -- 172.21.15.72:0/136763330 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f8cbc06f930 con 0x7f8cbc0d0600 2024-04-04T06:56:26.961 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:26.962+0000 7f8cb9600640 1 -- 172.21.15.72:0/136763330 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v17) ==== 138+0+0 (secure 0 0 0) 0x7f8ca4058be0 con 0x7f8cbc0d0600 2024-04-04T06:56:26.961 INFO:teuthology.orchestra.run.smithi072.stderr:pool 'cephfs_metadata' created 2024-04-04T06:56:26.964 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:26.965+0000 7f8cc3a00640 1 -- 172.21.15.72:0/136763330 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f8c9806c8f0 msgr2=0x7f8c9806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:26.964 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:26.965+0000 7f8cc3a00640 1 --2- 172.21.15.72:0/136763330 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f8c9806c8f0 0x7f8c9806edb0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f8cac036000 tx=0x7f8cac03b040 comp rx=0 tx=0).stop 2024-04-04T06:56:26.964 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:26.965+0000 7f8cc3a00640 1 -- 172.21.15.72:0/136763330 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8cbc0d0600 msgr2=0x7f8cbc166ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:26.964 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:26.965+0000 7f8cc3a00640 1 --2- 172.21.15.72:0/136763330 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8cbc0d0600 0x7f8cbc166ed0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f8ca400c4a0 tx=0x7f8ca400c960 comp rx=0 tx=0).stop 2024-04-04T06:56:26.965 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:26.966+0000 7f8cc3a00640 1 -- 172.21.15.72:0/136763330 shutdown_connections 2024-04-04T06:56:26.965 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:26.966+0000 7f8cc3a00640 1 --2- 172.21.15.72:0/136763330 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f8c9806c8f0 0x7f8c9806edb0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:26.965 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:26.966+0000 7f8cc3a00640 1 --2- 172.21.15.72:0/136763330 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8cbc15b230 0x7f8cbc167410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:26.965 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:26.966+0000 7f8cc3a00640 1 --2- 172.21.15.72:0/136763330 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8cbc0d0600 0x7f8cbc166ed0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:26.965 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:26.966+0000 7f8cc3a00640 1 --2- 172.21.15.72:0/136763330 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8cbc0c5700 0x7f8cbc0adde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:26.965 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:26.966+0000 7f8cc3a00640 1 -- 172.21.15.72:0/136763330 >> 172.21.15.72:0/136763330 conn(0x7f8cbc06b470 msgr2=0x7f8cbc0b3540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:56:26.965 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:26.966+0000 7f8cc3a00640 1 -- 172.21.15.72:0/136763330 shutdown_connections 2024-04-04T06:56:26.965 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:26.966+0000 7f8cc3a00640 1 -- 172.21.15.72:0/136763330 wait complete. 2024-04-04T06:56:26.993 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-04T06:56:27.190 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:27.192+0000 7f4a27800640 1 Processor -- start 2024-04-04T06:56:27.191 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:27.192+0000 7f4a27800640 1 -- start start 2024-04-04T06:56:27.193 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:27.193+0000 7f4a27800640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f4a2015afb0 0x7f4a20071e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:27.193 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:27.194+0000 7f4a27800640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4a200cf360 0x7f4a200726e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:27.193 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:27.194+0000 7f4a27800640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f4a2015b390 0x7f4a20072c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:27.193 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:27.194+0000 7f4a27800640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f4a20072350 con 0x7f4a2015b390 2024-04-04T06:56:27.193 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:27.194+0000 7f4a27800640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f4a2015ece0 con 0x7f4a2015afb0 2024-04-04T06:56:27.193 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:27.194+0000 7f4a27800640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f4a2015efa0 con 0x7f4a200cf360 2024-04-04T06:56:27.193 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:27.194+0000 7f4a25800640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f4a2015b390 0x7f4a20072c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:27.193 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:27.194+0000 7f4a25800640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f4a2015b390 0x7f4a20072c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:52950/0 (socket says 172.21.15.72:52950) 2024-04-04T06:56:27.193 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:27.194+0000 7f4a25800640 1 -- 172.21.15.72:0/2298942543 learned_addr learned my addr 172.21.15.72:0/2298942543 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:56:27.193 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:27.194+0000 7f4a24e00640 1 --2- 172.21.15.72:0/2298942543 >> v2:172.21.15.117:3300/0 conn(0x7f4a2015afb0 0x7f4a20071e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:27.193 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:27.194+0000 7f4a1fe00640 1 --2- 172.21.15.72:0/2298942543 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4a200cf360 0x7f4a200726e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:27.194 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:27.195+0000 7f4a25800640 1 -- 172.21.15.72:0/2298942543 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4a200cf360 msgr2=0x7f4a200726e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:56:27.194 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:27.195+0000 7f4a25800640 1 --2- 172.21.15.72:0/2298942543 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4a200cf360 0x7f4a200726e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:27.194 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:27.195+0000 7f4a25800640 1 -- 172.21.15.72:0/2298942543 >> v2:172.21.15.117:3300/0 conn(0x7f4a2015afb0 msgr2=0x7f4a20071e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:56:27.194 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:27.195+0000 7f4a25800640 1 --2- 172.21.15.72:0/2298942543 >> v2:172.21.15.117:3300/0 conn(0x7f4a2015afb0 0x7f4a20071e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:27.194 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:27.195+0000 7f4a25800640 1 -- 172.21.15.72:0/2298942543 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a2015f280 con 0x7f4a2015b390 2024-04-04T06:56:27.194 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:27.196+0000 7f4a25800640 1 --2- 172.21.15.72:0/2298942543 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4a2015b390 0x7f4a20072c20 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f4a2006f880 tx=0x7f4a1802bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c242ca6e55024db server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:27.195 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:27.196+0000 7f4a1f400640 1 -- 172.21.15.72:0/2298942543 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a1802ca80 con 0x7f4a2015b390 2024-04-04T06:56:27.195 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:27.197+0000 7f4a1f400640 1 -- 172.21.15.72:0/2298942543 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a1802cc20 con 0x7f4a2015b390 2024-04-04T06:56:27.195 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:27.197+0000 7f4a1f400640 1 -- 172.21.15.72:0/2298942543 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a180343f0 con 0x7f4a2015b390 2024-04-04T06:56:27.196 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:27.197+0000 7f4a27800640 1 -- 172.21.15.72:0/2298942543 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4a2015b390 msgr2=0x7f4a20072c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:27.196 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:27.197+0000 7f4a27800640 1 --2- 172.21.15.72:0/2298942543 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4a2015b390 0x7f4a20072c20 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f4a2006f880 tx=0x7f4a1802bee0 comp rx=0 tx=0).stop 2024-04-04T06:56:27.196 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:27.197+0000 7f4a27800640 1 -- 172.21.15.72:0/2298942543 shutdown_connections 2024-04-04T06:56:27.196 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:27.197+0000 7f4a27800640 1 --2- 172.21.15.72:0/2298942543 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4a2015b390 0x7f4a20072c20 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:27.196 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:27.197+0000 7f4a27800640 1 --2- 172.21.15.72:0/2298942543 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4a200cf360 0x7f4a200726e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:27.196 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:27.198+0000 7f4a27800640 1 --2- 172.21.15.72:0/2298942543 >> v2:172.21.15.117:3300/0 conn(0x7f4a2015afb0 0x7f4a20071e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:27.196 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:27.198+0000 7f4a27800640 1 -- 172.21.15.72:0/2298942543 >> 172.21.15.72:0/2298942543 conn(0x7f4a2006b470 msgr2=0x7f4a2006b850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:56:27.196 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:27.198+0000 7f4a27800640 1 -- 172.21.15.72:0/2298942543 shutdown_connections 2024-04-04T06:56:27.196 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:27.198+0000 7f4a27800640 1 -- 172.21.15.72:0/2298942543 wait complete. 2024-04-04T06:56:27.198 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:27.200+0000 7f4a27800640 1 Processor -- start 2024-04-04T06:56:27.199 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:27.200+0000 7f4a27800640 1 -- start start 2024-04-04T06:56:27.201 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:27.201+0000 7f4a27800640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4a200cf360 0x7f4a2015e250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:27.201 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:27.201+0000 7f4a27800640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4a2015afb0 0x7f4a2014adb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:27.201 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:27.201+0000 7f4a27800640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4a2015b390 0x7f4a2014d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:27.201 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:27.201+0000 7f4a27800640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f4a2015fb20 con 0x7f4a200cf360 2024-04-04T06:56:27.201 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:27.201+0000 7f4a27800640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f4a2015f840 con 0x7f4a2015b390 2024-04-04T06:56:27.201 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:27.201+0000 7f4a27800640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f4a200b2fd0 con 0x7f4a2015afb0 2024-04-04T06:56:27.202 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:27.202+0000 7f4a24e00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4a200cf360 0x7f4a2015e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:27.202 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:27.202+0000 7f4a24e00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4a200cf360 0x7f4a2015e250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:52956/0 (socket says 172.21.15.72:52956) 2024-04-04T06:56:27.202 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:27.202+0000 7f4a24e00640 1 -- 172.21.15.72:0/1287900685 learned_addr learned my addr 172.21.15.72:0/1287900685 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:56:27.202 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:27.202+0000 7f4a1fe00640 1 --2- 172.21.15.72:0/1287900685 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4a2015afb0 0x7f4a2014adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:27.202 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:27.202+0000 7f4a25800640 1 --2- 172.21.15.72:0/1287900685 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4a2015b390 0x7f4a2014d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:27.202 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:27.202+0000 7f4a24e00640 1 -- 172.21.15.72:0/1287900685 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4a2015afb0 msgr2=0x7f4a2014adb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:27.202 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:27.202+0000 7f4a24e00640 1 --2- 172.21.15.72:0/1287900685 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4a2015afb0 0x7f4a2014adb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:27.202 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:27.202+0000 7f4a24e00640 1 -- 172.21.15.72:0/1287900685 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4a2015b390 msgr2=0x7f4a2014d410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:27.202 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:27.202+0000 7f4a24e00640 1 --2- 172.21.15.72:0/1287900685 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4a2015b390 0x7f4a2014d410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:27.202 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:27.202+0000 7f4a24e00640 1 -- 172.21.15.72:0/1287900685 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a2014b790 con 0x7f4a200cf360 2024-04-04T06:56:27.202 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:27.202+0000 7f4a1fe00640 1 --2- 172.21.15.72:0/1287900685 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4a2015afb0 0x7f4a2014adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-04T06:56:27.202 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:27.202+0000 7f4a24e00640 1 --2- 172.21.15.72:0/1287900685 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4a200cf360 0x7f4a2015e250 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f4a1400e9b0 tx=0x7f4a1400ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:27.202 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:27.203+0000 7f4a1cc00640 1 -- 172.21.15.72:0/1287900685 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a14017070 con 0x7f4a200cf360 2024-04-04T06:56:27.202 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:27.203+0000 7f4a1cc00640 1 -- 172.21.15.72:0/1287900685 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a1400c9a0 con 0x7f4a200cf360 2024-04-04T06:56:27.203 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:27.203+0000 7f4a1cc00640 1 -- 172.21.15.72:0/1287900685 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a1400cd90 con 0x7f4a200cf360 2024-04-04T06:56:27.203 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:27.203+0000 7f4a27800640 1 -- 172.21.15.72:0/1287900685 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a20140ac0 con 0x7f4a200cf360 2024-04-04T06:56:27.203 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:27.203+0000 7f4a27800640 1 -- 172.21.15.72:0/1287900685 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a20141080 con 0x7f4a200cf360 2024-04-04T06:56:27.203 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:27.204+0000 7f4a27800640 1 -- 172.21.15.72:0/1287900685 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a20075730 con 0x7f4a200cf360 2024-04-04T06:56:27.204 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:27.206+0000 7f4a1cc00640 1 -- 172.21.15.72:0/1287900685 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4a1401a070 con 0x7f4a200cf360 2024-04-04T06:56:27.205 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:27.206+0000 7f4a1cc00640 1 --2- 172.21.15.72:0/1287900685 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f4a0006c8f0 0x7f4a0006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:27.205 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:27.207+0000 7f4a1cc00640 1 -- 172.21.15.72:0/1287900685 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 5227+0+0 (secure 0 0 0) 0x7f4a1408bd50 con 0x7f4a200cf360 2024-04-04T06:56:27.205 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:27.207+0000 7f4a1fe00640 1 --2- 172.21.15.72:0/1287900685 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f4a0006c8f0 0x7f4a0006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:27.206 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:27.207+0000 7f4a1fe00640 1 --2- 172.21.15.72:0/1287900685 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f4a0006c8f0 0x7f4a0006edb0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f4a2015bb00 tx=0x7f4a0c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:27.210 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:27.212+0000 7f4a1cc00640 1 -- 172.21.15.72:0/1287900685 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f4a1405a2c0 con 0x7f4a200cf360 2024-04-04T06:56:27.411 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:27.413+0000 7f4a27800640 1 -- 172.21.15.72:0/1287900685 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f4a200b1990 con 0x7f4a200cf360 2024-04-04T06:56:27.967 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:27.968+0000 7f4a1cc00640 1 -- 172.21.15.72:0/1287900685 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v18) ==== 170+0+0 (secure 0 0 0) 0x7f4a14059bc0 con 0x7f4a200cf360 2024-04-04T06:56:27.967 INFO:teuthology.orchestra.run.smithi072.stderr:pool 'cephfs_data' created 2024-04-04T06:56:27.971 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:27.972+0000 7f4a27800640 1 -- 172.21.15.72:0/1287900685 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f4a0006c8f0 msgr2=0x7f4a0006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:27.971 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:27.972+0000 7f4a27800640 1 --2- 172.21.15.72:0/1287900685 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f4a0006c8f0 0x7f4a0006edb0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f4a2015bb00 tx=0x7f4a0c008040 comp rx=0 tx=0).stop 2024-04-04T06:56:27.971 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:27.972+0000 7f4a27800640 1 -- 172.21.15.72:0/1287900685 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4a200cf360 msgr2=0x7f4a2015e250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:27.971 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:27.972+0000 7f4a27800640 1 --2- 172.21.15.72:0/1287900685 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4a200cf360 0x7f4a2015e250 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f4a1400e9b0 tx=0x7f4a1400ee70 comp rx=0 tx=0).stop 2024-04-04T06:56:27.971 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:27.972+0000 7f4a27800640 1 -- 172.21.15.72:0/1287900685 shutdown_connections 2024-04-04T06:56:27.972 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:27.972+0000 7f4a27800640 1 --2- 172.21.15.72:0/1287900685 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f4a0006c8f0 0x7f4a0006edb0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:27.972 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:27.972+0000 7f4a27800640 1 --2- 172.21.15.72:0/1287900685 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4a2015b390 0x7f4a2014d410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:27.972 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:27.972+0000 7f4a27800640 1 --2- 172.21.15.72:0/1287900685 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4a2015afb0 0x7f4a2014adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:27.972 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:27.972+0000 7f4a27800640 1 --2- 172.21.15.72:0/1287900685 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4a200cf360 0x7f4a2015e250 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:27.972 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:27.972+0000 7f4a27800640 1 -- 172.21.15.72:0/1287900685 >> 172.21.15.72:0/1287900685 conn(0x7f4a2006b470 msgr2=0x7f4a200d0190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:56:27.972 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:27.973+0000 7f4a27800640 1 -- 172.21.15.72:0/1287900685 shutdown_connections 2024-04-04T06:56:27.972 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:27.973+0000 7f4a27800640 1 -- 172.21.15.72:0/1287900685 wait complete. 2024-04-04T06:56:28.004 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-04T06:56:28.188 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:28.189+0000 7f59fde00640 1 Processor -- start 2024-04-04T06:56:28.188 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:28.189+0000 7f59fde00640 1 -- start start 2024-04-04T06:56:28.189 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:28.190+0000 7f59fde00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f59f80d0420 0x7f59f815f420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:28.189 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:28.190+0000 7f59fde00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f59f80d0800 0x7f59f80726b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:28.189 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:28.190+0000 7f59fde00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59f815f960 con 0x7f59f80b4170 2024-04-04T06:56:28.189 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:28.191+0000 7f59fde00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f59f815bc10 con 0x7f59f80d0800 2024-04-04T06:56:28.189 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:28.191+0000 7f59fde00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f59f815c410 con 0x7f59f80d0420 2024-04-04T06:56:28.190 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:28.191+0000 7f59fd400640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f59f80d0800 0x7f59f80726b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:28.190 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:28.191+0000 7f59fd400640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f59f80d0800 0x7f59f80726b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.72:43056/0 (socket says 172.21.15.72:43056) 2024-04-04T06:56:28.190 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:28.191+0000 7f59fd400640 1 -- 172.21.15.72:0/3408296582 learned_addr learned my addr 172.21.15.72:0/3408296582 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:56:28.191 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:28.191+0000 7f59f7e00640 1 --1- 172.21.15.72:0/3408296582 >> v1:172.21.15.117:6789/0 conn(0x7f59f80b4170 0x7f59f815b500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.72:50330/0 (socket says 172.21.15.72:50330) 2024-04-04T06:56:28.191 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:28.191+0000 7f59fca00640 1 --2- 172.21.15.72:0/3408296582 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f59f80d0420 0x7f59f815f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:28.191 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:28.192+0000 7f59fd400640 1 -- 172.21.15.72:0/3408296582 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f59f80d0420 msgr2=0x7f59f815f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:56:28.191 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:28.192+0000 7f59fd400640 1 --2- 172.21.15.72:0/3408296582 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f59f80d0420 0x7f59f815f420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:28.191 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:28.192+0000 7f59fd400640 1 -- 172.21.15.72:0/3408296582 >> v1:172.21.15.117:6789/0 conn(0x7f59f80b4170 legacy=0x7f59f815b500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:28.191 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:28.192+0000 7f59fd400640 1 -- 172.21.15.72:0/3408296582 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59f815be50 con 0x7f59f80d0800 2024-04-04T06:56:28.191 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:28.192+0000 7f59fca00640 1 --2- 172.21.15.72:0/3408296582 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f59f80d0420 0x7f59f815f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-04T06:56:28.192 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:28.194+0000 7f59fd400640 1 --2- 172.21.15.72:0/3408296582 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f59f80d0800 0x7f59f80726b0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f59f0009e50 tx=0x7f59f002bed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a627525da6865f26 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:28.192 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:28.194+0000 7f59f7400640 1 -- 172.21.15.72:0/3408296582 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59f002ca70 con 0x7f59f80d0800 2024-04-04T06:56:28.192 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:28.194+0000 7f59f7400640 1 -- 172.21.15.72:0/3408296582 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59f002cc10 con 0x7f59f80d0800 2024-04-04T06:56:28.193 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:28.194+0000 7f59f7400640 1 -- 172.21.15.72:0/3408296582 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59f00343f0 con 0x7f59f80d0800 2024-04-04T06:56:28.193 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:28.195+0000 7f59fde00640 1 -- 172.21.15.72:0/3408296582 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f59f80d0800 msgr2=0x7f59f80726b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:28.194 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:28.195+0000 7f59fde00640 1 --2- 172.21.15.72:0/3408296582 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f59f80d0800 0x7f59f80726b0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f59f0009e50 tx=0x7f59f002bed0 comp rx=0 tx=0).stop 2024-04-04T06:56:28.194 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:28.195+0000 7f59fde00640 1 -- 172.21.15.72:0/3408296582 shutdown_connections 2024-04-04T06:56:28.194 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:28.195+0000 7f59fde00640 1 --2- 172.21.15.72:0/3408296582 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f59f80d0800 0x7f59f80726b0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:28.194 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:28.195+0000 7f59fde00640 1 --2- 172.21.15.72:0/3408296582 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f59f80d0420 0x7f59f815f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:28.194 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:28.195+0000 7f59fde00640 1 -- 172.21.15.72:0/3408296582 >> 172.21.15.72:0/3408296582 conn(0x7f59f806b890 msgr2=0x7f59f806bca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:56:28.194 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:28.195+0000 7f59fde00640 1 -- 172.21.15.72:0/3408296582 shutdown_connections 2024-04-04T06:56:28.194 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:28.195+0000 7f59fde00640 1 -- 172.21.15.72:0/3408296582 wait complete. 2024-04-04T06:56:28.195 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:28.197+0000 7f59fde00640 1 Processor -- start 2024-04-04T06:56:28.195 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:28.197+0000 7f59fde00640 1 -- start start 2024-04-04T06:56:28.197 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:28.198+0000 7f59fde00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f59f80b4170 0x7f59f8151350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:28.198 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:28.198+0000 7f59fde00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f59f80d0420 0x7f59f81457a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:28.198 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:28.198+0000 7f59fde00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f59f80d0800 0x7f59f8159090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:28.198 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:28.198+0000 7f59fde00640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f59f815ef00 con 0x7f59f80b4170 2024-04-04T06:56:28.198 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:28.198+0000 7f59fde00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f59f815ec20 con 0x7f59f80d0420 2024-04-04T06:56:28.198 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:28.198+0000 7f59fde00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f59f8072bf0 con 0x7f59f80d0800 2024-04-04T06:56:28.198 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:28.198+0000 7f59fca00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f59f80b4170 0x7f59f8151350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:28.198 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:28.198+0000 7f59fca00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f59f80b4170 0x7f59f8151350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:52960/0 (socket says 172.21.15.72:52960) 2024-04-04T06:56:28.198 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:28.198+0000 7f59fca00640 1 -- 172.21.15.72:0/906854998 learned_addr learned my addr 172.21.15.72:0/906854998 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:56:28.198 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:28.198+0000 7f59f7e00640 1 --2- 172.21.15.72:0/906854998 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f59f80d0420 0x7f59f81457a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:28.198 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:28.198+0000 7f59fd400640 1 --2- 172.21.15.72:0/906854998 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f59f80d0800 0x7f59f8159090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:28.198 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:28.199+0000 7f59fca00640 1 -- 172.21.15.72:0/906854998 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f59f80d0800 msgr2=0x7f59f8159090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:28.198 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:28.199+0000 7f59fca00640 1 --2- 172.21.15.72:0/906854998 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f59f80d0800 0x7f59f8159090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:28.198 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:28.199+0000 7f59fca00640 1 -- 172.21.15.72:0/906854998 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f59f80d0420 msgr2=0x7f59f81457a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:28.199 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:28.199+0000 7f59fca00640 1 --2- 172.21.15.72:0/906854998 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f59f80d0420 0x7f59f81457a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:28.199 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:28.199+0000 7f59fca00640 1 -- 172.21.15.72:0/906854998 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59f8145ce0 con 0x7f59f80b4170 2024-04-04T06:56:28.199 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:28.199+0000 7f59fca00640 1 --2- 172.21.15.72:0/906854998 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f59f80b4170 0x7f59f8151350 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f59ec010fc0 tx=0x7f59ec00e0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:28.199 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:28.199+0000 7f59f4c00640 1 -- 172.21.15.72:0/906854998 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59ec01a020 con 0x7f59f80b4170 2024-04-04T06:56:28.199 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:28.199+0000 7f59f4c00640 1 -- 172.21.15.72:0/906854998 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59ec00ed00 con 0x7f59f80b4170 2024-04-04T06:56:28.199 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:28.199+0000 7f59f4c00640 1 -- 172.21.15.72:0/906854998 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59ec0166a0 con 0x7f59f80b4170 2024-04-04T06:56:28.199 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:28.199+0000 7f59fde00640 1 -- 172.21.15.72:0/906854998 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59f815a530 con 0x7f59f80b4170 2024-04-04T06:56:28.199 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:28.199+0000 7f59fde00640 1 -- 172.21.15.72:0/906854998 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59f8158890 con 0x7f59f80b4170 2024-04-04T06:56:28.199 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:28.201+0000 7f59fde00640 1 -- 172.21.15.72:0/906854998 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59f80756c0 con 0x7f59f80b4170 2024-04-04T06:56:28.200 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:28.202+0000 7f59f4c00640 1 -- 172.21.15.72:0/906854998 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f59ec01d020 con 0x7f59f80b4170 2024-04-04T06:56:28.201 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:28.203+0000 7f59f4c00640 1 --2- 172.21.15.72:0/906854998 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f59d806c8f0 0x7f59d806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:28.201 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:28.203+0000 7f59f4c00640 1 -- 172.21.15.72:0/906854998 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 5609+0+0 (secure 0 0 0) 0x7f59ec08e2e0 con 0x7f59f80b4170 2024-04-04T06:56:28.201 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:28.203+0000 7f59f7e00640 1 --2- 172.21.15.72:0/906854998 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f59d806c8f0 0x7f59d806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:28.202 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:28.203+0000 7f59f7e00640 1 --2- 172.21.15.72:0/906854998 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f59d806c8f0 0x7f59d806edb0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f59f80ced90 tx=0x7f59e4007cc0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:28.206 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:28.208+0000 7f59f4c00640 1 -- 172.21.15.72:0/906854998 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f59ec024030 con 0x7f59f80b4170 2024-04-04T06:56:28.431 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:28.433+0000 7f59fde00640 1 -- 172.21.15.72:0/906854998 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f59f80b3ee0 con 0x7f59f80b4170 2024-04-04T06:56:29.032 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:29.033+0000 7f59f4c00640 1 -- 172.21.15.72:0/906854998 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 172+0+0 (secure 0 0 0) 0x7f59f8145ce0 con 0x7f59f80b4170 2024-04-04T06:56:29.038 INFO:teuthology.orchestra.run.smithi072.stderr:new fs with metadata pool 2 and data pool 3 2024-04-04T06:56:29.046 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:29.047+0000 7f59fde00640 1 -- 172.21.15.72:0/906854998 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f59d806c8f0 msgr2=0x7f59d806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:29.046 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:29.047+0000 7f59fde00640 1 --2- 172.21.15.72:0/906854998 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f59d806c8f0 0x7f59d806edb0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f59f80ced90 tx=0x7f59e4007cc0 comp rx=0 tx=0).stop 2024-04-04T06:56:29.046 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:29.047+0000 7f59fde00640 1 -- 172.21.15.72:0/906854998 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f59f80b4170 msgr2=0x7f59f8151350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:29.046 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:29.047+0000 7f59fde00640 1 --2- 172.21.15.72:0/906854998 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f59f80b4170 0x7f59f8151350 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f59ec010fc0 tx=0x7f59ec00e0c0 comp rx=0 tx=0).stop 2024-04-04T06:56:29.046 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:29.048+0000 7f59fde00640 1 -- 172.21.15.72:0/906854998 shutdown_connections 2024-04-04T06:56:29.046 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:29.048+0000 7f59fde00640 1 --2- 172.21.15.72:0/906854998 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f59d806c8f0 0x7f59d806edb0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:29.047 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:29.048+0000 7f59fde00640 1 --2- 172.21.15.72:0/906854998 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f59f80d0800 0x7f59f8159090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:29.047 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:29.048+0000 7f59fde00640 1 --2- 172.21.15.72:0/906854998 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f59f80d0420 0x7f59f81457a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:29.047 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:29.048+0000 7f59fde00640 1 --2- 172.21.15.72:0/906854998 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f59f80b4170 0x7f59f8151350 secure :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f59ec010fc0 tx=0x7f59ec00e0c0 comp rx=0 tx=0).stop 2024-04-04T06:56:29.047 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:29.048+0000 7f59fde00640 1 -- 172.21.15.72:0/906854998 >> 172.21.15.72:0/906854998 conn(0x7f59f806b890 msgr2=0x7f59f815dfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:56:29.047 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:29.049+0000 7f59fde00640 1 -- 172.21.15.72:0/906854998 shutdown_connections 2024-04-04T06:56:29.047 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:29.049+0000 7f59fde00640 1 -- 172.21.15.72:0/906854998 wait complete. 2024-04-04T06:56:29.074 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-04T06:56:29.250 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:29.251+0000 7fc2ebe00640 1 Processor -- start 2024-04-04T06:56:29.250 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:29.252+0000 7fc2ebe00640 1 -- start start 2024-04-04T06:56:29.252 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:29.253+0000 7fc2ebe00640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc2ec1427e0 0x7fc2ec0ce6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:29.252 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:29.253+0000 7fc2ebe00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fc2ec06df20 0x7fc2ec0cec00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:29.252 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:29.253+0000 7fc2ebe00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc2ec0cf140 0x7fc2ec15fe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:29.252 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:29.253+0000 7fc2ebe00640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7fc2ec0cf5b0 con 0x7fc2ec1427e0 2024-04-04T06:56:29.252 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:29.253+0000 7fc2ebe00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fc2ec142bc0 con 0x7fc2ec06df20 2024-04-04T06:56:29.252 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:29.253+0000 7fc2ebe00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fc2ec06e490 con 0x7fc2ec0cf140 2024-04-04T06:56:29.252 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:29.253+0000 7fc2eaa00640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc2ec1427e0 0x7fc2ec0ce6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:29.252 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:29.253+0000 7fc2eaa00640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc2ec1427e0 0x7fc2ec0ce6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:45898/0 (socket says 172.21.15.72:45898) 2024-04-04T06:56:29.252 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:29.253+0000 7fc2eaa00640 1 -- 172.21.15.72:0/1893923795 learned_addr learned my addr 172.21.15.72:0/1893923795 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:56:29.253 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:29.254+0000 7fc2eaa00640 1 -- 172.21.15.72:0/1893923795 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc2ec0cf140 msgr2=0x7fc2ec15fe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:56:29.253 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:29.254+0000 7fc2eaa00640 1 --2- 172.21.15.72:0/1893923795 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc2ec0cf140 0x7fc2ec15fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:29.253 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:29.254+0000 7fc2eaa00640 1 -- 172.21.15.72:0/1893923795 >> v2:172.21.15.117:3300/0 conn(0x7fc2ec06df20 msgr2=0x7fc2ec0cec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:56:29.253 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:29.254+0000 7fc2e2000640 1 --2- 172.21.15.72:0/1893923795 >> v2:172.21.15.117:3300/0 conn(0x7fc2ec06df20 0x7fc2ec0cec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:29.253 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:29.254+0000 7fc2eaa00640 1 --2- 172.21.15.72:0/1893923795 >> v2:172.21.15.117:3300/0 conn(0x7fc2ec06df20 0x7fc2ec0cec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:29.253 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:29.254+0000 7fc2eaa00640 1 -- 172.21.15.72:0/1893923795 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2ec06e770 con 0x7fc2ec1427e0 2024-04-04T06:56:29.253 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:29.254+0000 7fc2e2000640 1 --2- 172.21.15.72:0/1893923795 >> v2:172.21.15.117:3300/0 conn(0x7fc2ec06df20 0x7fc2ec0cec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-04T06:56:29.255 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:29.255+0000 7fc2eaa00640 1 --2- 172.21.15.72:0/1893923795 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc2ec1427e0 0x7fc2ec0ce6c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fc2ec070d10 tx=0x7fc2dc02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e31493922b7a1944 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:29.255 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:29.255+0000 7fc2ea000640 1 -- 172.21.15.72:0/1893923795 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2dc02ca70 con 0x7fc2ec1427e0 2024-04-04T06:56:29.255 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:29.255+0000 7fc2ea000640 1 -- 172.21.15.72:0/1893923795 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2dc02cc10 con 0x7fc2ec1427e0 2024-04-04T06:56:29.255 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:29.255+0000 7fc2ea000640 1 -- 172.21.15.72:0/1893923795 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2dc0343f0 con 0x7fc2ec1427e0 2024-04-04T06:56:29.255 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:29.256+0000 7fc2ebe00640 1 -- 172.21.15.72:0/1893923795 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc2ec1427e0 msgr2=0x7fc2ec0ce6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:29.255 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:29.256+0000 7fc2ebe00640 1 --2- 172.21.15.72:0/1893923795 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc2ec1427e0 0x7fc2ec0ce6c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fc2ec070d10 tx=0x7fc2dc02bed0 comp rx=0 tx=0).stop 2024-04-04T06:56:29.255 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:29.256+0000 7fc2ebe00640 1 -- 172.21.15.72:0/1893923795 shutdown_connections 2024-04-04T06:56:29.255 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:29.256+0000 7fc2ebe00640 1 --2- 172.21.15.72:0/1893923795 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc2ec0cf140 0x7fc2ec15fe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:29.255 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:29.256+0000 7fc2ebe00640 1 --2- 172.21.15.72:0/1893923795 >> v2:172.21.15.117:3300/0 conn(0x7fc2ec06df20 0x7fc2ec0cec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:29.255 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:29.256+0000 7fc2ebe00640 1 --2- 172.21.15.72:0/1893923795 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc2ec1427e0 0x7fc2ec0ce6c0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:29.255 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:29.256+0000 7fc2ebe00640 1 -- 172.21.15.72:0/1893923795 >> 172.21.15.72:0/1893923795 conn(0x7fc2ec0b1840 msgr2=0x7fc2ec0b1c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:56:29.255 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:29.256+0000 7fc2ebe00640 1 -- 172.21.15.72:0/1893923795 shutdown_connections 2024-04-04T06:56:29.255 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:29.256+0000 7fc2ebe00640 1 -- 172.21.15.72:0/1893923795 wait complete. 2024-04-04T06:56:29.256 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:29.258+0000 7fc2ebe00640 1 Processor -- start 2024-04-04T06:56:29.256 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:29.258+0000 7fc2ebe00640 1 -- start start 2024-04-04T06:56:29.259 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:29.259+0000 7fc2ebe00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc2ec06df20 0x7fc2ec140c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:29.259 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:29.259+0000 7fc2ebe00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc2ec0cf140 0x7fc2ec0a9460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:29.259 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:29.259+0000 7fc2ebe00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc2ec1427e0 0x7fc2ec0ae580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:29.259 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:29.259+0000 7fc2ebe00640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fc2ec145ca0 con 0x7fc2ec06df20 2024-04-04T06:56:29.259 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:29.259+0000 7fc2ebe00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fc2ec06ed30 con 0x7fc2ec1427e0 2024-04-04T06:56:29.259 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:29.259+0000 7fc2ebe00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fc2ec160380 con 0x7fc2ec0cf140 2024-04-04T06:56:29.259 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:29.259+0000 7fc2eaa00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc2ec06df20 0x7fc2ec140c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:29.260 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:29.260+0000 7fc2eaa00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc2ec06df20 0x7fc2ec140c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:45914/0 (socket says 172.21.15.72:45914) 2024-04-04T06:56:29.260 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:29.260+0000 7fc2eaa00640 1 -- 172.21.15.72:0/3865863842 learned_addr learned my addr 172.21.15.72:0/3865863842 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:56:29.260 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:29.260+0000 7fc2eb400640 1 --2- 172.21.15.72:0/3865863842 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc2ec1427e0 0x7fc2ec0ae580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:29.260 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:29.260+0000 7fc2e2000640 1 --2- 172.21.15.72:0/3865863842 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc2ec0cf140 0x7fc2ec0a9460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:29.260 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:29.260+0000 7fc2eaa00640 1 -- 172.21.15.72:0/3865863842 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc2ec0cf140 msgr2=0x7fc2ec0a9460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:29.260 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:29.260+0000 7fc2eaa00640 1 --2- 172.21.15.72:0/3865863842 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc2ec0cf140 0x7fc2ec0a9460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:29.260 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:29.260+0000 7fc2eaa00640 1 -- 172.21.15.72:0/3865863842 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc2ec1427e0 msgr2=0x7fc2ec0ae580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:29.260 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:29.260+0000 7fc2eaa00640 1 --2- 172.21.15.72:0/3865863842 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc2ec1427e0 0x7fc2ec0ae580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:29.260 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:29.260+0000 7fc2eaa00640 1 -- 172.21.15.72:0/3865863842 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2ec0a9d40 con 0x7fc2ec06df20 2024-04-04T06:56:29.260 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:29.260+0000 7fc2eb400640 1 --2- 172.21.15.72:0/3865863842 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc2ec1427e0 0x7fc2ec0ae580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-04T06:56:29.260 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:29.260+0000 7fc2eaa00640 1 --2- 172.21.15.72:0/3865863842 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc2ec06df20 0x7fc2ec140c80 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fc2dc000f80 tx=0x7fc2dc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:29.260 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:29.261+0000 7fc2e3400640 1 -- 172.21.15.72:0/3865863842 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2dc043020 con 0x7fc2ec06df20 2024-04-04T06:56:29.260 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:29.261+0000 7fc2e3400640 1 -- 172.21.15.72:0/3865863842 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2dc03e450 con 0x7fc2ec06df20 2024-04-04T06:56:29.260 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:29.261+0000 7fc2e3400640 1 -- 172.21.15.72:0/3865863842 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2dc03e840 con 0x7fc2ec06df20 2024-04-04T06:56:29.261 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:29.261+0000 7fc2ebe00640 1 -- 172.21.15.72:0/3865863842 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2ec0aa020 con 0x7fc2ec06df20 2024-04-04T06:56:29.261 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:29.261+0000 7fc2ebe00640 1 -- 172.21.15.72:0/3865863842 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2ec0aa5e0 con 0x7fc2ec06df20 2024-04-04T06:56:29.261 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:29.262+0000 7fc2ebe00640 1 -- 172.21.15.72:0/3865863842 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc2ec0756c0 con 0x7fc2ec06df20 2024-04-04T06:56:29.261 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:29.263+0000 7fc2e3400640 1 -- 172.21.15.72:0/3865863842 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc2dc046020 con 0x7fc2ec06df20 2024-04-04T06:56:29.262 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:29.264+0000 7fc2e3400640 1 --2- 172.21.15.72:0/3865863842 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fc2c806c920 0x7fc2c806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:29.262 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:29.264+0000 7fc2e3400640 1 -- 172.21.15.72:0/3865863842 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5709+0+0 (secure 0 0 0) 0x7fc2dc0ae210 con 0x7fc2ec06df20 2024-04-04T06:56:29.262 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:29.264+0000 7fc2e2000640 1 --2- 172.21.15.72:0/3865863842 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fc2c806c920 0x7fc2c806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:29.263 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:29.264+0000 7fc2e2000640 1 --2- 172.21.15.72:0/3865863842 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fc2c806c920 0x7fc2c806ede0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fc2ec0ab820 tx=0x7fc2d4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:29.267 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:29.269+0000 7fc2e3400640 1 -- 172.21.15.72:0/3865863842 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fc2dc04d070 con 0x7fc2ec06df20 2024-04-04T06:56:29.466 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:29.467+0000 7fc2ebe00640 1 -- 172.21.15.72:0/3865863842 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc2ec15fb70 con 0x7fc2ec06df20 2024-04-04T06:56:29.468 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:29.470+0000 7fc2e3400640 1 -- 172.21.15.72:0/3865863842 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) ==== 74+0+16594 (secure 0 0 0) 0x7fc2dc07c640 con 0x7fc2ec06df20 2024-04-04T06:56:29.469 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T06:56:29.469 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":19,"fsid":"6708bac2-4f50-49b5-87a9-c390fd333eb3","created":"2024-04-04T06:56:04.282498+0000","modified":"2024-04-04T06:56:28.434697+0000","last_up_change":"2024-04-04T06:56:16.716089+0000","last_in_change":"2024-04-04T06:56:07.768593+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-04T06:56:17.421685+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-04T06:56:26.822661+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-04T06:56:27.429816+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7c345991-5af8-4dc6-a481-28610c40e128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":3889813953},{"type":"v1","addr":"172.21.15.72:6818","nonce":3889813953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":3889813953},{"type":"v1","addr":"172.21.15.72:6821","nonce":3889813953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":3889813953},{"type":"v1","addr":"172.21.15.72:6826","nonce":3889813953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":3889813953},{"type":"v1","addr":"172.21.15.72:6823","nonce":3889813953}]},"public_addr":"172.21.15.72:6818/3889813953","cluster_addr":"172.21.15.72:6821/3889813953","heartbeat_back_addr":"172.21.15.72:6826/3889813953","heartbeat_front_addr":"172.21.15.72:6823/3889813953","state":["exists","up"]},{"osd":1,"uuid":"1b3f7ab2-a56c-488d-a89a-1f3572361c95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":3101663154},{"type":"v1","addr":"172.21.15.72:6801","nonce":3101663154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":3101663154},{"type":"v1","addr":"172.21.15.72:6803","nonce":3101663154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":3101663154},{"type":"v1","addr":"172.21.15.72:6807","nonce":3101663154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":3101663154},{"type":"v1","addr":"172.21.15.72:6805","nonce":3101663154}]},"public_addr":"172.21.15.72:6801/3101663154","cluster_addr":"172.21.15.72:6803/3101663154","heartbeat_back_addr":"172.21.15.72:6807/3101663154","heartbeat_front_addr":"172.21.15.72:6805/3101663154","state":["exists","up"]},{"osd":2,"uuid":"fc9aa512-53df-40d7-ba04-3e6b7dcd1e34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":235374192},{"type":"v1","addr":"172.21.15.72:6809","nonce":235374192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":235374192},{"type":"v1","addr":"172.21.15.72:6811","nonce":235374192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":235374192},{"type":"v1","addr":"172.21.15.72:6815","nonce":235374192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":235374192},{"type":"v1","addr":"172.21.15.72:6813","nonce":235374192}]},"public_addr":"172.21.15.72:6809/235374192","cluster_addr":"172.21.15.72:6811/235374192","heartbeat_back_addr":"172.21.15.72:6815/235374192","heartbeat_front_addr":"172.21.15.72:6813/235374192","state":["exists","up"]},{"osd":3,"uuid":"b4f63eed-dc5b-4aba-bb50-de46eb41492b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6817","nonce":2806631742},{"type":"v1","addr":"172.21.15.72:6819","nonce":2806631742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":2806631742},{"type":"v1","addr":"172.21.15.72:6827","nonce":2806631742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":2806631742},{"type":"v1","addr":"172.21.15.72:6831","nonce":2806631742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":2806631742},{"type":"v1","addr":"172.21.15.72:6829","nonce":2806631742}]},"public_addr":"172.21.15.72:6819/2806631742","cluster_addr":"172.21.15.72:6827/2806631742","heartbeat_back_addr":"172.21.15.72:6831/2806631742","heartbeat_front_addr":"172.21.15.72:6829/2806631742","state":["exists","up"]},{"osd":4,"uuid":"9e985ef8-d711-4172-9286-c54e560895d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":4293536423},{"type":"v1","addr":"172.21.15.117:6825","nonce":4293536423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":4293536423},{"type":"v1","addr":"172.21.15.117:6827","nonce":4293536423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":4293536423},{"type":"v1","addr":"172.21.15.117:6831","nonce":4293536423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":4293536423},{"type":"v1","addr":"172.21.15.117:6829","nonce":4293536423}]},"public_addr":"172.21.15.117:6825/4293536423","cluster_addr":"172.21.15.117:6827/4293536423","heartbeat_back_addr":"172.21.15.117:6831/4293536423","heartbeat_front_addr":"172.21.15.117:6829/4293536423","state":["exists","up"]},{"osd":5,"uuid":"3e9f082b-8d7d-455f-8a96-66d0b4857125","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":684971679},{"type":"v1","addr":"172.21.15.117:6801","nonce":684971679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":684971679},{"type":"v1","addr":"172.21.15.117:6803","nonce":684971679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":684971679},{"type":"v1","addr":"172.21.15.117:6807","nonce":684971679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":684971679},{"type":"v1","addr":"172.21.15.117:6805","nonce":684971679}]},"public_addr":"172.21.15.117:6801/684971679","cluster_addr":"172.21.15.117:6803/684971679","heartbeat_back_addr":"172.21.15.117:6807/684971679","heartbeat_front_addr":"172.21.15.117:6805/684971679","state":["exists","up"]},{"osd":6,"uuid":"bcdafa9f-a870-4398-a38d-ab7697676473","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":2781186528},{"type":"v1","addr":"172.21.15.117:6809","nonce":2781186528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":2781186528},{"type":"v1","addr":"172.21.15.117:6811","nonce":2781186528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":2781186528},{"type":"v1","addr":"172.21.15.117:6815","nonce":2781186528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":2781186528},{"type":"v1","addr":"172.21.15.117:6813","nonce":2781186528}]},"public_addr":"172.21.15.117:6809/2781186528","cluster_addr":"172.21.15.117:6811/2781186528","heartbeat_back_addr":"172.21.15.117:6815/2781186528","heartbeat_front_addr":"172.21.15.117:6813/2781186528","state":["exists","up"]},{"osd":7,"uuid":"b68ec562-ff35-4d2d-a733-c896f8920cfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":617469882},{"type":"v1","addr":"172.21.15.117:6817","nonce":617469882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":617469882},{"type":"v1","addr":"172.21.15.117:6819","nonce":617469882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":617469882},{"type":"v1","addr":"172.21.15.117:6823","nonce":617469882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":617469882},{"type":"v1","addr":"172.21.15.117:6821","nonce":617469882}]},"public_addr":"172.21.15.117:6817/617469882","cluster_addr":"172.21.15.117:6819/617469882","heartbeat_back_addr":"172.21.15.117:6823/617469882","heartbeat_front_addr":"172.21.15.117:6821/617469882","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.347700+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.296619+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.361345+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.093323+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:12.857605+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:12.816090+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.083163+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.121639+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-04T06:56:29.472 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:29.473+0000 7fc2ebe00640 1 -- 172.21.15.72:0/3865863842 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fc2c806c920 msgr2=0x7fc2c806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:29.472 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:29.473+0000 7fc2ebe00640 1 --2- 172.21.15.72:0/3865863842 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fc2c806c920 0x7fc2c806ede0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fc2ec0ab820 tx=0x7fc2d4008040 comp rx=0 tx=0).stop 2024-04-04T06:56:29.472 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:29.473+0000 7fc2ebe00640 1 -- 172.21.15.72:0/3865863842 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc2ec06df20 msgr2=0x7fc2ec140c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:29.472 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:29.473+0000 7fc2ebe00640 1 --2- 172.21.15.72:0/3865863842 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc2ec06df20 0x7fc2ec140c80 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fc2dc000f80 tx=0x7fc2dc004a40 comp rx=0 tx=0).stop 2024-04-04T06:56:29.472 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:29.473+0000 7fc2ebe00640 1 -- 172.21.15.72:0/3865863842 shutdown_connections 2024-04-04T06:56:29.472 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:29.473+0000 7fc2ebe00640 1 --2- 172.21.15.72:0/3865863842 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fc2c806c920 0x7fc2c806ede0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:29.472 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:29.473+0000 7fc2ebe00640 1 --2- 172.21.15.72:0/3865863842 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc2ec1427e0 0x7fc2ec0ae580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:29.472 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:29.473+0000 7fc2ebe00640 1 --2- 172.21.15.72:0/3865863842 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc2ec0cf140 0x7fc2ec0a9460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:29.472 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:29.473+0000 7fc2ebe00640 1 --2- 172.21.15.72:0/3865863842 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc2ec06df20 0x7fc2ec140c80 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:29.472 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:29.473+0000 7fc2ebe00640 1 -- 172.21.15.72:0/3865863842 >> 172.21.15.72:0/3865863842 conn(0x7fc2ec0b1840 msgr2=0x7fc2ec141980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:56:29.472 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:29.473+0000 7fc2ebe00640 1 -- 172.21.15.72:0/3865863842 shutdown_connections 2024-04-04T06:56:29.472 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:29.473+0000 7fc2ebe00640 1 -- 172.21.15.72:0/3865863842 wait complete. 2024-04-04T06:56:29.490 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-04T06:56:29.684 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:29.686+0000 7f074da00640 1 Processor -- start 2024-04-04T06:56:29.684 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:29.686+0000 7f074da00640 1 -- start start 2024-04-04T06:56:29.688 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:29.687+0000 7f074da00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f07480ccb20 0x7f07480ccfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:29.688 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:29.687+0000 7f074da00640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f07480c6710 con 0x7f0748071610 2024-04-04T06:56:29.688 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:29.687+0000 7f074da00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f07480c69f0 con 0x7f074815c2d0 2024-04-04T06:56:29.688 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:29.687+0000 7f074da00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f07480c6fb0 con 0x7f07480ccb20 2024-04-04T06:56:29.688 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:29.687+0000 7f073fe00640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f0748071610 0x7f07480c5e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:52532/0 (socket says 172.21.15.72:52532) 2024-04-04T06:56:29.688 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:29.687+0000 7f073fe00640 1 -- 172.21.15.72:0/240408237 learned_addr learned my addr 172.21.15.72:0/240408237 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-04-04T06:56:29.689 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:29.688+0000 7f0747400640 1 --2- 172.21.15.72:0/240408237 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f07480ccb20 0x7f07480ccfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:29.689 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:29.688+0000 7f0746000640 1 -- 172.21.15.72:0/240408237 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 519205404 0 0) 0x7f07480c6710 con 0x7f0748071610 2024-04-04T06:56:29.689 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:29.688+0000 7f0746000640 1 -- 172.21.15.72:0/240408237 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f072c003520 con 0x7f0748071610 2024-04-04T06:56:29.689 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:29.688+0000 7f0746000640 1 -- 172.21.15.72:0/240408237 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2900489436 0 0) 0x7f072c003520 con 0x7f0748071610 2024-04-04T06:56:29.689 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:29.688+0000 7f0746000640 1 -- 172.21.15.72:0/240408237 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f07480ccb20 msgr2=0x7f07480ccfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:56:29.689 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:29.688+0000 7f0746000640 1 --2- 172.21.15.72:0/240408237 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f07480ccb20 0x7f07480ccfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:29.689 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:29.688+0000 7f0746000640 1 -- 172.21.15.72:0/240408237 >> v1:172.21.15.117:6789/0 conn(0x7f074815c2d0 legacy=0x7f074815c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:29.689 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:29.688+0000 7f0746000640 1 -- 172.21.15.72:0/240408237 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07480c6cd0 con 0x7f0748071610 2024-04-04T06:56:29.689 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:29.688+0000 7f0746000640 1 -- 172.21.15.72:0/240408237 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2465650867 0 0) 0x7f0730001670 con 0x7f0748071610 2024-04-04T06:56:29.689 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:29.688+0000 7f0746000640 1 -- 172.21.15.72:0/240408237 >> v1:172.21.15.72:6789/0 conn(0x7f0748071610 legacy=0x7f07480c5e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:29.689 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:29.688+0000 7f0746000640 1 --2- 172.21.15.72:0/240408237 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f072c0039e0 0x7f072c003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:29.689 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:29.688+0000 7f0746000640 1 --2- 172.21.15.72:0/240408237 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f072c004800 0x7f072c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:29.689 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:29.688+0000 7f0746000640 1 --2- 172.21.15.72:0/240408237 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f07480ccb20 0x7f072c005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:29.690 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:29.688+0000 7f0746000640 1 -- 172.21.15.72:0/240408237 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f07480c6fb0 con 0x7f072c0039e0 2024-04-04T06:56:29.690 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:29.688+0000 7f0746000640 1 -- 172.21.15.72:0/240408237 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f072c00baf0 con 0x7f072c004800 2024-04-04T06:56:29.690 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:29.688+0000 7f0746000640 1 -- 172.21.15.72:0/240408237 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f072c00bcf0 con 0x7f07480ccb20 2024-04-04T06:56:29.690 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:29.689+0000 7f0746a00640 1 --2- 172.21.15.72:0/240408237 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f072c0039e0 0x7f072c003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:29.690 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:29.689+0000 7f073fe00640 1 --2- 172.21.15.72:0/240408237 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f072c004800 0x7f072c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:29.690 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:29.689+0000 7f0746a00640 1 -- 172.21.15.72:0/240408237 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f07480ccb20 msgr2=0x7f072c005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:56:29.690 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:29.689+0000 7f0746a00640 1 --2- 172.21.15.72:0/240408237 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f07480ccb20 0x7f072c005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:29.690 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:29.689+0000 7f0746a00640 1 -- 172.21.15.72:0/240408237 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f072c004800 msgr2=0x7f072c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:56:29.690 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:29.689+0000 7f0746a00640 1 --2- 172.21.15.72:0/240408237 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f072c004800 0x7f072c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:29.690 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:29.689+0000 7f0746a00640 1 -- 172.21.15.72:0/240408237 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f072c003520 con 0x7f072c0039e0 2024-04-04T06:56:29.692 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:29.690+0000 7f0746a00640 1 --2- 172.21.15.72:0/240408237 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f072c0039e0 0x7f072c003e00 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f0738001750 tx=0x7f072c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66b482c18f188207 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:29.692 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:29.690+0000 7f0746000640 1 -- 172.21.15.72:0/240408237 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0738001370 con 0x7f072c0039e0 2024-04-04T06:56:29.692 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:29.690+0000 7f0746000640 1 -- 172.21.15.72:0/240408237 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07380052d0 con 0x7f072c0039e0 2024-04-04T06:56:29.692 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:29.690+0000 7f0746000640 1 -- 172.21.15.72:0/240408237 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0738003830 con 0x7f072c0039e0 2024-04-04T06:56:29.692 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:29.691+0000 7f074da00640 1 -- 172.21.15.72:0/240408237 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f072c0039e0 msgr2=0x7f072c003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:29.692 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:29.691+0000 7f074da00640 1 --2- 172.21.15.72:0/240408237 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f072c0039e0 0x7f072c003e00 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f0738001750 tx=0x7f072c005830 comp rx=0 tx=0).stop 2024-04-04T06:56:29.692 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:29.691+0000 7f0747400640 1 -- 172.21.15.72:0/240408237 reap_dead start 2024-04-04T06:56:29.692 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:29.691+0000 7f074da00640 1 -- 172.21.15.72:0/240408237 shutdown_connections 2024-04-04T06:56:29.692 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:29.691+0000 7f074da00640 1 -- 172.21.15.72:0/240408237 >> 172.21.15.72:0/240408237 conn(0x7f074806b470 msgr2=0x7f074806b880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:56:29.692 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:29.691+0000 7f074da00640 1 -- 172.21.15.72:0/240408237 shutdown_connections 2024-04-04T06:56:29.692 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:29.691+0000 7f074da00640 1 -- 172.21.15.72:0/240408237 wait complete. 2024-04-04T06:56:29.693 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:29.693+0000 7f074da00640 1 Processor -- start 2024-04-04T06:56:29.693 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:29.693+0000 7f074da00640 1 -- start start 2024-04-04T06:56:29.694 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:29.694+0000 7f074da00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f072c0039e0 0x7f07481f4640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:29.695 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:29.694+0000 7f074da00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f07480d09c0 0x7f07480b12f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:29.695 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:29.694+0000 7f074da00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f07480cee90 0x7f07480cbe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:29.695 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:29.694+0000 7f074da00640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f07480cd400 con 0x7f072c0039e0 2024-04-04T06:56:29.695 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:29.694+0000 7f074da00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f07480cd280 con 0x7f07480d09c0 2024-04-04T06:56:29.695 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:29.694+0000 7f074da00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f07480b3ea0 con 0x7f07480cee90 2024-04-04T06:56:29.695 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:29.694+0000 7f0746a00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f072c0039e0 0x7f07481f4640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:29.695 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:29.694+0000 7f0746a00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f072c0039e0 0x7f07481f4640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:45934/0 (socket says 172.21.15.72:45934) 2024-04-04T06:56:29.695 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:29.694+0000 7f0746a00640 1 -- 172.21.15.72:0/1285694814 learned_addr learned my addr 172.21.15.72:0/1285694814 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:56:29.695 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:29.694+0000 7f073fe00640 1 --2- 172.21.15.72:0/1285694814 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f07480d09c0 0x7f07480b12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:29.695 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:29.695+0000 7f0746a00640 1 -- 172.21.15.72:0/1285694814 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f07480cee90 msgr2=0x7f07480cbe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:29.695 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:29.695+0000 7f0747400640 1 --2- 172.21.15.72:0/1285694814 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f07480cee90 0x7f07480cbe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:29.695 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:29.695+0000 7f0746a00640 1 --2- 172.21.15.72:0/1285694814 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f07480cee90 0x7f07480cbe70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:29.696 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:29.695+0000 7f0746a00640 1 -- 172.21.15.72:0/1285694814 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f07480d09c0 msgr2=0x7f07480b12f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:29.696 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:29.695+0000 7f0746a00640 1 --2- 172.21.15.72:0/1285694814 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f07480d09c0 0x7f07480b12f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:29.696 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:29.695+0000 7f0746a00640 1 -- 172.21.15.72:0/1285694814 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07481f55a0 con 0x7f072c0039e0 2024-04-04T06:56:29.696 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:29.695+0000 7f073fe00640 1 --2- 172.21.15.72:0/1285694814 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f07480d09c0 0x7f07480b12f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-04T06:56:29.696 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:29.695+0000 7f0746a00640 1 --2- 172.21.15.72:0/1285694814 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f072c0039e0 0x7f07481f4640 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0738005040 tx=0x7f0738001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:29.696 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:29.695+0000 7f073ea00640 1 -- 172.21.15.72:0/1285694814 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0738041070 con 0x7f072c0039e0 2024-04-04T06:56:29.696 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:29.695+0000 7f073ea00640 1 -- 172.21.15.72:0/1285694814 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0738005480 con 0x7f072c0039e0 2024-04-04T06:56:29.696 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:29.695+0000 7f074da00640 1 -- 172.21.15.72:0/1285694814 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07481f4d00 con 0x7f072c0039e0 2024-04-04T06:56:29.696 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:29.695+0000 7f073ea00640 1 -- 172.21.15.72:0/1285694814 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0738001370 con 0x7f072c0039e0 2024-04-04T06:56:29.696 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:29.695+0000 7f074da00640 1 -- 172.21.15.72:0/1285694814 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07481f52c0 con 0x7f072c0039e0 2024-04-04T06:56:29.697 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:29.696+0000 7f074da00640 1 -- 172.21.15.72:0/1285694814 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0748075840 con 0x7f072c0039e0 2024-04-04T06:56:29.697 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:29.697+0000 7f073ea00640 1 -- 172.21.15.72:0/1285694814 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0738044070 con 0x7f072c0039e0 2024-04-04T06:56:29.697 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:29.699+0000 7f073ea00640 1 --2- 172.21.15.72:0/1285694814 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f072406c920 0x7f072406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:29.697 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:29.699+0000 7f073ea00640 1 -- 172.21.15.72:0/1285694814 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5709+0+0 (secure 0 0 0) 0x7f07380ad610 con 0x7f072c0039e0 2024-04-04T06:56:29.697 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:29.699+0000 7f073fe00640 1 --2- 172.21.15.72:0/1285694814 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f072406c920 0x7f072406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:29.698 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:29.699+0000 7f073fe00640 1 --2- 172.21.15.72:0/1285694814 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f072406c920 0x7f072406ede0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f0730001200 tx=0x7f0730000f70 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:29.701 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:29.703+0000 7f073ea00640 1 -- 172.21.15.72:0/1285694814 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f073807ba30 con 0x7f072c0039e0 2024-04-04T06:56:29.898 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:29.900+0000 7f074da00640 1 -- 172.21.15.72:0/1285694814 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f07480ce760 con 0x7f072c0039e0 2024-04-04T06:56:29.900 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:29.901+0000 7f073ea00640 1 -- 172.21.15.72:0/1285694814 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) ==== 74+0+16594 (secure 0 0 0) 0x7f073807b330 con 0x7f072c0039e0 2024-04-04T06:56:29.900 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T06:56:29.900 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":19,"fsid":"6708bac2-4f50-49b5-87a9-c390fd333eb3","created":"2024-04-04T06:56:04.282498+0000","modified":"2024-04-04T06:56:28.434697+0000","last_up_change":"2024-04-04T06:56:16.716089+0000","last_in_change":"2024-04-04T06:56:07.768593+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-04T06:56:17.421685+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-04T06:56:26.822661+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-04T06:56:27.429816+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7c345991-5af8-4dc6-a481-28610c40e128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":3889813953},{"type":"v1","addr":"172.21.15.72:6818","nonce":3889813953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":3889813953},{"type":"v1","addr":"172.21.15.72:6821","nonce":3889813953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":3889813953},{"type":"v1","addr":"172.21.15.72:6826","nonce":3889813953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":3889813953},{"type":"v1","addr":"172.21.15.72:6823","nonce":3889813953}]},"public_addr":"172.21.15.72:6818/3889813953","cluster_addr":"172.21.15.72:6821/3889813953","heartbeat_back_addr":"172.21.15.72:6826/3889813953","heartbeat_front_addr":"172.21.15.72:6823/3889813953","state":["exists","up"]},{"osd":1,"uuid":"1b3f7ab2-a56c-488d-a89a-1f3572361c95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":3101663154},{"type":"v1","addr":"172.21.15.72:6801","nonce":3101663154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":3101663154},{"type":"v1","addr":"172.21.15.72:6803","nonce":3101663154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":3101663154},{"type":"v1","addr":"172.21.15.72:6807","nonce":3101663154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":3101663154},{"type":"v1","addr":"172.21.15.72:6805","nonce":3101663154}]},"public_addr":"172.21.15.72:6801/3101663154","cluster_addr":"172.21.15.72:6803/3101663154","heartbeat_back_addr":"172.21.15.72:6807/3101663154","heartbeat_front_addr":"172.21.15.72:6805/3101663154","state":["exists","up"]},{"osd":2,"uuid":"fc9aa512-53df-40d7-ba04-3e6b7dcd1e34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":235374192},{"type":"v1","addr":"172.21.15.72:6809","nonce":235374192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":235374192},{"type":"v1","addr":"172.21.15.72:6811","nonce":235374192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":235374192},{"type":"v1","addr":"172.21.15.72:6815","nonce":235374192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":235374192},{"type":"v1","addr":"172.21.15.72:6813","nonce":235374192}]},"public_addr":"172.21.15.72:6809/235374192","cluster_addr":"172.21.15.72:6811/235374192","heartbeat_back_addr":"172.21.15.72:6815/235374192","heartbeat_front_addr":"172.21.15.72:6813/235374192","state":["exists","up"]},{"osd":3,"uuid":"b4f63eed-dc5b-4aba-bb50-de46eb41492b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6817","nonce":2806631742},{"type":"v1","addr":"172.21.15.72:6819","nonce":2806631742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":2806631742},{"type":"v1","addr":"172.21.15.72:6827","nonce":2806631742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":2806631742},{"type":"v1","addr":"172.21.15.72:6831","nonce":2806631742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":2806631742},{"type":"v1","addr":"172.21.15.72:6829","nonce":2806631742}]},"public_addr":"172.21.15.72:6819/2806631742","cluster_addr":"172.21.15.72:6827/2806631742","heartbeat_back_addr":"172.21.15.72:6831/2806631742","heartbeat_front_addr":"172.21.15.72:6829/2806631742","state":["exists","up"]},{"osd":4,"uuid":"9e985ef8-d711-4172-9286-c54e560895d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":4293536423},{"type":"v1","addr":"172.21.15.117:6825","nonce":4293536423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":4293536423},{"type":"v1","addr":"172.21.15.117:6827","nonce":4293536423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":4293536423},{"type":"v1","addr":"172.21.15.117:6831","nonce":4293536423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":4293536423},{"type":"v1","addr":"172.21.15.117:6829","nonce":4293536423}]},"public_addr":"172.21.15.117:6825/4293536423","cluster_addr":"172.21.15.117:6827/4293536423","heartbeat_back_addr":"172.21.15.117:6831/4293536423","heartbeat_front_addr":"172.21.15.117:6829/4293536423","state":["exists","up"]},{"osd":5,"uuid":"3e9f082b-8d7d-455f-8a96-66d0b4857125","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":684971679},{"type":"v1","addr":"172.21.15.117:6801","nonce":684971679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":684971679},{"type":"v1","addr":"172.21.15.117:6803","nonce":684971679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":684971679},{"type":"v1","addr":"172.21.15.117:6807","nonce":684971679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":684971679},{"type":"v1","addr":"172.21.15.117:6805","nonce":684971679}]},"public_addr":"172.21.15.117:6801/684971679","cluster_addr":"172.21.15.117:6803/684971679","heartbeat_back_addr":"172.21.15.117:6807/684971679","heartbeat_front_addr":"172.21.15.117:6805/684971679","state":["exists","up"]},{"osd":6,"uuid":"bcdafa9f-a870-4398-a38d-ab7697676473","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":2781186528},{"type":"v1","addr":"172.21.15.117:6809","nonce":2781186528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":2781186528},{"type":"v1","addr":"172.21.15.117:6811","nonce":2781186528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":2781186528},{"type":"v1","addr":"172.21.15.117:6815","nonce":2781186528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":2781186528},{"type":"v1","addr":"172.21.15.117:6813","nonce":2781186528}]},"public_addr":"172.21.15.117:6809/2781186528","cluster_addr":"172.21.15.117:6811/2781186528","heartbeat_back_addr":"172.21.15.117:6815/2781186528","heartbeat_front_addr":"172.21.15.117:6813/2781186528","state":["exists","up"]},{"osd":7,"uuid":"b68ec562-ff35-4d2d-a733-c896f8920cfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":617469882},{"type":"v1","addr":"172.21.15.117:6817","nonce":617469882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":617469882},{"type":"v1","addr":"172.21.15.117:6819","nonce":617469882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":617469882},{"type":"v1","addr":"172.21.15.117:6823","nonce":617469882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":617469882},{"type":"v1","addr":"172.21.15.117:6821","nonce":617469882}]},"public_addr":"172.21.15.117:6817/617469882","cluster_addr":"172.21.15.117:6819/617469882","heartbeat_back_addr":"172.21.15.117:6823/617469882","heartbeat_front_addr":"172.21.15.117:6821/617469882","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.347700+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.296619+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.361345+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.093323+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:12.857605+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:12.816090+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.083163+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.121639+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-04T06:56:29.903 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:29.904+0000 7f074da00640 1 -- 172.21.15.72:0/1285694814 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f072406c920 msgr2=0x7f072406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:29.903 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:29.904+0000 7f074da00640 1 --2- 172.21.15.72:0/1285694814 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f072406c920 0x7f072406ede0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f0730001200 tx=0x7f0730000f70 comp rx=0 tx=0).stop 2024-04-04T06:56:29.903 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:29.904+0000 7f074da00640 1 -- 172.21.15.72:0/1285694814 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f072c0039e0 msgr2=0x7f07481f4640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:29.903 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:29.904+0000 7f074da00640 1 --2- 172.21.15.72:0/1285694814 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f072c0039e0 0x7f07481f4640 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0738005040 tx=0x7f0738001120 comp rx=0 tx=0).stop 2024-04-04T06:56:29.903 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:29.904+0000 7f074da00640 1 -- 172.21.15.72:0/1285694814 shutdown_connections 2024-04-04T06:56:29.903 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:29.904+0000 7f074da00640 1 --2- 172.21.15.72:0/1285694814 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f072406c920 0x7f072406ede0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:29.903 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:29.904+0000 7f074da00640 1 --2- 172.21.15.72:0/1285694814 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f07480cee90 0x7f07480cbe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:29.903 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:29.904+0000 7f074da00640 1 --2- 172.21.15.72:0/1285694814 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f07480d09c0 0x7f07480b12f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:29.903 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:29.904+0000 7f074da00640 1 --2- 172.21.15.72:0/1285694814 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f072c0039e0 0x7f07481f4640 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:29.903 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:29.904+0000 7f074da00640 1 -- 172.21.15.72:0/1285694814 >> 172.21.15.72:0/1285694814 conn(0x7f074806b470 msgr2=0x7f074806d670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:56:29.903 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:29.904+0000 7f074da00640 1 -- 172.21.15.72:0/1285694814 shutdown_connections 2024-04-04T06:56:29.903 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:29.904+0000 7f074da00640 1 -- 172.21.15.72:0/1285694814 wait complete. 2024-04-04T06:56:29.919 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-04T06:56:30.145 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:30.147+0000 7f50c6000640 1 Processor -- start 2024-04-04T06:56:30.146 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:30.147+0000 7f50c6000640 1 -- start start 2024-04-04T06:56:30.147 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:30.148+0000 7f50c6000640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f50c015e370 0x7f50c015f330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:30.147 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:30.149+0000 7f50c6000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f50c00d1770 0x7f50c00b2b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:30.147 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:30.149+0000 7f50c6000640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50c015f870 con 0x7f50c00d4b40 2024-04-04T06:56:30.147 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:30.149+0000 7f50c6000640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f50c00ce930 con 0x7f50c015e370 2024-04-04T06:56:30.147 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:30.149+0000 7f50c6000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f50c00d31a0 con 0x7f50c00d1770 2024-04-04T06:56:30.148 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:30.149+0000 7f50c5600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f50c00d1770 0x7f50c00b2b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:30.148 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:30.149+0000 7f50c5600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f50c00d1770 0x7f50c00b2b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.72:40078/0 (socket says 172.21.15.72:40078) 2024-04-04T06:56:30.148 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:30.149+0000 7f50c5600640 1 -- 172.21.15.72:0/1733938495 learned_addr learned my addr 172.21.15.72:0/1733938495 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:56:30.148 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:30.149+0000 7f50c4c00640 1 --2- 172.21.15.72:0/1733938495 >> v2:172.21.15.117:3300/0 conn(0x7f50c015e370 0x7f50c015f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:30.148 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:30.150+0000 7f50c5600640 1 -- 172.21.15.72:0/1733938495 >> v2:172.21.15.117:3300/0 conn(0x7f50c015e370 msgr2=0x7f50c015f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:56:30.148 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:30.150+0000 7f50c5600640 1 --2- 172.21.15.72:0/1733938495 >> v2:172.21.15.117:3300/0 conn(0x7f50c015e370 0x7f50c015f330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:30.149 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:30.150+0000 7f50c5600640 1 -- 172.21.15.72:0/1733938495 >> v1:172.21.15.117:6789/0 conn(0x7f50c00d4b40 legacy=0x7f50c00d1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:30.149 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:30.150+0000 7f50c5600640 1 -- 172.21.15.72:0/1733938495 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50c00ceb80 con 0x7f50c00d1770 2024-04-04T06:56:30.149 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:30.151+0000 7f50c5600640 1 --2- 172.21.15.72:0/1733938495 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f50c00d1770 0x7f50c00b2b60 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f50b8009e50 tx=0x7f50b802bee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1892147ddab6c147 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:30.150 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:30.151+0000 7f50bf400640 1 -- 172.21.15.72:0/1733938495 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50b802ca80 con 0x7f50c00d1770 2024-04-04T06:56:30.150 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:30.151+0000 7f50bf400640 1 -- 172.21.15.72:0/1733938495 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50b802cc20 con 0x7f50c00d1770 2024-04-04T06:56:30.150 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:30.151+0000 7f50bf400640 1 -- 172.21.15.72:0/1733938495 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50b80343f0 con 0x7f50c00d1770 2024-04-04T06:56:30.151 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:30.152+0000 7f50c6000640 1 -- 172.21.15.72:0/1733938495 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f50c00d1770 msgr2=0x7f50c00b2b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:30.151 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:30.152+0000 7f50c6000640 1 --2- 172.21.15.72:0/1733938495 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f50c00d1770 0x7f50c00b2b60 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f50b8009e50 tx=0x7f50b802bee0 comp rx=0 tx=0).stop 2024-04-04T06:56:30.151 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:30.152+0000 7f50c6000640 1 -- 172.21.15.72:0/1733938495 shutdown_connections 2024-04-04T06:56:30.151 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:30.152+0000 7f50c6000640 1 --2- 172.21.15.72:0/1733938495 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f50c00d1770 0x7f50c00b2b60 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:30.151 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:30.152+0000 7f50c6000640 1 --2- 172.21.15.72:0/1733938495 >> v2:172.21.15.117:3300/0 conn(0x7f50c015e370 0x7f50c015f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:30.151 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:30.152+0000 7f50c6000640 1 -- 172.21.15.72:0/1733938495 >> 172.21.15.72:0/1733938495 conn(0x7f50c006b890 msgr2=0x7f50c006bca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:56:30.151 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:30.152+0000 7f50c6000640 1 -- 172.21.15.72:0/1733938495 shutdown_connections 2024-04-04T06:56:30.151 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:30.152+0000 7f50c6000640 1 -- 172.21.15.72:0/1733938495 wait complete. 2024-04-04T06:56:30.152 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:30.154+0000 7f50c6000640 1 Processor -- start 2024-04-04T06:56:30.152 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:30.154+0000 7f50c6000640 1 -- start start 2024-04-04T06:56:30.154 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:30.155+0000 7f50c6000640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f50c00d1770 0x7f50c00c7530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:30.155 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:30.155+0000 7f50c6000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f50c00d4b40 0x7f50c01f4b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:30.155 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:30.155+0000 7f50c6000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f50c015e370 0x7f50c0159290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:30.155 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:30.155+0000 7f50c6000640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f50c00cf420 con 0x7f50c00d1770 2024-04-04T06:56:30.155 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:30.155+0000 7f50c6000640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f50c00cf140 con 0x7f50c00d4b40 2024-04-04T06:56:30.155 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:30.155+0000 7f50c6000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f50c00cf940 con 0x7f50c015e370 2024-04-04T06:56:30.155 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:30.155+0000 7f50c4c00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f50c00d1770 0x7f50c00c7530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:30.155 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:30.155+0000 7f50c4c00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f50c00d1770 0x7f50c00c7530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:45944/0 (socket says 172.21.15.72:45944) 2024-04-04T06:56:30.155 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:30.155+0000 7f50c4c00640 1 -- 172.21.15.72:0/1346817938 learned_addr learned my addr 172.21.15.72:0/1346817938 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:56:30.155 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:30.155+0000 7f50c4c00640 1 -- 172.21.15.72:0/1346817938 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f50c015e370 msgr2=0x7f50c0159290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:30.155 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:30.155+0000 7f50c5600640 1 --2- 172.21.15.72:0/1346817938 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f50c015e370 0x7f50c0159290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:30.155 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:30.155+0000 7f50c4c00640 1 --2- 172.21.15.72:0/1346817938 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f50c015e370 0x7f50c0159290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:30.155 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:30.155+0000 7f50c4c00640 1 -- 172.21.15.72:0/1346817938 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f50c00d4b40 msgr2=0x7f50c01f4b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:30.155 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:30.155+0000 7f50bfe00640 1 --2- 172.21.15.72:0/1346817938 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f50c00d4b40 0x7f50c01f4b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:30.156 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:30.155+0000 7f50c4c00640 1 --2- 172.21.15.72:0/1346817938 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f50c00d4b40 0x7f50c01f4b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:30.156 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:30.155+0000 7f50c4c00640 1 -- 172.21.15.72:0/1346817938 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50c01f50a0 con 0x7f50c00d1770 2024-04-04T06:56:30.156 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:30.155+0000 7f50bfe00640 1 --2- 172.21.15.72:0/1346817938 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f50c00d4b40 0x7f50c01f4b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-04T06:56:30.156 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:30.156+0000 7f50c4c00640 1 --2- 172.21.15.72:0/1346817938 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f50c00d1770 0x7f50c00c7530 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f50b400e870 tx=0x7f50b400ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:30.156 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:30.156+0000 7f50bcc00640 1 -- 172.21.15.72:0/1346817938 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50b4017070 con 0x7f50c00d1770 2024-04-04T06:56:30.156 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:30.156+0000 7f50bcc00640 1 -- 172.21.15.72:0/1346817938 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50b400c940 con 0x7f50c00d1770 2024-04-04T06:56:30.156 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:30.156+0000 7f50c6000640 1 -- 172.21.15.72:0/1346817938 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50c01f5320 con 0x7f50c00d1770 2024-04-04T06:56:30.156 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:30.156+0000 7f50bcc00640 1 -- 172.21.15.72:0/1346817938 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50b400cd30 con 0x7f50c00d1770 2024-04-04T06:56:30.156 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:30.156+0000 7f50c6000640 1 -- 172.21.15.72:0/1346817938 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50c01f58e0 con 0x7f50c00d1770 2024-04-04T06:56:30.157 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:30.157+0000 7f50c6000640 1 -- 172.21.15.72:0/1346817938 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50c00685a0 con 0x7f50c00d1770 2024-04-04T06:56:30.157 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:30.158+0000 7f50bcc00640 1 -- 172.21.15.72:0/1346817938 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f50b401a070 con 0x7f50c00d1770 2024-04-04T06:56:30.157 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:30.159+0000 7f50bcc00640 1 --2- 172.21.15.72:0/1346817938 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f50a006c8f0 0x7f50a006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:30.157 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:30.159+0000 7f50bcc00640 1 -- 172.21.15.72:0/1346817938 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f50b408bd50 con 0x7f50c00d1770 2024-04-04T06:56:30.157 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:30.159+0000 7f50bfe00640 1 --2- 172.21.15.72:0/1346817938 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f50a006c8f0 0x7f50a006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:30.158 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:30.160+0000 7f50bfe00640 1 --2- 172.21.15.72:0/1346817938 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f50a006c8f0 0x7f50a006edb0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f50c01f80b0 tx=0x7f50ac009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:30.166 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:30.168+0000 7f50bcc00640 1 -- 172.21.15.72:0/1346817938 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f50b408f030 con 0x7f50c00d1770 2024-04-04T06:56:30.395 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:30.397+0000 7f50c6000640 1 -- 172.21.15.72:0/1346817938 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f50c00d4010 con 0x7f50c00d1770 2024-04-04T06:56:31.040 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:31.041+0000 7f50bcc00640 1 -- 172.21.15.72:0/1346817938 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) ==== 118+0+0 (secure 0 0 0) 0x7f50c01f50a0 con 0x7f50c00d1770 2024-04-04T06:56:31.044 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:31.045+0000 7f50c6000640 1 -- 172.21.15.72:0/1346817938 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f50a006c8f0 msgr2=0x7f50a006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:31.044 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:31.045+0000 7f50c6000640 1 --2- 172.21.15.72:0/1346817938 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f50a006c8f0 0x7f50a006edb0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f50c01f80b0 tx=0x7f50ac009040 comp rx=0 tx=0).stop 2024-04-04T06:56:31.044 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:31.045+0000 7f50c6000640 1 -- 172.21.15.72:0/1346817938 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f50c00d1770 msgr2=0x7f50c00c7530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:31.044 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:31.045+0000 7f50c6000640 1 --2- 172.21.15.72:0/1346817938 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f50c00d1770 0x7f50c00c7530 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f50b400e870 tx=0x7f50b400ed30 comp rx=0 tx=0).stop 2024-04-04T06:56:31.044 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:31.046+0000 7f50c6000640 1 -- 172.21.15.72:0/1346817938 shutdown_connections 2024-04-04T06:56:31.045 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:31.046+0000 7f50c6000640 1 --2- 172.21.15.72:0/1346817938 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f50a006c8f0 0x7f50a006edb0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:31.045 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:31.046+0000 7f50c6000640 1 --2- 172.21.15.72:0/1346817938 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f50c015e370 0x7f50c0159290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:31.045 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:31.046+0000 7f50c6000640 1 --2- 172.21.15.72:0/1346817938 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f50c00d4b40 0x7f50c01f4b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:31.045 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:31.046+0000 7f50c6000640 1 --2- 172.21.15.72:0/1346817938 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f50c00d1770 0x7f50c00c7530 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:31.045 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:31.046+0000 7f50c6000640 1 -- 172.21.15.72:0/1346817938 >> 172.21.15.72:0/1346817938 conn(0x7f50c006b890 msgr2=0x7f50c015c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:56:31.045 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:31.046+0000 7f50c6000640 1 -- 172.21.15.72:0/1346817938 shutdown_connections 2024-04-04T06:56:31.045 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:31.046+0000 7f50c6000640 1 -- 172.21.15.72:0/1346817938 wait complete. 2024-04-04T06:56:31.066 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-04-04T06:56:31.066 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-04T06:56:31.296 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:31.297+0000 7f9d74c00640 1 Processor -- start 2024-04-04T06:56:31.296 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:31.297+0000 7f9d74c00640 1 -- start start 2024-04-04T06:56:31.297 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:31.299+0000 7f9d74c00640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f9d700b6aa0 0x7f9d700d2410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:31.297 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:31.299+0000 7f9d74c00640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d700d3100 con 0x7f9d7015e6c0 2024-04-04T06:56:31.298 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:31.299+0000 7f9d74c00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d700d33e0 con 0x7f9d700d2950 2024-04-04T06:56:31.298 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:31.299+0000 7f9d74c00640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f9d7015eaa0 con 0x7f9d700b6aa0 2024-04-04T06:56:31.298 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:31.299+0000 7f9d65400640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f9d700b6aa0 0x7f9d700d2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:31.298 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:31.299+0000 7f9d6de00640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f9d7015e6c0 0x7f9d700b6390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:52546/0 (socket says 172.21.15.72:52546) 2024-04-04T06:56:31.298 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:31.299+0000 7f9d6de00640 1 -- 172.21.15.72:0/1440084147 learned_addr learned my addr 172.21.15.72:0/1440084147 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-04-04T06:56:31.298 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:31.299+0000 7f9d65400640 1 -- 172.21.15.72:0/1440084147 >> v1:172.21.15.117:6789/0 conn(0x7f9d700d2950 legacy=0x7f9d700b7520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:56:31.298 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:31.299+0000 7f9d65400640 1 -- 172.21.15.72:0/1440084147 >> v1:172.21.15.72:6789/0 conn(0x7f9d7015e6c0 legacy=0x7f9d700b6390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:31.298 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:31.299+0000 7f9d65400640 1 -- 172.21.15.72:0/1440084147 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d700d36c0 con 0x7f9d700b6aa0 2024-04-04T06:56:31.299 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:31.300+0000 7f9d65400640 1 --2- 172.21.15.72:0/1440084147 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9d700b6aa0 0x7f9d700d2410 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f9d580097a0 tx=0x7f9d5802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95279054dc4d9c1c server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:31.299 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:31.301+0000 7f9d6d400640 1 -- 172.21.15.72:0/1440084147 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d58035020 con 0x7f9d700b6aa0 2024-04-04T06:56:31.299 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:31.301+0000 7f9d6d400640 1 -- 172.21.15.72:0/1440084147 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d58031830 con 0x7f9d700b6aa0 2024-04-04T06:56:31.299 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:31.301+0000 7f9d6d400640 1 -- 172.21.15.72:0/1440084147 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d58031c00 con 0x7f9d700b6aa0 2024-04-04T06:56:31.300 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:31.301+0000 7f9d74c00640 1 -- 172.21.15.72:0/1440084147 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9d700b6aa0 msgr2=0x7f9d700d2410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:31.300 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:31.301+0000 7f9d74c00640 1 --2- 172.21.15.72:0/1440084147 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9d700b6aa0 0x7f9d700d2410 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f9d580097a0 tx=0x7f9d5802b8d0 comp rx=0 tx=0).stop 2024-04-04T06:56:31.300 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:31.301+0000 7f9d74c00640 1 -- 172.21.15.72:0/1440084147 shutdown_connections 2024-04-04T06:56:31.300 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:31.301+0000 7f9d74c00640 1 --2- 172.21.15.72:0/1440084147 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9d700b6aa0 0x7f9d700d2410 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:31.300 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:31.301+0000 7f9d74c00640 1 -- 172.21.15.72:0/1440084147 >> 172.21.15.72:0/1440084147 conn(0x7f9d70071e80 msgr2=0x7f9d70072290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:56:31.301 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:31.302+0000 7f9d74c00640 1 -- 172.21.15.72:0/1440084147 shutdown_connections 2024-04-04T06:56:31.301 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:31.302+0000 7f9d74c00640 1 -- 172.21.15.72:0/1440084147 wait complete. 2024-04-04T06:56:31.303 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:31.304+0000 7f9d74c00640 1 Processor -- start 2024-04-04T06:56:31.303 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:31.304+0000 7f9d74c00640 1 -- start start 2024-04-04T06:56:31.305 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:31.306+0000 7f9d74c00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9d700b6aa0 0x7f9d70157210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:31.305 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:31.306+0000 7f9d74c00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9d700d2950 0x7f9d700cb3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:31.305 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:31.306+0000 7f9d74c00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9d7015e6c0 0x7f9d700cb900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:31.305 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:31.306+0000 7f9d74c00640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f9d700d2d60 con 0x7f9d7015e6c0 2024-04-04T06:56:31.305 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:31.306+0000 7f9d74c00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f9d700d3c80 con 0x7f9d700b6aa0 2024-04-04T06:56:31.305 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:31.306+0000 7f9d74c00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f9d700d2ee0 con 0x7f9d700d2950 2024-04-04T06:56:31.305 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:31.306+0000 7f9d6e800640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9d7015e6c0 0x7f9d700cb900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:31.305 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:31.306+0000 7f9d6e800640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9d7015e6c0 0x7f9d700cb900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:45960/0 (socket says 172.21.15.72:45960) 2024-04-04T06:56:31.305 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:31.306+0000 7f9d6e800640 1 -- 172.21.15.72:0/747888376 learned_addr learned my addr 172.21.15.72:0/747888376 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:56:31.306 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:31.307+0000 7f9d65400640 1 --2- 172.21.15.72:0/747888376 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9d700d2950 0x7f9d700cb3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:31.306 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:31.307+0000 7f9d6de00640 1 --2- 172.21.15.72:0/747888376 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9d700b6aa0 0x7f9d70157210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:31.306 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:31.307+0000 7f9d6e800640 1 -- 172.21.15.72:0/747888376 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9d700d2950 msgr2=0x7f9d700cb3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:31.306 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:31.307+0000 7f9d6e800640 1 --2- 172.21.15.72:0/747888376 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9d700d2950 0x7f9d700cb3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:31.306 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:31.307+0000 7f9d6e800640 1 -- 172.21.15.72:0/747888376 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9d700b6aa0 msgr2=0x7f9d70157210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:31.306 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:31.307+0000 7f9d6e800640 1 --2- 172.21.15.72:0/747888376 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9d700b6aa0 0x7f9d70157210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:31.306 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:31.307+0000 7f9d6e800640 1 -- 172.21.15.72:0/747888376 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d70157980 con 0x7f9d7015e6c0 2024-04-04T06:56:31.307 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:31.307+0000 7f9d6e800640 1 --2- 172.21.15.72:0/747888376 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9d7015e6c0 0x7f9d700cb900 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f9d6800c440 tx=0x7f9d6800c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:31.307 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:31.307+0000 7f9d66a00640 1 -- 172.21.15.72:0/747888376 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d68011790 con 0x7f9d7015e6c0 2024-04-04T06:56:31.307 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:31.307+0000 7f9d66a00640 1 -- 172.21.15.72:0/747888376 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d68017070 con 0x7f9d7015e6c0 2024-04-04T06:56:31.307 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:31.307+0000 7f9d74c00640 1 -- 172.21.15.72:0/747888376 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d70157c60 con 0x7f9d7015e6c0 2024-04-04T06:56:31.307 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:31.307+0000 7f9d66a00640 1 -- 172.21.15.72:0/747888376 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d68011b70 con 0x7f9d7015e6c0 2024-04-04T06:56:31.308 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:31.308+0000 7f9d74c00640 1 -- 172.21.15.72:0/747888376 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d70158220 con 0x7f9d7015e6c0 2024-04-04T06:56:31.308 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:31.309+0000 7f9d74c00640 1 -- 172.21.15.72:0/747888376 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d70075730 con 0x7f9d7015e6c0 2024-04-04T06:56:31.308 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:31.310+0000 7f9d66a00640 1 -- 172.21.15.72:0/747888376 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9d68011d10 con 0x7f9d7015e6c0 2024-04-04T06:56:31.309 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:31.310+0000 7f9d66a00640 1 --2- 172.21.15.72:0/747888376 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f9d4c06c8f0 0x7f9d4c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:31.309 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:31.311+0000 7f9d66a00640 1 -- 172.21.15.72:0/747888376 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f9d6808b8a0 con 0x7f9d7015e6c0 2024-04-04T06:56:31.309 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:31.311+0000 7f9d6de00640 1 --2- 172.21.15.72:0/747888376 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f9d4c06c8f0 0x7f9d4c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:31.310 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:31.311+0000 7f9d6de00640 1 --2- 172.21.15.72:0/747888376 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f9d4c06c8f0 0x7f9d4c06edb0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f9d600012e0 tx=0x7f9d60009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:31.313 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:31.315+0000 7f9d66a00640 1 -- 172.21.15.72:0/747888376 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f9d68059cd0 con 0x7f9d7015e6c0 2024-04-04T06:56:31.554 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:31.556+0000 7f9d74c00640 1 -- 172.21.15.72:0/747888376 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f9d700b56b0 con 0x7f9d7015e6c0 2024-04-04T06:56:32.043 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:32.044+0000 7f9d66a00640 1 -- 172.21.15.72:0/747888376 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) ==== 122+0+0 (secure 0 0 0) 0x7f9d680595d0 con 0x7f9d7015e6c0 2024-04-04T06:56:32.047 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:32.048+0000 7f9d74c00640 1 -- 172.21.15.72:0/747888376 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f9d4c06c8f0 msgr2=0x7f9d4c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:32.047 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:32.048+0000 7f9d74c00640 1 --2- 172.21.15.72:0/747888376 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f9d4c06c8f0 0x7f9d4c06edb0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f9d600012e0 tx=0x7f9d60009040 comp rx=0 tx=0).stop 2024-04-04T06:56:32.047 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:32.048+0000 7f9d74c00640 1 -- 172.21.15.72:0/747888376 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9d7015e6c0 msgr2=0x7f9d700cb900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:32.047 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:32.048+0000 7f9d74c00640 1 --2- 172.21.15.72:0/747888376 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9d7015e6c0 0x7f9d700cb900 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f9d6800c440 tx=0x7f9d6800c900 comp rx=0 tx=0).stop 2024-04-04T06:56:32.047 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:32.048+0000 7f9d74c00640 1 -- 172.21.15.72:0/747888376 shutdown_connections 2024-04-04T06:56:32.047 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:32.048+0000 7f9d74c00640 1 --2- 172.21.15.72:0/747888376 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f9d4c06c8f0 0x7f9d4c06edb0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:32.048 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:32.048+0000 7f9d74c00640 1 --2- 172.21.15.72:0/747888376 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9d7015e6c0 0x7f9d700cb900 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:32.048 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:32.048+0000 7f9d74c00640 1 --2- 172.21.15.72:0/747888376 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9d700d2950 0x7f9d700cb3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:32.048 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:32.048+0000 7f9d74c00640 1 --2- 172.21.15.72:0/747888376 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9d700b6aa0 0x7f9d70157210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:32.048 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:32.048+0000 7f9d74c00640 1 -- 172.21.15.72:0/747888376 >> 172.21.15.72:0/747888376 conn(0x7f9d70071e80 msgr2=0x7f9d700b6390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:56:32.048 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:32.048+0000 7f9d74c00640 1 -- 172.21.15.72:0/747888376 shutdown_connections 2024-04-04T06:56:32.048 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:32.048+0000 7f9d74c00640 1 -- 172.21.15.72:0/747888376 wait complete. 2024-04-04T06:56:32.069 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-04T06:56:32.070 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-04T06:56:32.269 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:32.270+0000 7f723aa00640 1 Processor -- start 2024-04-04T06:56:32.269 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:32.270+0000 7f723aa00640 1 -- start start 2024-04-04T06:56:32.271 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:32.272+0000 7f723aa00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f72341427e0 0x7f72340ce6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:32.271 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:32.272+0000 7f723aa00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f723406df20 0x7f72340cec00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:32.271 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:32.272+0000 7f723aa00640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f72340cf5b0 con 0x7f72340cf140 2024-04-04T06:56:32.271 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:32.272+0000 7f723aa00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f7234142bc0 con 0x7f72341427e0 2024-04-04T06:56:32.271 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:32.272+0000 7f723aa00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f723406e490 con 0x7f723406df20 2024-04-04T06:56:32.271 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:32.272+0000 7f723a000640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f72340cf140 0x7f723415fe40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:52558/0 (socket says 172.21.15.72:52558) 2024-04-04T06:56:32.271 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:32.272+0000 7f723a000640 1 -- 172.21.15.72:0/1473843020 learned_addr learned my addr 172.21.15.72:0/1473843020 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-04-04T06:56:32.272 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:32.272+0000 7f7238c00640 1 --2- 172.21.15.72:0/1473843020 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f723406df20 0x7f72340cec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:32.272 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:32.272+0000 7f7239600640 1 --2- 172.21.15.72:0/1473843020 >> v2:172.21.15.117:3300/0 conn(0x7f72341427e0 0x7f72340ce6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:32.272 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:32.273+0000 7f7233e00640 1 -- 172.21.15.72:0/1473843020 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 444380833 0 0) 0x7f72340cf5b0 con 0x7f72340cf140 2024-04-04T06:56:32.272 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:32.273+0000 7f7233e00640 1 -- 172.21.15.72:0/1473843020 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f721c003520 con 0x7f72340cf140 2024-04-04T06:56:32.272 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:32.273+0000 7f7238c00640 1 -- 172.21.15.72:0/1473843020 >> v2:172.21.15.117:3300/0 conn(0x7f72341427e0 msgr2=0x7f72340ce6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:56:32.273 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:32.273+0000 7f7238c00640 1 --2- 172.21.15.72:0/1473843020 >> v2:172.21.15.117:3300/0 conn(0x7f72341427e0 0x7f72340ce6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:32.273 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:32.273+0000 7f7233e00640 1 -- 172.21.15.72:0/1473843020 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3283899963 0 0) 0x7f721c003520 con 0x7f72340cf140 2024-04-04T06:56:32.273 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:32.273+0000 7f7238c00640 1 -- 172.21.15.72:0/1473843020 >> v1:172.21.15.72:6789/0 conn(0x7f72340cf140 legacy=0x7f723415fe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:32.273 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:32.273+0000 7f7238c00640 1 -- 172.21.15.72:0/1473843020 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f723406e770 con 0x7f723406df20 2024-04-04T06:56:32.273 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:32.274+0000 7f7238c00640 1 --2- 172.21.15.72:0/1473843020 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f723406df20 0x7f72340cec00 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f72240097a0 tx=0x7f722402b790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1518695596f58a81 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:32.274 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:32.275+0000 7f7233e00640 1 -- 172.21.15.72:0/1473843020 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7224037070 con 0x7f723406df20 2024-04-04T06:56:32.274 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:32.275+0000 7f7233e00640 1 -- 172.21.15.72:0/1473843020 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7224030510 con 0x7f723406df20 2024-04-04T06:56:32.274 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:32.275+0000 7f7233e00640 1 -- 172.21.15.72:0/1473843020 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f722c0019f0 con 0x7f723406df20 2024-04-04T06:56:32.274 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:32.275+0000 7f723aa00640 1 -- 172.21.15.72:0/1473843020 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f723406df20 msgr2=0x7f72340cec00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:32.274 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:32.275+0000 7f723aa00640 1 --2- 172.21.15.72:0/1473843020 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f723406df20 0x7f72340cec00 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f72240097a0 tx=0x7f722402b790 comp rx=0 tx=0).stop 2024-04-04T06:56:32.275 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:32.276+0000 7f723aa00640 1 -- 172.21.15.72:0/1473843020 shutdown_connections 2024-04-04T06:56:32.275 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:32.276+0000 7f723aa00640 1 --2- 172.21.15.72:0/1473843020 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f723406df20 0x7f72340cec00 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:32.275 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:32.276+0000 7f723aa00640 1 --2- 172.21.15.72:0/1473843020 >> v2:172.21.15.117:3300/0 conn(0x7f72341427e0 0x7f72340ce6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:32.275 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:32.276+0000 7f723aa00640 1 -- 172.21.15.72:0/1473843020 >> 172.21.15.72:0/1473843020 conn(0x7f72340b1840 msgr2=0x7f72340b1c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:56:32.275 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:32.276+0000 7f723aa00640 1 -- 172.21.15.72:0/1473843020 shutdown_connections 2024-04-04T06:56:32.275 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:32.276+0000 7f723aa00640 1 -- 172.21.15.72:0/1473843020 wait complete. 2024-04-04T06:56:32.277 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:32.278+0000 7f723aa00640 1 Processor -- start 2024-04-04T06:56:32.277 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:32.279+0000 7f723aa00640 1 -- start start 2024-04-04T06:56:32.279 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:32.280+0000 7f723aa00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f723406df20 0x7f7234150b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:32.279 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:32.280+0000 7f723aa00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f72340cf140 0x7f723415e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:32.279 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:32.280+0000 7f723aa00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f72341427e0 0x7f723415e930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:32.279 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:32.280+0000 7f723aa00640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f7234145ca0 con 0x7f72340cf140 2024-04-04T06:56:32.279 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:32.280+0000 7f723aa00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f723406ed30 con 0x7f72341427e0 2024-04-04T06:56:32.279 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:32.280+0000 7f723aa00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f7234072590 con 0x7f723406df20 2024-04-04T06:56:32.279 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:32.280+0000 7f7238c00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f72340cf140 0x7f723415e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:32.279 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:32.281+0000 7f7238c00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f72340cf140 0x7f723415e3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:45970/0 (socket says 172.21.15.72:45970) 2024-04-04T06:56:32.279 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:32.281+0000 7f7238c00640 1 -- 172.21.15.72:0/2558840380 learned_addr learned my addr 172.21.15.72:0/2558840380 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:56:32.280 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:32.281+0000 7f7239600640 1 --2- 172.21.15.72:0/2558840380 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f723406df20 0x7f7234150b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:32.280 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:32.281+0000 7f723a000640 1 --2- 172.21.15.72:0/2558840380 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f72341427e0 0x7f723415e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:32.280 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:32.281+0000 7f7238c00640 1 -- 172.21.15.72:0/2558840380 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f723406df20 msgr2=0x7f7234150b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:32.281 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:32.281+0000 7f7238c00640 1 --2- 172.21.15.72:0/2558840380 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f723406df20 0x7f7234150b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:32.281 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:32.281+0000 7f7238c00640 1 -- 172.21.15.72:0/2558840380 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f72341427e0 msgr2=0x7f723415e930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:32.281 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:32.281+0000 7f7238c00640 1 --2- 172.21.15.72:0/2558840380 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f72341427e0 0x7f723415e930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:32.281 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:32.281+0000 7f7238c00640 1 -- 172.21.15.72:0/2558840380 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f723415d6c0 con 0x7f72340cf140 2024-04-04T06:56:32.281 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:32.281+0000 7f7238c00640 1 --2- 172.21.15.72:0/2558840380 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f72340cf140 0x7f723415e3f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f7224000c00 tx=0x7f72240046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:32.281 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:32.282+0000 7f7231600640 1 -- 172.21.15.72:0/2558840380 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7224040020 con 0x7f72340cf140 2024-04-04T06:56:32.281 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:32.282+0000 7f7231600640 1 -- 172.21.15.72:0/2558840380 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7224038040 con 0x7f72340cf140 2024-04-04T06:56:32.281 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:32.282+0000 7f723aa00640 1 -- 172.21.15.72:0/2558840380 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f723415d9a0 con 0x7f72340cf140 2024-04-04T06:56:32.281 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:32.282+0000 7f7231600640 1 -- 172.21.15.72:0/2558840380 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7224037070 con 0x7f72340cf140 2024-04-04T06:56:32.281 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:32.282+0000 7f723aa00640 1 -- 172.21.15.72:0/2558840380 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f723414dfa0 con 0x7f72340cf140 2024-04-04T06:56:32.281 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:32.283+0000 7f723aa00640 1 -- 172.21.15.72:0/2558840380 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72340756c0 con 0x7f72340cf140 2024-04-04T06:56:32.282 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:32.284+0000 7f7231600640 1 -- 172.21.15.72:0/2558840380 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7224043020 con 0x7f72340cf140 2024-04-04T06:56:32.284 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:32.285+0000 7f7231600640 1 --2- 172.21.15.72:0/2558840380 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f721806c8f0 0x7f721806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:32.284 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:32.285+0000 7f7231600640 1 -- 172.21.15.72:0/2558840380 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f72240ace00 con 0x7f72340cf140 2024-04-04T06:56:32.284 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:32.286+0000 7f7239600640 1 --2- 172.21.15.72:0/2558840380 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f721806c8f0 0x7f721806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:32.284 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:32.286+0000 7f7239600640 1 --2- 172.21.15.72:0/2558840380 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f721806c8f0 0x7f721806edb0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f7228009aa0 tx=0x7f7228009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:32.288 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:32.289+0000 7f7231600640 1 -- 172.21.15.72:0/2558840380 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f722404a030 con 0x7f72340cf140 2024-04-04T06:56:32.530 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:32.532+0000 7f723aa00640 1 -- 172.21.15.72:0/2558840380 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7234145660 con 0x7f72340cf140 2024-04-04T06:56:32.531 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:32.533+0000 7f7231600640 1 -- 172.21.15.72:0/2558840380 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5181 (secure 0 0 0) 0x7f722407ac70 con 0x7f72340cf140 2024-04-04T06:56:32.532 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T06:56:32.532 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6834/3570831137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":3570831137},{"type":"v1","addr":"172.21.15.117:6834","nonce":3570831137}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4238,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/1683311500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6833","nonce":1683311500},{"type":"v1","addr":"172.21.15.117:6835","nonce":1683311500}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6835/4150347227","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":4150347227},{"type":"v1","addr":"172.21.15.72:6835","nonce":4150347227}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-04T06:56:28.435113+0000","modified":"2024-04-04T06:56:31.557618+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4263},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4263":{"gid":4263,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.72:6837/2958027127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6836","nonce":2958027127},{"type":"v1","addr":"172.21.15.72:6837","nonce":2958027127}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4263,"qdb_cluster":[4263]},"id":1}]} 2024-04-04T06:56:32.532 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 8 2024-04-04T06:56:32.535 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:32.536+0000 7f723aa00640 1 -- 172.21.15.72:0/2558840380 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f721806c8f0 msgr2=0x7f721806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:32.535 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:32.536+0000 7f723aa00640 1 --2- 172.21.15.72:0/2558840380 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f721806c8f0 0x7f721806edb0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f7228009aa0 tx=0x7f7228009190 comp rx=0 tx=0).stop 2024-04-04T06:56:32.535 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:32.536+0000 7f723aa00640 1 -- 172.21.15.72:0/2558840380 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f72340cf140 msgr2=0x7f723415e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:32.535 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:32.536+0000 7f723aa00640 1 --2- 172.21.15.72:0/2558840380 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f72340cf140 0x7f723415e3f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f7224000c00 tx=0x7f72240046c0 comp rx=0 tx=0).stop 2024-04-04T06:56:32.535 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:32.536+0000 7f723aa00640 1 -- 172.21.15.72:0/2558840380 shutdown_connections 2024-04-04T06:56:32.535 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:32.536+0000 7f723aa00640 1 --2- 172.21.15.72:0/2558840380 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f721806c8f0 0x7f721806edb0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:32.535 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:32.536+0000 7f723aa00640 1 --2- 172.21.15.72:0/2558840380 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f72341427e0 0x7f723415e930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:32.535 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:32.536+0000 7f723aa00640 1 --2- 172.21.15.72:0/2558840380 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f72340cf140 0x7f723415e3f0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:32.535 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:32.536+0000 7f723aa00640 1 --2- 172.21.15.72:0/2558840380 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f723406df20 0x7f7234150b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:32.535 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:32.536+0000 7f723aa00640 1 -- 172.21.15.72:0/2558840380 >> 172.21.15.72:0/2558840380 conn(0x7f72340b1840 msgr2=0x7f72340af6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:56:32.535 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:32.536+0000 7f723aa00640 1 -- 172.21.15.72:0/2558840380 shutdown_connections 2024-04-04T06:56:32.535 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:32.536+0000 7f723aa00640 1 -- 172.21.15.72:0/2558840380 wait complete. 2024-04-04T06:56:32.554 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-04T06:56:32.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:32.765+0000 7fca88400640 1 Processor -- start 2024-04-04T06:56:32.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:32.765+0000 7fca88400640 1 -- start start 2024-04-04T06:56:32.766 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:32.767+0000 7fca88400640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fca8015e590 0x7fca8006c430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:32.766 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:32.767+0000 7fca88400640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fca800b9d10 0x7fca800cf0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:32.766 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:32.767+0000 7fca88400640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca8006cd30 con 0x7fca800cf620 2024-04-04T06:56:32.766 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:32.767+0000 7fca88400640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7fca800cfa60 con 0x7fca8015e590 2024-04-04T06:56:32.766 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:32.767+0000 7fca88400640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fca8006d010 con 0x7fca800b9d10 2024-04-04T06:56:32.766 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:32.767+0000 7fca86400640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fca800cf620 0x7fca801620f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:52570/0 (socket says 172.21.15.72:52570) 2024-04-04T06:56:32.766 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:32.767+0000 7fca85a00640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fca8015e590 0x7fca8006c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:32.766 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:32.767+0000 7fca86400640 1 -- 172.21.15.72:0/2527900751 learned_addr learned my addr 172.21.15.72:0/2527900751 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-04-04T06:56:32.766 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:32.767+0000 7fca85000640 1 --2- 172.21.15.72:0/2527900751 >> v2:172.21.15.117:3300/0 conn(0x7fca800b9d10 0x7fca800cf0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:32.767 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:32.767+0000 7fca85a00640 1 -- 172.21.15.72:0/2527900751 >> v2:172.21.15.117:3300/0 conn(0x7fca800b9d10 msgr2=0x7fca800cf0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:56:32.767 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:32.767+0000 7fca85a00640 1 --2- 172.21.15.72:0/2527900751 >> v2:172.21.15.117:3300/0 conn(0x7fca800b9d10 0x7fca800cf0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:32.767 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:32.768+0000 7fca85a00640 1 -- 172.21.15.72:0/2527900751 >> v1:172.21.15.72:6789/0 conn(0x7fca800cf620 legacy=0x7fca801620f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:32.767 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:32.768+0000 7fca85a00640 1 -- 172.21.15.72:0/2527900751 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca8006d2f0 con 0x7fca8015e590 2024-04-04T06:56:32.767 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:32.768+0000 7fca7fe00640 1 -- 172.21.15.72:0/2527900751 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3585684179 0 0) 0x7fca8006cd30 con 0x7fca800cf620 2024-04-04T06:56:32.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:32.769+0000 7fca85a00640 1 --2- 172.21.15.72:0/2527900751 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fca8015e590 0x7fca8006c430 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fca800ba480 tx=0x7fca7402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=570229a3c1f05541 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:32.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:32.769+0000 7fca7fe00640 1 -- 172.21.15.72:0/2527900751 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca74035020 con 0x7fca8015e590 2024-04-04T06:56:32.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:32.770+0000 7fca7fe00640 1 -- 172.21.15.72:0/2527900751 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca74031830 con 0x7fca8015e590 2024-04-04T06:56:32.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:32.770+0000 7fca7fe00640 1 -- 172.21.15.72:0/2527900751 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca74031c00 con 0x7fca8015e590 2024-04-04T06:56:32.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:32.770+0000 7fca88400640 1 -- 172.21.15.72:0/2527900751 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fca8015e590 msgr2=0x7fca8006c430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:32.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:32.770+0000 7fca88400640 1 --2- 172.21.15.72:0/2527900751 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fca8015e590 0x7fca8006c430 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fca800ba480 tx=0x7fca7402b8d0 comp rx=0 tx=0).stop 2024-04-04T06:56:32.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:32.770+0000 7fca88400640 1 -- 172.21.15.72:0/2527900751 shutdown_connections 2024-04-04T06:56:32.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:32.770+0000 7fca88400640 1 --2- 172.21.15.72:0/2527900751 >> v2:172.21.15.117:3300/0 conn(0x7fca800b9d10 0x7fca800cf0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:32.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:32.770+0000 7fca88400640 1 --2- 172.21.15.72:0/2527900751 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fca8015e590 0x7fca8006c430 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:32.771 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:32.770+0000 7fca88400640 1 -- 172.21.15.72:0/2527900751 >> 172.21.15.72:0/2527900751 conn(0x7fca800d0f70 msgr2=0x7fca800d1380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:56:32.771 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:32.770+0000 7fca88400640 1 -- 172.21.15.72:0/2527900751 shutdown_connections 2024-04-04T06:56:32.771 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:32.770+0000 7fca88400640 1 -- 172.21.15.72:0/2527900751 wait complete. 2024-04-04T06:56:32.773 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:32.772+0000 7fca88400640 1 Processor -- start 2024-04-04T06:56:32.773 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:32.772+0000 7fca88400640 1 -- start start 2024-04-04T06:56:32.773 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:32.773+0000 7fca88400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fca800b9d10 0x7fca8015a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:32.773 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:32.773+0000 7fca88400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fca800cf620 0x7fca800b2680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:32.773 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:32.773+0000 7fca88400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fca8015e590 0x7fca800c9fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:32.773 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:32.773+0000 7fca88400640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fca8006c970 con 0x7fca800b9d10 2024-04-04T06:56:32.773 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:32.773+0000 7fca88400640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fca8015e970 con 0x7fca8015e590 2024-04-04T06:56:32.773 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:32.773+0000 7fca88400640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fca8006caf0 con 0x7fca800cf620 2024-04-04T06:56:32.773 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:32.773+0000 7fca85a00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fca800b9d10 0x7fca8015a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:32.773 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:32.773+0000 7fca85a00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fca800b9d10 0x7fca8015a0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:45992/0 (socket says 172.21.15.72:45992) 2024-04-04T06:56:32.774 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:32.773+0000 7fca85a00640 1 -- 172.21.15.72:0/267926339 learned_addr learned my addr 172.21.15.72:0/267926339 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:56:32.774 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:32.773+0000 7fca85000640 1 --2- 172.21.15.72:0/267926339 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fca800cf620 0x7fca800b2680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:32.774 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:32.773+0000 7fca85a00640 1 -- 172.21.15.72:0/267926339 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fca800cf620 msgr2=0x7fca800b2680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:32.774 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:32.773+0000 7fca85a00640 1 --2- 172.21.15.72:0/267926339 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fca800cf620 0x7fca800b2680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:32.774 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:32.773+0000 7fca85a00640 1 -- 172.21.15.72:0/267926339 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fca8015e590 msgr2=0x7fca800c9fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:32.774 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:32.773+0000 7fca86400640 1 --2- 172.21.15.72:0/267926339 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fca8015e590 0x7fca800c9fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:32.774 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:32.773+0000 7fca85a00640 1 --2- 172.21.15.72:0/267926339 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fca8015e590 0x7fca800c9fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:32.774 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:32.773+0000 7fca85a00640 1 -- 172.21.15.72:0/267926339 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca8015a620 con 0x7fca800b9d10 2024-04-04T06:56:32.774 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:32.774+0000 7fca85a00640 1 --2- 172.21.15.72:0/267926339 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fca800b9d10 0x7fca8015a0e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fca74000c00 tx=0x7fca740046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:32.774 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:32.774+0000 7fca7d600640 1 -- 172.21.15.72:0/267926339 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca74041070 con 0x7fca800b9d10 2024-04-04T06:56:32.774 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:32.774+0000 7fca7d600640 1 -- 172.21.15.72:0/267926339 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca74004250 con 0x7fca800b9d10 2024-04-04T06:56:32.774 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:32.774+0000 7fca88400640 1 -- 172.21.15.72:0/267926339 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca800c8f30 con 0x7fca800b9d10 2024-04-04T06:56:32.775 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:32.774+0000 7fca7d600640 1 -- 172.21.15.72:0/267926339 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca74035040 con 0x7fca800b9d10 2024-04-04T06:56:32.775 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:32.774+0000 7fca88400640 1 -- 172.21.15.72:0/267926339 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca800c94f0 con 0x7fca800b9d10 2024-04-04T06:56:32.775 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:32.776+0000 7fca88400640 1 -- 172.21.15.72:0/267926339 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca80075840 con 0x7fca800b9d10 2024-04-04T06:56:32.775 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:32.776+0000 7fca7d600640 1 -- 172.21.15.72:0/267926339 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fca74038020 con 0x7fca800b9d10 2024-04-04T06:56:32.776 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:32.777+0000 7fca7d600640 1 --2- 172.21.15.72:0/267926339 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fca6006c8f0 0x7fca6006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:32.776 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:32.777+0000 7fca7d600640 1 -- 172.21.15.72:0/267926339 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fca740ad550 con 0x7fca800b9d10 2024-04-04T06:56:32.776 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:32.777+0000 7fca85000640 1 --2- 172.21.15.72:0/267926339 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fca6006c8f0 0x7fca6006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:32.776 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:32.778+0000 7fca85000640 1 --2- 172.21.15.72:0/267926339 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fca6006c8f0 0x7fca6006edb0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fca801f7410 tx=0x7fca6c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:32.784 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:32.786+0000 7fca7d600640 1 -- 172.21.15.72:0/267926339 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fca8015a620 con 0x7fca800b9d10 2024-04-04T06:56:32.987 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:32.989+0000 7fca88400640 1 -- 172.21.15.72:0/267926339 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fca800d1460 con 0x7fca800b9d10 2024-04-04T06:56:32.990 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:32.991+0000 7fca7d600640 1 -- 172.21.15.72:0/267926339 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16581 (secure 0 0 0) 0x7fca7407b980 con 0x7fca800b9d10 2024-04-04T06:56:32.990 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T06:56:32.990 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":20,"fsid":"6708bac2-4f50-49b5-87a9-c390fd333eb3","created":"2024-04-04T06:56:04.282498+0000","modified":"2024-04-04T06:56:30.007371+0000","last_up_change":"2024-04-04T06:56:16.716089+0000","last_in_change":"2024-04-04T06:56:07.768593+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-04T06:56:17.421685+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-04T06:56:26.822661+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-04T06:56:27.429816+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7c345991-5af8-4dc6-a481-28610c40e128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":3889813953},{"type":"v1","addr":"172.21.15.72:6818","nonce":3889813953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":3889813953},{"type":"v1","addr":"172.21.15.72:6821","nonce":3889813953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":3889813953},{"type":"v1","addr":"172.21.15.72:6826","nonce":3889813953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":3889813953},{"type":"v1","addr":"172.21.15.72:6823","nonce":3889813953}]},"public_addr":"172.21.15.72:6818/3889813953","cluster_addr":"172.21.15.72:6821/3889813953","heartbeat_back_addr":"172.21.15.72:6826/3889813953","heartbeat_front_addr":"172.21.15.72:6823/3889813953","state":["exists","up"]},{"osd":1,"uuid":"1b3f7ab2-a56c-488d-a89a-1f3572361c95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":3101663154},{"type":"v1","addr":"172.21.15.72:6801","nonce":3101663154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":3101663154},{"type":"v1","addr":"172.21.15.72:6803","nonce":3101663154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":3101663154},{"type":"v1","addr":"172.21.15.72:6807","nonce":3101663154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":3101663154},{"type":"v1","addr":"172.21.15.72:6805","nonce":3101663154}]},"public_addr":"172.21.15.72:6801/3101663154","cluster_addr":"172.21.15.72:6803/3101663154","heartbeat_back_addr":"172.21.15.72:6807/3101663154","heartbeat_front_addr":"172.21.15.72:6805/3101663154","state":["exists","up"]},{"osd":2,"uuid":"fc9aa512-53df-40d7-ba04-3e6b7dcd1e34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":235374192},{"type":"v1","addr":"172.21.15.72:6809","nonce":235374192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":235374192},{"type":"v1","addr":"172.21.15.72:6811","nonce":235374192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":235374192},{"type":"v1","addr":"172.21.15.72:6815","nonce":235374192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":235374192},{"type":"v1","addr":"172.21.15.72:6813","nonce":235374192}]},"public_addr":"172.21.15.72:6809/235374192","cluster_addr":"172.21.15.72:6811/235374192","heartbeat_back_addr":"172.21.15.72:6815/235374192","heartbeat_front_addr":"172.21.15.72:6813/235374192","state":["exists","up"]},{"osd":3,"uuid":"b4f63eed-dc5b-4aba-bb50-de46eb41492b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6817","nonce":2806631742},{"type":"v1","addr":"172.21.15.72:6819","nonce":2806631742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":2806631742},{"type":"v1","addr":"172.21.15.72:6827","nonce":2806631742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":2806631742},{"type":"v1","addr":"172.21.15.72:6831","nonce":2806631742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":2806631742},{"type":"v1","addr":"172.21.15.72:6829","nonce":2806631742}]},"public_addr":"172.21.15.72:6819/2806631742","cluster_addr":"172.21.15.72:6827/2806631742","heartbeat_back_addr":"172.21.15.72:6831/2806631742","heartbeat_front_addr":"172.21.15.72:6829/2806631742","state":["exists","up"]},{"osd":4,"uuid":"9e985ef8-d711-4172-9286-c54e560895d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":4293536423},{"type":"v1","addr":"172.21.15.117:6825","nonce":4293536423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":4293536423},{"type":"v1","addr":"172.21.15.117:6827","nonce":4293536423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":4293536423},{"type":"v1","addr":"172.21.15.117:6831","nonce":4293536423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":4293536423},{"type":"v1","addr":"172.21.15.117:6829","nonce":4293536423}]},"public_addr":"172.21.15.117:6825/4293536423","cluster_addr":"172.21.15.117:6827/4293536423","heartbeat_back_addr":"172.21.15.117:6831/4293536423","heartbeat_front_addr":"172.21.15.117:6829/4293536423","state":["exists","up"]},{"osd":5,"uuid":"3e9f082b-8d7d-455f-8a96-66d0b4857125","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":684971679},{"type":"v1","addr":"172.21.15.117:6801","nonce":684971679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":684971679},{"type":"v1","addr":"172.21.15.117:6803","nonce":684971679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":684971679},{"type":"v1","addr":"172.21.15.117:6807","nonce":684971679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":684971679},{"type":"v1","addr":"172.21.15.117:6805","nonce":684971679}]},"public_addr":"172.21.15.117:6801/684971679","cluster_addr":"172.21.15.117:6803/684971679","heartbeat_back_addr":"172.21.15.117:6807/684971679","heartbeat_front_addr":"172.21.15.117:6805/684971679","state":["exists","up"]},{"osd":6,"uuid":"bcdafa9f-a870-4398-a38d-ab7697676473","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":2781186528},{"type":"v1","addr":"172.21.15.117:6809","nonce":2781186528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":2781186528},{"type":"v1","addr":"172.21.15.117:6811","nonce":2781186528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":2781186528},{"type":"v1","addr":"172.21.15.117:6815","nonce":2781186528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":2781186528},{"type":"v1","addr":"172.21.15.117:6813","nonce":2781186528}]},"public_addr":"172.21.15.117:6809/2781186528","cluster_addr":"172.21.15.117:6811/2781186528","heartbeat_back_addr":"172.21.15.117:6815/2781186528","heartbeat_front_addr":"172.21.15.117:6813/2781186528","state":["exists","up"]},{"osd":7,"uuid":"b68ec562-ff35-4d2d-a733-c896f8920cfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":617469882},{"type":"v1","addr":"172.21.15.117:6817","nonce":617469882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":617469882},{"type":"v1","addr":"172.21.15.117:6819","nonce":617469882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":617469882},{"type":"v1","addr":"172.21.15.117:6823","nonce":617469882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":617469882},{"type":"v1","addr":"172.21.15.117:6821","nonce":617469882}]},"public_addr":"172.21.15.117:6817/617469882","cluster_addr":"172.21.15.117:6819/617469882","heartbeat_back_addr":"172.21.15.117:6823/617469882","heartbeat_front_addr":"172.21.15.117:6821/617469882","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.347700+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.296619+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.361345+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.093323+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:12.857605+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:12.816090+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.083163+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.121639+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-04T06:56:32.993 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:32.994+0000 7fca88400640 1 -- 172.21.15.72:0/267926339 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fca6006c8f0 msgr2=0x7fca6006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:32.993 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:32.994+0000 7fca88400640 1 --2- 172.21.15.72:0/267926339 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fca6006c8f0 0x7fca6006edb0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fca801f7410 tx=0x7fca6c008040 comp rx=0 tx=0).stop 2024-04-04T06:56:32.993 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:32.994+0000 7fca88400640 1 -- 172.21.15.72:0/267926339 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fca800b9d10 msgr2=0x7fca8015a0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:32.993 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:32.994+0000 7fca88400640 1 --2- 172.21.15.72:0/267926339 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fca800b9d10 0x7fca8015a0e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fca74000c00 tx=0x7fca740046c0 comp rx=0 tx=0).stop 2024-04-04T06:56:32.993 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:32.994+0000 7fca88400640 1 -- 172.21.15.72:0/267926339 shutdown_connections 2024-04-04T06:56:32.993 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:32.994+0000 7fca88400640 1 --2- 172.21.15.72:0/267926339 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fca6006c8f0 0x7fca6006edb0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:32.993 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:32.994+0000 7fca88400640 1 --2- 172.21.15.72:0/267926339 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fca8015e590 0x7fca800c9fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:32.993 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:32.994+0000 7fca88400640 1 --2- 172.21.15.72:0/267926339 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fca800cf620 0x7fca800b2680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:32.993 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:32.994+0000 7fca88400640 1 --2- 172.21.15.72:0/267926339 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fca800b9d10 0x7fca8015a0e0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:32.993 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:32.994+0000 7fca88400640 1 -- 172.21.15.72:0/267926339 >> 172.21.15.72:0/267926339 conn(0x7fca800d0f70 msgr2=0x7fca800d2d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:56:32.993 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:32.994+0000 7fca88400640 1 -- 172.21.15.72:0/267926339 shutdown_connections 2024-04-04T06:56:32.993 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:32.994+0000 7fca88400640 1 -- 172.21.15.72:0/267926339 wait complete. 2024-04-04T06:56:33.012 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-04T06:56:33.013 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-04T06:56:33.210 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:33.211+0000 7faa4ce00640 1 Processor -- start 2024-04-04T06:56:33.210 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:33.211+0000 7faa4ce00640 1 -- start start 2024-04-04T06:56:33.211 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:33.213+0000 7faa4ce00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7faa480c5700 0x7faa480ce030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:33.212 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:33.213+0000 7faa4ce00640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faa480c5c00 con 0x7faa480d07d0 2024-04-04T06:56:33.212 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:33.213+0000 7faa4ce00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faa4815b980 con 0x7faa4815b230 2024-04-04T06:56:33.212 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:33.213+0000 7faa4ce00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7faa4815c2b0 con 0x7faa480c5700 2024-04-04T06:56:33.212 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:33.213+0000 7faa45400640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7faa480d07d0 0x7faa480c4ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:52584/0 (socket says 172.21.15.72:52584) 2024-04-04T06:56:33.212 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:33.213+0000 7faa45400640 1 -- 172.21.15.72:0/4155516458 learned_addr learned my addr 172.21.15.72:0/4155516458 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-04-04T06:56:33.214 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:33.213+0000 7faa46800640 1 --2- 172.21.15.72:0/4155516458 >> v2:172.21.15.117:3300/0 conn(0x7faa480c5700 0x7faa480ce030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:33.214 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:33.214+0000 7faa44a00640 1 -- 172.21.15.72:0/4155516458 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3832546746 0 0) 0x7faa480c5c00 con 0x7faa480d07d0 2024-04-04T06:56:33.214 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:33.214+0000 7faa44a00640 1 -- 172.21.15.72:0/4155516458 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faa2c003520 con 0x7faa480d07d0 2024-04-04T06:56:33.214 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:33.214+0000 7faa44a00640 1 -- 172.21.15.72:0/4155516458 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2259891780 0 0) 0x7faa2c003520 con 0x7faa480d07d0 2024-04-04T06:56:33.214 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:33.214+0000 7faa44a00640 1 -- 172.21.15.72:0/4155516458 >> v2:172.21.15.117:3300/0 conn(0x7faa480c5700 msgr2=0x7faa480ce030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:56:33.214 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:33.214+0000 7faa44a00640 1 --2- 172.21.15.72:0/4155516458 >> v2:172.21.15.117:3300/0 conn(0x7faa480c5700 0x7faa480ce030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:33.214 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:33.214+0000 7faa44a00640 1 -- 172.21.15.72:0/4155516458 >> v1:172.21.15.117:6789/0 conn(0x7faa4815b230 legacy=0x7faa480d00c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:33.214 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:33.214+0000 7faa44a00640 1 -- 172.21.15.72:0/4155516458 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa4815bc60 con 0x7faa480d07d0 2024-04-04T06:56:33.214 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:33.214+0000 7faa44a00640 1 -- 172.21.15.72:0/4155516458 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2465650867 0 0) 0x7faa34001670 con 0x7faa480d07d0 2024-04-04T06:56:33.214 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:33.214+0000 7faa44a00640 1 -- 172.21.15.72:0/4155516458 >> v1:172.21.15.72:6789/0 conn(0x7faa480d07d0 legacy=0x7faa480c4ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:33.214 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:33.214+0000 7faa44a00640 1 --2- 172.21.15.72:0/4155516458 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faa2c003a00 0x7faa2c003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:33.215 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:33.214+0000 7faa44a00640 1 --2- 172.21.15.72:0/4155516458 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faa2c004800 0x7faa2c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:33.215 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:33.214+0000 7faa44a00640 1 --2- 172.21.15.72:0/4155516458 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faa2c0051c0 0x7faa2c00dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:33.215 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:33.214+0000 7faa44a00640 1 -- 172.21.15.72:0/4155516458 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7faa4815c2b0 con 0x7faa2c0051c0 2024-04-04T06:56:33.215 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:33.214+0000 7faa44a00640 1 -- 172.21.15.72:0/4155516458 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7faa2c00e300 con 0x7faa2c003a00 2024-04-04T06:56:33.215 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:33.214+0000 7faa44a00640 1 -- 172.21.15.72:0/4155516458 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7faa2c00e500 con 0x7faa2c004800 2024-04-04T06:56:33.215 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:33.215+0000 7faa46800640 1 --2- 172.21.15.72:0/4155516458 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faa2c0051c0 0x7faa2c00dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:33.215 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:33.215+0000 7faa45400640 1 --2- 172.21.15.72:0/4155516458 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faa2c004800 0x7faa2c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:33.215 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:33.215+0000 7faa46800640 1 -- 172.21.15.72:0/4155516458 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faa2c004800 msgr2=0x7faa2c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:56:33.215 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:33.215+0000 7faa46800640 1 --2- 172.21.15.72:0/4155516458 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faa2c004800 0x7faa2c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:33.215 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:33.215+0000 7faa45e00640 1 --2- 172.21.15.72:0/4155516458 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faa2c003a00 0x7faa2c003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:33.215 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:33.215+0000 7faa46800640 1 -- 172.21.15.72:0/4155516458 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faa2c003a00 msgr2=0x7faa2c003e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:56:33.215 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:33.215+0000 7faa46800640 1 --2- 172.21.15.72:0/4155516458 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faa2c003a00 0x7faa2c003e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:33.215 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:33.215+0000 7faa46800640 1 -- 172.21.15.72:0/4155516458 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa2c003520 con 0x7faa2c0051c0 2024-04-04T06:56:33.216 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:33.216+0000 7faa46800640 1 -- 172.21.15.72:0/4155516458 reap_dead start 2024-04-04T06:56:33.217 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:33.216+0000 7faa46800640 1 --2- 172.21.15.72:0/4155516458 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faa2c0051c0 0x7faa2c00dbd0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7faa4806c300 tx=0x7faa2c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf9987df72eb76d4 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:33.217 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:33.216+0000 7faa44a00640 1 -- 172.21.15.72:0/4155516458 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa40039070 con 0x7faa2c0051c0 2024-04-04T06:56:33.217 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:33.216+0000 7faa44a00640 1 -- 172.21.15.72:0/4155516458 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa4002cbd0 con 0x7faa2c0051c0 2024-04-04T06:56:33.217 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:33.216+0000 7faa44a00640 1 -- 172.21.15.72:0/4155516458 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa40009c10 con 0x7faa2c0051c0 2024-04-04T06:56:33.217 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:33.217+0000 7faa4ce00640 1 -- 172.21.15.72:0/4155516458 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faa2c0051c0 msgr2=0x7faa2c00dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:33.217 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:33.217+0000 7faa4ce00640 1 --2- 172.21.15.72:0/4155516458 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faa2c0051c0 0x7faa2c00dbd0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7faa4806c300 tx=0x7faa2c005830 comp rx=0 tx=0).stop 2024-04-04T06:56:33.217 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:33.217+0000 7faa4ce00640 1 -- 172.21.15.72:0/4155516458 shutdown_connections 2024-04-04T06:56:33.217 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:33.217+0000 7faa4ce00640 1 --2- 172.21.15.72:0/4155516458 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faa2c0051c0 0x7faa2c00dbd0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:33.217 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:33.217+0000 7faa4ce00640 1 -- 172.21.15.72:0/4155516458 >> 172.21.15.72:0/4155516458 conn(0x7faa4806b470 msgr2=0x7faa4806b880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:56:33.217 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:33.217+0000 7faa4ce00640 1 -- 172.21.15.72:0/4155516458 shutdown_connections 2024-04-04T06:56:33.217 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:33.217+0000 7faa4ce00640 1 -- 172.21.15.72:0/4155516458 wait complete. 2024-04-04T06:56:33.218 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:33.219+0000 7faa4ce00640 1 Processor -- start 2024-04-04T06:56:33.218 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:33.219+0000 7faa4ce00640 1 -- start start 2024-04-04T06:56:33.219 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:33.220+0000 7faa4ce00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faa2c0051c0 0x7faa4814f850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:33.219 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:33.220+0000 7faa4ce00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faa4814ff00 0x7faa48150380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:33.220 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:33.220+0000 7faa4ce00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faa48072560 0x7faa480729e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:33.220 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:33.220+0000 7faa4ce00640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7faa480c4ff0 con 0x7faa48072560 2024-04-04T06:56:33.220 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:33.220+0000 7faa4ce00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7faa4815b610 con 0x7faa4814ff00 2024-04-04T06:56:33.220 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:33.220+0000 7faa4ce00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7faa480c5170 con 0x7faa2c0051c0 2024-04-04T06:56:33.220 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:33.220+0000 7faa46800640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faa48072560 0x7faa480729e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:33.220 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:33.220+0000 7faa46800640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faa48072560 0x7faa480729e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46010/0 (socket says 172.21.15.72:46010) 2024-04-04T06:56:33.220 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:33.220+0000 7faa46800640 1 -- 172.21.15.72:0/1813799067 learned_addr learned my addr 172.21.15.72:0/1813799067 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:56:33.220 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:33.220+0000 7faa45e00640 1 --2- 172.21.15.72:0/1813799067 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faa2c0051c0 0x7faa4814f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:33.220 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:33.220+0000 7faa45400640 1 --2- 172.21.15.72:0/1813799067 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faa4814ff00 0x7faa48150380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:33.220 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:33.220+0000 7faa46800640 1 -- 172.21.15.72:0/1813799067 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faa2c0051c0 msgr2=0x7faa4814f850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:33.220 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:33.220+0000 7faa46800640 1 --2- 172.21.15.72:0/1813799067 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faa2c0051c0 0x7faa4814f850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:33.220 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:33.220+0000 7faa46800640 1 -- 172.21.15.72:0/1813799067 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faa4814ff00 msgr2=0x7faa48150380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:33.220 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:33.220+0000 7faa46800640 1 --2- 172.21.15.72:0/1813799067 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faa4814ff00 0x7faa48150380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:33.220 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:33.220+0000 7faa46800640 1 -- 172.21.15.72:0/1813799067 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa4815dbe0 con 0x7faa48072560 2024-04-04T06:56:33.221 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:33.221+0000 7faa46800640 1 --2- 172.21.15.72:0/1813799067 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faa48072560 0x7faa480729e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7faa4000e200 tx=0x7faa40009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:33.221 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:33.221+0000 7faa3e000640 1 -- 172.21.15.72:0/1813799067 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa40039040 con 0x7faa48072560 2024-04-04T06:56:33.221 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:33.221+0000 7faa3e000640 1 -- 172.21.15.72:0/1813799067 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa40045070 con 0x7faa48072560 2024-04-04T06:56:33.221 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:33.221+0000 7faa3e000640 1 -- 172.21.15.72:0/1813799067 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa4003e6a0 con 0x7faa48072560 2024-04-04T06:56:33.221 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:33.221+0000 7faa4ce00640 1 -- 172.21.15.72:0/1813799067 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa4815e160 con 0x7faa48072560 2024-04-04T06:56:33.221 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:33.221+0000 7faa4ce00640 1 -- 172.21.15.72:0/1813799067 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa4815de80 con 0x7faa48072560 2024-04-04T06:56:33.221 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:33.222+0000 7faa4ce00640 1 -- 172.21.15.72:0/1813799067 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa48075000 con 0x7faa48072560 2024-04-04T06:56:33.222 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:33.224+0000 7faa3e000640 1 -- 172.21.15.72:0/1813799067 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7faa4003c070 con 0x7faa48072560 2024-04-04T06:56:33.223 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:33.225+0000 7faa3e000640 1 --2- 172.21.15.72:0/1813799067 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7faa2806c920 0x7faa2806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:33.224 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:33.225+0000 7faa3e000640 1 -- 172.21.15.72:0/1813799067 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7faa400adc40 con 0x7faa48072560 2024-04-04T06:56:33.224 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:33.225+0000 7faa45e00640 1 --2- 172.21.15.72:0/1813799067 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7faa2806c920 0x7faa2806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:33.224 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:33.226+0000 7faa45e00640 1 --2- 172.21.15.72:0/1813799067 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7faa2806c920 0x7faa2806ede0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7faa481f7a00 tx=0x7faa38009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:33.232 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:33.233+0000 7faa3e000640 1 -- 172.21.15.72:0/1813799067 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7faa48075000 con 0x7faa48072560 2024-04-04T06:56:33.538 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:33.540+0000 7faa4ce00640 1 -- 172.21.15.72:0/1813799067 --> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7faa48075840 con 0x7faa2806c920 2024-04-04T06:56:33.551 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:33.552+0000 7faa3e000640 1 -- 172.21.15.72:0/1813799067 <== mgr.4101 v2:172.21.15.72:6832/2205173820 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251948 (secure 0 0 0) 0x7faa48075840 con 0x7faa2806c920 2024-04-04T06:56:33.555 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T06:56:33.556 INFO:teuthology.orchestra.run.smithi072.stderr:dumped all 2024-04-04T06:56:33.558 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:33.557+0000 7faa4ce00640 1 -- 172.21.15.72:0/1813799067 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7faa2806c920 msgr2=0x7faa2806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:33.558 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:33.557+0000 7faa4ce00640 1 --2- 172.21.15.72:0/1813799067 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7faa2806c920 0x7faa2806ede0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7faa481f7a00 tx=0x7faa38009040 comp rx=0 tx=0).stop 2024-04-04T06:56:33.558 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:33.557+0000 7faa4ce00640 1 -- 172.21.15.72:0/1813799067 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faa48072560 msgr2=0x7faa480729e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:33.558 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:33.557+0000 7faa4ce00640 1 --2- 172.21.15.72:0/1813799067 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faa48072560 0x7faa480729e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7faa4000e200 tx=0x7faa40009750 comp rx=0 tx=0).stop 2024-04-04T06:56:33.558 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:33.557+0000 7faa4ce00640 1 -- 172.21.15.72:0/1813799067 shutdown_connections 2024-04-04T06:56:33.558 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:33.557+0000 7faa4ce00640 1 --2- 172.21.15.72:0/1813799067 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7faa2806c920 0x7faa2806ede0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:33.558 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:33.557+0000 7faa4ce00640 1 --2- 172.21.15.72:0/1813799067 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faa48072560 0x7faa480729e0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:33.558 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:33.557+0000 7faa4ce00640 1 --2- 172.21.15.72:0/1813799067 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faa4814ff00 0x7faa48150380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:33.558 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:33.557+0000 7faa4ce00640 1 --2- 172.21.15.72:0/1813799067 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faa2c0051c0 0x7faa4814f850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:33.558 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:33.557+0000 7faa4ce00640 1 -- 172.21.15.72:0/1813799067 >> 172.21.15.72:0/1813799067 conn(0x7faa4806b470 msgr2=0x7faa4806b850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:56:33.558 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:33.557+0000 7faa4ce00640 1 -- 172.21.15.72:0/1813799067 shutdown_connections 2024-04-04T06:56:33.558 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:33.557+0000 7faa4ce00640 1 -- 172.21.15.72:0/1813799067 wait complete. 2024-04-04T06:56:33.574 INFO:teuthology.orchestra.run.smithi072.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-04-04T06:56:33.388496+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":185,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218996,"kb_used_data":2824,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755724,"statfs":{"total":773094113280,"available":772869861376,"internally_reserved":0,"allocated":2891776,"data_stored":1753028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":43,"apply_latency_ms":43,"commit_latency_ns":43000000,"apply_latency_ns":43000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001941"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.021316+0000","last_change":"2024-04-04T06:56:29.041884+0000","last_active":"2024-04-04T06:56:30.021316+0000","last_peered":"2024-04-04T06:56:30.021316+0000","last_clean":"2024-04-04T06:56:30.021316+0000","last_became_active":"2024-04-04T06:56:29.041589+0000","last_became_peered":"2024-04-04T06:56:29.041589+0000","last_unstale":"2024-04-04T06:56:30.021316+0000","last_undegraded":"2024-04-04T06:56:30.021316+0000","last_fullsized":"2024-04-04T06:56:30.021316+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T17:09:54.896779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.016096+0000","last_change":"2024-04-04T06:56:29.044652+0000","last_active":"2024-04-04T06:56:30.016096+0000","last_peered":"2024-04-04T06:56:30.016096+0000","last_clean":"2024-04-04T06:56:30.016096+0000","last_became_active":"2024-04-04T06:56:29.044287+0000","last_became_peered":"2024-04-04T06:56:29.044287+0000","last_unstale":"2024-04-04T06:56:30.016096+0000","last_undegraded":"2024-04-04T06:56:30.016096+0000","last_fullsized":"2024-04-04T06:56:30.016096+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T16:44:39.332035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.698416+0000","last_change":"2024-04-04T06:56:29.044464+0000","last_active":"2024-04-04T06:56:30.698416+0000","last_peered":"2024-04-04T06:56:30.698416+0000","last_clean":"2024-04-04T06:56:30.698416+0000","last_became_active":"2024-04-04T06:56:29.044200+0000","last_became_peered":"2024-04-04T06:56:29.044200+0000","last_unstale":"2024-04-04T06:56:30.698416+0000","last_undegraded":"2024-04-04T06:56:30.698416+0000","last_fullsized":"2024-04-04T06:56:30.698416+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T15:25:18.489701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.698540+0000","last_change":"2024-04-04T06:56:29.058211+0000","last_active":"2024-04-04T06:56:30.698540+0000","last_peered":"2024-04-04T06:56:30.698540+0000","last_clean":"2024-04-04T06:56:30.698540+0000","last_became_active":"2024-04-04T06:56:29.057931+0000","last_became_peered":"2024-04-04T06:56:29.057931+0000","last_unstale":"2024-04-04T06:56:30.698540+0000","last_undegraded":"2024-04-04T06:56:30.698540+0000","last_fullsized":"2024-04-04T06:56:30.698540+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T17:04:57.682659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.020954+0000","last_change":"2024-04-04T06:56:29.043939+0000","last_active":"2024-04-04T06:56:30.020954+0000","last_peered":"2024-04-04T06:56:30.020954+0000","last_clean":"2024-04-04T06:56:30.020954+0000","last_became_active":"2024-04-04T06:56:29.043646+0000","last_became_peered":"2024-04-04T06:56:29.043646+0000","last_unstale":"2024-04-04T06:56:30.020954+0000","last_undegraded":"2024-04-04T06:56:30.020954+0000","last_fullsized":"2024-04-04T06:56:30.020954+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T18:38:49.851932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.698199+0000","last_change":"2024-04-04T06:56:29.036398+0000","last_active":"2024-04-04T06:56:30.698199+0000","last_peered":"2024-04-04T06:56:30.698199+0000","last_clean":"2024-04-04T06:56:30.698199+0000","last_became_active":"2024-04-04T06:56:29.036119+0000","last_became_peered":"2024-04-04T06:56:29.036119+0000","last_unstale":"2024-04-04T06:56:30.698199+0000","last_undegraded":"2024-04-04T06:56:30.698199+0000","last_fullsized":"2024-04-04T06:56:30.698199+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T12:11:26.884771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.018127+0000","last_change":"2024-04-04T06:56:29.033491+0000","last_active":"2024-04-04T06:56:30.018127+0000","last_peered":"2024-04-04T06:56:30.018127+0000","last_clean":"2024-04-04T06:56:30.018127+0000","last_became_active":"2024-04-04T06:56:29.033159+0000","last_became_peered":"2024-04-04T06:56:29.033159+0000","last_unstale":"2024-04-04T06:56:30.018127+0000","last_undegraded":"2024-04-04T06:56:30.018127+0000","last_fullsized":"2024-04-04T06:56:30.018127+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T17:04:57.682659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.701021+0000","last_change":"2024-04-04T06:56:29.058473+0000","last_active":"2024-04-04T06:56:30.701021+0000","last_peered":"2024-04-04T06:56:30.701021+0000","last_clean":"2024-04-04T06:56:30.701021+0000","last_became_active":"2024-04-04T06:56:29.057579+0000","last_became_peered":"2024-04-04T06:56:29.057579+0000","last_unstale":"2024-04-04T06:56:30.701021+0000","last_undegraded":"2024-04-04T06:56:30.701021+0000","last_fullsized":"2024-04-04T06:56:30.701021+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T15:25:18.489701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.021435+0000","last_change":"2024-04-04T06:56:29.036872+0000","last_active":"2024-04-04T06:56:30.021435+0000","last_peered":"2024-04-04T06:56:30.021435+0000","last_clean":"2024-04-04T06:56:30.021435+0000","last_became_active":"2024-04-04T06:56:29.035533+0000","last_became_peered":"2024-04-04T06:56:29.035533+0000","last_unstale":"2024-04-04T06:56:30.021435+0000","last_undegraded":"2024-04-04T06:56:30.021435+0000","last_fullsized":"2024-04-04T06:56:30.021435+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T09:03:00.078302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.062681+0000","last_change":"2024-04-04T06:56:29.048015+0000","last_active":"2024-04-04T06:56:30.062681+0000","last_peered":"2024-04-04T06:56:30.062681+0000","last_clean":"2024-04-04T06:56:30.062681+0000","last_became_active":"2024-04-04T06:56:29.047193+0000","last_became_peered":"2024-04-04T06:56:29.047193+0000","last_unstale":"2024-04-04T06:56:30.062681+0000","last_undegraded":"2024-04-04T06:56:30.062681+0000","last_fullsized":"2024-04-04T06:56:30.062681+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T12:11:26.884771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.062555+0000","last_change":"2024-04-04T06:56:29.048692+0000","last_active":"2024-04-04T06:56:30.062555+0000","last_peered":"2024-04-04T06:56:30.062555+0000","last_clean":"2024-04-04T06:56:30.062555+0000","last_became_active":"2024-04-04T06:56:29.048370+0000","last_became_peered":"2024-04-04T06:56:29.048370+0000","last_unstale":"2024-04-04T06:56:30.062555+0000","last_undegraded":"2024-04-04T06:56:30.062555+0000","last_fullsized":"2024-04-04T06:56:30.062555+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T08:11:58.552420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.019591+0000","last_change":"2024-04-04T06:56:29.043832+0000","last_active":"2024-04-04T06:56:30.019591+0000","last_peered":"2024-04-04T06:56:30.019591+0000","last_clean":"2024-04-04T06:56:30.019591+0000","last_became_active":"2024-04-04T06:56:29.043483+0000","last_became_peered":"2024-04-04T06:56:29.043483+0000","last_unstale":"2024-04-04T06:56:30.019591+0000","last_undegraded":"2024-04-04T06:56:30.019591+0000","last_fullsized":"2024-04-04T06:56:30.019591+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T16:54:06.987375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.701295+0000","last_change":"2024-04-04T06:56:29.051626+0000","last_active":"2024-04-04T06:56:30.701295+0000","last_peered":"2024-04-04T06:56:30.701295+0000","last_clean":"2024-04-04T06:56:30.701295+0000","last_became_active":"2024-04-04T06:56:29.051241+0000","last_became_peered":"2024-04-04T06:56:29.051241+0000","last_unstale":"2024-04-04T06:56:30.701295+0000","last_undegraded":"2024-04-04T06:56:30.701295+0000","last_fullsized":"2024-04-04T06:56:30.701295+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T13:04:16.108138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.698067+0000","last_change":"2024-04-04T06:56:29.042853+0000","last_active":"2024-04-04T06:56:30.698067+0000","last_peered":"2024-04-04T06:56:30.698067+0000","last_clean":"2024-04-04T06:56:30.698067+0000","last_became_active":"2024-04-04T06:56:29.041487+0000","last_became_peered":"2024-04-04T06:56:29.041487+0000","last_unstale":"2024-04-04T06:56:30.698067+0000","last_undegraded":"2024-04-04T06:56:30.698067+0000","last_fullsized":"2024-04-04T06:56:30.698067+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T17:11:13.036810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.015396+0000","last_change":"2024-04-04T06:56:29.043554+0000","last_active":"2024-04-04T06:56:30.015396+0000","last_peered":"2024-04-04T06:56:30.015396+0000","last_clean":"2024-04-04T06:56:30.015396+0000","last_became_active":"2024-04-04T06:56:29.043300+0000","last_became_peered":"2024-04-04T06:56:29.043300+0000","last_unstale":"2024-04-04T06:56:30.015396+0000","last_undegraded":"2024-04-04T06:56:30.015396+0000","last_fullsized":"2024-04-04T06:56:30.015396+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T15:25:18.489701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.698063+0000","last_change":"2024-04-04T06:56:29.038506+0000","last_active":"2024-04-04T06:56:30.698063+0000","last_peered":"2024-04-04T06:56:30.698063+0000","last_clean":"2024-04-04T06:56:30.698063+0000","last_became_active":"2024-04-04T06:56:29.038150+0000","last_became_peered":"2024-04-04T06:56:29.038150+0000","last_unstale":"2024-04-04T06:56:30.698063+0000","last_undegraded":"2024-04-04T06:56:30.698063+0000","last_fullsized":"2024-04-04T06:56:30.698063+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T16:44:39.332035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.699391+0000","last_change":"2024-04-04T06:56:29.049923+0000","last_active":"2024-04-04T06:56:30.699391+0000","last_peered":"2024-04-04T06:56:30.699391+0000","last_clean":"2024-04-04T06:56:30.699391+0000","last_became_active":"2024-04-04T06:56:29.049658+0000","last_became_peered":"2024-04-04T06:56:29.049658+0000","last_unstale":"2024-04-04T06:56:30.699391+0000","last_undegraded":"2024-04-04T06:56:30.699391+0000","last_fullsized":"2024-04-04T06:56:30.699391+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T09:03:00.078302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.697501+0000","last_change":"2024-04-04T06:56:29.042470+0000","last_active":"2024-04-04T06:56:30.697501+0000","last_peered":"2024-04-04T06:56:30.697501+0000","last_clean":"2024-04-04T06:56:30.697501+0000","last_became_active":"2024-04-04T06:56:29.041885+0000","last_became_peered":"2024-04-04T06:56:29.041885+0000","last_unstale":"2024-04-04T06:56:30.697501+0000","last_undegraded":"2024-04-04T06:56:30.697501+0000","last_fullsized":"2024-04-04T06:56:30.697501+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T12:35:21.057399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.021811+0000","last_change":"2024-04-04T06:56:29.042854+0000","last_active":"2024-04-04T06:56:30.021811+0000","last_peered":"2024-04-04T06:56:30.021811+0000","last_clean":"2024-04-04T06:56:30.021811+0000","last_became_active":"2024-04-04T06:56:29.042590+0000","last_became_peered":"2024-04-04T06:56:29.042590+0000","last_unstale":"2024-04-04T06:56:30.021811+0000","last_undegraded":"2024-04-04T06:56:30.021811+0000","last_fullsized":"2024-04-04T06:56:30.021811+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T18:19:42.642201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.062254+0000","last_change":"2024-04-04T06:56:29.051612+0000","last_active":"2024-04-04T06:56:30.062254+0000","last_peered":"2024-04-04T06:56:30.062254+0000","last_clean":"2024-04-04T06:56:30.062254+0000","last_became_active":"2024-04-04T06:56:29.051315+0000","last_became_peered":"2024-04-04T06:56:29.051315+0000","last_unstale":"2024-04-04T06:56:30.062254+0000","last_undegraded":"2024-04-04T06:56:30.062254+0000","last_fullsized":"2024-04-04T06:56:30.062254+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T13:04:16.108138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.698320+0000","last_change":"2024-04-04T06:56:29.038247+0000","last_active":"2024-04-04T06:56:30.698320+0000","last_peered":"2024-04-04T06:56:30.698320+0000","last_clean":"2024-04-04T06:56:30.698320+0000","last_became_active":"2024-04-04T06:56:29.037756+0000","last_became_peered":"2024-04-04T06:56:29.037756+0000","last_unstale":"2024-04-04T06:56:30.698320+0000","last_undegraded":"2024-04-04T06:56:30.698320+0000","last_fullsized":"2024-04-04T06:56:30.698320+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T10:40:36.659855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.698776+0000","last_change":"2024-04-04T06:56:29.048171+0000","last_active":"2024-04-04T06:56:30.698776+0000","last_peered":"2024-04-04T06:56:30.698776+0000","last_clean":"2024-04-04T06:56:30.698776+0000","last_became_active":"2024-04-04T06:56:29.045845+0000","last_became_peered":"2024-04-04T06:56:29.045845+0000","last_unstale":"2024-04-04T06:56:30.698776+0000","last_undegraded":"2024-04-04T06:56:30.698776+0000","last_fullsized":"2024-04-04T06:56:30.698776+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T08:09:51.101974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.701153+0000","last_change":"2024-04-04T06:56:29.051157+0000","last_active":"2024-04-04T06:56:30.701153+0000","last_peered":"2024-04-04T06:56:30.701153+0000","last_clean":"2024-04-04T06:56:30.701153+0000","last_became_active":"2024-04-04T06:56:29.050862+0000","last_became_peered":"2024-04-04T06:56:29.050862+0000","last_unstale":"2024-04-04T06:56:30.701153+0000","last_undegraded":"2024-04-04T06:56:30.701153+0000","last_fullsized":"2024-04-04T06:56:30.701153+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T10:04:08.170276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.699292+0000","last_change":"2024-04-04T06:56:29.052206+0000","last_active":"2024-04-04T06:56:30.699292+0000","last_peered":"2024-04-04T06:56:30.699292+0000","last_clean":"2024-04-04T06:56:30.699292+0000","last_became_active":"2024-04-04T06:56:29.051882+0000","last_became_peered":"2024-04-04T06:56:29.051882+0000","last_unstale":"2024-04-04T06:56:30.699292+0000","last_undegraded":"2024-04-04T06:56:30.699292+0000","last_fullsized":"2024-04-04T06:56:30.699292+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T17:09:54.896779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.701636+0000","last_change":"2024-04-04T06:56:29.052181+0000","last_active":"2024-04-04T06:56:30.701636+0000","last_peered":"2024-04-04T06:56:30.701636+0000","last_clean":"2024-04-04T06:56:30.701636+0000","last_became_active":"2024-04-04T06:56:29.052011+0000","last_became_peered":"2024-04-04T06:56:29.052011+0000","last_unstale":"2024-04-04T06:56:30.701636+0000","last_undegraded":"2024-04-04T06:56:30.701636+0000","last_fullsized":"2024-04-04T06:56:30.701636+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T18:13:03.204979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.062644+0000","last_change":"2024-04-04T06:56:29.050650+0000","last_active":"2024-04-04T06:56:30.062644+0000","last_peered":"2024-04-04T06:56:30.062644+0000","last_clean":"2024-04-04T06:56:30.062644+0000","last_became_active":"2024-04-04T06:56:29.050382+0000","last_became_peered":"2024-04-04T06:56:29.050382+0000","last_unstale":"2024-04-04T06:56:30.062644+0000","last_undegraded":"2024-04-04T06:56:30.062644+0000","last_fullsized":"2024-04-04T06:56:30.062644+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T16:44:39.332035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.016177+0000","last_change":"2024-04-04T06:56:29.058438+0000","last_active":"2024-04-04T06:56:30.016177+0000","last_peered":"2024-04-04T06:56:30.016177+0000","last_clean":"2024-04-04T06:56:30.016177+0000","last_became_active":"2024-04-04T06:56:29.058155+0000","last_became_peered":"2024-04-04T06:56:29.058155+0000","last_unstale":"2024-04-04T06:56:30.016177+0000","last_undegraded":"2024-04-04T06:56:30.016177+0000","last_fullsized":"2024-04-04T06:56:30.016177+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T12:11:26.884771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.701823+0000","last_change":"2024-04-04T06:56:29.055605+0000","last_active":"2024-04-04T06:56:30.701823+0000","last_peered":"2024-04-04T06:56:30.701823+0000","last_clean":"2024-04-04T06:56:30.701823+0000","last_became_active":"2024-04-04T06:56:29.052573+0000","last_became_peered":"2024-04-04T06:56:29.052573+0000","last_unstale":"2024-04-04T06:56:30.701823+0000","last_undegraded":"2024-04-04T06:56:30.701823+0000","last_fullsized":"2024-04-04T06:56:30.701823+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T08:09:51.101974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.698490+0000","last_change":"2024-04-04T06:56:29.054105+0000","last_active":"2024-04-04T06:56:30.698490+0000","last_peered":"2024-04-04T06:56:30.698490+0000","last_clean":"2024-04-04T06:56:30.698490+0000","last_became_active":"2024-04-04T06:56:29.053803+0000","last_became_peered":"2024-04-04T06:56:29.053803+0000","last_unstale":"2024-04-04T06:56:30.698490+0000","last_undegraded":"2024-04-04T06:56:30.698490+0000","last_fullsized":"2024-04-04T06:56:30.698490+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T10:04:08.170276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.698508+0000","last_change":"2024-04-04T06:56:29.058755+0000","last_active":"2024-04-04T06:56:30.698508+0000","last_peered":"2024-04-04T06:56:30.698508+0000","last_clean":"2024-04-04T06:56:30.698508+0000","last_became_active":"2024-04-04T06:56:29.058413+0000","last_became_peered":"2024-04-04T06:56:29.058413+0000","last_unstale":"2024-04-04T06:56:30.698508+0000","last_undegraded":"2024-04-04T06:56:30.698508+0000","last_fullsized":"2024-04-04T06:56:30.698508+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T18:13:03.204979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.697222+0000","last_change":"2024-04-04T06:56:29.047614+0000","last_active":"2024-04-04T06:56:30.697222+0000","last_peered":"2024-04-04T06:56:30.697222+0000","last_clean":"2024-04-04T06:56:30.697222+0000","last_became_active":"2024-04-04T06:56:29.047371+0000","last_became_peered":"2024-04-04T06:56:29.047371+0000","last_unstale":"2024-04-04T06:56:30.697222+0000","last_undegraded":"2024-04-04T06:56:30.697222+0000","last_fullsized":"2024-04-04T06:56:30.697222+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T15:15:24.660634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.061901+0000","last_change":"2024-04-04T06:56:29.052722+0000","last_active":"2024-04-04T06:56:30.061901+0000","last_peered":"2024-04-04T06:56:30.061901+0000","last_clean":"2024-04-04T06:56:30.061901+0000","last_became_active":"2024-04-04T06:56:29.052245+0000","last_became_peered":"2024-04-04T06:56:29.052245+0000","last_unstale":"2024-04-04T06:56:30.061901+0000","last_undegraded":"2024-04-04T06:56:30.061901+0000","last_fullsized":"2024-04-04T06:56:30.061901+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T15:25:18.489701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.019151+0000","last_change":"2024-04-04T06:56:29.042686+0000","last_active":"2024-04-04T06:56:30.019151+0000","last_peered":"2024-04-04T06:56:30.019151+0000","last_clean":"2024-04-04T06:56:30.019151+0000","last_became_active":"2024-04-04T06:56:29.042124+0000","last_became_peered":"2024-04-04T06:56:29.042124+0000","last_unstale":"2024-04-04T06:56:30.019151+0000","last_undegraded":"2024-04-04T06:56:30.019151+0000","last_fullsized":"2024-04-04T06:56:30.019151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T13:32:45.903109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.701378+0000","last_change":"2024-04-04T06:56:28.001896+0000","last_active":"2024-04-04T06:56:30.701378+0000","last_peered":"2024-04-04T06:56:30.701378+0000","last_clean":"2024-04-04T06:56:30.701378+0000","last_became_active":"2024-04-04T06:56:28.001625+0000","last_became_peered":"2024-04-04T06:56:28.001625+0000","last_unstale":"2024-04-04T06:56:30.701378+0000","last_undegraded":"2024-04-04T06:56:30.701378+0000","last_fullsized":"2024-04-04T06:56:30.701378+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_clean_scrub_stamp":"2024-04-04T06:56:26.956814+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T13:33:08.840819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.698738+0000","last_change":"2024-04-04T06:56:29.031379+0000","last_active":"2024-04-04T06:56:30.698738+0000","last_peered":"2024-04-04T06:56:30.698738+0000","last_clean":"2024-04-04T06:56:30.698738+0000","last_became_active":"2024-04-04T06:56:29.028243+0000","last_became_peered":"2024-04-04T06:56:29.028243+0000","last_unstale":"2024-04-04T06:56:30.698738+0000","last_undegraded":"2024-04-04T06:56:30.698738+0000","last_fullsized":"2024-04-04T06:56:30.698738+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T08:11:58.552420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.061880+0000","last_change":"2024-04-04T06:56:28.012107+0000","last_active":"2024-04-04T06:56:30.061880+0000","last_peered":"2024-04-04T06:56:30.061880+0000","last_clean":"2024-04-04T06:56:30.061880+0000","last_became_active":"2024-04-04T06:56:28.011477+0000","last_became_peered":"2024-04-04T06:56:28.011477+0000","last_unstale":"2024-04-04T06:56:30.061880+0000","last_undegraded":"2024-04-04T06:56:30.061880+0000","last_fullsized":"2024-04-04T06:56:30.061880+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_clean_scrub_stamp":"2024-04-04T06:56:26.956814+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T16:13:09.520714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.700896+0000","last_change":"2024-04-04T06:56:28.013179+0000","last_active":"2024-04-04T06:56:30.700896+0000","last_peered":"2024-04-04T06:56:30.700896+0000","last_clean":"2024-04-04T06:56:30.700896+0000","last_became_active":"2024-04-04T06:56:28.012858+0000","last_became_peered":"2024-04-04T06:56:28.012858+0000","last_unstale":"2024-04-04T06:56:30.700896+0000","last_undegraded":"2024-04-04T06:56:30.700896+0000","last_fullsized":"2024-04-04T06:56:30.700896+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_clean_scrub_stamp":"2024-04-04T06:56:26.956814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T13:47:51.595456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.700825+0000","last_change":"2024-04-04T06:56:29.058027+0000","last_active":"2024-04-04T06:56:30.700825+0000","last_peered":"2024-04-04T06:56:30.700825+0000","last_clean":"2024-04-04T06:56:30.700825+0000","last_became_active":"2024-04-04T06:56:29.055298+0000","last_became_peered":"2024-04-04T06:56:29.055298+0000","last_unstale":"2024-04-04T06:56:30.700825+0000","last_undegraded":"2024-04-04T06:56:30.700825+0000","last_fullsized":"2024-04-04T06:56:30.700825+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T18:01:37.763615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.698254+0000","last_change":"2024-04-04T06:56:28.007500+0000","last_active":"2024-04-04T06:56:30.698254+0000","last_peered":"2024-04-04T06:56:30.698254+0000","last_clean":"2024-04-04T06:56:30.698254+0000","last_became_active":"2024-04-04T06:56:28.007056+0000","last_became_peered":"2024-04-04T06:56:28.007056+0000","last_unstale":"2024-04-04T06:56:30.698254+0000","last_undegraded":"2024-04-04T06:56:30.698254+0000","last_fullsized":"2024-04-04T06:56:30.698254+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_clean_scrub_stamp":"2024-04-04T06:56:26.956814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T09:54:19.792854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.015421+0000","last_change":"2024-04-04T06:56:29.067716+0000","last_active":"2024-04-04T06:56:30.015421+0000","last_peered":"2024-04-04T06:56:30.015421+0000","last_clean":"2024-04-04T06:56:30.015421+0000","last_became_active":"2024-04-04T06:56:29.067142+0000","last_became_peered":"2024-04-04T06:56:29.067142+0000","last_unstale":"2024-04-04T06:56:30.015421+0000","last_undegraded":"2024-04-04T06:56:30.015421+0000","last_fullsized":"2024-04-04T06:56:30.015421+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T10:04:08.170276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.062468+0000","last_change":"2024-04-04T06:56:28.015953+0000","last_active":"2024-04-04T06:56:30.062468+0000","last_peered":"2024-04-04T06:56:30.062468+0000","last_clean":"2024-04-04T06:56:30.062468+0000","last_became_active":"2024-04-04T06:56:28.015699+0000","last_became_peered":"2024-04-04T06:56:28.015699+0000","last_unstale":"2024-04-04T06:56:30.062468+0000","last_undegraded":"2024-04-04T06:56:30.062468+0000","last_fullsized":"2024-04-04T06:56:30.062468+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_clean_scrub_stamp":"2024-04-04T06:56:26.956814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T08:38:32.735117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.698943+0000","last_change":"2024-04-04T06:56:29.046517+0000","last_active":"2024-04-04T06:56:30.698943+0000","last_peered":"2024-04-04T06:56:30.698943+0000","last_clean":"2024-04-04T06:56:30.698943+0000","last_became_active":"2024-04-04T06:56:29.046107+0000","last_became_peered":"2024-04-04T06:56:29.046107+0000","last_unstale":"2024-04-04T06:56:30.698943+0000","last_undegraded":"2024-04-04T06:56:30.698943+0000","last_fullsized":"2024-04-04T06:56:30.698943+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T12:03:12.792963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.699100+0000","last_change":"2024-04-04T06:56:28.019198+0000","last_active":"2024-04-04T06:56:30.699100+0000","last_peered":"2024-04-04T06:56:30.699100+0000","last_clean":"2024-04-04T06:56:30.699100+0000","last_became_active":"2024-04-04T06:56:28.018911+0000","last_became_peered":"2024-04-04T06:56:28.018911+0000","last_unstale":"2024-04-04T06:56:30.699100+0000","last_undegraded":"2024-04-04T06:56:30.699100+0000","last_fullsized":"2024-04-04T06:56:30.699100+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_clean_scrub_stamp":"2024-04-04T06:56:26.956814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T15:15:23.654438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.699396+0000","last_change":"2024-04-04T06:56:29.049229+0000","last_active":"2024-04-04T06:56:30.699396+0000","last_peered":"2024-04-04T06:56:30.699396+0000","last_clean":"2024-04-04T06:56:30.699396+0000","last_became_active":"2024-04-04T06:56:29.048110+0000","last_became_peered":"2024-04-04T06:56:29.048110+0000","last_unstale":"2024-04-04T06:56:30.699396+0000","last_undegraded":"2024-04-04T06:56:30.699396+0000","last_fullsized":"2024-04-04T06:56:30.699396+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T12:11:26.884771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.015873+0000","last_change":"2024-04-04T06:56:28.009331+0000","last_active":"2024-04-04T06:56:30.015873+0000","last_peered":"2024-04-04T06:56:30.015873+0000","last_clean":"2024-04-04T06:56:30.015873+0000","last_became_active":"2024-04-04T06:56:28.009044+0000","last_became_peered":"2024-04-04T06:56:28.009044+0000","last_unstale":"2024-04-04T06:56:30.015873+0000","last_undegraded":"2024-04-04T06:56:30.015873+0000","last_fullsized":"2024-04-04T06:56:30.015873+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_clean_scrub_stamp":"2024-04-04T06:56:26.956814+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T08:38:32.735117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.019776+0000","last_change":"2024-04-04T06:56:29.037028+0000","last_active":"2024-04-04T06:56:30.019776+0000","last_peered":"2024-04-04T06:56:30.019776+0000","last_clean":"2024-04-04T06:56:30.019776+0000","last_became_active":"2024-04-04T06:56:29.036771+0000","last_became_peered":"2024-04-04T06:56:29.036771+0000","last_unstale":"2024-04-04T06:56:30.019776+0000","last_undegraded":"2024-04-04T06:56:30.019776+0000","last_fullsized":"2024-04-04T06:56:30.019776+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T15:15:24.660634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.062098+0000","last_change":"2024-04-04T06:56:28.017650+0000","last_active":"2024-04-04T06:56:30.062098+0000","last_peered":"2024-04-04T06:56:30.062098+0000","last_clean":"2024-04-04T06:56:30.062098+0000","last_became_active":"2024-04-04T06:56:28.017083+0000","last_became_peered":"2024-04-04T06:56:28.017083+0000","last_unstale":"2024-04-04T06:56:30.062098+0000","last_undegraded":"2024-04-04T06:56:30.062098+0000","last_fullsized":"2024-04-04T06:56:30.062098+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_clean_scrub_stamp":"2024-04-04T06:56:26.956814+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T09:54:19.792854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.018695+0000","last_change":"2024-04-04T06:56:29.053241+0000","last_active":"2024-04-04T06:56:30.018695+0000","last_peered":"2024-04-04T06:56:30.018695+0000","last_clean":"2024-04-04T06:56:30.018695+0000","last_became_active":"2024-04-04T06:56:29.052948+0000","last_became_peered":"2024-04-04T06:56:29.052948+0000","last_unstale":"2024-04-04T06:56:30.018695+0000","last_undegraded":"2024-04-04T06:56:30.018695+0000","last_fullsized":"2024-04-04T06:56:30.018695+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T08:09:51.101974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.698548+0000","last_change":"2024-04-04T06:56:27.997550+0000","last_active":"2024-04-04T06:56:30.698548+0000","last_peered":"2024-04-04T06:56:30.698548+0000","last_clean":"2024-04-04T06:56:30.698548+0000","last_became_active":"2024-04-04T06:56:27.997242+0000","last_became_peered":"2024-04-04T06:56:27.997242+0000","last_unstale":"2024-04-04T06:56:30.698548+0000","last_undegraded":"2024-04-04T06:56:30.698548+0000","last_fullsized":"2024-04-04T06:56:30.698548+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_clean_scrub_stamp":"2024-04-04T06:56:26.956814+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T13:33:08.840819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.698091+0000","last_change":"2024-04-04T06:56:29.044039+0000","last_active":"2024-04-04T06:56:30.698091+0000","last_peered":"2024-04-04T06:56:30.698091+0000","last_clean":"2024-04-04T06:56:30.698091+0000","last_became_active":"2024-04-04T06:56:29.043302+0000","last_became_peered":"2024-04-04T06:56:29.043302+0000","last_unstale":"2024-04-04T06:56:30.698091+0000","last_undegraded":"2024-04-04T06:56:30.698091+0000","last_fullsized":"2024-04-04T06:56:30.698091+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T18:01:37.763615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.698610+0000","last_change":"2024-04-04T06:56:28.014841+0000","last_active":"2024-04-04T06:56:30.698610+0000","last_peered":"2024-04-04T06:56:30.698610+0000","last_clean":"2024-04-04T06:56:30.698610+0000","last_became_active":"2024-04-04T06:56:28.011606+0000","last_became_peered":"2024-04-04T06:56:28.011606+0000","last_unstale":"2024-04-04T06:56:30.698610+0000","last_undegraded":"2024-04-04T06:56:30.698610+0000","last_fullsized":"2024-04-04T06:56:30.698610+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_clean_scrub_stamp":"2024-04-04T06:56:26.956814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T13:32:44.896913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.021248+0000","last_change":"2024-04-04T06:56:29.035188+0000","last_active":"2024-04-04T06:56:30.021248+0000","last_peered":"2024-04-04T06:56:30.021248+0000","last_clean":"2024-04-04T06:56:30.021248+0000","last_became_active":"2024-04-04T06:56:29.034915+0000","last_became_peered":"2024-04-04T06:56:29.034915+0000","last_unstale":"2024-04-04T06:56:30.021248+0000","last_undegraded":"2024-04-04T06:56:30.021248+0000","last_fullsized":"2024-04-04T06:56:30.021248+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T16:01:05.840859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.061612+0000","last_change":"2024-04-04T06:56:28.016246+0000","last_active":"2024-04-04T06:56:30.061612+0000","last_peered":"2024-04-04T06:56:30.061612+0000","last_clean":"2024-04-04T06:56:30.061612+0000","last_became_active":"2024-04-04T06:56:28.014193+0000","last_became_peered":"2024-04-04T06:56:28.014193+0000","last_unstale":"2024-04-04T06:56:30.061612+0000","last_undegraded":"2024-04-04T06:56:30.061612+0000","last_fullsized":"2024-04-04T06:56:30.061612+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_clean_scrub_stamp":"2024-04-04T06:56:26.956814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T10:18:31.915978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.061865+0000","last_change":"2024-04-04T06:56:29.052430+0000","last_active":"2024-04-04T06:56:30.061865+0000","last_peered":"2024-04-04T06:56:30.061865+0000","last_clean":"2024-04-04T06:56:30.061865+0000","last_became_active":"2024-04-04T06:56:29.052112+0000","last_became_peered":"2024-04-04T06:56:29.052112+0000","last_unstale":"2024-04-04T06:56:30.061865+0000","last_undegraded":"2024-04-04T06:56:30.061865+0000","last_fullsized":"2024-04-04T06:56:30.061865+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T10:40:36.659855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.696511+0000","last_change":"2024-04-04T06:56:27.998416+0000","last_active":"2024-04-04T06:56:30.696511+0000","last_peered":"2024-04-04T06:56:30.696511+0000","last_clean":"2024-04-04T06:56:30.696511+0000","last_became_active":"2024-04-04T06:56:27.997342+0000","last_became_peered":"2024-04-04T06:56:27.997342+0000","last_unstale":"2024-04-04T06:56:30.696511+0000","last_undegraded":"2024-04-04T06:56:30.696511+0000","last_fullsized":"2024-04-04T06:56:30.696511+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_clean_scrub_stamp":"2024-04-04T06:56:26.956814+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T10:18:31.915978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.020893+0000","last_change":"2024-04-04T06:56:29.033505+0000","last_active":"2024-04-04T06:56:30.020893+0000","last_peered":"2024-04-04T06:56:30.020893+0000","last_clean":"2024-04-04T06:56:30.020893+0000","last_became_active":"2024-04-04T06:56:29.032725+0000","last_became_peered":"2024-04-04T06:56:29.032725+0000","last_unstale":"2024-04-04T06:56:30.020893+0000","last_undegraded":"2024-04-04T06:56:30.020893+0000","last_fullsized":"2024-04-04T06:56:30.020893+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T12:03:12.792963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.020304+0000","last_change":"2024-04-04T06:56:27.999979+0000","last_active":"2024-04-04T06:56:30.020304+0000","last_peered":"2024-04-04T06:56:30.020304+0000","last_clean":"2024-04-04T06:56:30.020304+0000","last_became_active":"2024-04-04T06:56:27.999169+0000","last_became_peered":"2024-04-04T06:56:27.999169+0000","last_unstale":"2024-04-04T06:56:30.020304+0000","last_undegraded":"2024-04-04T06:56:30.020304+0000","last_fullsized":"2024-04-04T06:56:30.020304+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_clean_scrub_stamp":"2024-04-04T06:56:26.956814+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T12:03:09.060630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.021458+0000","last_change":"2024-04-04T06:56:29.043619+0000","last_active":"2024-04-04T06:56:30.021458+0000","last_peered":"2024-04-04T06:56:30.021458+0000","last_clean":"2024-04-04T06:56:30.021458+0000","last_became_active":"2024-04-04T06:56:29.043335+0000","last_became_peered":"2024-04-04T06:56:29.043335+0000","last_unstale":"2024-04-04T06:56:30.021458+0000","last_undegraded":"2024-04-04T06:56:30.021458+0000","last_fullsized":"2024-04-04T06:56:30.021458+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T10:52:30.479480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.697225+0000","last_change":"2024-04-04T06:56:27.999367+0000","last_active":"2024-04-04T06:56:30.697225+0000","last_peered":"2024-04-04T06:56:30.697225+0000","last_clean":"2024-04-04T06:56:30.697225+0000","last_became_active":"2024-04-04T06:56:27.999073+0000","last_became_peered":"2024-04-04T06:56:27.999073+0000","last_unstale":"2024-04-04T06:56:30.697225+0000","last_undegraded":"2024-04-04T06:56:30.697225+0000","last_fullsized":"2024-04-04T06:56:30.697225+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_clean_scrub_stamp":"2024-04-04T06:56:26.956814+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T09:54:19.792854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.021694+0000","last_change":"2024-04-04T06:56:29.047512+0000","last_active":"2024-04-04T06:56:30.021694+0000","last_peered":"2024-04-04T06:56:30.021694+0000","last_clean":"2024-04-04T06:56:30.021694+0000","last_became_active":"2024-04-04T06:56:29.046259+0000","last_became_peered":"2024-04-04T06:56:29.046259+0000","last_unstale":"2024-04-04T06:56:30.021694+0000","last_undegraded":"2024-04-04T06:56:30.021694+0000","last_fullsized":"2024-04-04T06:56:30.021694+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T11:46:36.780783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.016251+0000","last_change":"2024-04-04T06:56:27.999707+0000","last_active":"2024-04-04T06:56:30.016251+0000","last_peered":"2024-04-04T06:56:30.016251+0000","last_clean":"2024-04-04T06:56:30.016251+0000","last_became_active":"2024-04-04T06:56:27.999398+0000","last_became_peered":"2024-04-04T06:56:27.999398+0000","last_unstale":"2024-04-04T06:56:30.016251+0000","last_undegraded":"2024-04-04T06:56:30.016251+0000","last_fullsized":"2024-04-04T06:56:30.016251+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_clean_scrub_stamp":"2024-04-04T06:56:26.956814+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T16:54:05.981179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.699399+0000","last_change":"2024-04-04T06:56:29.067217+0000","last_active":"2024-04-04T06:56:30.699399+0000","last_peered":"2024-04-04T06:56:30.699399+0000","last_clean":"2024-04-04T06:56:30.699399+0000","last_became_active":"2024-04-04T06:56:29.066762+0000","last_became_peered":"2024-04-04T06:56:29.066762+0000","last_unstale":"2024-04-04T06:56:30.699399+0000","last_undegraded":"2024-04-04T06:56:30.699399+0000","last_fullsized":"2024-04-04T06:56:30.699399+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T10:52:30.479480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.696812+0000","last_change":"2024-04-04T06:56:28.017607+0000","last_active":"2024-04-04T06:56:30.696812+0000","last_peered":"2024-04-04T06:56:30.696812+0000","last_clean":"2024-04-04T06:56:30.696812+0000","last_became_active":"2024-04-04T06:56:28.017322+0000","last_became_peered":"2024-04-04T06:56:28.017322+0000","last_unstale":"2024-04-04T06:56:30.696812+0000","last_undegraded":"2024-04-04T06:56:30.696812+0000","last_fullsized":"2024-04-04T06:56:30.696812+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_clean_scrub_stamp":"2024-04-04T06:56:26.956814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T16:13:09.520714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.020775+0000","last_change":"2024-04-04T06:56:29.044164+0000","last_active":"2024-04-04T06:56:30.020775+0000","last_peered":"2024-04-04T06:56:30.020775+0000","last_clean":"2024-04-04T06:56:30.020775+0000","last_became_active":"2024-04-04T06:56:29.043814+0000","last_became_peered":"2024-04-04T06:56:29.043814+0000","last_unstale":"2024-04-04T06:56:30.020775+0000","last_undegraded":"2024-04-04T06:56:30.020775+0000","last_fullsized":"2024-04-04T06:56:30.020775+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T10:24:01.060246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":170,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.017600+0000","last_change":"2024-04-04T06:56:19.364611+0000","last_active":"2024-04-04T06:56:30.017600+0000","last_peered":"2024-04-04T06:56:30.017600+0000","last_clean":"2024-04-04T06:56:30.017600+0000","last_became_active":"2024-04-04T06:56:19.362232+0000","last_became_peered":"2024-04-04T06:56:19.362232+0000","last_unstale":"2024-04-04T06:56:30.017600+0000","last_undegraded":"2024-04-04T06:56:30.017600+0000","last_fullsized":"2024-04-04T06:56:30.017600+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:17.744258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:17.744258+0000","last_clean_scrub_stamp":"2024-04-04T06:56:17.744258+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T17:25:16.494215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.698001+0000","last_change":"2024-04-04T06:56:28.009818+0000","last_active":"2024-04-04T06:56:30.698001+0000","last_peered":"2024-04-04T06:56:30.698001+0000","last_clean":"2024-04-04T06:56:30.698001+0000","last_became_active":"2024-04-04T06:56:28.005509+0000","last_became_peered":"2024-04-04T06:56:28.005509+0000","last_unstale":"2024-04-04T06:56:30.698001+0000","last_undegraded":"2024-04-04T06:56:30.698001+0000","last_fullsized":"2024-04-04T06:56:30.698001+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_clean_scrub_stamp":"2024-04-04T06:56:26.956814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T10:18:31.915978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.701399+0000","last_change":"2024-04-04T06:56:29.056563+0000","last_active":"2024-04-04T06:56:30.701399+0000","last_peered":"2024-04-04T06:56:30.701399+0000","last_clean":"2024-04-04T06:56:30.701399+0000","last_became_active":"2024-04-04T06:56:29.056289+0000","last_became_peered":"2024-04-04T06:56:29.056289+0000","last_unstale":"2024-04-04T06:56:30.701399+0000","last_undegraded":"2024-04-04T06:56:30.701399+0000","last_fullsized":"2024-04-04T06:56:30.701399+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T16:44:39.332035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.017655+0000","last_change":"2024-04-04T06:56:28.008107+0000","last_active":"2024-04-04T06:56:30.017655+0000","last_peered":"2024-04-04T06:56:30.017655+0000","last_clean":"2024-04-04T06:56:30.017655+0000","last_became_active":"2024-04-04T06:56:28.007840+0000","last_became_peered":"2024-04-04T06:56:28.007840+0000","last_unstale":"2024-04-04T06:56:30.017655+0000","last_undegraded":"2024-04-04T06:56:30.017655+0000","last_fullsized":"2024-04-04T06:56:30.017655+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_clean_scrub_stamp":"2024-04-04T06:56:26.956814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T16:54:05.981179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.697676+0000","last_change":"2024-04-04T06:56:29.026533+0000","last_active":"2024-04-04T06:56:30.697676+0000","last_peered":"2024-04-04T06:56:30.697676+0000","last_clean":"2024-04-04T06:56:30.697676+0000","last_became_active":"2024-04-04T06:56:29.025763+0000","last_became_peered":"2024-04-04T06:56:29.025763+0000","last_unstale":"2024-04-04T06:56:30.697676+0000","last_undegraded":"2024-04-04T06:56:30.697676+0000","last_fullsized":"2024-04-04T06:56:30.697676+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T14:56:36.711210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.696766+0000","last_change":"2024-04-04T06:56:27.994114+0000","last_active":"2024-04-04T06:56:30.696766+0000","last_peered":"2024-04-04T06:56:30.696766+0000","last_clean":"2024-04-04T06:56:30.696766+0000","last_became_active":"2024-04-04T06:56:27.993840+0000","last_became_peered":"2024-04-04T06:56:27.993840+0000","last_unstale":"2024-04-04T06:56:30.696766+0000","last_undegraded":"2024-04-04T06:56:30.696766+0000","last_fullsized":"2024-04-04T06:56:30.696766+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_clean_scrub_stamp":"2024-04-04T06:56:26.956814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T13:32:44.896913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.015501+0000","last_change":"2024-04-04T06:56:29.047339+0000","last_active":"2024-04-04T06:56:30.015501+0000","last_peered":"2024-04-04T06:56:30.015501+0000","last_clean":"2024-04-04T06:56:30.015501+0000","last_became_active":"2024-04-04T06:56:29.047084+0000","last_became_peered":"2024-04-04T06:56:29.047084+0000","last_unstale":"2024-04-04T06:56:30.015501+0000","last_undegraded":"2024-04-04T06:56:30.015501+0000","last_fullsized":"2024-04-04T06:56:30.015501+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T13:04:16.108138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.698907+0000","last_change":"2024-04-04T06:56:28.011081+0000","last_active":"2024-04-04T06:56:30.698907+0000","last_peered":"2024-04-04T06:56:30.698907+0000","last_clean":"2024-04-04T06:56:30.698907+0000","last_became_active":"2024-04-04T06:56:28.010741+0000","last_became_peered":"2024-04-04T06:56:28.010741+0000","last_unstale":"2024-04-04T06:56:30.698907+0000","last_undegraded":"2024-04-04T06:56:30.698907+0000","last_fullsized":"2024-04-04T06:56:30.698907+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_clean_scrub_stamp":"2024-04-04T06:56:26.956814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T08:38:32.735117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.019466+0000","last_change":"2024-04-04T06:56:29.038187+0000","last_active":"2024-04-04T06:56:30.019466+0000","last_peered":"2024-04-04T06:56:30.019466+0000","last_clean":"2024-04-04T06:56:30.019466+0000","last_became_active":"2024-04-04T06:56:29.037716+0000","last_became_peered":"2024-04-04T06:56:29.037716+0000","last_unstale":"2024-04-04T06:56:30.019466+0000","last_undegraded":"2024-04-04T06:56:30.019466+0000","last_fullsized":"2024-04-04T06:56:30.019466+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T08:38:33.741314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.015764+0000","last_change":"2024-04-04T06:56:28.006139+0000","last_active":"2024-04-04T06:56:30.015764+0000","last_peered":"2024-04-04T06:56:30.015764+0000","last_clean":"2024-04-04T06:56:30.015764+0000","last_became_active":"2024-04-04T06:56:28.005763+0000","last_became_peered":"2024-04-04T06:56:28.005763+0000","last_unstale":"2024-04-04T06:56:30.015764+0000","last_undegraded":"2024-04-04T06:56:30.015764+0000","last_fullsized":"2024-04-04T06:56:30.015764+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_clean_scrub_stamp":"2024-04-04T06:56:26.956814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T13:32:44.896913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.699033+0000","last_change":"2024-04-04T06:56:29.058128+0000","last_active":"2024-04-04T06:56:30.699033+0000","last_peered":"2024-04-04T06:56:30.699033+0000","last_clean":"2024-04-04T06:56:30.699033+0000","last_became_active":"2024-04-04T06:56:29.057809+0000","last_became_peered":"2024-04-04T06:56:29.057809+0000","last_unstale":"2024-04-04T06:56:30.699033+0000","last_undegraded":"2024-04-04T06:56:30.699033+0000","last_fullsized":"2024-04-04T06:56:30.699033+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T16:01:05.840859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.020996+0000","last_change":"2024-04-04T06:56:28.012156+0000","last_active":"2024-04-04T06:56:30.020996+0000","last_peered":"2024-04-04T06:56:30.020996+0000","last_clean":"2024-04-04T06:56:30.020996+0000","last_became_active":"2024-04-04T06:56:28.011880+0000","last_became_peered":"2024-04-04T06:56:28.011880+0000","last_unstale":"2024-04-04T06:56:30.020996+0000","last_undegraded":"2024-04-04T06:56:30.020996+0000","last_fullsized":"2024-04-04T06:56:30.020996+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_clean_scrub_stamp":"2024-04-04T06:56:26.956814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T10:21:04.212235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.015724+0000","last_change":"2024-04-04T06:56:29.042619+0000","last_active":"2024-04-04T06:56:30.015724+0000","last_peered":"2024-04-04T06:56:30.015724+0000","last_clean":"2024-04-04T06:56:30.015724+0000","last_became_active":"2024-04-04T06:56:29.042331+0000","last_became_peered":"2024-04-04T06:56:29.042331+0000","last_unstale":"2024-04-04T06:56:30.015724+0000","last_undegraded":"2024-04-04T06:56:30.015724+0000","last_fullsized":"2024-04-04T06:56:30.015724+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T08:11:58.552420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.016292+0000","last_change":"2024-04-04T06:56:28.014328+0000","last_active":"2024-04-04T06:56:30.016292+0000","last_peered":"2024-04-04T06:56:30.016292+0000","last_clean":"2024-04-04T06:56:30.016292+0000","last_became_active":"2024-04-04T06:56:28.014076+0000","last_became_peered":"2024-04-04T06:56:28.014076+0000","last_unstale":"2024-04-04T06:56:30.016292+0000","last_undegraded":"2024-04-04T06:56:30.016292+0000","last_fullsized":"2024-04-04T06:56:30.016292+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_clean_scrub_stamp":"2024-04-04T06:56:26.956814+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T15:15:23.654438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.701803+0000","last_change":"2024-04-04T06:56:29.051193+0000","last_active":"2024-04-04T06:56:30.701803+0000","last_peered":"2024-04-04T06:56:30.701803+0000","last_clean":"2024-04-04T06:56:30.701803+0000","last_became_active":"2024-04-04T06:56:29.045454+0000","last_became_peered":"2024-04-04T06:56:29.045454+0000","last_unstale":"2024-04-04T06:56:30.701803+0000","last_undegraded":"2024-04-04T06:56:30.701803+0000","last_fullsized":"2024-04-04T06:56:30.701803+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T17:04:57.682659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.062601+0000","last_change":"2024-04-04T06:56:28.012644+0000","last_active":"2024-04-04T06:56:30.062601+0000","last_peered":"2024-04-04T06:56:30.062601+0000","last_clean":"2024-04-04T06:56:30.062601+0000","last_became_active":"2024-04-04T06:56:28.012293+0000","last_became_peered":"2024-04-04T06:56:28.012293+0000","last_unstale":"2024-04-04T06:56:30.062601+0000","last_undegraded":"2024-04-04T06:56:30.062601+0000","last_fullsized":"2024-04-04T06:56:30.062601+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_clean_scrub_stamp":"2024-04-04T06:56:26.956814+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T13:32:44.896913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.698639+0000","last_change":"2024-04-04T06:56:29.044040+0000","last_active":"2024-04-04T06:56:30.698639+0000","last_peered":"2024-04-04T06:56:30.698639+0000","last_clean":"2024-04-04T06:56:30.698639+0000","last_became_active":"2024-04-04T06:56:29.042922+0000","last_became_peered":"2024-04-04T06:56:29.042922+0000","last_unstale":"2024-04-04T06:56:30.698639+0000","last_undegraded":"2024-04-04T06:56:30.698639+0000","last_fullsized":"2024-04-04T06:56:30.698639+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T13:04:16.108138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.017156+0000","last_change":"2024-04-04T06:56:28.012453+0000","last_active":"2024-04-04T06:56:30.017156+0000","last_peered":"2024-04-04T06:56:30.017156+0000","last_clean":"2024-04-04T06:56:30.017156+0000","last_became_active":"2024-04-04T06:56:28.011057+0000","last_became_peered":"2024-04-04T06:56:28.011057+0000","last_unstale":"2024-04-04T06:56:30.017156+0000","last_undegraded":"2024-04-04T06:56:30.017156+0000","last_fullsized":"2024-04-04T06:56:30.017156+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_clean_scrub_stamp":"2024-04-04T06:56:26.956814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T08:38:32.735117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.018349+0000","last_change":"2024-04-04T06:56:29.044746+0000","last_active":"2024-04-04T06:56:30.018349+0000","last_peered":"2024-04-04T06:56:30.018349+0000","last_clean":"2024-04-04T06:56:30.018349+0000","last_became_active":"2024-04-04T06:56:29.044423+0000","last_became_peered":"2024-04-04T06:56:29.044423+0000","last_unstale":"2024-04-04T06:56:30.018349+0000","last_undegraded":"2024-04-04T06:56:30.018349+0000","last_fullsized":"2024-04-04T06:56:30.018349+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T10:18:32.922174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.015451+0000","last_change":"2024-04-04T06:56:27.996226+0000","last_active":"2024-04-04T06:56:30.015451+0000","last_peered":"2024-04-04T06:56:30.015451+0000","last_clean":"2024-04-04T06:56:30.015451+0000","last_became_active":"2024-04-04T06:56:27.995835+0000","last_became_peered":"2024-04-04T06:56:27.995835+0000","last_unstale":"2024-04-04T06:56:30.015451+0000","last_undegraded":"2024-04-04T06:56:30.015451+0000","last_fullsized":"2024-04-04T06:56:30.015451+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_clean_scrub_stamp":"2024-04-04T06:56:26.956814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T09:54:19.792854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.701001+0000","last_change":"2024-04-04T06:56:29.056813+0000","last_active":"2024-04-04T06:56:30.701001+0000","last_peered":"2024-04-04T06:56:30.701001+0000","last_clean":"2024-04-04T06:56:30.701001+0000","last_became_active":"2024-04-04T06:56:29.052514+0000","last_became_peered":"2024-04-04T06:56:29.052514+0000","last_unstale":"2024-04-04T06:56:30.701001+0000","last_undegraded":"2024-04-04T06:56:30.701001+0000","last_fullsized":"2024-04-04T06:56:30.701001+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T10:40:36.659855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.015571+0000","last_change":"2024-04-04T06:56:27.999750+0000","last_active":"2024-04-04T06:56:30.015571+0000","last_peered":"2024-04-04T06:56:30.015571+0000","last_clean":"2024-04-04T06:56:30.015571+0000","last_became_active":"2024-04-04T06:56:27.997685+0000","last_became_peered":"2024-04-04T06:56:27.997685+0000","last_unstale":"2024-04-04T06:56:30.015571+0000","last_undegraded":"2024-04-04T06:56:30.015571+0000","last_fullsized":"2024-04-04T06:56:30.015571+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_clean_scrub_stamp":"2024-04-04T06:56:26.956814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T10:18:31.915978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.701301+0000","last_change":"2024-04-04T06:56:29.056179+0000","last_active":"2024-04-04T06:56:30.701301+0000","last_peered":"2024-04-04T06:56:30.701301+0000","last_clean":"2024-04-04T06:56:30.701301+0000","last_became_active":"2024-04-04T06:56:29.055682+0000","last_became_peered":"2024-04-04T06:56:29.055682+0000","last_unstale":"2024-04-04T06:56:30.701301+0000","last_undegraded":"2024-04-04T06:56:30.701301+0000","last_fullsized":"2024-04-04T06:56:30.701301+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T08:11:58.552420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.021102+0000","last_change":"2024-04-04T06:56:28.010871+0000","last_active":"2024-04-04T06:56:30.021102+0000","last_peered":"2024-04-04T06:56:30.021102+0000","last_clean":"2024-04-04T06:56:30.021102+0000","last_became_active":"2024-04-04T06:56:28.010159+0000","last_became_peered":"2024-04-04T06:56:28.010159+0000","last_unstale":"2024-04-04T06:56:30.021102+0000","last_undegraded":"2024-04-04T06:56:30.021102+0000","last_fullsized":"2024-04-04T06:56:30.021102+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_clean_scrub_stamp":"2024-04-04T06:56:26.956814+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T12:35:20.051203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.061957+0000","last_change":"2024-04-04T06:56:29.051332+0000","last_active":"2024-04-04T06:56:30.061957+0000","last_peered":"2024-04-04T06:56:30.061957+0000","last_clean":"2024-04-04T06:56:30.061957+0000","last_became_active":"2024-04-04T06:56:29.051026+0000","last_became_peered":"2024-04-04T06:56:29.051026+0000","last_unstale":"2024-04-04T06:56:30.061957+0000","last_undegraded":"2024-04-04T06:56:30.061957+0000","last_fullsized":"2024-04-04T06:56:30.061957+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T10:04:08.170276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.698934+0000","last_change":"2024-04-04T06:56:29.045951+0000","last_active":"2024-04-04T06:56:30.698934+0000","last_peered":"2024-04-04T06:56:30.698934+0000","last_clean":"2024-04-04T06:56:30.698934+0000","last_became_active":"2024-04-04T06:56:29.044806+0000","last_became_peered":"2024-04-04T06:56:29.044806+0000","last_unstale":"2024-04-04T06:56:30.698934+0000","last_undegraded":"2024-04-04T06:56:30.698934+0000","last_fullsized":"2024-04-04T06:56:30.698934+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T10:24:01.060246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.019571+0000","last_change":"2024-04-04T06:56:28.022012+0000","last_active":"2024-04-04T06:56:30.019571+0000","last_peered":"2024-04-04T06:56:30.019571+0000","last_clean":"2024-04-04T06:56:30.019571+0000","last_became_active":"2024-04-04T06:56:28.021708+0000","last_became_peered":"2024-04-04T06:56:28.021708+0000","last_unstale":"2024-04-04T06:56:30.019571+0000","last_undegraded":"2024-04-04T06:56:30.019571+0000","last_fullsized":"2024-04-04T06:56:30.019571+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_clean_scrub_stamp":"2024-04-04T06:56:26.956814+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T15:15:23.654438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.698972+0000","last_change":"2024-04-04T06:56:29.045589+0000","last_active":"2024-04-04T06:56:30.698972+0000","last_peered":"2024-04-04T06:56:30.698972+0000","last_clean":"2024-04-04T06:56:30.698972+0000","last_became_active":"2024-04-04T06:56:29.045071+0000","last_became_peered":"2024-04-04T06:56:29.045071+0000","last_unstale":"2024-04-04T06:56:30.698972+0000","last_undegraded":"2024-04-04T06:56:30.698972+0000","last_fullsized":"2024-04-04T06:56:30.698972+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T18:38:49.851932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.019137+0000","last_change":"2024-04-04T06:56:28.014130+0000","last_active":"2024-04-04T06:56:30.019137+0000","last_peered":"2024-04-04T06:56:30.019137+0000","last_clean":"2024-04-04T06:56:30.019137+0000","last_became_active":"2024-04-04T06:56:28.013846+0000","last_became_peered":"2024-04-04T06:56:28.013846+0000","last_unstale":"2024-04-04T06:56:30.019137+0000","last_undegraded":"2024-04-04T06:56:30.019137+0000","last_fullsized":"2024-04-04T06:56:30.019137+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_clean_scrub_stamp":"2024-04-04T06:56:26.956814+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T15:09:29.813629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.698978+0000","last_change":"2024-04-04T06:56:29.049076+0000","last_active":"2024-04-04T06:56:30.698978+0000","last_peered":"2024-04-04T06:56:30.698978+0000","last_clean":"2024-04-04T06:56:30.698978+0000","last_became_active":"2024-04-04T06:56:29.048096+0000","last_became_peered":"2024-04-04T06:56:29.048096+0000","last_unstale":"2024-04-04T06:56:30.698978+0000","last_undegraded":"2024-04-04T06:56:30.698978+0000","last_fullsized":"2024-04-04T06:56:30.698978+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T16:44:39.332035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.701741+0000","last_change":"2024-04-04T06:56:27.998042+0000","last_active":"2024-04-04T06:56:30.701741+0000","last_peered":"2024-04-04T06:56:30.701741+0000","last_clean":"2024-04-04T06:56:30.701741+0000","last_became_active":"2024-04-04T06:56:27.996925+0000","last_became_peered":"2024-04-04T06:56:27.996925+0000","last_unstale":"2024-04-04T06:56:30.701741+0000","last_undegraded":"2024-04-04T06:56:30.701741+0000","last_fullsized":"2024-04-04T06:56:30.701741+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_clean_scrub_stamp":"2024-04-04T06:56:26.956814+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T16:13:09.520714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.701597+0000","last_change":"2024-04-04T06:56:29.051673+0000","last_active":"2024-04-04T06:56:30.701597+0000","last_peered":"2024-04-04T06:56:30.701597+0000","last_clean":"2024-04-04T06:56:30.701597+0000","last_became_active":"2024-04-04T06:56:29.051400+0000","last_became_peered":"2024-04-04T06:56:29.051400+0000","last_unstale":"2024-04-04T06:56:30.701597+0000","last_undegraded":"2024-04-04T06:56:30.701597+0000","last_fullsized":"2024-04-04T06:56:30.701597+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T12:11:26.884771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.699097+0000","last_change":"2024-04-04T06:56:28.000376+0000","last_active":"2024-04-04T06:56:30.699097+0000","last_peered":"2024-04-04T06:56:30.699097+0000","last_clean":"2024-04-04T06:56:30.699097+0000","last_became_active":"2024-04-04T06:56:27.999779+0000","last_became_peered":"2024-04-04T06:56:27.999779+0000","last_unstale":"2024-04-04T06:56:30.699097+0000","last_undegraded":"2024-04-04T06:56:30.699097+0000","last_fullsized":"2024-04-04T06:56:30.699097+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_clean_scrub_stamp":"2024-04-04T06:56:26.956814+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T13:47:51.595456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27808,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344032,"statfs":{"total":96636764160,"available":96608288768,"internally_reserved":0,"allocated":802816,"data_stored":661884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":208896,"data_stored":71024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":71060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":70934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574852,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":212992,"data_stored":71094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":811008,"data_stored":661940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-04T06:56:33.578 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-04T06:56:33.828 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:33.830+0000 7fede7200640 1 Processor -- start 2024-04-04T06:56:33.829 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:33.830+0000 7fede7200640 1 -- start start 2024-04-04T06:56:33.831 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:33.831+0000 7fede7200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fede0147540 0x7fede006c480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:33.831 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:33.832+0000 7fede7200640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fede0162c90 0x7fede006c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:33.831 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:33.832+0000 7fede7200640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fede015f7a0 con 0x7fede015ea40 2024-04-04T06:56:33.831 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:33.832+0000 7fede7200640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7fede01621b0 con 0x7fede0162c90 2024-04-04T06:56:33.831 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:33.832+0000 7fede7200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fede0162490 con 0x7fede0147540 2024-04-04T06:56:33.831 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:33.832+0000 7feddf400640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fede0162c90 0x7fede006c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:33.831 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:33.832+0000 7fede5200640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fede015ea40 0x7fede015eeb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:52588/0 (socket says 172.21.15.72:52588) 2024-04-04T06:56:33.831 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:33.832+0000 7fede5200640 1 -- 172.21.15.72:0/3321939507 learned_addr learned my addr 172.21.15.72:0/3321939507 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-04-04T06:56:33.831 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:33.832+0000 7feddfe00640 1 --2- 172.21.15.72:0/3321939507 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fede0147540 0x7fede006c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:33.832 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:33.833+0000 7feddf400640 1 -- 172.21.15.72:0/3321939507 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fede0147540 msgr2=0x7fede006c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:56:33.832 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:33.833+0000 7feddf400640 1 --2- 172.21.15.72:0/3321939507 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fede0147540 0x7fede006c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:33.832 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:33.833+0000 7feddf400640 1 -- 172.21.15.72:0/3321939507 >> v1:172.21.15.72:6789/0 conn(0x7fede015ea40 legacy=0x7fede015eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:33.832 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:33.833+0000 7feddf400640 1 -- 172.21.15.72:0/3321939507 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fede0147920 con 0x7fede0162c90 2024-04-04T06:56:33.832 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:33.833+0000 7feddfe00640 1 --2- 172.21.15.72:0/3321939507 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fede0147540 0x7fede006c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-04T06:56:33.833 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:33.834+0000 7feddf400640 1 --2- 172.21.15.72:0/3321939507 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fede0162c90 0x7fede006c9c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fedcc0097a0 tx=0x7fedcc02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=172b5711e0188cd server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:33.833 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:33.835+0000 7feddea00640 1 -- 172.21.15.72:0/3321939507 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedcc035020 con 0x7fede0162c90 2024-04-04T06:56:33.833 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:33.835+0000 7feddea00640 1 -- 172.21.15.72:0/3321939507 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fedcc031830 con 0x7fede0162c90 2024-04-04T06:56:33.833 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:33.835+0000 7feddea00640 1 -- 172.21.15.72:0/3321939507 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedcc031c00 con 0x7fede0162c90 2024-04-04T06:56:33.834 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:33.835+0000 7fede7200640 1 -- 172.21.15.72:0/3321939507 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fede0162c90 msgr2=0x7fede006c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:33.834 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:33.835+0000 7fede7200640 1 --2- 172.21.15.72:0/3321939507 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fede0162c90 0x7fede006c9c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fedcc0097a0 tx=0x7fedcc02b8d0 comp rx=0 tx=0).stop 2024-04-04T06:56:33.834 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:33.836+0000 7fede7200640 1 -- 172.21.15.72:0/3321939507 shutdown_connections 2024-04-04T06:56:33.834 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:33.836+0000 7fede7200640 1 --2- 172.21.15.72:0/3321939507 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fede0162c90 0x7fede006c9c0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:33.835 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:33.836+0000 7fede7200640 1 --2- 172.21.15.72:0/3321939507 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fede0147540 0x7fede006c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:33.835 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:33.836+0000 7fede7200640 1 -- 172.21.15.72:0/3321939507 >> 172.21.15.72:0/3321939507 conn(0x7fede0072470 msgr2=0x7fede0072880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:56:33.835 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:33.836+0000 7fede7200640 1 -- 172.21.15.72:0/3321939507 shutdown_connections 2024-04-04T06:56:33.835 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:33.836+0000 7fede7200640 1 -- 172.21.15.72:0/3321939507 wait complete. 2024-04-04T06:56:33.836 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:33.837+0000 7fede7200640 1 Processor -- start 2024-04-04T06:56:33.836 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:33.838+0000 7fede7200640 1 -- start start 2024-04-04T06:56:33.839 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:33.838+0000 7fede7200640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fede0147540 0x7fede00c9f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:33.839 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:33.838+0000 7fede7200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fede015ea40 0x7fede01f4730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:33.839 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:33.838+0000 7fede7200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fede00c9040 0x7fede0161050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:33.839 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:33.839+0000 7fede7200640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fede00cb9f0 con 0x7fede0147540 2024-04-04T06:56:33.839 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:33.839+0000 7fede7200640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fede00cb870 con 0x7fede015ea40 2024-04-04T06:56:33.839 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:33.839+0000 7fede7200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fede00cbb70 con 0x7fede00c9040 2024-04-04T06:56:33.839 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:33.839+0000 7feddfe00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fede0147540 0x7fede00c9f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:33.839 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:33.839+0000 7feddfe00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fede0147540 0x7fede00c9f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46040/0 (socket says 172.21.15.72:46040) 2024-04-04T06:56:33.839 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:33.839+0000 7feddfe00640 1 -- 172.21.15.72:0/3074940979 learned_addr learned my addr 172.21.15.72:0/3074940979 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:56:33.839 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:33.839+0000 7fede5200640 1 --2- 172.21.15.72:0/3074940979 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fede00c9040 0x7fede0161050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:33.839 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:33.839+0000 7feddfe00640 1 -- 172.21.15.72:0/3074940979 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fede00c9040 msgr2=0x7fede0161050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:33.839 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:33.839+0000 7feddfe00640 1 --2- 172.21.15.72:0/3074940979 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fede00c9040 0x7fede0161050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:33.839 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:33.839+0000 7feddfe00640 1 -- 172.21.15.72:0/3074940979 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fede015ea40 msgr2=0x7fede01f4730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:33.840 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:33.839+0000 7feddfe00640 1 --2- 172.21.15.72:0/3074940979 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fede015ea40 0x7fede01f4730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:33.840 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:33.839+0000 7feddfe00640 1 -- 172.21.15.72:0/3074940979 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fede00cade0 con 0x7fede0147540 2024-04-04T06:56:33.840 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:33.839+0000 7feddfe00640 1 --2- 172.21.15.72:0/3074940979 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fede0147540 0x7fede00c9f60 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fedd000e810 tx=0x7fedd000ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:33.840 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:33.840+0000 7fedd7e00640 1 -- 172.21.15.72:0/3074940979 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedd000f040 con 0x7fede0147540 2024-04-04T06:56:33.840 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:33.840+0000 7fedd7e00640 1 -- 172.21.15.72:0/3074940979 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fedd0004030 con 0x7fede0147540 2024-04-04T06:56:33.840 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:33.840+0000 7fedd7e00640 1 -- 172.21.15.72:0/3074940979 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedd0004400 con 0x7fede0147540 2024-04-04T06:56:33.840 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:33.840+0000 7fede7200640 1 -- 172.21.15.72:0/3074940979 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fede00ca540 con 0x7fede0147540 2024-04-04T06:56:33.840 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:33.840+0000 7fede7200640 1 -- 172.21.15.72:0/3074940979 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fede00cab00 con 0x7fede0147540 2024-04-04T06:56:33.841 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:33.841+0000 7fede7200640 1 -- 172.21.15.72:0/3074940979 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fede0075840 con 0x7fede0147540 2024-04-04T06:56:33.841 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:33.842+0000 7fedd7e00640 1 -- 172.21.15.72:0/3074940979 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fedd000c6d0 con 0x7fede0147540 2024-04-04T06:56:33.842 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:33.843+0000 7fedd7e00640 1 --2- 172.21.15.72:0/3074940979 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fedc006c920 0x7fedc006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:33.842 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:33.843+0000 7fedd7e00640 1 -- 172.21.15.72:0/3074940979 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fedd008b910 con 0x7fede0147540 2024-04-04T06:56:33.842 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:33.843+0000 7feddf400640 1 --2- 172.21.15.72:0/3074940979 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fedc006c920 0x7fedc006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:33.842 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:33.844+0000 7feddf400640 1 --2- 172.21.15.72:0/3074940979 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fedc006c920 0x7fedc006ede0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fedcc036000 tx=0x7fedcc030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:33.850 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:33.852+0000 7fedd7e00640 1 -- 172.21.15.72:0/3074940979 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fedd0017020 con 0x7fede0147540 2024-04-04T06:56:34.046 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:34.048+0000 7fede7200640 1 -- 172.21.15.72:0/3074940979 --> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fede0073730 con 0x7fedc006c920 2024-04-04T06:56:34.056 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:34.057+0000 7fedd7e00640 1 -- 172.21.15.72:0/3074940979 <== mgr.4101 v2:172.21.15.72:6832/2205173820 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251948 (secure 0 0 0) 0x7fede0073730 con 0x7fedc006c920 2024-04-04T06:56:34.059 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T06:56:34.061 INFO:teuthology.orchestra.run.smithi072.stderr:dumped all 2024-04-04T06:56:34.063 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:34.062+0000 7fede7200640 1 -- 172.21.15.72:0/3074940979 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fedc006c920 msgr2=0x7fedc006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:34.063 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:34.062+0000 7fede7200640 1 --2- 172.21.15.72:0/3074940979 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fedc006c920 0x7fedc006ede0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fedcc036000 tx=0x7fedcc030000 comp rx=0 tx=0).stop 2024-04-04T06:56:34.063 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:34.062+0000 7fede7200640 1 -- 172.21.15.72:0/3074940979 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fede0147540 msgr2=0x7fede00c9f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:34.063 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:34.062+0000 7fede7200640 1 --2- 172.21.15.72:0/3074940979 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fede0147540 0x7fede00c9f60 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fedd000e810 tx=0x7fedd000ecd0 comp rx=0 tx=0).stop 2024-04-04T06:56:34.063 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:34.062+0000 7fede7200640 1 -- 172.21.15.72:0/3074940979 shutdown_connections 2024-04-04T06:56:34.063 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:34.062+0000 7fede7200640 1 --2- 172.21.15.72:0/3074940979 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fedc006c920 0x7fedc006ede0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:34.063 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:34.062+0000 7fede7200640 1 --2- 172.21.15.72:0/3074940979 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fede00c9040 0x7fede0161050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:34.063 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:34.062+0000 7fede7200640 1 --2- 172.21.15.72:0/3074940979 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fede015ea40 0x7fede01f4730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:34.063 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:34.062+0000 7fede7200640 1 --2- 172.21.15.72:0/3074940979 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fede0147540 0x7fede00c9f60 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:34.063 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:34.062+0000 7fede7200640 1 -- 172.21.15.72:0/3074940979 >> 172.21.15.72:0/3074940979 conn(0x7fede0072470 msgr2=0x7fede0070690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:56:34.063 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:34.062+0000 7fede7200640 1 -- 172.21.15.72:0/3074940979 shutdown_connections 2024-04-04T06:56:34.064 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:34.062+0000 7fede7200640 1 -- 172.21.15.72:0/3074940979 wait complete. 2024-04-04T06:56:34.078 INFO:teuthology.orchestra.run.smithi072.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-04-04T06:56:33.388496+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":185,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218996,"kb_used_data":2824,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755724,"statfs":{"total":773094113280,"available":772869861376,"internally_reserved":0,"allocated":2891776,"data_stored":1753028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":43,"apply_latency_ms":43,"commit_latency_ns":43000000,"apply_latency_ns":43000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001941"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.021316+0000","last_change":"2024-04-04T06:56:29.041884+0000","last_active":"2024-04-04T06:56:30.021316+0000","last_peered":"2024-04-04T06:56:30.021316+0000","last_clean":"2024-04-04T06:56:30.021316+0000","last_became_active":"2024-04-04T06:56:29.041589+0000","last_became_peered":"2024-04-04T06:56:29.041589+0000","last_unstale":"2024-04-04T06:56:30.021316+0000","last_undegraded":"2024-04-04T06:56:30.021316+0000","last_fullsized":"2024-04-04T06:56:30.021316+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T17:09:54.896779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.016096+0000","last_change":"2024-04-04T06:56:29.044652+0000","last_active":"2024-04-04T06:56:30.016096+0000","last_peered":"2024-04-04T06:56:30.016096+0000","last_clean":"2024-04-04T06:56:30.016096+0000","last_became_active":"2024-04-04T06:56:29.044287+0000","last_became_peered":"2024-04-04T06:56:29.044287+0000","last_unstale":"2024-04-04T06:56:30.016096+0000","last_undegraded":"2024-04-04T06:56:30.016096+0000","last_fullsized":"2024-04-04T06:56:30.016096+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T16:44:39.332035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.698416+0000","last_change":"2024-04-04T06:56:29.044464+0000","last_active":"2024-04-04T06:56:30.698416+0000","last_peered":"2024-04-04T06:56:30.698416+0000","last_clean":"2024-04-04T06:56:30.698416+0000","last_became_active":"2024-04-04T06:56:29.044200+0000","last_became_peered":"2024-04-04T06:56:29.044200+0000","last_unstale":"2024-04-04T06:56:30.698416+0000","last_undegraded":"2024-04-04T06:56:30.698416+0000","last_fullsized":"2024-04-04T06:56:30.698416+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T15:25:18.489701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.698540+0000","last_change":"2024-04-04T06:56:29.058211+0000","last_active":"2024-04-04T06:56:30.698540+0000","last_peered":"2024-04-04T06:56:30.698540+0000","last_clean":"2024-04-04T06:56:30.698540+0000","last_became_active":"2024-04-04T06:56:29.057931+0000","last_became_peered":"2024-04-04T06:56:29.057931+0000","last_unstale":"2024-04-04T06:56:30.698540+0000","last_undegraded":"2024-04-04T06:56:30.698540+0000","last_fullsized":"2024-04-04T06:56:30.698540+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T17:04:57.682659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.020954+0000","last_change":"2024-04-04T06:56:29.043939+0000","last_active":"2024-04-04T06:56:30.020954+0000","last_peered":"2024-04-04T06:56:30.020954+0000","last_clean":"2024-04-04T06:56:30.020954+0000","last_became_active":"2024-04-04T06:56:29.043646+0000","last_became_peered":"2024-04-04T06:56:29.043646+0000","last_unstale":"2024-04-04T06:56:30.020954+0000","last_undegraded":"2024-04-04T06:56:30.020954+0000","last_fullsized":"2024-04-04T06:56:30.020954+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T18:38:49.851932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.698199+0000","last_change":"2024-04-04T06:56:29.036398+0000","last_active":"2024-04-04T06:56:30.698199+0000","last_peered":"2024-04-04T06:56:30.698199+0000","last_clean":"2024-04-04T06:56:30.698199+0000","last_became_active":"2024-04-04T06:56:29.036119+0000","last_became_peered":"2024-04-04T06:56:29.036119+0000","last_unstale":"2024-04-04T06:56:30.698199+0000","last_undegraded":"2024-04-04T06:56:30.698199+0000","last_fullsized":"2024-04-04T06:56:30.698199+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T12:11:26.884771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.018127+0000","last_change":"2024-04-04T06:56:29.033491+0000","last_active":"2024-04-04T06:56:30.018127+0000","last_peered":"2024-04-04T06:56:30.018127+0000","last_clean":"2024-04-04T06:56:30.018127+0000","last_became_active":"2024-04-04T06:56:29.033159+0000","last_became_peered":"2024-04-04T06:56:29.033159+0000","last_unstale":"2024-04-04T06:56:30.018127+0000","last_undegraded":"2024-04-04T06:56:30.018127+0000","last_fullsized":"2024-04-04T06:56:30.018127+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T17:04:57.682659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.701021+0000","last_change":"2024-04-04T06:56:29.058473+0000","last_active":"2024-04-04T06:56:30.701021+0000","last_peered":"2024-04-04T06:56:30.701021+0000","last_clean":"2024-04-04T06:56:30.701021+0000","last_became_active":"2024-04-04T06:56:29.057579+0000","last_became_peered":"2024-04-04T06:56:29.057579+0000","last_unstale":"2024-04-04T06:56:30.701021+0000","last_undegraded":"2024-04-04T06:56:30.701021+0000","last_fullsized":"2024-04-04T06:56:30.701021+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T15:25:18.489701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.021435+0000","last_change":"2024-04-04T06:56:29.036872+0000","last_active":"2024-04-04T06:56:30.021435+0000","last_peered":"2024-04-04T06:56:30.021435+0000","last_clean":"2024-04-04T06:56:30.021435+0000","last_became_active":"2024-04-04T06:56:29.035533+0000","last_became_peered":"2024-04-04T06:56:29.035533+0000","last_unstale":"2024-04-04T06:56:30.021435+0000","last_undegraded":"2024-04-04T06:56:30.021435+0000","last_fullsized":"2024-04-04T06:56:30.021435+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T09:03:00.078302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.062681+0000","last_change":"2024-04-04T06:56:29.048015+0000","last_active":"2024-04-04T06:56:30.062681+0000","last_peered":"2024-04-04T06:56:30.062681+0000","last_clean":"2024-04-04T06:56:30.062681+0000","last_became_active":"2024-04-04T06:56:29.047193+0000","last_became_peered":"2024-04-04T06:56:29.047193+0000","last_unstale":"2024-04-04T06:56:30.062681+0000","last_undegraded":"2024-04-04T06:56:30.062681+0000","last_fullsized":"2024-04-04T06:56:30.062681+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T12:11:26.884771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.062555+0000","last_change":"2024-04-04T06:56:29.048692+0000","last_active":"2024-04-04T06:56:30.062555+0000","last_peered":"2024-04-04T06:56:30.062555+0000","last_clean":"2024-04-04T06:56:30.062555+0000","last_became_active":"2024-04-04T06:56:29.048370+0000","last_became_peered":"2024-04-04T06:56:29.048370+0000","last_unstale":"2024-04-04T06:56:30.062555+0000","last_undegraded":"2024-04-04T06:56:30.062555+0000","last_fullsized":"2024-04-04T06:56:30.062555+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T08:11:58.552420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.019591+0000","last_change":"2024-04-04T06:56:29.043832+0000","last_active":"2024-04-04T06:56:30.019591+0000","last_peered":"2024-04-04T06:56:30.019591+0000","last_clean":"2024-04-04T06:56:30.019591+0000","last_became_active":"2024-04-04T06:56:29.043483+0000","last_became_peered":"2024-04-04T06:56:29.043483+0000","last_unstale":"2024-04-04T06:56:30.019591+0000","last_undegraded":"2024-04-04T06:56:30.019591+0000","last_fullsized":"2024-04-04T06:56:30.019591+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T16:54:06.987375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.701295+0000","last_change":"2024-04-04T06:56:29.051626+0000","last_active":"2024-04-04T06:56:30.701295+0000","last_peered":"2024-04-04T06:56:30.701295+0000","last_clean":"2024-04-04T06:56:30.701295+0000","last_became_active":"2024-04-04T06:56:29.051241+0000","last_became_peered":"2024-04-04T06:56:29.051241+0000","last_unstale":"2024-04-04T06:56:30.701295+0000","last_undegraded":"2024-04-04T06:56:30.701295+0000","last_fullsized":"2024-04-04T06:56:30.701295+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T13:04:16.108138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.698067+0000","last_change":"2024-04-04T06:56:29.042853+0000","last_active":"2024-04-04T06:56:30.698067+0000","last_peered":"2024-04-04T06:56:30.698067+0000","last_clean":"2024-04-04T06:56:30.698067+0000","last_became_active":"2024-04-04T06:56:29.041487+0000","last_became_peered":"2024-04-04T06:56:29.041487+0000","last_unstale":"2024-04-04T06:56:30.698067+0000","last_undegraded":"2024-04-04T06:56:30.698067+0000","last_fullsized":"2024-04-04T06:56:30.698067+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T17:11:13.036810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.015396+0000","last_change":"2024-04-04T06:56:29.043554+0000","last_active":"2024-04-04T06:56:30.015396+0000","last_peered":"2024-04-04T06:56:30.015396+0000","last_clean":"2024-04-04T06:56:30.015396+0000","last_became_active":"2024-04-04T06:56:29.043300+0000","last_became_peered":"2024-04-04T06:56:29.043300+0000","last_unstale":"2024-04-04T06:56:30.015396+0000","last_undegraded":"2024-04-04T06:56:30.015396+0000","last_fullsized":"2024-04-04T06:56:30.015396+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T15:25:18.489701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.698063+0000","last_change":"2024-04-04T06:56:29.038506+0000","last_active":"2024-04-04T06:56:30.698063+0000","last_peered":"2024-04-04T06:56:30.698063+0000","last_clean":"2024-04-04T06:56:30.698063+0000","last_became_active":"2024-04-04T06:56:29.038150+0000","last_became_peered":"2024-04-04T06:56:29.038150+0000","last_unstale":"2024-04-04T06:56:30.698063+0000","last_undegraded":"2024-04-04T06:56:30.698063+0000","last_fullsized":"2024-04-04T06:56:30.698063+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T16:44:39.332035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.699391+0000","last_change":"2024-04-04T06:56:29.049923+0000","last_active":"2024-04-04T06:56:30.699391+0000","last_peered":"2024-04-04T06:56:30.699391+0000","last_clean":"2024-04-04T06:56:30.699391+0000","last_became_active":"2024-04-04T06:56:29.049658+0000","last_became_peered":"2024-04-04T06:56:29.049658+0000","last_unstale":"2024-04-04T06:56:30.699391+0000","last_undegraded":"2024-04-04T06:56:30.699391+0000","last_fullsized":"2024-04-04T06:56:30.699391+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T09:03:00.078302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.697501+0000","last_change":"2024-04-04T06:56:29.042470+0000","last_active":"2024-04-04T06:56:30.697501+0000","last_peered":"2024-04-04T06:56:30.697501+0000","last_clean":"2024-04-04T06:56:30.697501+0000","last_became_active":"2024-04-04T06:56:29.041885+0000","last_became_peered":"2024-04-04T06:56:29.041885+0000","last_unstale":"2024-04-04T06:56:30.697501+0000","last_undegraded":"2024-04-04T06:56:30.697501+0000","last_fullsized":"2024-04-04T06:56:30.697501+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T12:35:21.057399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.021811+0000","last_change":"2024-04-04T06:56:29.042854+0000","last_active":"2024-04-04T06:56:30.021811+0000","last_peered":"2024-04-04T06:56:30.021811+0000","last_clean":"2024-04-04T06:56:30.021811+0000","last_became_active":"2024-04-04T06:56:29.042590+0000","last_became_peered":"2024-04-04T06:56:29.042590+0000","last_unstale":"2024-04-04T06:56:30.021811+0000","last_undegraded":"2024-04-04T06:56:30.021811+0000","last_fullsized":"2024-04-04T06:56:30.021811+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T18:19:42.642201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.062254+0000","last_change":"2024-04-04T06:56:29.051612+0000","last_active":"2024-04-04T06:56:30.062254+0000","last_peered":"2024-04-04T06:56:30.062254+0000","last_clean":"2024-04-04T06:56:30.062254+0000","last_became_active":"2024-04-04T06:56:29.051315+0000","last_became_peered":"2024-04-04T06:56:29.051315+0000","last_unstale":"2024-04-04T06:56:30.062254+0000","last_undegraded":"2024-04-04T06:56:30.062254+0000","last_fullsized":"2024-04-04T06:56:30.062254+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T13:04:16.108138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.698320+0000","last_change":"2024-04-04T06:56:29.038247+0000","last_active":"2024-04-04T06:56:30.698320+0000","last_peered":"2024-04-04T06:56:30.698320+0000","last_clean":"2024-04-04T06:56:30.698320+0000","last_became_active":"2024-04-04T06:56:29.037756+0000","last_became_peered":"2024-04-04T06:56:29.037756+0000","last_unstale":"2024-04-04T06:56:30.698320+0000","last_undegraded":"2024-04-04T06:56:30.698320+0000","last_fullsized":"2024-04-04T06:56:30.698320+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T10:40:36.659855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.698776+0000","last_change":"2024-04-04T06:56:29.048171+0000","last_active":"2024-04-04T06:56:30.698776+0000","last_peered":"2024-04-04T06:56:30.698776+0000","last_clean":"2024-04-04T06:56:30.698776+0000","last_became_active":"2024-04-04T06:56:29.045845+0000","last_became_peered":"2024-04-04T06:56:29.045845+0000","last_unstale":"2024-04-04T06:56:30.698776+0000","last_undegraded":"2024-04-04T06:56:30.698776+0000","last_fullsized":"2024-04-04T06:56:30.698776+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T08:09:51.101974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.701153+0000","last_change":"2024-04-04T06:56:29.051157+0000","last_active":"2024-04-04T06:56:30.701153+0000","last_peered":"2024-04-04T06:56:30.701153+0000","last_clean":"2024-04-04T06:56:30.701153+0000","last_became_active":"2024-04-04T06:56:29.050862+0000","last_became_peered":"2024-04-04T06:56:29.050862+0000","last_unstale":"2024-04-04T06:56:30.701153+0000","last_undegraded":"2024-04-04T06:56:30.701153+0000","last_fullsized":"2024-04-04T06:56:30.701153+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T10:04:08.170276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.699292+0000","last_change":"2024-04-04T06:56:29.052206+0000","last_active":"2024-04-04T06:56:30.699292+0000","last_peered":"2024-04-04T06:56:30.699292+0000","last_clean":"2024-04-04T06:56:30.699292+0000","last_became_active":"2024-04-04T06:56:29.051882+0000","last_became_peered":"2024-04-04T06:56:29.051882+0000","last_unstale":"2024-04-04T06:56:30.699292+0000","last_undegraded":"2024-04-04T06:56:30.699292+0000","last_fullsized":"2024-04-04T06:56:30.699292+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T17:09:54.896779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.701636+0000","last_change":"2024-04-04T06:56:29.052181+0000","last_active":"2024-04-04T06:56:30.701636+0000","last_peered":"2024-04-04T06:56:30.701636+0000","last_clean":"2024-04-04T06:56:30.701636+0000","last_became_active":"2024-04-04T06:56:29.052011+0000","last_became_peered":"2024-04-04T06:56:29.052011+0000","last_unstale":"2024-04-04T06:56:30.701636+0000","last_undegraded":"2024-04-04T06:56:30.701636+0000","last_fullsized":"2024-04-04T06:56:30.701636+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T18:13:03.204979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.062644+0000","last_change":"2024-04-04T06:56:29.050650+0000","last_active":"2024-04-04T06:56:30.062644+0000","last_peered":"2024-04-04T06:56:30.062644+0000","last_clean":"2024-04-04T06:56:30.062644+0000","last_became_active":"2024-04-04T06:56:29.050382+0000","last_became_peered":"2024-04-04T06:56:29.050382+0000","last_unstale":"2024-04-04T06:56:30.062644+0000","last_undegraded":"2024-04-04T06:56:30.062644+0000","last_fullsized":"2024-04-04T06:56:30.062644+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T16:44:39.332035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.016177+0000","last_change":"2024-04-04T06:56:29.058438+0000","last_active":"2024-04-04T06:56:30.016177+0000","last_peered":"2024-04-04T06:56:30.016177+0000","last_clean":"2024-04-04T06:56:30.016177+0000","last_became_active":"2024-04-04T06:56:29.058155+0000","last_became_peered":"2024-04-04T06:56:29.058155+0000","last_unstale":"2024-04-04T06:56:30.016177+0000","last_undegraded":"2024-04-04T06:56:30.016177+0000","last_fullsized":"2024-04-04T06:56:30.016177+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T12:11:26.884771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.701823+0000","last_change":"2024-04-04T06:56:29.055605+0000","last_active":"2024-04-04T06:56:30.701823+0000","last_peered":"2024-04-04T06:56:30.701823+0000","last_clean":"2024-04-04T06:56:30.701823+0000","last_became_active":"2024-04-04T06:56:29.052573+0000","last_became_peered":"2024-04-04T06:56:29.052573+0000","last_unstale":"2024-04-04T06:56:30.701823+0000","last_undegraded":"2024-04-04T06:56:30.701823+0000","last_fullsized":"2024-04-04T06:56:30.701823+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T08:09:51.101974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.698490+0000","last_change":"2024-04-04T06:56:29.054105+0000","last_active":"2024-04-04T06:56:30.698490+0000","last_peered":"2024-04-04T06:56:30.698490+0000","last_clean":"2024-04-04T06:56:30.698490+0000","last_became_active":"2024-04-04T06:56:29.053803+0000","last_became_peered":"2024-04-04T06:56:29.053803+0000","last_unstale":"2024-04-04T06:56:30.698490+0000","last_undegraded":"2024-04-04T06:56:30.698490+0000","last_fullsized":"2024-04-04T06:56:30.698490+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T10:04:08.170276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.698508+0000","last_change":"2024-04-04T06:56:29.058755+0000","last_active":"2024-04-04T06:56:30.698508+0000","last_peered":"2024-04-04T06:56:30.698508+0000","last_clean":"2024-04-04T06:56:30.698508+0000","last_became_active":"2024-04-04T06:56:29.058413+0000","last_became_peered":"2024-04-04T06:56:29.058413+0000","last_unstale":"2024-04-04T06:56:30.698508+0000","last_undegraded":"2024-04-04T06:56:30.698508+0000","last_fullsized":"2024-04-04T06:56:30.698508+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T18:13:03.204979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.697222+0000","last_change":"2024-04-04T06:56:29.047614+0000","last_active":"2024-04-04T06:56:30.697222+0000","last_peered":"2024-04-04T06:56:30.697222+0000","last_clean":"2024-04-04T06:56:30.697222+0000","last_became_active":"2024-04-04T06:56:29.047371+0000","last_became_peered":"2024-04-04T06:56:29.047371+0000","last_unstale":"2024-04-04T06:56:30.697222+0000","last_undegraded":"2024-04-04T06:56:30.697222+0000","last_fullsized":"2024-04-04T06:56:30.697222+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T15:15:24.660634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.061901+0000","last_change":"2024-04-04T06:56:29.052722+0000","last_active":"2024-04-04T06:56:30.061901+0000","last_peered":"2024-04-04T06:56:30.061901+0000","last_clean":"2024-04-04T06:56:30.061901+0000","last_became_active":"2024-04-04T06:56:29.052245+0000","last_became_peered":"2024-04-04T06:56:29.052245+0000","last_unstale":"2024-04-04T06:56:30.061901+0000","last_undegraded":"2024-04-04T06:56:30.061901+0000","last_fullsized":"2024-04-04T06:56:30.061901+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T15:25:18.489701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.019151+0000","last_change":"2024-04-04T06:56:29.042686+0000","last_active":"2024-04-04T06:56:30.019151+0000","last_peered":"2024-04-04T06:56:30.019151+0000","last_clean":"2024-04-04T06:56:30.019151+0000","last_became_active":"2024-04-04T06:56:29.042124+0000","last_became_peered":"2024-04-04T06:56:29.042124+0000","last_unstale":"2024-04-04T06:56:30.019151+0000","last_undegraded":"2024-04-04T06:56:30.019151+0000","last_fullsized":"2024-04-04T06:56:30.019151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T13:32:45.903109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.701378+0000","last_change":"2024-04-04T06:56:28.001896+0000","last_active":"2024-04-04T06:56:30.701378+0000","last_peered":"2024-04-04T06:56:30.701378+0000","last_clean":"2024-04-04T06:56:30.701378+0000","last_became_active":"2024-04-04T06:56:28.001625+0000","last_became_peered":"2024-04-04T06:56:28.001625+0000","last_unstale":"2024-04-04T06:56:30.701378+0000","last_undegraded":"2024-04-04T06:56:30.701378+0000","last_fullsized":"2024-04-04T06:56:30.701378+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_clean_scrub_stamp":"2024-04-04T06:56:26.956814+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T13:33:08.840819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.698738+0000","last_change":"2024-04-04T06:56:29.031379+0000","last_active":"2024-04-04T06:56:30.698738+0000","last_peered":"2024-04-04T06:56:30.698738+0000","last_clean":"2024-04-04T06:56:30.698738+0000","last_became_active":"2024-04-04T06:56:29.028243+0000","last_became_peered":"2024-04-04T06:56:29.028243+0000","last_unstale":"2024-04-04T06:56:30.698738+0000","last_undegraded":"2024-04-04T06:56:30.698738+0000","last_fullsized":"2024-04-04T06:56:30.698738+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T08:11:58.552420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.061880+0000","last_change":"2024-04-04T06:56:28.012107+0000","last_active":"2024-04-04T06:56:30.061880+0000","last_peered":"2024-04-04T06:56:30.061880+0000","last_clean":"2024-04-04T06:56:30.061880+0000","last_became_active":"2024-04-04T06:56:28.011477+0000","last_became_peered":"2024-04-04T06:56:28.011477+0000","last_unstale":"2024-04-04T06:56:30.061880+0000","last_undegraded":"2024-04-04T06:56:30.061880+0000","last_fullsized":"2024-04-04T06:56:30.061880+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_clean_scrub_stamp":"2024-04-04T06:56:26.956814+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T16:13:09.520714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.700896+0000","last_change":"2024-04-04T06:56:28.013179+0000","last_active":"2024-04-04T06:56:30.700896+0000","last_peered":"2024-04-04T06:56:30.700896+0000","last_clean":"2024-04-04T06:56:30.700896+0000","last_became_active":"2024-04-04T06:56:28.012858+0000","last_became_peered":"2024-04-04T06:56:28.012858+0000","last_unstale":"2024-04-04T06:56:30.700896+0000","last_undegraded":"2024-04-04T06:56:30.700896+0000","last_fullsized":"2024-04-04T06:56:30.700896+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_clean_scrub_stamp":"2024-04-04T06:56:26.956814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T13:47:51.595456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.700825+0000","last_change":"2024-04-04T06:56:29.058027+0000","last_active":"2024-04-04T06:56:30.700825+0000","last_peered":"2024-04-04T06:56:30.700825+0000","last_clean":"2024-04-04T06:56:30.700825+0000","last_became_active":"2024-04-04T06:56:29.055298+0000","last_became_peered":"2024-04-04T06:56:29.055298+0000","last_unstale":"2024-04-04T06:56:30.700825+0000","last_undegraded":"2024-04-04T06:56:30.700825+0000","last_fullsized":"2024-04-04T06:56:30.700825+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T18:01:37.763615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.698254+0000","last_change":"2024-04-04T06:56:28.007500+0000","last_active":"2024-04-04T06:56:30.698254+0000","last_peered":"2024-04-04T06:56:30.698254+0000","last_clean":"2024-04-04T06:56:30.698254+0000","last_became_active":"2024-04-04T06:56:28.007056+0000","last_became_peered":"2024-04-04T06:56:28.007056+0000","last_unstale":"2024-04-04T06:56:30.698254+0000","last_undegraded":"2024-04-04T06:56:30.698254+0000","last_fullsized":"2024-04-04T06:56:30.698254+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_clean_scrub_stamp":"2024-04-04T06:56:26.956814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T09:54:19.792854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.015421+0000","last_change":"2024-04-04T06:56:29.067716+0000","last_active":"2024-04-04T06:56:30.015421+0000","last_peered":"2024-04-04T06:56:30.015421+0000","last_clean":"2024-04-04T06:56:30.015421+0000","last_became_active":"2024-04-04T06:56:29.067142+0000","last_became_peered":"2024-04-04T06:56:29.067142+0000","last_unstale":"2024-04-04T06:56:30.015421+0000","last_undegraded":"2024-04-04T06:56:30.015421+0000","last_fullsized":"2024-04-04T06:56:30.015421+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T10:04:08.170276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.062468+0000","last_change":"2024-04-04T06:56:28.015953+0000","last_active":"2024-04-04T06:56:30.062468+0000","last_peered":"2024-04-04T06:56:30.062468+0000","last_clean":"2024-04-04T06:56:30.062468+0000","last_became_active":"2024-04-04T06:56:28.015699+0000","last_became_peered":"2024-04-04T06:56:28.015699+0000","last_unstale":"2024-04-04T06:56:30.062468+0000","last_undegraded":"2024-04-04T06:56:30.062468+0000","last_fullsized":"2024-04-04T06:56:30.062468+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_clean_scrub_stamp":"2024-04-04T06:56:26.956814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T08:38:32.735117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.698943+0000","last_change":"2024-04-04T06:56:29.046517+0000","last_active":"2024-04-04T06:56:30.698943+0000","last_peered":"2024-04-04T06:56:30.698943+0000","last_clean":"2024-04-04T06:56:30.698943+0000","last_became_active":"2024-04-04T06:56:29.046107+0000","last_became_peered":"2024-04-04T06:56:29.046107+0000","last_unstale":"2024-04-04T06:56:30.698943+0000","last_undegraded":"2024-04-04T06:56:30.698943+0000","last_fullsized":"2024-04-04T06:56:30.698943+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T12:03:12.792963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.699100+0000","last_change":"2024-04-04T06:56:28.019198+0000","last_active":"2024-04-04T06:56:30.699100+0000","last_peered":"2024-04-04T06:56:30.699100+0000","last_clean":"2024-04-04T06:56:30.699100+0000","last_became_active":"2024-04-04T06:56:28.018911+0000","last_became_peered":"2024-04-04T06:56:28.018911+0000","last_unstale":"2024-04-04T06:56:30.699100+0000","last_undegraded":"2024-04-04T06:56:30.699100+0000","last_fullsized":"2024-04-04T06:56:30.699100+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_clean_scrub_stamp":"2024-04-04T06:56:26.956814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T15:15:23.654438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.699396+0000","last_change":"2024-04-04T06:56:29.049229+0000","last_active":"2024-04-04T06:56:30.699396+0000","last_peered":"2024-04-04T06:56:30.699396+0000","last_clean":"2024-04-04T06:56:30.699396+0000","last_became_active":"2024-04-04T06:56:29.048110+0000","last_became_peered":"2024-04-04T06:56:29.048110+0000","last_unstale":"2024-04-04T06:56:30.699396+0000","last_undegraded":"2024-04-04T06:56:30.699396+0000","last_fullsized":"2024-04-04T06:56:30.699396+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T12:11:26.884771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.015873+0000","last_change":"2024-04-04T06:56:28.009331+0000","last_active":"2024-04-04T06:56:30.015873+0000","last_peered":"2024-04-04T06:56:30.015873+0000","last_clean":"2024-04-04T06:56:30.015873+0000","last_became_active":"2024-04-04T06:56:28.009044+0000","last_became_peered":"2024-04-04T06:56:28.009044+0000","last_unstale":"2024-04-04T06:56:30.015873+0000","last_undegraded":"2024-04-04T06:56:30.015873+0000","last_fullsized":"2024-04-04T06:56:30.015873+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_clean_scrub_stamp":"2024-04-04T06:56:26.956814+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T08:38:32.735117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.019776+0000","last_change":"2024-04-04T06:56:29.037028+0000","last_active":"2024-04-04T06:56:30.019776+0000","last_peered":"2024-04-04T06:56:30.019776+0000","last_clean":"2024-04-04T06:56:30.019776+0000","last_became_active":"2024-04-04T06:56:29.036771+0000","last_became_peered":"2024-04-04T06:56:29.036771+0000","last_unstale":"2024-04-04T06:56:30.019776+0000","last_undegraded":"2024-04-04T06:56:30.019776+0000","last_fullsized":"2024-04-04T06:56:30.019776+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T15:15:24.660634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.062098+0000","last_change":"2024-04-04T06:56:28.017650+0000","last_active":"2024-04-04T06:56:30.062098+0000","last_peered":"2024-04-04T06:56:30.062098+0000","last_clean":"2024-04-04T06:56:30.062098+0000","last_became_active":"2024-04-04T06:56:28.017083+0000","last_became_peered":"2024-04-04T06:56:28.017083+0000","last_unstale":"2024-04-04T06:56:30.062098+0000","last_undegraded":"2024-04-04T06:56:30.062098+0000","last_fullsized":"2024-04-04T06:56:30.062098+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_clean_scrub_stamp":"2024-04-04T06:56:26.956814+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T09:54:19.792854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.018695+0000","last_change":"2024-04-04T06:56:29.053241+0000","last_active":"2024-04-04T06:56:30.018695+0000","last_peered":"2024-04-04T06:56:30.018695+0000","last_clean":"2024-04-04T06:56:30.018695+0000","last_became_active":"2024-04-04T06:56:29.052948+0000","last_became_peered":"2024-04-04T06:56:29.052948+0000","last_unstale":"2024-04-04T06:56:30.018695+0000","last_undegraded":"2024-04-04T06:56:30.018695+0000","last_fullsized":"2024-04-04T06:56:30.018695+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T08:09:51.101974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.698548+0000","last_change":"2024-04-04T06:56:27.997550+0000","last_active":"2024-04-04T06:56:30.698548+0000","last_peered":"2024-04-04T06:56:30.698548+0000","last_clean":"2024-04-04T06:56:30.698548+0000","last_became_active":"2024-04-04T06:56:27.997242+0000","last_became_peered":"2024-04-04T06:56:27.997242+0000","last_unstale":"2024-04-04T06:56:30.698548+0000","last_undegraded":"2024-04-04T06:56:30.698548+0000","last_fullsized":"2024-04-04T06:56:30.698548+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_clean_scrub_stamp":"2024-04-04T06:56:26.956814+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T13:33:08.840819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.698091+0000","last_change":"2024-04-04T06:56:29.044039+0000","last_active":"2024-04-04T06:56:30.698091+0000","last_peered":"2024-04-04T06:56:30.698091+0000","last_clean":"2024-04-04T06:56:30.698091+0000","last_became_active":"2024-04-04T06:56:29.043302+0000","last_became_peered":"2024-04-04T06:56:29.043302+0000","last_unstale":"2024-04-04T06:56:30.698091+0000","last_undegraded":"2024-04-04T06:56:30.698091+0000","last_fullsized":"2024-04-04T06:56:30.698091+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T18:01:37.763615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.698610+0000","last_change":"2024-04-04T06:56:28.014841+0000","last_active":"2024-04-04T06:56:30.698610+0000","last_peered":"2024-04-04T06:56:30.698610+0000","last_clean":"2024-04-04T06:56:30.698610+0000","last_became_active":"2024-04-04T06:56:28.011606+0000","last_became_peered":"2024-04-04T06:56:28.011606+0000","last_unstale":"2024-04-04T06:56:30.698610+0000","last_undegraded":"2024-04-04T06:56:30.698610+0000","last_fullsized":"2024-04-04T06:56:30.698610+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_clean_scrub_stamp":"2024-04-04T06:56:26.956814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T13:32:44.896913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.021248+0000","last_change":"2024-04-04T06:56:29.035188+0000","last_active":"2024-04-04T06:56:30.021248+0000","last_peered":"2024-04-04T06:56:30.021248+0000","last_clean":"2024-04-04T06:56:30.021248+0000","last_became_active":"2024-04-04T06:56:29.034915+0000","last_became_peered":"2024-04-04T06:56:29.034915+0000","last_unstale":"2024-04-04T06:56:30.021248+0000","last_undegraded":"2024-04-04T06:56:30.021248+0000","last_fullsized":"2024-04-04T06:56:30.021248+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T16:01:05.840859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.061612+0000","last_change":"2024-04-04T06:56:28.016246+0000","last_active":"2024-04-04T06:56:30.061612+0000","last_peered":"2024-04-04T06:56:30.061612+0000","last_clean":"2024-04-04T06:56:30.061612+0000","last_became_active":"2024-04-04T06:56:28.014193+0000","last_became_peered":"2024-04-04T06:56:28.014193+0000","last_unstale":"2024-04-04T06:56:30.061612+0000","last_undegraded":"2024-04-04T06:56:30.061612+0000","last_fullsized":"2024-04-04T06:56:30.061612+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_clean_scrub_stamp":"2024-04-04T06:56:26.956814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T10:18:31.915978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.061865+0000","last_change":"2024-04-04T06:56:29.052430+0000","last_active":"2024-04-04T06:56:30.061865+0000","last_peered":"2024-04-04T06:56:30.061865+0000","last_clean":"2024-04-04T06:56:30.061865+0000","last_became_active":"2024-04-04T06:56:29.052112+0000","last_became_peered":"2024-04-04T06:56:29.052112+0000","last_unstale":"2024-04-04T06:56:30.061865+0000","last_undegraded":"2024-04-04T06:56:30.061865+0000","last_fullsized":"2024-04-04T06:56:30.061865+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T10:40:36.659855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.696511+0000","last_change":"2024-04-04T06:56:27.998416+0000","last_active":"2024-04-04T06:56:30.696511+0000","last_peered":"2024-04-04T06:56:30.696511+0000","last_clean":"2024-04-04T06:56:30.696511+0000","last_became_active":"2024-04-04T06:56:27.997342+0000","last_became_peered":"2024-04-04T06:56:27.997342+0000","last_unstale":"2024-04-04T06:56:30.696511+0000","last_undegraded":"2024-04-04T06:56:30.696511+0000","last_fullsized":"2024-04-04T06:56:30.696511+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_clean_scrub_stamp":"2024-04-04T06:56:26.956814+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T10:18:31.915978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.020893+0000","last_change":"2024-04-04T06:56:29.033505+0000","last_active":"2024-04-04T06:56:30.020893+0000","last_peered":"2024-04-04T06:56:30.020893+0000","last_clean":"2024-04-04T06:56:30.020893+0000","last_became_active":"2024-04-04T06:56:29.032725+0000","last_became_peered":"2024-04-04T06:56:29.032725+0000","last_unstale":"2024-04-04T06:56:30.020893+0000","last_undegraded":"2024-04-04T06:56:30.020893+0000","last_fullsized":"2024-04-04T06:56:30.020893+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T12:03:12.792963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.020304+0000","last_change":"2024-04-04T06:56:27.999979+0000","last_active":"2024-04-04T06:56:30.020304+0000","last_peered":"2024-04-04T06:56:30.020304+0000","last_clean":"2024-04-04T06:56:30.020304+0000","last_became_active":"2024-04-04T06:56:27.999169+0000","last_became_peered":"2024-04-04T06:56:27.999169+0000","last_unstale":"2024-04-04T06:56:30.020304+0000","last_undegraded":"2024-04-04T06:56:30.020304+0000","last_fullsized":"2024-04-04T06:56:30.020304+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_clean_scrub_stamp":"2024-04-04T06:56:26.956814+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T12:03:09.060630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.021458+0000","last_change":"2024-04-04T06:56:29.043619+0000","last_active":"2024-04-04T06:56:30.021458+0000","last_peered":"2024-04-04T06:56:30.021458+0000","last_clean":"2024-04-04T06:56:30.021458+0000","last_became_active":"2024-04-04T06:56:29.043335+0000","last_became_peered":"2024-04-04T06:56:29.043335+0000","last_unstale":"2024-04-04T06:56:30.021458+0000","last_undegraded":"2024-04-04T06:56:30.021458+0000","last_fullsized":"2024-04-04T06:56:30.021458+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T10:52:30.479480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.697225+0000","last_change":"2024-04-04T06:56:27.999367+0000","last_active":"2024-04-04T06:56:30.697225+0000","last_peered":"2024-04-04T06:56:30.697225+0000","last_clean":"2024-04-04T06:56:30.697225+0000","last_became_active":"2024-04-04T06:56:27.999073+0000","last_became_peered":"2024-04-04T06:56:27.999073+0000","last_unstale":"2024-04-04T06:56:30.697225+0000","last_undegraded":"2024-04-04T06:56:30.697225+0000","last_fullsized":"2024-04-04T06:56:30.697225+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_clean_scrub_stamp":"2024-04-04T06:56:26.956814+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T09:54:19.792854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.021694+0000","last_change":"2024-04-04T06:56:29.047512+0000","last_active":"2024-04-04T06:56:30.021694+0000","last_peered":"2024-04-04T06:56:30.021694+0000","last_clean":"2024-04-04T06:56:30.021694+0000","last_became_active":"2024-04-04T06:56:29.046259+0000","last_became_peered":"2024-04-04T06:56:29.046259+0000","last_unstale":"2024-04-04T06:56:30.021694+0000","last_undegraded":"2024-04-04T06:56:30.021694+0000","last_fullsized":"2024-04-04T06:56:30.021694+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T11:46:36.780783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.016251+0000","last_change":"2024-04-04T06:56:27.999707+0000","last_active":"2024-04-04T06:56:30.016251+0000","last_peered":"2024-04-04T06:56:30.016251+0000","last_clean":"2024-04-04T06:56:30.016251+0000","last_became_active":"2024-04-04T06:56:27.999398+0000","last_became_peered":"2024-04-04T06:56:27.999398+0000","last_unstale":"2024-04-04T06:56:30.016251+0000","last_undegraded":"2024-04-04T06:56:30.016251+0000","last_fullsized":"2024-04-04T06:56:30.016251+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_clean_scrub_stamp":"2024-04-04T06:56:26.956814+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T16:54:05.981179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.699399+0000","last_change":"2024-04-04T06:56:29.067217+0000","last_active":"2024-04-04T06:56:30.699399+0000","last_peered":"2024-04-04T06:56:30.699399+0000","last_clean":"2024-04-04T06:56:30.699399+0000","last_became_active":"2024-04-04T06:56:29.066762+0000","last_became_peered":"2024-04-04T06:56:29.066762+0000","last_unstale":"2024-04-04T06:56:30.699399+0000","last_undegraded":"2024-04-04T06:56:30.699399+0000","last_fullsized":"2024-04-04T06:56:30.699399+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T10:52:30.479480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.696812+0000","last_change":"2024-04-04T06:56:28.017607+0000","last_active":"2024-04-04T06:56:30.696812+0000","last_peered":"2024-04-04T06:56:30.696812+0000","last_clean":"2024-04-04T06:56:30.696812+0000","last_became_active":"2024-04-04T06:56:28.017322+0000","last_became_peered":"2024-04-04T06:56:28.017322+0000","last_unstale":"2024-04-04T06:56:30.696812+0000","last_undegraded":"2024-04-04T06:56:30.696812+0000","last_fullsized":"2024-04-04T06:56:30.696812+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_clean_scrub_stamp":"2024-04-04T06:56:26.956814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T16:13:09.520714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.020775+0000","last_change":"2024-04-04T06:56:29.044164+0000","last_active":"2024-04-04T06:56:30.020775+0000","last_peered":"2024-04-04T06:56:30.020775+0000","last_clean":"2024-04-04T06:56:30.020775+0000","last_became_active":"2024-04-04T06:56:29.043814+0000","last_became_peered":"2024-04-04T06:56:29.043814+0000","last_unstale":"2024-04-04T06:56:30.020775+0000","last_undegraded":"2024-04-04T06:56:30.020775+0000","last_fullsized":"2024-04-04T06:56:30.020775+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T10:24:01.060246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":170,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.017600+0000","last_change":"2024-04-04T06:56:19.364611+0000","last_active":"2024-04-04T06:56:30.017600+0000","last_peered":"2024-04-04T06:56:30.017600+0000","last_clean":"2024-04-04T06:56:30.017600+0000","last_became_active":"2024-04-04T06:56:19.362232+0000","last_became_peered":"2024-04-04T06:56:19.362232+0000","last_unstale":"2024-04-04T06:56:30.017600+0000","last_undegraded":"2024-04-04T06:56:30.017600+0000","last_fullsized":"2024-04-04T06:56:30.017600+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:17.744258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:17.744258+0000","last_clean_scrub_stamp":"2024-04-04T06:56:17.744258+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T17:25:16.494215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.698001+0000","last_change":"2024-04-04T06:56:28.009818+0000","last_active":"2024-04-04T06:56:30.698001+0000","last_peered":"2024-04-04T06:56:30.698001+0000","last_clean":"2024-04-04T06:56:30.698001+0000","last_became_active":"2024-04-04T06:56:28.005509+0000","last_became_peered":"2024-04-04T06:56:28.005509+0000","last_unstale":"2024-04-04T06:56:30.698001+0000","last_undegraded":"2024-04-04T06:56:30.698001+0000","last_fullsized":"2024-04-04T06:56:30.698001+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_clean_scrub_stamp":"2024-04-04T06:56:26.956814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T10:18:31.915978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.701399+0000","last_change":"2024-04-04T06:56:29.056563+0000","last_active":"2024-04-04T06:56:30.701399+0000","last_peered":"2024-04-04T06:56:30.701399+0000","last_clean":"2024-04-04T06:56:30.701399+0000","last_became_active":"2024-04-04T06:56:29.056289+0000","last_became_peered":"2024-04-04T06:56:29.056289+0000","last_unstale":"2024-04-04T06:56:30.701399+0000","last_undegraded":"2024-04-04T06:56:30.701399+0000","last_fullsized":"2024-04-04T06:56:30.701399+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T16:44:39.332035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.017655+0000","last_change":"2024-04-04T06:56:28.008107+0000","last_active":"2024-04-04T06:56:30.017655+0000","last_peered":"2024-04-04T06:56:30.017655+0000","last_clean":"2024-04-04T06:56:30.017655+0000","last_became_active":"2024-04-04T06:56:28.007840+0000","last_became_peered":"2024-04-04T06:56:28.007840+0000","last_unstale":"2024-04-04T06:56:30.017655+0000","last_undegraded":"2024-04-04T06:56:30.017655+0000","last_fullsized":"2024-04-04T06:56:30.017655+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_clean_scrub_stamp":"2024-04-04T06:56:26.956814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T16:54:05.981179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.697676+0000","last_change":"2024-04-04T06:56:29.026533+0000","last_active":"2024-04-04T06:56:30.697676+0000","last_peered":"2024-04-04T06:56:30.697676+0000","last_clean":"2024-04-04T06:56:30.697676+0000","last_became_active":"2024-04-04T06:56:29.025763+0000","last_became_peered":"2024-04-04T06:56:29.025763+0000","last_unstale":"2024-04-04T06:56:30.697676+0000","last_undegraded":"2024-04-04T06:56:30.697676+0000","last_fullsized":"2024-04-04T06:56:30.697676+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T14:56:36.711210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.696766+0000","last_change":"2024-04-04T06:56:27.994114+0000","last_active":"2024-04-04T06:56:30.696766+0000","last_peered":"2024-04-04T06:56:30.696766+0000","last_clean":"2024-04-04T06:56:30.696766+0000","last_became_active":"2024-04-04T06:56:27.993840+0000","last_became_peered":"2024-04-04T06:56:27.993840+0000","last_unstale":"2024-04-04T06:56:30.696766+0000","last_undegraded":"2024-04-04T06:56:30.696766+0000","last_fullsized":"2024-04-04T06:56:30.696766+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_clean_scrub_stamp":"2024-04-04T06:56:26.956814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T13:32:44.896913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.015501+0000","last_change":"2024-04-04T06:56:29.047339+0000","last_active":"2024-04-04T06:56:30.015501+0000","last_peered":"2024-04-04T06:56:30.015501+0000","last_clean":"2024-04-04T06:56:30.015501+0000","last_became_active":"2024-04-04T06:56:29.047084+0000","last_became_peered":"2024-04-04T06:56:29.047084+0000","last_unstale":"2024-04-04T06:56:30.015501+0000","last_undegraded":"2024-04-04T06:56:30.015501+0000","last_fullsized":"2024-04-04T06:56:30.015501+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T13:04:16.108138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.698907+0000","last_change":"2024-04-04T06:56:28.011081+0000","last_active":"2024-04-04T06:56:30.698907+0000","last_peered":"2024-04-04T06:56:30.698907+0000","last_clean":"2024-04-04T06:56:30.698907+0000","last_became_active":"2024-04-04T06:56:28.010741+0000","last_became_peered":"2024-04-04T06:56:28.010741+0000","last_unstale":"2024-04-04T06:56:30.698907+0000","last_undegraded":"2024-04-04T06:56:30.698907+0000","last_fullsized":"2024-04-04T06:56:30.698907+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_clean_scrub_stamp":"2024-04-04T06:56:26.956814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T08:38:32.735117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.019466+0000","last_change":"2024-04-04T06:56:29.038187+0000","last_active":"2024-04-04T06:56:30.019466+0000","last_peered":"2024-04-04T06:56:30.019466+0000","last_clean":"2024-04-04T06:56:30.019466+0000","last_became_active":"2024-04-04T06:56:29.037716+0000","last_became_peered":"2024-04-04T06:56:29.037716+0000","last_unstale":"2024-04-04T06:56:30.019466+0000","last_undegraded":"2024-04-04T06:56:30.019466+0000","last_fullsized":"2024-04-04T06:56:30.019466+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T08:38:33.741314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.015764+0000","last_change":"2024-04-04T06:56:28.006139+0000","last_active":"2024-04-04T06:56:30.015764+0000","last_peered":"2024-04-04T06:56:30.015764+0000","last_clean":"2024-04-04T06:56:30.015764+0000","last_became_active":"2024-04-04T06:56:28.005763+0000","last_became_peered":"2024-04-04T06:56:28.005763+0000","last_unstale":"2024-04-04T06:56:30.015764+0000","last_undegraded":"2024-04-04T06:56:30.015764+0000","last_fullsized":"2024-04-04T06:56:30.015764+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_clean_scrub_stamp":"2024-04-04T06:56:26.956814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T13:32:44.896913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.699033+0000","last_change":"2024-04-04T06:56:29.058128+0000","last_active":"2024-04-04T06:56:30.699033+0000","last_peered":"2024-04-04T06:56:30.699033+0000","last_clean":"2024-04-04T06:56:30.699033+0000","last_became_active":"2024-04-04T06:56:29.057809+0000","last_became_peered":"2024-04-04T06:56:29.057809+0000","last_unstale":"2024-04-04T06:56:30.699033+0000","last_undegraded":"2024-04-04T06:56:30.699033+0000","last_fullsized":"2024-04-04T06:56:30.699033+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T16:01:05.840859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.020996+0000","last_change":"2024-04-04T06:56:28.012156+0000","last_active":"2024-04-04T06:56:30.020996+0000","last_peered":"2024-04-04T06:56:30.020996+0000","last_clean":"2024-04-04T06:56:30.020996+0000","last_became_active":"2024-04-04T06:56:28.011880+0000","last_became_peered":"2024-04-04T06:56:28.011880+0000","last_unstale":"2024-04-04T06:56:30.020996+0000","last_undegraded":"2024-04-04T06:56:30.020996+0000","last_fullsized":"2024-04-04T06:56:30.020996+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_clean_scrub_stamp":"2024-04-04T06:56:26.956814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T10:21:04.212235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.015724+0000","last_change":"2024-04-04T06:56:29.042619+0000","last_active":"2024-04-04T06:56:30.015724+0000","last_peered":"2024-04-04T06:56:30.015724+0000","last_clean":"2024-04-04T06:56:30.015724+0000","last_became_active":"2024-04-04T06:56:29.042331+0000","last_became_peered":"2024-04-04T06:56:29.042331+0000","last_unstale":"2024-04-04T06:56:30.015724+0000","last_undegraded":"2024-04-04T06:56:30.015724+0000","last_fullsized":"2024-04-04T06:56:30.015724+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T08:11:58.552420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.016292+0000","last_change":"2024-04-04T06:56:28.014328+0000","last_active":"2024-04-04T06:56:30.016292+0000","last_peered":"2024-04-04T06:56:30.016292+0000","last_clean":"2024-04-04T06:56:30.016292+0000","last_became_active":"2024-04-04T06:56:28.014076+0000","last_became_peered":"2024-04-04T06:56:28.014076+0000","last_unstale":"2024-04-04T06:56:30.016292+0000","last_undegraded":"2024-04-04T06:56:30.016292+0000","last_fullsized":"2024-04-04T06:56:30.016292+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_clean_scrub_stamp":"2024-04-04T06:56:26.956814+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T15:15:23.654438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.701803+0000","last_change":"2024-04-04T06:56:29.051193+0000","last_active":"2024-04-04T06:56:30.701803+0000","last_peered":"2024-04-04T06:56:30.701803+0000","last_clean":"2024-04-04T06:56:30.701803+0000","last_became_active":"2024-04-04T06:56:29.045454+0000","last_became_peered":"2024-04-04T06:56:29.045454+0000","last_unstale":"2024-04-04T06:56:30.701803+0000","last_undegraded":"2024-04-04T06:56:30.701803+0000","last_fullsized":"2024-04-04T06:56:30.701803+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T17:04:57.682659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.062601+0000","last_change":"2024-04-04T06:56:28.012644+0000","last_active":"2024-04-04T06:56:30.062601+0000","last_peered":"2024-04-04T06:56:30.062601+0000","last_clean":"2024-04-04T06:56:30.062601+0000","last_became_active":"2024-04-04T06:56:28.012293+0000","last_became_peered":"2024-04-04T06:56:28.012293+0000","last_unstale":"2024-04-04T06:56:30.062601+0000","last_undegraded":"2024-04-04T06:56:30.062601+0000","last_fullsized":"2024-04-04T06:56:30.062601+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_clean_scrub_stamp":"2024-04-04T06:56:26.956814+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T13:32:44.896913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.698639+0000","last_change":"2024-04-04T06:56:29.044040+0000","last_active":"2024-04-04T06:56:30.698639+0000","last_peered":"2024-04-04T06:56:30.698639+0000","last_clean":"2024-04-04T06:56:30.698639+0000","last_became_active":"2024-04-04T06:56:29.042922+0000","last_became_peered":"2024-04-04T06:56:29.042922+0000","last_unstale":"2024-04-04T06:56:30.698639+0000","last_undegraded":"2024-04-04T06:56:30.698639+0000","last_fullsized":"2024-04-04T06:56:30.698639+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T13:04:16.108138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.017156+0000","last_change":"2024-04-04T06:56:28.012453+0000","last_active":"2024-04-04T06:56:30.017156+0000","last_peered":"2024-04-04T06:56:30.017156+0000","last_clean":"2024-04-04T06:56:30.017156+0000","last_became_active":"2024-04-04T06:56:28.011057+0000","last_became_peered":"2024-04-04T06:56:28.011057+0000","last_unstale":"2024-04-04T06:56:30.017156+0000","last_undegraded":"2024-04-04T06:56:30.017156+0000","last_fullsized":"2024-04-04T06:56:30.017156+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_clean_scrub_stamp":"2024-04-04T06:56:26.956814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T08:38:32.735117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.018349+0000","last_change":"2024-04-04T06:56:29.044746+0000","last_active":"2024-04-04T06:56:30.018349+0000","last_peered":"2024-04-04T06:56:30.018349+0000","last_clean":"2024-04-04T06:56:30.018349+0000","last_became_active":"2024-04-04T06:56:29.044423+0000","last_became_peered":"2024-04-04T06:56:29.044423+0000","last_unstale":"2024-04-04T06:56:30.018349+0000","last_undegraded":"2024-04-04T06:56:30.018349+0000","last_fullsized":"2024-04-04T06:56:30.018349+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T10:18:32.922174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.015451+0000","last_change":"2024-04-04T06:56:27.996226+0000","last_active":"2024-04-04T06:56:30.015451+0000","last_peered":"2024-04-04T06:56:30.015451+0000","last_clean":"2024-04-04T06:56:30.015451+0000","last_became_active":"2024-04-04T06:56:27.995835+0000","last_became_peered":"2024-04-04T06:56:27.995835+0000","last_unstale":"2024-04-04T06:56:30.015451+0000","last_undegraded":"2024-04-04T06:56:30.015451+0000","last_fullsized":"2024-04-04T06:56:30.015451+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_clean_scrub_stamp":"2024-04-04T06:56:26.956814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T09:54:19.792854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.701001+0000","last_change":"2024-04-04T06:56:29.056813+0000","last_active":"2024-04-04T06:56:30.701001+0000","last_peered":"2024-04-04T06:56:30.701001+0000","last_clean":"2024-04-04T06:56:30.701001+0000","last_became_active":"2024-04-04T06:56:29.052514+0000","last_became_peered":"2024-04-04T06:56:29.052514+0000","last_unstale":"2024-04-04T06:56:30.701001+0000","last_undegraded":"2024-04-04T06:56:30.701001+0000","last_fullsized":"2024-04-04T06:56:30.701001+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T10:40:36.659855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.015571+0000","last_change":"2024-04-04T06:56:27.999750+0000","last_active":"2024-04-04T06:56:30.015571+0000","last_peered":"2024-04-04T06:56:30.015571+0000","last_clean":"2024-04-04T06:56:30.015571+0000","last_became_active":"2024-04-04T06:56:27.997685+0000","last_became_peered":"2024-04-04T06:56:27.997685+0000","last_unstale":"2024-04-04T06:56:30.015571+0000","last_undegraded":"2024-04-04T06:56:30.015571+0000","last_fullsized":"2024-04-04T06:56:30.015571+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_clean_scrub_stamp":"2024-04-04T06:56:26.956814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T10:18:31.915978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.701301+0000","last_change":"2024-04-04T06:56:29.056179+0000","last_active":"2024-04-04T06:56:30.701301+0000","last_peered":"2024-04-04T06:56:30.701301+0000","last_clean":"2024-04-04T06:56:30.701301+0000","last_became_active":"2024-04-04T06:56:29.055682+0000","last_became_peered":"2024-04-04T06:56:29.055682+0000","last_unstale":"2024-04-04T06:56:30.701301+0000","last_undegraded":"2024-04-04T06:56:30.701301+0000","last_fullsized":"2024-04-04T06:56:30.701301+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T08:11:58.552420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.021102+0000","last_change":"2024-04-04T06:56:28.010871+0000","last_active":"2024-04-04T06:56:30.021102+0000","last_peered":"2024-04-04T06:56:30.021102+0000","last_clean":"2024-04-04T06:56:30.021102+0000","last_became_active":"2024-04-04T06:56:28.010159+0000","last_became_peered":"2024-04-04T06:56:28.010159+0000","last_unstale":"2024-04-04T06:56:30.021102+0000","last_undegraded":"2024-04-04T06:56:30.021102+0000","last_fullsized":"2024-04-04T06:56:30.021102+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_clean_scrub_stamp":"2024-04-04T06:56:26.956814+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T12:35:20.051203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.061957+0000","last_change":"2024-04-04T06:56:29.051332+0000","last_active":"2024-04-04T06:56:30.061957+0000","last_peered":"2024-04-04T06:56:30.061957+0000","last_clean":"2024-04-04T06:56:30.061957+0000","last_became_active":"2024-04-04T06:56:29.051026+0000","last_became_peered":"2024-04-04T06:56:29.051026+0000","last_unstale":"2024-04-04T06:56:30.061957+0000","last_undegraded":"2024-04-04T06:56:30.061957+0000","last_fullsized":"2024-04-04T06:56:30.061957+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T10:04:08.170276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.698934+0000","last_change":"2024-04-04T06:56:29.045951+0000","last_active":"2024-04-04T06:56:30.698934+0000","last_peered":"2024-04-04T06:56:30.698934+0000","last_clean":"2024-04-04T06:56:30.698934+0000","last_became_active":"2024-04-04T06:56:29.044806+0000","last_became_peered":"2024-04-04T06:56:29.044806+0000","last_unstale":"2024-04-04T06:56:30.698934+0000","last_undegraded":"2024-04-04T06:56:30.698934+0000","last_fullsized":"2024-04-04T06:56:30.698934+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T10:24:01.060246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.019571+0000","last_change":"2024-04-04T06:56:28.022012+0000","last_active":"2024-04-04T06:56:30.019571+0000","last_peered":"2024-04-04T06:56:30.019571+0000","last_clean":"2024-04-04T06:56:30.019571+0000","last_became_active":"2024-04-04T06:56:28.021708+0000","last_became_peered":"2024-04-04T06:56:28.021708+0000","last_unstale":"2024-04-04T06:56:30.019571+0000","last_undegraded":"2024-04-04T06:56:30.019571+0000","last_fullsized":"2024-04-04T06:56:30.019571+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_clean_scrub_stamp":"2024-04-04T06:56:26.956814+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T15:15:23.654438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.698972+0000","last_change":"2024-04-04T06:56:29.045589+0000","last_active":"2024-04-04T06:56:30.698972+0000","last_peered":"2024-04-04T06:56:30.698972+0000","last_clean":"2024-04-04T06:56:30.698972+0000","last_became_active":"2024-04-04T06:56:29.045071+0000","last_became_peered":"2024-04-04T06:56:29.045071+0000","last_unstale":"2024-04-04T06:56:30.698972+0000","last_undegraded":"2024-04-04T06:56:30.698972+0000","last_fullsized":"2024-04-04T06:56:30.698972+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T18:38:49.851932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.019137+0000","last_change":"2024-04-04T06:56:28.014130+0000","last_active":"2024-04-04T06:56:30.019137+0000","last_peered":"2024-04-04T06:56:30.019137+0000","last_clean":"2024-04-04T06:56:30.019137+0000","last_became_active":"2024-04-04T06:56:28.013846+0000","last_became_peered":"2024-04-04T06:56:28.013846+0000","last_unstale":"2024-04-04T06:56:30.019137+0000","last_undegraded":"2024-04-04T06:56:30.019137+0000","last_fullsized":"2024-04-04T06:56:30.019137+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_clean_scrub_stamp":"2024-04-04T06:56:26.956814+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T15:09:29.813629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.698978+0000","last_change":"2024-04-04T06:56:29.049076+0000","last_active":"2024-04-04T06:56:30.698978+0000","last_peered":"2024-04-04T06:56:30.698978+0000","last_clean":"2024-04-04T06:56:30.698978+0000","last_became_active":"2024-04-04T06:56:29.048096+0000","last_became_peered":"2024-04-04T06:56:29.048096+0000","last_unstale":"2024-04-04T06:56:30.698978+0000","last_undegraded":"2024-04-04T06:56:30.698978+0000","last_fullsized":"2024-04-04T06:56:30.698978+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T16:44:39.332035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.701741+0000","last_change":"2024-04-04T06:56:27.998042+0000","last_active":"2024-04-04T06:56:30.701741+0000","last_peered":"2024-04-04T06:56:30.701741+0000","last_clean":"2024-04-04T06:56:30.701741+0000","last_became_active":"2024-04-04T06:56:27.996925+0000","last_became_peered":"2024-04-04T06:56:27.996925+0000","last_unstale":"2024-04-04T06:56:30.701741+0000","last_undegraded":"2024-04-04T06:56:30.701741+0000","last_fullsized":"2024-04-04T06:56:30.701741+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_clean_scrub_stamp":"2024-04-04T06:56:26.956814+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T16:13:09.520714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.701597+0000","last_change":"2024-04-04T06:56:29.051673+0000","last_active":"2024-04-04T06:56:30.701597+0000","last_peered":"2024-04-04T06:56:30.701597+0000","last_clean":"2024-04-04T06:56:30.701597+0000","last_became_active":"2024-04-04T06:56:29.051400+0000","last_became_peered":"2024-04-04T06:56:29.051400+0000","last_unstale":"2024-04-04T06:56:30.701597+0000","last_undegraded":"2024-04-04T06:56:30.701597+0000","last_fullsized":"2024-04-04T06:56:30.701597+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T12:11:26.884771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.699097+0000","last_change":"2024-04-04T06:56:28.000376+0000","last_active":"2024-04-04T06:56:30.699097+0000","last_peered":"2024-04-04T06:56:30.699097+0000","last_clean":"2024-04-04T06:56:30.699097+0000","last_became_active":"2024-04-04T06:56:27.999779+0000","last_became_peered":"2024-04-04T06:56:27.999779+0000","last_unstale":"2024-04-04T06:56:30.699097+0000","last_undegraded":"2024-04-04T06:56:30.699097+0000","last_fullsized":"2024-04-04T06:56:30.699097+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_clean_scrub_stamp":"2024-04-04T06:56:26.956814+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T13:47:51.595456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27808,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344032,"statfs":{"total":96636764160,"available":96608288768,"internally_reserved":0,"allocated":802816,"data_stored":661884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":208896,"data_stored":71024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":71060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":70934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574852,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":212992,"data_stored":71094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":811008,"data_stored":661940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-04T06:56:34.082 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-04T06:56:34.082 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-04-04T06:56:34.083 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-04-04T06:56:34.083 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-04-04T06:56:34.083 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-04-04T06:56:34.326 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:34.328+0000 7f9718800640 1 Processor -- start 2024-04-04T06:56:34.326 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:34.328+0000 7f9718800640 1 -- start start 2024-04-04T06:56:34.327 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:34.329+0000 7f9718800640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f97100ccb20 0x7f97100ccfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:34.328 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:34.329+0000 7f9718800640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f97100c6710 con 0x7f971015c2d0 2024-04-04T06:56:34.328 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:34.329+0000 7f9718800640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f97100c69f0 con 0x7f9710071610 2024-04-04T06:56:34.328 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:34.329+0000 7f9718800640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f97100c6fb0 con 0x7f97100ccb20 2024-04-04T06:56:34.328 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:34.329+0000 7f9715e00640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f971015c2d0 0x7f971015c6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:52604/0 (socket says 172.21.15.72:52604) 2024-04-04T06:56:34.328 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:34.329+0000 7f9715e00640 1 -- 172.21.15.72:0/3435069198 learned_addr learned my addr 172.21.15.72:0/3435069198 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-04-04T06:56:34.330 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:34.330+0000 7f9716800640 1 --2- 172.21.15.72:0/3435069198 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f97100ccb20 0x7f97100ccfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:34.330 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:34.330+0000 7f9714a00640 1 -- 172.21.15.72:0/3435069198 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3793540180 0 0) 0x7f97100c6710 con 0x7f971015c2d0 2024-04-04T06:56:34.330 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:34.330+0000 7f9714a00640 1 -- 172.21.15.72:0/3435069198 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f96f8003520 con 0x7f971015c2d0 2024-04-04T06:56:34.330 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:34.330+0000 7f9714a00640 1 -- 172.21.15.72:0/3435069198 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2304849521 0 0) 0x7f96f8003520 con 0x7f971015c2d0 2024-04-04T06:56:34.330 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:34.330+0000 7f9714a00640 1 -- 172.21.15.72:0/3435069198 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f97100ccb20 msgr2=0x7f97100ccfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:56:34.330 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:34.330+0000 7f9714a00640 1 --2- 172.21.15.72:0/3435069198 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f97100ccb20 0x7f97100ccfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:34.330 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:34.330+0000 7f9714a00640 1 -- 172.21.15.72:0/3435069198 >> v1:172.21.15.117:6789/0 conn(0x7f9710071610 legacy=0x7f97100c5e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:34.330 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:34.330+0000 7f9714a00640 1 -- 172.21.15.72:0/3435069198 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97100c6cd0 con 0x7f971015c2d0 2024-04-04T06:56:34.330 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:34.330+0000 7f9714a00640 1 -- 172.21.15.72:0/3435069198 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2465650867 0 0) 0x7f9704001670 con 0x7f971015c2d0 2024-04-04T06:56:34.331 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:34.330+0000 7f9714a00640 1 -- 172.21.15.72:0/3435069198 >> v1:172.21.15.72:6789/0 conn(0x7f971015c2d0 legacy=0x7f971015c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:34.331 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:34.330+0000 7f9714a00640 1 --2- 172.21.15.72:0/3435069198 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f96f80039e0 0x7f96f8003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:34.331 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:34.330+0000 7f9714a00640 1 --2- 172.21.15.72:0/3435069198 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f96f8004800 0x7f96f8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:34.331 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:34.330+0000 7f9714a00640 1 --2- 172.21.15.72:0/3435069198 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f97100ccb20 0x7f96f8005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:34.331 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:34.330+0000 7f9714a00640 1 -- 172.21.15.72:0/3435069198 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f97100c6fb0 con 0x7f96f8004800 2024-04-04T06:56:34.331 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:34.330+0000 7f9714a00640 1 -- 172.21.15.72:0/3435069198 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f96f800baf0 con 0x7f96f80039e0 2024-04-04T06:56:34.331 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:34.330+0000 7f9714a00640 1 -- 172.21.15.72:0/3435069198 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f96f800bcf0 con 0x7f97100ccb20 2024-04-04T06:56:34.331 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:34.331+0000 7f9715400640 1 --2- 172.21.15.72:0/3435069198 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f96f8004800 0x7f96f8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:34.331 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:34.331+0000 7f9716800640 1 --2- 172.21.15.72:0/3435069198 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f97100ccb20 0x7f96f8005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:34.331 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:34.331+0000 7f9715e00640 1 --2- 172.21.15.72:0/3435069198 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f96f80039e0 0x7f96f8003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:34.331 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:34.331+0000 7f9715400640 1 -- 172.21.15.72:0/3435069198 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f97100ccb20 msgr2=0x7f96f8005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:56:34.331 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:34.331+0000 7f9715400640 1 --2- 172.21.15.72:0/3435069198 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f97100ccb20 0x7f96f8005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:34.331 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:34.331+0000 7f9715400640 1 -- 172.21.15.72:0/3435069198 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f96f80039e0 msgr2=0x7f96f8003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:56:34.332 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:34.331+0000 7f9715400640 1 --2- 172.21.15.72:0/3435069198 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f96f80039e0 0x7f96f8003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:34.332 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:34.331+0000 7f9715400640 1 -- 172.21.15.72:0/3435069198 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96f8003520 con 0x7f96f8004800 2024-04-04T06:56:34.332 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:34.331+0000 7f9715e00640 1 --2- 172.21.15.72:0/3435069198 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f96f80039e0 0x7f96f8003e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-04T06:56:34.332 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:34.331+0000 7f9716800640 1 --2- 172.21.15.72:0/3435069198 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f97100ccb20 0x7f96f8005200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-04T06:56:34.333 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:34.333+0000 7f9715400640 1 --2- 172.21.15.72:0/3435069198 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f96f8004800 0x7f96f8004c80 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f9700001750 tx=0x7f96f8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4552e82b76f4109 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:34.333 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:34.333+0000 7f9714a00640 1 -- 172.21.15.72:0/3435069198 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9700001370 con 0x7f96f8004800 2024-04-04T06:56:34.333 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:34.333+0000 7f9714a00640 1 -- 172.21.15.72:0/3435069198 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97000052d0 con 0x7f96f8004800 2024-04-04T06:56:34.333 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:34.333+0000 7f9714a00640 1 -- 172.21.15.72:0/3435069198 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9700003830 con 0x7f96f8004800 2024-04-04T06:56:34.333 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:34.333+0000 7f9718800640 1 -- 172.21.15.72:0/3435069198 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f96f8004800 msgr2=0x7f96f8004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:34.333 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:34.333+0000 7f9718800640 1 --2- 172.21.15.72:0/3435069198 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f96f8004800 0x7f96f8004c80 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f9700001750 tx=0x7f96f8005830 comp rx=0 tx=0).stop 2024-04-04T06:56:34.333 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:34.333+0000 7f9716800640 1 -- 172.21.15.72:0/3435069198 reap_dead start 2024-04-04T06:56:34.333 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:34.334+0000 7f9718800640 1 -- 172.21.15.72:0/3435069198 shutdown_connections 2024-04-04T06:56:34.333 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:34.334+0000 7f9718800640 1 -- 172.21.15.72:0/3435069198 >> 172.21.15.72:0/3435069198 conn(0x7f971006b470 msgr2=0x7f971006b880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:56:34.333 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:34.334+0000 7f9718800640 1 -- 172.21.15.72:0/3435069198 shutdown_connections 2024-04-04T06:56:34.334 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:34.334+0000 7f9718800640 1 -- 172.21.15.72:0/3435069198 wait complete. 2024-04-04T06:56:34.334 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:34.335+0000 7f9718800640 1 Processor -- start 2024-04-04T06:56:34.334 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:34.336+0000 7f9718800640 1 -- start start 2024-04-04T06:56:34.336 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:34.337+0000 7f9718800640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f96f8004800 0x7f9710154580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:34.336 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:34.337+0000 7f9718800640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f97100c8a30 0x7f97100cee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:34.336 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:34.337+0000 7f9718800640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f97100cf3d0 0x7f97100cbd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:34.336 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:34.337+0000 7f9718800640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f97100cd400 con 0x7f97100cf3d0 2024-04-04T06:56:34.336 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:34.337+0000 7f9718800640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f97100cd280 con 0x7f96f8004800 2024-04-04T06:56:34.336 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:34.337+0000 7f9718800640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f97100b3ea0 con 0x7f97100c8a30 2024-04-04T06:56:34.336 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:34.337+0000 7f9716800640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f97100cf3d0 0x7f97100cbd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:34.336 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:34.337+0000 7f9716800640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f97100cf3d0 0x7f97100cbd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46058/0 (socket says 172.21.15.72:46058) 2024-04-04T06:56:34.336 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:34.337+0000 7f9716800640 1 -- 172.21.15.72:0/2254343559 learned_addr learned my addr 172.21.15.72:0/2254343559 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:56:34.337 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:34.337+0000 7f9715400640 1 --2- 172.21.15.72:0/2254343559 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f97100c8a30 0x7f97100cee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:34.337 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:34.337+0000 7f9715e00640 1 --2- 172.21.15.72:0/2254343559 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f96f8004800 0x7f9710154580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:34.337 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:34.337+0000 7f9716800640 1 -- 172.21.15.72:0/2254343559 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f97100c8a30 msgr2=0x7f97100cee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:34.337 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:34.337+0000 7f9716800640 1 --2- 172.21.15.72:0/2254343559 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f97100c8a30 0x7f97100cee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:34.337 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:34.337+0000 7f9716800640 1 -- 172.21.15.72:0/2254343559 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f96f8004800 msgr2=0x7f9710154580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:34.337 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:34.337+0000 7f9716800640 1 --2- 172.21.15.72:0/2254343559 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f96f8004800 0x7f9710154580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:34.337 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:34.337+0000 7f9716800640 1 -- 172.21.15.72:0/2254343559 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97100cf8e0 con 0x7f97100cf3d0 2024-04-04T06:56:34.337 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:34.338+0000 7f9716800640 1 --2- 172.21.15.72:0/2254343559 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f97100cf3d0 0x7f97100cbd70 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f96f8004780 tx=0x7f970c00f4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:34.338 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:34.338+0000 7f970a000640 1 -- 172.21.15.72:0/2254343559 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f970c01c070 con 0x7f97100cf3d0 2024-04-04T06:56:34.338 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:34.338+0000 7f970a000640 1 -- 172.21.15.72:0/2254343559 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f970c017400 con 0x7f97100cf3d0 2024-04-04T06:56:34.338 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:34.338+0000 7f970a000640 1 -- 172.21.15.72:0/2254343559 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f970c0177d0 con 0x7f97100cf3d0 2024-04-04T06:56:34.338 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:34.338+0000 7f9718800640 1 -- 172.21.15.72:0/2254343559 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97100cfbc0 con 0x7f97100cf3d0 2024-04-04T06:56:34.338 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:34.338+0000 7f9718800640 1 -- 172.21.15.72:0/2254343559 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97100ad470 con 0x7f97100cf3d0 2024-04-04T06:56:34.338 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:34.339+0000 7f9718800640 1 -- 172.21.15.72:0/2254343559 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f97100ad670 con 0x7f97100cf3d0 2024-04-04T06:56:34.339 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:34.340+0000 7f970a000640 1 -- 172.21.15.72:0/2254343559 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f970c005d10 con 0x7f97100cf3d0 2024-04-04T06:56:34.339 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:34.341+0000 7f970a000640 1 --2- 172.21.15.72:0/2254343559 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f96f406c8f0 0x7f96f406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:34.340 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:34.341+0000 7f970a000640 1 -- 172.21.15.72:0/2254343559 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f970c08bd50 con 0x7f97100cf3d0 2024-04-04T06:56:34.340 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:34.341+0000 7f9715e00640 1 --2- 172.21.15.72:0/2254343559 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f96f406c8f0 0x7f96f406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:34.340 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:34.342+0000 7f9715e00640 1 --2- 172.21.15.72:0/2254343559 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f96f406c8f0 0x7f96f406edb0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f97040017e0 tx=0x7f9704009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:34.344 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:34.346+0000 7f970a000640 1 -- 172.21.15.72:0/2254343559 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f97100ad670 con 0x7f97100cf3d0 2024-04-04T06:56:34.597 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:34.598+0000 7f9718800640 1 -- 172.21.15.72:0/2254343559 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f9710075840 con 0x7f97100cf3d0 2024-04-04T06:56:34.602 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:34.603+0000 7f970a000640 1 -- 172.21.15.72:0/2254343559 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+174136 (secure 0 0 0) 0x7f970c08f030 con 0x7f97100cf3d0 2024-04-04T06:56:34.604 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T06:56:34.606 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:34.608+0000 7f9718800640 1 -- 172.21.15.72:0/2254343559 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f96f406c8f0 msgr2=0x7f96f406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:34.607 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:34.608+0000 7f9718800640 1 --2- 172.21.15.72:0/2254343559 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f96f406c8f0 0x7f96f406edb0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f97040017e0 tx=0x7f9704009040 comp rx=0 tx=0).stop 2024-04-04T06:56:34.607 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:34.608+0000 7f9718800640 1 -- 172.21.15.72:0/2254343559 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f97100cf3d0 msgr2=0x7f97100cbd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:34.607 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:34.608+0000 7f9718800640 1 --2- 172.21.15.72:0/2254343559 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f97100cf3d0 0x7f97100cbd70 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f96f8004780 tx=0x7f970c00f4a0 comp rx=0 tx=0).stop 2024-04-04T06:56:34.607 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:34.608+0000 7f9718800640 1 -- 172.21.15.72:0/2254343559 shutdown_connections 2024-04-04T06:56:34.607 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:34.608+0000 7f9718800640 1 --2- 172.21.15.72:0/2254343559 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f96f406c8f0 0x7f96f406edb0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:34.607 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:34.608+0000 7f9718800640 1 --2- 172.21.15.72:0/2254343559 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f97100cf3d0 0x7f97100cbd70 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:34.607 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:34.608+0000 7f9718800640 1 --2- 172.21.15.72:0/2254343559 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f97100c8a30 0x7f97100cee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:34.607 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:34.608+0000 7f9718800640 1 --2- 172.21.15.72:0/2254343559 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f96f8004800 0x7f9710154580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:34.607 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:34.608+0000 7f9718800640 1 -- 172.21.15.72:0/2254343559 >> 172.21.15.72:0/2254343559 conn(0x7f971006b470 msgr2=0x7f9710067280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:56:34.607 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:34.608+0000 7f9718800640 1 -- 172.21.15.72:0/2254343559 shutdown_connections 2024-04-04T06:56:34.607 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:34.608+0000 7f9718800640 1 -- 172.21.15.72:0/2254343559 wait complete. 2024-04-04T06:56:34.625 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":5,"flags":0,"active_gid":4101,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6832","nonce":2205173820},{"type":"v1","addr":"172.21.15.72:6833","nonce":2205173820}]},"active_addr":"172.21.15.72:6833/2205173820","active_change":"2024-04-04T06:56:09.368047+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4111,"name":"x","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.72:0","nonce":1701382667}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.72:0","nonce":587934133}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.72:0","nonce":2344630077}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.72:0","nonce":1259569398}]}]} 2024-04-04T06:56:34.629 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-04-04T06:56:34.629 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-04-04T06:56:34.629 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-04T06:56:34.826 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:34.827+0000 7fd4f8c00640 1 Processor -- start 2024-04-04T06:56:34.826 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:34.828+0000 7fd4f8c00640 1 -- start start 2024-04-04T06:56:34.828 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:34.829+0000 7fd4f8c00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd4f415e560 0x7fd4f40d2420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:34.828 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:34.829+0000 7fd4f8c00640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd4f415e940 con 0x7fd4f40b9e00 2024-04-04T06:56:34.828 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:34.829+0000 7fd4f8c00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd4f40d2e00 con 0x7fd4f40d2960 2024-04-04T06:56:34.828 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:34.829+0000 7fd4f8c00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fd4f40d30e0 con 0x7fd4f415e560 2024-04-04T06:56:34.828 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:34.829+0000 7fd4f1400640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fd4f40b9e00 0x7fd4f40d12d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:52618/0 (socket says 172.21.15.72:52618) 2024-04-04T06:56:34.828 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:34.829+0000 7fd4f1400640 1 -- 172.21.15.72:0/3259421131 learned_addr learned my addr 172.21.15.72:0/3259421131 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-04-04T06:56:34.830 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:34.830+0000 7fd4f1e00640 1 --2- 172.21.15.72:0/3259421131 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd4f415e560 0x7fd4f40d2420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:34.830 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:34.830+0000 7fd4f0a00640 1 -- 172.21.15.72:0/3259421131 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2902808456 0 0) 0x7fd4f415e940 con 0x7fd4f40b9e00 2024-04-04T06:56:34.830 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:34.830+0000 7fd4f0a00640 1 -- 172.21.15.72:0/3259421131 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd4d8003520 con 0x7fd4f40b9e00 2024-04-04T06:56:34.830 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:34.830+0000 7fd4f0a00640 1 -- 172.21.15.72:0/3259421131 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3092756999 0 0) 0x7fd4d8003520 con 0x7fd4f40b9e00 2024-04-04T06:56:34.830 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:34.830+0000 7fd4f0a00640 1 -- 172.21.15.72:0/3259421131 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd4f415e560 msgr2=0x7fd4f40d2420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:56:34.830 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:34.830+0000 7fd4f0a00640 1 --2- 172.21.15.72:0/3259421131 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd4f415e560 0x7fd4f40d2420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:34.830 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:34.830+0000 7fd4f0a00640 1 -- 172.21.15.72:0/3259421131 >> v1:172.21.15.117:6789/0 conn(0x7fd4f40d2960 legacy=0x7fd4f40b7510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:34.830 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:34.830+0000 7fd4f0a00640 1 -- 172.21.15.72:0/3259421131 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4f40d33c0 con 0x7fd4f40b9e00 2024-04-04T06:56:34.830 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:34.830+0000 7fd4f0a00640 1 -- 172.21.15.72:0/3259421131 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2465650867 0 0) 0x7fd4dc001690 con 0x7fd4f40b9e00 2024-04-04T06:56:34.830 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:34.830+0000 7fd4f0a00640 1 -- 172.21.15.72:0/3259421131 >> v1:172.21.15.72:6789/0 conn(0x7fd4f40b9e00 legacy=0x7fd4f40d12d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:34.830 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:34.830+0000 7fd4f0a00640 1 --2- 172.21.15.72:0/3259421131 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd4d80039e0 0x7fd4d8003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:34.831 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:34.830+0000 7fd4f0a00640 1 --2- 172.21.15.72:0/3259421131 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd4f415e560 0x7fd4d8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:34.831 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:34.830+0000 7fd4f0a00640 1 --2- 172.21.15.72:0/3259421131 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd4d8004d40 0x7fd4d80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:34.831 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:34.831+0000 7fd4f0a00640 1 -- 172.21.15.72:0/3259421131 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fd4f40d30e0 con 0x7fd4d80039e0 2024-04-04T06:56:34.831 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:34.831+0000 7fd4f0a00640 1 -- 172.21.15.72:0/3259421131 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fd4d800ba70 con 0x7fd4d8004d40 2024-04-04T06:56:34.831 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:34.831+0000 7fd4f0a00640 1 -- 172.21.15.72:0/3259421131 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fd4d800bc70 con 0x7fd4f415e560 2024-04-04T06:56:34.831 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:34.831+0000 7fd4f1e00640 1 --2- 172.21.15.72:0/3259421131 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd4d80039e0 0x7fd4d8003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:34.831 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:34.831+0000 7fd4f1400640 1 --2- 172.21.15.72:0/3259421131 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd4f415e560 0x7fd4d8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:34.831 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:34.831+0000 7fd4f1e00640 1 -- 172.21.15.72:0/3259421131 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd4f415e560 msgr2=0x7fd4d8004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:56:34.831 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:34.831+0000 7fd4f2800640 1 --2- 172.21.15.72:0/3259421131 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd4d8004d40 0x7fd4d80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:34.831 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:34.831+0000 7fd4f1e00640 1 --2- 172.21.15.72:0/3259421131 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd4f415e560 0x7fd4d8004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:34.831 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:34.831+0000 7fd4f1e00640 1 -- 172.21.15.72:0/3259421131 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd4d8004d40 msgr2=0x7fd4d80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:56:34.832 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:34.831+0000 7fd4f1e00640 1 --2- 172.21.15.72:0/3259421131 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd4d8004d40 0x7fd4d80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:34.832 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:34.831+0000 7fd4f1e00640 1 -- 172.21.15.72:0/3259421131 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4d8003520 con 0x7fd4d80039e0 2024-04-04T06:56:34.832 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:34.831+0000 7fd4f1400640 1 --2- 172.21.15.72:0/3259421131 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd4f415e560 0x7fd4d8004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-04T06:56:34.832 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:34.831+0000 7fd4f2800640 1 --2- 172.21.15.72:0/3259421131 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd4d8004d40 0x7fd4d80051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-04T06:56:34.833 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:34.832+0000 7fd4f1e00640 1 --2- 172.21.15.72:0/3259421131 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd4d80039e0 0x7fd4d8003e00 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fd4e4009a90 tx=0x7fd4d8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=794ab26448e2c336 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:34.833 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:34.833+0000 7fd4f0a00640 1 -- 172.21.15.72:0/3259421131 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4e4039070 con 0x7fd4d80039e0 2024-04-04T06:56:34.833 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:34.833+0000 7fd4f0a00640 1 -- 172.21.15.72:0/3259421131 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4e402c680 con 0x7fd4d80039e0 2024-04-04T06:56:34.833 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:34.833+0000 7fd4f0a00640 1 -- 172.21.15.72:0/3259421131 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4e4009690 con 0x7fd4d80039e0 2024-04-04T06:56:34.833 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:34.833+0000 7fd4f8c00640 1 -- 172.21.15.72:0/3259421131 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd4d80039e0 msgr2=0x7fd4d8003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:34.833 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:34.833+0000 7fd4f8c00640 1 --2- 172.21.15.72:0/3259421131 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd4d80039e0 0x7fd4d8003e00 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fd4e4009a90 tx=0x7fd4d8005830 comp rx=0 tx=0).stop 2024-04-04T06:56:34.833 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:34.833+0000 7fd4f2800640 1 -- 172.21.15.72:0/3259421131 reap_dead start 2024-04-04T06:56:34.833 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:34.833+0000 7fd4f8c00640 1 -- 172.21.15.72:0/3259421131 shutdown_connections 2024-04-04T06:56:34.833 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:34.833+0000 7fd4f8c00640 1 -- 172.21.15.72:0/3259421131 >> 172.21.15.72:0/3259421131 conn(0x7fd4f4071e80 msgr2=0x7fd4f4072290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:56:34.833 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:34.834+0000 7fd4f8c00640 1 -- 172.21.15.72:0/3259421131 shutdown_connections 2024-04-04T06:56:34.834 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:34.834+0000 7fd4f8c00640 1 -- 172.21.15.72:0/3259421131 wait complete. 2024-04-04T06:56:34.834 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:34.835+0000 7fd4f8c00640 1 Processor -- start 2024-04-04T06:56:34.834 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:34.835+0000 7fd4f8c00640 1 -- start start 2024-04-04T06:56:34.835 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:34.836+0000 7fd4f8c00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd4d80039e0 0x7fd4f4154a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:34.835 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:34.836+0000 7fd4f8c00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd4f41564e0 0x7fd4f40c9e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:34.835 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:34.836+0000 7fd4f8c00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd4f40c7f10 0x7fd4f40c83c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:34.835 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:34.836+0000 7fd4f8c00640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fd4f40d19e0 con 0x7fd4f41564e0 2024-04-04T06:56:34.835 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:34.836+0000 7fd4f8c00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fd4f40d3980 con 0x7fd4f40c7f10 2024-04-04T06:56:34.835 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:34.836+0000 7fd4f8c00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fd4f40d1b60 con 0x7fd4d80039e0 2024-04-04T06:56:34.835 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:34.837+0000 7fd4f1400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd4f41564e0 0x7fd4f40c9e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:34.835 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:34.837+0000 7fd4f1400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd4f41564e0 0x7fd4f40c9e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46076/0 (socket says 172.21.15.72:46076) 2024-04-04T06:56:34.835 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:34.837+0000 7fd4f1400640 1 -- 172.21.15.72:0/3894916925 learned_addr learned my addr 172.21.15.72:0/3894916925 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:56:34.836 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:34.837+0000 7fd4f1400640 1 -- 172.21.15.72:0/3894916925 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd4d80039e0 msgr2=0x7fd4f4154a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:34.837 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:34.837+0000 7fd4f2800640 1 --2- 172.21.15.72:0/3894916925 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd4f40c7f10 0x7fd4f40c83c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:34.837 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:34.837+0000 7fd4f1400640 1 --2- 172.21.15.72:0/3894916925 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd4d80039e0 0x7fd4f4154a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:34.837 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:34.837+0000 7fd4f1400640 1 -- 172.21.15.72:0/3894916925 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd4f40c7f10 msgr2=0x7fd4f40c83c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:34.837 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:34.837+0000 7fd4f1400640 1 --2- 172.21.15.72:0/3894916925 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd4f40c7f10 0x7fd4f40c83c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:34.837 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:34.837+0000 7fd4f1400640 1 -- 172.21.15.72:0/3894916925 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4f40ca5b0 con 0x7fd4f41564e0 2024-04-04T06:56:34.837 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:34.837+0000 7fd4f2800640 1 --2- 172.21.15.72:0/3894916925 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd4f40c7f10 0x7fd4f40c83c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-04T06:56:34.837 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:34.837+0000 7fd4f1400640 1 --2- 172.21.15.72:0/3894916925 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd4f41564e0 0x7fd4f40c9e30 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fd4dc000f60 tx=0x7fd4dc00df70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:34.837 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:34.838+0000 7fd4ea000640 1 -- 172.21.15.72:0/3894916925 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4dc019070 con 0x7fd4f41564e0 2024-04-04T06:56:34.837 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:34.838+0000 7fd4ea000640 1 -- 172.21.15.72:0/3894916925 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4dc0074e0 con 0x7fd4f41564e0 2024-04-04T06:56:34.837 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:34.838+0000 7fd4f8c00640 1 -- 172.21.15.72:0/3894916925 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4f40ca890 con 0x7fd4f41564e0 2024-04-04T06:56:34.837 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:34.838+0000 7fd4ea000640 1 -- 172.21.15.72:0/3894916925 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4dc0047e0 con 0x7fd4f41564e0 2024-04-04T06:56:34.837 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:34.838+0000 7fd4f8c00640 1 -- 172.21.15.72:0/3894916925 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4f40c8900 con 0x7fd4f41564e0 2024-04-04T06:56:34.838 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:34.839+0000 7fd4f8c00640 1 -- 172.21.15.72:0/3894916925 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd4f4075840 con 0x7fd4f41564e0 2024-04-04T06:56:34.838 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:34.840+0000 7fd4ea000640 1 -- 172.21.15.72:0/3894916925 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd4dc01c070 con 0x7fd4f41564e0 2024-04-04T06:56:34.839 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:34.841+0000 7fd4ea000640 1 --2- 172.21.15.72:0/3894916925 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fd4d006c920 0x7fd4d006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:34.839 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:34.841+0000 7fd4ea000640 1 -- 172.21.15.72:0/3894916925 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fd4dc08b7d0 con 0x7fd4f41564e0 2024-04-04T06:56:34.839 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:34.841+0000 7fd4f1e00640 1 --2- 172.21.15.72:0/3894916925 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fd4d006c920 0x7fd4d006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:34.840 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:34.842+0000 7fd4f1e00640 1 --2- 172.21.15.72:0/3894916925 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fd4d006c920 0x7fd4d006ede0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd4e4036000 tx=0x7fd4e402e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:34.843 INFO:tasks.ceph.mds.c.smithi072.stderr:2024-04-04T06:56:34.845+0000 7f8110a00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-04T06:56:34.844 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:34.845+0000 7fd4ea000640 1 -- 172.21.15.72:0/3894916925 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fd4dc059b60 con 0x7fd4f41564e0 2024-04-04T06:56:35.043 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.044+0000 7fd4f8c00640 1 -- 172.21.15.72:0/3894916925 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd4f40c7cd0 con 0x7fd4f41564e0 2024-04-04T06:56:35.044 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.046+0000 7fd4ea000640 1 -- 172.21.15.72:0/3894916925 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16581 (secure 0 0 0) 0x7fd4dc059460 con 0x7fd4f41564e0 2024-04-04T06:56:35.045 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T06:56:35.045 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":20,"fsid":"6708bac2-4f50-49b5-87a9-c390fd333eb3","created":"2024-04-04T06:56:04.282498+0000","modified":"2024-04-04T06:56:30.007371+0000","last_up_change":"2024-04-04T06:56:16.716089+0000","last_in_change":"2024-04-04T06:56:07.768593+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-04T06:56:17.421685+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-04T06:56:26.822661+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-04T06:56:27.429816+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7c345991-5af8-4dc6-a481-28610c40e128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":3889813953},{"type":"v1","addr":"172.21.15.72:6818","nonce":3889813953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":3889813953},{"type":"v1","addr":"172.21.15.72:6821","nonce":3889813953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":3889813953},{"type":"v1","addr":"172.21.15.72:6826","nonce":3889813953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":3889813953},{"type":"v1","addr":"172.21.15.72:6823","nonce":3889813953}]},"public_addr":"172.21.15.72:6818/3889813953","cluster_addr":"172.21.15.72:6821/3889813953","heartbeat_back_addr":"172.21.15.72:6826/3889813953","heartbeat_front_addr":"172.21.15.72:6823/3889813953","state":["exists","up"]},{"osd":1,"uuid":"1b3f7ab2-a56c-488d-a89a-1f3572361c95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":3101663154},{"type":"v1","addr":"172.21.15.72:6801","nonce":3101663154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":3101663154},{"type":"v1","addr":"172.21.15.72:6803","nonce":3101663154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":3101663154},{"type":"v1","addr":"172.21.15.72:6807","nonce":3101663154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":3101663154},{"type":"v1","addr":"172.21.15.72:6805","nonce":3101663154}]},"public_addr":"172.21.15.72:6801/3101663154","cluster_addr":"172.21.15.72:6803/3101663154","heartbeat_back_addr":"172.21.15.72:6807/3101663154","heartbeat_front_addr":"172.21.15.72:6805/3101663154","state":["exists","up"]},{"osd":2,"uuid":"fc9aa512-53df-40d7-ba04-3e6b7dcd1e34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":235374192},{"type":"v1","addr":"172.21.15.72:6809","nonce":235374192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":235374192},{"type":"v1","addr":"172.21.15.72:6811","nonce":235374192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":235374192},{"type":"v1","addr":"172.21.15.72:6815","nonce":235374192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":235374192},{"type":"v1","addr":"172.21.15.72:6813","nonce":235374192}]},"public_addr":"172.21.15.72:6809/235374192","cluster_addr":"172.21.15.72:6811/235374192","heartbeat_back_addr":"172.21.15.72:6815/235374192","heartbeat_front_addr":"172.21.15.72:6813/235374192","state":["exists","up"]},{"osd":3,"uuid":"b4f63eed-dc5b-4aba-bb50-de46eb41492b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6817","nonce":2806631742},{"type":"v1","addr":"172.21.15.72:6819","nonce":2806631742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":2806631742},{"type":"v1","addr":"172.21.15.72:6827","nonce":2806631742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":2806631742},{"type":"v1","addr":"172.21.15.72:6831","nonce":2806631742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":2806631742},{"type":"v1","addr":"172.21.15.72:6829","nonce":2806631742}]},"public_addr":"172.21.15.72:6819/2806631742","cluster_addr":"172.21.15.72:6827/2806631742","heartbeat_back_addr":"172.21.15.72:6831/2806631742","heartbeat_front_addr":"172.21.15.72:6829/2806631742","state":["exists","up"]},{"osd":4,"uuid":"9e985ef8-d711-4172-9286-c54e560895d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":4293536423},{"type":"v1","addr":"172.21.15.117:6825","nonce":4293536423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":4293536423},{"type":"v1","addr":"172.21.15.117:6827","nonce":4293536423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":4293536423},{"type":"v1","addr":"172.21.15.117:6831","nonce":4293536423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":4293536423},{"type":"v1","addr":"172.21.15.117:6829","nonce":4293536423}]},"public_addr":"172.21.15.117:6825/4293536423","cluster_addr":"172.21.15.117:6827/4293536423","heartbeat_back_addr":"172.21.15.117:6831/4293536423","heartbeat_front_addr":"172.21.15.117:6829/4293536423","state":["exists","up"]},{"osd":5,"uuid":"3e9f082b-8d7d-455f-8a96-66d0b4857125","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":684971679},{"type":"v1","addr":"172.21.15.117:6801","nonce":684971679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":684971679},{"type":"v1","addr":"172.21.15.117:6803","nonce":684971679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":684971679},{"type":"v1","addr":"172.21.15.117:6807","nonce":684971679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":684971679},{"type":"v1","addr":"172.21.15.117:6805","nonce":684971679}]},"public_addr":"172.21.15.117:6801/684971679","cluster_addr":"172.21.15.117:6803/684971679","heartbeat_back_addr":"172.21.15.117:6807/684971679","heartbeat_front_addr":"172.21.15.117:6805/684971679","state":["exists","up"]},{"osd":6,"uuid":"bcdafa9f-a870-4398-a38d-ab7697676473","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":2781186528},{"type":"v1","addr":"172.21.15.117:6809","nonce":2781186528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":2781186528},{"type":"v1","addr":"172.21.15.117:6811","nonce":2781186528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":2781186528},{"type":"v1","addr":"172.21.15.117:6815","nonce":2781186528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":2781186528},{"type":"v1","addr":"172.21.15.117:6813","nonce":2781186528}]},"public_addr":"172.21.15.117:6809/2781186528","cluster_addr":"172.21.15.117:6811/2781186528","heartbeat_back_addr":"172.21.15.117:6815/2781186528","heartbeat_front_addr":"172.21.15.117:6813/2781186528","state":["exists","up"]},{"osd":7,"uuid":"b68ec562-ff35-4d2d-a733-c896f8920cfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":617469882},{"type":"v1","addr":"172.21.15.117:6817","nonce":617469882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":617469882},{"type":"v1","addr":"172.21.15.117:6819","nonce":617469882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":617469882},{"type":"v1","addr":"172.21.15.117:6823","nonce":617469882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":617469882},{"type":"v1","addr":"172.21.15.117:6821","nonce":617469882}]},"public_addr":"172.21.15.117:6817/617469882","cluster_addr":"172.21.15.117:6819/617469882","heartbeat_back_addr":"172.21.15.117:6823/617469882","heartbeat_front_addr":"172.21.15.117:6821/617469882","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.347700+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.296619+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.361345+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.093323+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:12.857605+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:12.816090+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.083163+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.121639+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-04T06:56:35.048 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.049+0000 7fd4f8c00640 1 -- 172.21.15.72:0/3894916925 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fd4d006c920 msgr2=0x7fd4d006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:35.048 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.049+0000 7fd4f8c00640 1 --2- 172.21.15.72:0/3894916925 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fd4d006c920 0x7fd4d006ede0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd4e4036000 tx=0x7fd4e402e000 comp rx=0 tx=0).stop 2024-04-04T06:56:35.048 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.049+0000 7fd4f8c00640 1 -- 172.21.15.72:0/3894916925 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd4f41564e0 msgr2=0x7fd4f40c9e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:35.048 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.049+0000 7fd4f8c00640 1 --2- 172.21.15.72:0/3894916925 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd4f41564e0 0x7fd4f40c9e30 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fd4dc000f60 tx=0x7fd4dc00df70 comp rx=0 tx=0).stop 2024-04-04T06:56:35.048 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.049+0000 7fd4f8c00640 1 -- 172.21.15.72:0/3894916925 shutdown_connections 2024-04-04T06:56:35.048 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.049+0000 7fd4f8c00640 1 --2- 172.21.15.72:0/3894916925 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fd4d006c920 0x7fd4d006ede0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:35.048 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.049+0000 7fd4f8c00640 1 --2- 172.21.15.72:0/3894916925 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd4f40c7f10 0x7fd4f40c83c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:35.048 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.049+0000 7fd4f8c00640 1 --2- 172.21.15.72:0/3894916925 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd4f41564e0 0x7fd4f40c9e30 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:35.048 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.049+0000 7fd4f8c00640 1 --2- 172.21.15.72:0/3894916925 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd4d80039e0 0x7fd4f4154a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:35.048 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.049+0000 7fd4f8c00640 1 -- 172.21.15.72:0/3894916925 >> 172.21.15.72:0/3894916925 conn(0x7fd4f4071e80 msgr2=0x7fd4f4072290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:56:35.048 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.049+0000 7fd4f8c00640 1 -- 172.21.15.72:0/3894916925 shutdown_connections 2024-04-04T06:56:35.048 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.049+0000 7fd4f8c00640 1 -- 172.21.15.72:0/3894916925 wait complete. 2024-04-04T06:56:35.065 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-04-04T06:56:35.066 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-04T06:56:35.267 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.268+0000 7efd3dc00640 1 Processor -- start 2024-04-04T06:56:35.267 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.268+0000 7efd3dc00640 1 -- start start 2024-04-04T06:56:35.269 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.270+0000 7efd3dc00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7efd380d19e0 0x7efd38169080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:35.269 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.270+0000 7efd3dc00640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efd3815e940 con 0x7efd3815e560 2024-04-04T06:56:35.269 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.270+0000 7efd3dc00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efd380d2b30 con 0x7efd380b9e00 2024-04-04T06:56:35.269 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.270+0000 7efd3dc00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7efd380b8520 con 0x7efd380d19e0 2024-04-04T06:56:35.269 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.270+0000 7efd36a00640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7efd3815e560 0x7efd380d2420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:52620/0 (socket says 172.21.15.72:52620) 2024-04-04T06:56:35.269 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.270+0000 7efd36a00640 1 -- 172.21.15.72:0/3734557401 learned_addr learned my addr 172.21.15.72:0/3734557401 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-04-04T06:56:35.271 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.271+0000 7efd35600640 1 -- 172.21.15.72:0/3734557401 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4036534484 0 0) 0x7efd3815e940 con 0x7efd3815e560 2024-04-04T06:56:35.272 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.271+0000 7efd35600640 1 -- 172.21.15.72:0/3734557401 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efd1c003520 con 0x7efd3815e560 2024-04-04T06:56:35.272 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.271+0000 7efd37400640 1 --2- 172.21.15.72:0/3734557401 >> v2:172.21.15.117:3300/0 conn(0x7efd380d19e0 0x7efd38169080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:35.272 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.271+0000 7efd35600640 1 -- 172.21.15.72:0/3734557401 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2669946086 0 0) 0x7efd1c003520 con 0x7efd3815e560 2024-04-04T06:56:35.272 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.271+0000 7efd35600640 1 -- 172.21.15.72:0/3734557401 >> v2:172.21.15.117:3300/0 conn(0x7efd380d19e0 msgr2=0x7efd38169080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:56:35.272 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.271+0000 7efd35600640 1 --2- 172.21.15.72:0/3734557401 >> v2:172.21.15.117:3300/0 conn(0x7efd380d19e0 0x7efd38169080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:35.272 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.271+0000 7efd35600640 1 -- 172.21.15.72:0/3734557401 >> v1:172.21.15.117:6789/0 conn(0x7efd380b9e00 legacy=0x7efd380d12d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:35.272 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.271+0000 7efd35600640 1 -- 172.21.15.72:0/3734557401 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd380d2e00 con 0x7efd3815e560 2024-04-04T06:56:35.272 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.271+0000 7efd35600640 1 -- 172.21.15.72:0/3734557401 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2465650867 0 0) 0x7efd28001690 con 0x7efd3815e560 2024-04-04T06:56:35.272 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.271+0000 7efd35600640 1 -- 172.21.15.72:0/3734557401 >> v1:172.21.15.72:6789/0 conn(0x7efd3815e560 legacy=0x7efd380d2420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:35.272 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.271+0000 7efd35600640 1 --2- 172.21.15.72:0/3734557401 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efd1c0039b0 0x7efd1c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:35.272 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.271+0000 7efd35600640 1 --2- 172.21.15.72:0/3734557401 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efd1c004800 0x7efd1c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:35.272 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.271+0000 7efd35600640 1 --2- 172.21.15.72:0/3734557401 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efd1c0051c0 0x7efd1c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:35.272 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.272+0000 7efd35600640 1 -- 172.21.15.72:0/3734557401 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7efd380b8520 con 0x7efd1c004800 2024-04-04T06:56:35.272 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.272+0000 7efd35600640 1 -- 172.21.15.72:0/3734557401 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7efd1c00c110 con 0x7efd1c0051c0 2024-04-04T06:56:35.273 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.272+0000 7efd35600640 1 -- 172.21.15.72:0/3734557401 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7efd1c00c310 con 0x7efd1c0039b0 2024-04-04T06:56:35.273 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.272+0000 7efd36000640 1 --2- 172.21.15.72:0/3734557401 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efd1c004800 0x7efd1c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:35.273 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.272+0000 7efd36000640 1 -- 172.21.15.72:0/3734557401 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efd1c0039b0 msgr2=0x7efd1c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:56:35.273 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.272+0000 7efd36a00640 1 --2- 172.21.15.72:0/3734557401 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efd1c0039b0 0x7efd1c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:35.273 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.272+0000 7efd36000640 1 --2- 172.21.15.72:0/3734557401 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efd1c0039b0 0x7efd1c003dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:35.273 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.272+0000 7efd36000640 1 -- 172.21.15.72:0/3734557401 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efd1c0051c0 msgr2=0x7efd1c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:56:35.273 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.272+0000 7efd37400640 1 --2- 172.21.15.72:0/3734557401 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efd1c0051c0 0x7efd1c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:35.273 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.272+0000 7efd36000640 1 --2- 172.21.15.72:0/3734557401 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efd1c0051c0 0x7efd1c00b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:35.273 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.272+0000 7efd36000640 1 -- 172.21.15.72:0/3734557401 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd1c003520 con 0x7efd1c004800 2024-04-04T06:56:35.273 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.272+0000 7efd37400640 1 -- 172.21.15.72:0/3734557401 reap_dead start 2024-04-04T06:56:35.273 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.273+0000 7efd36000640 1 --2- 172.21.15.72:0/3734557401 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efd1c004800 0x7efd1c004c80 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7efd24001750 tx=0x7efd1c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d1177443716a1e6 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:35.274 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.273+0000 7efd35600640 1 -- 172.21.15.72:0/3734557401 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd24001370 con 0x7efd1c004800 2024-04-04T06:56:35.274 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.273+0000 7efd35600640 1 -- 172.21.15.72:0/3734557401 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd240052d0 con 0x7efd1c004800 2024-04-04T06:56:35.275 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.274+0000 7efd35600640 1 -- 172.21.15.72:0/3734557401 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd24003830 con 0x7efd1c004800 2024-04-04T06:56:35.275 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.274+0000 7efd3dc00640 1 -- 172.21.15.72:0/3734557401 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efd1c004800 msgr2=0x7efd1c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:35.275 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.274+0000 7efd3dc00640 1 --2- 172.21.15.72:0/3734557401 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efd1c004800 0x7efd1c004c80 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7efd24001750 tx=0x7efd1c005830 comp rx=0 tx=0).stop 2024-04-04T06:56:35.275 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.274+0000 7efd3dc00640 1 -- 172.21.15.72:0/3734557401 shutdown_connections 2024-04-04T06:56:35.275 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.274+0000 7efd3dc00640 1 --2- 172.21.15.72:0/3734557401 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efd1c004800 0x7efd1c004c80 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:35.275 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.274+0000 7efd3dc00640 1 -- 172.21.15.72:0/3734557401 >> 172.21.15.72:0/3734557401 conn(0x7efd38071e80 msgr2=0x7efd38072290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:56:35.275 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.274+0000 7efd3dc00640 1 -- 172.21.15.72:0/3734557401 shutdown_connections 2024-04-04T06:56:35.275 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.274+0000 7efd3dc00640 1 -- 172.21.15.72:0/3734557401 wait complete. 2024-04-04T06:56:35.275 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.276+0000 7efd3dc00640 1 Processor -- start 2024-04-04T06:56:35.275 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.276+0000 7efd3dc00640 1 -- start start 2024-04-04T06:56:35.276 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.277+0000 7efd3dc00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efd1c004800 0x7efd38158600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:35.276 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.277+0000 7efd3dc00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efd3815b1d0 0x7efd3814b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:35.277 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.277+0000 7efd3dc00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efd380b5360 0x7efd3815cb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:35.277 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.277+0000 7efd3dc00640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7efd380d36a0 con 0x7efd1c004800 2024-04-04T06:56:35.277 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.277+0000 7efd3dc00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7efd380d33c0 con 0x7efd3815b1d0 2024-04-04T06:56:35.277 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.277+0000 7efd3dc00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7efd380d3980 con 0x7efd380b5360 2024-04-04T06:56:35.277 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.277+0000 7efd36a00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efd1c004800 0x7efd38158600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:35.277 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.277+0000 7efd36a00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efd1c004800 0x7efd38158600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46096/0 (socket says 172.21.15.72:46096) 2024-04-04T06:56:35.277 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.277+0000 7efd36a00640 1 -- 172.21.15.72:0/2038420798 learned_addr learned my addr 172.21.15.72:0/2038420798 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:56:35.277 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.278+0000 7efd37400640 1 --2- 172.21.15.72:0/2038420798 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efd380b5360 0x7efd3815cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:35.277 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.278+0000 7efd36000640 1 --2- 172.21.15.72:0/2038420798 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efd3815b1d0 0x7efd3814b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:35.277 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.278+0000 7efd36a00640 1 -- 172.21.15.72:0/2038420798 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efd380b5360 msgr2=0x7efd3815cb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:35.277 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.278+0000 7efd36a00640 1 --2- 172.21.15.72:0/2038420798 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efd380b5360 0x7efd3815cb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:35.277 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.278+0000 7efd36a00640 1 -- 172.21.15.72:0/2038420798 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efd3815b1d0 msgr2=0x7efd3814b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:35.277 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.278+0000 7efd36a00640 1 --2- 172.21.15.72:0/2038420798 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efd3815b1d0 0x7efd3814b430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:35.277 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.278+0000 7efd36a00640 1 -- 172.21.15.72:0/2038420798 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd381575a0 con 0x7efd1c004800 2024-04-04T06:56:35.277 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.278+0000 7efd36000640 1 --2- 172.21.15.72:0/2038420798 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efd3815b1d0 0x7efd3814b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-04T06:56:35.278 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.278+0000 7efd36a00640 1 --2- 172.21.15.72:0/2038420798 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efd1c004800 0x7efd38158600 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7efd2800d870 tx=0x7efd2800dd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:35.279 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.278+0000 7efd2ea00640 1 -- 172.21.15.72:0/2038420798 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd28019070 con 0x7efd1c004800 2024-04-04T06:56:35.279 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.278+0000 7efd2ea00640 1 -- 172.21.15.72:0/2038420798 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd280074e0 con 0x7efd1c004800 2024-04-04T06:56:35.279 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.279+0000 7efd3dc00640 1 -- 172.21.15.72:0/2038420798 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd38157840 con 0x7efd1c004800 2024-04-04T06:56:35.279 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.279+0000 7efd2ea00640 1 -- 172.21.15.72:0/2038420798 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd28004a20 con 0x7efd1c004800 2024-04-04T06:56:35.279 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.279+0000 7efd3dc00640 1 -- 172.21.15.72:0/2038420798 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd38157e00 con 0x7efd1c004800 2024-04-04T06:56:35.279 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.280+0000 7efd3dc00640 1 -- 172.21.15.72:0/2038420798 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd38075840 con 0x7efd1c004800 2024-04-04T06:56:35.279 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.281+0000 7efd2ea00640 1 -- 172.21.15.72:0/2038420798 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7efd2801c070 con 0x7efd1c004800 2024-04-04T06:56:35.280 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.282+0000 7efd2ea00640 1 --2- 172.21.15.72:0/2038420798 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7efd1806c8f0 0x7efd1806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:35.280 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.282+0000 7efd2ea00640 1 -- 172.21.15.72:0/2038420798 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7efd2808b600 con 0x7efd1c004800 2024-04-04T06:56:35.280 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.282+0000 7efd36000640 1 --2- 172.21.15.72:0/2038420798 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7efd1806c8f0 0x7efd1806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:35.281 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.283+0000 7efd36000640 1 --2- 172.21.15.72:0/2038420798 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7efd1806c8f0 0x7efd1806edb0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7efd24033000 tx=0x7efd24009030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:35.284 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.286+0000 7efd2ea00640 1 -- 172.21.15.72:0/2038420798 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7efd28059990 con 0x7efd1c004800 2024-04-04T06:56:35.522 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.523+0000 7efd3dc00640 1 -- 172.21.15.72:0/2038420798 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7efd380d13e0 con 0x7efd1c004800 2024-04-04T06:56:35.524 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.526+0000 7efd2ea00640 1 -- 172.21.15.72:0/2038420798 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16581 (secure 0 0 0) 0x7efd28059290 con 0x7efd1c004800 2024-04-04T06:56:35.525 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T06:56:35.525 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":20,"fsid":"6708bac2-4f50-49b5-87a9-c390fd333eb3","created":"2024-04-04T06:56:04.282498+0000","modified":"2024-04-04T06:56:30.007371+0000","last_up_change":"2024-04-04T06:56:16.716089+0000","last_in_change":"2024-04-04T06:56:07.768593+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-04T06:56:17.421685+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-04T06:56:26.822661+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-04T06:56:27.429816+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7c345991-5af8-4dc6-a481-28610c40e128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":3889813953},{"type":"v1","addr":"172.21.15.72:6818","nonce":3889813953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":3889813953},{"type":"v1","addr":"172.21.15.72:6821","nonce":3889813953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":3889813953},{"type":"v1","addr":"172.21.15.72:6826","nonce":3889813953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":3889813953},{"type":"v1","addr":"172.21.15.72:6823","nonce":3889813953}]},"public_addr":"172.21.15.72:6818/3889813953","cluster_addr":"172.21.15.72:6821/3889813953","heartbeat_back_addr":"172.21.15.72:6826/3889813953","heartbeat_front_addr":"172.21.15.72:6823/3889813953","state":["exists","up"]},{"osd":1,"uuid":"1b3f7ab2-a56c-488d-a89a-1f3572361c95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":3101663154},{"type":"v1","addr":"172.21.15.72:6801","nonce":3101663154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":3101663154},{"type":"v1","addr":"172.21.15.72:6803","nonce":3101663154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":3101663154},{"type":"v1","addr":"172.21.15.72:6807","nonce":3101663154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":3101663154},{"type":"v1","addr":"172.21.15.72:6805","nonce":3101663154}]},"public_addr":"172.21.15.72:6801/3101663154","cluster_addr":"172.21.15.72:6803/3101663154","heartbeat_back_addr":"172.21.15.72:6807/3101663154","heartbeat_front_addr":"172.21.15.72:6805/3101663154","state":["exists","up"]},{"osd":2,"uuid":"fc9aa512-53df-40d7-ba04-3e6b7dcd1e34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":235374192},{"type":"v1","addr":"172.21.15.72:6809","nonce":235374192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":235374192},{"type":"v1","addr":"172.21.15.72:6811","nonce":235374192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":235374192},{"type":"v1","addr":"172.21.15.72:6815","nonce":235374192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":235374192},{"type":"v1","addr":"172.21.15.72:6813","nonce":235374192}]},"public_addr":"172.21.15.72:6809/235374192","cluster_addr":"172.21.15.72:6811/235374192","heartbeat_back_addr":"172.21.15.72:6815/235374192","heartbeat_front_addr":"172.21.15.72:6813/235374192","state":["exists","up"]},{"osd":3,"uuid":"b4f63eed-dc5b-4aba-bb50-de46eb41492b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6817","nonce":2806631742},{"type":"v1","addr":"172.21.15.72:6819","nonce":2806631742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":2806631742},{"type":"v1","addr":"172.21.15.72:6827","nonce":2806631742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":2806631742},{"type":"v1","addr":"172.21.15.72:6831","nonce":2806631742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":2806631742},{"type":"v1","addr":"172.21.15.72:6829","nonce":2806631742}]},"public_addr":"172.21.15.72:6819/2806631742","cluster_addr":"172.21.15.72:6827/2806631742","heartbeat_back_addr":"172.21.15.72:6831/2806631742","heartbeat_front_addr":"172.21.15.72:6829/2806631742","state":["exists","up"]},{"osd":4,"uuid":"9e985ef8-d711-4172-9286-c54e560895d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":4293536423},{"type":"v1","addr":"172.21.15.117:6825","nonce":4293536423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":4293536423},{"type":"v1","addr":"172.21.15.117:6827","nonce":4293536423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":4293536423},{"type":"v1","addr":"172.21.15.117:6831","nonce":4293536423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":4293536423},{"type":"v1","addr":"172.21.15.117:6829","nonce":4293536423}]},"public_addr":"172.21.15.117:6825/4293536423","cluster_addr":"172.21.15.117:6827/4293536423","heartbeat_back_addr":"172.21.15.117:6831/4293536423","heartbeat_front_addr":"172.21.15.117:6829/4293536423","state":["exists","up"]},{"osd":5,"uuid":"3e9f082b-8d7d-455f-8a96-66d0b4857125","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":684971679},{"type":"v1","addr":"172.21.15.117:6801","nonce":684971679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":684971679},{"type":"v1","addr":"172.21.15.117:6803","nonce":684971679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":684971679},{"type":"v1","addr":"172.21.15.117:6807","nonce":684971679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":684971679},{"type":"v1","addr":"172.21.15.117:6805","nonce":684971679}]},"public_addr":"172.21.15.117:6801/684971679","cluster_addr":"172.21.15.117:6803/684971679","heartbeat_back_addr":"172.21.15.117:6807/684971679","heartbeat_front_addr":"172.21.15.117:6805/684971679","state":["exists","up"]},{"osd":6,"uuid":"bcdafa9f-a870-4398-a38d-ab7697676473","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":2781186528},{"type":"v1","addr":"172.21.15.117:6809","nonce":2781186528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":2781186528},{"type":"v1","addr":"172.21.15.117:6811","nonce":2781186528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":2781186528},{"type":"v1","addr":"172.21.15.117:6815","nonce":2781186528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":2781186528},{"type":"v1","addr":"172.21.15.117:6813","nonce":2781186528}]},"public_addr":"172.21.15.117:6809/2781186528","cluster_addr":"172.21.15.117:6811/2781186528","heartbeat_back_addr":"172.21.15.117:6815/2781186528","heartbeat_front_addr":"172.21.15.117:6813/2781186528","state":["exists","up"]},{"osd":7,"uuid":"b68ec562-ff35-4d2d-a733-c896f8920cfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":617469882},{"type":"v1","addr":"172.21.15.117:6817","nonce":617469882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":617469882},{"type":"v1","addr":"172.21.15.117:6819","nonce":617469882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":617469882},{"type":"v1","addr":"172.21.15.117:6823","nonce":617469882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":617469882},{"type":"v1","addr":"172.21.15.117:6821","nonce":617469882}]},"public_addr":"172.21.15.117:6817/617469882","cluster_addr":"172.21.15.117:6819/617469882","heartbeat_back_addr":"172.21.15.117:6823/617469882","heartbeat_front_addr":"172.21.15.117:6821/617469882","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.347700+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.296619+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.361345+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.093323+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:12.857605+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:12.816090+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.083163+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.121639+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-04T06:56:35.528 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.529+0000 7efd3dc00640 1 -- 172.21.15.72:0/2038420798 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7efd1806c8f0 msgr2=0x7efd1806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:35.528 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.529+0000 7efd3dc00640 1 --2- 172.21.15.72:0/2038420798 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7efd1806c8f0 0x7efd1806edb0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7efd24033000 tx=0x7efd24009030 comp rx=0 tx=0).stop 2024-04-04T06:56:35.528 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.529+0000 7efd3dc00640 1 -- 172.21.15.72:0/2038420798 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efd1c004800 msgr2=0x7efd38158600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:35.528 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.529+0000 7efd3dc00640 1 --2- 172.21.15.72:0/2038420798 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efd1c004800 0x7efd38158600 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7efd2800d870 tx=0x7efd2800dd30 comp rx=0 tx=0).stop 2024-04-04T06:56:35.528 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.529+0000 7efd3dc00640 1 -- 172.21.15.72:0/2038420798 shutdown_connections 2024-04-04T06:56:35.528 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.529+0000 7efd3dc00640 1 --2- 172.21.15.72:0/2038420798 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7efd1806c8f0 0x7efd1806edb0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:35.528 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.529+0000 7efd3dc00640 1 --2- 172.21.15.72:0/2038420798 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efd380b5360 0x7efd3815cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:35.528 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.529+0000 7efd3dc00640 1 --2- 172.21.15.72:0/2038420798 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efd3815b1d0 0x7efd3814b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:35.528 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.529+0000 7efd3dc00640 1 --2- 172.21.15.72:0/2038420798 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efd1c004800 0x7efd38158600 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:35.528 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.529+0000 7efd3dc00640 1 -- 172.21.15.72:0/2038420798 >> 172.21.15.72:0/2038420798 conn(0x7efd38071e80 msgr2=0x7efd380d4300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:56:35.528 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.529+0000 7efd3dc00640 1 -- 172.21.15.72:0/2038420798 shutdown_connections 2024-04-04T06:56:35.529 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.529+0000 7efd3dc00640 1 -- 172.21.15.72:0/2038420798 wait complete. 2024-04-04T06:56:35.545 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-04-04T06:56:35.545 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-04-04T06:56:35.546 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-04-04T06:56:35.546 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-04-04T06:56:35.547 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-04-04T06:56:35.547 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-04-04T06:56:35.547 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-04-04T06:56:35.548 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-04-04T06:56:35.863 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.864+0000 7ff280a00640 1 Processor -- start 2024-04-04T06:56:35.864 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.865+0000 7ff280a00640 1 -- start start 2024-04-04T06:56:35.865 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.866+0000 7fe1d3400640 1 Processor -- start 2024-04-04T06:56:35.865 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.866+0000 7fe1d3400640 1 -- start start 2024-04-04T06:56:35.865 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.866+0000 7fe2d7400640 1 Processor -- start 2024-04-04T06:56:35.865 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.867+0000 7fe2d7400640 1 -- start start 2024-04-04T06:56:35.866 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.867+0000 7ff280a00640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff27c15d2b0 0x7ff27c0ce300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:35.866 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.867+0000 7ff280a00640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff27c0d0090 con 0x7ff27c0cea70 2024-04-04T06:56:35.866 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.867+0000 7ff280a00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff27c0cc830 con 0x7ff27c0b79b0 2024-04-04T06:56:35.866 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.867+0000 7ff280a00640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7ff27c0cf930 con 0x7ff27c15d2b0 2024-04-04T06:56:35.866 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.868+0000 7fe1d3400640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fe1cc0d47c0 0x7fe1cc0b7480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:35.866 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.868+0000 7fe1d3400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe1cc0cf2d0 0x7fe1cc0d4ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:35.867 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.868+0000 7ff279e00640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7ff27c0b79b0 0x7ff27c0d1310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.72:58756/0 (socket says 172.21.15.72:58756) 2024-04-04T06:56:35.867 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.868+0000 7fe1d3400640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe1cc0d1500 0x7fe1cc0d3370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:35.867 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.868+0000 7ff279400640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff27c15d2b0 0x7ff27c0ce300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:35.868 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.868+0000 7ff279400640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff27c15d2b0 0x7ff27c0ce300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46098/0 (socket says 172.21.15.72:46098) 2024-04-04T06:56:35.868 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.868+0000 7ff279400640 1 -- 172.21.15.72:0/480430126 learned_addr learned my addr 172.21.15.72:0/480430126 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:56:35.868 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.868+0000 7fe1d3400640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7fe1cc0b79c0 con 0x7fe1cc0d1500 2024-04-04T06:56:35.868 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.868+0000 7fe1d3400640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fe1cc0cfb00 con 0x7fe1cc0d47c0 2024-04-04T06:56:35.868 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.868+0000 7fe1d3400640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fe1cc15e940 con 0x7fe1cc0cf2d0 2024-04-04T06:56:35.868 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.869+0000 7fe1cbe00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe1cc0cf2d0 0x7fe1cc0d4ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:35.868 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.869+0000 7fe1d0a00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fe1cc0d47c0 0x7fe1cc0b7480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:35.869 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.869+0000 7fe1d0a00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fe1cc0d47c0 0x7fe1cc0b7480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.72:39914/0 (socket says 172.21.15.72:39914) 2024-04-04T06:56:35.869 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.869+0000 7fe1d0a00640 1 -- 172.21.15.72:0/3006979680 learned_addr learned my addr 172.21.15.72:0/3006979680 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:56:35.869 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.869+0000 7f4db1e00640 1 Processor -- start 2024-04-04T06:56:35.869 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.870+0000 7fc113400640 1 Processor -- start 2024-04-04T06:56:35.869 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.871+0000 7fc113400640 1 -- start start 2024-04-04T06:56:35.870 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.869+0000 7fe1d1400640 1 --2- 172.21.15.72:0/3006979680 >> v2:172.21.15.72:3300/0 conn(0x7fe1cc0d1500 0x7fe1cc0d3370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:35.870 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.869+0000 7fe2d7400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe2d015e270 0x7fe2d0072bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:35.870 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.869+0000 7fe2d7400640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe2d00b39e0 0x7fe2d0073100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:35.870 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.869+0000 7fe2d7400640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe2d00adf90 con 0x7fe2d00aed50 2024-04-04T06:56:35.870 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.869+0000 7fe2d7400640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7fe2d00723f0 con 0x7fe2d00b39e0 2024-04-04T06:56:35.870 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.869+0000 7fe2d7400640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fe2d00add40 con 0x7fe2d015e270 2024-04-04T06:56:35.870 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.870+0000 7fe2cfe00640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fe2d00aed50 0x7fe2d00b32d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:52626/0 (socket says 172.21.15.72:52626) 2024-04-04T06:56:35.870 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.870+0000 7fe2cfe00640 1 -- 172.21.15.72:0/1973402293 learned_addr learned my addr 172.21.15.72:0/1973402293 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-04-04T06:56:35.870 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.870+0000 7fe2d4a00640 1 --2- 172.21.15.72:0/1973402293 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe2d015e270 0x7fe2d0072bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:35.871 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.870+0000 7fe2d5400640 1 --2- 172.21.15.72:0/1973402293 >> v2:172.21.15.72:3300/0 conn(0x7fe2d00b39e0 0x7fe2d0073100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:35.871 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.869+0000 7ff279400640 1 -- 172.21.15.72:0/480430126 >> v1:172.21.15.117:6789/0 conn(0x7ff27c0b79b0 legacy=0x7ff27c0d1310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:56:35.871 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.869+0000 7ff279400640 1 -- 172.21.15.72:0/480430126 >> v1:172.21.15.72:6789/0 conn(0x7ff27c0cea70 legacy=0x7ff27c0cee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:35.871 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.869+0000 7ff279400640 1 -- 172.21.15.72:0/480430126 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff27c06e5a0 con 0x7ff27c15d2b0 2024-04-04T06:56:35.871 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.871+0000 7fe2d5400640 1 -- 172.21.15.72:0/1973402293 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe2d015e270 msgr2=0x7fe2d0072bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:56:35.872 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.871+0000 7ff279400640 1 --2- 172.21.15.72:0/480430126 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff27c15d2b0 0x7ff27c0ce300 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ff268009870 tx=0x7ff26802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=379cb5bac44bf566 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:35.872 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.869+0000 7f4db1e00640 1 -- start start 2024-04-04T06:56:35.873 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.871+0000 7f4db1e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4dac0b1b10 0x7f4dac0b1f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:35.873 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.871+0000 7f4db1e00640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4dac163a00 con 0x7f4dac14c3e0 2024-04-04T06:56:35.873 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.871+0000 7f4db1e00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4dac163ce0 con 0x7f4dac164aa0 2024-04-04T06:56:35.873 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.871+0000 7f4db1e00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f4dac0b24b0 con 0x7f4dac0b1b10 2024-04-04T06:56:35.873 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.872+0000 7ff278a00640 1 -- 172.21.15.72:0/480430126 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff268035020 con 0x7ff27c15d2b0 2024-04-04T06:56:35.873 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.871+0000 7fe1d1400640 1 -- 172.21.15.72:0/3006979680 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe1cc0cf2d0 msgr2=0x7fe1cc0d4ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:56:35.873 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.871+0000 7fe1d1400640 1 --2- 172.21.15.72:0/3006979680 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe1cc0cf2d0 0x7fe1cc0d4ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:35.873 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.871+0000 7fe1d1400640 1 -- 172.21.15.72:0/3006979680 >> v2:172.21.15.117:3300/0 conn(0x7fe1cc0d47c0 msgr2=0x7fe1cc0b7480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:56:35.873 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.871+0000 7fe1d1400640 1 --2- 172.21.15.72:0/3006979680 >> v2:172.21.15.117:3300/0 conn(0x7fe1cc0d47c0 0x7fe1cc0b7480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:35.874 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.871+0000 7fe1d1400640 1 -- 172.21.15.72:0/3006979680 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1cc0d50e0 con 0x7fe1cc0d1500 2024-04-04T06:56:35.874 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.873+0000 7ff278a00640 1 -- 172.21.15.72:0/480430126 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff268031870 con 0x7ff27c15d2b0 2024-04-04T06:56:35.874 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.873+0000 7ff278a00640 1 -- 172.21.15.72:0/480430126 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff268031c40 con 0x7ff27c15d2b0 2024-04-04T06:56:35.874 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.873+0000 7fc113400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc10c15bf10 0x7fc10c0b44e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:35.875 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.873+0000 7f4daaa00640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f4dac14c3e0 0x7f4dac162ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:52638/0 (socket says 172.21.15.72:52638) 2024-04-04T06:56:35.875 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.873+0000 7f4daaa00640 1 -- 172.21.15.72:0/1632792510 learned_addr learned my addr 172.21.15.72:0/1632792510 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-04-04T06:56:35.875 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.871+0000 7fe2d5400640 1 --2- 172.21.15.72:0/1973402293 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe2d015e270 0x7fe2d0072bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:35.875 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.871+0000 7fe2d5400640 1 -- 172.21.15.72:0/1973402293 >> v1:172.21.15.72:6789/0 conn(0x7fe2d00aed50 legacy=0x7fe2d00b32d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:35.875 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.873+0000 7fc10be00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc10c15bf10 0x7fc10c0b44e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:35.875 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.874+0000 7fc110a00640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fc10c0b2e80 0x7fc10c0b1b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:52654/0 (socket says 172.21.15.72:52654) 2024-04-04T06:56:35.876 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.874+0000 7fe1d1400640 1 --2- 172.21.15.72:0/3006979680 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe1cc0d1500 0x7fe1cc0d3370 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fe1cc071c90 tx=0x7fe1c402be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13b81f456b39f078 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:35.876 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.871+0000 7fe2d5400640 1 -- 172.21.15.72:0/1973402293 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2d00ae270 con 0x7fe2d00b39e0 2024-04-04T06:56:35.876 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.874+0000 7ff280a00640 1 -- 172.21.15.72:0/480430126 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff27c15d2b0 msgr2=0x7ff27c0ce300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:35.876 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.874+0000 7ff280a00640 1 --2- 172.21.15.72:0/480430126 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff27c15d2b0 0x7ff27c0ce300 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ff268009870 tx=0x7ff26802b910 comp rx=0 tx=0).stop 2024-04-04T06:56:35.876 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.874+0000 7fc10be00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc10c15bf10 0x7fc10c0b44e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.72:40258/0 (socket says 172.21.15.72:40258) 2024-04-04T06:56:35.877 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.873+0000 7f4da2000640 1 --2- 172.21.15.72:0/1632792510 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4dac0b1b10 0x7f4dac0b1f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:35.877 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.874+0000 7f4daa000640 1 -- 172.21.15.72:0/1632792510 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 579716015 0 0) 0x7f4dac163a00 con 0x7f4dac14c3e0 2024-04-04T06:56:35.877 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.874+0000 7f4daa000640 1 -- 172.21.15.72:0/1632792510 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4d90003520 con 0x7f4dac14c3e0 2024-04-04T06:56:35.877 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.874+0000 7f4daa000640 1 -- 172.21.15.72:0/1632792510 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2471840071 0 0) 0x7f4dac163ce0 con 0x7f4dac164aa0 2024-04-04T06:56:35.877 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.874+0000 7f4daa000640 1 -- 172.21.15.72:0/1632792510 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4dac163a00 con 0x7f4dac164aa0 2024-04-04T06:56:35.878 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.874+0000 7f4daa000640 1 -- 172.21.15.72:0/1632792510 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3969105799 0 0) 0x7f4d90003520 con 0x7f4dac14c3e0 2024-04-04T06:56:35.878 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.875+0000 7f4daa000640 1 -- 172.21.15.72:0/1632792510 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4dac0b1b10 msgr2=0x7f4dac0b1f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:56:35.878 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.875+0000 7f4daa000640 1 --2- 172.21.15.72:0/1632792510 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4dac0b1b10 0x7f4dac0b1f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:35.878 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.874+0000 7fe2d5400640 1 --2- 172.21.15.72:0/1973402293 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe2d00b39e0 0x7fe2d0073100 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fe2c8009d90 tx=0x7fe2c802bec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d1784b371b6a311 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:35.878 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.875+0000 7f4daa000640 1 -- 172.21.15.72:0/1632792510 >> v1:172.21.15.117:6789/0 conn(0x7f4dac164aa0 legacy=0x7f4dac164f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:35.878 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.875+0000 7f4daa000640 1 -- 172.21.15.72:0/1632792510 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4dac163fc0 con 0x7f4dac14c3e0 2024-04-04T06:56:35.879 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.875+0000 7fe1cb400640 1 -- 172.21.15.72:0/3006979680 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1c4039070 con 0x7fe1cc0d1500 2024-04-04T06:56:35.879 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.875+0000 7fe1cb400640 1 -- 172.21.15.72:0/3006979680 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1c402cbf0 con 0x7fe1cc0d1500 2024-04-04T06:56:35.879 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.875+0000 7fe1cb400640 1 -- 172.21.15.72:0/3006979680 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1c4034440 con 0x7fe1cc0d1500 2024-04-04T06:56:35.879 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.875+0000 7fe2cf400640 1 -- 172.21.15.72:0/1973402293 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2c8039070 con 0x7fe2d00b39e0 2024-04-04T06:56:35.880 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.875+0000 7fe2cf400640 1 -- 172.21.15.72:0/1973402293 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2c802cc70 con 0x7fe2d00b39e0 2024-04-04T06:56:35.880 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.875+0000 7fe2cf400640 1 -- 172.21.15.72:0/1973402293 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2c802ce60 con 0x7fe2d00b39e0 2024-04-04T06:56:35.880 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.875+0000 7fc110a00640 1 -- 172.21.15.72:0/526498701 learned_addr learned my addr 172.21.15.72:0/526498701 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-04-04T06:56:35.880 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.875+0000 7f4daa000640 1 -- 172.21.15.72:0/1632792510 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2465650867 0 0) 0x7f4d9c001670 con 0x7f4dac14c3e0 2024-04-04T06:56:35.880 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.875+0000 7f4daa000640 1 -- 172.21.15.72:0/1632792510 >> v1:172.21.15.72:6789/0 conn(0x7f4dac14c3e0 legacy=0x7f4dac162ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:35.881 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.875+0000 7f4daa000640 1 --2- 172.21.15.72:0/1632792510 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4d90004bd0 0x7f4d90004fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:35.881 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.875+0000 7f4daa000640 1 --2- 172.21.15.72:0/1632792510 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4d900037a0 0x7f4d90003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:35.881 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.875+0000 7f4daa000640 1 --2- 172.21.15.72:0/1632792510 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4dac0b1b10 0x7f4d90004210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:35.881 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.875+0000 7f4daa000640 1 -- 172.21.15.72:0/1632792510 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f4d9000bb50 con 0x7f4d900037a0 2024-04-04T06:56:35.881 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.875+0000 7f4daa000640 1 -- 172.21.15.72:0/1632792510 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f4d9000bd00 con 0x7f4d90004bd0 2024-04-04T06:56:35.881 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.875+0000 7f4daa000640 1 -- 172.21.15.72:0/1632792510 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f4d9000bf00 con 0x7f4dac0b1b10 2024-04-04T06:56:35.881 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.876+0000 7f4da2000640 1 --2- 172.21.15.72:0/1632792510 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4d900037a0 0x7f4d90003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:35.881 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.876+0000 7fe1d3400640 1 -- 172.21.15.72:0/3006979680 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe1cc0d1500 msgr2=0x7fe1cc0d3370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:35.881 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.876+0000 7fe1d3400640 1 --2- 172.21.15.72:0/3006979680 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe1cc0d1500 0x7fe1cc0d3370 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fe1cc071c90 tx=0x7fe1c402be40 comp rx=0 tx=0).stop 2024-04-04T06:56:35.882 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.876+0000 7fe1d3400640 1 -- 172.21.15.72:0/3006979680 shutdown_connections 2024-04-04T06:56:35.882 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.876+0000 7fe1d3400640 1 --2- 172.21.15.72:0/3006979680 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe1cc0d1500 0x7fe1cc0d3370 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:35.882 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.876+0000 7fe1d3400640 1 --2- 172.21.15.72:0/3006979680 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe1cc0cf2d0 0x7fe1cc0d4ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:35.882 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.876+0000 7fe1d3400640 1 --2- 172.21.15.72:0/3006979680 >> v2:172.21.15.117:3300/0 conn(0x7fe1cc0d47c0 0x7fe1cc0b7480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:35.882 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.876+0000 7f4dab400640 1 --2- 172.21.15.72:0/1632792510 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4dac0b1b10 0x7f4d90004210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:35.882 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.876+0000 7fe1d3400640 1 -- 172.21.15.72:0/3006979680 >> 172.21.15.72:0/3006979680 conn(0x7fe1cc06b860 msgr2=0x7fe1cc06bc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:56:35.883 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.876+0000 7fe1d3400640 1 -- 172.21.15.72:0/3006979680 shutdown_connections 2024-04-04T06:56:35.883 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.877+0000 7fe1d3400640 1 -- 172.21.15.72:0/3006979680 wait complete. 2024-04-04T06:56:35.883 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.877+0000 7f4da2000640 1 -- 172.21.15.72:0/1632792510 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4dac0b1b10 msgr2=0x7f4d90004210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:56:35.883 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.877+0000 7f4da2000640 1 --2- 172.21.15.72:0/1632792510 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4dac0b1b10 0x7f4d90004210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:35.883 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.877+0000 7f4da2000640 1 -- 172.21.15.72:0/1632792510 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4d90004bd0 msgr2=0x7f4d90004fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:56:35.883 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.877+0000 7f4da2000640 1 --2- 172.21.15.72:0/1632792510 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4d90004bd0 0x7f4d90004fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:35.883 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.877+0000 7f4da2000640 1 -- 172.21.15.72:0/1632792510 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d90003520 con 0x7f4d900037a0 2024-04-04T06:56:35.884 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.877+0000 7fe2d7400640 1 -- 172.21.15.72:0/1973402293 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe2d00b39e0 msgr2=0x7fe2d0073100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:35.884 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.877+0000 7fe2d7400640 1 --2- 172.21.15.72:0/1973402293 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe2d00b39e0 0x7fe2d0073100 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fe2c8009d90 tx=0x7fe2c802bec0 comp rx=0 tx=0).stop 2024-04-04T06:56:35.884 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.877+0000 7fe2d7400640 1 -- 172.21.15.72:0/1973402293 shutdown_connections 2024-04-04T06:56:35.884 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.877+0000 7fe2d7400640 1 --2- 172.21.15.72:0/1973402293 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe2d00b39e0 0x7fe2d0073100 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:35.884 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.877+0000 7fe2d7400640 1 --2- 172.21.15.72:0/1973402293 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe2d015e270 0x7fe2d0072bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:35.884 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.877+0000 7fe2d7400640 1 -- 172.21.15.72:0/1973402293 >> 172.21.15.72:0/1973402293 conn(0x7fe2d006d490 msgr2=0x7fe2d006d870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:56:35.884 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.878+0000 7fe2d7400640 1 -- 172.21.15.72:0/1973402293 shutdown_connections 2024-04-04T06:56:35.885 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.878+0000 7fe2d7400640 1 -- 172.21.15.72:0/1973402293 wait complete. 2024-04-04T06:56:35.885 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.879+0000 7f4da2000640 1 --2- 172.21.15.72:0/1632792510 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4d900037a0 0x7f4d90003c20 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f4d9400ba00 tx=0x7f4d90005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd83f09bec46c464 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:35.885 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.879+0000 7f4daa000640 1 -- 172.21.15.72:0/1632792510 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d94036020 con 0x7f4d900037a0 2024-04-04T06:56:35.885 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.879+0000 7f4daa000640 1 -- 172.21.15.72:0/1632792510 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d94032620 con 0x7f4d900037a0 2024-04-04T06:56:35.885 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.880+0000 7fe2d7400640 1 Processor -- start 2024-04-04T06:56:35.886 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.880+0000 7fe1d3400640 1 Processor -- start 2024-04-04T06:56:35.886 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.880+0000 7fe2d7400640 1 -- start start 2024-04-04T06:56:35.886 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.880+0000 7fe1d3400640 1 -- start start 2024-04-04T06:56:35.887 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.880+0000 7f4db1e00640 1 -- 172.21.15.72:0/1632792510 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4d900037a0 msgr2=0x7f4d90003c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:35.887 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.881+0000 7f4daa000640 1 -- 172.21.15.72:0/1632792510 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d94036020 con 0x7f4d900037a0 2024-04-04T06:56:35.887 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.881+0000 7f4db1e00640 1 --2- 172.21.15.72:0/1632792510 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4d900037a0 0x7f4d90003c20 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f4d9400ba00 tx=0x7f4d90005830 comp rx=0 tx=0).stop 2024-04-04T06:56:35.887 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.881+0000 7f4d22000640 1 Processor -- start 2024-04-04T06:56:35.888 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.881+0000 7f4dab400640 1 -- 172.21.15.72:0/1632792510 reap_dead start 2024-04-04T06:56:35.888 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.881+0000 7f4db1e00640 1 -- 172.21.15.72:0/1632792510 shutdown_connections 2024-04-04T06:56:35.888 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.881+0000 7f4db1e00640 1 -- 172.21.15.72:0/1632792510 >> 172.21.15.72:0/1632792510 conn(0x7f4dac06b470 msgr2=0x7f4dac06b850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:56:35.888 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.881+0000 7f4db1e00640 1 -- 172.21.15.72:0/1632792510 shutdown_connections 2024-04-04T06:56:35.888 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.881+0000 7f4db1e00640 1 -- 172.21.15.72:0/1632792510 wait complete. 2024-04-04T06:56:35.888 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.882+0000 7fe2d7400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe2d00aed50 0x7fe2d01e9e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:35.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.882+0000 7ff280a00640 1 -- 172.21.15.72:0/480430126 shutdown_connections 2024-04-04T06:56:35.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.882+0000 7ff280a00640 1 --2- 172.21.15.72:0/480430126 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff27c15d2b0 0x7ff27c0ce300 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:35.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.882+0000 7ff280a00640 1 -- 172.21.15.72:0/480430126 >> 172.21.15.72:0/480430126 conn(0x7ff27c0744d0 msgr2=0x7ff27c0748b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:56:35.890 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.882+0000 7fe2d7400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe2d00b39e0 0x7fe2d014bef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:35.890 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.882+0000 7fe2d7400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe2d015e270 0x7fe2d01e72d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:35.890 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.882+0000 7fe2d7400640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fe2d015e650 con 0x7fe2d00aed50 2024-04-04T06:56:35.890 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.882+0000 7fe2d7400640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fe2d00ae830 con 0x7fe2d00b39e0 2024-04-04T06:56:35.890 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.882+0000 7fe2d7400640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fe2d015e7d0 con 0x7fe2d015e270 2024-04-04T06:56:35.890 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.883+0000 7fe2cfe00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe2d00b39e0 0x7fe2d014bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:35.890 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.883+0000 7fe2cfe00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe2d00b39e0 0x7fe2d014bef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.72:39930/0 (socket says 172.21.15.72:39930) 2024-04-04T06:56:35.890 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.883+0000 7fe2cfe00640 1 -- 172.21.15.72:0/1957370615 learned_addr learned my addr 172.21.15.72:0/1957370615 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:56:35.891 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.882+0000 7fc113400640 1 -- 172.21.15.72:0/526498701 --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc10c0b3440 con 0x7fc10c0b2e80 2024-04-04T06:56:35.891 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.883+0000 7fc113400640 1 -- 172.21.15.72:0/526498701 --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc10c0b3720 con 0x7fc10c15c370 2024-04-04T06:56:35.891 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.883+0000 7fc113400640 1 -- 172.21.15.72:0/526498701 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fc10c0b2290 con 0x7fc10c15bf10 2024-04-04T06:56:35.891 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.881+0000 7f4d22000640 1 -- start start 2024-04-04T06:56:35.892 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.883+0000 7fe2d4a00640 1 --2- 172.21.15.72:0/1957370615 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe2d00aed50 0x7fe2d01e9e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:35.892 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.883+0000 7ff280a00640 1 -- 172.21.15.72:0/480430126 shutdown_connections 2024-04-04T06:56:35.892 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.883+0000 7fc10b400640 1 -- 172.21.15.72:0/526498701 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2866038678 0 0) 0x7fc10c0b3440 con 0x7fc10c0b2e80 2024-04-04T06:56:35.892 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.883+0000 7fe2d5400640 1 --2- 172.21.15.72:0/1957370615 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe2d015e270 0x7fe2d01e72d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:35.893 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.883+0000 7fc10b400640 1 -- 172.21.15.72:0/526498701 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc0f4003520 con 0x7fc10c0b2e80 2024-04-04T06:56:35.893 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.883+0000 7fc10b400640 1 -- 172.21.15.72:0/526498701 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1452102599 0 0) 0x7fc10c0b3720 con 0x7fc10c15c370 2024-04-04T06:56:35.893 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.883+0000 7fc10b400640 1 -- 172.21.15.72:0/526498701 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc10c0b3440 con 0x7fc10c15c370 2024-04-04T06:56:35.893 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.883+0000 7fc10be00640 1 -- 172.21.15.72:0/526498701 >> v1:172.21.15.117:6789/0 conn(0x7fc10c15c370 legacy=0x7fc10c15e340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:35.893 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.883+0000 7fc10be00640 1 -- 172.21.15.72:0/526498701 >> v1:172.21.15.72:6789/0 conn(0x7fc10c0b2e80 legacy=0x7fc10c0b1b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:35.893 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.883+0000 7fc10be00640 1 -- 172.21.15.72:0/526498701 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc10c0b3a00 con 0x7fc10c15bf10 2024-04-04T06:56:35.894 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.883+0000 7fe1d3400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe1cc0cf2d0 0x7fe1cc0b9270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:35.894 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.884+0000 7fe1d3400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe1cc0d1500 0x7fe1cc0b97b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:35.894 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.884+0000 7fe1d3400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe1cc0d47c0 0x7fe1cc0cbd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:35.894 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.884+0000 7fe1d3400640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fe1cc0d2b70 con 0x7fe1cc0cf2d0 2024-04-04T06:56:35.894 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.884+0000 7fe1d3400640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fe1cc0cf820 con 0x7fe1cc0d47c0 2024-04-04T06:56:35.894 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.884+0000 7fe1d3400640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fe1cc0d2e50 con 0x7fe1cc0d1500 2024-04-04T06:56:35.894 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.884+0000 7fe2cfe00640 1 -- 172.21.15.72:0/1957370615 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe2d015e270 msgr2=0x7fe2d01e72d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:35.894 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.884+0000 7ff280a00640 1 -- 172.21.15.72:0/480430126 wait complete. 2024-04-04T06:56:35.895 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.885+0000 7fe1d1400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe1cc0d47c0 0x7fe1cc0cbd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:35.895 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.885+0000 7fe1d1400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe1cc0d47c0 0x7fe1cc0cbd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.72:39940/0 (socket says 172.21.15.72:39940) 2024-04-04T06:56:35.895 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.885+0000 7fe1d1400640 1 -- 172.21.15.72:0/2972685797 learned_addr learned my addr 172.21.15.72:0/2972685797 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:56:35.895 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.885+0000 7fe1cbe00640 1 --2- 172.21.15.72:0/2972685797 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe1cc0d1500 0x7fe1cc0b97b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:35.895 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.885+0000 7fe1d0a00640 1 --2- 172.21.15.72:0/2972685797 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe1cc0cf2d0 0x7fe1cc0b9270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:35.895 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.885+0000 7fe2cfe00640 1 --2- 172.21.15.72:0/1957370615 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe2d015e270 0x7fe2d01e72d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:35.896 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.885+0000 7fe2cfe00640 1 -- 172.21.15.72:0/1957370615 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe2d00aed50 msgr2=0x7fe2d01e9e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:35.896 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.885+0000 7fe2cfe00640 1 --2- 172.21.15.72:0/1957370615 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe2d00aed50 0x7fe2d01e9e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:35.896 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.885+0000 7f4db1e00640 1 Processor -- start 2024-04-04T06:56:35.896 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.885+0000 7fe2cfe00640 1 -- 172.21.15.72:0/1957370615 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2d014ae50 con 0x7fe2d00b39e0 2024-04-04T06:56:35.896 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.885+0000 7fe2d5400640 1 --2- 172.21.15.72:0/1957370615 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe2d015e270 0x7fe2d01e72d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-04T06:56:35.897 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.885+0000 7fc10be00640 1 --2- 172.21.15.72:0/526498701 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc10c15bf10 0x7fc10c0b44e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fc0f80097d0 tx=0x7fc0f802b930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=22b9eb472d23fe71 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:35.897 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.886+0000 7fe1d0a00640 1 -- 172.21.15.72:0/2972685797 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe1cc0d1500 msgr2=0x7fe1cc0b97b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:35.897 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.886+0000 7fe1d0a00640 1 --2- 172.21.15.72:0/2972685797 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe1cc0d1500 0x7fe1cc0b97b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:35.897 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.886+0000 7fe1d0a00640 1 -- 172.21.15.72:0/2972685797 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe1cc0d47c0 msgr2=0x7fe1cc0cbd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:35.897 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.886+0000 7fe1d0a00640 1 --2- 172.21.15.72:0/2972685797 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe1cc0d47c0 0x7fe1cc0cbd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:35.897 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.886+0000 7fe1d0a00640 1 -- 172.21.15.72:0/2972685797 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1cc0cc930 con 0x7fe1cc0cf2d0 2024-04-04T06:56:35.898 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.886+0000 7fc10b400640 1 -- 172.21.15.72:0/526498701 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0f8035020 con 0x7fc10c15bf10 2024-04-04T06:56:35.898 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.886+0000 7fc10b400640 1 -- 172.21.15.72:0/526498701 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0f8031890 con 0x7fc10c15bf10 2024-04-04T06:56:35.898 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.887+0000 7f4d22000640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f4d1c0cea50 0x7f4d1c0ceec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:35.898 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.887+0000 7f4d20c00640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f4d1c15e450 0x7f4d1c0b74e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:52660/0 (socket says 172.21.15.72:52660) 2024-04-04T06:56:35.899 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.887+0000 7fc113400640 1 -- 172.21.15.72:0/526498701 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc10c15bf10 msgr2=0x7fc10c0b44e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:35.899 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.887+0000 7fc113400640 1 --2- 172.21.15.72:0/526498701 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc10c15bf10 0x7fc10c0b44e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fc0f80097d0 tx=0x7fc0f802b930 comp rx=0 tx=0).stop 2024-04-04T06:56:35.899 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.887+0000 7fc113400640 1 -- 172.21.15.72:0/526498701 shutdown_connections 2024-04-04T06:56:35.899 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.887+0000 7fc113400640 1 --2- 172.21.15.72:0/526498701 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc10c15bf10 0x7fc10c0b44e0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:35.899 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.887+0000 7fc113400640 1 -- 172.21.15.72:0/526498701 >> 172.21.15.72:0/526498701 conn(0x7fc10c06b470 msgr2=0x7fc10c06b850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:56:35.899 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.887+0000 7fe1d0a00640 1 --2- 172.21.15.72:0/2972685797 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe1cc0cf2d0 0x7fe1cc0b9270 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fe1c000e870 tx=0x7fe1c000ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:35.900 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.885+0000 7f4db1e00640 1 -- start start 2024-04-04T06:56:35.900 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.887+0000 7f4db1e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4dac162540 0x7f4dac0aa5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:35.900 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.887+0000 7f4db1e00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4dac1f97b0 0x7f4dac146f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:35.900 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.887+0000 7f4db1e00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4dac1f9c30 0x7f4dac1474d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:35.900 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.887+0000 7f4db1e00640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f4dac0b4700 con 0x7f4dac1f9c30 2024-04-04T06:56:35.900 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.887+0000 7f4db1e00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f4dac164580 con 0x7f4dac1f97b0 2024-04-04T06:56:35.900 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.887+0000 7f4db1e00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f4dac0b4880 con 0x7f4dac162540 2024-04-04T06:56:35.900 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.887+0000 7f4d20c00640 1 -- 172.21.15.72:0/2018194830 learned_addr learned my addr 172.21.15.72:0/2018194830 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-04-04T06:56:35.901 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.888+0000 7fe2cfe00640 1 --2- 172.21.15.72:0/1957370615 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe2d00b39e0 0x7fe2d014bef0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe2bc00c4a0 tx=0x7fe2bc00c960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:35.901 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.886+0000 7ff280a00640 1 Processor -- start 2024-04-04T06:56:35.901 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.887+0000 7ff280a00640 1 -- start start 2024-04-04T06:56:35.901 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.888+0000 7f4da2000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4dac1f97b0 0x7f4dac146f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:35.901 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.888+0000 7f4d22000640 1 -- 172.21.15.72:0/2018194830 --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d1c0b3890 con 0x7f4d1c15e450 2024-04-04T06:56:35.902 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.888+0000 7f4da2000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4dac1f97b0 0x7f4dac146f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.72:39944/0 (socket says 172.21.15.72:39944) 2024-04-04T06:56:35.902 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.888+0000 7f4d22000640 1 -- 172.21.15.72:0/2018194830 --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d1c0cf5a0 con 0x7f4d1c0d0800 2024-04-04T06:56:35.902 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.888+0000 7f4da2000640 1 -- 172.21.15.72:0/2806653234 learned_addr learned my addr 172.21.15.72:0/2806653234 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:56:35.903 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.888+0000 7f4d22000640 1 -- 172.21.15.72:0/2018194830 --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f4d1c0cfb60 con 0x7f4d1c0cea50 2024-04-04T06:56:35.903 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.888+0000 7fe2ccc00640 1 -- 172.21.15.72:0/1957370615 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2bc017070 con 0x7fe2d00b39e0 2024-04-04T06:56:35.903 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.888+0000 7fe2d7400640 1 -- 172.21.15.72:0/1957370615 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2d014b130 con 0x7fe2d00b39e0 2024-04-04T06:56:35.903 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.888+0000 7fe2d7400640 1 -- 172.21.15.72:0/1957370615 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2d014b6f0 con 0x7fe2d00b39e0 2024-04-04T06:56:35.904 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.889+0000 7f4d1b400640 1 -- 172.21.15.72:0/2018194830 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 531857564 0 0) 0x7f4d1c0cf5a0 con 0x7f4d1c0d0800 2024-04-04T06:56:35.904 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.889+0000 7f4d1b400640 1 -- 172.21.15.72:0/2018194830 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4d00003520 con 0x7f4d1c0d0800 2024-04-04T06:56:35.904 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.890+0000 7f4d1b400640 1 -- 172.21.15.72:0/2018194830 <== mon.1 v1:172.21.15.117:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3466348034 0 0) 0x7f4d00003520 con 0x7f4d1c0d0800 2024-04-04T06:56:35.904 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.890+0000 7f4d1b400640 1 -- 172.21.15.72:0/2018194830 >> v2:172.21.15.72:3300/0 conn(0x7f4d1c0cea50 msgr2=0x7f4d1c0ceec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:56:35.904 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.890+0000 7f4d1b400640 1 --2- 172.21.15.72:0/2018194830 >> v2:172.21.15.72:3300/0 conn(0x7f4d1c0cea50 0x7f4d1c0ceec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:35.904 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.890+0000 7f4d1b400640 1 -- 172.21.15.72:0/2018194830 >> v1:172.21.15.72:6789/0 conn(0x7f4d1c15e450 legacy=0x7f4d1c0b74e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:35.904 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.890+0000 7f4d1b400640 1 -- 172.21.15.72:0/2018194830 --> v1:172.21.15.117:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d1c0cf880 con 0x7f4d1c0d0800 2024-04-04T06:56:35.904 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.890+0000 7f4d1b400640 1 -- 172.21.15.72:0/2018194830 <== mon.1 v1:172.21.15.117:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2465650867 0 0) 0x7f4d0c001670 con 0x7f4d1c0d0800 2024-04-04T06:56:35.904 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.890+0000 7f4d1b400640 1 -- 172.21.15.72:0/2018194830 >> v1:172.21.15.117:6789/0 conn(0x7f4d1c0d0800 legacy=0x7f4d1c0d0c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:35.904 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.890+0000 7f4d1b400640 1 --2- 172.21.15.72:0/2018194830 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4d000039b0 0x7f4d00003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:35.904 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.890+0000 7f4d1b400640 1 --2- 172.21.15.72:0/2018194830 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4d00004800 0x7f4d00004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:35.905 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.890+0000 7f4d1b400640 1 --2- 172.21.15.72:0/2018194830 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4d000052e0 0x7f4d0000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:35.905 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.890+0000 7f4d1b400640 1 -- 172.21.15.72:0/2018194830 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f4d1c0cfb60 con 0x7f4d000052e0 2024-04-04T06:56:35.905 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.890+0000 7f4d1b400640 1 -- 172.21.15.72:0/2018194830 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f4d0000c1d0 con 0x7f4d00004800 2024-04-04T06:56:35.905 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.890+0000 7f4d1b400640 1 -- 172.21.15.72:0/2018194830 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f4d0000c3d0 con 0x7f4d000039b0 2024-04-04T06:56:35.905 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.890+0000 7f4daaa00640 1 --2- 172.21.15.72:0/2806653234 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4dac162540 0x7f4dac0aa5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:35.905 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.891+0000 7fe2ccc00640 1 -- 172.21.15.72:0/1957370615 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2bc005ce0 con 0x7fe2d00b39e0 2024-04-04T06:56:35.906 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.891+0000 7f4dab400640 1 --2- 172.21.15.72:0/2806653234 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4dac1f9c30 0x7f4dac1474d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:35.906 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.891+0000 7fe2ccc00640 1 -- 172.21.15.72:0/1957370615 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2bc007270 con 0x7fe2d00b39e0 2024-04-04T06:56:35.906 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.891+0000 7f4d21600640 1 --2- 172.21.15.72:0/2018194830 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4d000052e0 0x7f4d0000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:35.906 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.891+0000 7f4d20c00640 1 --2- 172.21.15.72:0/2018194830 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4d000039b0 0x7f4d00003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:35.907 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.891+0000 7f4da2000640 1 -- 172.21.15.72:0/2806653234 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4dac162540 msgr2=0x7f4dac0aa5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:35.907 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.891+0000 7f4da2000640 1 --2- 172.21.15.72:0/2806653234 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4dac162540 0x7f4dac0aa5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:35.907 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.891+0000 7fe1c8c00640 1 -- 172.21.15.72:0/2972685797 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1c0017070 con 0x7fe1cc0cf2d0 2024-04-04T06:56:35.907 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.892+0000 7fe1c8c00640 1 -- 172.21.15.72:0/2972685797 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1c000ee60 con 0x7fe1cc0cf2d0 2024-04-04T06:56:35.907 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.892+0000 7fe1c8c00640 1 -- 172.21.15.72:0/2972685797 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1c000cb40 con 0x7fe1cc0cf2d0 2024-04-04T06:56:35.908 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.892+0000 7f4da2000640 1 -- 172.21.15.72:0/2806653234 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4dac1f9c30 msgr2=0x7f4dac1474d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:35.908 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.892+0000 7fe1d3400640 1 -- 172.21.15.72:0/2972685797 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1cc0ccc10 con 0x7fe1cc0cf2d0 2024-04-04T06:56:35.908 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.892+0000 7f4da2000640 1 --2- 172.21.15.72:0/2806653234 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4dac1f9c30 0x7f4dac1474d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:35.909 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.888+0000 7fc113400640 1 -- 172.21.15.72:0/526498701 shutdown_connections 2024-04-04T06:56:35.909 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.888+0000 7fc113400640 1 -- 172.21.15.72:0/526498701 wait complete. 2024-04-04T06:56:35.909 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.891+0000 7fc113400640 1 Processor -- start 2024-04-04T06:56:35.909 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.891+0000 7fc113400640 1 -- start start 2024-04-04T06:56:35.909 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.892+0000 7f4d20c00640 1 -- 172.21.15.72:0/2018194830 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4d00004800 msgr2=0x7f4d00004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:56:35.910 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.892+0000 7f4d20c00640 1 --2- 172.21.15.72:0/2018194830 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4d00004800 0x7f4d00004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:35.910 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.892+0000 7f4d20c00640 1 -- 172.21.15.72:0/2018194830 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4d000052e0 msgr2=0x7f4d0000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:56:35.910 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.892+0000 7fc113400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc10c0b2e80 0x7fc10c08b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:35.910 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.892+0000 7fc113400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc10c15bf10 0x7fc10c0b1050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:35.910 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.893+0000 7fc113400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc10c15c370 0x7fc10c0b1590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:35.910 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.893+0000 7fc113400640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fc10c15ea50 con 0x7fc10c0b2e80 2024-04-04T06:56:35.910 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.893+0000 7fc113400640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fc10c0b3fc0 con 0x7fc10c15c370 2024-04-04T06:56:35.911 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.893+0000 7fc113400640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fc10c15ebd0 con 0x7fc10c15bf10 2024-04-04T06:56:35.911 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.893+0000 7fe2ccc00640 1 -- 172.21.15.72:0/1957370615 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe2bc01a070 con 0x7fe2d00b39e0 2024-04-04T06:56:35.911 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.889+0000 7ff280a00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff27c0b79b0 0x7ff27c0cb170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:35.911 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.892+0000 7fe1d3400640 1 -- 172.21.15.72:0/2972685797 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1cc0cd1d0 con 0x7fe1cc0cf2d0 2024-04-04T06:56:35.912 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.893+0000 7fc110a00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc10c0b2e80 0x7fc10c08b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:35.912 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.893+0000 7fc110a00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc10c0b2e80 0x7fc10c08b7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46204/0 (socket says 172.21.15.72:46204) 2024-04-04T06:56:35.912 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.893+0000 7fc110a00640 1 -- 172.21.15.72:0/55613287 learned_addr learned my addr 172.21.15.72:0/55613287 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:56:35.912 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.893+0000 7fc10be00640 1 --2- 172.21.15.72:0/55613287 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc10c15bf10 0x7fc10c0b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:35.912 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.894+0000 7fc111400640 1 --2- 172.21.15.72:0/55613287 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc10c15c370 0x7fc10c0b1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:35.912 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.893+0000 7fe2d7400640 1 -- 172.21.15.72:0/1957370615 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe2ac001030 con 0x7fe2d00b39e0 2024-04-04T06:56:35.912 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.894+0000 7fe2ccc00640 1 --2- 172.21.15.72:0/1957370615 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fe2b006c8f0 0x7fe2b006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:35.912 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.894+0000 7fe2ccc00640 1 -- 172.21.15.72:0/1957370615 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fe2bc08ae60 con 0x7fe2d00b39e0 2024-04-04T06:56:35.912 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.894+0000 7fe2ccc00640 1 --2- 172.21.15.72:0/1957370615 >> [v2:172.21.15.117:6824/4293536423,v1:172.21.15.117:6825/4293536423] conn(0x7fe2b0074a90 0x7fe2b0076eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:35.912 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.894+0000 7fe2ccc00640 1 -- 172.21.15.72:0/1957370615 --> [v2:172.21.15.117:6824/4293536423,v1:172.21.15.117:6825/4293536423] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe2bc015e50 con 0x7fe2b0074a90 2024-04-04T06:56:35.913 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.894+0000 7fe2ccc00640 1 -- 172.21.15.72:0/1957370615 <== mon.1 v2:172.21.15.117:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fe2bc08d480 con 0x7fe2d00b39e0 2024-04-04T06:56:35.913 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.889+0000 7ff280a00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff27c0cea70 0x7ff27c1f8350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:35.913 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.889+0000 7ff280a00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff27c15d2b0 0x7ff27c1f8890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:35.913 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.890+0000 7ff279e00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff27c0b79b0 0x7ff27c0cb170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:35.913 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.890+0000 7ff279e00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff27c0b79b0 0x7ff27c0cb170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.72:39954/0 (socket says 172.21.15.72:39954) 2024-04-04T06:56:35.913 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.890+0000 7ff279400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff27c0cea70 0x7ff27c1f8350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:35.913 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.890+0000 7ff279400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff27c0cea70 0x7ff27c1f8350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46176/0 (socket says 172.21.15.72:46176) 2024-04-04T06:56:35.913 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.893+0000 7ff279e00640 1 -- 172.21.15.72:0/2303447420 learned_addr learned my addr 172.21.15.72:0/2303447420 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:56:35.913 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.893+0000 7ff280a00640 1 -- 172.21.15.72:0/2303447420 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7ff27c0d1a20 con 0x7ff27c0cea70 2024-04-04T06:56:35.913 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.893+0000 7ff280a00640 1 -- 172.21.15.72:0/2303447420 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7ff27c0ce840 con 0x7ff27c0b79b0 2024-04-04T06:56:35.913 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.893+0000 7ff280a00640 1 -- 172.21.15.72:0/2303447420 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7ff27c0ccdf0 con 0x7ff27c15d2b0 2024-04-04T06:56:35.913 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.894+0000 7ff279400640 1 -- 172.21.15.72:0/2303447420 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff27c15d2b0 msgr2=0x7ff27c1f8890 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-04T06:56:35.913 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.894+0000 7ff279400640 1 --2- 172.21.15.72:0/2303447420 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff27c15d2b0 0x7ff27c1f8890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:35.914 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.894+0000 7ff279400640 1 -- 172.21.15.72:0/2303447420 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff27c0b79b0 msgr2=0x7ff27c0cb170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:35.914 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.894+0000 7ff279400640 1 --2- 172.21.15.72:0/2303447420 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff27c0b79b0 0x7ff27c0cb170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:35.914 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.894+0000 7ff279400640 1 -- 172.21.15.72:0/2303447420 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff27c1497c0 con 0x7ff27c0cea70 2024-04-04T06:56:35.914 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.893+0000 7f4da2000640 1 -- 172.21.15.72:0/2806653234 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4dac144a00 con 0x7f4dac1f97b0 2024-04-04T06:56:35.914 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.893+0000 7f4daaa00640 1 --2- 172.21.15.72:0/2806653234 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4dac162540 0x7f4dac0aa5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-04T06:56:35.914 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.893+0000 7f4dab400640 1 --2- 172.21.15.72:0/2806653234 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4dac1f9c30 0x7f4dac1474d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-04T06:56:35.914 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.895+0000 7f4d20c00640 1 --2- 172.21.15.72:0/2018194830 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4d000052e0 0x7f4d0000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:35.914 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.895+0000 7f4d20c00640 1 -- 172.21.15.72:0/2018194830 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d1c0cf880 con 0x7f4d000039b0 2024-04-04T06:56:35.915 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.895+0000 7fe1d3400640 1 -- 172.21.15.72:0/2972685797 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe1cc0685a0 con 0x7fe1cc0cf2d0 2024-04-04T06:56:35.915 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.895+0000 7fc110a00640 1 -- 172.21.15.72:0/55613287 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc10c15bf10 msgr2=0x7fc10c0b1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:35.915 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.895+0000 7fc110a00640 1 --2- 172.21.15.72:0/55613287 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc10c15bf10 0x7fc10c0b1050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:35.915 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.895+0000 7fc110a00640 1 -- 172.21.15.72:0/55613287 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc10c15c370 msgr2=0x7fc10c0b1590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:35.915 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.895+0000 7fc110a00640 1 --2- 172.21.15.72:0/55613287 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc10c15c370 0x7fc10c0b1590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:35.915 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.895+0000 7fc110a00640 1 -- 172.21.15.72:0/55613287 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc10c201c80 con 0x7fc10c0b2e80 2024-04-04T06:56:35.916 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.896+0000 7f4da2000640 1 --2- 172.21.15.72:0/2806653234 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4dac1f97b0 0x7f4dac146f90 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f4d94032cd0 tx=0x7f4d94004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:35.916 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.896+0000 7f4d21600640 1 --2- 172.21.15.72:0/2018194830 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4d000052e0 0x7f4d0000b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-04T06:56:35.916 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.896+0000 7f4d21600640 1 -- 172.21.15.72:0/2018194830 reap_dead start 2024-04-04T06:56:35.916 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.896+0000 7ff279400640 1 --2- 172.21.15.72:0/2303447420 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff27c0cea70 0x7ff27c1f8350 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7ff268033000 tx=0x7ff2680046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:35.916 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.897+0000 7f4da3e00640 1 -- 172.21.15.72:0/2806653234 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d94036040 con 0x7f4dac1f97b0 2024-04-04T06:56:35.917 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.897+0000 7f4db1e00640 1 -- 172.21.15.72:0/2806653234 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4dac144ce0 con 0x7f4dac1f97b0 2024-04-04T06:56:35.917 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.897+0000 7f4db1e00640 1 -- 172.21.15.72:0/2806653234 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4dac1452a0 con 0x7f4dac1f97b0 2024-04-04T06:56:35.917 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.897+0000 7fe2d4a00640 1 --2- 172.21.15.72:0/1957370615 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fe2b006c8f0 0x7fe2b006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:35.917 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.897+0000 7f4da3e00640 1 -- 172.21.15.72:0/2806653234 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d94032620 con 0x7f4dac1f97b0 2024-04-04T06:56:35.917 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.898+0000 7fe2d5400640 1 --2- 172.21.15.72:0/1957370615 >> [v2:172.21.15.117:6824/4293536423,v1:172.21.15.117:6825/4293536423] conn(0x7fe2b0074a90 0x7fe2b0076eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:35.918 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.898+0000 7fc110a00640 1 --2- 172.21.15.72:0/55613287 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc10c0b2e80 0x7fc10c08b7d0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fc10000c520 tx=0x7fc10000c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:35.918 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.898+0000 7f4db1e00640 1 -- 172.21.15.72:0/2806653234 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f4d84001030 con 0x7f4dac1f97b0 2024-04-04T06:56:35.918 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.898+0000 7fe1c8c00640 1 -- 172.21.15.72:0/2972685797 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe1c001a070 con 0x7fe1cc0cf2d0 2024-04-04T06:56:35.919 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.897+0000 7ff272000640 1 -- 172.21.15.72:0/2303447420 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff268040070 con 0x7ff27c0cea70 2024-04-04T06:56:35.919 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.897+0000 7ff272000640 1 -- 172.21.15.72:0/2303447420 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff26803a420 con 0x7ff27c0cea70 2024-04-04T06:56:35.919 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.897+0000 7ff272000640 1 -- 172.21.15.72:0/2303447420 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff268035040 con 0x7ff27c0cea70 2024-04-04T06:56:35.919 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.899+0000 7ff280a00640 1 -- 172.21.15.72:0/2303447420 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff27c149aa0 con 0x7ff27c0cea70 2024-04-04T06:56:35.919 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.899+0000 7fe2d4a00640 1 --2- 172.21.15.72:0/1957370615 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fe2b006c8f0 0x7fe2b006edb0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe2c4006fd0 tx=0x7fe2c4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:35.920 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.899+0000 7fe2d5400640 1 --2- 172.21.15.72:0/1957370615 >> [v2:172.21.15.117:6824/4293536423,v1:172.21.15.117:6825/4293536423] conn(0x7fe2b0074a90 0x7fe2b0076eb0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:35.920 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.899+0000 7ff280a00640 1 -- 172.21.15.72:0/2303447420 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff27c0cb6b0 con 0x7ff27c0cea70 2024-04-04T06:56:35.920 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.899+0000 7f4da3e00640 1 -- 172.21.15.72:0/2806653234 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d94036040 con 0x7f4dac1f97b0 2024-04-04T06:56:35.920 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.899+0000 7f4d20c00640 1 --2- 172.21.15.72:0/2018194830 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4d000039b0 0x7f4d00003dd0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f4d1400c160 tx=0x7f4d00005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b5b1e0038b0f5313 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:35.921 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.899+0000 7fc108c00640 1 -- 172.21.15.72:0/55613287 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc100018070 con 0x7fc10c0b2e80 2024-04-04T06:56:35.921 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.899+0000 7fc108c00640 1 -- 172.21.15.72:0/55613287 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1000074e0 con 0x7fc10c0b2e80 2024-04-04T06:56:35.921 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.899+0000 7fc108c00640 1 -- 172.21.15.72:0/55613287 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1000049e0 con 0x7fc10c0b2e80 2024-04-04T06:56:35.921 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.899+0000 7fc113400640 1 -- 172.21.15.72:0/55613287 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc10c14b040 con 0x7fc10c0b2e80 2024-04-04T06:56:35.921 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.900+0000 7fc113400640 1 -- 172.21.15.72:0/55613287 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc10c14b600 con 0x7fc10c0b2e80 2024-04-04T06:56:35.921 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.900+0000 7ff280a00640 1 -- 172.21.15.72:0/2303447420 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff27c0cbbc0 con 0x7ff27c0cea70 2024-04-04T06:56:35.921 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.901+0000 7fc113400640 1 -- 172.21.15.72:0/55613287 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc10c0734a0 con 0x7fc10c0b2e80 2024-04-04T06:56:35.922 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.901+0000 7f4d1b400640 1 -- 172.21.15.72:0/2018194830 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d14001ee0 con 0x7f4d000039b0 2024-04-04T06:56:35.922 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.902+0000 7fe2ccc00640 1 -- 172.21.15.72:0/1957370615 <== osd.4 v2:172.21.15.117:6824/4293536423 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe2bc015e50 con 0x7fe2b0074a90 2024-04-04T06:56:35.923 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.901+0000 7f4d1b400640 1 -- 172.21.15.72:0/2018194830 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d14030070 con 0x7f4d000039b0 2024-04-04T06:56:35.923 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.901+0000 7f4d1b400640 1 -- 172.21.15.72:0/2018194830 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d1402cc10 con 0x7f4d000039b0 2024-04-04T06:56:35.923 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.902+0000 7f4d22000640 1 -- 172.21.15.72:0/2018194830 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4d000039b0 msgr2=0x7f4d00003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:35.923 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.902+0000 7f4d22000640 1 --2- 172.21.15.72:0/2018194830 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4d000039b0 0x7f4d00003dd0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f4d1400c160 tx=0x7f4d00005830 comp rx=0 tx=0).stop 2024-04-04T06:56:35.923 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.902+0000 7f4d22000640 1 -- 172.21.15.72:0/2018194830 shutdown_connections 2024-04-04T06:56:35.923 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.902+0000 7f4d22000640 1 --2- 172.21.15.72:0/2018194830 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4d000039b0 0x7f4d00003dd0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:35.923 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.903+0000 7f4d22000640 1 -- 172.21.15.72:0/2018194830 >> 172.21.15.72:0/2018194830 conn(0x7f4d1c071a90 msgr2=0x7f4d1c071ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:56:35.923 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.901+0000 7fe1c8c00640 1 --2- 172.21.15.72:0/2972685797 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fe1ac06c940 0x7fe1ac06ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:35.924 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.901+0000 7fe1c8c00640 1 -- 172.21.15.72:0/2972685797 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fe1c008c060 con 0x7fe1cc0cf2d0 2024-04-04T06:56:35.924 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.901+0000 7fe1c8c00640 1 --2- 172.21.15.72:0/2972685797 >> [v2:172.21.15.72:6817/2806631742,v1:172.21.15.72:6819/2806631742] conn(0x7fe1ac074bc0 0x7fe1ac076fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:35.924 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.901+0000 7fe1c8c00640 1 -- 172.21.15.72:0/2972685797 --> [v2:172.21.15.72:6817/2806631742,v1:172.21.15.72:6819/2806631742] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe1ac077690 con 0x7fe1ac074bc0 2024-04-04T06:56:35.924 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.901+0000 7fe1c8c00640 1 -- 172.21.15.72:0/2972685797 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fe1c008c410 con 0x7fe1cc0cf2d0 2024-04-04T06:56:35.924 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.902+0000 7fe1d1400640 1 --2- 172.21.15.72:0/2972685797 >> [v2:172.21.15.72:6817/2806631742,v1:172.21.15.72:6819/2806631742] conn(0x7fe1ac074bc0 0x7fe1ac076fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:35.924 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.905+0000 7ff272000640 1 -- 172.21.15.72:0/2303447420 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff26804b060 con 0x7ff27c0cea70 2024-04-04T06:56:35.924 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.905+0000 7f4d22000640 1 -- 172.21.15.72:0/2018194830 shutdown_connections 2024-04-04T06:56:35.924 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.905+0000 7f4d22000640 1 -- 172.21.15.72:0/2018194830 wait complete. 2024-04-04T06:56:35.925 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.906+0000 7fe1cbe00640 1 --2- 172.21.15.72:0/2972685797 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fe1ac06c940 0x7fe1ac06ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:35.925 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.906+0000 7fc108c00640 1 -- 172.21.15.72:0/55613287 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc10001b070 con 0x7fc10c0b2e80 2024-04-04T06:56:35.925 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.906+0000 7ff272000640 1 --2- 172.21.15.72:0/2303447420 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7ff25c06c9c0 0x7ff25c06ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:35.925 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.906+0000 7ff272000640 1 -- 172.21.15.72:0/2303447420 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7ff2680add10 con 0x7ff27c0cea70 2024-04-04T06:56:35.925 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.906+0000 7ff272000640 1 --2- 172.21.15.72:0/2303447420 >> [v2:172.21.15.117:6808/2781186528,v1:172.21.15.117:6809/2781186528] conn(0x7ff25c074c40 0x7ff25c077060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:35.926 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.906+0000 7ff272000640 1 -- 172.21.15.72:0/2303447420 --> [v2:172.21.15.117:6808/2781186528,v1:172.21.15.117:6809/2781186528] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff25c077710 con 0x7ff25c074c40 2024-04-04T06:56:35.926 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.906+0000 7ff272000640 1 -- 172.21.15.72:0/2303447420 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7ff2680ae100 con 0x7ff27c0cea70 2024-04-04T06:56:35.926 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.905+0000 7f4da3e00640 1 -- 172.21.15.72:0/2806653234 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4d94039020 con 0x7f4dac1f97b0 2024-04-04T06:56:35.926 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.907+0000 7f4da3e00640 1 --2- 172.21.15.72:0/2806653234 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f4d8806cb20 0x7f4d8806efe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:35.926 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.907+0000 7fc108c00640 1 --2- 172.21.15.72:0/55613287 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fc0ec06c9c0 0x7fc0ec06ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:35.926 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.907+0000 7fc108c00640 1 -- 172.21.15.72:0/55613287 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fc10008b710 con 0x7fc10c0b2e80 2024-04-04T06:56:35.927 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.908+0000 7f8251a00640 1 Processor -- start 2024-04-04T06:56:35.927 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.907+0000 7ff27a800640 1 --2- 172.21.15.72:0/2303447420 >> [v2:172.21.15.117:6808/2781186528,v1:172.21.15.117:6809/2781186528] conn(0x7ff25c074c40 0x7ff25c077060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:35.927 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.907+0000 7ff279e00640 1 --2- 172.21.15.72:0/2303447420 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7ff25c06c9c0 0x7ff25c06ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:35.928 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.907+0000 7f4da3e00640 1 -- 172.21.15.72:0/2806653234 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f4d940ad910 con 0x7f4dac1f97b0 2024-04-04T06:56:35.928 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.908+0000 7f4daaa00640 1 --2- 172.21.15.72:0/2806653234 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f4d8806cb20 0x7f4d8806efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:35.928 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.908+0000 7f4da3e00640 1 --2- 172.21.15.72:0/2806653234 >> [v2:172.21.15.117:6816/617469882,v1:172.21.15.117:6817/617469882] conn(0x7f4d88074cc0 0x7f4d880770e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:35.928 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.909+0000 7f4d22000640 1 Processor -- start 2024-04-04T06:56:35.928 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.909+0000 7f4da3e00640 1 -- 172.21.15.72:0/2806653234 --> [v2:172.21.15.117:6816/617469882,v1:172.21.15.117:6817/617469882] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4d9403ee50 con 0x7f4d88074cc0 2024-04-04T06:56:35.929 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.907+0000 7fc108c00640 1 --2- 172.21.15.72:0/55613287 >> [v2:172.21.15.72:6808/235374192,v1:172.21.15.72:6809/235374192] conn(0x7fc0ec074c40 0x7fc0ec077060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:35.929 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.907+0000 7fc108c00640 1 -- 172.21.15.72:0/55613287 --> [v2:172.21.15.72:6808/235374192,v1:172.21.15.72:6809/235374192] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc10000de50 con 0x7fc0ec074c40 2024-04-04T06:56:35.929 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.907+0000 7fc108c00640 1 -- 172.21.15.72:0/55613287 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fc10008bb00 con 0x7fc10c0b2e80 2024-04-04T06:56:35.929 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.908+0000 7fc10be00640 1 --2- 172.21.15.72:0/55613287 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fc0ec06c9c0 0x7fc0ec06ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:35.929 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.909+0000 7fc111400640 1 --2- 172.21.15.72:0/55613287 >> [v2:172.21.15.72:6808/235374192,v1:172.21.15.72:6809/235374192] conn(0x7fc0ec074c40 0x7fc0ec077060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:35.930 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.909+0000 7ff279e00640 1 --2- 172.21.15.72:0/2303447420 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7ff25c06c9c0 0x7ff25c06ee80 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff26c000f60 tx=0x7ff26c007f00 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:35.930 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.909+0000 7f4da3e00640 1 -- 172.21.15.72:0/2806653234 <== mon.1 v2:172.21.15.117:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f4d940add00 con 0x7f4dac1f97b0 2024-04-04T06:56:35.930 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.909+0000 7f4dab400640 1 --2- 172.21.15.72:0/2806653234 >> [v2:172.21.15.117:6816/617469882,v1:172.21.15.117:6817/617469882] conn(0x7f4d88074cc0 0x7f4d880770e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:35.930 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.908+0000 7fe1cbe00640 1 --2- 172.21.15.72:0/2972685797 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fe1ac06c940 0x7fe1ac06ee00 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fe1cc0b9f20 tx=0x7fe1b8009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:35.931 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.910+0000 7f4daaa00640 1 --2- 172.21.15.72:0/2806653234 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f4d8806cb20 0x7f4d8806efe0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f4d9c001030 tx=0x7f4d9c0048a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:35.931 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.910+0000 7fc10be00640 1 --2- 172.21.15.72:0/55613287 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fc0ec06c9c0 0x7fc0ec06ee80 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc0f8036000 tx=0x7fc0f8008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:35.931 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.910+0000 7fc111400640 1 --2- 172.21.15.72:0/55613287 >> [v2:172.21.15.72:6808/235374192,v1:172.21.15.72:6809/235374192] conn(0x7fc0ec074c40 0x7fc0ec077060 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:35.931 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.910+0000 7ff27a800640 1 --2- 172.21.15.72:0/2303447420 >> [v2:172.21.15.117:6808/2781186528,v1:172.21.15.117:6809/2781186528] conn(0x7ff25c074c40 0x7ff25c077060 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:35.932 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.909+0000 7f8251a00640 1 -- start start 2024-04-04T06:56:35.932 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.910+0000 7f4d22000640 1 -- start start 2024-04-04T06:56:35.932 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.911+0000 7f4dab400640 1 --2- 172.21.15.72:0/2806653234 >> [v2:172.21.15.117:6816/617469882,v1:172.21.15.117:6817/617469882] conn(0x7f4d88074cc0 0x7f4d880770e0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:35.932 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.911+0000 7fc108c00640 1 -- 172.21.15.72:0/55613287 <== osd.2 v2:172.21.15.72:6808/235374192 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc10000de50 con 0x7fc0ec074c40 2024-04-04T06:56:35.933 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.911+0000 7fe1d1400640 1 --2- 172.21.15.72:0/2972685797 >> [v2:172.21.15.72:6817/2806631742,v1:172.21.15.72:6819/2806631742] conn(0x7fe1ac074bc0 0x7fe1ac076fe0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:35.933 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.912+0000 7f8251a00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f824c15e980 0x7f824c0b4570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:35.933 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.912+0000 7f8251a00640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f824c071ec0 con 0x7f824c06df80 2024-04-04T06:56:35.933 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.912+0000 7f8251a00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f824c0721a0 con 0x7f824c0cf290 2024-04-04T06:56:35.933 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.912+0000 7f8251a00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f824c072480 con 0x7f824c15e980 2024-04-04T06:56:35.933 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.912+0000 7fe1c8c00640 1 -- 172.21.15.72:0/2972685797 <== osd.3 v2:172.21.15.72:6817/2806631742 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe1ac077690 con 0x7fe1ac074bc0 2024-04-04T06:56:35.934 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.912+0000 7f824aa00640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f824c06df80 0x7f824c15a180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:52674/0 (socket says 172.21.15.72:52674) 2024-04-04T06:56:35.934 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.912+0000 7f824aa00640 1 -- 172.21.15.72:0/1579565682 learned_addr learned my addr 172.21.15.72:0/1579565682 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-04-04T06:56:35.934 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.912+0000 7ff272000640 1 -- 172.21.15.72:0/2303447420 <== osd.6 v2:172.21.15.117:6808/2781186528 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff25c077710 con 0x7ff25c074c40 2024-04-04T06:56:35.934 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.912+0000 7f824b400640 1 --2- 172.21.15.72:0/1579565682 >> v2:172.21.15.117:3300/0 conn(0x7f824c15e980 0x7f824c0b4570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:35.934 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.913+0000 7f4d22000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4d000039b0 0x7f4d1c1504c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:35.935 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.913+0000 7f8249600640 1 -- 172.21.15.72:0/1579565682 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2918217087 0 0) 0x7f824c071ec0 con 0x7f824c06df80 2024-04-04T06:56:35.935 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.913+0000 7f8249600640 1 -- 172.21.15.72:0/1579565682 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8230003520 con 0x7f824c06df80 2024-04-04T06:56:35.935 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.913+0000 7f4d22000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4d1c15dab0 0x7f4d1c0b54f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:35.935 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.913+0000 7f4d22000640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4d1c15a5f0 0x7f4d1c15aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:35.935 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.913+0000 7f4d22000640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f4d1c15e830 con 0x7f4d1c15a5f0 2024-04-04T06:56:35.936 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.913+0000 7f4d22000640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f4d1c0d2670 con 0x7f4d1c15dab0 2024-04-04T06:56:35.936 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.913+0000 7f4d22000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f4d1c15e9b0 con 0x7f4d000039b0 2024-04-04T06:56:35.936 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.913+0000 7f824b400640 1 -- 172.21.15.72:0/1579565682 >> v1:172.21.15.117:6789/0 conn(0x7f824c0cf290 legacy=0x7f824c0b3e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:35.936 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.913+0000 7f8249600640 1 -- 172.21.15.72:0/1579565682 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2311531185 0 0) 0x7f8230003520 con 0x7f824c06df80 2024-04-04T06:56:35.936 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.913+0000 7f824b400640 1 -- 172.21.15.72:0/1579565682 >> v1:172.21.15.72:6789/0 conn(0x7f824c06df80 legacy=0x7f824c15a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:35.936 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.913+0000 7f824b400640 1 -- 172.21.15.72:0/1579565682 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f824c0b3940 con 0x7f824c15e980 2024-04-04T06:56:35.936 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.914+0000 7f4da3e00640 1 -- 172.21.15.72:0/2806653234 <== osd.7 v2:172.21.15.117:6816/617469882 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f4d9403ee50 con 0x7f4d88074cc0 2024-04-04T06:56:35.937 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.914+0000 7f4d1be00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4d1c15dab0 0x7f4d1c0b54f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:35.937 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.914+0000 7f4d1be00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4d1c15dab0 0x7f4d1c0b54f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.72:39992/0 (socket says 172.21.15.72:39992) 2024-04-04T06:56:35.937 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.914+0000 7f4d1be00640 1 -- 172.21.15.72:0/420962209 learned_addr learned my addr 172.21.15.72:0/420962209 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:56:35.938 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.915+0000 7f4d20c00640 1 --2- 172.21.15.72:0/420962209 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4d000039b0 0x7f4d1c1504c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:35.938 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.915+0000 7f4d21600640 1 --2- 172.21.15.72:0/420962209 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4d1c15a5f0 0x7f4d1c15aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:35.938 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.917+0000 7f4d21600640 1 -- 172.21.15.72:0/420962209 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4d000039b0 msgr2=0x7f4d1c1504c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:35.938 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.917+0000 7f4d21600640 1 --2- 172.21.15.72:0/420962209 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4d000039b0 0x7f4d1c1504c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:35.938 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.917+0000 7f4d21600640 1 -- 172.21.15.72:0/420962209 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4d1c15dab0 msgr2=0x7f4d1c0b54f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:35.938 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.917+0000 7f4d21600640 1 --2- 172.21.15.72:0/420962209 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4d1c15dab0 0x7f4d1c0b54f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:35.938 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.917+0000 7f4d21600640 1 -- 172.21.15.72:0/420962209 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d1c0b6400 con 0x7f4d1c15a5f0 2024-04-04T06:56:35.938 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.917+0000 7f4d1be00640 1 --2- 172.21.15.72:0/420962209 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4d1c15dab0 0x7f4d1c0b54f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-04T06:56:35.938 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.918+0000 7f4d21600640 1 --2- 172.21.15.72:0/420962209 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4d1c15a5f0 0x7f4d1c15aa80 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f4d1c0d50e0 tx=0x7f4d0c00dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:35.939 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.918+0000 7f824b400640 1 --2- 172.21.15.72:0/1579565682 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f824c15e980 0x7f824c0b4570 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f8244009d90 tx=0x7f824402be20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a4dc7f2c7cd2fd1 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:35.939 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.919+0000 7f8249600640 1 -- 172.21.15.72:0/1579565682 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8244039070 con 0x7f824c15e980 2024-04-04T06:56:35.939 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.919+0000 7f8249600640 1 -- 172.21.15.72:0/1579565682 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f824402c950 con 0x7f824c15e980 2024-04-04T06:56:35.939 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.919+0000 7f8249600640 1 -- 172.21.15.72:0/1579565682 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f823c001670 con 0x7f824c15e980 2024-04-04T06:56:35.939 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.919+0000 7f8251a00640 1 -- 172.21.15.72:0/1579565682 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f824c15e980 msgr2=0x7f824c0b4570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:35.939 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.919+0000 7f8251a00640 1 --2- 172.21.15.72:0/1579565682 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f824c15e980 0x7f824c0b4570 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f8244009d90 tx=0x7f824402be20 comp rx=0 tx=0).stop 2024-04-04T06:56:35.940 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.920+0000 7f4d18c00640 1 -- 172.21.15.72:0/420962209 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d0c018070 con 0x7f4d1c15a5f0 2024-04-04T06:56:35.940 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.920+0000 7f4d18c00640 1 -- 172.21.15.72:0/420962209 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d0c005070 con 0x7f4d1c15a5f0 2024-04-04T06:56:35.940 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.920+0000 7f4d18c00640 1 -- 172.21.15.72:0/420962209 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d0c005460 con 0x7f4d1c15a5f0 2024-04-04T06:56:35.940 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.920+0000 7f8251a00640 1 -- 172.21.15.72:0/1579565682 shutdown_connections 2024-04-04T06:56:35.940 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.920+0000 7f8251a00640 1 --2- 172.21.15.72:0/1579565682 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f824c15e980 0x7f824c0b4570 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:35.941 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.920+0000 7f8251a00640 1 -- 172.21.15.72:0/1579565682 >> 172.21.15.72:0/1579565682 conn(0x7f824c06d490 msgr2=0x7f824c06d870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:56:35.941 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.921+0000 7f8251a00640 1 -- 172.21.15.72:0/1579565682 shutdown_connections 2024-04-04T06:56:35.941 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.921+0000 7f8251a00640 1 -- 172.21.15.72:0/1579565682 wait complete. 2024-04-04T06:56:35.941 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.921+0000 7f4d22000640 1 -- 172.21.15.72:0/420962209 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d1c0b5e40 con 0x7f4d1c15a5f0 2024-04-04T06:56:35.941 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.921+0000 7f4d22000640 1 -- 172.21.15.72:0/420962209 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d1c0c8570 con 0x7f4d1c15a5f0 2024-04-04T06:56:35.941 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.923+0000 7f4d22000640 1 -- 172.21.15.72:0/420962209 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f4d1c0685a0 con 0x7f4d1c15a5f0 2024-04-04T06:56:35.942 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.923+0000 7f8251a00640 1 Processor -- start 2024-04-04T06:56:35.942 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.923+0000 7fcb83e00640 1 Processor -- start 2024-04-04T06:56:35.942 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.923+0000 7fcb83e00640 1 -- start start 2024-04-04T06:56:35.942 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.925+0000 7f4d18c00640 1 -- 172.21.15.72:0/420962209 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4d0c01b070 con 0x7f4d1c15a5f0 2024-04-04T06:56:35.943 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.926+0000 7fcb83e00640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fcb7c166a20 0x7fcb7c0d06c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:35.943 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.926+0000 7fcb83e00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fcb7c166eb0 0x7fcb7c0d0c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:35.943 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.926+0000 7fcb83e00640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcb7c0d3130 con 0x7fcb7c162910 2024-04-04T06:56:35.943 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.926+0000 7fcb83e00640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7fcb7c0d4bf0 con 0x7fcb7c166a20 2024-04-04T06:56:35.943 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.926+0000 7fcb83e00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fcb7c0d3d00 con 0x7fcb7c166eb0 2024-04-04T06:56:35.943 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.926+0000 7fcb80a00640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fcb7c166a20 0x7fcb7c0d06c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:35.943 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.926+0000 7fcb80a00640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fcb7c166a20 0x7fcb7c0d06c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46216/0 (socket says 172.21.15.72:46216) 2024-04-04T06:56:35.943 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.926+0000 7fcb80a00640 1 -- 172.21.15.72:0/1135470802 learned_addr learned my addr 172.21.15.72:0/1135470802 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:56:35.943 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.926+0000 7f8251a00640 1 -- start start 2024-04-04T06:56:35.944 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.927+0000 7f4d18c00640 1 --2- 172.21.15.72:0/420962209 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f4cfc06c9f0 0x7f4cfc06eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:35.944 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.927+0000 7f8251a00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f824c06df80 0x7f824c153440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:35.944 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.927+0000 7f4d18c00640 1 -- 172.21.15.72:0/420962209 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f4d0c08b0c0 con 0x7f4d1c15a5f0 2024-04-04T06:56:35.944 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.928+0000 7f8251a00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f824c0cf290 0x7f824c15a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:35.945 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.928+0000 7f4d18c00640 1 --2- 172.21.15.72:0/420962209 >> [v2:172.21.15.72:6800/3101663154,v1:172.21.15.72:6801/3101663154] conn(0x7f4cfc074c10 0x7f4cfc077030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:35.945 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.928+0000 7f8251a00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f824c15e980 0x7f824c0cd490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:35.945 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.928+0000 7f4d18c00640 1 -- 172.21.15.72:0/420962209 --> [v2:172.21.15.72:6800/3101663154,v1:172.21.15.72:6801/3101663154] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4cfc0776e0 con 0x7f4cfc074c10 2024-04-04T06:56:35.945 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.928+0000 7f4d18c00640 1 -- 172.21.15.72:0/420962209 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f4d0c092050 con 0x7f4d1c15a5f0 2024-04-04T06:56:35.946 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.928+0000 7f824aa00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f824c06df80 0x7f824c153440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:35.946 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.928+0000 7f824aa00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f824c06df80 0x7f824c153440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.72:40330/0 (socket says 172.21.15.72:40330) 2024-04-04T06:56:35.946 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.929+0000 7f824aa00640 1 -- 172.21.15.72:0/1212505255 learned_addr learned my addr 172.21.15.72:0/1212505255 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:56:35.946 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.929+0000 7f4d1be00640 1 --2- 172.21.15.72:0/420962209 >> [v2:172.21.15.72:6800/3101663154,v1:172.21.15.72:6801/3101663154] conn(0x7f4cfc074c10 0x7f4cfc077030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:35.947 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.929+0000 7f8251a00640 1 -- 172.21.15.72:0/1212505255 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f824c0b4c30 con 0x7f824c0cf290 2024-04-04T06:56:35.947 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.929+0000 7f824a000640 1 --2- 172.21.15.72:0/1212505255 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f824c0cf290 0x7f824c15a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:35.947 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.929+0000 7f824b400640 1 --2- 172.21.15.72:0/1212505255 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f824c15e980 0x7f824c0cd490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:35.947 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.928+0000 7fcb80a00640 1 -- 172.21.15.72:0/1135470802 >> v2:172.21.15.117:3300/0 conn(0x7fcb7c166eb0 msgr2=0x7fcb7c0d0c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:56:35.948 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.928+0000 7fcb80a00640 1 --2- 172.21.15.72:0/1135470802 >> v2:172.21.15.117:3300/0 conn(0x7fcb7c166eb0 0x7fcb7c0d0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:35.948 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.928+0000 7fcb80a00640 1 -- 172.21.15.72:0/1135470802 >> v1:172.21.15.72:6789/0 conn(0x7fcb7c162910 legacy=0x7fcb7c166310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:35.948 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.928+0000 7fcb80a00640 1 -- 172.21.15.72:0/1135470802 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb7c0d3fe0 con 0x7fcb7c166a20 2024-04-04T06:56:35.948 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.929+0000 7f8251a00640 1 -- 172.21.15.72:0/1212505255 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f824c0b4ab0 con 0x7f824c15e980 2024-04-04T06:56:35.948 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.930+0000 7f8251a00640 1 -- 172.21.15.72:0/1212505255 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f824c0b4db0 con 0x7f824c06df80 2024-04-04T06:56:35.948 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.930+0000 7f4d20c00640 1 --2- 172.21.15.72:0/420962209 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f4cfc06c9f0 0x7f4cfc06eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:35.949 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.931+0000 7f824aa00640 1 -- 172.21.15.72:0/1212505255 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f824c15e980 msgr2=0x7f824c0cd490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:35.949 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.931+0000 7f824aa00640 1 --2- 172.21.15.72:0/1212505255 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f824c15e980 0x7f824c0cd490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:35.949 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.931+0000 7f824aa00640 1 -- 172.21.15.72:0/1212505255 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f824c0cf290 msgr2=0x7f824c15a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:35.949 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.931+0000 7f824aa00640 1 --2- 172.21.15.72:0/1212505255 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f824c0cf290 0x7f824c15a360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:35.950 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.931+0000 7f4d20c00640 1 --2- 172.21.15.72:0/420962209 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f4cfc06c9f0 0x7f4cfc06eeb0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f4d14034000 tx=0x7f4d14007000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:35.950 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.931+0000 7f4d1be00640 1 --2- 172.21.15.72:0/420962209 >> [v2:172.21.15.72:6800/3101663154,v1:172.21.15.72:6801/3101663154] conn(0x7f4cfc074c10 0x7f4cfc077030 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:35.951 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.931+0000 7f824aa00640 1 -- 172.21.15.72:0/1212505255 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f824c153ea0 con 0x7f824c06df80 2024-04-04T06:56:35.951 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.932+0000 7f824aa00640 1 --2- 172.21.15.72:0/1212505255 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f824c06df80 0x7f824c153440 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f823c00c720 tx=0x7f823c00cbe0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:35.951 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.932+0000 7f8242a00640 1 -- 172.21.15.72:0/1212505255 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f823c005ad0 con 0x7f824c06df80 2024-04-04T06:56:35.951 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.932+0000 7f8242a00640 1 -- 172.21.15.72:0/1212505255 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f823c005c70 con 0x7f824c06df80 2024-04-04T06:56:35.951 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.933+0000 7f8251a00640 1 -- 172.21.15.72:0/1212505255 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f824c153980 con 0x7f824c06df80 2024-04-04T06:56:35.951 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.933+0000 7f4d18c00640 1 -- 172.21.15.72:0/420962209 <== osd.1 v2:172.21.15.72:6800/3101663154 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f4cfc0776e0 con 0x7f4cfc074c10 2024-04-04T06:56:35.951 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.933+0000 7fcb80a00640 1 --2- 172.21.15.72:0/1135470802 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcb7c166a20 0x7fcb7c0d06c0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fcb7c0ce890 tx=0x7fcb7002b9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59bd89ee6e604d17 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:35.952 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.933+0000 7f8251a00640 1 -- 172.21.15.72:0/1212505255 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f824c2025d0 con 0x7f824c06df80 2024-04-04T06:56:35.952 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.933+0000 7f8242a00640 1 -- 172.21.15.72:0/1212505255 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f823c005e60 con 0x7f824c06df80 2024-04-04T06:56:35.952 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.935+0000 7f8251a00640 1 -- 172.21.15.72:0/1212505255 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f824c0757a0 con 0x7f824c06df80 2024-04-04T06:56:35.952 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.937+0000 7f8242a00640 1 -- 172.21.15.72:0/1212505255 <== mon.2 v2:172.21.15.117:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f823c007270 con 0x7f824c06df80 2024-04-04T06:56:35.953 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.934+0000 7fcb7be00640 1 -- 172.21.15.72:0/1135470802 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb70034070 con 0x7fcb7c166a20 2024-04-04T06:56:35.953 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.934+0000 7fcb7be00640 1 -- 172.21.15.72:0/1135470802 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb70030870 con 0x7fcb7c166a20 2024-04-04T06:56:35.953 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.935+0000 7fcb83e00640 1 -- 172.21.15.72:0/1135470802 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcb7c166a20 msgr2=0x7fcb7c0d06c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:35.953 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.935+0000 7fcb83e00640 1 --2- 172.21.15.72:0/1135470802 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcb7c166a20 0x7fcb7c0d06c0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fcb7c0ce890 tx=0x7fcb7002b9b0 comp rx=0 tx=0).stop 2024-04-04T06:56:35.953 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.935+0000 7fcb83e00640 1 -- 172.21.15.72:0/1135470802 shutdown_connections 2024-04-04T06:56:35.953 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.935+0000 7fcb83e00640 1 --2- 172.21.15.72:0/1135470802 >> v2:172.21.15.117:3300/0 conn(0x7fcb7c166eb0 0x7fcb7c0d0c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:35.953 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.935+0000 7fcb83e00640 1 --2- 172.21.15.72:0/1135470802 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcb7c166a20 0x7fcb7c0d06c0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:35.953 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.935+0000 7fcb83e00640 1 -- 172.21.15.72:0/1135470802 >> 172.21.15.72:0/1135470802 conn(0x7fcb7c06b470 msgr2=0x7fcb7c06b880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:56:35.953 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.935+0000 7fcb83e00640 1 -- 172.21.15.72:0/1135470802 shutdown_connections 2024-04-04T06:56:35.953 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.935+0000 7fcb83e00640 1 -- 172.21.15.72:0/1135470802 wait complete. 2024-04-04T06:56:35.953 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.938+0000 7fcb83e00640 1 Processor -- start 2024-04-04T06:56:35.953 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.938+0000 7fcb83e00640 1 -- start start 2024-04-04T06:56:35.954 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.939+0000 7f8242a00640 1 --2- 172.21.15.72:0/1212505255 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f822c06c940 0x7f822c06ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:35.954 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.940+0000 7fcb83e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcb7c162910 0x7fcb7c0cc490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:35.954 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.940+0000 7fcb83e00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcb7c166a20 0x7fcb7c0ce920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:35.954 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.939+0000 7f8242a00640 1 -- 172.21.15.72:0/1212505255 <== mon.2 v2:172.21.15.117:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f823c08bb80 con 0x7f824c06df80 2024-04-04T06:56:35.955 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.939+0000 7f8242a00640 1 --2- 172.21.15.72:0/1212505255 >> [v2:172.21.15.72:6816/3889813953,v1:172.21.15.72:6818/3889813953] conn(0x7f822c074bc0 0x7f822c076fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:35.955 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.939+0000 7f8242a00640 1 -- 172.21.15.72:0/1212505255 --> [v2:172.21.15.72:6816/3889813953,v1:172.21.15.72:6818/3889813953] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f822c077690 con 0x7f822c074bc0 2024-04-04T06:56:35.955 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.939+0000 7f8242a00640 1 -- 172.21.15.72:0/1212505255 <== mon.2 v2:172.21.15.117:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f823c08bf70 con 0x7f824c06df80 2024-04-04T06:56:35.955 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.940+0000 7fcb83e00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcb7c166eb0 0x7fcb7c0c7200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:35.955 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.940+0000 7fcb83e00640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fcb7c0d4880 con 0x7fcb7c166a20 2024-04-04T06:56:35.955 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.940+0000 7fcb83e00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fcb7c0d45a0 con 0x7fcb7c166eb0 2024-04-04T06:56:35.955 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.940+0000 7fcb83e00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fcb7c0c7de0 con 0x7fcb7c162910 2024-04-04T06:56:35.955 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.940+0000 7f824a000640 1 --2- 172.21.15.72:0/1212505255 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f822c06c940 0x7f822c06ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:35.956 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.941+0000 7fcb81e00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcb7c166eb0 0x7fcb7c0c7200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:35.956 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.941+0000 7fcb81e00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcb7c166eb0 0x7fcb7c0c7200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.72:40018/0 (socket says 172.21.15.72:40018) 2024-04-04T06:56:35.956 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.941+0000 7fcb81e00640 1 -- 172.21.15.72:0/3888991861 learned_addr learned my addr 172.21.15.72:0/3888991861 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:56:35.956 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.941+0000 7fcb80a00640 1 --2- 172.21.15.72:0/3888991861 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcb7c166a20 0x7fcb7c0ce920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:35.956 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.941+0000 7fcb81400640 1 --2- 172.21.15.72:0/3888991861 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcb7c162910 0x7fcb7c0cc490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:35.956 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.941+0000 7fc113400640 1 -- 172.21.15.72:0/55613287 --> [v2:172.21.15.72:6808/235374192,v1:172.21.15.72:6809/235374192] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fc10c15da50 con 0x7fc0ec074c40 2024-04-04T06:56:35.957 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.941+0000 7fcb80a00640 1 -- 172.21.15.72:0/3888991861 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcb7c162910 msgr2=0x7fcb7c0cc490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:35.958 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.941+0000 7fcb80a00640 1 --2- 172.21.15.72:0/3888991861 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcb7c162910 0x7fcb7c0cc490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:35.958 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.941+0000 7fcb80a00640 1 -- 172.21.15.72:0/3888991861 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcb7c166eb0 msgr2=0x7fcb7c0c7200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:35.958 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.941+0000 7fcb80a00640 1 --2- 172.21.15.72:0/3888991861 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcb7c166eb0 0x7fcb7c0c7200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:35.958 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.941+0000 7fcb80a00640 1 -- 172.21.15.72:0/3888991861 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb7c0c7740 con 0x7fcb7c166a20 2024-04-04T06:56:35.958 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.942+0000 7fcb80a00640 1 --2- 172.21.15.72:0/3888991861 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcb7c166a20 0x7fcb7c0ce920 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fcb70033000 tx=0x7fcb70004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:35.958 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.942+0000 7fcb79600640 1 -- 172.21.15.72:0/3888991861 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb70048070 con 0x7fcb7c166a20 2024-04-04T06:56:35.958 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.942+0000 7fcb79600640 1 -- 172.21.15.72:0/3888991861 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb7002f5d0 con 0x7fcb7c166a20 2024-04-04T06:56:35.958 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.942+0000 7fcb79600640 1 -- 172.21.15.72:0/3888991861 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb70048070 con 0x7fcb7c166a20 2024-04-04T06:56:35.958 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.942+0000 7fcb83e00640 1 -- 172.21.15.72:0/3888991861 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb7c0cf020 con 0x7fcb7c166a20 2024-04-04T06:56:35.958 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.943+0000 7fcb83e00640 1 -- 172.21.15.72:0/3888991861 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb7c0b8630 con 0x7fcb7c166a20 2024-04-04T06:56:35.959 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.944+0000 7f824a000640 1 --2- 172.21.15.72:0/1212505255 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f822c06c940 0x7f822c06ee00 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f824c0ad950 tx=0x7f8238009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:35.959 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.944+0000 7fcb83e00640 1 -- 172.21.15.72:0/3888991861 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fcb7c0757a0 con 0x7fcb7c166a20 2024-04-04T06:56:35.959 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.944+0000 7fc108c00640 1 -- 172.21.15.72:0/55613287 <== osd.2 v2:172.21.15.72:6808/235374192 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fc10c15da50 con 0x7fc0ec074c40 2024-04-04T06:56:35.960 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.945+0000 7fc113400640 1 -- 172.21.15.72:0/55613287 >> [v2:172.21.15.72:6808/235374192,v1:172.21.15.72:6809/235374192] conn(0x7fc0ec074c40 msgr2=0x7fc0ec077060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:35.960 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.945+0000 7fc113400640 1 --2- 172.21.15.72:0/55613287 >> [v2:172.21.15.72:6808/235374192,v1:172.21.15.72:6809/235374192] conn(0x7fc0ec074c40 0x7fc0ec077060 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:35.960 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.945+0000 7fcb79600640 1 -- 172.21.15.72:0/3888991861 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fcb70037070 con 0x7fcb7c166a20 2024-04-04T06:56:35.960 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.946+0000 7ff280a00640 1 -- 172.21.15.72:0/2303447420 --> [v2:172.21.15.117:6808/2781186528,v1:172.21.15.117:6809/2781186528] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ff27c0757a0 con 0x7ff25c074c40 2024-04-04T06:56:35.961 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.947+0000 7ff272000640 1 -- 172.21.15.72:0/2303447420 <== osd.6 v2:172.21.15.117:6808/2781186528 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7ff27c0757a0 con 0x7ff25c074c40 2024-04-04T06:56:35.961 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.947+0000 7fcb79600640 1 --2- 172.21.15.72:0/3888991861 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fcb5c06caf0 0x7fcb5c06efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:35.961 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.947+0000 7ff280a00640 1 -- 172.21.15.72:0/2303447420 >> [v2:172.21.15.117:6808/2781186528,v1:172.21.15.117:6809/2781186528] conn(0x7ff25c074c40 msgr2=0x7ff25c077060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:35.961 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.947+0000 7ff280a00640 1 --2- 172.21.15.72:0/2303447420 >> [v2:172.21.15.117:6808/2781186528,v1:172.21.15.117:6809/2781186528] conn(0x7ff25c074c40 0x7ff25c077060 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:35.962 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.947+0000 7fcb81400640 1 --2- 172.21.15.72:0/3888991861 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fcb5c06caf0 0x7fcb5c06efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:35.962 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.947+0000 7ff280a00640 1 -- 172.21.15.72:0/2303447420 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7ff25c06c9c0 msgr2=0x7ff25c06ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:35.962 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.948+0000 7ff280a00640 1 --2- 172.21.15.72:0/2303447420 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7ff25c06c9c0 0x7ff25c06ee80 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff26c000f60 tx=0x7ff26c007f00 comp rx=0 tx=0).stop 2024-04-04T06:56:35.962 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.948+0000 7f824b400640 1 --2- 172.21.15.72:0/1212505255 >> [v2:172.21.15.72:6816/3889813953,v1:172.21.15.72:6818/3889813953] conn(0x7f822c074bc0 0x7f822c076fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:35.963 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.948+0000 7ff280a00640 1 -- 172.21.15.72:0/2303447420 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff27c0cea70 msgr2=0x7ff27c1f8350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:35.963 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.948+0000 7ff280a00640 1 --2- 172.21.15.72:0/2303447420 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff27c0cea70 0x7ff27c1f8350 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7ff268033000 tx=0x7ff2680046c0 comp rx=0 tx=0).stop 2024-04-04T06:56:35.963 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.948+0000 7fc113400640 1 -- 172.21.15.72:0/55613287 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fc0ec06c9c0 msgr2=0x7fc0ec06ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:35.963 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.948+0000 7fc113400640 1 --2- 172.21.15.72:0/55613287 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fc0ec06c9c0 0x7fc0ec06ee80 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc0f8036000 tx=0x7fc0f8008030 comp rx=0 tx=0).stop 2024-04-04T06:56:35.963 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.948+0000 7fc113400640 1 -- 172.21.15.72:0/55613287 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc10c0b2e80 msgr2=0x7fc10c08b7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:35.963 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.948+0000 7fc113400640 1 --2- 172.21.15.72:0/55613287 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc10c0b2e80 0x7fc10c08b7d0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fc10000c520 tx=0x7fc10000c9e0 comp rx=0 tx=0).stop 2024-04-04T06:56:35.963 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.948+0000 7fcb79600640 1 -- 172.21.15.72:0/3888991861 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fcb700796c0 con 0x7fcb7c166a20 2024-04-04T06:56:35.964 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.948+0000 7fc111400640 1 -- 172.21.15.72:0/55613287 reap_dead start 2024-04-04T06:56:35.964 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.948+0000 7ff27a800640 1 -- 172.21.15.72:0/2303447420 reap_dead start 2024-04-04T06:56:35.964 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.949+0000 7fcb81400640 1 --2- 172.21.15.72:0/3888991861 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fcb5c06caf0 0x7fcb5c06efb0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fcb68000f60 tx=0x7fcb68009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:35.965 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.949+0000 7ff280a00640 1 -- 172.21.15.72:0/2303447420 shutdown_connections 2024-04-04T06:56:35.965 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.949+0000 7ff280a00640 1 -- 172.21.15.72:0/2303447420 >> 172.21.15.72:0/2303447420 conn(0x7ff27c0744d0 msgr2=0x7ff27c0d0430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:56:35.965 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.949+0000 7fc113400640 1 -- 172.21.15.72:0/55613287 shutdown_connections 2024-04-04T06:56:35.965 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.949+0000 7fc113400640 1 -- 172.21.15.72:0/55613287 >> 172.21.15.72:0/55613287 conn(0x7fc10c06b470 msgr2=0x7fc10c155d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:56:35.965 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.949+0000 7fc113400640 1 -- 172.21.15.72:0/55613287 shutdown_connections 2024-04-04T06:56:35.965 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.949+0000 7fc113400640 1 -- 172.21.15.72:0/55613287 wait complete. 2024-04-04T06:56:35.966 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.949+0000 7f824b400640 1 --2- 172.21.15.72:0/1212505255 >> [v2:172.21.15.72:6816/3889813953,v1:172.21.15.72:6818/3889813953] conn(0x7f822c074bc0 0x7f822c076fe0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:35.966 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.950+0000 7f4db1e00640 1 -- 172.21.15.72:0/2806653234 --> [v2:172.21.15.117:6816/617469882,v1:172.21.15.117:6817/617469882] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f4d84002dd0 con 0x7f4d88074cc0 2024-04-04T06:56:35.966 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.950+0000 7ff280a00640 1 -- 172.21.15.72:0/2303447420 shutdown_connections 2024-04-04T06:56:35.966 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.951+0000 7f8242a00640 1 -- 172.21.15.72:0/1212505255 <== osd.0 v2:172.21.15.72:6816/3889813953 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f822c077690 con 0x7f822c074bc0 2024-04-04T06:56:35.967 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.951+0000 7ff280a00640 1 -- 172.21.15.72:0/2303447420 wait complete. 2024-04-04T06:56:35.967 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.951+0000 7fe2d7400640 1 -- 172.21.15.72:0/1957370615 --> [v2:172.21.15.117:6824/4293536423,v1:172.21.15.117:6825/4293536423] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fe2ac002dd0 con 0x7fe2b0074a90 2024-04-04T06:56:35.967 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.952+0000 7fe2ccc00640 1 -- 172.21.15.72:0/1957370615 <== osd.4 v2:172.21.15.117:6824/4293536423 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fe2ac002dd0 con 0x7fe2b0074a90 2024-04-04T06:56:35.968 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.952+0000 7fcb79600640 1 --2- 172.21.15.72:0/3888991861 >> [v2:172.21.15.117:6800/684971679,v1:172.21.15.117:6801/684971679] conn(0x7fcb5c075820 0x7fcb5c077cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:35.968 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.953+0000 7fcb79600640 1 -- 172.21.15.72:0/3888991861 --> [v2:172.21.15.117:6800/684971679,v1:172.21.15.117:6801/684971679] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fcb5c078390 con 0x7fcb5c075820 2024-04-04T06:56:35.968 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.953+0000 7fcb79600640 1 -- 172.21.15.72:0/3888991861 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fcb70078050 con 0x7fcb7c166a20 2024-04-04T06:56:35.968 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.953+0000 7fcb81e00640 1 --2- 172.21.15.72:0/3888991861 >> [v2:172.21.15.117:6800/684971679,v1:172.21.15.117:6801/684971679] conn(0x7fcb5c075820 0x7fcb5c077cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:35.968 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.953+0000 7fe1d3400640 1 -- 172.21.15.72:0/2972685797 --> [v2:172.21.15.72:6817/2806631742,v1:172.21.15.72:6819/2806631742] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fe1cc161250 con 0x7fe1ac074bc0 2024-04-04T06:56:35.968 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.954+0000 7fcb81e00640 1 --2- 172.21.15.72:0/3888991861 >> [v2:172.21.15.117:6800/684971679,v1:172.21.15.117:6801/684971679] conn(0x7fcb5c075820 0x7fcb5c077cc0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:35.969 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.954+0000 7fe1c8c00640 1 -- 172.21.15.72:0/2972685797 <== osd.3 v2:172.21.15.72:6817/2806631742 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fe1cc161250 con 0x7fe1ac074bc0 2024-04-04T06:56:35.969 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.952+0000 7f4da3e00640 1 -- 172.21.15.72:0/2806653234 <== osd.7 v2:172.21.15.117:6816/617469882 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f4d84002dd0 con 0x7f4d88074cc0 2024-04-04T06:56:35.970 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.955+0000 7fe1d3400640 1 -- 172.21.15.72:0/2972685797 >> [v2:172.21.15.72:6817/2806631742,v1:172.21.15.72:6819/2806631742] conn(0x7fe1ac074bc0 msgr2=0x7fe1ac076fe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:35.970 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.955+0000 7fe1d3400640 1 --2- 172.21.15.72:0/2972685797 >> [v2:172.21.15.72:6817/2806631742,v1:172.21.15.72:6819/2806631742] conn(0x7fe1ac074bc0 0x7fe1ac076fe0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:35.970 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.955+0000 7fe1d3400640 1 -- 172.21.15.72:0/2972685797 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fe1ac06c940 msgr2=0x7fe1ac06ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:35.970 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.955+0000 7fe1d3400640 1 --2- 172.21.15.72:0/2972685797 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fe1ac06c940 0x7fe1ac06ee00 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fe1cc0b9f20 tx=0x7fe1b8009190 comp rx=0 tx=0).stop 2024-04-04T06:56:35.970 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.955+0000 7fe1d3400640 1 -- 172.21.15.72:0/2972685797 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe1cc0cf2d0 msgr2=0x7fe1cc0b9270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:35.970 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.955+0000 7fe1d3400640 1 --2- 172.21.15.72:0/2972685797 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe1cc0cf2d0 0x7fe1cc0b9270 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fe1c000e870 tx=0x7fe1c000ed30 comp rx=0 tx=0).stop 2024-04-04T06:56:35.971 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.955+0000 7fe2d7400640 1 -- 172.21.15.72:0/1957370615 >> [v2:172.21.15.117:6824/4293536423,v1:172.21.15.117:6825/4293536423] conn(0x7fe2b0074a90 msgr2=0x7fe2b0076eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:35.971 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.955+0000 7fe2d7400640 1 --2- 172.21.15.72:0/1957370615 >> [v2:172.21.15.117:6824/4293536423,v1:172.21.15.117:6825/4293536423] conn(0x7fe2b0074a90 0x7fe2b0076eb0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:35.971 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.955+0000 7fe1d1400640 1 -- 172.21.15.72:0/2972685797 reap_dead start 2024-04-04T06:56:35.971 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.955+0000 7fe1d3400640 1 -- 172.21.15.72:0/2972685797 shutdown_connections 2024-04-04T06:56:35.971 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.955+0000 7fe1d3400640 1 -- 172.21.15.72:0/2972685797 >> 172.21.15.72:0/2972685797 conn(0x7fe1cc06b860 msgr2=0x7fe1cc161fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:56:35.971 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.955+0000 7f4db1e00640 1 -- 172.21.15.72:0/2806653234 >> [v2:172.21.15.117:6816/617469882,v1:172.21.15.117:6817/617469882] conn(0x7f4d88074cc0 msgr2=0x7f4d880770e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:35.972 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.955+0000 7fe2d7400640 1 -- 172.21.15.72:0/1957370615 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fe2b006c8f0 msgr2=0x7fe2b006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:35.972 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.955+0000 7fe2d7400640 1 --2- 172.21.15.72:0/1957370615 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fe2b006c8f0 0x7fe2b006edb0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe2c4006fd0 tx=0x7fe2c4008040 comp rx=0 tx=0).stop 2024-04-04T06:56:35.972 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.955+0000 7fe2d7400640 1 -- 172.21.15.72:0/1957370615 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe2d00b39e0 msgr2=0x7fe2d014bef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:35.972 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.955+0000 7fe2d7400640 1 --2- 172.21.15.72:0/1957370615 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe2d00b39e0 0x7fe2d014bef0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe2bc00c4a0 tx=0x7fe2bc00c960 comp rx=0 tx=0).stop 2024-04-04T06:56:35.972 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.955+0000 7fe2d5400640 1 -- 172.21.15.72:0/1957370615 reap_dead start 2024-04-04T06:56:35.972 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.955+0000 7f4db1e00640 1 --2- 172.21.15.72:0/2806653234 >> [v2:172.21.15.117:6816/617469882,v1:172.21.15.117:6817/617469882] conn(0x7f4d88074cc0 0x7f4d880770e0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:35.972 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.956+0000 7f4db1e00640 1 -- 172.21.15.72:0/2806653234 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f4d8806cb20 msgr2=0x7f4d8806efe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:35.972 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.956+0000 7f4db1e00640 1 --2- 172.21.15.72:0/2806653234 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f4d8806cb20 0x7f4d8806efe0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f4d9c001030 tx=0x7f4d9c0048a0 comp rx=0 tx=0).stop 2024-04-04T06:56:35.973 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.956+0000 7f4db1e00640 1 -- 172.21.15.72:0/2806653234 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4dac1f97b0 msgr2=0x7f4dac146f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:35.973 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.956+0000 7f4db1e00640 1 --2- 172.21.15.72:0/2806653234 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4dac1f97b0 0x7f4dac146f90 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f4d94032cd0 tx=0x7f4d94004730 comp rx=0 tx=0).stop 2024-04-04T06:56:35.973 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.956+0000 7f4dab400640 1 -- 172.21.15.72:0/2806653234 reap_dead start 2024-04-04T06:56:35.973 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.956+0000 7f4db1e00640 1 -- 172.21.15.72:0/2806653234 shutdown_connections 2024-04-04T06:56:35.973 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.956+0000 7fe2d7400640 1 -- 172.21.15.72:0/1957370615 shutdown_connections 2024-04-04T06:56:35.973 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.956+0000 7fe2d7400640 1 -- 172.21.15.72:0/1957370615 >> 172.21.15.72:0/1957370615 conn(0x7fe2d006d490 msgr2=0x7fe2d015e950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:56:35.973 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.956+0000 7f4db1e00640 1 -- 172.21.15.72:0/2806653234 >> 172.21.15.72:0/2806653234 conn(0x7f4dac06b470 msgr2=0x7f4dac0b1f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:56:35.974 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.956+0000 7fe2d7400640 1 -- 172.21.15.72:0/1957370615 shutdown_connections 2024-04-04T06:56:35.974 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.956+0000 7fe2d7400640 1 -- 172.21.15.72:0/1957370615 wait complete. 2024-04-04T06:56:35.974 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.956+0000 7f4db1e00640 1 -- 172.21.15.72:0/2806653234 shutdown_connections 2024-04-04T06:56:35.974 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.956+0000 7fe1d3400640 1 -- 172.21.15.72:0/2972685797 shutdown_connections 2024-04-04T06:56:35.975 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.957+0000 7fcb79600640 1 -- 172.21.15.72:0/3888991861 <== osd.5 v2:172.21.15.117:6800/684971679 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fcb5c078390 con 0x7fcb5c075820 2024-04-04T06:56:35.975 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.957+0000 7f4db1e00640 1 -- 172.21.15.72:0/2806653234 wait complete. 2024-04-04T06:56:35.975 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.957+0000 7fe1d3400640 1 -- 172.21.15.72:0/2972685797 wait complete. 2024-04-04T06:56:35.976 INFO:teuthology.orchestra.run.smithi072.stdout:55834574854 2024-04-04T06:56:35.976 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-04T06:56:35.977 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.976+0000 7f4d22000640 1 -- 172.21.15.72:0/420962209 --> [v2:172.21.15.72:6800/3101663154,v1:172.21.15.72:6801/3101663154] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f4d1c0d1fb0 con 0x7f4cfc074c10 2024-04-04T06:56:35.977 INFO:teuthology.orchestra.run.smithi072.stdout:55834574855 2024-04-04T06:56:35.978 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.977+0000 7f4d18c00640 1 -- 172.21.15.72:0/420962209 <== osd.1 v2:172.21.15.72:6800/3101663154 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f4d1c0d1fb0 con 0x7f4cfc074c10 2024-04-04T06:56:35.978 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-04T06:56:35.979 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.978+0000 7f4d22000640 1 -- 172.21.15.72:0/420962209 >> [v2:172.21.15.72:6800/3101663154,v1:172.21.15.72:6801/3101663154] conn(0x7f4cfc074c10 msgr2=0x7f4cfc077030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:35.980 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.978+0000 7f4d22000640 1 --2- 172.21.15.72:0/420962209 >> [v2:172.21.15.72:6800/3101663154,v1:172.21.15.72:6801/3101663154] conn(0x7f4cfc074c10 0x7f4cfc077030 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:35.980 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.978+0000 7f4d22000640 1 -- 172.21.15.72:0/420962209 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f4cfc06c9f0 msgr2=0x7f4cfc06eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:35.980 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.978+0000 7f4d22000640 1 --2- 172.21.15.72:0/420962209 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f4cfc06c9f0 0x7f4cfc06eeb0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f4d14034000 tx=0x7f4d14007000 comp rx=0 tx=0).stop 2024-04-04T06:56:35.980 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.978+0000 7f4d22000640 1 -- 172.21.15.72:0/420962209 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4d1c15a5f0 msgr2=0x7f4d1c15aa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:35.980 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.978+0000 7f4d22000640 1 --2- 172.21.15.72:0/420962209 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4d1c15a5f0 0x7f4d1c15aa80 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f4d1c0d50e0 tx=0x7f4d0c00dc00 comp rx=0 tx=0).stop 2024-04-04T06:56:35.980 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.978+0000 7f4d21600640 1 -- 172.21.15.72:0/420962209 reap_dead start 2024-04-04T06:56:35.980 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.978+0000 7f4d22000640 1 -- 172.21.15.72:0/420962209 shutdown_connections 2024-04-04T06:56:35.980 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.978+0000 7f4d22000640 1 -- 172.21.15.72:0/420962209 >> 172.21.15.72:0/420962209 conn(0x7f4d1c071a90 msgr2=0x7f4d1c15f8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:56:35.980 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.980+0000 7f4d22000640 1 -- 172.21.15.72:0/420962209 shutdown_connections 2024-04-04T06:56:35.980 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.980+0000 7f4d22000640 1 -- 172.21.15.72:0/420962209 wait complete. 2024-04-04T06:56:35.981 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.982+0000 7f8251a00640 1 -- 172.21.15.72:0/1212505255 --> [v2:172.21.15.72:6816/3889813953,v1:172.21.15.72:6818/3889813953] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f824c0b3560 con 0x7f822c074bc0 2024-04-04T06:56:35.987 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.984+0000 7f8242a00640 1 -- 172.21.15.72:0/1212505255 <== osd.0 v2:172.21.15.72:6816/3889813953 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f824c0b3560 con 0x7f822c074bc0 2024-04-04T06:56:35.987 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.984+0000 7f8251a00640 1 -- 172.21.15.72:0/1212505255 >> [v2:172.21.15.72:6816/3889813953,v1:172.21.15.72:6818/3889813953] conn(0x7f822c074bc0 msgr2=0x7f822c076fe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:35.987 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.984+0000 7f8251a00640 1 --2- 172.21.15.72:0/1212505255 >> [v2:172.21.15.72:6816/3889813953,v1:172.21.15.72:6818/3889813953] conn(0x7f822c074bc0 0x7f822c076fe0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:35.987 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.986+0000 7f8251a00640 1 -- 172.21.15.72:0/1212505255 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f822c06c940 msgr2=0x7f822c06ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:35.987 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.986+0000 7f8251a00640 1 --2- 172.21.15.72:0/1212505255 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f822c06c940 0x7f822c06ee00 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f824c0ad950 tx=0x7f8238009040 comp rx=0 tx=0).stop 2024-04-04T06:56:35.987 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.986+0000 7f8251a00640 1 -- 172.21.15.72:0/1212505255 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f824c06df80 msgr2=0x7f824c153440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:35.987 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.986+0000 7f8251a00640 1 --2- 172.21.15.72:0/1212505255 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f824c06df80 0x7f824c153440 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f823c00c720 tx=0x7f823c00cbe0 comp rx=0 tx=0).stop 2024-04-04T06:56:35.987 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.986+0000 7f824b400640 1 -- 172.21.15.72:0/1212505255 reap_dead start 2024-04-04T06:56:35.987 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.987+0000 7f8251a00640 1 -- 172.21.15.72:0/1212505255 shutdown_connections 2024-04-04T06:56:35.987 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.987+0000 7f8251a00640 1 -- 172.21.15.72:0/1212505255 >> 172.21.15.72:0/1212505255 conn(0x7f824c06d490 msgr2=0x7f824c0adb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:56:35.987 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.987+0000 7f8251a00640 1 -- 172.21.15.72:0/1212505255 shutdown_connections 2024-04-04T06:56:35.988 INFO:teuthology.orchestra.run.smithi072.stdout:55834574853 2024-04-04T06:56:35.988 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-04T06:56:35.988 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.987+0000 7f8251a00640 1 -- 172.21.15.72:0/1212505255 wait complete. 2024-04-04T06:56:35.991 INFO:teuthology.orchestra.run.smithi072.stdout:55834574855 2024-04-04T06:56:35.992 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.992+0000 7fcb83e00640 1 -- 172.21.15.72:0/3888991861 --> [v2:172.21.15.117:6800/684971679,v1:172.21.15.117:6801/684971679] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fcb7c0c7ac0 con 0x7fcb5c075820 2024-04-04T06:56:35.992 INFO:teuthology.orchestra.run.smithi072.stdout:55834574855 2024-04-04T06:56:35.992 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-04T06:56:35.993 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-04T06:56:35.994 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.993+0000 7fcb79600640 1 -- 172.21.15.72:0/3888991861 <== osd.5 v2:172.21.15.117:6800/684971679 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fcb7c0c7ac0 con 0x7fcb5c075820 2024-04-04T06:56:35.994 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.995+0000 7fcb83e00640 1 -- 172.21.15.72:0/3888991861 >> [v2:172.21.15.117:6800/684971679,v1:172.21.15.117:6801/684971679] conn(0x7fcb5c075820 msgr2=0x7fcb5c077cc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:35.995 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.995+0000 7fcb83e00640 1 --2- 172.21.15.72:0/3888991861 >> [v2:172.21.15.117:6800/684971679,v1:172.21.15.117:6801/684971679] conn(0x7fcb5c075820 0x7fcb5c077cc0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:35.995 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.996+0000 7fcb83e00640 1 -- 172.21.15.72:0/3888991861 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fcb5c06caf0 msgr2=0x7fcb5c06efb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:35.995 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.996+0000 7fcb83e00640 1 --2- 172.21.15.72:0/3888991861 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fcb5c06caf0 0x7fcb5c06efb0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fcb68000f60 tx=0x7fcb68009040 comp rx=0 tx=0).stop 2024-04-04T06:56:35.995 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.996+0000 7fcb83e00640 1 -- 172.21.15.72:0/3888991861 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcb7c166a20 msgr2=0x7fcb7c0ce920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:35.995 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.996+0000 7fcb83e00640 1 --2- 172.21.15.72:0/3888991861 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcb7c166a20 0x7fcb7c0ce920 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fcb70033000 tx=0x7fcb70004730 comp rx=0 tx=0).stop 2024-04-04T06:56:36.000 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.996+0000 7fcb81e00640 1 -- 172.21.15.72:0/3888991861 reap_dead start 2024-04-04T06:56:36.000 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.996+0000 7fcb83e00640 1 -- 172.21.15.72:0/3888991861 shutdown_connections 2024-04-04T06:56:36.000 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.996+0000 7fcb83e00640 1 -- 172.21.15.72:0/3888991861 >> 172.21.15.72:0/3888991861 conn(0x7fcb7c06b470 msgr2=0x7fcb7c15f660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:56:36.000 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.997+0000 7fcb83e00640 1 -- 172.21.15.72:0/3888991861 shutdown_connections 2024-04-04T06:56:36.000 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:35.998+0000 7fcb83e00640 1 -- 172.21.15.72:0/3888991861 wait complete. 2024-04-04T06:56:36.009 INFO:teuthology.orchestra.run.smithi072.stdout:55834574853 2024-04-04T06:56:36.009 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-04T06:56:36.015 INFO:teuthology.orchestra.run.smithi072.stdout:55834574854 2024-04-04T06:56:36.015 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-04T06:56:36.023 INFO:teuthology.orchestra.run.smithi072.stdout:55834574854 2024-04-04T06:56:36.023 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-04T06:56:36.282 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.281+0000 7f9be0c00640 1 Processor -- start 2024-04-04T06:56:36.282 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.282+0000 7f9be0c00640 1 -- start start 2024-04-04T06:56:36.283 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.283+0000 7f9be0c00640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f9bd40df420 0x7f9bd4053260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:36.283 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.284+0000 7f9bdb400640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f9bd404fa90 0x7f9bd404fe70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:52696/0 (socket says 172.21.15.72:52696) 2024-04-04T06:56:36.283 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.285+0000 7f9bdb400640 1 -- 172.21.15.72:0/3181042943 learned_addr learned my addr 172.21.15.72:0/3181042943 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-04-04T06:56:36.284 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.286+0000 7f9bdaa00640 1 --2- 172.21.15.72:0/3181042943 >> v2:172.21.15.72:3300/0 conn(0x7f9bd40df420 0x7f9bd4053260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:36.284 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.286+0000 7f9be0c00640 1 -- 172.21.15.72:0/3181042943 --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9bd4006af0 con 0x7f9bd404fa90 2024-04-04T06:56:36.285 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.287+0000 7f9be0c00640 1 -- 172.21.15.72:0/3181042943 --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9bd4006dd0 con 0x7f9bd40392d0 2024-04-04T06:56:36.285 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.287+0000 7f9be0c00640 1 -- 172.21.15.72:0/3181042943 --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f9bd40068a0 con 0x7f9bd40df420 2024-04-04T06:56:36.286 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.288+0000 7f9bdaa00640 1 -- 172.21.15.72:0/3181042943 >> v1:172.21.15.117:6789/0 conn(0x7f9bd40392d0 legacy=0x7f9bd40537a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:36.287 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.288+0000 7f9bdaa00640 1 -- 172.21.15.72:0/3181042943 >> v1:172.21.15.72:6789/0 conn(0x7f9bd404fa90 legacy=0x7f9bd404fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:36.287 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.288+0000 7f9bda000640 1 -- 172.21.15.72:0/3181042943 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3258932400 0 0) 0x7f9bd4006af0 con 0x7f9bd404fa90 2024-04-04T06:56:36.287 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.288+0000 7f9bdaa00640 1 -- 172.21.15.72:0/3181042943 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9bd40070b0 con 0x7f9bd40df420 2024-04-04T06:56:36.289 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.291+0000 7f9bdaa00640 1 --2- 172.21.15.72:0/3181042943 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9bd40df420 0x7f9bd4053260 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f9bd000b970 tx=0x7f9bd002c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa68bc95daca0159 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:36.290 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.292+0000 7f9bda000640 1 -- 172.21.15.72:0/3181042943 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bd0039070 con 0x7f9bd40df420 2024-04-04T06:56:36.290 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.292+0000 7f9bda000640 1 -- 172.21.15.72:0/3181042943 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9bd002cdf0 con 0x7f9bd40df420 2024-04-04T06:56:36.290 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.292+0000 7f9bda000640 1 -- 172.21.15.72:0/3181042943 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bd0034660 con 0x7f9bd40df420 2024-04-04T06:56:36.292 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.294+0000 7f9be0c00640 1 -- 172.21.15.72:0/3181042943 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9bd40df420 msgr2=0x7f9bd4053260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:36.292 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.294+0000 7f9be0c00640 1 --2- 172.21.15.72:0/3181042943 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9bd40df420 0x7f9bd4053260 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f9bd000b970 tx=0x7f9bd002c040 comp rx=0 tx=0).stop 2024-04-04T06:56:36.293 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.294+0000 7fe3b6c00640 1 Processor -- start 2024-04-04T06:56:36.293 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.295+0000 7f9be0c00640 1 -- 172.21.15.72:0/3181042943 shutdown_connections 2024-04-04T06:56:36.293 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.295+0000 7f9be0c00640 1 --2- 172.21.15.72:0/3181042943 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9bd40df420 0x7f9bd4053260 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:36.293 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.295+0000 7f9be0c00640 1 -- 172.21.15.72:0/3181042943 >> 172.21.15.72:0/3181042943 conn(0x7f9bd4009fb0 msgr2=0x7f9bd400a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:56:36.294 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.296+0000 7f9be0c00640 1 -- 172.21.15.72:0/3181042943 shutdown_connections 2024-04-04T06:56:36.294 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.296+0000 7f9be0c00640 1 -- 172.21.15.72:0/3181042943 wait complete. 2024-04-04T06:56:36.295 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.294+0000 7fe3b6c00640 1 -- start start 2024-04-04T06:56:36.295 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.296+0000 7fe3b6c00640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe3a80eb060 0x7fe3a8055300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:36.295 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.296+0000 7fe3b6c00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fe3a80061a0 0x7fe3a8006610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:36.295 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.296+0000 7fe3b6c00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3a80387e0 con 0x7fe3a80eb440 2024-04-04T06:56:36.295 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.296+0000 7fe3b6c00640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7fe3a8057e30 con 0x7fe3a80eb060 2024-04-04T06:56:36.295 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.296+0000 7fe3b6c00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fe3a80579a0 con 0x7fe3a80061a0 2024-04-04T06:56:36.296 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.297+0000 7fe3b6200640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fe3a80061a0 0x7fe3a8006610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:36.296 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.297+0000 7fe3b4e00640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7fe3a80eb440 0x7fe3a80eb8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.72:58792/0 (socket says 172.21.15.72:58792) 2024-04-04T06:56:36.296 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.298+0000 7fe3b4e00640 1 -- 172.21.15.72:0/3030274127 learned_addr learned my addr 172.21.15.72:0/3030274127 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-04-04T06:56:36.297 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.299+0000 7fe3afe00640 1 -- 172.21.15.72:0/3030274127 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3250441558 0 0) 0x7fe3a4001110 con 0x7fe3a80eb440 2024-04-04T06:56:36.297 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.299+0000 7fe3afe00640 1 -- 172.21.15.72:0/3030274127 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe398003520 con 0x7fe3a80eb440 2024-04-04T06:56:36.297 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.299+0000 7fe3b6200640 1 -- 172.21.15.72:0/3030274127 >> v2:172.21.15.72:3300/0 conn(0x7fe3a80eb060 msgr2=0x7fe3a8055300 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-04T06:56:36.298 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.299+0000 7fe3afe00640 1 -- 172.21.15.72:0/3030274127 <== mon.1 v1:172.21.15.117:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 288696350 0 0) 0x7fe398003520 con 0x7fe3a80eb440 2024-04-04T06:56:36.299 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.300+0000 7f9be0c00640 1 Processor -- start 2024-04-04T06:56:36.299 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.300+0000 7f9be0c00640 1 -- start start 2024-04-04T06:56:36.300 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.302+0000 7f9be0c00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9bd40392d0 0x7f9bd40e0110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:36.301 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.302+0000 7f9be0c00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9bd404fa90 0x7f9bd404c770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:36.301 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.303+0000 7fe3b5800640 1 --2- 172.21.15.72:0/3030274127 >> v2:172.21.15.72:3300/0 conn(0x7fe3a80eb060 0x7fe3a8055300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:36.302 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.303+0000 7f9be0c00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9bd40e0650 0x7f9bd404ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:36.302 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.303+0000 7f9bdb400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9bd40392d0 0x7f9bd40e0110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:36.302 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.303+0000 7f9bdb400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9bd40392d0 0x7f9bd40e0110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.72:40044/0 (socket says 172.21.15.72:40044) 2024-04-04T06:56:36.302 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.303+0000 7f9bdaa00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9bd404fa90 0x7f9bd404c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:36.303 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.304+0000 7f9bdaa00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9bd404fa90 0x7f9bd404c770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.72:40352/0 (socket says 172.21.15.72:40352) 2024-04-04T06:56:36.305 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.304+0000 7f9bdbe00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9bd40e0650 0x7f9bd404ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:36.305 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.304+0000 7f9bdb400640 1 -- 172.21.15.72:0/3328799743 learned_addr learned my addr 172.21.15.72:0/3328799743 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:56:36.305 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.306+0000 7f9be0c00640 1 -- 172.21.15.72:0/3328799743 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f9bd4052cc0 con 0x7f9bd40e0650 2024-04-04T06:56:36.305 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.306+0000 7f9be0c00640 1 -- 172.21.15.72:0/3328799743 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f9bd4052b40 con 0x7f9bd40392d0 2024-04-04T06:56:36.305 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.306+0000 7f9be0c00640 1 -- 172.21.15.72:0/3328799743 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f9bd400aaa0 con 0x7f9bd404fa90 2024-04-04T06:56:36.306 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.307+0000 7f9bdb400640 1 -- 172.21.15.72:0/3328799743 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9bd404fa90 msgr2=0x7f9bd404c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:36.306 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.303+0000 7fe3b6200640 1 --2- 172.21.15.72:0/3030274127 >> v2:172.21.15.72:3300/0 conn(0x7fe3a80eb060 0x7fe3a8055300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:36.306 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.303+0000 7fe3b6200640 1 -- 172.21.15.72:0/3030274127 >> v1:172.21.15.117:6789/0 conn(0x7fe3a80eb440 legacy=0x7fe3a80eb8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:36.307 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.308+0000 7f9bdb400640 1 --2- 172.21.15.72:0/3328799743 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9bd404fa90 0x7f9bd404c770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:36.307 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.308+0000 7f9bdb400640 1 -- 172.21.15.72:0/3328799743 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9bd40e0650 msgr2=0x7f9bd404ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:36.307 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.308+0000 7f9bdb400640 1 --2- 172.21.15.72:0/3328799743 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9bd40e0650 0x7f9bd404ccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:36.307 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.308+0000 7f9bdb400640 1 -- 172.21.15.72:0/3328799743 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9bd40e25b0 con 0x7f9bd40392d0 2024-04-04T06:56:36.307 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.303+0000 7fe3b6200640 1 -- 172.21.15.72:0/3030274127 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3a8056d90 con 0x7fe3a80061a0 2024-04-04T06:56:36.307 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.308+0000 7f9bdaa00640 1 --2- 172.21.15.72:0/3328799743 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9bd404fa90 0x7f9bd404c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-04T06:56:36.308 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.304+0000 7fe3b6200640 1 --2- 172.21.15.72:0/3030274127 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe3a80061a0 0x7fe3a8006610 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fe3b0065040 tx=0x7fe3b006ae30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=57d662af18797448 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:36.308 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.305+0000 7fe3afe00640 1 -- 172.21.15.72:0/3030274127 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3b00b4070 con 0x7fe3a80061a0 2024-04-04T06:56:36.308 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.305+0000 7fe3afe00640 1 -- 172.21.15.72:0/3030274127 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3b00a7910 con 0x7fe3a80061a0 2024-04-04T06:56:36.308 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.305+0000 7fe3afe00640 1 -- 172.21.15.72:0/3030274127 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3b00b4070 con 0x7fe3a80061a0 2024-04-04T06:56:36.308 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.306+0000 7fe3b6c00640 1 -- 172.21.15.72:0/3030274127 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe3a80061a0 msgr2=0x7fe3a8006610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:36.308 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.306+0000 7fe3b6c00640 1 --2- 172.21.15.72:0/3030274127 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe3a80061a0 0x7fe3a8006610 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fe3b0065040 tx=0x7fe3b006ae30 comp rx=0 tx=0).stop 2024-04-04T06:56:36.308 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.308+0000 7f9bdbe00640 1 --2- 172.21.15.72:0/3328799743 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9bd40e0650 0x7f9bd404ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-04T06:56:36.309 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.308+0000 7fe3b6c00640 1 -- 172.21.15.72:0/3030274127 shutdown_connections 2024-04-04T06:56:36.309 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.308+0000 7fe3b6c00640 1 --2- 172.21.15.72:0/3030274127 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe3a80061a0 0x7fe3a8006610 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:36.309 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.308+0000 7fe3b6c00640 1 --2- 172.21.15.72:0/3030274127 >> v2:172.21.15.72:3300/0 conn(0x7fe3a80eb060 0x7fe3a8055300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:36.309 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.308+0000 7fe3b6c00640 1 -- 172.21.15.72:0/3030274127 >> 172.21.15.72:0/3030274127 conn(0x7fe3a80559e0 msgr2=0x7fe3a8055df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:56:36.309 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.308+0000 7fe3b5800640 1 --2- 172.21.15.72:0/3030274127 >> v2:172.21.15.72:3300/0 conn(0x7fe3a80eb060 0x7fe3a8055300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-04T06:56:36.309 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.308+0000 7f9bdb400640 1 --2- 172.21.15.72:0/3328799743 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9bd40392d0 0x7f9bd40e0110 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f9bdc02d900 tx=0x7f9bdc069080 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:36.310 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.309+0000 7fe3b6c00640 1 -- 172.21.15.72:0/3030274127 shutdown_connections 2024-04-04T06:56:36.310 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.311+0000 7f9bcf400640 1 -- 172.21.15.72:0/3328799743 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bdc06cbe0 con 0x7f9bd40392d0 2024-04-04T06:56:36.310 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.310+0000 7fe3b6c00640 1 -- 172.21.15.72:0/3030274127 wait complete. 2024-04-04T06:56:36.311 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.312+0000 7f9bcf400640 1 -- 172.21.15.72:0/3328799743 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9bdc06cda0 con 0x7f9bd40392d0 2024-04-04T06:56:36.311 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.312+0000 7f9bcf400640 1 -- 172.21.15.72:0/3328799743 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bdc073400 con 0x7f9bd40392d0 2024-04-04T06:56:36.311 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.312+0000 7f9be0c00640 1 -- 172.21.15.72:0/3328799743 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9bd40e1d50 con 0x7f9bd40392d0 2024-04-04T06:56:36.311 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.312+0000 7fe3b6c00640 1 Processor -- start 2024-04-04T06:56:36.311 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.312+0000 7f9be0c00640 1 -- 172.21.15.72:0/3328799743 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9bd40d98d0 con 0x7f9bd40392d0 2024-04-04T06:56:36.312 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.313+0000 7fe3b6c00640 1 -- start start 2024-04-04T06:56:36.313 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.314+0000 7fe3b6c00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe3a80061a0 0x7fe3a803fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:36.313 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.315+0000 7fe3b6c00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe3a80eb440 0x7fe3a80d41a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:36.314 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.315+0000 7fe3b6c00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe3a80d46e0 0x7fe3a80d1aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:36.314 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.315+0000 7fe3b6c00640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fe3a8057630 con 0x7fe3a80eb440 2024-04-04T06:56:36.314 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.315+0000 7fe3b5800640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe3a80061a0 0x7fe3a803fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:36.314 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.315+0000 7fe3b6c00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fe3a8057350 con 0x7fe3a80d46e0 2024-04-04T06:56:36.314 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.315+0000 7fe3b6c00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fe3a80e1e10 con 0x7fe3a80061a0 2024-04-04T06:56:36.314 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.315+0000 7fe3b5800640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe3a80061a0 0x7fe3a803fdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.72:40358/0 (socket says 172.21.15.72:40358) 2024-04-04T06:56:36.314 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.315+0000 7fe3b5800640 1 -- 172.21.15.72:0/3253555450 learned_addr learned my addr 172.21.15.72:0/3253555450 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:56:36.314 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.316+0000 7fe3b6200640 1 --2- 172.21.15.72:0/3253555450 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe3a80d46e0 0x7fe3a80d1aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:36.315 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.316+0000 7fe3b4e00640 1 --2- 172.21.15.72:0/3253555450 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe3a80eb440 0x7fe3a80d41a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:36.316 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.318+0000 7f9348a00640 1 Processor -- start 2024-04-04T06:56:36.316 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.317+0000 7fe3b4e00640 1 -- 172.21.15.72:0/3253555450 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe3a80061a0 msgr2=0x7fe3a803fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:36.316 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.317+0000 7fe3b4e00640 1 --2- 172.21.15.72:0/3253555450 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe3a80061a0 0x7fe3a803fdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:36.317 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.317+0000 7fe3b4e00640 1 -- 172.21.15.72:0/3253555450 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe3a80d46e0 msgr2=0x7fe3a80d1aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:36.317 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.318+0000 7fe3b4e00640 1 --2- 172.21.15.72:0/3253555450 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe3a80d46e0 0x7fe3a80d1aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:36.317 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.318+0000 7fe3b4e00640 1 -- 172.21.15.72:0/3253555450 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3a8051170 con 0x7fe3a80eb440 2024-04-04T06:56:36.317 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.318+0000 7fe3b6200640 1 --2- 172.21.15.72:0/3253555450 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe3a80d46e0 0x7fe3a80d1aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-04T06:56:36.317 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.316+0000 7f9be0c00640 1 -- 172.21.15.72:0/3328799743 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9bb8005290 con 0x7f9bd40392d0 2024-04-04T06:56:36.317 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.318+0000 7f9348a00640 1 -- start start 2024-04-04T06:56:36.318 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.320+0000 7f9348a00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f934415e720 0x7f93440d1300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:36.318 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.320+0000 7f9348a00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f93440d3660 0x7f93440d3a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:36.318 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.320+0000 7f9348a00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f93440d51a0 con 0x7f93440d1840 2024-04-04T06:56:36.318 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.320+0000 7f9348a00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f93440d1cd0 con 0x7f934415e720 2024-04-04T06:56:36.318 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.320+0000 7f9348a00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f93440d4100 con 0x7f93440d3660 2024-04-04T06:56:36.319 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.318+0000 7f9bcf400640 1 -- 172.21.15.72:0/3328799743 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9bdc073660 con 0x7f9bd40392d0 2024-04-04T06:56:36.319 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.319+0000 7fe3b4e00640 1 --2- 172.21.15.72:0/3253555450 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe3a80eb440 0x7fe3a80d41a0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fe3a400cac0 tx=0x7fe3a400cf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:36.319 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.319+0000 7fe3ad600640 1 -- 172.21.15.72:0/3253555450 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3a4018070 con 0x7fe3a80eb440 2024-04-04T06:56:36.319 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.319+0000 7fe3ad600640 1 -- 172.21.15.72:0/3253555450 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3a40075a0 con 0x7fe3a80eb440 2024-04-04T06:56:36.319 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.319+0000 7fe3ad600640 1 -- 172.21.15.72:0/3253555450 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3a4004a20 con 0x7fe3a80eb440 2024-04-04T06:56:36.319 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.319+0000 7fe3b6c00640 1 -- 172.21.15.72:0/3253555450 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3a80d3c10 con 0x7fe3a80eb440 2024-04-04T06:56:36.319 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.319+0000 7fe3b6c00640 1 -- 172.21.15.72:0/3253555450 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3a8051710 con 0x7fe3a80eb440 2024-04-04T06:56:36.320 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.320+0000 7f9341400640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f93440d1840 0x7f93440b7460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.72:58794/0 (socket says 172.21.15.72:58794) 2024-04-04T06:56:36.320 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.320+0000 7f9341400640 1 -- 172.21.15.72:0/3747957362 learned_addr learned my addr 172.21.15.72:0/3747957362 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-04-04T06:56:36.320 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.320+0000 7f9bcf400640 1 --2- 172.21.15.72:0/3328799743 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f9bbc06c9c0 0x7f9bbc06ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:36.320 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.321+0000 7f9bdaa00640 1 --2- 172.21.15.72:0/3328799743 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f9bbc06c9c0 0x7f9bbc06ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:36.320 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.321+0000 7f9341e00640 1 --2- 172.21.15.72:0/3747957362 >> v2:172.21.15.117:3300/0 conn(0x7f934415e720 0x7f93440d1300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:36.321 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.321+0000 7fe3b6c00640 1 -- 172.21.15.72:0/3253555450 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe38c005290 con 0x7fe3a80eb440 2024-04-04T06:56:36.321 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.321+0000 7f9342800640 1 --2- 172.21.15.72:0/3747957362 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f93440d3660 0x7f93440d3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:36.321 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.322+0000 7f8342c00640 1 Processor -- start 2024-04-04T06:56:36.321 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.322+0000 7f9341e00640 1 -- 172.21.15.72:0/3747957362 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f93440d3660 msgr2=0x7f93440d3a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:56:36.322 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.322+0000 7f9bcf400640 1 -- 172.21.15.72:0/3328799743 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f9bdc106770 con 0x7f9bd40392d0 2024-04-04T06:56:36.322 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.322+0000 7f9bdaa00640 1 --2- 172.21.15.72:0/3328799743 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f9bbc06c9c0 0x7f9bbc06ee80 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f9bd0036000 tx=0x7f9bd0030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:36.322 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.322+0000 7f9341e00640 1 --2- 172.21.15.72:0/3747957362 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f93440d3660 0x7f93440d3a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:36.322 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.322+0000 7f9341e00640 1 -- 172.21.15.72:0/3747957362 >> v1:172.21.15.117:6789/0 conn(0x7f93440d1840 legacy=0x7f93440b7460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:36.323 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.322+0000 7f9341e00640 1 -- 172.21.15.72:0/3747957362 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93440d43e0 con 0x7f934415e720 2024-04-04T06:56:36.323 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.323+0000 7f9342800640 1 --2- 172.21.15.72:0/3747957362 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f93440d3660 0x7f93440d3a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-04T06:56:36.323 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.323+0000 7f8342c00640 1 -- start start 2024-04-04T06:56:36.324 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.324+0000 7f8342c00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f833c0d0810 0x7f833c15a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:36.324 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.324+0000 7f8342c00640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f833c0718d0 0x7f833c164df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:36.324 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.324+0000 7f8342c00640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f833c0b41c0 con 0x7f833c0b3d60 2024-04-04T06:56:36.324 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.324+0000 7f8342c00640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f833c06d170 con 0x7f833c0718d0 2024-04-04T06:56:36.324 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.324+0000 7f8342c00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f833c0734f0 con 0x7f833c0d0810 2024-04-04T06:56:36.324 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.324+0000 7fe3ad600640 1 -- 172.21.15.72:0/3253555450 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe3a401b070 con 0x7fe3a80eb440 2024-04-04T06:56:36.325 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.324+0000 7f8341800640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f833c0d0810 0x7f833c15a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:36.325 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.325+0000 7f8341800640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f833c0d0810 0x7f833c15a7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.72:40070/0 (socket says 172.21.15.72:40070) 2024-04-04T06:56:36.325 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.325+0000 7f8341800640 1 -- 172.21.15.72:0/1660821058 learned_addr learned my addr 172.21.15.72:0/1660821058 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:56:36.325 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.325+0000 7f8341800640 1 -- 172.21.15.72:0/1660821058 >> v2:172.21.15.72:3300/0 conn(0x7f833c0718d0 msgr2=0x7f833c164df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:56:36.325 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.325+0000 7f8341800640 1 --2- 172.21.15.72:0/1660821058 >> v2:172.21.15.72:3300/0 conn(0x7f833c0718d0 0x7f833c164df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:36.325 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.325+0000 7f8341800640 1 -- 172.21.15.72:0/1660821058 >> v1:172.21.15.72:6789/0 conn(0x7f833c0b3d60 legacy=0x7f833c0711c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:56:36.325 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.325+0000 7f9341e00640 1 --2- 172.21.15.72:0/3747957362 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f934415e720 0x7f93440d1300 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f933c009d90 tx=0x7f933c02bd80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f3722bbbcb65a432 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:36.326 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.326+0000 7fe3ad600640 1 --2- 172.21.15.72:0/3253555450 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fe39006c9c0 0x7fe39006ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:36.326 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.326+0000 7fe3ad600640 1 -- 172.21.15.72:0/3253555450 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fe3a408b350 con 0x7fe3a80eb440 2024-04-04T06:56:36.326 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.326+0000 7fe3b5800640 1 --2- 172.21.15.72:0/3253555450 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fe39006c9c0 0x7fe39006ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:36.326 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.327+0000 7fe3b5800640 1 --2- 172.21.15.72:0/3253555450 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fe39006c9c0 0x7fe39006ee80 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fe3a80ea700 tx=0x7fe39c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:36.326 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.327+0000 7f8341800640 1 -- 172.21.15.72:0/1660821058 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f833c0b4490 con 0x7f833c0d0810 2024-04-04T06:56:36.327 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.329+0000 7f8341800640 1 --2- 172.21.15.72:0/1660821058 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f833c0d0810 0x7f833c15a7c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f833c0632b0 tx=0x7f833002b910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4822eafcb8587314 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:36.329 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.331+0000 7f145ae00640 1 Processor -- start 2024-04-04T06:56:36.330 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.331+0000 7fa6e0400640 1 Processor -- start 2024-04-04T06:56:36.330 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.331+0000 7f145ae00640 1 -- start start 2024-04-04T06:56:36.331 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.331+0000 7fa6e0400640 1 -- start start 2024-04-04T06:56:36.331 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.333+0000 7f6f36000640 1 Processor -- start 2024-04-04T06:56:36.331 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.333+0000 7fe3ad600640 1 -- 172.21.15.72:0/3253555450 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fe3a80387e0 con 0x7fe3a80eb440 2024-04-04T06:56:36.332 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.333+0000 7f145ae00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f145415e520 0x7f1454161ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:36.332 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.333+0000 7fa6e0400640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fa6d815ce10 0x7fa6d80b7e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:36.332 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.333+0000 7fa6e0400640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa6d80b8940 con 0x7fa6d80b63a0 2024-04-04T06:56:36.332 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.333+0000 7fa6e0400640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa6d80b8c20 con 0x7fa6d80b9f20 2024-04-04T06:56:36.332 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.333+0000 7fa6e0400640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fa6d80ce990 con 0x7fa6d815ce10 2024-04-04T06:56:36.333 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.333+0000 7f145ae00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f14540b9ba0 0x7f14540ceee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:36.333 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.333+0000 7f145ae00640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f14540b73b0 con 0x7f14540cf420 2024-04-04T06:56:36.333 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.333+0000 7f145ae00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f14540cf890 con 0x7f145415e520 2024-04-04T06:56:36.333 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.333+0000 7f145ae00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f1454162530 con 0x7f14540b9ba0 2024-04-04T06:56:36.333 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.334+0000 7fa6de400640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fa6d80b63a0 0x7fa6d80cee20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:52736/0 (socket says 172.21.15.72:52736) 2024-04-04T06:56:36.333 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.333+0000 7f6f36000640 1 -- start start 2024-04-04T06:56:36.334 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.334+0000 7f6f36000640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f6f300d19e0 0x7f6f30169080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:36.334 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.334+0000 7f6f36000640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f3015e940 con 0x7f6f300b9e00 2024-04-04T06:56:36.334 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.334+0000 7f6f36000640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f300d2b30 con 0x7f6f3015e560 2024-04-04T06:56:36.334 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.334+0000 7f6f36000640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f6f300b8520 con 0x7f6f300d19e0 2024-04-04T06:56:36.334 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.334+0000 7fa6de400640 1 -- 172.21.15.72:0/1805824238 learned_addr learned my addr 172.21.15.72:0/1805824238 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-04-04T06:56:36.334 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.334+0000 7f1458e00640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f14540cf420 0x7f1454071a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:52722/0 (socket says 172.21.15.72:52722) 2024-04-04T06:56:36.334 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.334+0000 7f1458e00640 1 -- 172.21.15.72:0/4105403277 learned_addr learned my addr 172.21.15.72:0/4105403277 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-04-04T06:56:36.335 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.334+0000 7f1453e00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f145415e520 0x7f1454161ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:36.335 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.334+0000 7f6f2ea00640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f6f300b9e00 0x7f6f300d12d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:52752/0 (socket says 172.21.15.72:52752) 2024-04-04T06:56:36.335 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.334+0000 7f6f2ea00640 1 -- 172.21.15.72:0/4173687499 learned_addr learned my addr 172.21.15.72:0/4173687499 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-04-04T06:56:36.335 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.334+0000 7f1453400640 1 --2- 172.21.15.72:0/4105403277 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f14540b9ba0 0x7f14540ceee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:36.335 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.334+0000 7fa6dda00640 1 --2- 172.21.15.72:0/1805824238 >> v2:172.21.15.117:3300/0 conn(0x7fa6d815ce10 0x7fa6d80b7e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:36.336 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.335+0000 7f6f2e000640 1 -- 172.21.15.72:0/4173687499 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 392804971 0 0) 0x7f6f3015e940 con 0x7f6f300b9e00 2024-04-04T06:56:36.336 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.335+0000 7fa6d7e00640 1 -- 172.21.15.72:0/1805824238 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2549066936 0 0) 0x7fa6d80b8940 con 0x7fa6d80b63a0 2024-04-04T06:56:36.336 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.335+0000 7f6f2fe00640 1 --2- 172.21.15.72:0/4173687499 >> v2:172.21.15.117:3300/0 conn(0x7f6f300d19e0 0x7f6f30169080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:36.336 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.335+0000 7fa6d7e00640 1 -- 172.21.15.72:0/1805824238 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa6c0003520 con 0x7fa6d80b63a0 2024-04-04T06:56:36.337 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.335+0000 7f6f2e000640 1 -- 172.21.15.72:0/4173687499 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6f14003520 con 0x7f6f300b9e00 2024-04-04T06:56:36.337 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.335+0000 7f1452a00640 1 -- 172.21.15.72:0/4105403277 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3141880502 0 0) 0x7f144c001490 con 0x7f14540cf420 2024-04-04T06:56:36.337 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.335+0000 7f1452a00640 1 -- 172.21.15.72:0/4105403277 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1438003520 con 0x7f14540cf420 2024-04-04T06:56:36.337 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.335+0000 7f1453400640 1 -- 172.21.15.72:0/4105403277 >> v2:172.21.15.117:3300/0 conn(0x7f145415e520 msgr2=0x7f1454161ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:56:36.337 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.335+0000 7f1453400640 1 --2- 172.21.15.72:0/4105403277 >> v2:172.21.15.117:3300/0 conn(0x7f145415e520 0x7f1454161ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:36.337 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.335+0000 7f1453400640 1 -- 172.21.15.72:0/4105403277 >> v1:172.21.15.72:6789/0 conn(0x7f14540cf420 legacy=0x7f1454071a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:36.338 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.336+0000 7f1453400640 1 -- 172.21.15.72:0/4105403277 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f145415e900 con 0x7f14540b9ba0 2024-04-04T06:56:36.338 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.336+0000 7fa6dda00640 1 -- 172.21.15.72:0/1805824238 >> v1:172.21.15.117:6789/0 conn(0x7fa6d80b9f20 legacy=0x7fa6d80b5c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:36.338 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.336+0000 7fa6dda00640 1 -- 172.21.15.72:0/1805824238 >> v1:172.21.15.72:6789/0 conn(0x7fa6d80b63a0 legacy=0x7fa6d80cee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:36.338 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.336+0000 7fa6dda00640 1 -- 172.21.15.72:0/1805824238 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6d80b8f00 con 0x7fa6d815ce10 2024-04-04T06:56:36.339 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.336+0000 7f6f2e000640 1 -- 172.21.15.72:0/4173687499 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2751791367 0 0) 0x7f6f14003520 con 0x7f6f300b9e00 2024-04-04T06:56:36.339 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.336+0000 7f6f2e000640 1 -- 172.21.15.72:0/4173687499 >> v2:172.21.15.117:3300/0 conn(0x7f6f300d19e0 msgr2=0x7f6f30169080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:56:36.339 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.336+0000 7f6f2e000640 1 --2- 172.21.15.72:0/4173687499 >> v2:172.21.15.117:3300/0 conn(0x7f6f300d19e0 0x7f6f30169080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:36.339 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.336+0000 7f6f2e000640 1 -- 172.21.15.72:0/4173687499 >> v1:172.21.15.117:6789/0 conn(0x7f6f3015e560 legacy=0x7f6f300d2420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:36.339 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.336+0000 7f6f2e000640 1 -- 172.21.15.72:0/4173687499 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f300d2e00 con 0x7f6f300b9e00 2024-04-04T06:56:36.339 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.336+0000 7f6f2e000640 1 -- 172.21.15.72:0/4173687499 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2465650867 0 0) 0x7f6f1c001690 con 0x7f6f300b9e00 2024-04-04T06:56:36.339 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.336+0000 7f6f2e000640 1 -- 172.21.15.72:0/4173687499 >> v1:172.21.15.72:6789/0 conn(0x7f6f300b9e00 legacy=0x7f6f300d12d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:36.339 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.336+0000 7f6f2e000640 1 --2- 172.21.15.72:0/4173687499 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6f14003a00 0x7f6f14003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:36.339 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.336+0000 7f6f2e000640 1 --2- 172.21.15.72:0/4173687499 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6f14004800 0x7f6f14004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:36.339 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.336+0000 7f6f2e000640 1 --2- 172.21.15.72:0/4173687499 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6f14005210 0x7f6f140141d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:36.339 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.336+0000 7f6f2e000640 1 -- 172.21.15.72:0/4173687499 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f6f300b8520 con 0x7f6f14003a00 2024-04-04T06:56:36.339 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.336+0000 7f6f2e000640 1 -- 172.21.15.72:0/4173687499 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f6f14014970 con 0x7f6f14004800 2024-04-04T06:56:36.339 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.336+0000 7f6f2e000640 1 -- 172.21.15.72:0/4173687499 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f6f14014b70 con 0x7f6f14005210 2024-04-04T06:56:36.340 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.337+0000 7f1453e00640 1 --2- 172.21.15.72:0/4105403277 >> v2:172.21.15.117:3300/0 conn(0x7f145415e520 0x7f1454161ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-04T06:56:36.340 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.337+0000 7f6f2f400640 1 --2- 172.21.15.72:0/4173687499 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6f14003a00 0x7f6f14003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:36.340 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.337+0000 7f6f2ea00640 1 --2- 172.21.15.72:0/4173687499 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6f14004800 0x7f6f14004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:36.340 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.337+0000 7f833be00640 1 -- 172.21.15.72:0/1660821058 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8330035020 con 0x7f833c0d0810 2024-04-04T06:56:36.341 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.337+0000 7f6f2f400640 1 -- 172.21.15.72:0/4173687499 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6f14005210 msgr2=0x7f6f140141d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:56:36.341 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.337+0000 7f6f2f400640 1 --2- 172.21.15.72:0/4173687499 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6f14005210 0x7f6f140141d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:36.341 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.337+0000 7f6f2f400640 1 -- 172.21.15.72:0/4173687499 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6f14004800 msgr2=0x7f6f14004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:56:36.341 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.337+0000 7f6f2f400640 1 --2- 172.21.15.72:0/4173687499 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6f14004800 0x7f6f14004c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:36.341 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.337+0000 7f6f2f400640 1 -- 172.21.15.72:0/4173687499 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f14003520 con 0x7f6f14003a00 2024-04-04T06:56:36.341 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.337+0000 7f6f2fe00640 1 -- 172.21.15.72:0/4173687499 reap_dead start 2024-04-04T06:56:36.341 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.337+0000 7f9340a00640 1 -- 172.21.15.72:0/3747957362 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f933c039070 con 0x7f934415e720 2024-04-04T06:56:36.341 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.338+0000 7f9340a00640 1 -- 172.21.15.72:0/3747957362 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f933c02cb30 con 0x7f934415e720 2024-04-04T06:56:36.342 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.338+0000 7f9340a00640 1 -- 172.21.15.72:0/3747957362 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f933c034440 con 0x7f934415e720 2024-04-04T06:56:36.342 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.338+0000 7fa6dda00640 1 --2- 172.21.15.72:0/1805824238 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa6d815ce10 0x7fa6d80b7e80 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fa6d80ceb10 tx=0x7fa6cc02b820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4d5c5b3e9f64b184 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:36.342 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.338+0000 7f9bcf400640 1 -- 172.21.15.72:0/3328799743 <== mon.1 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f9bdc08f030 con 0x7f9bd40392d0 2024-04-04T06:56:36.343 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.337+0000 7f833be00640 1 -- 172.21.15.72:0/1660821058 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8330031870 con 0x7f833c0d0810 2024-04-04T06:56:36.343 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.338+0000 7f833be00640 1 -- 172.21.15.72:0/1660821058 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8330031c40 con 0x7f833c0d0810 2024-04-04T06:56:36.343 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.338+0000 7f1453400640 1 --2- 172.21.15.72:0/4105403277 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f14540b9ba0 0x7f14540ceee0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f14440097a0 tx=0x7f144402b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=272185fe7742a281 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:36.343 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.338+0000 7f1452a00640 1 -- 172.21.15.72:0/4105403277 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1444035020 con 0x7f14540b9ba0 2024-04-04T06:56:36.343 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.338+0000 7f1452a00640 1 -- 172.21.15.72:0/4105403277 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1444031830 con 0x7f14540b9ba0 2024-04-04T06:56:36.343 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.338+0000 7f1452a00640 1 -- 172.21.15.72:0/4105403277 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1444031c40 con 0x7f14540b9ba0 2024-04-04T06:56:36.343 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.339+0000 7f8342c00640 1 -- 172.21.15.72:0/1660821058 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f833c0d0810 msgr2=0x7f833c15a7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:36.344 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.339+0000 7f8342c00640 1 --2- 172.21.15.72:0/1660821058 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f833c0d0810 0x7f833c15a7c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f833c0632b0 tx=0x7f833002b910 comp rx=0 tx=0).stop 2024-04-04T06:56:36.344 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.339+0000 7f9348a00640 1 -- 172.21.15.72:0/3747957362 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f934415e720 msgr2=0x7f93440d1300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:36.344 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.339+0000 7f9348a00640 1 --2- 172.21.15.72:0/3747957362 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f934415e720 0x7f93440d1300 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f933c009d90 tx=0x7f933c02bd80 comp rx=0 tx=0).stop 2024-04-04T06:56:36.344 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.339+0000 7fa6d7e00640 1 -- 172.21.15.72:0/1805824238 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6cc038070 con 0x7fa6d815ce10 2024-04-04T06:56:36.345 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.339+0000 7fa6d7e00640 1 -- 172.21.15.72:0/1805824238 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6cc031700 con 0x7fa6d815ce10 2024-04-04T06:56:36.345 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.339+0000 7fa6d7e00640 1 -- 172.21.15.72:0/1805824238 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6cc038070 con 0x7fa6d815ce10 2024-04-04T06:56:36.345 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.339+0000 7f6f2f400640 1 --2- 172.21.15.72:0/4173687499 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6f14003a00 0x7f6f14003e20 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f6f20001730 tx=0x7f6f14005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8885e8fafcf02123 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:36.345 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.339+0000 7f9348a00640 1 -- 172.21.15.72:0/3747957362 shutdown_connections 2024-04-04T06:56:36.345 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.339+0000 7f9348a00640 1 --2- 172.21.15.72:0/3747957362 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f93440d3660 0x7f93440d3a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:36.345 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.339+0000 7f9348a00640 1 --2- 172.21.15.72:0/3747957362 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f934415e720 0x7f93440d1300 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:36.345 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.339+0000 7f9348a00640 1 -- 172.21.15.72:0/3747957362 >> 172.21.15.72:0/3747957362 conn(0x7f9344071eb0 msgr2=0x7f93440722c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:56:36.346 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.339+0000 7f8342c00640 1 -- 172.21.15.72:0/1660821058 shutdown_connections 2024-04-04T06:56:36.346 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.339+0000 7f8342c00640 1 --2- 172.21.15.72:0/1660821058 >> v2:172.21.15.72:3300/0 conn(0x7f833c0718d0 0x7f833c164df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:36.346 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.339+0000 7f8342c00640 1 --2- 172.21.15.72:0/1660821058 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f833c0d0810 0x7f833c15a7c0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:36.346 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.339+0000 7f8342c00640 1 -- 172.21.15.72:0/1660821058 >> 172.21.15.72:0/1660821058 conn(0x7f833c0cfd20 msgr2=0x7f833c0d0100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:56:36.346 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.339+0000 7f145ae00640 1 -- 172.21.15.72:0/4105403277 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f14540b9ba0 msgr2=0x7f14540ceee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:36.346 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.339+0000 7f145ae00640 1 --2- 172.21.15.72:0/4105403277 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f14540b9ba0 0x7f14540ceee0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f14440097a0 tx=0x7f144402b8f0 comp rx=0 tx=0).stop 2024-04-04T06:56:36.347 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.340+0000 7f6f2e000640 1 -- 172.21.15.72:0/4173687499 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f20001350 con 0x7f6f14003a00 2024-04-04T06:56:36.347 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.340+0000 7f6f2e000640 1 -- 172.21.15.72:0/4173687499 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f200052f0 con 0x7f6f14003a00 2024-04-04T06:56:36.347 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.340+0000 7fa6e0400640 1 -- 172.21.15.72:0/1805824238 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa6d815ce10 msgr2=0x7fa6d80b7e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:36.347 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.340+0000 7fa6e0400640 1 --2- 172.21.15.72:0/1805824238 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa6d815ce10 0x7fa6d80b7e80 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fa6d80ceb10 tx=0x7fa6cc02b820 comp rx=0 tx=0).stop 2024-04-04T06:56:36.347 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.340+0000 7fa6e0400640 1 -- 172.21.15.72:0/1805824238 shutdown_connections 2024-04-04T06:56:36.347 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.340+0000 7fa6e0400640 1 --2- 172.21.15.72:0/1805824238 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa6d815ce10 0x7fa6d80b7e80 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:36.348 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.340+0000 7f6f2e000640 1 -- 172.21.15.72:0/4173687499 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f20003830 con 0x7f6f14003a00 2024-04-04T06:56:36.348 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.340+0000 7f9348a00640 1 -- 172.21.15.72:0/3747957362 shutdown_connections 2024-04-04T06:56:36.348 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.340+0000 7fa6e0400640 1 -- 172.21.15.72:0/1805824238 >> 172.21.15.72:0/1805824238 conn(0x7fa6d80d0c90 msgr2=0x7fa6d80d1070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:56:36.349 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.340+0000 7fa6e0400640 1 -- 172.21.15.72:0/1805824238 shutdown_connections 2024-04-04T06:56:36.349 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.340+0000 7fa6e0400640 1 -- 172.21.15.72:0/1805824238 wait complete. 2024-04-04T06:56:36.349 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.341+0000 7f6f36000640 1 -- 172.21.15.72:0/4173687499 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6f14003a00 msgr2=0x7f6f14003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:36.349 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.341+0000 7f6f36000640 1 --2- 172.21.15.72:0/4173687499 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6f14003a00 0x7f6f14003e20 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f6f20001730 tx=0x7f6f14005830 comp rx=0 tx=0).stop 2024-04-04T06:56:36.349 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.340+0000 7f9348a00640 1 -- 172.21.15.72:0/3747957362 wait complete. 2024-04-04T06:56:36.350 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.342+0000 7f6f36000640 1 -- 172.21.15.72:0/4173687499 shutdown_connections 2024-04-04T06:56:36.350 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.342+0000 7f6f36000640 1 --2- 172.21.15.72:0/4173687499 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6f14003a00 0x7f6f14003e20 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:36.350 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.342+0000 7f6f36000640 1 -- 172.21.15.72:0/4173687499 >> 172.21.15.72:0/4173687499 conn(0x7f6f30071e80 msgr2=0x7f6f30072290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:56:36.350 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.342+0000 7f6f36000640 1 -- 172.21.15.72:0/4173687499 shutdown_connections 2024-04-04T06:56:36.350 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.342+0000 7f6f36000640 1 -- 172.21.15.72:0/4173687499 wait complete. 2024-04-04T06:56:36.351 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.342+0000 7fa6e0400640 1 Processor -- start 2024-04-04T06:56:36.351 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.343+0000 7fa6e0400640 1 -- start start 2024-04-04T06:56:36.351 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.343+0000 7f9348a00640 1 Processor -- start 2024-04-04T06:56:36.351 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.343+0000 7f9348a00640 1 -- start start 2024-04-04T06:56:36.352 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.344+0000 7f145ae00640 1 -- 172.21.15.72:0/4105403277 shutdown_connections 2024-04-04T06:56:36.352 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.344+0000 7f145ae00640 1 --2- 172.21.15.72:0/4105403277 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f14540b9ba0 0x7f14540ceee0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:36.352 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.344+0000 7f145ae00640 1 --2- 172.21.15.72:0/4105403277 >> v2:172.21.15.117:3300/0 conn(0x7f145415e520 0x7f1454161ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:36.352 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.344+0000 7f145ae00640 1 -- 172.21.15.72:0/4105403277 >> 172.21.15.72:0/4105403277 conn(0x7f14540d0c90 msgr2=0x7f14540d1070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:56:36.352 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.344+0000 7fa6e0400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa6d80b63a0 0x7fa6d81fbd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:36.352 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.344+0000 7f8342c00640 1 -- 172.21.15.72:0/1660821058 shutdown_connections 2024-04-04T06:56:36.353 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.344+0000 7fa6e0400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa6d80b9f20 0x7fa6d8158350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:36.353 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.345+0000 7f9348a00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f93440d1840 0x7f93440ca7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:36.353 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.344+0000 7fa6e0400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa6d815ce10 0x7fa6d8158890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:36.353 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.344+0000 7fa6e0400640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fa6d80b83c0 con 0x7fa6d815ce10 2024-04-04T06:56:36.353 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.344+0000 7fa6e0400640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fa6d815d1f0 con 0x7fa6d80b63a0 2024-04-04T06:56:36.354 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.345+0000 7f9348a00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f93440d3660 0x7f93441610c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:36.354 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.344+0000 7fa6e0400640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fa6d80b8540 con 0x7fa6d80b9f20 2024-04-04T06:56:36.354 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.345+0000 7f9348a00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f934415e720 0x7f93440ccfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:36.354 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.345+0000 7f9348a00640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f93440d4c80 con 0x7f93440d3660 2024-04-04T06:56:36.355 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.345+0000 7f9348a00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f93440d49a0 con 0x7f93440d1840 2024-04-04T06:56:36.355 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.345+0000 7f9348a00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f93440ba200 con 0x7f934415e720 2024-04-04T06:56:36.355 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.345+0000 7f145ae00640 1 -- 172.21.15.72:0/4105403277 shutdown_connections 2024-04-04T06:56:36.355 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.345+0000 7f145ae00640 1 -- 172.21.15.72:0/4105403277 wait complete. 2024-04-04T06:56:36.355 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.345+0000 7fa6dda00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa6d80b63a0 0x7fa6d81fbd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:36.356 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.345+0000 7f6f36000640 1 Processor -- start 2024-04-04T06:56:36.356 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.345+0000 7f6f36000640 1 -- start start 2024-04-04T06:56:36.356 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.345+0000 7fa6de400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa6d815ce10 0x7fa6d8158890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:36.356 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.345+0000 7fa6dda00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa6d80b63a0 0x7fa6d81fbd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.72:40140/0 (socket says 172.21.15.72:40140) 2024-04-04T06:56:36.356 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.345+0000 7fa6dda00640 1 -- 172.21.15.72:0/1721905894 learned_addr learned my addr 172.21.15.72:0/1721905894 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:56:36.356 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.345+0000 7fa6dd000640 1 --2- 172.21.15.72:0/1721905894 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa6d80b9f20 0x7fa6d8158350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:36.356 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.346+0000 7fa6de400640 1 -- 172.21.15.72:0/1721905894 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa6d80b9f20 msgr2=0x7fa6d8158350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:36.356 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.346+0000 7fa6de400640 1 --2- 172.21.15.72:0/1721905894 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa6d80b9f20 0x7fa6d8158350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:36.357 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.346+0000 7fa6de400640 1 -- 172.21.15.72:0/1721905894 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa6d80b63a0 msgr2=0x7fa6d81fbd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:36.357 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.346+0000 7fa6de400640 1 --2- 172.21.15.72:0/1721905894 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa6d80b63a0 0x7fa6d81fbd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:36.357 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.346+0000 7fa6de400640 1 -- 172.21.15.72:0/1721905894 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6d80cc850 con 0x7fa6d815ce10 2024-04-04T06:56:36.357 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.346+0000 7fa6dda00640 1 --2- 172.21.15.72:0/1721905894 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa6d80b63a0 0x7fa6d81fbd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-04T06:56:36.357 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.346+0000 7f6f36000640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6f14003a00 0x7f6f300b4350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:36.358 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.346+0000 7f6f36000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6f300b55e0 0x7f6f301477b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:36.358 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.346+0000 7f6f36000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6f30150010 0x7f6f30150490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:36.358 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.346+0000 7f6f36000640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f6f300d36a0 con 0x7f6f14003a00 2024-04-04T06:56:36.358 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.346+0000 7f6f36000640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f6f300d33c0 con 0x7f6f300b55e0 2024-04-04T06:56:36.358 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.346+0000 7f6f36000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f6f300d3980 con 0x7f6f30150010 2024-04-04T06:56:36.358 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.347+0000 7f6f2f400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6f14003a00 0x7f6f300b4350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:36.358 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.347+0000 7f6f2f400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6f14003a00 0x7f6f300b4350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46298/0 (socket says 172.21.15.72:46298) 2024-04-04T06:56:36.358 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.347+0000 7f6f2f400640 1 -- 172.21.15.72:0/3008315649 learned_addr learned my addr 172.21.15.72:0/3008315649 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:56:36.358 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.347+0000 7f6f2fe00640 1 --2- 172.21.15.72:0/3008315649 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6f30150010 0x7f6f30150490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:36.358 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.347+0000 7fa6de400640 1 --2- 172.21.15.72:0/1721905894 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa6d815ce10 0x7fa6d8158890 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fa6d0001ff0 tx=0x7fa6d000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:36.359 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.347+0000 7f6f2f400640 1 -- 172.21.15.72:0/3008315649 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6f30150010 msgr2=0x7f6f30150490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:36.359 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.347+0000 7f6f2f400640 1 --2- 172.21.15.72:0/3008315649 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6f30150010 0x7f6f30150490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:36.359 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.347+0000 7f6f2f400640 1 -- 172.21.15.72:0/3008315649 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6f300b55e0 msgr2=0x7f6f301477b0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-04T06:56:36.359 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.347+0000 7f6f2f400640 1 --2- 172.21.15.72:0/3008315649 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6f300b55e0 0x7f6f301477b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:36.359 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.347+0000 7f6f2f400640 1 -- 172.21.15.72:0/3008315649 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f30152d00 con 0x7f6f14003a00 2024-04-04T06:56:36.359 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.347+0000 7fa6d5600640 1 -- 172.21.15.72:0/1721905894 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6d0012400 con 0x7fa6d815ce10 2024-04-04T06:56:36.360 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.348+0000 7fa6d5600640 1 -- 172.21.15.72:0/1721905894 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6d00125a0 con 0x7fa6d815ce10 2024-04-04T06:56:36.360 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.348+0000 7fa6d5600640 1 -- 172.21.15.72:0/1721905894 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6d0012a10 con 0x7fa6d815ce10 2024-04-04T06:56:36.360 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.348+0000 7fa6e0400640 1 -- 172.21.15.72:0/1721905894 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6d80ccb30 con 0x7fa6d815ce10 2024-04-04T06:56:36.360 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.348+0000 7f6f2f400640 1 --2- 172.21.15.72:0/3008315649 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6f14003a00 0x7f6f300b4350 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f6f2002bca0 tx=0x7f6f20001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:36.360 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.348+0000 7fa6e0400640 1 -- 172.21.15.72:0/1721905894 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6d80cd0f0 con 0x7fa6d815ce10 2024-04-04T06:56:36.361 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.349+0000 7f9341400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f93440d3660 0x7f93441610c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:36.361 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.349+0000 7f9341e00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f93440d1840 0x7f93440ca7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:36.361 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.348+0000 7f145ae00640 1 Processor -- start 2024-04-04T06:56:36.361 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.349+0000 7f9341400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f93440d3660 0x7f93441610c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46308/0 (socket says 172.21.15.72:46308) 2024-04-04T06:56:36.361 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.349+0000 7f9341400640 1 -- 172.21.15.72:0/1237049674 learned_addr learned my addr 172.21.15.72:0/1237049674 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:56:36.362 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.349+0000 7f145ae00640 1 -- start start 2024-04-04T06:56:36.362 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.350+0000 7f6f27400640 1 -- 172.21.15.72:0/3008315649 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f20041070 con 0x7f6f14003a00 2024-04-04T06:56:36.362 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.350+0000 7f6f27400640 1 -- 172.21.15.72:0/3008315649 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f200054a0 con 0x7f6f14003a00 2024-04-04T06:56:36.362 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.350+0000 7f6f27400640 1 -- 172.21.15.72:0/3008315649 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f20006c20 con 0x7f6f14003a00 2024-04-04T06:56:36.362 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.350+0000 7f6f36000640 1 -- 172.21.15.72:0/3008315649 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f30152fa0 con 0x7f6f14003a00 2024-04-04T06:56:36.363 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.350+0000 7fa6e0400640 1 -- 172.21.15.72:0/1721905894 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa6d80cd2f0 con 0x7fa6d815ce10 2024-04-04T06:56:36.363 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.350+0000 7f6f36000640 1 -- 172.21.15.72:0/3008315649 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f30153560 con 0x7f6f14003a00 2024-04-04T06:56:36.363 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.350+0000 7f9341400640 1 -- 172.21.15.72:0/1237049674 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f934415e720 msgr2=0x7f93440ccfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:36.363 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.350+0000 7f9341400640 1 --2- 172.21.15.72:0/1237049674 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f934415e720 0x7f93440ccfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:36.364 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.350+0000 7f9341400640 1 -- 172.21.15.72:0/1237049674 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f93440d1840 msgr2=0x7f93440ca7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:36.364 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.350+0000 7f9341400640 1 --2- 172.21.15.72:0/1237049674 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f93440d1840 0x7f93440ca7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:36.364 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.350+0000 7f9341400640 1 -- 172.21.15.72:0/1237049674 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f934415fa10 con 0x7f93440d3660 2024-04-04T06:56:36.364 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.352+0000 7f9341400640 1 --2- 172.21.15.72:0/1237049674 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f93440d3660 0x7f93441610c0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f933400c3c0 tx=0x7f933400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:36.364 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.352+0000 7fa6d5600640 1 -- 172.21.15.72:0/1721905894 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa6d0012bb0 con 0x7fa6d815ce10 2024-04-04T06:56:36.364 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.352+0000 7f6f24c00640 1 -- 172.21.15.72:0/3008315649 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f30068fd0 con 0x7f6f14003a00 2024-04-04T06:56:36.365 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.353+0000 7fa6d5600640 1 --2- 172.21.15.72:0/1721905894 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fa6b806c8f0 0x7fa6b806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:36.365 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.353+0000 7f933a000640 1 -- 172.21.15.72:0/1237049674 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9334017070 con 0x7f93440d3660 2024-04-04T06:56:36.365 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.353+0000 7f933a000640 1 -- 172.21.15.72:0/1237049674 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9334005ce0 con 0x7f93440d3660 2024-04-04T06:56:36.365 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.353+0000 7f933a000640 1 -- 172.21.15.72:0/1237049674 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93340072f0 con 0x7f93440d3660 2024-04-04T06:56:36.365 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.353+0000 7f9348a00640 1 -- 172.21.15.72:0/1237049674 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f934415fcf0 con 0x7f93440d3660 2024-04-04T06:56:36.365 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.353+0000 7f9348a00640 1 -- 172.21.15.72:0/1237049674 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93441602b0 con 0x7f93440d3660 2024-04-04T06:56:36.366 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.354+0000 7f145ae00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f14540b9ba0 0x7f14541e93c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:36.366 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.354+0000 7f145ae00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f14540cf420 0x7f1454155ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:36.366 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.354+0000 7f6f27400640 1 -- 172.21.15.72:0/3008315649 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6f20044070 con 0x7f6f14003a00 2024-04-04T06:56:36.366 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.353+0000 7fa6d5600640 1 -- 172.21.15.72:0/1721905894 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fa6d008c360 con 0x7fa6d815ce10 2024-04-04T06:56:36.367 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.354+0000 7f145ae00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f145415e520 0x7f14540cc240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:36.367 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.355+0000 7fa6dda00640 1 --2- 172.21.15.72:0/1721905894 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fa6b806c8f0 0x7fa6b806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:36.367 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.355+0000 7f6f27400640 1 --2- 172.21.15.72:0/3008315649 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f6f1006c920 0x7f6f1006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:36.367 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.355+0000 7f6f27400640 1 -- 172.21.15.72:0/3008315649 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f6f200ad7e0 con 0x7f6f14003a00 2024-04-04T06:56:36.368 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.344+0000 7f8342c00640 1 -- 172.21.15.72:0/1660821058 wait complete. 2024-04-04T06:56:36.368 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.347+0000 7f8342c00640 1 Processor -- start 2024-04-04T06:56:36.368 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.355+0000 7f145ae00640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f1454162d70 con 0x7f14540cf420 2024-04-04T06:56:36.368 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.356+0000 7f9348a00640 1 -- 172.21.15.72:0/1237049674 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f931c005290 con 0x7f93440d3660 2024-04-04T06:56:36.369 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.355+0000 7f1458e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f145415e520 0x7f14540cc240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:36.369 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.356+0000 7f1458e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f145415e520 0x7f14540cc240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.72:40436/0 (socket says 172.21.15.72:40436) 2024-04-04T06:56:36.369 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.356+0000 7f1458e00640 1 -- 172.21.15.72:0/1269837750 learned_addr learned my addr 172.21.15.72:0/1269837750 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:56:36.369 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.355+0000 7f1453e00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f14540b9ba0 0x7f14541e93c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:36.369 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.357+0000 7f6f2ea00640 1 --2- 172.21.15.72:0/3008315649 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f6f1006c920 0x7f6f1006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:36.369 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.357+0000 7f145ae00640 1 -- 172.21.15.72:0/1269837750 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f1454162a90 con 0x7f14540b9ba0 2024-04-04T06:56:36.370 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.358+0000 7f145ae00640 1 -- 172.21.15.72:0/1269837750 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f14540d27f0 con 0x7f145415e520 2024-04-04T06:56:36.370 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.358+0000 7fa6dda00640 1 --2- 172.21.15.72:0/1721905894 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fa6b806c8f0 0x7fa6b806edb0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fa6cc009560 tx=0x7fa6cc008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:36.370 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.357+0000 7f1453400640 1 --2- 172.21.15.72:0/1269837750 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f14540cf420 0x7f1454155ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:36.370 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.357+0000 7f8342c00640 1 -- start start 2024-04-04T06:56:36.371 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.359+0000 7f8342c00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f833c0718d0 0x7f833c154090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:36.371 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.359+0000 7f8342c00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f833c0b3d60 0x7f833c0ce7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:36.371 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.359+0000 7f8342c00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f833c0d0810 0x7f833c0ced00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:36.371 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.359+0000 7f8342c00640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f833c0b4a50 con 0x7f833c0b3d60 2024-04-04T06:56:36.371 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.359+0000 7f8342c00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f833c0acf40 con 0x7f833c0718d0 2024-04-04T06:56:36.371 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.359+0000 7f8342c00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f833c0b4d30 con 0x7f833c0d0810 2024-04-04T06:56:36.371 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.360+0000 7f8341800640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f833c0718d0 0x7f833c154090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:36.371 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.360+0000 7f8340e00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f833c0b3d60 0x7f833c0ce7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:36.371 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.360+0000 7f8341800640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f833c0718d0 0x7f833c154090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.72:40164/0 (socket says 172.21.15.72:40164) 2024-04-04T06:56:36.371 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.360+0000 7f8341800640 1 -- 172.21.15.72:0/128658877 learned_addr learned my addr 172.21.15.72:0/128658877 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:56:36.371 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.361+0000 7f6f2ea00640 1 --2- 172.21.15.72:0/3008315649 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f6f1006c920 0x7f6f1006ede0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f6f30071a60 tx=0x7f6f1c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:36.372 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.361+0000 7f1453400640 1 -- 172.21.15.72:0/1269837750 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f145415e520 msgr2=0x7f14540cc240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:36.372 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.361+0000 7f1453400640 1 --2- 172.21.15.72:0/1269837750 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f145415e520 0x7f14540cc240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:36.372 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.361+0000 7f1453400640 1 -- 172.21.15.72:0/1269837750 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f14540b9ba0 msgr2=0x7f14541e93c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:36.372 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.361+0000 7f1453400640 1 --2- 172.21.15.72:0/1269837750 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f14540b9ba0 0x7f14541e93c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:36.372 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.361+0000 7f1453400640 1 -- 172.21.15.72:0/1269837750 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14541e8320 con 0x7f14540cf420 2024-04-04T06:56:36.372 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.362+0000 7f8340e00640 1 -- 172.21.15.72:0/128658877 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f833c0d0810 msgr2=0x7f833c0ced00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-04T06:56:36.373 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.362+0000 7f8340e00640 1 --2- 172.21.15.72:0/128658877 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f833c0d0810 0x7f833c0ced00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:36.373 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.362+0000 7f8340e00640 1 -- 172.21.15.72:0/128658877 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f833c0718d0 msgr2=0x7f833c154090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:36.373 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.362+0000 7f8340e00640 1 --2- 172.21.15.72:0/128658877 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f833c0718d0 0x7f833c154090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:36.373 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.362+0000 7f8340e00640 1 -- 172.21.15.72:0/128658877 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f833c09cee0 con 0x7f833c0b3d60 2024-04-04T06:56:36.373 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.360+0000 7fa6d5600640 1 -- 172.21.15.72:0/1721905894 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fa6d005a140 con 0x7fa6d815ce10 2024-04-04T06:56:36.373 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.362+0000 7f933a000640 1 -- 172.21.15.72:0/1237049674 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f933401a070 con 0x7f93440d3660 2024-04-04T06:56:36.373 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.363+0000 7f8340e00640 1 --2- 172.21.15.72:0/128658877 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f833c0b3d60 0x7f833c0ce7c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f832800c410 tx=0x7f832800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:36.374 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.363+0000 7f1453400640 1 --2- 172.21.15.72:0/1269837750 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f14540cf420 0x7f1454155ae0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f14541626b0 tx=0x7f14440046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:36.374 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.364+0000 7f933a000640 1 --2- 172.21.15.72:0/1237049674 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f932406c940 0x7f932406ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:36.374 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.364+0000 7f9341e00640 1 --2- 172.21.15.72:0/1237049674 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f932406c940 0x7f932406ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:36.375 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.366+0000 7f9341e00640 1 --2- 172.21.15.72:0/1237049674 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f932406c940 0x7f932406ee00 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f933c036000 tx=0x7f933c030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:36.375 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.373+0000 7f933a000640 1 -- 172.21.15.72:0/1237049674 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f9334057130 con 0x7f93440d3660 2024-04-04T06:56:36.375 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.373+0000 7f144be00640 1 -- 172.21.15.72:0/1269837750 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1444035040 con 0x7f14540cf420 2024-04-04T06:56:36.375 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.374+0000 7f6f27400640 1 -- 172.21.15.72:0/3008315649 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f6f30068fd0 con 0x7f6f14003a00 2024-04-04T06:56:36.375 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.373+0000 7f8339600640 1 -- 172.21.15.72:0/128658877 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8328017070 con 0x7f833c0b3d60 2024-04-04T06:56:36.375 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.374+0000 7f8342c00640 1 -- 172.21.15.72:0/128658877 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f833c09d1c0 con 0x7f833c0b3d60 2024-04-04T06:56:36.376 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.374+0000 7f8342c00640 1 -- 172.21.15.72:0/128658877 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f833c157f40 con 0x7f833c0b3d60 2024-04-04T06:56:36.376 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.373+0000 7f145ae00640 1 -- 172.21.15.72:0/1269837750 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14541e8600 con 0x7f14540cf420 2024-04-04T06:56:36.376 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.373+0000 7f145ae00640 1 -- 172.21.15.72:0/1269837750 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14541e8bc0 con 0x7f14540cf420 2024-04-04T06:56:36.376 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.375+0000 7f145ae00640 1 -- 172.21.15.72:0/1269837750 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1454075840 con 0x7f14540cf420 2024-04-04T06:56:36.376 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.376+0000 7f8342c00640 1 -- 172.21.15.72:0/128658877 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f833c0756c0 con 0x7f833c0b3d60 2024-04-04T06:56:36.384 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.386+0000 7f8339600640 1 -- 172.21.15.72:0/128658877 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8328005230 con 0x7f833c0b3d60 2024-04-04T06:56:36.384 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.386+0000 7f8339600640 1 -- 172.21.15.72:0/128658877 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8328021060 con 0x7f833c0b3d60 2024-04-04T06:56:36.388 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.389+0000 7f933a000640 1 -- 172.21.15.72:0/1237049674 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f9334021020 con 0x7f93440d3660 2024-04-04T06:56:36.388 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.388+0000 7f8339600640 1 -- 172.21.15.72:0/128658877 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f832801a070 con 0x7f833c0b3d60 2024-04-04T06:56:36.389 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.390+0000 7f8339600640 1 --2- 172.21.15.72:0/128658877 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f831c06caf0 0x7f831c06efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:36.389 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.390+0000 7f8339600640 1 -- 172.21.15.72:0/128658877 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f832808af10 con 0x7f833c0b3d60 2024-04-04T06:56:36.390 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.390+0000 7f144be00640 1 -- 172.21.15.72:0/1269837750 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1444031800 con 0x7f14540cf420 2024-04-04T06:56:36.390 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.390+0000 7f144be00640 1 -- 172.21.15.72:0/1269837750 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f144403bb00 con 0x7f14540cf420 2024-04-04T06:56:36.390 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.390+0000 7f144be00640 1 -- 172.21.15.72:0/1269837750 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1444038020 con 0x7f14540cf420 2024-04-04T06:56:36.390 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.391+0000 7f144be00640 1 --2- 172.21.15.72:0/1269837750 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f143406c920 0x7f143406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:36.390 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.391+0000 7f144be00640 1 -- 172.21.15.72:0/1269837750 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f14440ae0e0 con 0x7f14540cf420 2024-04-04T06:56:36.391 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.391+0000 7f8341800640 1 --2- 172.21.15.72:0/128658877 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f831c06caf0 0x7f831c06efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:36.391 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.393+0000 7f1453e00640 1 --2- 172.21.15.72:0/1269837750 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f143406c920 0x7f143406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:36.392 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.394+0000 7f8341800640 1 --2- 172.21.15.72:0/128658877 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f831c06caf0 0x7f831c06efb0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f8330009630 tx=0x7f833003c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:36.395 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.394+0000 7f1453e00640 1 --2- 172.21.15.72:0/1269837750 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f143406c920 0x7f143406ede0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f1440009560 tx=0x7f1440009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:36.396 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.398+0000 7f144be00640 1 -- 172.21.15.72:0/1269837750 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f1444055080 con 0x7f14540cf420 2024-04-04T06:56:36.403 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.405+0000 7f8339600640 1 -- 172.21.15.72:0/128658877 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f8328058d60 con 0x7f833c0b3d60 2024-04-04T06:56:36.445 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.446+0000 7f31b3c00640 1 Processor -- start 2024-04-04T06:56:36.450 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.446+0000 7f31b3c00640 1 -- start start 2024-04-04T06:56:36.450 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.448+0000 7f31b3c00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f31ac144be0 0x7f31ac15ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:36.450 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.448+0000 7f31b3c00640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f31ac0b5390 0x7f31ac0b57c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:36.450 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.449+0000 7f31b3c00640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31ac144fc0 con 0x7f31ac0b4070 2024-04-04T06:56:36.451 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.449+0000 7f31b3c00640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f31ac070ee0 con 0x7f31ac0b5390 2024-04-04T06:56:36.451 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.449+0000 7f31b3c00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f31ac072be0 con 0x7f31ac144be0 2024-04-04T06:56:36.451 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.449+0000 7f31abe00640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f31ac0b4070 0x7f31ac0724d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:52756/0 (socket says 172.21.15.72:52756) 2024-04-04T06:56:36.451 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.449+0000 7f31abe00640 1 -- 172.21.15.72:0/2565266411 learned_addr learned my addr 172.21.15.72:0/2565266411 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-04-04T06:56:36.451 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.450+0000 7f31b1c00640 1 --2- 172.21.15.72:0/2565266411 >> v2:172.21.15.72:3300/0 conn(0x7f31ac0b5390 0x7f31ac0b57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:36.451 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.450+0000 7f31ab400640 1 -- 172.21.15.72:0/2565266411 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 99017490 0 0) 0x7f31ac144fc0 con 0x7f31ac0b4070 2024-04-04T06:56:36.451 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.450+0000 7f31ab400640 1 -- 172.21.15.72:0/2565266411 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3194003520 con 0x7f31ac0b4070 2024-04-04T06:56:36.451 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.451+0000 7f31b1c00640 1 -- 172.21.15.72:0/2565266411 >> v2:172.21.15.117:3300/0 conn(0x7f31ac144be0 msgr2=0x7f31ac15ecb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-04T06:56:36.451 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.451+0000 7f31b1c00640 1 --2- 172.21.15.72:0/2565266411 >> v2:172.21.15.117:3300/0 conn(0x7f31ac144be0 0x7f31ac15ecb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:36.451 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.451+0000 7f31b1c00640 1 -- 172.21.15.72:0/2565266411 >> v1:172.21.15.72:6789/0 conn(0x7f31ac0b4070 legacy=0x7f31ac0724d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:36.451 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.451+0000 7f31b1c00640 1 -- 172.21.15.72:0/2565266411 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31ac15f420 con 0x7f31ac0b5390 2024-04-04T06:56:36.454 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.456+0000 7f31b1c00640 1 --2- 172.21.15.72:0/2565266411 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f31ac0b5390 0x7f31ac0b57c0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f31ac0754b0 tx=0x7f31a402e110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e2761449e2a3698 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:36.455 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.457+0000 7f31ab400640 1 -- 172.21.15.72:0/2565266411 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31a403b070 con 0x7f31ac0b5390 2024-04-04T06:56:36.455 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.457+0000 7f31ab400640 1 -- 172.21.15.72:0/2565266411 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31a4036440 con 0x7f31ac0b5390 2024-04-04T06:56:36.455 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.457+0000 7f31ab400640 1 -- 172.21.15.72:0/2565266411 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31a4036850 con 0x7f31ac0b5390 2024-04-04T06:56:36.457 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.459+0000 7f31b3c00640 1 -- 172.21.15.72:0/2565266411 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f31ac0b5390 msgr2=0x7f31ac0b57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:36.457 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.459+0000 7f31b3c00640 1 --2- 172.21.15.72:0/2565266411 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f31ac0b5390 0x7f31ac0b57c0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f31ac0754b0 tx=0x7f31a402e110 comp rx=0 tx=0).stop 2024-04-04T06:56:36.457 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.459+0000 7f31b3c00640 1 -- 172.21.15.72:0/2565266411 shutdown_connections 2024-04-04T06:56:36.458 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.459+0000 7f31b3c00640 1 --2- 172.21.15.72:0/2565266411 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f31ac0b5390 0x7f31ac0b57c0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:36.458 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.460+0000 7f31b3c00640 1 --2- 172.21.15.72:0/2565266411 >> v2:172.21.15.117:3300/0 conn(0x7f31ac144be0 0x7f31ac15ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:36.458 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.460+0000 7f31b3c00640 1 -- 172.21.15.72:0/2565266411 >> 172.21.15.72:0/2565266411 conn(0x7f31ac0d1080 msgr2=0x7f31ac0d1490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:56:36.459 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.460+0000 7f31b3c00640 1 -- 172.21.15.72:0/2565266411 shutdown_connections 2024-04-04T06:56:36.465 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.460+0000 7f31b3c00640 1 -- 172.21.15.72:0/2565266411 wait complete. 2024-04-04T06:56:36.465 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.463+0000 7f31b3c00640 1 Processor -- start 2024-04-04T06:56:36.465 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.467+0000 7f31b3c00640 1 -- start start 2024-04-04T06:56:36.468 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.469+0000 7f31b3c00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f31ac0b4070 0x7f31ac06b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:36.468 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.470+0000 7f31b1200640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f31ac0b4070 0x7f31ac06b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:36.468 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.470+0000 7f31b1200640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f31ac0b4070 0x7f31ac06b6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46352/0 (socket says 172.21.15.72:46352) 2024-04-04T06:56:36.468 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.470+0000 7f31b3c00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f31ac0b5390 0x7f31ac1570b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:36.469 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.470+0000 7f31b3c00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f31ac144be0 0x7f31ac159b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:36.470 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.470+0000 7f31b3c00640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f31ac15b960 con 0x7f31ac0b4070 2024-04-04T06:56:36.470 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.470+0000 7f31b3c00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f31ac15b670 con 0x7f31ac144be0 2024-04-04T06:56:36.470 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.470+0000 7f31b3c00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f31ac0b5d00 con 0x7f31ac0b5390 2024-04-04T06:56:36.470 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.471+0000 7f31abe00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f31ac0b5390 0x7f31ac1570b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:36.470 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.471+0000 7f31b1c00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f31ac144be0 0x7f31ac159b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:36.470 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.471+0000 7f31abe00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f31ac0b5390 0x7f31ac1570b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.72:40448/0 (socket says 172.21.15.72:40448) 2024-04-04T06:56:36.470 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.471+0000 7f31abe00640 1 -- 172.21.15.72:0/3052169165 learned_addr learned my addr 172.21.15.72:0/3052169165 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:56:36.471 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.472+0000 7f31abe00640 1 -- 172.21.15.72:0/3052169165 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f31ac144be0 msgr2=0x7f31ac159b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:36.471 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.472+0000 7f31abe00640 1 --2- 172.21.15.72:0/3052169165 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f31ac144be0 0x7f31ac159b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:36.471 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.472+0000 7f31abe00640 1 -- 172.21.15.72:0/3052169165 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f31ac0b4070 msgr2=0x7f31ac06b6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:36.478 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.480+0000 7f31abe00640 1 --2- 172.21.15.72:0/3052169165 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f31ac0b4070 0x7f31ac06b6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:36.478 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.480+0000 7f31abe00640 1 -- 172.21.15.72:0/3052169165 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31ac205410 con 0x7f31ac0b5390 2024-04-04T06:56:36.478 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.480+0000 7f31b1200640 1 --2- 172.21.15.72:0/3052169165 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f31ac0b4070 0x7f31ac06b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-04T06:56:36.479 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.481+0000 7f31abe00640 1 --2- 172.21.15.72:0/3052169165 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f31ac0b5390 0x7f31ac1570b0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f31a000c430 tx=0x7f31a000c8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:36.480 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.482+0000 7f31a8c00640 1 -- 172.21.15.72:0/3052169165 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31a0017070 con 0x7f31ac0b5390 2024-04-04T06:56:36.480 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.482+0000 7f31a8c00640 1 -- 172.21.15.72:0/3052169165 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31a0005ce0 con 0x7f31ac0b5390 2024-04-04T06:56:36.480 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.482+0000 7f31b3c00640 1 -- 172.21.15.72:0/3052169165 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31ac1590b0 con 0x7f31ac0b5390 2024-04-04T06:56:36.480 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.482+0000 7f31a8c00640 1 -- 172.21.15.72:0/3052169165 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31a00072f0 con 0x7f31ac0b5390 2024-04-04T06:56:36.484 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.486+0000 7f31b3c00640 1 -- 172.21.15.72:0/3052169165 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f31ac159670 con 0x7f31ac0b5390 2024-04-04T06:56:36.486 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.487+0000 7f31b3c00640 1 -- 172.21.15.72:0/3052169165 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31ac159870 con 0x7f31ac0b5390 2024-04-04T06:56:36.491 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.493+0000 7f31a8c00640 1 -- 172.21.15.72:0/3052169165 <== mon.2 v2:172.21.15.117:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f31a001a070 con 0x7f31ac0b5390 2024-04-04T06:56:36.496 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.498+0000 7f31a8c00640 1 --2- 172.21.15.72:0/3052169165 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f318c06c940 0x7f318c06ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:36.496 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.498+0000 7f31a8c00640 1 -- 172.21.15.72:0/3052169165 <== mon.2 v2:172.21.15.117:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f31a008cde0 con 0x7f31ac0b5390 2024-04-04T06:56:36.498 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.499+0000 7f31b1200640 1 --2- 172.21.15.72:0/3052169165 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f318c06c940 0x7f318c06ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:36.502 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.504+0000 7f31b1200640 1 --2- 172.21.15.72:0/3052169165 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f318c06c940 0x7f318c06ee00 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f319800a860 tx=0x7f3198008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:36.514 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.516+0000 7f31a8c00640 1 -- 172.21.15.72:0/3052169165 <== mon.2 v2:172.21.15.117:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f31ac159870 con 0x7f31ac0b5390 2024-04-04T06:56:36.759 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.761+0000 7f9be0c00640 1 -- 172.21.15.72:0/3328799743 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f9bb8005580 con 0x7f9bd40392d0 2024-04-04T06:56:36.762 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.763+0000 7f9bcf400640 1 -- 172.21.15.72:0/3328799743 <== mon.1 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f9bdc0d44a0 con 0x7f9bd40392d0 2024-04-04T06:56:36.763 INFO:teuthology.orchestra.run.smithi072.stdout:55834574853 2024-04-04T06:56:36.767 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.769+0000 7f9be0c00640 1 -- 172.21.15.72:0/3328799743 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f9bbc06c9c0 msgr2=0x7f9bbc06ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:36.767 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.769+0000 7f9be0c00640 1 --2- 172.21.15.72:0/3328799743 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f9bbc06c9c0 0x7f9bbc06ee80 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f9bd0036000 tx=0x7f9bd0030000 comp rx=0 tx=0).stop 2024-04-04T06:56:36.768 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.769+0000 7f9be0c00640 1 -- 172.21.15.72:0/3328799743 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9bd40392d0 msgr2=0x7f9bd40e0110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:36.768 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.769+0000 7f9be0c00640 1 --2- 172.21.15.72:0/3328799743 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9bd40392d0 0x7f9bd40e0110 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f9bdc02d900 tx=0x7f9bdc069080 comp rx=0 tx=0).stop 2024-04-04T06:56:36.769 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.771+0000 7f9be0c00640 1 -- 172.21.15.72:0/3328799743 shutdown_connections 2024-04-04T06:56:36.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.771+0000 7f9be0c00640 1 --2- 172.21.15.72:0/3328799743 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f9bbc06c9c0 0x7f9bbc06ee80 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:36.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.771+0000 7f9be0c00640 1 --2- 172.21.15.72:0/3328799743 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9bd40e0650 0x7f9bd404ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:36.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.771+0000 7f9be0c00640 1 --2- 172.21.15.72:0/3328799743 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9bd404fa90 0x7f9bd404c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:36.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.771+0000 7f9be0c00640 1 --2- 172.21.15.72:0/3328799743 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9bd40392d0 0x7f9bd40e0110 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:36.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.771+0000 7f9be0c00640 1 -- 172.21.15.72:0/3328799743 >> 172.21.15.72:0/3328799743 conn(0x7f9bd4009fb0 msgr2=0x7f9bd4039790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:56:36.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.772+0000 7f9be0c00640 1 -- 172.21.15.72:0/3328799743 shutdown_connections 2024-04-04T06:56:36.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.772+0000 7f9be0c00640 1 -- 172.21.15.72:0/3328799743 wait complete. 2024-04-04T06:56:36.784 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.786+0000 7f9348a00640 1 -- 172.21.15.72:0/1237049674 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f931c005850 con 0x7f93440d3660 2024-04-04T06:56:36.788 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.790+0000 7f933a000640 1 -- 172.21.15.72:0/1237049674 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f9334059090 con 0x7f93440d3660 2024-04-04T06:56:36.798 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.799+0000 7fa6e0400640 1 -- 172.21.15.72:0/1721905894 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fa6d8075840 con 0x7fa6d815ce10 2024-04-04T06:56:36.799 INFO:teuthology.orchestra.run.smithi072.stdout:55834574854 2024-04-04T06:56:36.799 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.800+0000 7fa6d5600640 1 -- 172.21.15.72:0/1721905894 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fa6d005e440 con 0x7fa6d815ce10 2024-04-04T06:56:36.799 INFO:teuthology.orchestra.run.smithi072.stdout:55834574852 2024-04-04T06:56:36.802 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.804+0000 7f9348a00640 1 -- 172.21.15.72:0/1237049674 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f932406c940 msgr2=0x7f932406ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:36.803 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.804+0000 7f9348a00640 1 --2- 172.21.15.72:0/1237049674 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f932406c940 0x7f932406ee00 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f933c036000 tx=0x7f933c030000 comp rx=0 tx=0).stop 2024-04-04T06:56:36.803 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.804+0000 7fa6e0400640 1 -- 172.21.15.72:0/1721905894 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fa6b806c8f0 msgr2=0x7fa6b806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:36.803 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.804+0000 7fa6e0400640 1 --2- 172.21.15.72:0/1721905894 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fa6b806c8f0 0x7fa6b806edb0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fa6cc009560 tx=0x7fa6cc008030 comp rx=0 tx=0).stop 2024-04-04T06:56:36.804 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.804+0000 7f9348a00640 1 -- 172.21.15.72:0/1237049674 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f93440d3660 msgr2=0x7f93441610c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:36.804 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.804+0000 7f9348a00640 1 --2- 172.21.15.72:0/1237049674 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f93440d3660 0x7f93441610c0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f933400c3c0 tx=0x7f933400c880 comp rx=0 tx=0).stop 2024-04-04T06:56:36.804 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.804+0000 7f9348a00640 1 -- 172.21.15.72:0/1237049674 shutdown_connections 2024-04-04T06:56:36.804 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.804+0000 7f9348a00640 1 --2- 172.21.15.72:0/1237049674 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f932406c940 0x7f932406ee00 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:36.804 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.804+0000 7f9348a00640 1 --2- 172.21.15.72:0/1237049674 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f934415e720 0x7f93440ccfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:36.804 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.804+0000 7f9348a00640 1 --2- 172.21.15.72:0/1237049674 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f93440d3660 0x7f93441610c0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:36.804 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.804+0000 7f9348a00640 1 --2- 172.21.15.72:0/1237049674 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f93440d1840 0x7f93440ca7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:36.804 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.804+0000 7f9348a00640 1 -- 172.21.15.72:0/1237049674 >> 172.21.15.72:0/1237049674 conn(0x7f9344071eb0 msgr2=0x7f934415c340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:56:36.805 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.804+0000 7fa6e0400640 1 -- 172.21.15.72:0/1721905894 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa6d815ce10 msgr2=0x7fa6d8158890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:36.805 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.804+0000 7fa6e0400640 1 --2- 172.21.15.72:0/1721905894 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa6d815ce10 0x7fa6d8158890 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fa6d0001ff0 tx=0x7fa6d000a430 comp rx=0 tx=0).stop 2024-04-04T06:56:36.805 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.806+0000 7fa6e0400640 1 -- 172.21.15.72:0/1721905894 shutdown_connections 2024-04-04T06:56:36.805 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.806+0000 7fa6e0400640 1 --2- 172.21.15.72:0/1721905894 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fa6b806c8f0 0x7fa6b806edb0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:36.805 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.806+0000 7fa6e0400640 1 --2- 172.21.15.72:0/1721905894 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa6d815ce10 0x7fa6d8158890 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:36.805 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.806+0000 7fa6e0400640 1 --2- 172.21.15.72:0/1721905894 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa6d80b9f20 0x7fa6d8158350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:36.805 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.806+0000 7fa6e0400640 1 --2- 172.21.15.72:0/1721905894 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa6d80b63a0 0x7fa6d81fbd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:36.805 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.806+0000 7fa6e0400640 1 -- 172.21.15.72:0/1721905894 >> 172.21.15.72:0/1721905894 conn(0x7fa6d80d0c90 msgr2=0x7fa6d80d3840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:56:36.805 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.806+0000 7fa6e0400640 1 -- 172.21.15.72:0/1721905894 shutdown_connections 2024-04-04T06:56:36.805 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.806+0000 7fa6e0400640 1 -- 172.21.15.72:0/1721905894 wait complete. 2024-04-04T06:56:36.807 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.6 2024-04-04T06:56:36.807 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.808+0000 7f9348a00640 1 -- 172.21.15.72:0/1237049674 shutdown_connections 2024-04-04T06:56:36.807 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.808+0000 7f9348a00640 1 -- 172.21.15.72:0/1237049674 wait complete. 2024-04-04T06:56:36.810 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.811+0000 7fe3b6c00640 1 -- 172.21.15.72:0/3253555450 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fe38c005580 con 0x7fe3a80eb440 2024-04-04T06:56:36.815 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.813+0000 7fe3ad600640 1 -- 172.21.15.72:0/3253555450 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fe3a40597f0 con 0x7fe3a80eb440 2024-04-04T06:56:36.818 INFO:teuthology.orchestra.run.smithi072.stdout:55834574854 2024-04-04T06:56:36.819 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.820+0000 7fe3b6c00640 1 -- 172.21.15.72:0/3253555450 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fe39006c9c0 msgr2=0x7fe39006ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:36.819 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.820+0000 7fe3b6c00640 1 --2- 172.21.15.72:0/3253555450 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fe39006c9c0 0x7fe39006ee80 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fe3a80ea700 tx=0x7fe39c008040 comp rx=0 tx=0).stop 2024-04-04T06:56:36.819 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.820+0000 7fe3b6c00640 1 -- 172.21.15.72:0/3253555450 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe3a80eb440 msgr2=0x7fe3a80d41a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:36.819 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.820+0000 7fe3b6c00640 1 --2- 172.21.15.72:0/3253555450 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe3a80eb440 0x7fe3a80d41a0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fe3a400cac0 tx=0x7fe3a400cf80 comp rx=0 tx=0).stop 2024-04-04T06:56:36.820 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.821+0000 7fe3b6c00640 1 -- 172.21.15.72:0/3253555450 shutdown_connections 2024-04-04T06:56:36.820 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.821+0000 7fe3b6c00640 1 --2- 172.21.15.72:0/3253555450 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fe39006c9c0 0x7fe39006ee80 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:36.820 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.821+0000 7fe3b6c00640 1 --2- 172.21.15.72:0/3253555450 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe3a80d46e0 0x7fe3a80d1aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:36.820 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.821+0000 7fe3b6c00640 1 --2- 172.21.15.72:0/3253555450 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe3a80eb440 0x7fe3a80d41a0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:36.820 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.821+0000 7fe3b6c00640 1 --2- 172.21.15.72:0/3253555450 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe3a80061a0 0x7fe3a803fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:36.820 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.821+0000 7fe3b6c00640 1 -- 172.21.15.72:0/3253555450 >> 172.21.15.72:0/3253555450 conn(0x7fe3a80559e0 msgr2=0x7fe3a80389c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:56:36.821 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.822+0000 7fe3b6c00640 1 -- 172.21.15.72:0/3253555450 shutdown_connections 2024-04-04T06:56:36.821 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.822+0000 7fe3b6c00640 1 -- 172.21.15.72:0/3253555450 wait complete. 2024-04-04T06:56:36.829 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.830+0000 7f8342c00640 1 -- 172.21.15.72:0/128658877 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f833c06fb50 con 0x7f833c0b3d60 2024-04-04T06:56:36.829 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.831+0000 7f8339600640 1 -- 172.21.15.72:0/128658877 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f832805d060 con 0x7f833c0b3d60 2024-04-04T06:56:36.830 INFO:teuthology.orchestra.run.smithi072.stdout:55834574852 2024-04-04T06:56:36.833 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.835+0000 7f8342c00640 1 -- 172.21.15.72:0/128658877 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f831c06caf0 msgr2=0x7f831c06efb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:36.834 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.835+0000 7f8342c00640 1 --2- 172.21.15.72:0/128658877 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f831c06caf0 0x7f831c06efb0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f8330009630 tx=0x7f833003c040 comp rx=0 tx=0).stop 2024-04-04T06:56:36.834 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.835+0000 7f8342c00640 1 -- 172.21.15.72:0/128658877 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f833c0b3d60 msgr2=0x7f833c0ce7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:36.835 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.835+0000 7f8342c00640 1 --2- 172.21.15.72:0/128658877 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f833c0b3d60 0x7f833c0ce7c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f832800c410 tx=0x7f832800c8d0 comp rx=0 tx=0).stop 2024-04-04T06:56:36.835 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.835+0000 7f8342c00640 1 -- 172.21.15.72:0/128658877 shutdown_connections 2024-04-04T06:56:36.835 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.835+0000 7f8342c00640 1 --2- 172.21.15.72:0/128658877 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f831c06caf0 0x7f831c06efb0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:36.835 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.835+0000 7f8342c00640 1 --2- 172.21.15.72:0/128658877 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f833c0d0810 0x7f833c0ced00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:36.835 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.835+0000 7f8342c00640 1 --2- 172.21.15.72:0/128658877 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f833c0b3d60 0x7f833c0ce7c0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:36.835 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.835+0000 7f8342c00640 1 --2- 172.21.15.72:0/128658877 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f833c0718d0 0x7f833c154090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:36.835 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.835+0000 7f8342c00640 1 -- 172.21.15.72:0/128658877 >> 172.21.15.72:0/128658877 conn(0x7f833c0cfd20 msgr2=0x7f833c06f310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:56:36.835 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.836+0000 7f8342c00640 1 -- 172.21.15.72:0/128658877 shutdown_connections 2024-04-04T06:56:36.835 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.836+0000 7f8342c00640 1 -- 172.21.15.72:0/128658877 wait complete. 2024-04-04T06:56:36.836 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.1 2024-04-04T06:56:36.836 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.2 2024-04-04T06:56:36.844 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.3 2024-04-04T06:56:36.845 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.847+0000 7f145ae00640 1 -- 172.21.15.72:0/1269837750 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f14540b8cb0 con 0x7f14540cf420 2024-04-04T06:56:36.846 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.847+0000 7f144be00640 1 -- 172.21.15.72:0/1269837750 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f144407c580 con 0x7f14540cf420 2024-04-04T06:56:36.846 INFO:teuthology.orchestra.run.smithi072.stdout:55834574854 2024-04-04T06:56:36.848 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.849+0000 7f145ae00640 1 -- 172.21.15.72:0/1269837750 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f143406c920 msgr2=0x7f143406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:36.848 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.849+0000 7f145ae00640 1 --2- 172.21.15.72:0/1269837750 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f143406c920 0x7f143406ede0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f1440009560 tx=0x7f1440009190 comp rx=0 tx=0).stop 2024-04-04T06:56:36.848 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.849+0000 7f145ae00640 1 -- 172.21.15.72:0/1269837750 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f14540cf420 msgr2=0x7f1454155ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:36.849 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.849+0000 7f145ae00640 1 --2- 172.21.15.72:0/1269837750 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f14540cf420 0x7f1454155ae0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f14541626b0 tx=0x7f14440046c0 comp rx=0 tx=0).stop 2024-04-04T06:56:36.849 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.850+0000 7f145ae00640 1 -- 172.21.15.72:0/1269837750 shutdown_connections 2024-04-04T06:56:36.849 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.850+0000 7f145ae00640 1 --2- 172.21.15.72:0/1269837750 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f143406c920 0x7f143406ede0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:36.849 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.850+0000 7f145ae00640 1 --2- 172.21.15.72:0/1269837750 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f145415e520 0x7f14540cc240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:36.849 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.850+0000 7f145ae00640 1 --2- 172.21.15.72:0/1269837750 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f14540cf420 0x7f1454155ae0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:36.849 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.850+0000 7f145ae00640 1 --2- 172.21.15.72:0/1269837750 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f14540b9ba0 0x7f14541e93c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:36.849 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.850+0000 7f145ae00640 1 -- 172.21.15.72:0/1269837750 >> 172.21.15.72:0/1269837750 conn(0x7f14540d0c90 msgr2=0x7f14540d1070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:56:36.849 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.850+0000 7f145ae00640 1 -- 172.21.15.72:0/1269837750 shutdown_connections 2024-04-04T06:56:36.849 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.850+0000 7f145ae00640 1 -- 172.21.15.72:0/1269837750 wait complete. 2024-04-04T06:56:36.854 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.856+0000 7f6f24c00640 1 -- 172.21.15.72:0/3008315649 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f6f30075840 con 0x7f6f14003a00 2024-04-04T06:56:36.855 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.856+0000 7f6f27400640 1 -- 172.21.15.72:0/3008315649 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f6f2007b650 con 0x7f6f14003a00 2024-04-04T06:56:36.855 INFO:teuthology.orchestra.run.smithi072.stdout:55834574853 2024-04-04T06:56:36.857 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.859+0000 7f6f24c00640 1 -- 172.21.15.72:0/3008315649 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f6f1006c920 msgr2=0x7f6f1006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:36.857 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.859+0000 7f6f24c00640 1 --2- 172.21.15.72:0/3008315649 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f6f1006c920 0x7f6f1006ede0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f6f30071a60 tx=0x7f6f1c009040 comp rx=0 tx=0).stop 2024-04-04T06:56:36.857 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.859+0000 7f6f24c00640 1 -- 172.21.15.72:0/3008315649 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6f14003a00 msgr2=0x7f6f300b4350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:36.858 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.859+0000 7f6f24c00640 1 --2- 172.21.15.72:0/3008315649 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6f14003a00 0x7f6f300b4350 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f6f2002bca0 tx=0x7f6f20001120 comp rx=0 tx=0).stop 2024-04-04T06:56:36.858 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.860+0000 7f6f24c00640 1 -- 172.21.15.72:0/3008315649 shutdown_connections 2024-04-04T06:56:36.858 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.860+0000 7f6f24c00640 1 --2- 172.21.15.72:0/3008315649 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f6f1006c920 0x7f6f1006ede0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:36.858 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.860+0000 7f6f24c00640 1 --2- 172.21.15.72:0/3008315649 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6f30150010 0x7f6f30150490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:36.859 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.860+0000 7f6f24c00640 1 --2- 172.21.15.72:0/3008315649 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6f300b55e0 0x7f6f301477b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:36.859 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.860+0000 7f6f24c00640 1 --2- 172.21.15.72:0/3008315649 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6f14003a00 0x7f6f300b4350 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:36.859 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.860+0000 7f6f24c00640 1 -- 172.21.15.72:0/3008315649 >> 172.21.15.72:0/3008315649 conn(0x7f6f30071e80 msgr2=0x7f6f300d1ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:56:36.859 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.860+0000 7f6f24c00640 1 -- 172.21.15.72:0/3008315649 shutdown_connections 2024-04-04T06:56:36.859 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.860+0000 7f6f24c00640 1 -- 172.21.15.72:0/3008315649 wait complete. 2024-04-04T06:56:36.860 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.4 2024-04-04T06:56:36.866 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.7 2024-04-04T06:56:36.874 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.0 2024-04-04T06:56:36.984 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.985+0000 7f31b3c00640 1 -- 172.21.15.72:0/3052169165 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f31ac075840 con 0x7f31ac0b5390 2024-04-04T06:56:36.985 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.986+0000 7f31a8c00640 1 -- 172.21.15.72:0/3052169165 <== mon.2 v2:172.21.15.117:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f31a0058ad0 con 0x7f31ac0b5390 2024-04-04T06:56:36.985 INFO:teuthology.orchestra.run.smithi072.stdout:55834574853 2024-04-04T06:56:36.988 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.989+0000 7f31b3c00640 1 -- 172.21.15.72:0/3052169165 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f318c06c940 msgr2=0x7f318c06ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:36.988 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.989+0000 7f31b3c00640 1 --2- 172.21.15.72:0/3052169165 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f318c06c940 0x7f318c06ee00 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f319800a860 tx=0x7f3198008040 comp rx=0 tx=0).stop 2024-04-04T06:56:36.988 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.989+0000 7f31b3c00640 1 -- 172.21.15.72:0/3052169165 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f31ac0b5390 msgr2=0x7f31ac1570b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:36.988 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.989+0000 7f31b3c00640 1 --2- 172.21.15.72:0/3052169165 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f31ac0b5390 0x7f31ac1570b0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f31a000c430 tx=0x7f31a000c8f0 comp rx=0 tx=0).stop 2024-04-04T06:56:36.988 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.989+0000 7f31b3c00640 1 -- 172.21.15.72:0/3052169165 shutdown_connections 2024-04-04T06:56:36.988 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.989+0000 7f31b3c00640 1 --2- 172.21.15.72:0/3052169165 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f318c06c940 0x7f318c06ee00 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:36.988 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.989+0000 7f31b3c00640 1 --2- 172.21.15.72:0/3052169165 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f31ac144be0 0x7f31ac159b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:36.989 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.989+0000 7f31b3c00640 1 --2- 172.21.15.72:0/3052169165 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f31ac0b5390 0x7f31ac1570b0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:36.989 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.989+0000 7f31b3c00640 1 --2- 172.21.15.72:0/3052169165 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f31ac0b4070 0x7f31ac06b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:36.989 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.989+0000 7f31b3c00640 1 -- 172.21.15.72:0/3052169165 >> 172.21.15.72:0/3052169165 conn(0x7f31ac0d1080 msgr2=0x7f31ac0b4c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:56:36.989 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.989+0000 7f31b3c00640 1 -- 172.21.15.72:0/3052169165 shutdown_connections 2024-04-04T06:56:36.989 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:36.990+0000 7f31b3c00640 1 -- 172.21.15.72:0/3052169165 wait complete. 2024-04-04T06:56:37.005 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.5 2024-04-04T06:56:37.808 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-04T06:56:37.837 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-04T06:56:37.837 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-04T06:56:37.846 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-04T06:56:37.861 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-04T06:56:37.867 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-04T06:56:37.874 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-04T06:56:38.006 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-04T06:56:38.101 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.102+0000 7f41e4200640 1 Processor -- start 2024-04-04T06:56:38.102 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.103+0000 7f41e4200640 1 -- start start 2024-04-04T06:56:38.103 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.104+0000 7f41e4200640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f41dc15bfd0 0x7f41dc0c4ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:38.103 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.105+0000 7f41e4200640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f41dc15f9d0 0x7f41dc0cf7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:38.104 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.105+0000 7f41e4200640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41dc0af4a0 con 0x7f41dc15c3b0 2024-04-04T06:56:38.104 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.105+0000 7f41e4200640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f41dc0af780 con 0x7f41dc15bfd0 2024-04-04T06:56:38.104 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.105+0000 7f41e4200640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f41dc0732b0 con 0x7f41dc15f9d0 2024-04-04T06:56:38.105 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.106+0000 7f41e1800640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f41dc15bfd0 0x7f41dc0c4ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:38.105 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.106+0000 7f41e1800640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f41dc15bfd0 0x7f41dc0c4ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46358/0 (socket says 172.21.15.72:46358) 2024-04-04T06:56:38.105 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.106+0000 7f41e1800640 1 -- 172.21.15.72:0/3303347547 learned_addr learned my addr 172.21.15.72:0/3303347547 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:56:38.105 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.107+0000 7f41e0e00640 1 --2- 172.21.15.72:0/3303347547 >> v2:172.21.15.117:3300/0 conn(0x7f41dc15f9d0 0x7f41dc0cf7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:38.106 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.108+0000 7f41e0e00640 1 -- 172.21.15.72:0/3303347547 >> v2:172.21.15.72:3300/0 conn(0x7f41dc15bfd0 msgr2=0x7f41dc0c4ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:56:38.106 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.108+0000 7f41e0e00640 1 --2- 172.21.15.72:0/3303347547 >> v2:172.21.15.72:3300/0 conn(0x7f41dc15bfd0 0x7f41dc0c4ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:38.107 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.108+0000 7f41e0e00640 1 -- 172.21.15.72:0/3303347547 >> v1:172.21.15.117:6789/0 conn(0x7f41dc15c3b0 legacy=0x7f41dc0ccb10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-04T06:56:38.107 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.108+0000 7f41e0e00640 1 -- 172.21.15.72:0/3303347547 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41dc073590 con 0x7f41dc15f9d0 2024-04-04T06:56:38.113 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.114+0000 7f41e0e00640 1 --2- 172.21.15.72:0/3303347547 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f41dc15f9d0 0x7f41dc0cf7c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f41dc0c62d0 tx=0x7f41c8033f40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7a5906f3ec4ca446 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:38.117 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.119+0000 7f41dbe00640 1 -- 172.21.15.72:0/3303347547 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41c8041070 con 0x7f41dc15f9d0 2024-04-04T06:56:38.118 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.119+0000 7f41dbe00640 1 -- 172.21.15.72:0/3303347547 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41c8034cf0 con 0x7f41dc15f9d0 2024-04-04T06:56:38.118 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.119+0000 7f41dbe00640 1 -- 172.21.15.72:0/3303347547 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41c803c660 con 0x7f41dc15f9d0 2024-04-04T06:56:38.119 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.120+0000 7f41e4200640 1 -- 172.21.15.72:0/3303347547 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f41dc15f9d0 msgr2=0x7f41dc0cf7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:38.119 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.120+0000 7f41e4200640 1 --2- 172.21.15.72:0/3303347547 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f41dc15f9d0 0x7f41dc0cf7c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f41dc0c62d0 tx=0x7f41c8033f40 comp rx=0 tx=0).stop 2024-04-04T06:56:38.124 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.126+0000 7f11aba00640 1 Processor -- start 2024-04-04T06:56:38.125 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.125+0000 7f41e4200640 1 -- 172.21.15.72:0/3303347547 shutdown_connections 2024-04-04T06:56:38.125 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.125+0000 7f41e4200640 1 --2- 172.21.15.72:0/3303347547 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f41dc15f9d0 0x7f41dc0cf7c0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:38.125 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.125+0000 7f41e4200640 1 --2- 172.21.15.72:0/3303347547 >> v2:172.21.15.72:3300/0 conn(0x7f41dc15bfd0 0x7f41dc0c4ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:38.125 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.125+0000 7f41e4200640 1 -- 172.21.15.72:0/3303347547 >> 172.21.15.72:0/3303347547 conn(0x7f41dc071b50 msgr2=0x7f41dc072a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:56:38.126 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.126+0000 7f11aba00640 1 -- start start 2024-04-04T06:56:38.127 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.128+0000 7f11aba00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f11a40af3b0 0x7f11a415e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:38.127 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.128+0000 7f11aba00640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f11a40af790 0x7f11a40ca780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:38.127 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.128+0000 7f11aba00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f11a415b750 0x7f11a40c4ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:38.127 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.128+0000 7f11aba00640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f11a406d7e0 con 0x7f11a40af790 2024-04-04T06:56:38.127 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.128+0000 7f11aba00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f11a415e8a0 con 0x7f11a415b750 2024-04-04T06:56:38.127 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.128+0000 7f11aba00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f11a415eb80 con 0x7f11a40af3b0 2024-04-04T06:56:38.128 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.128+0000 7f41e4200640 1 -- 172.21.15.72:0/3303347547 shutdown_connections 2024-04-04T06:56:38.128 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.129+0000 7f6f65a00640 1 Processor -- start 2024-04-04T06:56:38.129 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.129+0000 7f6f65a00640 1 -- start start 2024-04-04T06:56:38.129 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.129+0000 7f11a9a00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f11a415b750 0x7f11a40c4ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:38.130 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.129+0000 7f11a9000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f11a40af3b0 0x7f11a415e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:38.130 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.129+0000 7f11a9000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f11a40af3b0 0x7f11a415e2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.72:40464/0 (socket says 172.21.15.72:40464) 2024-04-04T06:56:38.130 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.129+0000 7f11a9000640 1 -- 172.21.15.72:0/51628212 learned_addr learned my addr 172.21.15.72:0/51628212 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:56:38.130 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.130+0000 7f41e4200640 1 -- 172.21.15.72:0/3303347547 wait complete. 2024-04-04T06:56:38.131 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.130+0000 7f11a3e00640 1 --2- 172.21.15.72:0/51628212 >> v2:172.21.15.72:3300/0 conn(0x7f11a40af790 0x7f11a40ca780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:38.132 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.131+0000 7f6f65a00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6f580e30c0 0x7f6f58057d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:38.132 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.131+0000 7f6f65a00640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f580582d0 con 0x7f6f5803e840 2024-04-04T06:56:38.132 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.131+0000 7f6f65a00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f58058570 con 0x7f6f58054300 2024-04-04T06:56:38.132 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.131+0000 7f6f65a00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f6f58058850 con 0x7f6f580e30c0 2024-04-04T06:56:38.132 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.132+0000 7f6f5fe00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6f580e30c0 0x7f6f58057d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:38.133 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.130+0000 7f11a9000640 1 -- 172.21.15.72:0/51628212 >> v2:172.21.15.117:3300/0 conn(0x7f11a415b750 msgr2=0x7f11a40c4ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:56:38.133 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.132+0000 7f6f5fe00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6f580e30c0 0x7f6f58057d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.72:40472/0 (socket says 172.21.15.72:40472) 2024-04-04T06:56:38.133 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.132+0000 7f6f5fe00640 1 -- 172.21.15.72:0/3085503315 learned_addr learned my addr 172.21.15.72:0/3085503315 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:56:38.134 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.133+0000 7f11a9000640 1 --2- 172.21.15.72:0/51628212 >> v2:172.21.15.117:3300/0 conn(0x7f11a415b750 0x7f11a40c4ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:38.134 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.133+0000 7f11a9000640 1 -- 172.21.15.72:0/51628212 >> v2:172.21.15.72:3300/0 conn(0x7f11a40af790 msgr2=0x7f11a40ca780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:56:38.135 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.133+0000 7f41e4200640 1 Processor -- start 2024-04-04T06:56:38.135 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.134+0000 7f41e4200640 1 -- start start 2024-04-04T06:56:38.135 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.132+0000 7f6f5fe00640 1 -- 172.21.15.72:0/3085503315 >> v1:172.21.15.117:6789/0 conn(0x7f6f58054300 legacy=0x7f6f580068d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:56:38.136 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.133+0000 7f6f5fe00640 1 -- 172.21.15.72:0/3085503315 >> v1:172.21.15.72:6789/0 conn(0x7f6f5803e840 legacy=0x7f6f58053bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:38.136 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.134+0000 7f6f5fe00640 1 -- 172.21.15.72:0/3085503315 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f58058b30 con 0x7f6f580e30c0 2024-04-04T06:56:38.136 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.133+0000 7f6f5ea00640 1 -- 172.21.15.72:0/3085503315 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3193561181 0 0) 0x7f6f580582d0 con 0x7f6f5803e840 2024-04-04T06:56:38.136 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.133+0000 7f11a9000640 1 --2- 172.21.15.72:0/51628212 >> v2:172.21.15.72:3300/0 conn(0x7f11a40af790 0x7f11a40ca780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:38.137 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.133+0000 7f11a9000640 1 -- 172.21.15.72:0/51628212 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11a415ee60 con 0x7f11a40af3b0 2024-04-04T06:56:38.137 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.136+0000 7f6f5fe00640 1 --2- 172.21.15.72:0/3085503315 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6f580e30c0 0x7f6f58057d90 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f6f540098a0 tx=0x7f6f5402ba20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e2ac5732b673c6be server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:38.138 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.136+0000 7f41e4200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f41dc15bfd0 0x7f41dc1571d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:38.138 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.136+0000 7f6f5ea00640 1 -- 172.21.15.72:0/3085503315 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f5402f840 con 0x7f6f580e30c0 2024-04-04T06:56:38.138 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.136+0000 7f6f5ea00640 1 -- 172.21.15.72:0/3085503315 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f5402f9e0 con 0x7f6f580e30c0 2024-04-04T06:56:38.139 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.136+0000 7f6f5ea00640 1 -- 172.21.15.72:0/3085503315 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f5402fdb0 con 0x7f6f580e30c0 2024-04-04T06:56:38.140 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.136+0000 7f41e4200640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f41dc15c3b0 0x7f41dc1521a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:38.140 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.137+0000 7f41e4200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f41dc15f9d0 0x7f41dc0c76c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:38.140 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.137+0000 7f41e4200640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f41dc0cfe80 con 0x7f41dc15c3b0 2024-04-04T06:56:38.140 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.137+0000 7f41e4200640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f41dc0cfd00 con 0x7f41dc15f9d0 2024-04-04T06:56:38.141 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.138+0000 7f41e1800640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f41dc15bfd0 0x7f41dc1571d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:38.141 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.137+0000 7f6f65a00640 1 -- 172.21.15.72:0/3085503315 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6f580e30c0 msgr2=0x7f6f58057d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:38.142 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.138+0000 7f41e4200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f41dc0cd220 con 0x7f41dc15bfd0 2024-04-04T06:56:38.142 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.138+0000 7f41e0e00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f41dc15c3b0 0x7f41dc1521a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:38.142 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.138+0000 7f41e1800640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f41dc15bfd0 0x7f41dc1571d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.72:40476/0 (socket says 172.21.15.72:40476) 2024-04-04T06:56:38.142 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.138+0000 7f41e1800640 1 -- 172.21.15.72:0/2708941370 learned_addr learned my addr 172.21.15.72:0/2708941370 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:56:38.143 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.137+0000 7f6f65a00640 1 --2- 172.21.15.72:0/3085503315 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6f580e30c0 0x7f6f58057d90 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f6f540098a0 tx=0x7f6f5402ba20 comp rx=0 tx=0).stop 2024-04-04T06:56:38.143 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.138+0000 7f41e2200640 1 --2- 172.21.15.72:0/2708941370 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f41dc15f9d0 0x7f41dc0c76c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:38.144 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.138+0000 7f6f65a00640 1 -- 172.21.15.72:0/3085503315 shutdown_connections 2024-04-04T06:56:38.144 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.138+0000 7f6f65a00640 1 --2- 172.21.15.72:0/3085503315 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6f580e30c0 0x7f6f58057d90 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:38.144 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.138+0000 7f6f65a00640 1 -- 172.21.15.72:0/3085503315 >> 172.21.15.72:0/3085503315 conn(0x7f6f580559e0 msgr2=0x7f6f58055df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:56:38.145 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.139+0000 7f6f65a00640 1 -- 172.21.15.72:0/3085503315 shutdown_connections 2024-04-04T06:56:38.145 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.135+0000 7f11a3e00640 1 --2- 172.21.15.72:0/51628212 >> v2:172.21.15.72:3300/0 conn(0x7f11a40af790 0x7f11a40ca780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-04T06:56:38.145 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.135+0000 7f11a9a00640 1 --2- 172.21.15.72:0/51628212 >> v2:172.21.15.117:3300/0 conn(0x7f11a415b750 0x7f11a40c4ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-04T06:56:38.145 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.139+0000 7f11a9000640 1 --2- 172.21.15.72:0/51628212 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f11a40af3b0 0x7f11a415e2c0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f11a406cef0 tx=0x7f119c02be00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ef3d1b036c80610c server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:38.146 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.139+0000 7f6f65a00640 1 -- 172.21.15.72:0/3085503315 wait complete. 2024-04-04T06:56:38.147 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.139+0000 7f41e1800640 1 -- 172.21.15.72:0/2708941370 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f41dc15f9d0 msgr2=0x7f41dc0c76c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:38.147 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.139+0000 7f41e1800640 1 --2- 172.21.15.72:0/2708941370 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f41dc15f9d0 0x7f41dc0c76c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:38.147 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.139+0000 7f41e1800640 1 -- 172.21.15.72:0/2708941370 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f41dc15c3b0 msgr2=0x7f41dc1521a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:38.147 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.140+0000 7f41e2200640 1 --2- 172.21.15.72:0/2708941370 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f41dc15f9d0 0x7f41dc0c76c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-04T06:56:38.148 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.140+0000 7f11a3400640 1 -- 172.21.15.72:0/51628212 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f119c02c9a0 con 0x7f11a40af3b0 2024-04-04T06:56:38.148 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.140+0000 7f11a3400640 1 -- 172.21.15.72:0/51628212 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f119c02cb40 con 0x7f11a40af3b0 2024-04-04T06:56:38.148 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.140+0000 7f11a3400640 1 -- 172.21.15.72:0/51628212 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f119c0343f0 con 0x7f11a40af3b0 2024-04-04T06:56:38.148 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.141+0000 7f41e1800640 1 --2- 172.21.15.72:0/2708941370 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f41dc15c3b0 0x7f41dc1521a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:38.148 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.141+0000 7f41e1800640 1 -- 172.21.15.72:0/2708941370 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41dc0ad7b0 con 0x7f41dc15bfd0 2024-04-04T06:56:38.149 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.141+0000 7f11aba00640 1 -- 172.21.15.72:0/51628212 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f11a40af3b0 msgr2=0x7f11a415e2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:38.149 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.141+0000 7f11aba00640 1 --2- 172.21.15.72:0/51628212 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f11a40af3b0 0x7f11a415e2c0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f11a406cef0 tx=0x7f119c02be00 comp rx=0 tx=0).stop 2024-04-04T06:56:38.150 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.141+0000 7f41e0e00640 1 --2- 172.21.15.72:0/2708941370 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f41dc15c3b0 0x7f41dc1521a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-04T06:56:38.150 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.142+0000 7f11aba00640 1 -- 172.21.15.72:0/51628212 shutdown_connections 2024-04-04T06:56:38.151 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.142+0000 7f11aba00640 1 --2- 172.21.15.72:0/51628212 >> v2:172.21.15.117:3300/0 conn(0x7f11a415b750 0x7f11a40c4ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:38.151 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.142+0000 7f11aba00640 1 --2- 172.21.15.72:0/51628212 >> v2:172.21.15.72:3300/0 conn(0x7f11a40af790 0x7f11a40ca780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:38.151 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.142+0000 7f11aba00640 1 --2- 172.21.15.72:0/51628212 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f11a40af3b0 0x7f11a415e2c0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:38.151 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.142+0000 7f11aba00640 1 -- 172.21.15.72:0/51628212 >> 172.21.15.72:0/51628212 conn(0x7f11a4071b50 msgr2=0x7f11a4072a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:56:38.151 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.142+0000 7f11aba00640 1 -- 172.21.15.72:0/51628212 shutdown_connections 2024-04-04T06:56:38.152 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.142+0000 7f41e1800640 1 --2- 172.21.15.72:0/2708941370 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f41dc15bfd0 0x7f41dc1571d0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f41d000e840 tx=0x7f41d000ed00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:38.152 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.143+0000 7f6f65a00640 1 Processor -- start 2024-04-04T06:56:38.152 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.144+0000 7f6f65a00640 1 -- start start 2024-04-04T06:56:38.153 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.142+0000 7f11aba00640 1 -- 172.21.15.72:0/51628212 wait complete. 2024-04-04T06:56:38.153 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.145+0000 7f6f65a00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6f5803e840 0x7f6f580d7220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:38.154 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.145+0000 7f11aba00640 1 Processor -- start 2024-04-04T06:56:38.155 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.145+0000 7f6f65a00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6f58054300 0x7f6f580dfbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:38.155 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.145+0000 7f6f65a00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6f580e30c0 0x7f6f580e3620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:38.155 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.145+0000 7f6f65a00640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f6f580e34a0 con 0x7f6f58054300 2024-04-04T06:56:38.155 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.146+0000 7f11aba00640 1 -- start start 2024-04-04T06:56:38.156 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.145+0000 7f41d9600640 1 -- 172.21.15.72:0/2708941370 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41d0017070 con 0x7f41dc15bfd0 2024-04-04T06:56:38.156 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.145+0000 7f41d9600640 1 -- 172.21.15.72:0/2708941370 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41d000c8e0 con 0x7f41dc15bfd0 2024-04-04T06:56:38.157 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.145+0000 7f6f65a00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f6f5803bfc0 con 0x7f6f580e30c0 2024-04-04T06:56:38.157 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.145+0000 7f6f65a00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f6f58006fe0 con 0x7f6f5803e840 2024-04-04T06:56:38.157 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.146+0000 7f6f65000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6f580e30c0 0x7f6f580e3620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:38.158 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.146+0000 7f41e4200640 1 -- 172.21.15.72:0/2708941370 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41dc0ada90 con 0x7f41dc15bfd0 2024-04-04T06:56:38.158 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.146+0000 7f41e4200640 1 -- 172.21.15.72:0/2708941370 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f41dc0ae330 con 0x7f41dc15bfd0 2024-04-04T06:56:38.158 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.146+0000 7f41d9600640 1 -- 172.21.15.72:0/2708941370 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41d000ccb0 con 0x7f41dc15bfd0 2024-04-04T06:56:38.159 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.147+0000 7f6f65000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6f580e30c0 0x7f6f580e3620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.72:40204/0 (socket says 172.21.15.72:40204) 2024-04-04T06:56:38.160 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.147+0000 7f6f65000640 1 -- 172.21.15.72:0/1362287088 learned_addr learned my addr 172.21.15.72:0/1362287088 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:56:38.160 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.147+0000 7f6f5fe00640 1 --2- 172.21.15.72:0/1362287088 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6f5803e840 0x7f6f580d7220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:38.160 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.148+0000 7f6f5f400640 1 --2- 172.21.15.72:0/1362287088 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6f58054300 0x7f6f580dfbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:38.160 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.148+0000 7f41cea00640 1 -- 172.21.15.72:0/2708941370 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41b0005290 con 0x7f41dc15bfd0 2024-04-04T06:56:38.161 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.149+0000 7f6f5f400640 1 -- 172.21.15.72:0/1362287088 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6f5803e840 msgr2=0x7f6f580d7220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:38.161 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.149+0000 7f6f5f400640 1 --2- 172.21.15.72:0/1362287088 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6f5803e840 0x7f6f580d7220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:38.161 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.149+0000 7f6f5f400640 1 -- 172.21.15.72:0/1362287088 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6f580e30c0 msgr2=0x7f6f580e3620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:38.161 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.149+0000 7f6f5f400640 1 --2- 172.21.15.72:0/1362287088 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6f580e30c0 0x7f6f580e3620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:38.162 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.149+0000 7f6f5f400640 1 -- 172.21.15.72:0/1362287088 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f580e7190 con 0x7f6f58054300 2024-04-04T06:56:38.162 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.150+0000 7f6f5f400640 1 --2- 172.21.15.72:0/1362287088 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6f58054300 0x7f6f580dfbd0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f6f580584a0 tx=0x7f6f4c00cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:38.162 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.150+0000 7f6f53e00640 1 -- 172.21.15.72:0/1362287088 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f4c0050d0 con 0x7f6f58054300 2024-04-04T06:56:38.162 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.150+0000 7f6f53e00640 1 -- 172.21.15.72:0/1362287088 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f4c005270 con 0x7f6f58054300 2024-04-04T06:56:38.162 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.150+0000 7f6f53e00640 1 -- 172.21.15.72:0/1362287088 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f4c0050d0 con 0x7f6f58054300 2024-04-04T06:56:38.162 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.151+0000 7f6f65a00640 1 -- 172.21.15.72:0/1362287088 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f580e7470 con 0x7f6f58054300 2024-04-04T06:56:38.163 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.151+0000 7f6f65a00640 1 -- 172.21.15.72:0/1362287088 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f58051ce0 con 0x7f6f58054300 2024-04-04T06:56:38.163 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.151+0000 7f11aba00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f11a40af3b0 0x7f11a40ce030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:38.163 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.151+0000 7f11aba00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f11a40af790 0x7f11a4201a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:38.163 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.151+0000 7f11aba00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f11a415b750 0x7f11a41fadd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:38.164 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.153+0000 7f41d9600640 1 -- 172.21.15.72:0/2708941370 <== mon.2 v2:172.21.15.117:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f41d001a070 con 0x7f41dc15bfd0 2024-04-04T06:56:38.164 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.154+0000 7f41d9600640 1 --2- 172.21.15.72:0/2708941370 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f41bc06c9f0 0x7f41bc06eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:38.164 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.154+0000 7f41d9600640 1 -- 172.21.15.72:0/2708941370 <== mon.2 v2:172.21.15.117:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f41d008bc00 con 0x7f41dc15bfd0 2024-04-04T06:56:38.165 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.152+0000 7f11aba00640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f11a4073110 con 0x7f11a415b750 2024-04-04T06:56:38.165 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.152+0000 7f11aba00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f11a415f140 con 0x7f11a40af790 2024-04-04T06:56:38.166 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.152+0000 7f11aba00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f11a4073290 con 0x7f11a40af3b0 2024-04-04T06:56:38.166 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.152+0000 7f11a9a00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f11a415b750 0x7f11a41fadd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:38.166 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.152+0000 7f11a3e00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f11a40af790 0x7f11a4201a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:38.166 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.152+0000 7f11a9a00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f11a415b750 0x7f11a41fadd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46392/0 (socket says 172.21.15.72:46392) 2024-04-04T06:56:38.166 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.152+0000 7f11a9a00640 1 -- 172.21.15.72:0/2138847719 learned_addr learned my addr 172.21.15.72:0/2138847719 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:56:38.166 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.154+0000 7f11a9a00640 1 -- 172.21.15.72:0/2138847719 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f11a40af3b0 msgr2=0x7f11a40ce030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:38.167 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.154+0000 7f11a9a00640 1 --2- 172.21.15.72:0/2138847719 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f11a40af3b0 0x7f11a40ce030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:38.167 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.154+0000 7f11a9a00640 1 -- 172.21.15.72:0/2138847719 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f11a40af790 msgr2=0x7f11a4201a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:38.167 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.154+0000 7f11a9a00640 1 --2- 172.21.15.72:0/2138847719 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f11a40af790 0x7f11a4201a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:38.167 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.154+0000 7f11a9a00640 1 -- 172.21.15.72:0/2138847719 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11a4201fa0 con 0x7f11a415b750 2024-04-04T06:56:38.168 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.155+0000 7f41e0e00640 1 --2- 172.21.15.72:0/2708941370 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f41bc06c9f0 0x7f41bc06eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:38.168 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.156+0000 7f41e0e00640 1 --2- 172.21.15.72:0/2708941370 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f41bc06c9f0 0x7f41bc06eeb0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f41c803e000 tx=0x7f41c8038000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:38.168 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.157+0000 7f6f65a00640 1 -- 172.21.15.72:0/1362287088 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f58007bc0 con 0x7f6f58054300 2024-04-04T06:56:38.169 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.156+0000 7f11a9a00640 1 --2- 172.21.15.72:0/2138847719 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f11a415b750 0x7f11a41fadd0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f119400e880 tx=0x7f119400ed40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:38.169 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.158+0000 7f6f53e00640 1 -- 172.21.15.72:0/1362287088 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6f4c00a640 con 0x7f6f58054300 2024-04-04T06:56:38.169 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.158+0000 7f11a0c00640 1 -- 172.21.15.72:0/2138847719 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1194017070 con 0x7f11a415b750 2024-04-04T06:56:38.170 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.159+0000 7f6f53e00640 1 --2- 172.21.15.72:0/1362287088 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f6f4006caf0 0x7f6f4006efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:38.170 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.159+0000 7f11a0c00640 1 -- 172.21.15.72:0/2138847719 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1194004020 con 0x7f11a415b750 2024-04-04T06:56:38.170 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.159+0000 7f11a0c00640 1 -- 172.21.15.72:0/2138847719 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11940043f0 con 0x7f11a415b750 2024-04-04T06:56:38.170 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.160+0000 7f11aba00640 1 -- 172.21.15.72:0/2138847719 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11a40ce630 con 0x7f11a415b750 2024-04-04T06:56:38.171 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.160+0000 7f6f53e00640 1 -- 172.21.15.72:0/1362287088 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f6f4c08b2e0 con 0x7f6f58054300 2024-04-04T06:56:38.171 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.160+0000 7f6f5fe00640 1 --2- 172.21.15.72:0/1362287088 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f6f4006caf0 0x7f6f4006efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:38.171 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.161+0000 7f6f5fe00640 1 --2- 172.21.15.72:0/1362287088 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f6f4006caf0 0x7f6f4006efb0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f6f54036000 tx=0x7f6f54008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:38.171 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.164+0000 7f11aba00640 1 -- 172.21.15.72:0/2138847719 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11a40cebf0 con 0x7f11a415b750 2024-04-04T06:56:38.171 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.166+0000 7f11aba00640 1 -- 172.21.15.72:0/2138847719 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f11a4075840 con 0x7f11a415b750 2024-04-04T06:56:38.172 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.161+0000 7fcf25200640 1 Processor -- start 2024-04-04T06:56:38.172 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.161+0000 7fcf25200640 1 -- start start 2024-04-04T06:56:38.172 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.163+0000 7fcf25200640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fcf200d3bb0 0x7fcf200b7f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:38.172 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.163+0000 7fcf25200640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcf200d3fc0 con 0x7fcf20162c00 2024-04-04T06:56:38.172 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.163+0000 7fcf25200640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcf200cf350 con 0x7fcf200d4710 2024-04-04T06:56:38.172 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.163+0000 7fcf25200640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7fcf200d2e80 con 0x7fcf200d3bb0 2024-04-04T06:56:38.173 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.164+0000 7fcf1f400640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7fcf200d4710 0x7fcf200d4af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.72:58820/0 (socket says 172.21.15.72:58820) 2024-04-04T06:56:38.173 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.164+0000 7fcf1f400640 1 -- 172.21.15.72:0/1785807332 learned_addr learned my addr 172.21.15.72:0/1785807332 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-04-04T06:56:38.173 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.165+0000 7fcf1fe00640 1 --2- 172.21.15.72:0/1785807332 >> v2:172.21.15.72:3300/0 conn(0x7fcf200d3bb0 0x7fcf200b7f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:38.173 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.166+0000 7fcf1e000640 1 -- 172.21.15.72:0/1785807332 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1944251410 0 0) 0x7fcf200cf350 con 0x7fcf200d4710 2024-04-04T06:56:38.173 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.166+0000 7fcf1e000640 1 -- 172.21.15.72:0/1785807332 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcf04003520 con 0x7fcf200d4710 2024-04-04T06:56:38.173 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.167+0000 7fcf1e000640 1 -- 172.21.15.72:0/1785807332 <== mon.1 v1:172.21.15.117:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3632397006 0 0) 0x7fcf04003520 con 0x7fcf200d4710 2024-04-04T06:56:38.173 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.167+0000 7fcf1e000640 1 -- 172.21.15.72:0/1785807332 >> v2:172.21.15.72:3300/0 conn(0x7fcf200d3bb0 msgr2=0x7fcf200b7f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:56:38.173 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.167+0000 7fcf1e000640 1 --2- 172.21.15.72:0/1785807332 >> v2:172.21.15.72:3300/0 conn(0x7fcf200d3bb0 0x7fcf200b7f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:38.173 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.167+0000 7fcf1e000640 1 -- 172.21.15.72:0/1785807332 >> v1:172.21.15.72:6789/0 conn(0x7fcf20162c00 legacy=0x7fcf200ce8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:56:38.173 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.167+0000 7fcf1e000640 1 -- 172.21.15.72:0/1785807332 --> v1:172.21.15.117:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf200d30d0 con 0x7fcf200d4710 2024-04-04T06:56:38.173 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.167+0000 7fcf1e000640 1 -- 172.21.15.72:0/1785807332 <== mon.1 v1:172.21.15.117:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2465650867 0 0) 0x7fcf100019f0 con 0x7fcf200d4710 2024-04-04T06:56:38.173 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.167+0000 7fcf1e000640 1 -- 172.21.15.72:0/1785807332 >> v1:172.21.15.117:6789/0 conn(0x7fcf200d4710 legacy=0x7fcf200d4af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:38.173 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.167+0000 7fcf1e000640 1 --2- 172.21.15.72:0/1785807332 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcf040039b0 0x7fcf04003db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:38.173 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.167+0000 7fcf1e000640 1 --2- 172.21.15.72:0/1785807332 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcf04004800 0x7fcf04004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:38.173 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.167+0000 7fcf1e000640 1 --2- 172.21.15.72:0/1785807332 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcf040052e0 0x7fcf0402d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:38.173 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.167+0000 7fcf1e000640 1 -- 172.21.15.72:0/1785807332 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fcf200d2e80 con 0x7fcf040052e0 2024-04-04T06:56:38.174 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.167+0000 7fcf1e000640 1 -- 172.21.15.72:0/1785807332 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fcf0402e240 con 0x7fcf04004800 2024-04-04T06:56:38.174 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.167+0000 7fcf1e000640 1 -- 172.21.15.72:0/1785807332 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fcf0402e440 con 0x7fcf040039b0 2024-04-04T06:56:38.174 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.168+0000 7fcf1f400640 1 --2- 172.21.15.72:0/1785807332 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcf040039b0 0x7fcf04003db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:38.174 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.169+0000 7fcf1ea00640 1 --2- 172.21.15.72:0/1785807332 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcf04004800 0x7fcf04004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:38.174 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.169+0000 7fcf1fe00640 1 --2- 172.21.15.72:0/1785807332 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcf040052e0 0x7fcf0402d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:38.174 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.170+0000 7fcf1f400640 1 -- 172.21.15.72:0/1785807332 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcf04004800 msgr2=0x7fcf04004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:56:38.174 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.170+0000 7fcf1f400640 1 --2- 172.21.15.72:0/1785807332 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcf04004800 0x7fcf04004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:38.174 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.170+0000 7fcf1f400640 1 -- 172.21.15.72:0/1785807332 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcf040052e0 msgr2=0x7fcf0402d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:56:38.174 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.170+0000 7f41d9600640 1 -- 172.21.15.72:0/2708941370 <== mon.2 v2:172.21.15.117:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f41d0059a50 con 0x7f41dc15bfd0 2024-04-04T06:56:38.175 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.170+0000 7fcf1f400640 1 --2- 172.21.15.72:0/1785807332 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcf040052e0 0x7fcf0402d9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:38.175 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.170+0000 7fcf1f400640 1 -- 172.21.15.72:0/1785807332 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf200d30d0 con 0x7fcf040039b0 2024-04-04T06:56:38.175 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.170+0000 7fcf1fe00640 1 --2- 172.21.15.72:0/1785807332 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcf040052e0 0x7fcf0402d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-04T06:56:38.175 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.170+0000 7fcf1fe00640 1 -- 172.21.15.72:0/1785807332 reap_dead start 2024-04-04T06:56:38.176 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.174+0000 7f11a0c00640 1 -- 172.21.15.72:0/2138847719 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f119400c940 con 0x7f11a415b750 2024-04-04T06:56:38.176 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.176+0000 7f11a0c00640 1 --2- 172.21.15.72:0/2138847719 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f118406c9f0 0x7f118406eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:38.176 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.176+0000 7fcf1f400640 1 --2- 172.21.15.72:0/1785807332 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcf040039b0 0x7fcf04003db0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fcf1000a8c0 tx=0x7fcf04005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=be27036cee0a118 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:38.176 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.176+0000 7f11a0c00640 1 -- 172.21.15.72:0/2138847719 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f119408c100 con 0x7f11a415b750 2024-04-04T06:56:38.176 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.176+0000 7fcf1e000640 1 -- 172.21.15.72:0/1785807332 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf1000a4c0 con 0x7fcf040039b0 2024-04-04T06:56:38.177 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.176+0000 7f11a9000640 1 --2- 172.21.15.72:0/2138847719 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f118406c9f0 0x7f118406eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:38.177 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.177+0000 7fcf1e000640 1 -- 172.21.15.72:0/1785807332 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf10034650 con 0x7fcf040039b0 2024-04-04T06:56:38.177 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.178+0000 7fcf25200640 1 -- 172.21.15.72:0/1785807332 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcf040039b0 msgr2=0x7fcf04003db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:38.177 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.178+0000 7fcf25200640 1 --2- 172.21.15.72:0/1785807332 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcf040039b0 0x7fcf04003db0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fcf1000a8c0 tx=0x7fcf04005830 comp rx=0 tx=0).stop 2024-04-04T06:56:38.177 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.178+0000 7f11a9000640 1 --2- 172.21.15.72:0/2138847719 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f118406c9f0 0x7f118406eeb0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f119c035000 tx=0x7f119c02e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:38.179 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.178+0000 7fcf25200640 1 -- 172.21.15.72:0/1785807332 shutdown_connections 2024-04-04T06:56:38.179 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.178+0000 7fcf25200640 1 --2- 172.21.15.72:0/1785807332 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcf040039b0 0x7fcf04003db0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:38.179 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.178+0000 7fcf25200640 1 -- 172.21.15.72:0/1785807332 >> 172.21.15.72:0/1785807332 conn(0x7fcf2006b860 msgr2=0x7fcf2006bc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:56:38.179 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.179+0000 7fcf25200640 1 -- 172.21.15.72:0/1785807332 shutdown_connections 2024-04-04T06:56:38.179 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.179+0000 7fcf25200640 1 -- 172.21.15.72:0/1785807332 wait complete. 2024-04-04T06:56:38.180 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.181+0000 7fcf25200640 1 Processor -- start 2024-04-04T06:56:38.180 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.181+0000 7fcf25200640 1 -- start start 2024-04-04T06:56:38.181 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.181+0000 7f6f53e00640 1 -- 172.21.15.72:0/1362287088 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f6f58007bc0 con 0x7f6f58054300 2024-04-04T06:56:38.181 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.183+0000 7fcf25200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcf040039b0 0x7fcf20150d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:38.182 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.183+0000 7fcf25200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcf20157b90 0x7fcf20154040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:38.182 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.183+0000 7fcf25200640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcf200cc4e0 0x7fcf200cc960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:38.183 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.183+0000 7fcf25200640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fcf200d29d0 con 0x7fcf200cc4e0 2024-04-04T06:56:38.183 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.183+0000 7fcf25200640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fcf200d3690 con 0x7fcf040039b0 2024-04-04T06:56:38.183 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.183+0000 7fcf25200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fcf200d4af0 con 0x7fcf20157b90 2024-04-04T06:56:38.184 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.183+0000 7fcf1f400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcf040039b0 0x7fcf20150d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:38.184 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.183+0000 7fcf1f400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcf040039b0 0x7fcf20150d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.72:40222/0 (socket says 172.21.15.72:40222) 2024-04-04T06:56:38.184 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.183+0000 7fcf1f400640 1 -- 172.21.15.72:0/1446684082 learned_addr learned my addr 172.21.15.72:0/1446684082 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:56:38.184 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.184+0000 7fcf1fe00640 1 --2- 172.21.15.72:0/1446684082 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcf200cc4e0 0x7fcf200cc960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:38.184 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.184+0000 7fcf1f400640 1 -- 172.21.15.72:0/1446684082 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcf20157b90 msgr2=0x7fcf20154040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:38.184 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.184+0000 7fcf1f400640 1 --2- 172.21.15.72:0/1446684082 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcf20157b90 0x7fcf20154040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:38.184 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.184+0000 7fcf1f400640 1 -- 172.21.15.72:0/1446684082 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcf200cc4e0 msgr2=0x7fcf200cc960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:38.184 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.184+0000 7fcf1f400640 1 --2- 172.21.15.72:0/1446684082 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcf200cc4e0 0x7fcf200cc960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:38.184 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.184+0000 7fcf1f400640 1 -- 172.21.15.72:0/1446684082 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf20153840 con 0x7fcf040039b0 2024-04-04T06:56:38.184 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.185+0000 7fcf1f400640 1 --2- 172.21.15.72:0/1446684082 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcf040039b0 0x7fcf20150d50 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fcf1000a9b0 tx=0x7fcf10001cf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:38.184 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.185+0000 7fcf17400640 1 -- 172.21.15.72:0/1446684082 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf10042020 con 0x7fcf040039b0 2024-04-04T06:56:38.185 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.185+0000 7fcf25200640 1 -- 172.21.15.72:0/1446684082 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf200cba00 con 0x7fcf040039b0 2024-04-04T06:56:38.185 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.185+0000 7fcf25200640 1 -- 172.21.15.72:0/1446684082 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf20158010 con 0x7fcf040039b0 2024-04-04T06:56:38.185 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.187+0000 7f11a0c00640 1 -- 172.21.15.72:0/2138847719 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f11a4201fa0 con 0x7f11a415b750 2024-04-04T06:56:38.186 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.187+0000 7fcf25200640 1 -- 172.21.15.72:0/1446684082 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf200685a0 con 0x7fcf040039b0 2024-04-04T06:56:38.186 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.187+0000 7fcf17400640 1 -- 172.21.15.72:0/1446684082 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf1000a580 con 0x7fcf040039b0 2024-04-04T06:56:38.186 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.187+0000 7fcf17400640 1 -- 172.21.15.72:0/1446684082 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf10039040 con 0x7fcf040039b0 2024-04-04T06:56:38.191 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.190+0000 7fcf17400640 1 -- 172.21.15.72:0/1446684082 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fcf10045020 con 0x7fcf040039b0 2024-04-04T06:56:38.191 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.192+0000 7fcf17400640 1 --2- 172.21.15.72:0/1446684082 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fcf0006c920 0x7fcf0006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:38.191 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.192+0000 7fcf17400640 1 -- 172.21.15.72:0/1446684082 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fcf100ae1b0 con 0x7fcf040039b0 2024-04-04T06:56:38.191 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.193+0000 7fcf1ea00640 1 --2- 172.21.15.72:0/1446684082 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fcf0006c920 0x7fcf0006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:38.193 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.194+0000 7fcf1ea00640 1 --2- 172.21.15.72:0/1446684082 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fcf0006c920 0x7fcf0006ede0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fcf200b5cb0 tx=0x7fcf0c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:38.206 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.208+0000 7fcf17400640 1 -- 172.21.15.72:0/1446684082 <== mon.1 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fcf1004c070 con 0x7fcf040039b0 2024-04-04T06:56:38.206 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.208+0000 7f0025a00640 1 Processor -- start 2024-04-04T06:56:38.211 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.208+0000 7f0025a00640 1 -- start start 2024-04-04T06:56:38.211 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.210+0000 7f0025a00640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f002015a5a0 0x7f002006e570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:38.211 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.210+0000 7f0025a00640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f002015a980 con 0x7f00200b4360 2024-04-04T06:56:38.211 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.210+0000 7f0025a00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f002015efe0 con 0x7f002015eae0 2024-04-04T06:56:38.211 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.210+0000 7f0025a00640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f002006d7b0 con 0x7f002015a5a0 2024-04-04T06:56:38.211 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.210+0000 7f001f400640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f002015eae0 0x7f00200b3c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.72:58824/0 (socket says 172.21.15.72:58824) 2024-04-04T06:56:38.212 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.211+0000 7f001f400640 1 -- 172.21.15.72:0/1188309191 learned_addr learned my addr 172.21.15.72:0/1188309191 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-04-04T06:56:38.212 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.211+0000 7f001fe00640 1 --2- 172.21.15.72:0/1188309191 >> v2:172.21.15.72:3300/0 conn(0x7f002015a5a0 0x7f002006e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:38.212 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.211+0000 7f001ea00640 1 -- 172.21.15.72:0/1188309191 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 980915713 0 0) 0x7f002015efe0 con 0x7f002015eae0 2024-04-04T06:56:38.212 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.211+0000 7f001ea00640 1 -- 172.21.15.72:0/1188309191 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0004003520 con 0x7f002015eae0 2024-04-04T06:56:38.212 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.212+0000 7f001fe00640 1 -- 172.21.15.72:0/1188309191 >> v1:172.21.15.117:6789/0 conn(0x7f002015eae0 legacy=0x7f00200b3c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:38.212 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.212+0000 7f001fe00640 1 -- 172.21.15.72:0/1188309191 >> v1:172.21.15.72:6789/0 conn(0x7f00200b4360 legacy=0x7f00200cc9b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-04T06:56:38.212 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.212+0000 7f001fe00640 1 -- 172.21.15.72:0/1188309191 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f002006da90 con 0x7f002015a5a0 2024-04-04T06:56:38.212 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.214+0000 7f001fe00640 1 --2- 172.21.15.72:0/1188309191 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f002015a5a0 0x7f002006e570 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f00100097a0 tx=0x7f001002b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=444f0ce2b272eda3 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:38.213 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.214+0000 7f001ea00640 1 -- 172.21.15.72:0/1188309191 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0010034070 con 0x7f002015a5a0 2024-04-04T06:56:38.213 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.215+0000 7f001ea00640 1 -- 172.21.15.72:0/1188309191 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0010030610 con 0x7f002015a5a0 2024-04-04T06:56:38.216 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.215+0000 7f001ea00640 1 -- 172.21.15.72:0/1188309191 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0010034070 con 0x7f002015a5a0 2024-04-04T06:56:38.216 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.216+0000 7f0025a00640 1 -- 172.21.15.72:0/1188309191 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f002015a5a0 msgr2=0x7f002006e570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:38.216 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.216+0000 7f0025a00640 1 --2- 172.21.15.72:0/1188309191 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f002015a5a0 0x7f002006e570 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f00100097a0 tx=0x7f001002b960 comp rx=0 tx=0).stop 2024-04-04T06:56:38.216 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.218+0000 7f0025a00640 1 -- 172.21.15.72:0/1188309191 shutdown_connections 2024-04-04T06:56:38.216 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.218+0000 7f0025a00640 1 --2- 172.21.15.72:0/1188309191 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f002015a5a0 0x7f002006e570 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:38.216 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.218+0000 7f0025a00640 1 -- 172.21.15.72:0/1188309191 >> 172.21.15.72:0/1188309191 conn(0x7f00200cfc90 msgr2=0x7f00200d00a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:56:38.219 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.221+0000 7f0025a00640 1 -- 172.21.15.72:0/1188309191 shutdown_connections 2024-04-04T06:56:38.220 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.221+0000 7f0025a00640 1 -- 172.21.15.72:0/1188309191 wait complete. 2024-04-04T06:56:38.223 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.225+0000 7f0025a00640 1 Processor -- start 2024-04-04T06:56:38.225 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.227+0000 7fe213400640 1 Processor -- start 2024-04-04T06:56:38.225 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.227+0000 7fe213400640 1 -- start start 2024-04-04T06:56:38.226 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.225+0000 7f0025a00640 1 -- start start 2024-04-04T06:56:38.226 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.227+0000 7f0025a00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f00200b4360 0x7f0020154760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:38.226 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.227+0000 7f0025a00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f002015a5a0 0x7f0020156e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:38.226 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.227+0000 7f0025a00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f002015eae0 0x7f00200aee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:38.226 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.227+0000 7f0025a00640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f0020073080 con 0x7f002015eae0 2024-04-04T06:56:38.226 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.227+0000 7f0025a00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f002006e050 con 0x7f002015a5a0 2024-04-04T06:56:38.226 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.227+0000 7f0025a00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f0020073200 con 0x7f00200b4360 2024-04-04T06:56:38.227 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.228+0000 7f0025000640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f002015eae0 0x7f00200aee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:38.227 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.228+0000 7f0025000640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f002015eae0 0x7f00200aee50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46444/0 (socket says 172.21.15.72:46444) 2024-04-04T06:56:38.227 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.228+0000 7f001fe00640 1 --2- 172.21.15.72:0/1335012491 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f00200b4360 0x7f0020154760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:38.227 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.228+0000 7f0025000640 1 -- 172.21.15.72:0/1335012491 learned_addr learned my addr 172.21.15.72:0/1335012491 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:56:38.227 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.228+0000 7f001f400640 1 --2- 172.21.15.72:0/1335012491 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f002015a5a0 0x7f0020156e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:38.228 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.229+0000 7fe213400640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fe20c15f9d0 0x7fe20c0cf7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:38.228 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.229+0000 7fe213400640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe20c0af4a0 con 0x7fe20c15bfd0 2024-04-04T06:56:38.228 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.229+0000 7fe213400640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe20c0af780 con 0x7fe20c15c3b0 2024-04-04T06:56:38.228 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.229+0000 7fe213400640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fe20c0732b0 con 0x7fe20c15f9d0 2024-04-04T06:56:38.229 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.230+0000 7fe210a00640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fe20c15bfd0 0x7fe20c0c4ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:52768/0 (socket says 172.21.15.72:52768) 2024-04-04T06:56:38.229 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.230+0000 7f001fe00640 1 -- 172.21.15.72:0/1335012491 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f002015a5a0 msgr2=0x7f0020156e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:38.229 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.230+0000 7f001fe00640 1 --2- 172.21.15.72:0/1335012491 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f002015a5a0 0x7f0020156e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:38.229 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.230+0000 7f001fe00640 1 -- 172.21.15.72:0/1335012491 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f002015eae0 msgr2=0x7f00200aee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:38.229 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.230+0000 7f001fe00640 1 --2- 172.21.15.72:0/1335012491 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f002015eae0 0x7f00200aee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:38.229 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.230+0000 7f001fe00640 1 -- 172.21.15.72:0/1335012491 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0020155ae0 con 0x7f00200b4360 2024-04-04T06:56:38.230 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.230+0000 7fe210a00640 1 -- 172.21.15.72:0/3051392491 learned_addr learned my addr 172.21.15.72:0/3051392491 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-04-04T06:56:38.230 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.230+0000 7fe20b400640 1 -- 172.21.15.72:0/3051392491 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1111166504 0 0) 0x7fe20c0af4a0 con 0x7fe20c15bfd0 2024-04-04T06:56:38.230 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.231+0000 7fe20b400640 1 -- 172.21.15.72:0/3051392491 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe1f0003520 con 0x7fe20c15bfd0 2024-04-04T06:56:38.230 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.231+0000 7fe20be00640 1 --2- 172.21.15.72:0/3051392491 >> v2:172.21.15.117:3300/0 conn(0x7fe20c15f9d0 0x7fe20c0cf7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:38.230 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.231+0000 7fe20b400640 1 -- 172.21.15.72:0/3051392491 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1944586583 0 0) 0x7fe1f0003520 con 0x7fe20c15bfd0 2024-04-04T06:56:38.230 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.231+0000 7fe20b400640 1 -- 172.21.15.72:0/3051392491 >> v2:172.21.15.117:3300/0 conn(0x7fe20c15f9d0 msgr2=0x7fe20c0cf7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:56:38.231 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.231+0000 7f001fe00640 1 --2- 172.21.15.72:0/1335012491 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f00200b4360 0x7f0020154760 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f0010033000 tx=0x7f00100046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:38.231 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.231+0000 7fe20b400640 1 --2- 172.21.15.72:0/3051392491 >> v2:172.21.15.117:3300/0 conn(0x7fe20c15f9d0 0x7fe20c0cf7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:38.231 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.231+0000 7fe20b400640 1 -- 172.21.15.72:0/3051392491 >> v1:172.21.15.117:6789/0 conn(0x7fe20c15c3b0 legacy=0x7fe20c0ccb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:38.231 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.231+0000 7fe20b400640 1 -- 172.21.15.72:0/3051392491 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe20c073590 con 0x7fe20c15bfd0 2024-04-04T06:56:38.232 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.232+0000 7f0017e00640 1 -- 172.21.15.72:0/1335012491 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0010047070 con 0x7f00200b4360 2024-04-04T06:56:38.232 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.232+0000 7fe20b400640 1 -- 172.21.15.72:0/3051392491 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2465650867 0 0) 0x7fe2040019f0 con 0x7fe20c15bfd0 2024-04-04T06:56:38.232 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.232+0000 7fe20b400640 1 -- 172.21.15.72:0/3051392491 >> v1:172.21.15.72:6789/0 conn(0x7fe20c15bfd0 legacy=0x7fe20c0c4ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:38.232 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.232+0000 7fe20b400640 1 --2- 172.21.15.72:0/3051392491 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe1f00039b0 0x7fe1f0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:38.232 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.232+0000 7fe20b400640 1 --2- 172.21.15.72:0/3051392491 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe1f0004800 0x7fe1f0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:38.233 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.232+0000 7f0017e00640 1 -- 172.21.15.72:0/1335012491 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0010030410 con 0x7f00200b4360 2024-04-04T06:56:38.233 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.232+0000 7f0017e00640 1 -- 172.21.15.72:0/1335012491 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0010047070 con 0x7f00200b4360 2024-04-04T06:56:38.233 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.232+0000 7fe20b400640 1 --2- 172.21.15.72:0/3051392491 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe1f00053a0 0x7fe1f000ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:38.233 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.232+0000 7fe20b400640 1 -- 172.21.15.72:0/3051392491 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fe20c0732b0 con 0x7fe1f00053a0 2024-04-04T06:56:38.234 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.232+0000 7fe20b400640 1 -- 172.21.15.72:0/3051392491 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fe1f0014af0 con 0x7fe1f0004800 2024-04-04T06:56:38.234 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.232+0000 7fe20b400640 1 -- 172.21.15.72:0/3051392491 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fe1f0014cf0 con 0x7fe1f00039b0 2024-04-04T06:56:38.234 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.232+0000 7fe210a00640 1 --2- 172.21.15.72:0/3051392491 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe1f00039b0 0x7fe1f0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:38.234 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.233+0000 7f0025a00640 1 -- 172.21.15.72:0/1335012491 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0020155dc0 con 0x7f00200b4360 2024-04-04T06:56:38.234 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.232+0000 7fe211400640 1 --2- 172.21.15.72:0/3051392491 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe1f00053a0 0x7fe1f000ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:38.234 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.234+0000 7fe20be00640 1 --2- 172.21.15.72:0/3051392491 >> v2:172.21.15.117:3300/0 conn(0x7fe20c15f9d0 0x7fe20c0cf7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-04T06:56:38.235 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.234+0000 7f0025a00640 1 -- 172.21.15.72:0/1335012491 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f0020156380 con 0x7f00200b4360 2024-04-04T06:56:38.236 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.234+0000 7fe211400640 1 -- 172.21.15.72:0/3051392491 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe1f00039b0 msgr2=0x7fe1f0003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:56:38.236 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.234+0000 7fe211400640 1 --2- 172.21.15.72:0/3051392491 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe1f00039b0 0x7fe1f0003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:38.236 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.234+0000 7fe211400640 1 -- 172.21.15.72:0/3051392491 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe1f0004800 msgr2=0x7fe1f0004c80 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-04T06:56:38.236 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.234+0000 7fe211400640 1 --2- 172.21.15.72:0/3051392491 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe1f0004800 0x7fe1f0004c80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:38.236 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.234+0000 7fe211400640 1 -- 172.21.15.72:0/3051392491 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1f0003520 con 0x7fe1f00053a0 2024-04-04T06:56:38.236 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.236+0000 7fe211400640 1 --2- 172.21.15.72:0/3051392491 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe1f00053a0 0x7fe1f000ba00 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fe1f8001860 tx=0x7fe1f0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb70d50f6ba85908 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:38.236 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.236+0000 7fe211400640 1 -- 172.21.15.72:0/3051392491 reap_dead start 2024-04-04T06:56:38.236 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.237+0000 7fe20b400640 1 -- 172.21.15.72:0/3051392491 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1f8001430 con 0x7fe1f00053a0 2024-04-04T06:56:38.236 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.237+0000 7fe20b400640 1 -- 172.21.15.72:0/3051392491 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1f80052d0 con 0x7fe1f00053a0 2024-04-04T06:56:38.237 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.238+0000 7fe213400640 1 -- 172.21.15.72:0/3051392491 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe1f00053a0 msgr2=0x7fe1f000ba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:38.237 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.239+0000 7f0017e00640 1 -- 172.21.15.72:0/1335012491 <== mon.2 v2:172.21.15.117:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0010037070 con 0x7f00200b4360 2024-04-04T06:56:38.237 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.238+0000 7fe213400640 1 --2- 172.21.15.72:0/3051392491 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe1f00053a0 0x7fe1f000ba00 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fe1f8001860 tx=0x7fe1f0005830 comp rx=0 tx=0).stop 2024-04-04T06:56:38.239 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.240+0000 7fe213400640 1 -- 172.21.15.72:0/3051392491 shutdown_connections 2024-04-04T06:56:38.239 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.240+0000 7fe213400640 1 --2- 172.21.15.72:0/3051392491 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe1f00053a0 0x7fe1f000ba00 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:38.239 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.240+0000 7fe213400640 1 -- 172.21.15.72:0/3051392491 >> 172.21.15.72:0/3051392491 conn(0x7fe20c071b50 msgr2=0x7fe20c072a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:56:38.242 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.243+0000 7f0017e00640 1 --2- 172.21.15.72:0/1335012491 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f000006caf0 0x7f000006efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:38.242 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.243+0000 7f0015600640 1 -- 172.21.15.72:0/1335012491 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efff4005290 con 0x7f00200b4360 2024-04-04T06:56:38.242 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.244+0000 7f0017e00640 1 -- 172.21.15.72:0/1335012491 <== mon.2 v2:172.21.15.117:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f00100ad1f0 con 0x7f00200b4360 2024-04-04T06:56:38.243 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.244+0000 7f001f400640 1 --2- 172.21.15.72:0/1335012491 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f000006caf0 0x7f000006efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:38.243 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.244+0000 7fe213400640 1 -- 172.21.15.72:0/3051392491 shutdown_connections 2024-04-04T06:56:38.243 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.244+0000 7fe213400640 1 -- 172.21.15.72:0/3051392491 wait complete. 2024-04-04T06:56:38.246 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.248+0000 7f001f400640 1 --2- 172.21.15.72:0/1335012491 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f000006caf0 0x7f000006efb0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f00200ac820 tx=0x7f000c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:38.247 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.247+0000 7fe213400640 1 Processor -- start 2024-04-04T06:56:38.247 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.249+0000 7fe213400640 1 -- start start 2024-04-04T06:56:38.249 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.251+0000 7fe213400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe1f00053a0 0x7fe20c157bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:38.250 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.251+0000 7fe210a00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe1f00053a0 0x7fe20c157bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:38.250 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.252+0000 7fe210a00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe1f00053a0 0x7fe20c157bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46460/0 (socket says 172.21.15.72:46460) 2024-04-04T06:56:38.250 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.252+0000 7fe210a00640 1 -- 172.21.15.72:0/2134387187 learned_addr learned my addr 172.21.15.72:0/2134387187 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:56:38.250 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.252+0000 7fe213400640 1 --2- 172.21.15.72:0/2134387187 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe20c06f0b0 0x7fe20c1484c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:38.251 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.252+0000 7fe213400640 1 --2- 172.21.15.72:0/2134387187 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe20c0af9c0 0x7fe20c0afe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:38.251 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.253+0000 7fe20be00640 1 --2- 172.21.15.72:0/2134387187 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe20c06f0b0 0x7fe20c1484c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:38.251 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.253+0000 7fe213400640 1 -- 172.21.15.72:0/2134387187 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fe20c0c5380 con 0x7fe1f00053a0 2024-04-04T06:56:38.252 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.253+0000 7fe211400640 1 --2- 172.21.15.72:0/2134387187 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe20c0af9c0 0x7fe20c0afe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:38.252 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.253+0000 7fe213400640 1 -- 172.21.15.72:0/2134387187 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fe20c0c5200 con 0x7fe20c0af9c0 2024-04-04T06:56:38.252 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.254+0000 7fe213400640 1 -- 172.21.15.72:0/2134387187 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fe20c0c5500 con 0x7fe20c06f0b0 2024-04-04T06:56:38.254 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.255+0000 7fe210a00640 1 -- 172.21.15.72:0/2134387187 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe20c06f0b0 msgr2=0x7fe20c1484c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:38.255 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.256+0000 7fe210a00640 1 --2- 172.21.15.72:0/2134387187 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe20c06f0b0 0x7fe20c1484c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:38.255 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.256+0000 7fe210a00640 1 -- 172.21.15.72:0/2134387187 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe20c0af9c0 msgr2=0x7fe20c0afe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:38.255 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.256+0000 7fe210a00640 1 --2- 172.21.15.72:0/2134387187 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe20c0af9c0 0x7fe20c0afe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:38.255 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.256+0000 7fe210a00640 1 -- 172.21.15.72:0/2134387187 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe20c1595a0 con 0x7fe1f00053a0 2024-04-04T06:56:38.255 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.256+0000 7fe211400640 1 --2- 172.21.15.72:0/2134387187 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe20c0af9c0 0x7fe20c0afe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-04T06:56:38.255 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.257+0000 7fe210a00640 1 --2- 172.21.15.72:0/2134387187 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe1f00053a0 0x7fe20c157bb0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fe204007850 tx=0x7fe20400a640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:38.256 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.258+0000 7fe208c00640 1 -- 172.21.15.72:0/2134387187 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe20400ae10 con 0x7fe1f00053a0 2024-04-04T06:56:38.257 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.258+0000 7fe208c00640 1 -- 172.21.15.72:0/2134387187 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe204018070 con 0x7fe1f00053a0 2024-04-04T06:56:38.258 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.258+0000 7fe208c00640 1 -- 172.21.15.72:0/2134387187 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe204013630 con 0x7fe1f00053a0 2024-04-04T06:56:38.258 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.258+0000 7fe213400640 1 -- 172.21.15.72:0/2134387187 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe20c159880 con 0x7fe1f00053a0 2024-04-04T06:56:38.258 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.259+0000 7fe213400640 1 -- 172.21.15.72:0/2134387187 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe20c159e40 con 0x7fe1f00053a0 2024-04-04T06:56:38.259 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.260+0000 7fe213400640 1 -- 172.21.15.72:0/2134387187 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe20c1617a0 con 0x7fe1f00053a0 2024-04-04T06:56:38.264 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.262+0000 7f0017e00640 1 -- 172.21.15.72:0/1335012491 <== mon.2 v2:172.21.15.117:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f00100305e0 con 0x7f00200b4360 2024-04-04T06:56:38.264 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.264+0000 7fe208c00640 1 -- 172.21.15.72:0/2134387187 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe2040137d0 con 0x7fe1f00053a0 2024-04-04T06:56:38.264 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.266+0000 7fe208c00640 1 --2- 172.21.15.72:0/2134387187 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fe1ec06c9f0 0x7fe1ec06eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:38.265 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.266+0000 7fe208c00640 1 -- 172.21.15.72:0/2134387187 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fe20408cc30 con 0x7fe1f00053a0 2024-04-04T06:56:38.265 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.267+0000 7fe20be00640 1 --2- 172.21.15.72:0/2134387187 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fe1ec06c9f0 0x7fe1ec06eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:38.266 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.268+0000 7fe20be00640 1 --2- 172.21.15.72:0/2134387187 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fe1ec06c9f0 0x7fe1ec06eeb0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fe20c06f040 tx=0x7fe1fc008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:38.273 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.273+0000 7fe208c00640 1 -- 172.21.15.72:0/2134387187 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fe20c1617a0 con 0x7fe1f00053a0 2024-04-04T06:56:38.277 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.279+0000 7f2f0a400640 1 Processor -- start 2024-04-04T06:56:38.277 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.279+0000 7f2f0a400640 1 -- start start 2024-04-04T06:56:38.283 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.281+0000 7f2f0a400640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f2f0415e720 0x7f2f040d1300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:38.283 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.281+0000 7f2f0a400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2f040d1840 0x7f2f040b7460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:38.283 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.281+0000 7f2f0a400640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f2f040b79a0 0x7f2f040b7df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:38.283 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.281+0000 7f2f0a400640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f2f040d1ca0 con 0x7f2f040b79a0 2024-04-04T06:56:38.283 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.281+0000 7f2f0a400640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f2f040d51a0 con 0x7f2f0415e720 2024-04-04T06:56:38.283 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.281+0000 7f2f0a400640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f2f040d4100 con 0x7f2f040d1840 2024-04-04T06:56:38.283 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.281+0000 7f2f03e00640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f2f040b79a0 0x7f2f040b7df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:38.283 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.281+0000 7f2f03e00640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f2f040b79a0 0x7f2f040b7df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46466/0 (socket says 172.21.15.72:46466) 2024-04-04T06:56:38.283 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.281+0000 7f2f03e00640 1 -- 172.21.15.72:0/3048786813 learned_addr learned my addr 172.21.15.72:0/3048786813 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:56:38.283 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.282+0000 7f2f03400640 1 --2- 172.21.15.72:0/3048786813 >> v2:172.21.15.117:3300/0 conn(0x7f2f0415e720 0x7f2f040d1300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:38.283 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.282+0000 7f2f03e00640 1 -- 172.21.15.72:0/3048786813 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2f040d1840 msgr2=0x7f2f040b7460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:56:38.284 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.282+0000 7f2f02a00640 1 --2- 172.21.15.72:0/3048786813 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2f040d1840 0x7f2f040b7460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:38.284 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.282+0000 7f2f03e00640 1 --2- 172.21.15.72:0/3048786813 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2f040d1840 0x7f2f040b7460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:38.284 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.282+0000 7f2f03e00640 1 -- 172.21.15.72:0/3048786813 >> v2:172.21.15.117:3300/0 conn(0x7f2f0415e720 msgr2=0x7f2f040d1300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:56:38.284 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.282+0000 7f2f03e00640 1 --2- 172.21.15.72:0/3048786813 >> v2:172.21.15.117:3300/0 conn(0x7f2f0415e720 0x7f2f040d1300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:38.284 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.282+0000 7f2f03e00640 1 -- 172.21.15.72:0/3048786813 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f040d43e0 con 0x7f2f040b79a0 2024-04-04T06:56:38.284 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.283+0000 7f2f03400640 1 --2- 172.21.15.72:0/3048786813 >> v2:172.21.15.117:3300/0 conn(0x7f2f0415e720 0x7f2f040d1300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-04T06:56:38.284 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.286+0000 7f2f03e00640 1 --2- 172.21.15.72:0/3048786813 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2f040b79a0 0x7f2f040b7df0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f2f040d5390 tx=0x7f2ef002b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=988ccf55a6cf58e2 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:38.288 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.290+0000 7f2f02000640 1 -- 172.21.15.72:0/3048786813 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ef0035020 con 0x7f2f040b79a0 2024-04-04T06:56:38.288 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.290+0000 7f2f02000640 1 -- 172.21.15.72:0/3048786813 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ef0031810 con 0x7f2f040b79a0 2024-04-04T06:56:38.288 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.290+0000 7f2f02000640 1 -- 172.21.15.72:0/3048786813 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ef0031c20 con 0x7f2f040b79a0 2024-04-04T06:56:38.293 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.291+0000 7f2f0a400640 1 -- 172.21.15.72:0/3048786813 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2f040b79a0 msgr2=0x7f2f040b7df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:38.293 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.291+0000 7f2f0a400640 1 --2- 172.21.15.72:0/3048786813 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2f040b79a0 0x7f2f040b7df0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f2f040d5390 tx=0x7f2ef002b8b0 comp rx=0 tx=0).stop 2024-04-04T06:56:38.293 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.295+0000 7f2f0a400640 1 -- 172.21.15.72:0/3048786813 shutdown_connections 2024-04-04T06:56:38.293 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.295+0000 7f2f0a400640 1 --2- 172.21.15.72:0/3048786813 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2f040b79a0 0x7f2f040b7df0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:38.293 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.295+0000 7f2f0a400640 1 --2- 172.21.15.72:0/3048786813 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2f040d1840 0x7f2f040b7460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:38.293 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.295+0000 7f2f0a400640 1 --2- 172.21.15.72:0/3048786813 >> v2:172.21.15.117:3300/0 conn(0x7f2f0415e720 0x7f2f040d1300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:38.293 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.295+0000 7f2f0a400640 1 -- 172.21.15.72:0/3048786813 >> 172.21.15.72:0/3048786813 conn(0x7f2f04071eb0 msgr2=0x7f2f040722c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:56:38.295 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.296+0000 7f2f0a400640 1 -- 172.21.15.72:0/3048786813 shutdown_connections 2024-04-04T06:56:38.298 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.296+0000 7f2f0a400640 1 -- 172.21.15.72:0/3048786813 wait complete. 2024-04-04T06:56:38.298 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.299+0000 7f2f0a400640 1 Processor -- start 2024-04-04T06:56:38.298 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.300+0000 7f2f0a400640 1 -- start start 2024-04-04T06:56:38.300 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.302+0000 7f2f0a400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2f040b79a0 0x7f2f04161620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:38.301 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.302+0000 7f2f0a400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2f040d1840 0x7f2f0415f510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:38.303 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.303+0000 7f2f0a400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2f0415e720 0x7f2f041f3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:38.303 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.305+0000 7f2f0a400640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f2f040d4c80 con 0x7f2f040b79a0 2024-04-04T06:56:38.304 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.305+0000 7f2f03400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2f040b79a0 0x7f2f04161620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:38.304 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.305+0000 7f2f03e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2f0415e720 0x7f2f041f3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:38.304 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.305+0000 7f2f03400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2f040b79a0 0x7f2f04161620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46470/0 (socket says 172.21.15.72:46470) 2024-04-04T06:56:38.304 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.305+0000 7f2f03400640 1 -- 172.21.15.72:0/3879974006 learned_addr learned my addr 172.21.15.72:0/3879974006 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:56:38.304 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.305+0000 7f2f0a400640 1 -- 172.21.15.72:0/3879974006 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f2f040d49a0 con 0x7f2f040d1840 2024-04-04T06:56:38.304 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.305+0000 7f2f02a00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2f040d1840 0x7f2f0415f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:38.304 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.306+0000 7f2f0a400640 1 -- 172.21.15.72:0/3879974006 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f2f040ba200 con 0x7f2f0415e720 2024-04-04T06:56:38.305 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.307+0000 7f2f03400640 1 -- 172.21.15.72:0/3879974006 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2f0415e720 msgr2=0x7f2f041f3550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:38.305 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.307+0000 7f2f03400640 1 --2- 172.21.15.72:0/3879974006 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2f0415e720 0x7f2f041f3550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:38.305 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.307+0000 7f2f03400640 1 -- 172.21.15.72:0/3879974006 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2f040d1840 msgr2=0x7f2f0415f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:38.305 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.307+0000 7f2f03400640 1 --2- 172.21.15.72:0/3879974006 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2f040d1840 0x7f2f0415f510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:38.306 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.307+0000 7f2f03400640 1 -- 172.21.15.72:0/3879974006 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f0415fc10 con 0x7f2f040b79a0 2024-04-04T06:56:38.306 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.307+0000 7f2f03400640 1 --2- 172.21.15.72:0/3879974006 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2f040b79a0 0x7f2f04161620 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f2efc00d430 tx=0x7f2efc00d8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:38.307 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.308+0000 7f2efb400640 1 -- 172.21.15.72:0/3879974006 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2efc01a070 con 0x7f2f040b79a0 2024-04-04T06:56:38.307 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.308+0000 7f2efb400640 1 -- 172.21.15.72:0/3879974006 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2efc003bb0 con 0x7f2f040b79a0 2024-04-04T06:56:38.307 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.308+0000 7f2efb400640 1 -- 172.21.15.72:0/3879974006 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2efc004030 con 0x7f2f040b79a0 2024-04-04T06:56:38.307 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.308+0000 7f2f0a400640 1 -- 172.21.15.72:0/3879974006 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f0415fef0 con 0x7f2f040b79a0 2024-04-04T06:56:38.307 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.308+0000 7f2f0a400640 1 -- 172.21.15.72:0/3879974006 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f041f3a90 con 0x7f2f040b79a0 2024-04-04T06:56:38.310 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.310+0000 7f2f0a400640 1 -- 172.21.15.72:0/3879974006 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f04075840 con 0x7f2f040b79a0 2024-04-04T06:56:38.311 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.312+0000 7f2efb400640 1 -- 172.21.15.72:0/3879974006 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2efc01d070 con 0x7f2f040b79a0 2024-04-04T06:56:38.312 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.314+0000 7f2efb400640 1 --2- 172.21.15.72:0/3879974006 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f2ee806cac0 0x7f2ee806ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:38.313 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.314+0000 7f2f02a00640 1 --2- 172.21.15.72:0/3879974006 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f2ee806cac0 0x7f2ee806ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:38.319 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.318+0000 7f2f02a00640 1 --2- 172.21.15.72:0/3879974006 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f2ee806cac0 0x7f2ee806ef80 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f2f04159130 tx=0x7f2ef4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:38.328 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.330+0000 7f2efb400640 1 -- 172.21.15.72:0/3879974006 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f2efc08a0b0 con 0x7f2f040b79a0 2024-04-04T06:56:38.329 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.331+0000 7f2efb400640 1 -- 172.21.15.72:0/3879974006 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f2efc010070 con 0x7f2f040b79a0 2024-04-04T06:56:38.374 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.376+0000 7f2fa8c00640 1 Processor -- start 2024-04-04T06:56:38.374 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.376+0000 7f2fa8c00640 1 -- start start 2024-04-04T06:56:38.377 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.378+0000 7f2fa8c00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2fa40ada80 0x7f2fa4150f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:38.377 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.378+0000 7f2fa8c00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f2fa41514a0 0x7f2fa40b3d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:38.377 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.378+0000 7f2fa8c00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2fa40ae7f0 con 0x7f2fa415b5c0 2024-04-04T06:56:38.377 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.378+0000 7f2fa8c00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f2fa415af60 con 0x7f2fa41514a0 2024-04-04T06:56:38.377 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.378+0000 7f2fa8c00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f2fa40adf50 con 0x7f2fa40ada80 2024-04-04T06:56:38.378 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.379+0000 7f2fa3e00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f2fa41514a0 0x7f2fa40b3d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:38.378 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.379+0000 7f2fa3e00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f2fa41514a0 0x7f2fa40b3d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.72:40300/0 (socket says 172.21.15.72:40300) 2024-04-04T06:56:38.378 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.379+0000 7f2fa3e00640 1 -- 172.21.15.72:0/4168903092 learned_addr learned my addr 172.21.15.72:0/4168903092 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:56:38.378 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.380+0000 7f2fa2a00640 1 --2- 172.21.15.72:0/4168903092 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2fa40ada80 0x7f2fa4150f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:38.382 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.380+0000 7f2fa3e00640 1 -- 172.21.15.72:0/4168903092 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2fa40ada80 msgr2=0x7f2fa4150f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:56:38.382 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.382+0000 7f2fa3e00640 1 --2- 172.21.15.72:0/4168903092 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2fa40ada80 0x7f2fa4150f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:38.382 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.382+0000 7f2fa3e00640 1 -- 172.21.15.72:0/4168903092 >> v1:172.21.15.117:6789/0 conn(0x7f2fa415b5c0 legacy=0x7f2fa40ad370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:38.382 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.382+0000 7f2fa3e00640 1 -- 172.21.15.72:0/4168903092 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fa40ae230 con 0x7f2fa41514a0 2024-04-04T06:56:38.382 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.381+0000 7f2fa2000640 1 -- 172.21.15.72:0/4168903092 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2459125724 0 0) 0x7f2fa40ae7f0 con 0x7f2fa415b5c0 2024-04-04T06:56:38.382 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.383+0000 7f2fa2a00640 1 --2- 172.21.15.72:0/4168903092 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2fa40ada80 0x7f2fa4150f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-04T06:56:38.385 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.387+0000 7f2fa3e00640 1 --2- 172.21.15.72:0/4168903092 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2fa41514a0 0x7f2fa40b3d60 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f2f9c009e50 tx=0x7f2f9c02bfa0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d28f4e86b29eeed9 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:38.386 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.387+0000 7f2fa2000640 1 -- 172.21.15.72:0/4168903092 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f9c02cb40 con 0x7f2fa41514a0 2024-04-04T06:56:38.388 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.389+0000 7f2fa2000640 1 -- 172.21.15.72:0/4168903092 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f9c02cce0 con 0x7f2fa41514a0 2024-04-04T06:56:38.388 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.390+0000 7f2fa2000640 1 -- 172.21.15.72:0/4168903092 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f9c034610 con 0x7f2fa41514a0 2024-04-04T06:56:38.389 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.391+0000 7f2fa8c00640 1 -- 172.21.15.72:0/4168903092 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2fa41514a0 msgr2=0x7f2fa40b3d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:38.390 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.391+0000 7f2fa8c00640 1 --2- 172.21.15.72:0/4168903092 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2fa41514a0 0x7f2fa40b3d60 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f2f9c009e50 tx=0x7f2f9c02bfa0 comp rx=0 tx=0).stop 2024-04-04T06:56:38.390 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.391+0000 7f2fa8c00640 1 -- 172.21.15.72:0/4168903092 shutdown_connections 2024-04-04T06:56:38.391 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.391+0000 7f2fa8c00640 1 --2- 172.21.15.72:0/4168903092 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2fa41514a0 0x7f2fa40b3d60 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:38.391 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.391+0000 7f2fa8c00640 1 --2- 172.21.15.72:0/4168903092 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2fa40ada80 0x7f2fa4150f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:38.391 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.391+0000 7f2fa8c00640 1 -- 172.21.15.72:0/4168903092 >> 172.21.15.72:0/4168903092 conn(0x7f2fa40cfd20 msgr2=0x7f2fa40d0100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:56:38.391 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.391+0000 7f2fa8c00640 1 -- 172.21.15.72:0/4168903092 shutdown_connections 2024-04-04T06:56:38.391 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.391+0000 7f2fa8c00640 1 -- 172.21.15.72:0/4168903092 wait complete. 2024-04-04T06:56:38.399 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.395+0000 7f2fa8c00640 1 Processor -- start 2024-04-04T06:56:38.404 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.401+0000 7f2fa8c00640 1 -- start start 2024-04-04T06:56:38.405 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.406+0000 7f2fa8c00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2fa40ada80 0x7f2fa40cdf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:38.408 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.406+0000 7f2fa8c00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2fa41514a0 0x7f2fa40ce6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:38.408 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.407+0000 7f2fa3400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2fa40ada80 0x7f2fa40cdf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:38.408 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.410+0000 7f2fa8c00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2fa415b5c0 0x7f2fa40cebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:38.409 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.410+0000 7f2fa8c00640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f2fa415b9a0 con 0x7f2fa41514a0 2024-04-04T06:56:38.409 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.410+0000 7f2fa8c00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f2fa4071360 con 0x7f2fa415b5c0 2024-04-04T06:56:38.409 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.410+0000 7f2fa8c00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f2fa415bb20 con 0x7f2fa40ada80 2024-04-04T06:56:38.409 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.410+0000 7f2fa2a00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2fa41514a0 0x7f2fa40ce6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:38.409 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.410+0000 7f2fa2a00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2fa41514a0 0x7f2fa40ce6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46476/0 (socket says 172.21.15.72:46476) 2024-04-04T06:56:38.409 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.410+0000 7f2fa2a00640 1 -- 172.21.15.72:0/1640063932 learned_addr learned my addr 172.21.15.72:0/1640063932 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:56:38.409 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.410+0000 7f2fa3e00640 1 --2- 172.21.15.72:0/1640063932 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2fa415b5c0 0x7f2fa40cebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:38.410 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.411+0000 7f2fa2a00640 1 -- 172.21.15.72:0/1640063932 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2fa40ada80 msgr2=0x7f2fa40cdf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:38.410 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.412+0000 7f2fa2a00640 1 --2- 172.21.15.72:0/1640063932 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2fa40ada80 0x7f2fa40cdf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:38.410 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.412+0000 7f2fa2a00640 1 -- 172.21.15.72:0/1640063932 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2fa415b5c0 msgr2=0x7f2fa40cebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:38.410 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.412+0000 7f2fa2a00640 1 --2- 172.21.15.72:0/1640063932 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2fa415b5c0 0x7f2fa40cebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:38.411 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.412+0000 7f2fa2a00640 1 -- 172.21.15.72:0/1640063932 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fa40ce490 con 0x7f2fa41514a0 2024-04-04T06:56:38.411 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.412+0000 7f2fa3e00640 1 --2- 172.21.15.72:0/1640063932 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2fa415b5c0 0x7f2fa40cebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-04T06:56:38.411 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.412+0000 7f2fa3400640 1 --2- 172.21.15.72:0/1640063932 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2fa40ada80 0x7f2fa40cdf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-04T06:56:38.411 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.413+0000 7f2fa2a00640 1 --2- 172.21.15.72:0/1640063932 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2fa41514a0 0x7f2fa40ce6a0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f2f9000c7f0 tx=0x7f2f9000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:38.412 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.414+0000 7f2f9b400640 1 -- 172.21.15.72:0/1640063932 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f90015070 con 0x7f2fa41514a0 2024-04-04T06:56:38.412 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.414+0000 7f2f9b400640 1 -- 172.21.15.72:0/1640063932 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f90007a30 con 0x7f2fa41514a0 2024-04-04T06:56:38.417 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.414+0000 7f2f9b400640 1 -- 172.21.15.72:0/1640063932 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f90007e00 con 0x7f2fa41514a0 2024-04-04T06:56:38.417 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.414+0000 7f2fa8c00640 1 -- 172.21.15.72:0/1640063932 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2fa409b4b0 con 0x7f2fa41514a0 2024-04-04T06:56:38.417 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.414+0000 7f2fa8c00640 1 -- 172.21.15.72:0/1640063932 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2fa409ba70 con 0x7f2fa41514a0 2024-04-04T06:56:38.417 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.416+0000 7f2fa8c00640 1 -- 172.21.15.72:0/1640063932 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2fa40756c0 con 0x7f2fa41514a0 2024-04-04T06:56:38.437 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.439+0000 7f2f9b400640 1 -- 172.21.15.72:0/1640063932 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2f90018070 con 0x7f2fa41514a0 2024-04-04T06:56:38.443 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.440+0000 7f2f9b400640 1 --2- 172.21.15.72:0/1640063932 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f2f8406c9c0 0x7f2f8406ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:38.443 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.440+0000 7f2f9b400640 1 -- 172.21.15.72:0/1640063932 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f2f9008be80 con 0x7f2fa41514a0 2024-04-04T06:56:38.443 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.445+0000 7f2fa3400640 1 --2- 172.21.15.72:0/1640063932 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f2f8406c9c0 0x7f2f8406ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:38.445 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.446+0000 7f2fa3400640 1 --2- 172.21.15.72:0/1640063932 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f2f8406c9c0 0x7f2f8406ee80 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f2f94000f60 tx=0x7f2f94009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:38.454 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.456+0000 7f2f9b400640 1 -- 172.21.15.72:0/1640063932 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f2f9005a320 con 0x7f2fa41514a0 2024-04-04T06:56:38.590 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.591+0000 7f11aba00640 1 -- 172.21.15.72:0/2138847719 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f11a4073870 con 0x7f11a415b750 2024-04-04T06:56:38.593 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.595+0000 7f11a0c00640 1 -- 172.21.15.72:0/2138847719 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f119405a510 con 0x7f11a415b750 2024-04-04T06:56:38.596 INFO:teuthology.orchestra.run.smithi072.stdout:55834574855 2024-04-04T06:56:38.598 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.600+0000 7f11aba00640 1 -- 172.21.15.72:0/2138847719 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f118406c9f0 msgr2=0x7f118406eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:38.598 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.600+0000 7f11aba00640 1 --2- 172.21.15.72:0/2138847719 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f118406c9f0 0x7f118406eeb0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f119c035000 tx=0x7f119c02e000 comp rx=0 tx=0).stop 2024-04-04T06:56:38.598 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.600+0000 7f11aba00640 1 -- 172.21.15.72:0/2138847719 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f11a415b750 msgr2=0x7f11a41fadd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:38.599 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.600+0000 7f11aba00640 1 --2- 172.21.15.72:0/2138847719 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f11a415b750 0x7f11a41fadd0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f119400e880 tx=0x7f119400ed40 comp rx=0 tx=0).stop 2024-04-04T06:56:38.599 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.601+0000 7f11aba00640 1 -- 172.21.15.72:0/2138847719 shutdown_connections 2024-04-04T06:56:38.600 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.601+0000 7f11aba00640 1 --2- 172.21.15.72:0/2138847719 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f118406c9f0 0x7f118406eeb0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:38.600 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.601+0000 7f11aba00640 1 --2- 172.21.15.72:0/2138847719 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f11a415b750 0x7f11a41fadd0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:38.600 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.601+0000 7f11aba00640 1 --2- 172.21.15.72:0/2138847719 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f11a40af790 0x7f11a4201a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:38.600 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.601+0000 7f11aba00640 1 --2- 172.21.15.72:0/2138847719 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f11a40af3b0 0x7f11a40ce030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:38.600 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.601+0000 7f11aba00640 1 -- 172.21.15.72:0/2138847719 >> 172.21.15.72:0/2138847719 conn(0x7f11a4071b50 msgr2=0x7f11a4158bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:56:38.600 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.602+0000 7f11aba00640 1 -- 172.21.15.72:0/2138847719 shutdown_connections 2024-04-04T06:56:38.600 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.602+0000 7f11aba00640 1 -- 172.21.15.72:0/2138847719 wait complete. 2024-04-04T06:56:38.602 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.604+0000 7f41cea00640 1 -- 172.21.15.72:0/2708941370 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f41b0005580 con 0x7f41dc15bfd0 2024-04-04T06:56:38.604 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.605+0000 7f41d9600640 1 -- 172.21.15.72:0/2708941370 <== mon.2 v2:172.21.15.117:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f41d005dd50 con 0x7f41dc15bfd0 2024-04-04T06:56:38.604 INFO:teuthology.orchestra.run.smithi072.stdout:55834574854 2024-04-04T06:56:38.607 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.609+0000 7f6f65a00640 1 -- 172.21.15.72:0/1362287088 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f6f580057e0 con 0x7f6f58054300 2024-04-04T06:56:38.608 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.609+0000 7f41cea00640 1 -- 172.21.15.72:0/2708941370 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f41bc06c9f0 msgr2=0x7f41bc06eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:38.608 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.609+0000 7f41cea00640 1 --2- 172.21.15.72:0/2708941370 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f41bc06c9f0 0x7f41bc06eeb0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f41c803e000 tx=0x7f41c8038000 comp rx=0 tx=0).stop 2024-04-04T06:56:38.608 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.610+0000 7f6f53e00640 1 -- 172.21.15.72:0/1362287088 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f6f4c059670 con 0x7f6f58054300 2024-04-04T06:56:38.609 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.610+0000 7f41cea00640 1 -- 172.21.15.72:0/2708941370 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f41dc15bfd0 msgr2=0x7f41dc1571d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:38.609 INFO:teuthology.orchestra.run.smithi072.stdout:55834574853 2024-04-04T06:56:38.609 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.610+0000 7f41cea00640 1 --2- 172.21.15.72:0/2708941370 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f41dc15bfd0 0x7f41dc1571d0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f41d000e840 tx=0x7f41d000ed00 comp rx=0 tx=0).stop 2024-04-04T06:56:38.610 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.612+0000 7f41cea00640 1 -- 172.21.15.72:0/2708941370 shutdown_connections 2024-04-04T06:56:38.611 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.612+0000 7f41cea00640 1 --2- 172.21.15.72:0/2708941370 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f41bc06c9f0 0x7f41bc06eeb0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:38.611 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.612+0000 7f41cea00640 1 --2- 172.21.15.72:0/2708941370 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f41dc15f9d0 0x7f41dc0c76c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:38.611 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.612+0000 7f41cea00640 1 --2- 172.21.15.72:0/2708941370 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f41dc15c3b0 0x7f41dc1521a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:38.611 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.612+0000 7f41cea00640 1 --2- 172.21.15.72:0/2708941370 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f41dc15bfd0 0x7f41dc1571d0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:38.611 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.612+0000 7f41cea00640 1 -- 172.21.15.72:0/2708941370 >> 172.21.15.72:0/2708941370 conn(0x7f41dc071b50 msgr2=0x7f41dc0ca760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:56:38.613 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.615+0000 7f41cea00640 1 -- 172.21.15.72:0/2708941370 shutdown_connections 2024-04-04T06:56:38.614 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.615+0000 7f41cea00640 1 -- 172.21.15.72:0/2708941370 wait complete. 2024-04-04T06:56:38.614 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.615+0000 7f6f65a00640 1 -- 172.21.15.72:0/1362287088 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f6f4006caf0 msgr2=0x7f6f4006efb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:38.614 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.615+0000 7f6f65a00640 1 --2- 172.21.15.72:0/1362287088 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f6f4006caf0 0x7f6f4006efb0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f6f54036000 tx=0x7f6f54008030 comp rx=0 tx=0).stop 2024-04-04T06:56:38.614 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.615+0000 7f6f65a00640 1 -- 172.21.15.72:0/1362287088 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6f58054300 msgr2=0x7f6f580dfbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:38.614 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.615+0000 7f6f65a00640 1 --2- 172.21.15.72:0/1362287088 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6f58054300 0x7f6f580dfbd0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f6f580584a0 tx=0x7f6f4c00cbe0 comp rx=0 tx=0).stop 2024-04-04T06:56:38.616 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.618+0000 7f6f65a00640 1 -- 172.21.15.72:0/1362287088 shutdown_connections 2024-04-04T06:56:38.616 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.618+0000 7f6f65a00640 1 --2- 172.21.15.72:0/1362287088 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f6f4006caf0 0x7f6f4006efb0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:38.616 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.618+0000 7f6f65a00640 1 --2- 172.21.15.72:0/1362287088 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6f580e30c0 0x7f6f580e3620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:38.616 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.618+0000 7f6f65a00640 1 --2- 172.21.15.72:0/1362287088 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6f58054300 0x7f6f580dfbd0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:38.616 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.618+0000 7f6f65a00640 1 --2- 172.21.15.72:0/1362287088 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6f5803e840 0x7f6f580d7220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:38.617 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.618+0000 7f6f65a00640 1 -- 172.21.15.72:0/1362287088 >> 172.21.15.72:0/1362287088 conn(0x7f6f580559e0 msgr2=0x7f6f5803d710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:56:38.617 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.618+0000 7f6f65a00640 1 -- 172.21.15.72:0/1362287088 shutdown_connections 2024-04-04T06:56:38.617 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.618+0000 7f6f65a00640 1 -- 172.21.15.72:0/1362287088 wait complete. 2024-04-04T06:56:38.633 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.3 2024-04-04T06:56:38.633 DEBUG:teuthology.parallel:result is None 2024-04-04T06:56:38.653 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.6 2024-04-04T06:56:38.653 DEBUG:teuthology.parallel:result is None 2024-04-04T06:56:38.654 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.1 2024-04-04T06:56:38.654 DEBUG:teuthology.parallel:result is None 2024-04-04T06:56:38.658 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.659+0000 7fcf25200640 1 -- 172.21.15.72:0/1446684082 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fcf200b5a00 con 0x7fcf040039b0 2024-04-04T06:56:38.659 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.660+0000 7fcf17400640 1 -- 172.21.15.72:0/1446684082 <== mon.1 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fcf1007c5c0 con 0x7fcf040039b0 2024-04-04T06:56:38.659 INFO:teuthology.orchestra.run.smithi072.stdout:55834574855 2024-04-04T06:56:38.662 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.663+0000 7fcf25200640 1 -- 172.21.15.72:0/1446684082 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fcf0006c920 msgr2=0x7fcf0006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:38.662 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.663+0000 7fcf25200640 1 --2- 172.21.15.72:0/1446684082 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fcf0006c920 0x7fcf0006ede0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fcf200b5cb0 tx=0x7fcf0c009040 comp rx=0 tx=0).stop 2024-04-04T06:56:38.662 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.663+0000 7fcf25200640 1 -- 172.21.15.72:0/1446684082 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcf040039b0 msgr2=0x7fcf20150d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:38.662 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.663+0000 7fcf25200640 1 --2- 172.21.15.72:0/1446684082 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcf040039b0 0x7fcf20150d50 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fcf1000a9b0 tx=0x7fcf10001cf0 comp rx=0 tx=0).stop 2024-04-04T06:56:38.662 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.663+0000 7fcf25200640 1 -- 172.21.15.72:0/1446684082 shutdown_connections 2024-04-04T06:56:38.662 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.663+0000 7fcf25200640 1 --2- 172.21.15.72:0/1446684082 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fcf0006c920 0x7fcf0006ede0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:38.662 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.663+0000 7fcf25200640 1 --2- 172.21.15.72:0/1446684082 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcf200cc4e0 0x7fcf200cc960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:38.662 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.663+0000 7fcf25200640 1 --2- 172.21.15.72:0/1446684082 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcf20157b90 0x7fcf20154040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:38.662 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.663+0000 7fcf25200640 1 --2- 172.21.15.72:0/1446684082 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcf040039b0 0x7fcf20150d50 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:38.662 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.663+0000 7fcf25200640 1 -- 172.21.15.72:0/1446684082 >> 172.21.15.72:0/1446684082 conn(0x7fcf2006b860 msgr2=0x7fcf200b3970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:56:38.662 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.663+0000 7fcf25200640 1 -- 172.21.15.72:0/1446684082 shutdown_connections 2024-04-04T06:56:38.662 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.663+0000 7fcf25200640 1 -- 172.21.15.72:0/1446684082 wait complete. 2024-04-04T06:56:38.679 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.2 2024-04-04T06:56:38.679 DEBUG:teuthology.parallel:result is None 2024-04-04T06:56:38.689 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.690+0000 7fe213400640 1 -- 172.21.15.72:0/2134387187 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7fe20c0cae80 con 0x7fe1f00053a0 2024-04-04T06:56:38.689 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.691+0000 7fe208c00640 1 -- 172.21.15.72:0/2134387187 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fe20c0cae80 con 0x7fe1f00053a0 2024-04-04T06:56:38.689 INFO:teuthology.orchestra.run.smithi072.stdout:55834574855 2024-04-04T06:56:38.692 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.693+0000 7fe213400640 1 -- 172.21.15.72:0/2134387187 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fe1ec06c9f0 msgr2=0x7fe1ec06eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:38.692 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.693+0000 7fe213400640 1 --2- 172.21.15.72:0/2134387187 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fe1ec06c9f0 0x7fe1ec06eeb0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fe20c06f040 tx=0x7fe1fc008040 comp rx=0 tx=0).stop 2024-04-04T06:56:38.692 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.693+0000 7fe213400640 1 -- 172.21.15.72:0/2134387187 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe1f00053a0 msgr2=0x7fe20c157bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:38.692 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.693+0000 7fe213400640 1 --2- 172.21.15.72:0/2134387187 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe1f00053a0 0x7fe20c157bb0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fe204007850 tx=0x7fe20400a640 comp rx=0 tx=0).stop 2024-04-04T06:56:38.692 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.693+0000 7fe213400640 1 -- 172.21.15.72:0/2134387187 shutdown_connections 2024-04-04T06:56:38.692 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.693+0000 7fe213400640 1 --2- 172.21.15.72:0/2134387187 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fe1ec06c9f0 0x7fe1ec06eeb0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:38.692 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.693+0000 7fe213400640 1 --2- 172.21.15.72:0/2134387187 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe20c0af9c0 0x7fe20c0afe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:38.692 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.693+0000 7fe213400640 1 --2- 172.21.15.72:0/2134387187 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe20c06f0b0 0x7fe20c1484c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:38.692 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.693+0000 7fe213400640 1 --2- 172.21.15.72:0/2134387187 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe1f00053a0 0x7fe20c157bb0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:38.692 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.693+0000 7fe213400640 1 -- 172.21.15.72:0/2134387187 >> 172.21.15.72:0/2134387187 conn(0x7fe20c071b50 msgr2=0x7fe20c161090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:56:38.692 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.693+0000 7fe213400640 1 -- 172.21.15.72:0/2134387187 shutdown_connections 2024-04-04T06:56:38.692 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.693+0000 7fe213400640 1 -- 172.21.15.72:0/2134387187 wait complete. 2024-04-04T06:56:38.696 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.698+0000 7f0015600640 1 -- 172.21.15.72:0/1335012491 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7efff4005580 con 0x7f00200b4360 2024-04-04T06:56:38.697 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.699+0000 7f0017e00640 1 -- 172.21.15.72:0/1335012491 <== mon.2 v2:172.21.15.117:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f001007d090 con 0x7f00200b4360 2024-04-04T06:56:38.697 INFO:teuthology.orchestra.run.smithi072.stdout:55834574853 2024-04-04T06:56:38.701 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.702+0000 7f0015600640 1 -- 172.21.15.72:0/1335012491 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f000006caf0 msgr2=0x7f000006efb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:38.701 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.702+0000 7f0015600640 1 --2- 172.21.15.72:0/1335012491 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f000006caf0 0x7f000006efb0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f00200ac820 tx=0x7f000c009040 comp rx=0 tx=0).stop 2024-04-04T06:56:38.701 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.702+0000 7f0015600640 1 -- 172.21.15.72:0/1335012491 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f00200b4360 msgr2=0x7f0020154760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:38.701 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.702+0000 7f0015600640 1 --2- 172.21.15.72:0/1335012491 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f00200b4360 0x7f0020154760 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f0010033000 tx=0x7f00100046c0 comp rx=0 tx=0).stop 2024-04-04T06:56:38.701 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.702+0000 7f0015600640 1 -- 172.21.15.72:0/1335012491 shutdown_connections 2024-04-04T06:56:38.701 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.702+0000 7f0015600640 1 --2- 172.21.15.72:0/1335012491 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f000006caf0 0x7f000006efb0 secure :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f00200ac820 tx=0x7f000c009040 comp rx=0 tx=0).stop 2024-04-04T06:56:38.701 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.702+0000 7f0015600640 1 --2- 172.21.15.72:0/1335012491 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f002015eae0 0x7f00200aee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:38.702 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.702+0000 7f0015600640 1 --2- 172.21.15.72:0/1335012491 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f002015a5a0 0x7f0020156e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:38.702 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.702+0000 7f0015600640 1 --2- 172.21.15.72:0/1335012491 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f00200b4360 0x7f0020154760 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:38.702 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.702+0000 7f0015600640 1 -- 172.21.15.72:0/1335012491 >> 172.21.15.72:0/1335012491 conn(0x7f00200cfc90 msgr2=0x7f00200b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:56:38.702 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.703+0000 7f0015600640 1 -- 172.21.15.72:0/1335012491 shutdown_connections 2024-04-04T06:56:38.702 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.703+0000 7f0015600640 1 -- 172.21.15.72:0/1335012491 wait complete. 2024-04-04T06:56:38.714 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.7 2024-04-04T06:56:38.715 DEBUG:teuthology.parallel:result is None 2024-04-04T06:56:38.718 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.4 2024-04-04T06:56:38.718 DEBUG:teuthology.parallel:result is None 2024-04-04T06:56:38.769 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.771+0000 7f2f0a400640 1 -- 172.21.15.72:0/3879974006 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f2f040b4910 con 0x7f2f040b79a0 2024-04-04T06:56:38.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.771+0000 7f2efb400640 1 -- 172.21.15.72:0/3879974006 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f2efc0598e0 con 0x7f2f040b79a0 2024-04-04T06:56:38.770 INFO:teuthology.orchestra.run.smithi072.stdout:55834574854 2024-04-04T06:56:38.772 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.773+0000 7f2f0a400640 1 -- 172.21.15.72:0/3879974006 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f2ee806cac0 msgr2=0x7f2ee806ef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:38.772 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.773+0000 7f2f0a400640 1 --2- 172.21.15.72:0/3879974006 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f2ee806cac0 0x7f2ee806ef80 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f2f04159130 tx=0x7f2ef4008040 comp rx=0 tx=0).stop 2024-04-04T06:56:38.772 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.773+0000 7f2f0a400640 1 -- 172.21.15.72:0/3879974006 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2f040b79a0 msgr2=0x7f2f04161620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:38.772 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.773+0000 7f2f0a400640 1 --2- 172.21.15.72:0/3879974006 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2f040b79a0 0x7f2f04161620 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f2efc00d430 tx=0x7f2efc00d8f0 comp rx=0 tx=0).stop 2024-04-04T06:56:38.773 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.774+0000 7f2f0a400640 1 -- 172.21.15.72:0/3879974006 shutdown_connections 2024-04-04T06:56:38.773 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.774+0000 7f2f0a400640 1 --2- 172.21.15.72:0/3879974006 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f2ee806cac0 0x7f2ee806ef80 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:38.773 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.774+0000 7f2f0a400640 1 --2- 172.21.15.72:0/3879974006 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2f0415e720 0x7f2f041f3550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:38.773 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.774+0000 7f2f0a400640 1 --2- 172.21.15.72:0/3879974006 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2f040d1840 0x7f2f0415f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:38.773 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.774+0000 7f2f0a400640 1 --2- 172.21.15.72:0/3879974006 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2f040b79a0 0x7f2f04161620 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:38.773 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.774+0000 7f2f0a400640 1 -- 172.21.15.72:0/3879974006 >> 172.21.15.72:0/3879974006 conn(0x7f2f04071eb0 msgr2=0x7f2f0415d9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:56:38.773 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.774+0000 7f2f0a400640 1 -- 172.21.15.72:0/3879974006 shutdown_connections 2024-04-04T06:56:38.773 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.774+0000 7f2f0a400640 1 -- 172.21.15.72:0/3879974006 wait complete. 2024-04-04T06:56:38.791 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.0 2024-04-04T06:56:38.791 DEBUG:teuthology.parallel:result is None 2024-04-04T06:56:38.839 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.841+0000 7f2fa8c00640 1 -- 172.21.15.72:0/1640063932 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f2fa4151280 con 0x7f2fa41514a0 2024-04-04T06:56:38.840 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.841+0000 7f2f9b400640 1 -- 172.21.15.72:0/1640063932 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f2f90059c20 con 0x7f2fa41514a0 2024-04-04T06:56:38.840 INFO:teuthology.orchestra.run.smithi072.stdout:55834574854 2024-04-04T06:56:38.842 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.844+0000 7f2fa8c00640 1 -- 172.21.15.72:0/1640063932 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f2f8406c9c0 msgr2=0x7f2f8406ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:38.842 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.844+0000 7f2fa8c00640 1 --2- 172.21.15.72:0/1640063932 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f2f8406c9c0 0x7f2f8406ee80 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f2f94000f60 tx=0x7f2f94009040 comp rx=0 tx=0).stop 2024-04-04T06:56:38.843 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.844+0000 7f2fa8c00640 1 -- 172.21.15.72:0/1640063932 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2fa41514a0 msgr2=0x7f2fa40ce6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:38.843 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.844+0000 7f2fa8c00640 1 --2- 172.21.15.72:0/1640063932 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2fa41514a0 0x7f2fa40ce6a0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f2f9000c7f0 tx=0x7f2f9000ccb0 comp rx=0 tx=0).stop 2024-04-04T06:56:38.843 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.844+0000 7f2fa8c00640 1 -- 172.21.15.72:0/1640063932 shutdown_connections 2024-04-04T06:56:38.843 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.844+0000 7f2fa8c00640 1 --2- 172.21.15.72:0/1640063932 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f2f8406c9c0 0x7f2f8406ee80 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:38.843 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.844+0000 7f2fa8c00640 1 --2- 172.21.15.72:0/1640063932 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2fa415b5c0 0x7f2fa40cebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:38.843 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.844+0000 7f2fa8c00640 1 --2- 172.21.15.72:0/1640063932 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2fa41514a0 0x7f2fa40ce6a0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:38.843 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.844+0000 7f2fa8c00640 1 --2- 172.21.15.72:0/1640063932 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2fa40ada80 0x7f2fa40cdf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:38.843 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.844+0000 7f2fa8c00640 1 -- 172.21.15.72:0/1640063932 >> 172.21.15.72:0/1640063932 conn(0x7f2fa40cfd20 msgr2=0x7f2fa40b4100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:56:38.843 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.844+0000 7f2fa8c00640 1 -- 172.21.15.72:0/1640063932 shutdown_connections 2024-04-04T06:56:38.843 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:38.844+0000 7f2fa8c00640 1 -- 172.21.15.72:0/1640063932 wait complete. 2024-04-04T06:56:38.860 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.5 2024-04-04T06:56:38.860 DEBUG:teuthology.parallel:result is None 2024-04-04T06:56:38.860 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-04T06:56:38.860 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-04T06:56:39.042 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.043+0000 7f158e400640 1 Processor -- start 2024-04-04T06:56:39.042 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.043+0000 7f158e400640 1 -- start start 2024-04-04T06:56:39.043 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.045+0000 7f158e400640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f158806df20 0x7f15880cedd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:39.044 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.045+0000 7f158e400640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1588142bc0 con 0x7f15881427e0 2024-04-04T06:56:39.044 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.045+0000 7f158e400640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f158806e490 con 0x7f15880cf310 2024-04-04T06:56:39.044 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.045+0000 7f158e400640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f158806e770 con 0x7f158806df20 2024-04-04T06:56:39.044 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.045+0000 7f158d000640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f15881427e0 0x7f15880ce6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:52772/0 (socket says 172.21.15.72:52772) 2024-04-04T06:56:39.044 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.045+0000 7f158d000640 1 -- 172.21.15.72:0/3245932697 learned_addr learned my addr 172.21.15.72:0/3245932697 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-04-04T06:56:39.046 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.045+0000 7f1587400640 1 -- 172.21.15.72:0/3245932697 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3932814484 0 0) 0x7f1588142bc0 con 0x7f15881427e0 2024-04-04T06:56:39.046 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.046+0000 7f1587400640 1 -- 172.21.15.72:0/3245932697 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1570003520 con 0x7f15881427e0 2024-04-04T06:56:39.046 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.046+0000 7f1587e00640 1 --2- 172.21.15.72:0/3245932697 >> v2:172.21.15.117:3300/0 conn(0x7f158806df20 0x7f15880cedd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:39.046 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.046+0000 7f1587400640 1 -- 172.21.15.72:0/3245932697 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1691103804 0 0) 0x7f1570003520 con 0x7f15881427e0 2024-04-04T06:56:39.046 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.046+0000 7f1587400640 1 -- 172.21.15.72:0/3245932697 >> v2:172.21.15.117:3300/0 conn(0x7f158806df20 msgr2=0x7f15880cedd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:56:39.046 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.046+0000 7f1587400640 1 --2- 172.21.15.72:0/3245932697 >> v2:172.21.15.117:3300/0 conn(0x7f158806df20 0x7f15880cedd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:39.046 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.046+0000 7f1587400640 1 -- 172.21.15.72:0/3245932697 >> v1:172.21.15.117:6789/0 conn(0x7f15880cf310 legacy=0x7f1588071580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:39.046 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.046+0000 7f1587400640 1 -- 172.21.15.72:0/3245932697 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f158806ea50 con 0x7f15881427e0 2024-04-04T06:56:39.046 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.046+0000 7f1587400640 1 -- 172.21.15.72:0/3245932697 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2465650867 0 0) 0x7f157c001670 con 0x7f15881427e0 2024-04-04T06:56:39.046 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.046+0000 7f1587400640 1 -- 172.21.15.72:0/3245932697 >> v1:172.21.15.72:6789/0 conn(0x7f15881427e0 legacy=0x7f15880ce6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:39.046 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.046+0000 7f1587400640 1 --2- 172.21.15.72:0/3245932697 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1570003a00 0x7f1570003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:39.047 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.046+0000 7f1587400640 1 --2- 172.21.15.72:0/3245932697 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1570004800 0x7f1570004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:39.047 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.046+0000 7f1587400640 1 --2- 172.21.15.72:0/3245932697 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f15700052e0 0x7f157000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:39.047 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.046+0000 7f1587400640 1 -- 172.21.15.72:0/3245932697 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f158806e770 con 0x7f1570003a00 2024-04-04T06:56:39.047 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.046+0000 7f1587400640 1 -- 172.21.15.72:0/3245932697 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f157000c200 con 0x7f15700052e0 2024-04-04T06:56:39.047 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.046+0000 7f1587400640 1 -- 172.21.15.72:0/3245932697 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f157000c400 con 0x7f1570004800 2024-04-04T06:56:39.047 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.046+0000 7f158d000640 1 --2- 172.21.15.72:0/3245932697 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1570003a00 0x7f1570003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:39.047 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.047+0000 7f1587e00640 1 --2- 172.21.15.72:0/3245932697 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1570004800 0x7f1570004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:39.047 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.047+0000 7f158da00640 1 --2- 172.21.15.72:0/3245932697 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f15700052e0 0x7f157000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:39.047 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.047+0000 7f158d000640 1 -- 172.21.15.72:0/3245932697 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1570004800 msgr2=0x7f1570004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:56:39.047 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.047+0000 7f158d000640 1 --2- 172.21.15.72:0/3245932697 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1570004800 0x7f1570004c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:39.047 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.047+0000 7f158d000640 1 -- 172.21.15.72:0/3245932697 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f15700052e0 msgr2=0x7f157000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:56:39.047 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.047+0000 7f158d000640 1 --2- 172.21.15.72:0/3245932697 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f15700052e0 0x7f157000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:39.047 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.047+0000 7f158d000640 1 -- 172.21.15.72:0/3245932697 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1570003520 con 0x7f1570003a00 2024-04-04T06:56:39.047 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.047+0000 7f158da00640 1 --2- 172.21.15.72:0/3245932697 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f15700052e0 0x7f157000b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-04T06:56:39.048 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.047+0000 7f158da00640 1 -- 172.21.15.72:0/3245932697 reap_dead start 2024-04-04T06:56:39.048 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.048+0000 7f158d000640 1 --2- 172.21.15.72:0/3245932697 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1570003a00 0x7f1570003e20 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f157c00c190 tx=0x7f1570005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22feb41af3ca465a server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:39.049 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.048+0000 7f1587400640 1 -- 172.21.15.72:0/3245932697 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f157c007c60 con 0x7f1570003a00 2024-04-04T06:56:39.049 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.048+0000 7f1587400640 1 -- 172.21.15.72:0/3245932697 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f157c030070 con 0x7f1570003a00 2024-04-04T06:56:39.049 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.048+0000 7f1587400640 1 -- 172.21.15.72:0/3245932697 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f157c005d90 con 0x7f1570003a00 2024-04-04T06:56:39.049 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.049+0000 7f158e400640 1 -- 172.21.15.72:0/3245932697 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1570003a00 msgr2=0x7f1570003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:39.049 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.049+0000 7f158e400640 1 --2- 172.21.15.72:0/3245932697 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1570003a00 0x7f1570003e20 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f157c00c190 tx=0x7f1570005830 comp rx=0 tx=0).stop 2024-04-04T06:56:39.049 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.049+0000 7f158e400640 1 -- 172.21.15.72:0/3245932697 shutdown_connections 2024-04-04T06:56:39.049 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.049+0000 7f158e400640 1 --2- 172.21.15.72:0/3245932697 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1570003a00 0x7f1570003e20 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:39.049 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.049+0000 7f158e400640 1 -- 172.21.15.72:0/3245932697 >> 172.21.15.72:0/3245932697 conn(0x7f15880b1840 msgr2=0x7f15880b1c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:56:39.049 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.049+0000 7f158e400640 1 -- 172.21.15.72:0/3245932697 shutdown_connections 2024-04-04T06:56:39.049 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.049+0000 7f158e400640 1 -- 172.21.15.72:0/3245932697 wait complete. 2024-04-04T06:56:39.049 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.051+0000 7f158e400640 1 Processor -- start 2024-04-04T06:56:39.051 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.051+0000 7f158e400640 1 -- start start 2024-04-04T06:56:39.052 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.051+0000 7f158e400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1570003a00 0x7f158815b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:39.052 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.052+0000 7f158e400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f158813a970 0x7f158813adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:39.052 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.052+0000 7f158e400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f158813d620 0x7f158813daa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:39.052 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.052+0000 7f158e400640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f15880ce6c0 con 0x7f158813a970 2024-04-04T06:56:39.052 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.052+0000 7f158e400640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f1588145ca0 con 0x7f158813d620 2024-04-04T06:56:39.052 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.052+0000 7f158e400640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f15880ce840 con 0x7f1570003a00 2024-04-04T06:56:39.052 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.052+0000 7f1587e00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f158813a970 0x7f158813adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:39.052 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.052+0000 7f1587e00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f158813a970 0x7f158813adf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46504/0 (socket says 172.21.15.72:46504) 2024-04-04T06:56:39.052 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.052+0000 7f1587e00640 1 -- 172.21.15.72:0/2733347895 learned_addr learned my addr 172.21.15.72:0/2733347895 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:56:39.052 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.052+0000 7f158d000640 1 --2- 172.21.15.72:0/2733347895 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1570003a00 0x7f158815b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:39.052 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.052+0000 7f158da00640 1 --2- 172.21.15.72:0/2733347895 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f158813d620 0x7f158813daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:39.052 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.052+0000 7f1587e00640 1 -- 172.21.15.72:0/2733347895 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1570003a00 msgr2=0x7f158815b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:39.052 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.052+0000 7f1587e00640 1 --2- 172.21.15.72:0/2733347895 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1570003a00 0x7f158815b8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:39.053 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.052+0000 7f1587e00640 1 -- 172.21.15.72:0/2733347895 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f158813d620 msgr2=0x7f158813daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:39.053 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.052+0000 7f1587e00640 1 --2- 172.21.15.72:0/2733347895 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f158813d620 0x7f158813daa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:39.053 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.052+0000 7f1587e00640 1 -- 172.21.15.72:0/2733347895 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f158813fc90 con 0x7f158813a970 2024-04-04T06:56:39.053 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.053+0000 7f1587e00640 1 --2- 172.21.15.72:0/2733347895 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f158813a970 0x7f158813adf0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f157400e540 tx=0x7f157400ea00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:39.053 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.053+0000 7f1584c00640 1 -- 172.21.15.72:0/2733347895 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1574017070 con 0x7f158813a970 2024-04-04T06:56:39.053 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.053+0000 7f1584c00640 1 -- 172.21.15.72:0/2733347895 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1574013610 con 0x7f158813a970 2024-04-04T06:56:39.053 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.053+0000 7f1584c00640 1 -- 172.21.15.72:0/2733347895 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f157400f040 con 0x7f158813a970 2024-04-04T06:56:39.053 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.053+0000 7f158e400640 1 -- 172.21.15.72:0/2733347895 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f158813ff50 con 0x7f158813a970 2024-04-04T06:56:39.053 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.053+0000 7f158e400640 1 -- 172.21.15.72:0/2733347895 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1588140510 con 0x7f158813a970 2024-04-04T06:56:39.054 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.054+0000 7f158e400640 1 -- 172.21.15.72:0/2733347895 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15880756c0 con 0x7f158813a970 2024-04-04T06:56:39.054 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.055+0000 7f1584c00640 1 -- 172.21.15.72:0/2733347895 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f157401a070 con 0x7f158813a970 2024-04-04T06:56:39.055 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.056+0000 7f1584c00640 1 --2- 172.21.15.72:0/2733347895 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f156806c8f0 0x7f156806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:39.055 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.056+0000 7f1584c00640 1 -- 172.21.15.72:0/2733347895 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f157408b570 con 0x7f158813a970 2024-04-04T06:56:39.055 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.056+0000 7f158d000640 1 --2- 172.21.15.72:0/2733347895 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f156806c8f0 0x7f156806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:39.055 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.057+0000 7f158d000640 1 --2- 172.21.15.72:0/2733347895 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f156806c8f0 0x7f156806edb0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f157c00c160 tx=0x7f157c039040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:39.059 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.060+0000 7f1584c00640 1 -- 172.21.15.72:0/2733347895 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f15740599a0 con 0x7f158813a970 2024-04-04T06:56:39.245 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.247+0000 7f158e400640 1 -- 172.21.15.72:0/2733347895 --> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f15880732b0 con 0x7f156806c8f0 2024-04-04T06:56:39.252 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.253+0000 7f1584c00640 1 -- 172.21.15.72:0/2733347895 <== mgr.4101 v2:172.21.15.72:6832/2205173820 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251836 (secure 0 0 0) 0x7f15880732b0 con 0x7f156806c8f0 2024-04-04T06:56:39.255 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T06:56:39.256 INFO:teuthology.orchestra.run.smithi072.stderr:dumped all 2024-04-04T06:56:39.258 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.258+0000 7f158e400640 1 -- 172.21.15.72:0/2733347895 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f156806c8f0 msgr2=0x7f156806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:39.258 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.258+0000 7f158e400640 1 --2- 172.21.15.72:0/2733347895 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f156806c8f0 0x7f156806edb0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f157c00c160 tx=0x7f157c039040 comp rx=0 tx=0).stop 2024-04-04T06:56:39.258 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.258+0000 7f158e400640 1 -- 172.21.15.72:0/2733347895 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f158813a970 msgr2=0x7f158813adf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:39.258 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.258+0000 7f158e400640 1 --2- 172.21.15.72:0/2733347895 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f158813a970 0x7f158813adf0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f157400e540 tx=0x7f157400ea00 comp rx=0 tx=0).stop 2024-04-04T06:56:39.258 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.258+0000 7f158e400640 1 -- 172.21.15.72:0/2733347895 shutdown_connections 2024-04-04T06:56:39.259 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.258+0000 7f158e400640 1 --2- 172.21.15.72:0/2733347895 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f156806c8f0 0x7f156806edb0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:39.259 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.258+0000 7f158e400640 1 --2- 172.21.15.72:0/2733347895 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f158813d620 0x7f158813daa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:39.259 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.258+0000 7f158e400640 1 --2- 172.21.15.72:0/2733347895 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f158813a970 0x7f158813adf0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:39.259 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.258+0000 7f158e400640 1 --2- 172.21.15.72:0/2733347895 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1570003a00 0x7f158815b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:39.259 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.258+0000 7f158e400640 1 -- 172.21.15.72:0/2733347895 >> 172.21.15.72:0/2733347895 conn(0x7f15880b1840 msgr2=0x7f15880cebd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:56:39.259 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.259+0000 7f158e400640 1 -- 172.21.15.72:0/2733347895 shutdown_connections 2024-04-04T06:56:39.259 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.259+0000 7f158e400640 1 -- 172.21.15.72:0/2733347895 wait complete. 2024-04-04T06:56:39.275 INFO:teuthology.orchestra.run.smithi072.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-04-04T06:56:37.389969+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218996,"kb_used_data":2824,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755724,"statfs":{"total":773094113280,"available":772869861376,"internally_reserved":0,"allocated":2891776,"data_stored":1753028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.379764"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.021316+0000","last_change":"2024-04-04T06:56:29.041884+0000","last_active":"2024-04-04T06:56:30.021316+0000","last_peered":"2024-04-04T06:56:30.021316+0000","last_clean":"2024-04-04T06:56:30.021316+0000","last_became_active":"2024-04-04T06:56:29.041589+0000","last_became_peered":"2024-04-04T06:56:29.041589+0000","last_unstale":"2024-04-04T06:56:30.021316+0000","last_undegraded":"2024-04-04T06:56:30.021316+0000","last_fullsized":"2024-04-04T06:56:30.021316+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T17:09:54.896779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.016096+0000","last_change":"2024-04-04T06:56:29.044652+0000","last_active":"2024-04-04T06:56:30.016096+0000","last_peered":"2024-04-04T06:56:30.016096+0000","last_clean":"2024-04-04T06:56:30.016096+0000","last_became_active":"2024-04-04T06:56:29.044287+0000","last_became_peered":"2024-04-04T06:56:29.044287+0000","last_unstale":"2024-04-04T06:56:30.016096+0000","last_undegraded":"2024-04-04T06:56:30.016096+0000","last_fullsized":"2024-04-04T06:56:30.016096+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T16:44:39.332035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.698416+0000","last_change":"2024-04-04T06:56:29.044464+0000","last_active":"2024-04-04T06:56:30.698416+0000","last_peered":"2024-04-04T06:56:30.698416+0000","last_clean":"2024-04-04T06:56:30.698416+0000","last_became_active":"2024-04-04T06:56:29.044200+0000","last_became_peered":"2024-04-04T06:56:29.044200+0000","last_unstale":"2024-04-04T06:56:30.698416+0000","last_undegraded":"2024-04-04T06:56:30.698416+0000","last_fullsized":"2024-04-04T06:56:30.698416+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T15:25:18.489701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.698540+0000","last_change":"2024-04-04T06:56:29.058211+0000","last_active":"2024-04-04T06:56:30.698540+0000","last_peered":"2024-04-04T06:56:30.698540+0000","last_clean":"2024-04-04T06:56:30.698540+0000","last_became_active":"2024-04-04T06:56:29.057931+0000","last_became_peered":"2024-04-04T06:56:29.057931+0000","last_unstale":"2024-04-04T06:56:30.698540+0000","last_undegraded":"2024-04-04T06:56:30.698540+0000","last_fullsized":"2024-04-04T06:56:30.698540+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T17:04:57.682659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.020954+0000","last_change":"2024-04-04T06:56:29.043939+0000","last_active":"2024-04-04T06:56:30.020954+0000","last_peered":"2024-04-04T06:56:30.020954+0000","last_clean":"2024-04-04T06:56:30.020954+0000","last_became_active":"2024-04-04T06:56:29.043646+0000","last_became_peered":"2024-04-04T06:56:29.043646+0000","last_unstale":"2024-04-04T06:56:30.020954+0000","last_undegraded":"2024-04-04T06:56:30.020954+0000","last_fullsized":"2024-04-04T06:56:30.020954+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T18:38:49.851932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.698199+0000","last_change":"2024-04-04T06:56:29.036398+0000","last_active":"2024-04-04T06:56:30.698199+0000","last_peered":"2024-04-04T06:56:30.698199+0000","last_clean":"2024-04-04T06:56:30.698199+0000","last_became_active":"2024-04-04T06:56:29.036119+0000","last_became_peered":"2024-04-04T06:56:29.036119+0000","last_unstale":"2024-04-04T06:56:30.698199+0000","last_undegraded":"2024-04-04T06:56:30.698199+0000","last_fullsized":"2024-04-04T06:56:30.698199+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T12:11:26.884771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.018127+0000","last_change":"2024-04-04T06:56:29.033491+0000","last_active":"2024-04-04T06:56:30.018127+0000","last_peered":"2024-04-04T06:56:30.018127+0000","last_clean":"2024-04-04T06:56:30.018127+0000","last_became_active":"2024-04-04T06:56:29.033159+0000","last_became_peered":"2024-04-04T06:56:29.033159+0000","last_unstale":"2024-04-04T06:56:30.018127+0000","last_undegraded":"2024-04-04T06:56:30.018127+0000","last_fullsized":"2024-04-04T06:56:30.018127+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T17:04:57.682659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.701021+0000","last_change":"2024-04-04T06:56:29.058473+0000","last_active":"2024-04-04T06:56:30.701021+0000","last_peered":"2024-04-04T06:56:30.701021+0000","last_clean":"2024-04-04T06:56:30.701021+0000","last_became_active":"2024-04-04T06:56:29.057579+0000","last_became_peered":"2024-04-04T06:56:29.057579+0000","last_unstale":"2024-04-04T06:56:30.701021+0000","last_undegraded":"2024-04-04T06:56:30.701021+0000","last_fullsized":"2024-04-04T06:56:30.701021+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T15:25:18.489701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.021435+0000","last_change":"2024-04-04T06:56:29.036872+0000","last_active":"2024-04-04T06:56:30.021435+0000","last_peered":"2024-04-04T06:56:30.021435+0000","last_clean":"2024-04-04T06:56:30.021435+0000","last_became_active":"2024-04-04T06:56:29.035533+0000","last_became_peered":"2024-04-04T06:56:29.035533+0000","last_unstale":"2024-04-04T06:56:30.021435+0000","last_undegraded":"2024-04-04T06:56:30.021435+0000","last_fullsized":"2024-04-04T06:56:30.021435+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T09:03:00.078302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.062681+0000","last_change":"2024-04-04T06:56:29.048015+0000","last_active":"2024-04-04T06:56:30.062681+0000","last_peered":"2024-04-04T06:56:30.062681+0000","last_clean":"2024-04-04T06:56:30.062681+0000","last_became_active":"2024-04-04T06:56:29.047193+0000","last_became_peered":"2024-04-04T06:56:29.047193+0000","last_unstale":"2024-04-04T06:56:30.062681+0000","last_undegraded":"2024-04-04T06:56:30.062681+0000","last_fullsized":"2024-04-04T06:56:30.062681+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T12:11:26.884771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.062555+0000","last_change":"2024-04-04T06:56:29.048692+0000","last_active":"2024-04-04T06:56:30.062555+0000","last_peered":"2024-04-04T06:56:30.062555+0000","last_clean":"2024-04-04T06:56:30.062555+0000","last_became_active":"2024-04-04T06:56:29.048370+0000","last_became_peered":"2024-04-04T06:56:29.048370+0000","last_unstale":"2024-04-04T06:56:30.062555+0000","last_undegraded":"2024-04-04T06:56:30.062555+0000","last_fullsized":"2024-04-04T06:56:30.062555+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T08:11:58.552420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.019591+0000","last_change":"2024-04-04T06:56:29.043832+0000","last_active":"2024-04-04T06:56:30.019591+0000","last_peered":"2024-04-04T06:56:30.019591+0000","last_clean":"2024-04-04T06:56:30.019591+0000","last_became_active":"2024-04-04T06:56:29.043483+0000","last_became_peered":"2024-04-04T06:56:29.043483+0000","last_unstale":"2024-04-04T06:56:30.019591+0000","last_undegraded":"2024-04-04T06:56:30.019591+0000","last_fullsized":"2024-04-04T06:56:30.019591+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T16:54:06.987375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.701295+0000","last_change":"2024-04-04T06:56:29.051626+0000","last_active":"2024-04-04T06:56:30.701295+0000","last_peered":"2024-04-04T06:56:30.701295+0000","last_clean":"2024-04-04T06:56:30.701295+0000","last_became_active":"2024-04-04T06:56:29.051241+0000","last_became_peered":"2024-04-04T06:56:29.051241+0000","last_unstale":"2024-04-04T06:56:30.701295+0000","last_undegraded":"2024-04-04T06:56:30.701295+0000","last_fullsized":"2024-04-04T06:56:30.701295+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T13:04:16.108138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.698067+0000","last_change":"2024-04-04T06:56:29.042853+0000","last_active":"2024-04-04T06:56:30.698067+0000","last_peered":"2024-04-04T06:56:30.698067+0000","last_clean":"2024-04-04T06:56:30.698067+0000","last_became_active":"2024-04-04T06:56:29.041487+0000","last_became_peered":"2024-04-04T06:56:29.041487+0000","last_unstale":"2024-04-04T06:56:30.698067+0000","last_undegraded":"2024-04-04T06:56:30.698067+0000","last_fullsized":"2024-04-04T06:56:30.698067+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T17:11:13.036810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.015396+0000","last_change":"2024-04-04T06:56:29.043554+0000","last_active":"2024-04-04T06:56:30.015396+0000","last_peered":"2024-04-04T06:56:30.015396+0000","last_clean":"2024-04-04T06:56:30.015396+0000","last_became_active":"2024-04-04T06:56:29.043300+0000","last_became_peered":"2024-04-04T06:56:29.043300+0000","last_unstale":"2024-04-04T06:56:30.015396+0000","last_undegraded":"2024-04-04T06:56:30.015396+0000","last_fullsized":"2024-04-04T06:56:30.015396+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T15:25:18.489701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.698063+0000","last_change":"2024-04-04T06:56:29.038506+0000","last_active":"2024-04-04T06:56:30.698063+0000","last_peered":"2024-04-04T06:56:30.698063+0000","last_clean":"2024-04-04T06:56:30.698063+0000","last_became_active":"2024-04-04T06:56:29.038150+0000","last_became_peered":"2024-04-04T06:56:29.038150+0000","last_unstale":"2024-04-04T06:56:30.698063+0000","last_undegraded":"2024-04-04T06:56:30.698063+0000","last_fullsized":"2024-04-04T06:56:30.698063+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T16:44:39.332035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.699391+0000","last_change":"2024-04-04T06:56:29.049923+0000","last_active":"2024-04-04T06:56:30.699391+0000","last_peered":"2024-04-04T06:56:30.699391+0000","last_clean":"2024-04-04T06:56:30.699391+0000","last_became_active":"2024-04-04T06:56:29.049658+0000","last_became_peered":"2024-04-04T06:56:29.049658+0000","last_unstale":"2024-04-04T06:56:30.699391+0000","last_undegraded":"2024-04-04T06:56:30.699391+0000","last_fullsized":"2024-04-04T06:56:30.699391+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T09:03:00.078302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.697501+0000","last_change":"2024-04-04T06:56:29.042470+0000","last_active":"2024-04-04T06:56:30.697501+0000","last_peered":"2024-04-04T06:56:30.697501+0000","last_clean":"2024-04-04T06:56:30.697501+0000","last_became_active":"2024-04-04T06:56:29.041885+0000","last_became_peered":"2024-04-04T06:56:29.041885+0000","last_unstale":"2024-04-04T06:56:30.697501+0000","last_undegraded":"2024-04-04T06:56:30.697501+0000","last_fullsized":"2024-04-04T06:56:30.697501+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T12:35:21.057399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.021811+0000","last_change":"2024-04-04T06:56:29.042854+0000","last_active":"2024-04-04T06:56:30.021811+0000","last_peered":"2024-04-04T06:56:30.021811+0000","last_clean":"2024-04-04T06:56:30.021811+0000","last_became_active":"2024-04-04T06:56:29.042590+0000","last_became_peered":"2024-04-04T06:56:29.042590+0000","last_unstale":"2024-04-04T06:56:30.021811+0000","last_undegraded":"2024-04-04T06:56:30.021811+0000","last_fullsized":"2024-04-04T06:56:30.021811+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T18:19:42.642201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.062254+0000","last_change":"2024-04-04T06:56:29.051612+0000","last_active":"2024-04-04T06:56:30.062254+0000","last_peered":"2024-04-04T06:56:30.062254+0000","last_clean":"2024-04-04T06:56:30.062254+0000","last_became_active":"2024-04-04T06:56:29.051315+0000","last_became_peered":"2024-04-04T06:56:29.051315+0000","last_unstale":"2024-04-04T06:56:30.062254+0000","last_undegraded":"2024-04-04T06:56:30.062254+0000","last_fullsized":"2024-04-04T06:56:30.062254+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T13:04:16.108138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.698320+0000","last_change":"2024-04-04T06:56:29.038247+0000","last_active":"2024-04-04T06:56:30.698320+0000","last_peered":"2024-04-04T06:56:30.698320+0000","last_clean":"2024-04-04T06:56:30.698320+0000","last_became_active":"2024-04-04T06:56:29.037756+0000","last_became_peered":"2024-04-04T06:56:29.037756+0000","last_unstale":"2024-04-04T06:56:30.698320+0000","last_undegraded":"2024-04-04T06:56:30.698320+0000","last_fullsized":"2024-04-04T06:56:30.698320+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T10:40:36.659855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.698776+0000","last_change":"2024-04-04T06:56:29.048171+0000","last_active":"2024-04-04T06:56:30.698776+0000","last_peered":"2024-04-04T06:56:30.698776+0000","last_clean":"2024-04-04T06:56:30.698776+0000","last_became_active":"2024-04-04T06:56:29.045845+0000","last_became_peered":"2024-04-04T06:56:29.045845+0000","last_unstale":"2024-04-04T06:56:30.698776+0000","last_undegraded":"2024-04-04T06:56:30.698776+0000","last_fullsized":"2024-04-04T06:56:30.698776+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T08:09:51.101974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.701153+0000","last_change":"2024-04-04T06:56:29.051157+0000","last_active":"2024-04-04T06:56:30.701153+0000","last_peered":"2024-04-04T06:56:30.701153+0000","last_clean":"2024-04-04T06:56:30.701153+0000","last_became_active":"2024-04-04T06:56:29.050862+0000","last_became_peered":"2024-04-04T06:56:29.050862+0000","last_unstale":"2024-04-04T06:56:30.701153+0000","last_undegraded":"2024-04-04T06:56:30.701153+0000","last_fullsized":"2024-04-04T06:56:30.701153+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T10:04:08.170276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.699292+0000","last_change":"2024-04-04T06:56:29.052206+0000","last_active":"2024-04-04T06:56:30.699292+0000","last_peered":"2024-04-04T06:56:30.699292+0000","last_clean":"2024-04-04T06:56:30.699292+0000","last_became_active":"2024-04-04T06:56:29.051882+0000","last_became_peered":"2024-04-04T06:56:29.051882+0000","last_unstale":"2024-04-04T06:56:30.699292+0000","last_undegraded":"2024-04-04T06:56:30.699292+0000","last_fullsized":"2024-04-04T06:56:30.699292+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T17:09:54.896779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.701636+0000","last_change":"2024-04-04T06:56:29.052181+0000","last_active":"2024-04-04T06:56:30.701636+0000","last_peered":"2024-04-04T06:56:30.701636+0000","last_clean":"2024-04-04T06:56:30.701636+0000","last_became_active":"2024-04-04T06:56:29.052011+0000","last_became_peered":"2024-04-04T06:56:29.052011+0000","last_unstale":"2024-04-04T06:56:30.701636+0000","last_undegraded":"2024-04-04T06:56:30.701636+0000","last_fullsized":"2024-04-04T06:56:30.701636+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T18:13:03.204979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.062644+0000","last_change":"2024-04-04T06:56:29.050650+0000","last_active":"2024-04-04T06:56:30.062644+0000","last_peered":"2024-04-04T06:56:30.062644+0000","last_clean":"2024-04-04T06:56:30.062644+0000","last_became_active":"2024-04-04T06:56:29.050382+0000","last_became_peered":"2024-04-04T06:56:29.050382+0000","last_unstale":"2024-04-04T06:56:30.062644+0000","last_undegraded":"2024-04-04T06:56:30.062644+0000","last_fullsized":"2024-04-04T06:56:30.062644+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T16:44:39.332035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.016177+0000","last_change":"2024-04-04T06:56:29.058438+0000","last_active":"2024-04-04T06:56:30.016177+0000","last_peered":"2024-04-04T06:56:30.016177+0000","last_clean":"2024-04-04T06:56:30.016177+0000","last_became_active":"2024-04-04T06:56:29.058155+0000","last_became_peered":"2024-04-04T06:56:29.058155+0000","last_unstale":"2024-04-04T06:56:30.016177+0000","last_undegraded":"2024-04-04T06:56:30.016177+0000","last_fullsized":"2024-04-04T06:56:30.016177+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T12:11:26.884771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.701823+0000","last_change":"2024-04-04T06:56:29.055605+0000","last_active":"2024-04-04T06:56:30.701823+0000","last_peered":"2024-04-04T06:56:30.701823+0000","last_clean":"2024-04-04T06:56:30.701823+0000","last_became_active":"2024-04-04T06:56:29.052573+0000","last_became_peered":"2024-04-04T06:56:29.052573+0000","last_unstale":"2024-04-04T06:56:30.701823+0000","last_undegraded":"2024-04-04T06:56:30.701823+0000","last_fullsized":"2024-04-04T06:56:30.701823+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T08:09:51.101974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.698490+0000","last_change":"2024-04-04T06:56:29.054105+0000","last_active":"2024-04-04T06:56:30.698490+0000","last_peered":"2024-04-04T06:56:30.698490+0000","last_clean":"2024-04-04T06:56:30.698490+0000","last_became_active":"2024-04-04T06:56:29.053803+0000","last_became_peered":"2024-04-04T06:56:29.053803+0000","last_unstale":"2024-04-04T06:56:30.698490+0000","last_undegraded":"2024-04-04T06:56:30.698490+0000","last_fullsized":"2024-04-04T06:56:30.698490+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T10:04:08.170276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.698508+0000","last_change":"2024-04-04T06:56:29.058755+0000","last_active":"2024-04-04T06:56:30.698508+0000","last_peered":"2024-04-04T06:56:30.698508+0000","last_clean":"2024-04-04T06:56:30.698508+0000","last_became_active":"2024-04-04T06:56:29.058413+0000","last_became_peered":"2024-04-04T06:56:29.058413+0000","last_unstale":"2024-04-04T06:56:30.698508+0000","last_undegraded":"2024-04-04T06:56:30.698508+0000","last_fullsized":"2024-04-04T06:56:30.698508+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T18:13:03.204979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.697222+0000","last_change":"2024-04-04T06:56:29.047614+0000","last_active":"2024-04-04T06:56:30.697222+0000","last_peered":"2024-04-04T06:56:30.697222+0000","last_clean":"2024-04-04T06:56:30.697222+0000","last_became_active":"2024-04-04T06:56:29.047371+0000","last_became_peered":"2024-04-04T06:56:29.047371+0000","last_unstale":"2024-04-04T06:56:30.697222+0000","last_undegraded":"2024-04-04T06:56:30.697222+0000","last_fullsized":"2024-04-04T06:56:30.697222+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T15:15:24.660634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.061901+0000","last_change":"2024-04-04T06:56:29.052722+0000","last_active":"2024-04-04T06:56:30.061901+0000","last_peered":"2024-04-04T06:56:30.061901+0000","last_clean":"2024-04-04T06:56:30.061901+0000","last_became_active":"2024-04-04T06:56:29.052245+0000","last_became_peered":"2024-04-04T06:56:29.052245+0000","last_unstale":"2024-04-04T06:56:30.061901+0000","last_undegraded":"2024-04-04T06:56:30.061901+0000","last_fullsized":"2024-04-04T06:56:30.061901+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T15:25:18.489701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.019151+0000","last_change":"2024-04-04T06:56:29.042686+0000","last_active":"2024-04-04T06:56:30.019151+0000","last_peered":"2024-04-04T06:56:30.019151+0000","last_clean":"2024-04-04T06:56:30.019151+0000","last_became_active":"2024-04-04T06:56:29.042124+0000","last_became_peered":"2024-04-04T06:56:29.042124+0000","last_unstale":"2024-04-04T06:56:30.019151+0000","last_undegraded":"2024-04-04T06:56:30.019151+0000","last_fullsized":"2024-04-04T06:56:30.019151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T13:32:45.903109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.701378+0000","last_change":"2024-04-04T06:56:28.001896+0000","last_active":"2024-04-04T06:56:30.701378+0000","last_peered":"2024-04-04T06:56:30.701378+0000","last_clean":"2024-04-04T06:56:30.701378+0000","last_became_active":"2024-04-04T06:56:28.001625+0000","last_became_peered":"2024-04-04T06:56:28.001625+0000","last_unstale":"2024-04-04T06:56:30.701378+0000","last_undegraded":"2024-04-04T06:56:30.701378+0000","last_fullsized":"2024-04-04T06:56:30.701378+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_clean_scrub_stamp":"2024-04-04T06:56:26.956814+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T13:33:08.840819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.698738+0000","last_change":"2024-04-04T06:56:29.031379+0000","last_active":"2024-04-04T06:56:30.698738+0000","last_peered":"2024-04-04T06:56:30.698738+0000","last_clean":"2024-04-04T06:56:30.698738+0000","last_became_active":"2024-04-04T06:56:29.028243+0000","last_became_peered":"2024-04-04T06:56:29.028243+0000","last_unstale":"2024-04-04T06:56:30.698738+0000","last_undegraded":"2024-04-04T06:56:30.698738+0000","last_fullsized":"2024-04-04T06:56:30.698738+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T08:11:58.552420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.061880+0000","last_change":"2024-04-04T06:56:28.012107+0000","last_active":"2024-04-04T06:56:30.061880+0000","last_peered":"2024-04-04T06:56:30.061880+0000","last_clean":"2024-04-04T06:56:30.061880+0000","last_became_active":"2024-04-04T06:56:28.011477+0000","last_became_peered":"2024-04-04T06:56:28.011477+0000","last_unstale":"2024-04-04T06:56:30.061880+0000","last_undegraded":"2024-04-04T06:56:30.061880+0000","last_fullsized":"2024-04-04T06:56:30.061880+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_clean_scrub_stamp":"2024-04-04T06:56:26.956814+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T16:13:09.520714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.700896+0000","last_change":"2024-04-04T06:56:28.013179+0000","last_active":"2024-04-04T06:56:30.700896+0000","last_peered":"2024-04-04T06:56:30.700896+0000","last_clean":"2024-04-04T06:56:30.700896+0000","last_became_active":"2024-04-04T06:56:28.012858+0000","last_became_peered":"2024-04-04T06:56:28.012858+0000","last_unstale":"2024-04-04T06:56:30.700896+0000","last_undegraded":"2024-04-04T06:56:30.700896+0000","last_fullsized":"2024-04-04T06:56:30.700896+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_clean_scrub_stamp":"2024-04-04T06:56:26.956814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T13:47:51.595456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.700825+0000","last_change":"2024-04-04T06:56:29.058027+0000","last_active":"2024-04-04T06:56:30.700825+0000","last_peered":"2024-04-04T06:56:30.700825+0000","last_clean":"2024-04-04T06:56:30.700825+0000","last_became_active":"2024-04-04T06:56:29.055298+0000","last_became_peered":"2024-04-04T06:56:29.055298+0000","last_unstale":"2024-04-04T06:56:30.700825+0000","last_undegraded":"2024-04-04T06:56:30.700825+0000","last_fullsized":"2024-04-04T06:56:30.700825+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T18:01:37.763615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.698254+0000","last_change":"2024-04-04T06:56:28.007500+0000","last_active":"2024-04-04T06:56:30.698254+0000","last_peered":"2024-04-04T06:56:30.698254+0000","last_clean":"2024-04-04T06:56:30.698254+0000","last_became_active":"2024-04-04T06:56:28.007056+0000","last_became_peered":"2024-04-04T06:56:28.007056+0000","last_unstale":"2024-04-04T06:56:30.698254+0000","last_undegraded":"2024-04-04T06:56:30.698254+0000","last_fullsized":"2024-04-04T06:56:30.698254+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_clean_scrub_stamp":"2024-04-04T06:56:26.956814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T09:54:19.792854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.015421+0000","last_change":"2024-04-04T06:56:29.067716+0000","last_active":"2024-04-04T06:56:30.015421+0000","last_peered":"2024-04-04T06:56:30.015421+0000","last_clean":"2024-04-04T06:56:30.015421+0000","last_became_active":"2024-04-04T06:56:29.067142+0000","last_became_peered":"2024-04-04T06:56:29.067142+0000","last_unstale":"2024-04-04T06:56:30.015421+0000","last_undegraded":"2024-04-04T06:56:30.015421+0000","last_fullsized":"2024-04-04T06:56:30.015421+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T10:04:08.170276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.062468+0000","last_change":"2024-04-04T06:56:28.015953+0000","last_active":"2024-04-04T06:56:30.062468+0000","last_peered":"2024-04-04T06:56:30.062468+0000","last_clean":"2024-04-04T06:56:30.062468+0000","last_became_active":"2024-04-04T06:56:28.015699+0000","last_became_peered":"2024-04-04T06:56:28.015699+0000","last_unstale":"2024-04-04T06:56:30.062468+0000","last_undegraded":"2024-04-04T06:56:30.062468+0000","last_fullsized":"2024-04-04T06:56:30.062468+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_clean_scrub_stamp":"2024-04-04T06:56:26.956814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T08:38:32.735117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.698943+0000","last_change":"2024-04-04T06:56:29.046517+0000","last_active":"2024-04-04T06:56:30.698943+0000","last_peered":"2024-04-04T06:56:30.698943+0000","last_clean":"2024-04-04T06:56:30.698943+0000","last_became_active":"2024-04-04T06:56:29.046107+0000","last_became_peered":"2024-04-04T06:56:29.046107+0000","last_unstale":"2024-04-04T06:56:30.698943+0000","last_undegraded":"2024-04-04T06:56:30.698943+0000","last_fullsized":"2024-04-04T06:56:30.698943+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T12:03:12.792963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.699100+0000","last_change":"2024-04-04T06:56:28.019198+0000","last_active":"2024-04-04T06:56:30.699100+0000","last_peered":"2024-04-04T06:56:30.699100+0000","last_clean":"2024-04-04T06:56:30.699100+0000","last_became_active":"2024-04-04T06:56:28.018911+0000","last_became_peered":"2024-04-04T06:56:28.018911+0000","last_unstale":"2024-04-04T06:56:30.699100+0000","last_undegraded":"2024-04-04T06:56:30.699100+0000","last_fullsized":"2024-04-04T06:56:30.699100+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_clean_scrub_stamp":"2024-04-04T06:56:26.956814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T15:15:23.654438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.699396+0000","last_change":"2024-04-04T06:56:29.049229+0000","last_active":"2024-04-04T06:56:30.699396+0000","last_peered":"2024-04-04T06:56:30.699396+0000","last_clean":"2024-04-04T06:56:30.699396+0000","last_became_active":"2024-04-04T06:56:29.048110+0000","last_became_peered":"2024-04-04T06:56:29.048110+0000","last_unstale":"2024-04-04T06:56:30.699396+0000","last_undegraded":"2024-04-04T06:56:30.699396+0000","last_fullsized":"2024-04-04T06:56:30.699396+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T12:11:26.884771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.015873+0000","last_change":"2024-04-04T06:56:28.009331+0000","last_active":"2024-04-04T06:56:30.015873+0000","last_peered":"2024-04-04T06:56:30.015873+0000","last_clean":"2024-04-04T06:56:30.015873+0000","last_became_active":"2024-04-04T06:56:28.009044+0000","last_became_peered":"2024-04-04T06:56:28.009044+0000","last_unstale":"2024-04-04T06:56:30.015873+0000","last_undegraded":"2024-04-04T06:56:30.015873+0000","last_fullsized":"2024-04-04T06:56:30.015873+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_clean_scrub_stamp":"2024-04-04T06:56:26.956814+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T08:38:32.735117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.019776+0000","last_change":"2024-04-04T06:56:29.037028+0000","last_active":"2024-04-04T06:56:30.019776+0000","last_peered":"2024-04-04T06:56:30.019776+0000","last_clean":"2024-04-04T06:56:30.019776+0000","last_became_active":"2024-04-04T06:56:29.036771+0000","last_became_peered":"2024-04-04T06:56:29.036771+0000","last_unstale":"2024-04-04T06:56:30.019776+0000","last_undegraded":"2024-04-04T06:56:30.019776+0000","last_fullsized":"2024-04-04T06:56:30.019776+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T15:15:24.660634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.062098+0000","last_change":"2024-04-04T06:56:28.017650+0000","last_active":"2024-04-04T06:56:30.062098+0000","last_peered":"2024-04-04T06:56:30.062098+0000","last_clean":"2024-04-04T06:56:30.062098+0000","last_became_active":"2024-04-04T06:56:28.017083+0000","last_became_peered":"2024-04-04T06:56:28.017083+0000","last_unstale":"2024-04-04T06:56:30.062098+0000","last_undegraded":"2024-04-04T06:56:30.062098+0000","last_fullsized":"2024-04-04T06:56:30.062098+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_clean_scrub_stamp":"2024-04-04T06:56:26.956814+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T09:54:19.792854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.018695+0000","last_change":"2024-04-04T06:56:29.053241+0000","last_active":"2024-04-04T06:56:30.018695+0000","last_peered":"2024-04-04T06:56:30.018695+0000","last_clean":"2024-04-04T06:56:30.018695+0000","last_became_active":"2024-04-04T06:56:29.052948+0000","last_became_peered":"2024-04-04T06:56:29.052948+0000","last_unstale":"2024-04-04T06:56:30.018695+0000","last_undegraded":"2024-04-04T06:56:30.018695+0000","last_fullsized":"2024-04-04T06:56:30.018695+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T08:09:51.101974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.698548+0000","last_change":"2024-04-04T06:56:27.997550+0000","last_active":"2024-04-04T06:56:30.698548+0000","last_peered":"2024-04-04T06:56:30.698548+0000","last_clean":"2024-04-04T06:56:30.698548+0000","last_became_active":"2024-04-04T06:56:27.997242+0000","last_became_peered":"2024-04-04T06:56:27.997242+0000","last_unstale":"2024-04-04T06:56:30.698548+0000","last_undegraded":"2024-04-04T06:56:30.698548+0000","last_fullsized":"2024-04-04T06:56:30.698548+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_clean_scrub_stamp":"2024-04-04T06:56:26.956814+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T13:33:08.840819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.698091+0000","last_change":"2024-04-04T06:56:29.044039+0000","last_active":"2024-04-04T06:56:30.698091+0000","last_peered":"2024-04-04T06:56:30.698091+0000","last_clean":"2024-04-04T06:56:30.698091+0000","last_became_active":"2024-04-04T06:56:29.043302+0000","last_became_peered":"2024-04-04T06:56:29.043302+0000","last_unstale":"2024-04-04T06:56:30.698091+0000","last_undegraded":"2024-04-04T06:56:30.698091+0000","last_fullsized":"2024-04-04T06:56:30.698091+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T18:01:37.763615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.698610+0000","last_change":"2024-04-04T06:56:28.014841+0000","last_active":"2024-04-04T06:56:30.698610+0000","last_peered":"2024-04-04T06:56:30.698610+0000","last_clean":"2024-04-04T06:56:30.698610+0000","last_became_active":"2024-04-04T06:56:28.011606+0000","last_became_peered":"2024-04-04T06:56:28.011606+0000","last_unstale":"2024-04-04T06:56:30.698610+0000","last_undegraded":"2024-04-04T06:56:30.698610+0000","last_fullsized":"2024-04-04T06:56:30.698610+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_clean_scrub_stamp":"2024-04-04T06:56:26.956814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T13:32:44.896913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.021248+0000","last_change":"2024-04-04T06:56:29.035188+0000","last_active":"2024-04-04T06:56:30.021248+0000","last_peered":"2024-04-04T06:56:30.021248+0000","last_clean":"2024-04-04T06:56:30.021248+0000","last_became_active":"2024-04-04T06:56:29.034915+0000","last_became_peered":"2024-04-04T06:56:29.034915+0000","last_unstale":"2024-04-04T06:56:30.021248+0000","last_undegraded":"2024-04-04T06:56:30.021248+0000","last_fullsized":"2024-04-04T06:56:30.021248+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T16:01:05.840859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.061612+0000","last_change":"2024-04-04T06:56:28.016246+0000","last_active":"2024-04-04T06:56:30.061612+0000","last_peered":"2024-04-04T06:56:30.061612+0000","last_clean":"2024-04-04T06:56:30.061612+0000","last_became_active":"2024-04-04T06:56:28.014193+0000","last_became_peered":"2024-04-04T06:56:28.014193+0000","last_unstale":"2024-04-04T06:56:30.061612+0000","last_undegraded":"2024-04-04T06:56:30.061612+0000","last_fullsized":"2024-04-04T06:56:30.061612+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_clean_scrub_stamp":"2024-04-04T06:56:26.956814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T10:18:31.915978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.061865+0000","last_change":"2024-04-04T06:56:29.052430+0000","last_active":"2024-04-04T06:56:30.061865+0000","last_peered":"2024-04-04T06:56:30.061865+0000","last_clean":"2024-04-04T06:56:30.061865+0000","last_became_active":"2024-04-04T06:56:29.052112+0000","last_became_peered":"2024-04-04T06:56:29.052112+0000","last_unstale":"2024-04-04T06:56:30.061865+0000","last_undegraded":"2024-04-04T06:56:30.061865+0000","last_fullsized":"2024-04-04T06:56:30.061865+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T10:40:36.659855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.696511+0000","last_change":"2024-04-04T06:56:27.998416+0000","last_active":"2024-04-04T06:56:30.696511+0000","last_peered":"2024-04-04T06:56:30.696511+0000","last_clean":"2024-04-04T06:56:30.696511+0000","last_became_active":"2024-04-04T06:56:27.997342+0000","last_became_peered":"2024-04-04T06:56:27.997342+0000","last_unstale":"2024-04-04T06:56:30.696511+0000","last_undegraded":"2024-04-04T06:56:30.696511+0000","last_fullsized":"2024-04-04T06:56:30.696511+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_clean_scrub_stamp":"2024-04-04T06:56:26.956814+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T10:18:31.915978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.020893+0000","last_change":"2024-04-04T06:56:29.033505+0000","last_active":"2024-04-04T06:56:30.020893+0000","last_peered":"2024-04-04T06:56:30.020893+0000","last_clean":"2024-04-04T06:56:30.020893+0000","last_became_active":"2024-04-04T06:56:29.032725+0000","last_became_peered":"2024-04-04T06:56:29.032725+0000","last_unstale":"2024-04-04T06:56:30.020893+0000","last_undegraded":"2024-04-04T06:56:30.020893+0000","last_fullsized":"2024-04-04T06:56:30.020893+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T12:03:12.792963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.020304+0000","last_change":"2024-04-04T06:56:27.999979+0000","last_active":"2024-04-04T06:56:30.020304+0000","last_peered":"2024-04-04T06:56:30.020304+0000","last_clean":"2024-04-04T06:56:30.020304+0000","last_became_active":"2024-04-04T06:56:27.999169+0000","last_became_peered":"2024-04-04T06:56:27.999169+0000","last_unstale":"2024-04-04T06:56:30.020304+0000","last_undegraded":"2024-04-04T06:56:30.020304+0000","last_fullsized":"2024-04-04T06:56:30.020304+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_clean_scrub_stamp":"2024-04-04T06:56:26.956814+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T12:03:09.060630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.021458+0000","last_change":"2024-04-04T06:56:29.043619+0000","last_active":"2024-04-04T06:56:30.021458+0000","last_peered":"2024-04-04T06:56:30.021458+0000","last_clean":"2024-04-04T06:56:30.021458+0000","last_became_active":"2024-04-04T06:56:29.043335+0000","last_became_peered":"2024-04-04T06:56:29.043335+0000","last_unstale":"2024-04-04T06:56:30.021458+0000","last_undegraded":"2024-04-04T06:56:30.021458+0000","last_fullsized":"2024-04-04T06:56:30.021458+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T10:52:30.479480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.697225+0000","last_change":"2024-04-04T06:56:27.999367+0000","last_active":"2024-04-04T06:56:30.697225+0000","last_peered":"2024-04-04T06:56:30.697225+0000","last_clean":"2024-04-04T06:56:30.697225+0000","last_became_active":"2024-04-04T06:56:27.999073+0000","last_became_peered":"2024-04-04T06:56:27.999073+0000","last_unstale":"2024-04-04T06:56:30.697225+0000","last_undegraded":"2024-04-04T06:56:30.697225+0000","last_fullsized":"2024-04-04T06:56:30.697225+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_clean_scrub_stamp":"2024-04-04T06:56:26.956814+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T09:54:19.792854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.021694+0000","last_change":"2024-04-04T06:56:29.047512+0000","last_active":"2024-04-04T06:56:30.021694+0000","last_peered":"2024-04-04T06:56:30.021694+0000","last_clean":"2024-04-04T06:56:30.021694+0000","last_became_active":"2024-04-04T06:56:29.046259+0000","last_became_peered":"2024-04-04T06:56:29.046259+0000","last_unstale":"2024-04-04T06:56:30.021694+0000","last_undegraded":"2024-04-04T06:56:30.021694+0000","last_fullsized":"2024-04-04T06:56:30.021694+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T11:46:36.780783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.016251+0000","last_change":"2024-04-04T06:56:27.999707+0000","last_active":"2024-04-04T06:56:30.016251+0000","last_peered":"2024-04-04T06:56:30.016251+0000","last_clean":"2024-04-04T06:56:30.016251+0000","last_became_active":"2024-04-04T06:56:27.999398+0000","last_became_peered":"2024-04-04T06:56:27.999398+0000","last_unstale":"2024-04-04T06:56:30.016251+0000","last_undegraded":"2024-04-04T06:56:30.016251+0000","last_fullsized":"2024-04-04T06:56:30.016251+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_clean_scrub_stamp":"2024-04-04T06:56:26.956814+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T16:54:05.981179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.699399+0000","last_change":"2024-04-04T06:56:29.067217+0000","last_active":"2024-04-04T06:56:30.699399+0000","last_peered":"2024-04-04T06:56:30.699399+0000","last_clean":"2024-04-04T06:56:30.699399+0000","last_became_active":"2024-04-04T06:56:29.066762+0000","last_became_peered":"2024-04-04T06:56:29.066762+0000","last_unstale":"2024-04-04T06:56:30.699399+0000","last_undegraded":"2024-04-04T06:56:30.699399+0000","last_fullsized":"2024-04-04T06:56:30.699399+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T10:52:30.479480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.696812+0000","last_change":"2024-04-04T06:56:28.017607+0000","last_active":"2024-04-04T06:56:30.696812+0000","last_peered":"2024-04-04T06:56:30.696812+0000","last_clean":"2024-04-04T06:56:30.696812+0000","last_became_active":"2024-04-04T06:56:28.017322+0000","last_became_peered":"2024-04-04T06:56:28.017322+0000","last_unstale":"2024-04-04T06:56:30.696812+0000","last_undegraded":"2024-04-04T06:56:30.696812+0000","last_fullsized":"2024-04-04T06:56:30.696812+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_clean_scrub_stamp":"2024-04-04T06:56:26.956814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T16:13:09.520714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.020775+0000","last_change":"2024-04-04T06:56:29.044164+0000","last_active":"2024-04-04T06:56:30.020775+0000","last_peered":"2024-04-04T06:56:30.020775+0000","last_clean":"2024-04-04T06:56:30.020775+0000","last_became_active":"2024-04-04T06:56:29.043814+0000","last_became_peered":"2024-04-04T06:56:29.043814+0000","last_unstale":"2024-04-04T06:56:30.020775+0000","last_undegraded":"2024-04-04T06:56:30.020775+0000","last_fullsized":"2024-04-04T06:56:30.020775+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T10:24:01.060246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":170,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.017600+0000","last_change":"2024-04-04T06:56:19.364611+0000","last_active":"2024-04-04T06:56:30.017600+0000","last_peered":"2024-04-04T06:56:30.017600+0000","last_clean":"2024-04-04T06:56:30.017600+0000","last_became_active":"2024-04-04T06:56:19.362232+0000","last_became_peered":"2024-04-04T06:56:19.362232+0000","last_unstale":"2024-04-04T06:56:30.017600+0000","last_undegraded":"2024-04-04T06:56:30.017600+0000","last_fullsized":"2024-04-04T06:56:30.017600+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:17.744258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:17.744258+0000","last_clean_scrub_stamp":"2024-04-04T06:56:17.744258+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T17:25:16.494215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.698001+0000","last_change":"2024-04-04T06:56:28.009818+0000","last_active":"2024-04-04T06:56:30.698001+0000","last_peered":"2024-04-04T06:56:30.698001+0000","last_clean":"2024-04-04T06:56:30.698001+0000","last_became_active":"2024-04-04T06:56:28.005509+0000","last_became_peered":"2024-04-04T06:56:28.005509+0000","last_unstale":"2024-04-04T06:56:30.698001+0000","last_undegraded":"2024-04-04T06:56:30.698001+0000","last_fullsized":"2024-04-04T06:56:30.698001+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_clean_scrub_stamp":"2024-04-04T06:56:26.956814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T10:18:31.915978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.701399+0000","last_change":"2024-04-04T06:56:29.056563+0000","last_active":"2024-04-04T06:56:30.701399+0000","last_peered":"2024-04-04T06:56:30.701399+0000","last_clean":"2024-04-04T06:56:30.701399+0000","last_became_active":"2024-04-04T06:56:29.056289+0000","last_became_peered":"2024-04-04T06:56:29.056289+0000","last_unstale":"2024-04-04T06:56:30.701399+0000","last_undegraded":"2024-04-04T06:56:30.701399+0000","last_fullsized":"2024-04-04T06:56:30.701399+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T16:44:39.332035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.017655+0000","last_change":"2024-04-04T06:56:28.008107+0000","last_active":"2024-04-04T06:56:30.017655+0000","last_peered":"2024-04-04T06:56:30.017655+0000","last_clean":"2024-04-04T06:56:30.017655+0000","last_became_active":"2024-04-04T06:56:28.007840+0000","last_became_peered":"2024-04-04T06:56:28.007840+0000","last_unstale":"2024-04-04T06:56:30.017655+0000","last_undegraded":"2024-04-04T06:56:30.017655+0000","last_fullsized":"2024-04-04T06:56:30.017655+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_clean_scrub_stamp":"2024-04-04T06:56:26.956814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T16:54:05.981179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.697676+0000","last_change":"2024-04-04T06:56:29.026533+0000","last_active":"2024-04-04T06:56:30.697676+0000","last_peered":"2024-04-04T06:56:30.697676+0000","last_clean":"2024-04-04T06:56:30.697676+0000","last_became_active":"2024-04-04T06:56:29.025763+0000","last_became_peered":"2024-04-04T06:56:29.025763+0000","last_unstale":"2024-04-04T06:56:30.697676+0000","last_undegraded":"2024-04-04T06:56:30.697676+0000","last_fullsized":"2024-04-04T06:56:30.697676+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T14:56:36.711210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.696766+0000","last_change":"2024-04-04T06:56:27.994114+0000","last_active":"2024-04-04T06:56:30.696766+0000","last_peered":"2024-04-04T06:56:30.696766+0000","last_clean":"2024-04-04T06:56:30.696766+0000","last_became_active":"2024-04-04T06:56:27.993840+0000","last_became_peered":"2024-04-04T06:56:27.993840+0000","last_unstale":"2024-04-04T06:56:30.696766+0000","last_undegraded":"2024-04-04T06:56:30.696766+0000","last_fullsized":"2024-04-04T06:56:30.696766+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_clean_scrub_stamp":"2024-04-04T06:56:26.956814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T13:32:44.896913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.015501+0000","last_change":"2024-04-04T06:56:29.047339+0000","last_active":"2024-04-04T06:56:30.015501+0000","last_peered":"2024-04-04T06:56:30.015501+0000","last_clean":"2024-04-04T06:56:30.015501+0000","last_became_active":"2024-04-04T06:56:29.047084+0000","last_became_peered":"2024-04-04T06:56:29.047084+0000","last_unstale":"2024-04-04T06:56:30.015501+0000","last_undegraded":"2024-04-04T06:56:30.015501+0000","last_fullsized":"2024-04-04T06:56:30.015501+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T13:04:16.108138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.698907+0000","last_change":"2024-04-04T06:56:28.011081+0000","last_active":"2024-04-04T06:56:30.698907+0000","last_peered":"2024-04-04T06:56:30.698907+0000","last_clean":"2024-04-04T06:56:30.698907+0000","last_became_active":"2024-04-04T06:56:28.010741+0000","last_became_peered":"2024-04-04T06:56:28.010741+0000","last_unstale":"2024-04-04T06:56:30.698907+0000","last_undegraded":"2024-04-04T06:56:30.698907+0000","last_fullsized":"2024-04-04T06:56:30.698907+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_clean_scrub_stamp":"2024-04-04T06:56:26.956814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T08:38:32.735117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.019466+0000","last_change":"2024-04-04T06:56:29.038187+0000","last_active":"2024-04-04T06:56:30.019466+0000","last_peered":"2024-04-04T06:56:30.019466+0000","last_clean":"2024-04-04T06:56:30.019466+0000","last_became_active":"2024-04-04T06:56:29.037716+0000","last_became_peered":"2024-04-04T06:56:29.037716+0000","last_unstale":"2024-04-04T06:56:30.019466+0000","last_undegraded":"2024-04-04T06:56:30.019466+0000","last_fullsized":"2024-04-04T06:56:30.019466+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T08:38:33.741314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.015764+0000","last_change":"2024-04-04T06:56:28.006139+0000","last_active":"2024-04-04T06:56:30.015764+0000","last_peered":"2024-04-04T06:56:30.015764+0000","last_clean":"2024-04-04T06:56:30.015764+0000","last_became_active":"2024-04-04T06:56:28.005763+0000","last_became_peered":"2024-04-04T06:56:28.005763+0000","last_unstale":"2024-04-04T06:56:30.015764+0000","last_undegraded":"2024-04-04T06:56:30.015764+0000","last_fullsized":"2024-04-04T06:56:30.015764+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_clean_scrub_stamp":"2024-04-04T06:56:26.956814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T13:32:44.896913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.699033+0000","last_change":"2024-04-04T06:56:29.058128+0000","last_active":"2024-04-04T06:56:30.699033+0000","last_peered":"2024-04-04T06:56:30.699033+0000","last_clean":"2024-04-04T06:56:30.699033+0000","last_became_active":"2024-04-04T06:56:29.057809+0000","last_became_peered":"2024-04-04T06:56:29.057809+0000","last_unstale":"2024-04-04T06:56:30.699033+0000","last_undegraded":"2024-04-04T06:56:30.699033+0000","last_fullsized":"2024-04-04T06:56:30.699033+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T16:01:05.840859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.020996+0000","last_change":"2024-04-04T06:56:28.012156+0000","last_active":"2024-04-04T06:56:30.020996+0000","last_peered":"2024-04-04T06:56:30.020996+0000","last_clean":"2024-04-04T06:56:30.020996+0000","last_became_active":"2024-04-04T06:56:28.011880+0000","last_became_peered":"2024-04-04T06:56:28.011880+0000","last_unstale":"2024-04-04T06:56:30.020996+0000","last_undegraded":"2024-04-04T06:56:30.020996+0000","last_fullsized":"2024-04-04T06:56:30.020996+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_clean_scrub_stamp":"2024-04-04T06:56:26.956814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T10:21:04.212235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.015724+0000","last_change":"2024-04-04T06:56:29.042619+0000","last_active":"2024-04-04T06:56:30.015724+0000","last_peered":"2024-04-04T06:56:30.015724+0000","last_clean":"2024-04-04T06:56:30.015724+0000","last_became_active":"2024-04-04T06:56:29.042331+0000","last_became_peered":"2024-04-04T06:56:29.042331+0000","last_unstale":"2024-04-04T06:56:30.015724+0000","last_undegraded":"2024-04-04T06:56:30.015724+0000","last_fullsized":"2024-04-04T06:56:30.015724+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T08:11:58.552420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.016292+0000","last_change":"2024-04-04T06:56:28.014328+0000","last_active":"2024-04-04T06:56:30.016292+0000","last_peered":"2024-04-04T06:56:30.016292+0000","last_clean":"2024-04-04T06:56:30.016292+0000","last_became_active":"2024-04-04T06:56:28.014076+0000","last_became_peered":"2024-04-04T06:56:28.014076+0000","last_unstale":"2024-04-04T06:56:30.016292+0000","last_undegraded":"2024-04-04T06:56:30.016292+0000","last_fullsized":"2024-04-04T06:56:30.016292+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_clean_scrub_stamp":"2024-04-04T06:56:26.956814+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T15:15:23.654438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.701803+0000","last_change":"2024-04-04T06:56:29.051193+0000","last_active":"2024-04-04T06:56:30.701803+0000","last_peered":"2024-04-04T06:56:30.701803+0000","last_clean":"2024-04-04T06:56:30.701803+0000","last_became_active":"2024-04-04T06:56:29.045454+0000","last_became_peered":"2024-04-04T06:56:29.045454+0000","last_unstale":"2024-04-04T06:56:30.701803+0000","last_undegraded":"2024-04-04T06:56:30.701803+0000","last_fullsized":"2024-04-04T06:56:30.701803+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T17:04:57.682659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.062601+0000","last_change":"2024-04-04T06:56:28.012644+0000","last_active":"2024-04-04T06:56:30.062601+0000","last_peered":"2024-04-04T06:56:30.062601+0000","last_clean":"2024-04-04T06:56:30.062601+0000","last_became_active":"2024-04-04T06:56:28.012293+0000","last_became_peered":"2024-04-04T06:56:28.012293+0000","last_unstale":"2024-04-04T06:56:30.062601+0000","last_undegraded":"2024-04-04T06:56:30.062601+0000","last_fullsized":"2024-04-04T06:56:30.062601+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_clean_scrub_stamp":"2024-04-04T06:56:26.956814+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T13:32:44.896913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.698639+0000","last_change":"2024-04-04T06:56:29.044040+0000","last_active":"2024-04-04T06:56:30.698639+0000","last_peered":"2024-04-04T06:56:30.698639+0000","last_clean":"2024-04-04T06:56:30.698639+0000","last_became_active":"2024-04-04T06:56:29.042922+0000","last_became_peered":"2024-04-04T06:56:29.042922+0000","last_unstale":"2024-04-04T06:56:30.698639+0000","last_undegraded":"2024-04-04T06:56:30.698639+0000","last_fullsized":"2024-04-04T06:56:30.698639+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T13:04:16.108138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.017156+0000","last_change":"2024-04-04T06:56:28.012453+0000","last_active":"2024-04-04T06:56:30.017156+0000","last_peered":"2024-04-04T06:56:30.017156+0000","last_clean":"2024-04-04T06:56:30.017156+0000","last_became_active":"2024-04-04T06:56:28.011057+0000","last_became_peered":"2024-04-04T06:56:28.011057+0000","last_unstale":"2024-04-04T06:56:30.017156+0000","last_undegraded":"2024-04-04T06:56:30.017156+0000","last_fullsized":"2024-04-04T06:56:30.017156+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_clean_scrub_stamp":"2024-04-04T06:56:26.956814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T08:38:32.735117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.018349+0000","last_change":"2024-04-04T06:56:29.044746+0000","last_active":"2024-04-04T06:56:30.018349+0000","last_peered":"2024-04-04T06:56:30.018349+0000","last_clean":"2024-04-04T06:56:30.018349+0000","last_became_active":"2024-04-04T06:56:29.044423+0000","last_became_peered":"2024-04-04T06:56:29.044423+0000","last_unstale":"2024-04-04T06:56:30.018349+0000","last_undegraded":"2024-04-04T06:56:30.018349+0000","last_fullsized":"2024-04-04T06:56:30.018349+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T10:18:32.922174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.015451+0000","last_change":"2024-04-04T06:56:27.996226+0000","last_active":"2024-04-04T06:56:30.015451+0000","last_peered":"2024-04-04T06:56:30.015451+0000","last_clean":"2024-04-04T06:56:30.015451+0000","last_became_active":"2024-04-04T06:56:27.995835+0000","last_became_peered":"2024-04-04T06:56:27.995835+0000","last_unstale":"2024-04-04T06:56:30.015451+0000","last_undegraded":"2024-04-04T06:56:30.015451+0000","last_fullsized":"2024-04-04T06:56:30.015451+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_clean_scrub_stamp":"2024-04-04T06:56:26.956814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T09:54:19.792854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.701001+0000","last_change":"2024-04-04T06:56:29.056813+0000","last_active":"2024-04-04T06:56:30.701001+0000","last_peered":"2024-04-04T06:56:30.701001+0000","last_clean":"2024-04-04T06:56:30.701001+0000","last_became_active":"2024-04-04T06:56:29.052514+0000","last_became_peered":"2024-04-04T06:56:29.052514+0000","last_unstale":"2024-04-04T06:56:30.701001+0000","last_undegraded":"2024-04-04T06:56:30.701001+0000","last_fullsized":"2024-04-04T06:56:30.701001+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T10:40:36.659855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.015571+0000","last_change":"2024-04-04T06:56:27.999750+0000","last_active":"2024-04-04T06:56:30.015571+0000","last_peered":"2024-04-04T06:56:30.015571+0000","last_clean":"2024-04-04T06:56:30.015571+0000","last_became_active":"2024-04-04T06:56:27.997685+0000","last_became_peered":"2024-04-04T06:56:27.997685+0000","last_unstale":"2024-04-04T06:56:30.015571+0000","last_undegraded":"2024-04-04T06:56:30.015571+0000","last_fullsized":"2024-04-04T06:56:30.015571+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_clean_scrub_stamp":"2024-04-04T06:56:26.956814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T10:18:31.915978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.701301+0000","last_change":"2024-04-04T06:56:29.056179+0000","last_active":"2024-04-04T06:56:30.701301+0000","last_peered":"2024-04-04T06:56:30.701301+0000","last_clean":"2024-04-04T06:56:30.701301+0000","last_became_active":"2024-04-04T06:56:29.055682+0000","last_became_peered":"2024-04-04T06:56:29.055682+0000","last_unstale":"2024-04-04T06:56:30.701301+0000","last_undegraded":"2024-04-04T06:56:30.701301+0000","last_fullsized":"2024-04-04T06:56:30.701301+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T08:11:58.552420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.021102+0000","last_change":"2024-04-04T06:56:28.010871+0000","last_active":"2024-04-04T06:56:30.021102+0000","last_peered":"2024-04-04T06:56:30.021102+0000","last_clean":"2024-04-04T06:56:30.021102+0000","last_became_active":"2024-04-04T06:56:28.010159+0000","last_became_peered":"2024-04-04T06:56:28.010159+0000","last_unstale":"2024-04-04T06:56:30.021102+0000","last_undegraded":"2024-04-04T06:56:30.021102+0000","last_fullsized":"2024-04-04T06:56:30.021102+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_clean_scrub_stamp":"2024-04-04T06:56:26.956814+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T12:35:20.051203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.061957+0000","last_change":"2024-04-04T06:56:29.051332+0000","last_active":"2024-04-04T06:56:30.061957+0000","last_peered":"2024-04-04T06:56:30.061957+0000","last_clean":"2024-04-04T06:56:30.061957+0000","last_became_active":"2024-04-04T06:56:29.051026+0000","last_became_peered":"2024-04-04T06:56:29.051026+0000","last_unstale":"2024-04-04T06:56:30.061957+0000","last_undegraded":"2024-04-04T06:56:30.061957+0000","last_fullsized":"2024-04-04T06:56:30.061957+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T10:04:08.170276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.698934+0000","last_change":"2024-04-04T06:56:29.045951+0000","last_active":"2024-04-04T06:56:30.698934+0000","last_peered":"2024-04-04T06:56:30.698934+0000","last_clean":"2024-04-04T06:56:30.698934+0000","last_became_active":"2024-04-04T06:56:29.044806+0000","last_became_peered":"2024-04-04T06:56:29.044806+0000","last_unstale":"2024-04-04T06:56:30.698934+0000","last_undegraded":"2024-04-04T06:56:30.698934+0000","last_fullsized":"2024-04-04T06:56:30.698934+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T10:24:01.060246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.019571+0000","last_change":"2024-04-04T06:56:28.022012+0000","last_active":"2024-04-04T06:56:30.019571+0000","last_peered":"2024-04-04T06:56:30.019571+0000","last_clean":"2024-04-04T06:56:30.019571+0000","last_became_active":"2024-04-04T06:56:28.021708+0000","last_became_peered":"2024-04-04T06:56:28.021708+0000","last_unstale":"2024-04-04T06:56:30.019571+0000","last_undegraded":"2024-04-04T06:56:30.019571+0000","last_fullsized":"2024-04-04T06:56:30.019571+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_clean_scrub_stamp":"2024-04-04T06:56:26.956814+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T15:15:23.654438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.698972+0000","last_change":"2024-04-04T06:56:29.045589+0000","last_active":"2024-04-04T06:56:30.698972+0000","last_peered":"2024-04-04T06:56:30.698972+0000","last_clean":"2024-04-04T06:56:30.698972+0000","last_became_active":"2024-04-04T06:56:29.045071+0000","last_became_peered":"2024-04-04T06:56:29.045071+0000","last_unstale":"2024-04-04T06:56:30.698972+0000","last_undegraded":"2024-04-04T06:56:30.698972+0000","last_fullsized":"2024-04-04T06:56:30.698972+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T18:38:49.851932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.019137+0000","last_change":"2024-04-04T06:56:28.014130+0000","last_active":"2024-04-04T06:56:30.019137+0000","last_peered":"2024-04-04T06:56:30.019137+0000","last_clean":"2024-04-04T06:56:30.019137+0000","last_became_active":"2024-04-04T06:56:28.013846+0000","last_became_peered":"2024-04-04T06:56:28.013846+0000","last_unstale":"2024-04-04T06:56:30.019137+0000","last_undegraded":"2024-04-04T06:56:30.019137+0000","last_fullsized":"2024-04-04T06:56:30.019137+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_clean_scrub_stamp":"2024-04-04T06:56:26.956814+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T15:09:29.813629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.698978+0000","last_change":"2024-04-04T06:56:29.049076+0000","last_active":"2024-04-04T06:56:30.698978+0000","last_peered":"2024-04-04T06:56:30.698978+0000","last_clean":"2024-04-04T06:56:30.698978+0000","last_became_active":"2024-04-04T06:56:29.048096+0000","last_became_peered":"2024-04-04T06:56:29.048096+0000","last_unstale":"2024-04-04T06:56:30.698978+0000","last_undegraded":"2024-04-04T06:56:30.698978+0000","last_fullsized":"2024-04-04T06:56:30.698978+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T16:44:39.332035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.701741+0000","last_change":"2024-04-04T06:56:27.998042+0000","last_active":"2024-04-04T06:56:30.701741+0000","last_peered":"2024-04-04T06:56:30.701741+0000","last_clean":"2024-04-04T06:56:30.701741+0000","last_became_active":"2024-04-04T06:56:27.996925+0000","last_became_peered":"2024-04-04T06:56:27.996925+0000","last_unstale":"2024-04-04T06:56:30.701741+0000","last_undegraded":"2024-04-04T06:56:30.701741+0000","last_fullsized":"2024-04-04T06:56:30.701741+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_clean_scrub_stamp":"2024-04-04T06:56:26.956814+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T16:13:09.520714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.701597+0000","last_change":"2024-04-04T06:56:29.051673+0000","last_active":"2024-04-04T06:56:30.701597+0000","last_peered":"2024-04-04T06:56:30.701597+0000","last_clean":"2024-04-04T06:56:30.701597+0000","last_became_active":"2024-04-04T06:56:29.051400+0000","last_became_peered":"2024-04-04T06:56:29.051400+0000","last_unstale":"2024-04-04T06:56:30.701597+0000","last_undegraded":"2024-04-04T06:56:30.701597+0000","last_fullsized":"2024-04-04T06:56:30.701597+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T12:11:26.884771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.699097+0000","last_change":"2024-04-04T06:56:28.000376+0000","last_active":"2024-04-04T06:56:30.699097+0000","last_peered":"2024-04-04T06:56:30.699097+0000","last_clean":"2024-04-04T06:56:30.699097+0000","last_became_active":"2024-04-04T06:56:27.999779+0000","last_became_peered":"2024-04-04T06:56:27.999779+0000","last_unstale":"2024-04-04T06:56:30.699097+0000","last_undegraded":"2024-04-04T06:56:30.699097+0000","last_fullsized":"2024-04-04T06:56:30.699097+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_clean_scrub_stamp":"2024-04-04T06:56:26.956814+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T13:47:51.595456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27808,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344032,"statfs":{"total":96636764160,"available":96608288768,"internally_reserved":0,"allocated":802816,"data_stored":661884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":208896,"data_stored":71024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":71060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":70934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":212992,"data_stored":71094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":811008,"data_stored":661940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-04T06:56:39.279 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-04T06:56:39.503 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.504+0000 7fb562c00640 1 Processor -- start 2024-04-04T06:56:39.503 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.504+0000 7fb562c00640 1 -- start start 2024-04-04T06:56:39.504 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.505+0000 7fb562c00640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb55c145220 0x7fb55c1457c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:39.504 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.506+0000 7fb562c00640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb55c0c7620 con 0x7fb55c0d03d0 2024-04-04T06:56:39.505 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.506+0000 7fb562c00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb55c0c78c0 con 0x7fb55c145d00 2024-04-04T06:56:39.505 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.506+0000 7fb562c00640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7fb55c0b4990 con 0x7fb55c145220 2024-04-04T06:56:39.505 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.506+0000 7fb560c00640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fb55c0d03d0 0x7fb55c0cc740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:39562/0 (socket says 172.21.15.72:39562) 2024-04-04T06:56:39.505 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.506+0000 7fb560c00640 1 -- 172.21.15.72:0/3076051153 learned_addr learned my addr 172.21.15.72:0/3076051153 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-04-04T06:56:39.505 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.506+0000 7fb55be00640 1 --2- 172.21.15.72:0/3076051153 >> v2:172.21.15.72:3300/0 conn(0x7fb55c145220 0x7fb55c1457c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:39.505 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.506+0000 7fb55aa00640 1 -- 172.21.15.72:0/3076051153 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2753356340 0 0) 0x7fb55c0c7620 con 0x7fb55c0d03d0 2024-04-04T06:56:39.506 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.506+0000 7fb55aa00640 1 -- 172.21.15.72:0/3076051153 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb540003520 con 0x7fb55c0d03d0 2024-04-04T06:56:39.506 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.507+0000 7fb55be00640 1 -- 172.21.15.72:0/3076051153 >> v1:172.21.15.117:6789/0 conn(0x7fb55c145d00 legacy=0x7fb55c0cfcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:39.506 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.507+0000 7fb55be00640 1 -- 172.21.15.72:0/3076051153 >> v1:172.21.15.72:6789/0 conn(0x7fb55c0d03d0 legacy=0x7fb55c0cc740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:39.506 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.507+0000 7fb55be00640 1 -- 172.21.15.72:0/3076051153 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb55c0c7ba0 con 0x7fb55c145220 2024-04-04T06:56:39.506 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.508+0000 7fb55be00640 1 --2- 172.21.15.72:0/3076051153 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb55c145220 0x7fb55c1457c0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fb54c0097a0 tx=0x7fb54c02b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bf9bb37a0ff8d9a server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:39.507 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.508+0000 7fb55aa00640 1 -- 172.21.15.72:0/3076051153 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb54c034070 con 0x7fb55c145220 2024-04-04T06:56:39.508 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.508+0000 7fb55aa00640 1 -- 172.21.15.72:0/3076051153 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb54c030610 con 0x7fb55c145220 2024-04-04T06:56:39.508 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.508+0000 7fb55aa00640 1 -- 172.21.15.72:0/3076051153 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb54c0309e0 con 0x7fb55c145220 2024-04-04T06:56:39.508 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.509+0000 7fb562c00640 1 -- 172.21.15.72:0/3076051153 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb55c145220 msgr2=0x7fb55c1457c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:39.508 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.509+0000 7fb562c00640 1 --2- 172.21.15.72:0/3076051153 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb55c145220 0x7fb55c1457c0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fb54c0097a0 tx=0x7fb54c02b960 comp rx=0 tx=0).stop 2024-04-04T06:56:39.508 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.509+0000 7fb562c00640 1 -- 172.21.15.72:0/3076051153 shutdown_connections 2024-04-04T06:56:39.508 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.509+0000 7fb562c00640 1 --2- 172.21.15.72:0/3076051153 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb55c145220 0x7fb55c1457c0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:39.508 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.509+0000 7fb562c00640 1 -- 172.21.15.72:0/3076051153 >> 172.21.15.72:0/3076051153 conn(0x7fb55c0d2180 msgr2=0x7fb55c0d2560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:56:39.508 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.509+0000 7fb562c00640 1 -- 172.21.15.72:0/3076051153 shutdown_connections 2024-04-04T06:56:39.508 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.509+0000 7fb562c00640 1 -- 172.21.15.72:0/3076051153 wait complete. 2024-04-04T06:56:39.510 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.512+0000 7fb562c00640 1 Processor -- start 2024-04-04T06:56:39.510 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.512+0000 7fb562c00640 1 -- start start 2024-04-04T06:56:39.513 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.513+0000 7fb562c00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb55c0d03d0 0x7fb55c0b5a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:39.513 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.514+0000 7fb562c00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb55c145220 0x7fb55c0b4b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:39.513 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.514+0000 7fb562c00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb55c145d00 0x7fb55c141670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:39.514 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.514+0000 7fb562c00640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fb55c0c81f0 con 0x7fb55c0d03d0 2024-04-04T06:56:39.514 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.514+0000 7fb562c00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fb55c145600 con 0x7fb55c145220 2024-04-04T06:56:39.514 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.514+0000 7fb562c00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fb55c0c8680 con 0x7fb55c145d00 2024-04-04T06:56:39.514 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.514+0000 7fb55be00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb55c0d03d0 0x7fb55c0b5a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:39.514 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.514+0000 7fb55be00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb55c0d03d0 0x7fb55c0b5a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:34590/0 (socket says 172.21.15.72:34590) 2024-04-04T06:56:39.514 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.514+0000 7fb55be00640 1 -- 172.21.15.72:0/2757696471 learned_addr learned my addr 172.21.15.72:0/2757696471 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:56:39.514 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.514+0000 7fb55b400640 1 --2- 172.21.15.72:0/2757696471 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb55c145220 0x7fb55c0b4b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:39.514 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.514+0000 7fb55be00640 1 -- 172.21.15.72:0/2757696471 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb55c145d00 msgr2=0x7fb55c141670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:39.514 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.514+0000 7fb55be00640 1 --2- 172.21.15.72:0/2757696471 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb55c145d00 0x7fb55c141670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:39.514 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.514+0000 7fb55be00640 1 -- 172.21.15.72:0/2757696471 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb55c145220 msgr2=0x7fb55c0b4b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:39.514 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.514+0000 7fb55be00640 1 --2- 172.21.15.72:0/2757696471 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb55c145220 0x7fb55c0b4b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:39.514 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.514+0000 7fb55be00640 1 -- 172.21.15.72:0/2757696471 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb55c1e5aa0 con 0x7fb55c0d03d0 2024-04-04T06:56:39.514 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.514+0000 7fb55b400640 1 --2- 172.21.15.72:0/2757696471 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb55c145220 0x7fb55c0b4b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-04T06:56:39.515 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.515+0000 7fb55be00640 1 --2- 172.21.15.72:0/2757696471 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb55c0d03d0 0x7fb55c0b5a00 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fb54c000c00 tx=0x7fb54c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:39.515 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.515+0000 7fb553e00640 1 -- 172.21.15.72:0/2757696471 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb54c034040 con 0x7fb55c0d03d0 2024-04-04T06:56:39.515 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.515+0000 7fb553e00640 1 -- 172.21.15.72:0/2757696471 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb54c03aaa0 con 0x7fb55c0d03d0 2024-04-04T06:56:39.515 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.515+0000 7fb553e00640 1 -- 172.21.15.72:0/2757696471 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb54c0443f0 con 0x7fb55c0d03d0 2024-04-04T06:56:39.515 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.515+0000 7fb562c00640 1 -- 172.21.15.72:0/2757696471 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb55c1e5d80 con 0x7fb55c0d03d0 2024-04-04T06:56:39.515 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.515+0000 7fb562c00640 1 -- 172.21.15.72:0/2757696471 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb55c1e6340 con 0x7fb55c0d03d0 2024-04-04T06:56:39.515 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.516+0000 7fb562c00640 1 -- 172.21.15.72:0/2757696471 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb55c0d2f00 con 0x7fb55c0d03d0 2024-04-04T06:56:39.515 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.517+0000 7fb553e00640 1 -- 172.21.15.72:0/2757696471 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb54c04b060 con 0x7fb55c0d03d0 2024-04-04T06:56:39.517 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.518+0000 7fb553e00640 1 --2- 172.21.15.72:0/2757696471 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fb53c06c8f0 0x7fb53c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:39.517 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.518+0000 7fb553e00640 1 -- 172.21.15.72:0/2757696471 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fb54c0ad9a0 con 0x7fb55c0d03d0 2024-04-04T06:56:39.517 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.518+0000 7fb55b400640 1 --2- 172.21.15.72:0/2757696471 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fb53c06c8f0 0x7fb53c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:39.517 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.519+0000 7fb55b400640 1 --2- 172.21.15.72:0/2757696471 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fb53c06c8f0 0x7fb53c06edb0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fb55c0ce490 tx=0x7fb548009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:39.521 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.523+0000 7fb553e00640 1 -- 172.21.15.72:0/2757696471 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fb55c0d2f00 con 0x7fb55c0d03d0 2024-04-04T06:56:39.710 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.711+0000 7fb562c00640 1 -- 172.21.15.72:0/2757696471 --> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb55c075840 con 0x7fb53c06c8f0 2024-04-04T06:56:39.716 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.718+0000 7fb553e00640 1 -- 172.21.15.72:0/2757696471 <== mgr.4101 v2:172.21.15.72:6832/2205173820 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251837 (secure 0 0 0) 0x7fb55c075840 con 0x7fb53c06c8f0 2024-04-04T06:56:39.720 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T06:56:39.721 INFO:teuthology.orchestra.run.smithi072.stderr:dumped all 2024-04-04T06:56:39.723 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.723+0000 7fb562c00640 1 -- 172.21.15.72:0/2757696471 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fb53c06c8f0 msgr2=0x7fb53c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:39.723 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.723+0000 7fb562c00640 1 --2- 172.21.15.72:0/2757696471 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fb53c06c8f0 0x7fb53c06edb0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fb55c0ce490 tx=0x7fb548009040 comp rx=0 tx=0).stop 2024-04-04T06:56:39.723 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.723+0000 7fb562c00640 1 -- 172.21.15.72:0/2757696471 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb55c0d03d0 msgr2=0x7fb55c0b5a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:39.723 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.723+0000 7fb562c00640 1 --2- 172.21.15.72:0/2757696471 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb55c0d03d0 0x7fb55c0b5a00 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fb54c000c00 tx=0x7fb54c0046c0 comp rx=0 tx=0).stop 2024-04-04T06:56:39.723 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.723+0000 7fb562c00640 1 -- 172.21.15.72:0/2757696471 shutdown_connections 2024-04-04T06:56:39.723 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.723+0000 7fb562c00640 1 --2- 172.21.15.72:0/2757696471 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fb53c06c8f0 0x7fb53c06edb0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:39.723 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.723+0000 7fb562c00640 1 --2- 172.21.15.72:0/2757696471 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb55c145d00 0x7fb55c141670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:39.723 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.723+0000 7fb562c00640 1 --2- 172.21.15.72:0/2757696471 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb55c145220 0x7fb55c0b4b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:39.723 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.723+0000 7fb562c00640 1 --2- 172.21.15.72:0/2757696471 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb55c0d03d0 0x7fb55c0b5a00 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:39.723 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.723+0000 7fb562c00640 1 -- 172.21.15.72:0/2757696471 >> 172.21.15.72:0/2757696471 conn(0x7fb55c0d2180 msgr2=0x7fb55c1e3600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:56:39.723 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.723+0000 7fb562c00640 1 -- 172.21.15.72:0/2757696471 shutdown_connections 2024-04-04T06:56:39.723 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.723+0000 7fb562c00640 1 -- 172.21.15.72:0/2757696471 wait complete. 2024-04-04T06:56:39.739 INFO:teuthology.orchestra.run.smithi072.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-04-04T06:56:39.390888+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218996,"kb_used_data":2824,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755724,"statfs":{"total":773094113280,"available":772869861376,"internally_reserved":0,"allocated":2891776,"data_stored":1753028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.003766"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.021316+0000","last_change":"2024-04-04T06:56:29.041884+0000","last_active":"2024-04-04T06:56:30.021316+0000","last_peered":"2024-04-04T06:56:30.021316+0000","last_clean":"2024-04-04T06:56:30.021316+0000","last_became_active":"2024-04-04T06:56:29.041589+0000","last_became_peered":"2024-04-04T06:56:29.041589+0000","last_unstale":"2024-04-04T06:56:30.021316+0000","last_undegraded":"2024-04-04T06:56:30.021316+0000","last_fullsized":"2024-04-04T06:56:30.021316+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T17:09:54.896779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.016096+0000","last_change":"2024-04-04T06:56:29.044652+0000","last_active":"2024-04-04T06:56:30.016096+0000","last_peered":"2024-04-04T06:56:30.016096+0000","last_clean":"2024-04-04T06:56:30.016096+0000","last_became_active":"2024-04-04T06:56:29.044287+0000","last_became_peered":"2024-04-04T06:56:29.044287+0000","last_unstale":"2024-04-04T06:56:30.016096+0000","last_undegraded":"2024-04-04T06:56:30.016096+0000","last_fullsized":"2024-04-04T06:56:30.016096+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T16:44:39.332035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.698416+0000","last_change":"2024-04-04T06:56:29.044464+0000","last_active":"2024-04-04T06:56:30.698416+0000","last_peered":"2024-04-04T06:56:30.698416+0000","last_clean":"2024-04-04T06:56:30.698416+0000","last_became_active":"2024-04-04T06:56:29.044200+0000","last_became_peered":"2024-04-04T06:56:29.044200+0000","last_unstale":"2024-04-04T06:56:30.698416+0000","last_undegraded":"2024-04-04T06:56:30.698416+0000","last_fullsized":"2024-04-04T06:56:30.698416+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T15:25:18.489701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.698540+0000","last_change":"2024-04-04T06:56:29.058211+0000","last_active":"2024-04-04T06:56:30.698540+0000","last_peered":"2024-04-04T06:56:30.698540+0000","last_clean":"2024-04-04T06:56:30.698540+0000","last_became_active":"2024-04-04T06:56:29.057931+0000","last_became_peered":"2024-04-04T06:56:29.057931+0000","last_unstale":"2024-04-04T06:56:30.698540+0000","last_undegraded":"2024-04-04T06:56:30.698540+0000","last_fullsized":"2024-04-04T06:56:30.698540+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T17:04:57.682659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.020954+0000","last_change":"2024-04-04T06:56:29.043939+0000","last_active":"2024-04-04T06:56:30.020954+0000","last_peered":"2024-04-04T06:56:30.020954+0000","last_clean":"2024-04-04T06:56:30.020954+0000","last_became_active":"2024-04-04T06:56:29.043646+0000","last_became_peered":"2024-04-04T06:56:29.043646+0000","last_unstale":"2024-04-04T06:56:30.020954+0000","last_undegraded":"2024-04-04T06:56:30.020954+0000","last_fullsized":"2024-04-04T06:56:30.020954+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T18:38:49.851932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.698199+0000","last_change":"2024-04-04T06:56:29.036398+0000","last_active":"2024-04-04T06:56:30.698199+0000","last_peered":"2024-04-04T06:56:30.698199+0000","last_clean":"2024-04-04T06:56:30.698199+0000","last_became_active":"2024-04-04T06:56:29.036119+0000","last_became_peered":"2024-04-04T06:56:29.036119+0000","last_unstale":"2024-04-04T06:56:30.698199+0000","last_undegraded":"2024-04-04T06:56:30.698199+0000","last_fullsized":"2024-04-04T06:56:30.698199+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T12:11:26.884771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.018127+0000","last_change":"2024-04-04T06:56:29.033491+0000","last_active":"2024-04-04T06:56:30.018127+0000","last_peered":"2024-04-04T06:56:30.018127+0000","last_clean":"2024-04-04T06:56:30.018127+0000","last_became_active":"2024-04-04T06:56:29.033159+0000","last_became_peered":"2024-04-04T06:56:29.033159+0000","last_unstale":"2024-04-04T06:56:30.018127+0000","last_undegraded":"2024-04-04T06:56:30.018127+0000","last_fullsized":"2024-04-04T06:56:30.018127+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T17:04:57.682659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.701021+0000","last_change":"2024-04-04T06:56:29.058473+0000","last_active":"2024-04-04T06:56:30.701021+0000","last_peered":"2024-04-04T06:56:30.701021+0000","last_clean":"2024-04-04T06:56:30.701021+0000","last_became_active":"2024-04-04T06:56:29.057579+0000","last_became_peered":"2024-04-04T06:56:29.057579+0000","last_unstale":"2024-04-04T06:56:30.701021+0000","last_undegraded":"2024-04-04T06:56:30.701021+0000","last_fullsized":"2024-04-04T06:56:30.701021+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T15:25:18.489701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.021435+0000","last_change":"2024-04-04T06:56:29.036872+0000","last_active":"2024-04-04T06:56:30.021435+0000","last_peered":"2024-04-04T06:56:30.021435+0000","last_clean":"2024-04-04T06:56:30.021435+0000","last_became_active":"2024-04-04T06:56:29.035533+0000","last_became_peered":"2024-04-04T06:56:29.035533+0000","last_unstale":"2024-04-04T06:56:30.021435+0000","last_undegraded":"2024-04-04T06:56:30.021435+0000","last_fullsized":"2024-04-04T06:56:30.021435+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T09:03:00.078302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.062681+0000","last_change":"2024-04-04T06:56:29.048015+0000","last_active":"2024-04-04T06:56:30.062681+0000","last_peered":"2024-04-04T06:56:30.062681+0000","last_clean":"2024-04-04T06:56:30.062681+0000","last_became_active":"2024-04-04T06:56:29.047193+0000","last_became_peered":"2024-04-04T06:56:29.047193+0000","last_unstale":"2024-04-04T06:56:30.062681+0000","last_undegraded":"2024-04-04T06:56:30.062681+0000","last_fullsized":"2024-04-04T06:56:30.062681+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T12:11:26.884771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.062555+0000","last_change":"2024-04-04T06:56:29.048692+0000","last_active":"2024-04-04T06:56:30.062555+0000","last_peered":"2024-04-04T06:56:30.062555+0000","last_clean":"2024-04-04T06:56:30.062555+0000","last_became_active":"2024-04-04T06:56:29.048370+0000","last_became_peered":"2024-04-04T06:56:29.048370+0000","last_unstale":"2024-04-04T06:56:30.062555+0000","last_undegraded":"2024-04-04T06:56:30.062555+0000","last_fullsized":"2024-04-04T06:56:30.062555+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T08:11:58.552420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.019591+0000","last_change":"2024-04-04T06:56:29.043832+0000","last_active":"2024-04-04T06:56:30.019591+0000","last_peered":"2024-04-04T06:56:30.019591+0000","last_clean":"2024-04-04T06:56:30.019591+0000","last_became_active":"2024-04-04T06:56:29.043483+0000","last_became_peered":"2024-04-04T06:56:29.043483+0000","last_unstale":"2024-04-04T06:56:30.019591+0000","last_undegraded":"2024-04-04T06:56:30.019591+0000","last_fullsized":"2024-04-04T06:56:30.019591+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T16:54:06.987375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.701295+0000","last_change":"2024-04-04T06:56:29.051626+0000","last_active":"2024-04-04T06:56:30.701295+0000","last_peered":"2024-04-04T06:56:30.701295+0000","last_clean":"2024-04-04T06:56:30.701295+0000","last_became_active":"2024-04-04T06:56:29.051241+0000","last_became_peered":"2024-04-04T06:56:29.051241+0000","last_unstale":"2024-04-04T06:56:30.701295+0000","last_undegraded":"2024-04-04T06:56:30.701295+0000","last_fullsized":"2024-04-04T06:56:30.701295+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T13:04:16.108138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.698067+0000","last_change":"2024-04-04T06:56:29.042853+0000","last_active":"2024-04-04T06:56:30.698067+0000","last_peered":"2024-04-04T06:56:30.698067+0000","last_clean":"2024-04-04T06:56:30.698067+0000","last_became_active":"2024-04-04T06:56:29.041487+0000","last_became_peered":"2024-04-04T06:56:29.041487+0000","last_unstale":"2024-04-04T06:56:30.698067+0000","last_undegraded":"2024-04-04T06:56:30.698067+0000","last_fullsized":"2024-04-04T06:56:30.698067+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T17:11:13.036810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.015396+0000","last_change":"2024-04-04T06:56:29.043554+0000","last_active":"2024-04-04T06:56:30.015396+0000","last_peered":"2024-04-04T06:56:30.015396+0000","last_clean":"2024-04-04T06:56:30.015396+0000","last_became_active":"2024-04-04T06:56:29.043300+0000","last_became_peered":"2024-04-04T06:56:29.043300+0000","last_unstale":"2024-04-04T06:56:30.015396+0000","last_undegraded":"2024-04-04T06:56:30.015396+0000","last_fullsized":"2024-04-04T06:56:30.015396+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T15:25:18.489701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.698063+0000","last_change":"2024-04-04T06:56:29.038506+0000","last_active":"2024-04-04T06:56:30.698063+0000","last_peered":"2024-04-04T06:56:30.698063+0000","last_clean":"2024-04-04T06:56:30.698063+0000","last_became_active":"2024-04-04T06:56:29.038150+0000","last_became_peered":"2024-04-04T06:56:29.038150+0000","last_unstale":"2024-04-04T06:56:30.698063+0000","last_undegraded":"2024-04-04T06:56:30.698063+0000","last_fullsized":"2024-04-04T06:56:30.698063+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T16:44:39.332035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.699391+0000","last_change":"2024-04-04T06:56:29.049923+0000","last_active":"2024-04-04T06:56:30.699391+0000","last_peered":"2024-04-04T06:56:30.699391+0000","last_clean":"2024-04-04T06:56:30.699391+0000","last_became_active":"2024-04-04T06:56:29.049658+0000","last_became_peered":"2024-04-04T06:56:29.049658+0000","last_unstale":"2024-04-04T06:56:30.699391+0000","last_undegraded":"2024-04-04T06:56:30.699391+0000","last_fullsized":"2024-04-04T06:56:30.699391+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T09:03:00.078302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.697501+0000","last_change":"2024-04-04T06:56:29.042470+0000","last_active":"2024-04-04T06:56:30.697501+0000","last_peered":"2024-04-04T06:56:30.697501+0000","last_clean":"2024-04-04T06:56:30.697501+0000","last_became_active":"2024-04-04T06:56:29.041885+0000","last_became_peered":"2024-04-04T06:56:29.041885+0000","last_unstale":"2024-04-04T06:56:30.697501+0000","last_undegraded":"2024-04-04T06:56:30.697501+0000","last_fullsized":"2024-04-04T06:56:30.697501+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T12:35:21.057399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.021811+0000","last_change":"2024-04-04T06:56:29.042854+0000","last_active":"2024-04-04T06:56:30.021811+0000","last_peered":"2024-04-04T06:56:30.021811+0000","last_clean":"2024-04-04T06:56:30.021811+0000","last_became_active":"2024-04-04T06:56:29.042590+0000","last_became_peered":"2024-04-04T06:56:29.042590+0000","last_unstale":"2024-04-04T06:56:30.021811+0000","last_undegraded":"2024-04-04T06:56:30.021811+0000","last_fullsized":"2024-04-04T06:56:30.021811+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T18:19:42.642201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.062254+0000","last_change":"2024-04-04T06:56:29.051612+0000","last_active":"2024-04-04T06:56:30.062254+0000","last_peered":"2024-04-04T06:56:30.062254+0000","last_clean":"2024-04-04T06:56:30.062254+0000","last_became_active":"2024-04-04T06:56:29.051315+0000","last_became_peered":"2024-04-04T06:56:29.051315+0000","last_unstale":"2024-04-04T06:56:30.062254+0000","last_undegraded":"2024-04-04T06:56:30.062254+0000","last_fullsized":"2024-04-04T06:56:30.062254+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T13:04:16.108138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.698320+0000","last_change":"2024-04-04T06:56:29.038247+0000","last_active":"2024-04-04T06:56:30.698320+0000","last_peered":"2024-04-04T06:56:30.698320+0000","last_clean":"2024-04-04T06:56:30.698320+0000","last_became_active":"2024-04-04T06:56:29.037756+0000","last_became_peered":"2024-04-04T06:56:29.037756+0000","last_unstale":"2024-04-04T06:56:30.698320+0000","last_undegraded":"2024-04-04T06:56:30.698320+0000","last_fullsized":"2024-04-04T06:56:30.698320+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T10:40:36.659855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.698776+0000","last_change":"2024-04-04T06:56:29.048171+0000","last_active":"2024-04-04T06:56:30.698776+0000","last_peered":"2024-04-04T06:56:30.698776+0000","last_clean":"2024-04-04T06:56:30.698776+0000","last_became_active":"2024-04-04T06:56:29.045845+0000","last_became_peered":"2024-04-04T06:56:29.045845+0000","last_unstale":"2024-04-04T06:56:30.698776+0000","last_undegraded":"2024-04-04T06:56:30.698776+0000","last_fullsized":"2024-04-04T06:56:30.698776+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T08:09:51.101974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.701153+0000","last_change":"2024-04-04T06:56:29.051157+0000","last_active":"2024-04-04T06:56:30.701153+0000","last_peered":"2024-04-04T06:56:30.701153+0000","last_clean":"2024-04-04T06:56:30.701153+0000","last_became_active":"2024-04-04T06:56:29.050862+0000","last_became_peered":"2024-04-04T06:56:29.050862+0000","last_unstale":"2024-04-04T06:56:30.701153+0000","last_undegraded":"2024-04-04T06:56:30.701153+0000","last_fullsized":"2024-04-04T06:56:30.701153+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T10:04:08.170276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.699292+0000","last_change":"2024-04-04T06:56:29.052206+0000","last_active":"2024-04-04T06:56:30.699292+0000","last_peered":"2024-04-04T06:56:30.699292+0000","last_clean":"2024-04-04T06:56:30.699292+0000","last_became_active":"2024-04-04T06:56:29.051882+0000","last_became_peered":"2024-04-04T06:56:29.051882+0000","last_unstale":"2024-04-04T06:56:30.699292+0000","last_undegraded":"2024-04-04T06:56:30.699292+0000","last_fullsized":"2024-04-04T06:56:30.699292+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T17:09:54.896779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.701636+0000","last_change":"2024-04-04T06:56:29.052181+0000","last_active":"2024-04-04T06:56:30.701636+0000","last_peered":"2024-04-04T06:56:30.701636+0000","last_clean":"2024-04-04T06:56:30.701636+0000","last_became_active":"2024-04-04T06:56:29.052011+0000","last_became_peered":"2024-04-04T06:56:29.052011+0000","last_unstale":"2024-04-04T06:56:30.701636+0000","last_undegraded":"2024-04-04T06:56:30.701636+0000","last_fullsized":"2024-04-04T06:56:30.701636+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T18:13:03.204979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.062644+0000","last_change":"2024-04-04T06:56:29.050650+0000","last_active":"2024-04-04T06:56:30.062644+0000","last_peered":"2024-04-04T06:56:30.062644+0000","last_clean":"2024-04-04T06:56:30.062644+0000","last_became_active":"2024-04-04T06:56:29.050382+0000","last_became_peered":"2024-04-04T06:56:29.050382+0000","last_unstale":"2024-04-04T06:56:30.062644+0000","last_undegraded":"2024-04-04T06:56:30.062644+0000","last_fullsized":"2024-04-04T06:56:30.062644+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T16:44:39.332035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.016177+0000","last_change":"2024-04-04T06:56:29.058438+0000","last_active":"2024-04-04T06:56:30.016177+0000","last_peered":"2024-04-04T06:56:30.016177+0000","last_clean":"2024-04-04T06:56:30.016177+0000","last_became_active":"2024-04-04T06:56:29.058155+0000","last_became_peered":"2024-04-04T06:56:29.058155+0000","last_unstale":"2024-04-04T06:56:30.016177+0000","last_undegraded":"2024-04-04T06:56:30.016177+0000","last_fullsized":"2024-04-04T06:56:30.016177+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T12:11:26.884771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.701823+0000","last_change":"2024-04-04T06:56:29.055605+0000","last_active":"2024-04-04T06:56:30.701823+0000","last_peered":"2024-04-04T06:56:30.701823+0000","last_clean":"2024-04-04T06:56:30.701823+0000","last_became_active":"2024-04-04T06:56:29.052573+0000","last_became_peered":"2024-04-04T06:56:29.052573+0000","last_unstale":"2024-04-04T06:56:30.701823+0000","last_undegraded":"2024-04-04T06:56:30.701823+0000","last_fullsized":"2024-04-04T06:56:30.701823+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T08:09:51.101974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.698490+0000","last_change":"2024-04-04T06:56:29.054105+0000","last_active":"2024-04-04T06:56:30.698490+0000","last_peered":"2024-04-04T06:56:30.698490+0000","last_clean":"2024-04-04T06:56:30.698490+0000","last_became_active":"2024-04-04T06:56:29.053803+0000","last_became_peered":"2024-04-04T06:56:29.053803+0000","last_unstale":"2024-04-04T06:56:30.698490+0000","last_undegraded":"2024-04-04T06:56:30.698490+0000","last_fullsized":"2024-04-04T06:56:30.698490+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T10:04:08.170276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.698508+0000","last_change":"2024-04-04T06:56:29.058755+0000","last_active":"2024-04-04T06:56:30.698508+0000","last_peered":"2024-04-04T06:56:30.698508+0000","last_clean":"2024-04-04T06:56:30.698508+0000","last_became_active":"2024-04-04T06:56:29.058413+0000","last_became_peered":"2024-04-04T06:56:29.058413+0000","last_unstale":"2024-04-04T06:56:30.698508+0000","last_undegraded":"2024-04-04T06:56:30.698508+0000","last_fullsized":"2024-04-04T06:56:30.698508+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T18:13:03.204979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.697222+0000","last_change":"2024-04-04T06:56:29.047614+0000","last_active":"2024-04-04T06:56:30.697222+0000","last_peered":"2024-04-04T06:56:30.697222+0000","last_clean":"2024-04-04T06:56:30.697222+0000","last_became_active":"2024-04-04T06:56:29.047371+0000","last_became_peered":"2024-04-04T06:56:29.047371+0000","last_unstale":"2024-04-04T06:56:30.697222+0000","last_undegraded":"2024-04-04T06:56:30.697222+0000","last_fullsized":"2024-04-04T06:56:30.697222+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T15:15:24.660634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.061901+0000","last_change":"2024-04-04T06:56:29.052722+0000","last_active":"2024-04-04T06:56:30.061901+0000","last_peered":"2024-04-04T06:56:30.061901+0000","last_clean":"2024-04-04T06:56:30.061901+0000","last_became_active":"2024-04-04T06:56:29.052245+0000","last_became_peered":"2024-04-04T06:56:29.052245+0000","last_unstale":"2024-04-04T06:56:30.061901+0000","last_undegraded":"2024-04-04T06:56:30.061901+0000","last_fullsized":"2024-04-04T06:56:30.061901+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T15:25:18.489701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.019151+0000","last_change":"2024-04-04T06:56:29.042686+0000","last_active":"2024-04-04T06:56:30.019151+0000","last_peered":"2024-04-04T06:56:30.019151+0000","last_clean":"2024-04-04T06:56:30.019151+0000","last_became_active":"2024-04-04T06:56:29.042124+0000","last_became_peered":"2024-04-04T06:56:29.042124+0000","last_unstale":"2024-04-04T06:56:30.019151+0000","last_undegraded":"2024-04-04T06:56:30.019151+0000","last_fullsized":"2024-04-04T06:56:30.019151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T13:32:45.903109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.701378+0000","last_change":"2024-04-04T06:56:28.001896+0000","last_active":"2024-04-04T06:56:30.701378+0000","last_peered":"2024-04-04T06:56:30.701378+0000","last_clean":"2024-04-04T06:56:30.701378+0000","last_became_active":"2024-04-04T06:56:28.001625+0000","last_became_peered":"2024-04-04T06:56:28.001625+0000","last_unstale":"2024-04-04T06:56:30.701378+0000","last_undegraded":"2024-04-04T06:56:30.701378+0000","last_fullsized":"2024-04-04T06:56:30.701378+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_clean_scrub_stamp":"2024-04-04T06:56:26.956814+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T13:33:08.840819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.698738+0000","last_change":"2024-04-04T06:56:29.031379+0000","last_active":"2024-04-04T06:56:30.698738+0000","last_peered":"2024-04-04T06:56:30.698738+0000","last_clean":"2024-04-04T06:56:30.698738+0000","last_became_active":"2024-04-04T06:56:29.028243+0000","last_became_peered":"2024-04-04T06:56:29.028243+0000","last_unstale":"2024-04-04T06:56:30.698738+0000","last_undegraded":"2024-04-04T06:56:30.698738+0000","last_fullsized":"2024-04-04T06:56:30.698738+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T08:11:58.552420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.061880+0000","last_change":"2024-04-04T06:56:28.012107+0000","last_active":"2024-04-04T06:56:30.061880+0000","last_peered":"2024-04-04T06:56:30.061880+0000","last_clean":"2024-04-04T06:56:30.061880+0000","last_became_active":"2024-04-04T06:56:28.011477+0000","last_became_peered":"2024-04-04T06:56:28.011477+0000","last_unstale":"2024-04-04T06:56:30.061880+0000","last_undegraded":"2024-04-04T06:56:30.061880+0000","last_fullsized":"2024-04-04T06:56:30.061880+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_clean_scrub_stamp":"2024-04-04T06:56:26.956814+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T16:13:09.520714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.700896+0000","last_change":"2024-04-04T06:56:28.013179+0000","last_active":"2024-04-04T06:56:30.700896+0000","last_peered":"2024-04-04T06:56:30.700896+0000","last_clean":"2024-04-04T06:56:30.700896+0000","last_became_active":"2024-04-04T06:56:28.012858+0000","last_became_peered":"2024-04-04T06:56:28.012858+0000","last_unstale":"2024-04-04T06:56:30.700896+0000","last_undegraded":"2024-04-04T06:56:30.700896+0000","last_fullsized":"2024-04-04T06:56:30.700896+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_clean_scrub_stamp":"2024-04-04T06:56:26.956814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T13:47:51.595456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.700825+0000","last_change":"2024-04-04T06:56:29.058027+0000","last_active":"2024-04-04T06:56:30.700825+0000","last_peered":"2024-04-04T06:56:30.700825+0000","last_clean":"2024-04-04T06:56:30.700825+0000","last_became_active":"2024-04-04T06:56:29.055298+0000","last_became_peered":"2024-04-04T06:56:29.055298+0000","last_unstale":"2024-04-04T06:56:30.700825+0000","last_undegraded":"2024-04-04T06:56:30.700825+0000","last_fullsized":"2024-04-04T06:56:30.700825+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T18:01:37.763615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.698254+0000","last_change":"2024-04-04T06:56:28.007500+0000","last_active":"2024-04-04T06:56:30.698254+0000","last_peered":"2024-04-04T06:56:30.698254+0000","last_clean":"2024-04-04T06:56:30.698254+0000","last_became_active":"2024-04-04T06:56:28.007056+0000","last_became_peered":"2024-04-04T06:56:28.007056+0000","last_unstale":"2024-04-04T06:56:30.698254+0000","last_undegraded":"2024-04-04T06:56:30.698254+0000","last_fullsized":"2024-04-04T06:56:30.698254+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_clean_scrub_stamp":"2024-04-04T06:56:26.956814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T09:54:19.792854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.015421+0000","last_change":"2024-04-04T06:56:29.067716+0000","last_active":"2024-04-04T06:56:30.015421+0000","last_peered":"2024-04-04T06:56:30.015421+0000","last_clean":"2024-04-04T06:56:30.015421+0000","last_became_active":"2024-04-04T06:56:29.067142+0000","last_became_peered":"2024-04-04T06:56:29.067142+0000","last_unstale":"2024-04-04T06:56:30.015421+0000","last_undegraded":"2024-04-04T06:56:30.015421+0000","last_fullsized":"2024-04-04T06:56:30.015421+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T10:04:08.170276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.062468+0000","last_change":"2024-04-04T06:56:28.015953+0000","last_active":"2024-04-04T06:56:30.062468+0000","last_peered":"2024-04-04T06:56:30.062468+0000","last_clean":"2024-04-04T06:56:30.062468+0000","last_became_active":"2024-04-04T06:56:28.015699+0000","last_became_peered":"2024-04-04T06:56:28.015699+0000","last_unstale":"2024-04-04T06:56:30.062468+0000","last_undegraded":"2024-04-04T06:56:30.062468+0000","last_fullsized":"2024-04-04T06:56:30.062468+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_clean_scrub_stamp":"2024-04-04T06:56:26.956814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T08:38:32.735117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.698943+0000","last_change":"2024-04-04T06:56:29.046517+0000","last_active":"2024-04-04T06:56:30.698943+0000","last_peered":"2024-04-04T06:56:30.698943+0000","last_clean":"2024-04-04T06:56:30.698943+0000","last_became_active":"2024-04-04T06:56:29.046107+0000","last_became_peered":"2024-04-04T06:56:29.046107+0000","last_unstale":"2024-04-04T06:56:30.698943+0000","last_undegraded":"2024-04-04T06:56:30.698943+0000","last_fullsized":"2024-04-04T06:56:30.698943+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T12:03:12.792963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.699100+0000","last_change":"2024-04-04T06:56:28.019198+0000","last_active":"2024-04-04T06:56:30.699100+0000","last_peered":"2024-04-04T06:56:30.699100+0000","last_clean":"2024-04-04T06:56:30.699100+0000","last_became_active":"2024-04-04T06:56:28.018911+0000","last_became_peered":"2024-04-04T06:56:28.018911+0000","last_unstale":"2024-04-04T06:56:30.699100+0000","last_undegraded":"2024-04-04T06:56:30.699100+0000","last_fullsized":"2024-04-04T06:56:30.699100+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_clean_scrub_stamp":"2024-04-04T06:56:26.956814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T15:15:23.654438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.699396+0000","last_change":"2024-04-04T06:56:29.049229+0000","last_active":"2024-04-04T06:56:30.699396+0000","last_peered":"2024-04-04T06:56:30.699396+0000","last_clean":"2024-04-04T06:56:30.699396+0000","last_became_active":"2024-04-04T06:56:29.048110+0000","last_became_peered":"2024-04-04T06:56:29.048110+0000","last_unstale":"2024-04-04T06:56:30.699396+0000","last_undegraded":"2024-04-04T06:56:30.699396+0000","last_fullsized":"2024-04-04T06:56:30.699396+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T12:11:26.884771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.015873+0000","last_change":"2024-04-04T06:56:28.009331+0000","last_active":"2024-04-04T06:56:30.015873+0000","last_peered":"2024-04-04T06:56:30.015873+0000","last_clean":"2024-04-04T06:56:30.015873+0000","last_became_active":"2024-04-04T06:56:28.009044+0000","last_became_peered":"2024-04-04T06:56:28.009044+0000","last_unstale":"2024-04-04T06:56:30.015873+0000","last_undegraded":"2024-04-04T06:56:30.015873+0000","last_fullsized":"2024-04-04T06:56:30.015873+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_clean_scrub_stamp":"2024-04-04T06:56:26.956814+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T08:38:32.735117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.019776+0000","last_change":"2024-04-04T06:56:29.037028+0000","last_active":"2024-04-04T06:56:30.019776+0000","last_peered":"2024-04-04T06:56:30.019776+0000","last_clean":"2024-04-04T06:56:30.019776+0000","last_became_active":"2024-04-04T06:56:29.036771+0000","last_became_peered":"2024-04-04T06:56:29.036771+0000","last_unstale":"2024-04-04T06:56:30.019776+0000","last_undegraded":"2024-04-04T06:56:30.019776+0000","last_fullsized":"2024-04-04T06:56:30.019776+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T15:15:24.660634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.062098+0000","last_change":"2024-04-04T06:56:28.017650+0000","last_active":"2024-04-04T06:56:30.062098+0000","last_peered":"2024-04-04T06:56:30.062098+0000","last_clean":"2024-04-04T06:56:30.062098+0000","last_became_active":"2024-04-04T06:56:28.017083+0000","last_became_peered":"2024-04-04T06:56:28.017083+0000","last_unstale":"2024-04-04T06:56:30.062098+0000","last_undegraded":"2024-04-04T06:56:30.062098+0000","last_fullsized":"2024-04-04T06:56:30.062098+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_clean_scrub_stamp":"2024-04-04T06:56:26.956814+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T09:54:19.792854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.018695+0000","last_change":"2024-04-04T06:56:29.053241+0000","last_active":"2024-04-04T06:56:30.018695+0000","last_peered":"2024-04-04T06:56:30.018695+0000","last_clean":"2024-04-04T06:56:30.018695+0000","last_became_active":"2024-04-04T06:56:29.052948+0000","last_became_peered":"2024-04-04T06:56:29.052948+0000","last_unstale":"2024-04-04T06:56:30.018695+0000","last_undegraded":"2024-04-04T06:56:30.018695+0000","last_fullsized":"2024-04-04T06:56:30.018695+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T08:09:51.101974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.698548+0000","last_change":"2024-04-04T06:56:27.997550+0000","last_active":"2024-04-04T06:56:30.698548+0000","last_peered":"2024-04-04T06:56:30.698548+0000","last_clean":"2024-04-04T06:56:30.698548+0000","last_became_active":"2024-04-04T06:56:27.997242+0000","last_became_peered":"2024-04-04T06:56:27.997242+0000","last_unstale":"2024-04-04T06:56:30.698548+0000","last_undegraded":"2024-04-04T06:56:30.698548+0000","last_fullsized":"2024-04-04T06:56:30.698548+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_clean_scrub_stamp":"2024-04-04T06:56:26.956814+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T13:33:08.840819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.698091+0000","last_change":"2024-04-04T06:56:29.044039+0000","last_active":"2024-04-04T06:56:30.698091+0000","last_peered":"2024-04-04T06:56:30.698091+0000","last_clean":"2024-04-04T06:56:30.698091+0000","last_became_active":"2024-04-04T06:56:29.043302+0000","last_became_peered":"2024-04-04T06:56:29.043302+0000","last_unstale":"2024-04-04T06:56:30.698091+0000","last_undegraded":"2024-04-04T06:56:30.698091+0000","last_fullsized":"2024-04-04T06:56:30.698091+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T18:01:37.763615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.698610+0000","last_change":"2024-04-04T06:56:28.014841+0000","last_active":"2024-04-04T06:56:30.698610+0000","last_peered":"2024-04-04T06:56:30.698610+0000","last_clean":"2024-04-04T06:56:30.698610+0000","last_became_active":"2024-04-04T06:56:28.011606+0000","last_became_peered":"2024-04-04T06:56:28.011606+0000","last_unstale":"2024-04-04T06:56:30.698610+0000","last_undegraded":"2024-04-04T06:56:30.698610+0000","last_fullsized":"2024-04-04T06:56:30.698610+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_clean_scrub_stamp":"2024-04-04T06:56:26.956814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T13:32:44.896913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.021248+0000","last_change":"2024-04-04T06:56:29.035188+0000","last_active":"2024-04-04T06:56:30.021248+0000","last_peered":"2024-04-04T06:56:30.021248+0000","last_clean":"2024-04-04T06:56:30.021248+0000","last_became_active":"2024-04-04T06:56:29.034915+0000","last_became_peered":"2024-04-04T06:56:29.034915+0000","last_unstale":"2024-04-04T06:56:30.021248+0000","last_undegraded":"2024-04-04T06:56:30.021248+0000","last_fullsized":"2024-04-04T06:56:30.021248+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T16:01:05.840859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.061612+0000","last_change":"2024-04-04T06:56:28.016246+0000","last_active":"2024-04-04T06:56:30.061612+0000","last_peered":"2024-04-04T06:56:30.061612+0000","last_clean":"2024-04-04T06:56:30.061612+0000","last_became_active":"2024-04-04T06:56:28.014193+0000","last_became_peered":"2024-04-04T06:56:28.014193+0000","last_unstale":"2024-04-04T06:56:30.061612+0000","last_undegraded":"2024-04-04T06:56:30.061612+0000","last_fullsized":"2024-04-04T06:56:30.061612+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_clean_scrub_stamp":"2024-04-04T06:56:26.956814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T10:18:31.915978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.061865+0000","last_change":"2024-04-04T06:56:29.052430+0000","last_active":"2024-04-04T06:56:30.061865+0000","last_peered":"2024-04-04T06:56:30.061865+0000","last_clean":"2024-04-04T06:56:30.061865+0000","last_became_active":"2024-04-04T06:56:29.052112+0000","last_became_peered":"2024-04-04T06:56:29.052112+0000","last_unstale":"2024-04-04T06:56:30.061865+0000","last_undegraded":"2024-04-04T06:56:30.061865+0000","last_fullsized":"2024-04-04T06:56:30.061865+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T10:40:36.659855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.696511+0000","last_change":"2024-04-04T06:56:27.998416+0000","last_active":"2024-04-04T06:56:30.696511+0000","last_peered":"2024-04-04T06:56:30.696511+0000","last_clean":"2024-04-04T06:56:30.696511+0000","last_became_active":"2024-04-04T06:56:27.997342+0000","last_became_peered":"2024-04-04T06:56:27.997342+0000","last_unstale":"2024-04-04T06:56:30.696511+0000","last_undegraded":"2024-04-04T06:56:30.696511+0000","last_fullsized":"2024-04-04T06:56:30.696511+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_clean_scrub_stamp":"2024-04-04T06:56:26.956814+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T10:18:31.915978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.020893+0000","last_change":"2024-04-04T06:56:29.033505+0000","last_active":"2024-04-04T06:56:30.020893+0000","last_peered":"2024-04-04T06:56:30.020893+0000","last_clean":"2024-04-04T06:56:30.020893+0000","last_became_active":"2024-04-04T06:56:29.032725+0000","last_became_peered":"2024-04-04T06:56:29.032725+0000","last_unstale":"2024-04-04T06:56:30.020893+0000","last_undegraded":"2024-04-04T06:56:30.020893+0000","last_fullsized":"2024-04-04T06:56:30.020893+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T12:03:12.792963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.020304+0000","last_change":"2024-04-04T06:56:27.999979+0000","last_active":"2024-04-04T06:56:30.020304+0000","last_peered":"2024-04-04T06:56:30.020304+0000","last_clean":"2024-04-04T06:56:30.020304+0000","last_became_active":"2024-04-04T06:56:27.999169+0000","last_became_peered":"2024-04-04T06:56:27.999169+0000","last_unstale":"2024-04-04T06:56:30.020304+0000","last_undegraded":"2024-04-04T06:56:30.020304+0000","last_fullsized":"2024-04-04T06:56:30.020304+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_clean_scrub_stamp":"2024-04-04T06:56:26.956814+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T12:03:09.060630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.021458+0000","last_change":"2024-04-04T06:56:29.043619+0000","last_active":"2024-04-04T06:56:30.021458+0000","last_peered":"2024-04-04T06:56:30.021458+0000","last_clean":"2024-04-04T06:56:30.021458+0000","last_became_active":"2024-04-04T06:56:29.043335+0000","last_became_peered":"2024-04-04T06:56:29.043335+0000","last_unstale":"2024-04-04T06:56:30.021458+0000","last_undegraded":"2024-04-04T06:56:30.021458+0000","last_fullsized":"2024-04-04T06:56:30.021458+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T10:52:30.479480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.697225+0000","last_change":"2024-04-04T06:56:27.999367+0000","last_active":"2024-04-04T06:56:30.697225+0000","last_peered":"2024-04-04T06:56:30.697225+0000","last_clean":"2024-04-04T06:56:30.697225+0000","last_became_active":"2024-04-04T06:56:27.999073+0000","last_became_peered":"2024-04-04T06:56:27.999073+0000","last_unstale":"2024-04-04T06:56:30.697225+0000","last_undegraded":"2024-04-04T06:56:30.697225+0000","last_fullsized":"2024-04-04T06:56:30.697225+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_clean_scrub_stamp":"2024-04-04T06:56:26.956814+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T09:54:19.792854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.021694+0000","last_change":"2024-04-04T06:56:29.047512+0000","last_active":"2024-04-04T06:56:30.021694+0000","last_peered":"2024-04-04T06:56:30.021694+0000","last_clean":"2024-04-04T06:56:30.021694+0000","last_became_active":"2024-04-04T06:56:29.046259+0000","last_became_peered":"2024-04-04T06:56:29.046259+0000","last_unstale":"2024-04-04T06:56:30.021694+0000","last_undegraded":"2024-04-04T06:56:30.021694+0000","last_fullsized":"2024-04-04T06:56:30.021694+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T11:46:36.780783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.016251+0000","last_change":"2024-04-04T06:56:27.999707+0000","last_active":"2024-04-04T06:56:30.016251+0000","last_peered":"2024-04-04T06:56:30.016251+0000","last_clean":"2024-04-04T06:56:30.016251+0000","last_became_active":"2024-04-04T06:56:27.999398+0000","last_became_peered":"2024-04-04T06:56:27.999398+0000","last_unstale":"2024-04-04T06:56:30.016251+0000","last_undegraded":"2024-04-04T06:56:30.016251+0000","last_fullsized":"2024-04-04T06:56:30.016251+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_clean_scrub_stamp":"2024-04-04T06:56:26.956814+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T16:54:05.981179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.699399+0000","last_change":"2024-04-04T06:56:29.067217+0000","last_active":"2024-04-04T06:56:30.699399+0000","last_peered":"2024-04-04T06:56:30.699399+0000","last_clean":"2024-04-04T06:56:30.699399+0000","last_became_active":"2024-04-04T06:56:29.066762+0000","last_became_peered":"2024-04-04T06:56:29.066762+0000","last_unstale":"2024-04-04T06:56:30.699399+0000","last_undegraded":"2024-04-04T06:56:30.699399+0000","last_fullsized":"2024-04-04T06:56:30.699399+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T10:52:30.479480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.696812+0000","last_change":"2024-04-04T06:56:28.017607+0000","last_active":"2024-04-04T06:56:30.696812+0000","last_peered":"2024-04-04T06:56:30.696812+0000","last_clean":"2024-04-04T06:56:30.696812+0000","last_became_active":"2024-04-04T06:56:28.017322+0000","last_became_peered":"2024-04-04T06:56:28.017322+0000","last_unstale":"2024-04-04T06:56:30.696812+0000","last_undegraded":"2024-04-04T06:56:30.696812+0000","last_fullsized":"2024-04-04T06:56:30.696812+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_clean_scrub_stamp":"2024-04-04T06:56:26.956814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T16:13:09.520714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.020775+0000","last_change":"2024-04-04T06:56:29.044164+0000","last_active":"2024-04-04T06:56:30.020775+0000","last_peered":"2024-04-04T06:56:30.020775+0000","last_clean":"2024-04-04T06:56:30.020775+0000","last_became_active":"2024-04-04T06:56:29.043814+0000","last_became_peered":"2024-04-04T06:56:29.043814+0000","last_unstale":"2024-04-04T06:56:30.020775+0000","last_undegraded":"2024-04-04T06:56:30.020775+0000","last_fullsized":"2024-04-04T06:56:30.020775+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T10:24:01.060246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":170,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.017600+0000","last_change":"2024-04-04T06:56:19.364611+0000","last_active":"2024-04-04T06:56:30.017600+0000","last_peered":"2024-04-04T06:56:30.017600+0000","last_clean":"2024-04-04T06:56:30.017600+0000","last_became_active":"2024-04-04T06:56:19.362232+0000","last_became_peered":"2024-04-04T06:56:19.362232+0000","last_unstale":"2024-04-04T06:56:30.017600+0000","last_undegraded":"2024-04-04T06:56:30.017600+0000","last_fullsized":"2024-04-04T06:56:30.017600+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:17.744258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:17.744258+0000","last_clean_scrub_stamp":"2024-04-04T06:56:17.744258+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T17:25:16.494215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.698001+0000","last_change":"2024-04-04T06:56:28.009818+0000","last_active":"2024-04-04T06:56:30.698001+0000","last_peered":"2024-04-04T06:56:30.698001+0000","last_clean":"2024-04-04T06:56:30.698001+0000","last_became_active":"2024-04-04T06:56:28.005509+0000","last_became_peered":"2024-04-04T06:56:28.005509+0000","last_unstale":"2024-04-04T06:56:30.698001+0000","last_undegraded":"2024-04-04T06:56:30.698001+0000","last_fullsized":"2024-04-04T06:56:30.698001+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_clean_scrub_stamp":"2024-04-04T06:56:26.956814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T10:18:31.915978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.701399+0000","last_change":"2024-04-04T06:56:29.056563+0000","last_active":"2024-04-04T06:56:30.701399+0000","last_peered":"2024-04-04T06:56:30.701399+0000","last_clean":"2024-04-04T06:56:30.701399+0000","last_became_active":"2024-04-04T06:56:29.056289+0000","last_became_peered":"2024-04-04T06:56:29.056289+0000","last_unstale":"2024-04-04T06:56:30.701399+0000","last_undegraded":"2024-04-04T06:56:30.701399+0000","last_fullsized":"2024-04-04T06:56:30.701399+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T16:44:39.332035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.017655+0000","last_change":"2024-04-04T06:56:28.008107+0000","last_active":"2024-04-04T06:56:30.017655+0000","last_peered":"2024-04-04T06:56:30.017655+0000","last_clean":"2024-04-04T06:56:30.017655+0000","last_became_active":"2024-04-04T06:56:28.007840+0000","last_became_peered":"2024-04-04T06:56:28.007840+0000","last_unstale":"2024-04-04T06:56:30.017655+0000","last_undegraded":"2024-04-04T06:56:30.017655+0000","last_fullsized":"2024-04-04T06:56:30.017655+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_clean_scrub_stamp":"2024-04-04T06:56:26.956814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T16:54:05.981179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.697676+0000","last_change":"2024-04-04T06:56:29.026533+0000","last_active":"2024-04-04T06:56:30.697676+0000","last_peered":"2024-04-04T06:56:30.697676+0000","last_clean":"2024-04-04T06:56:30.697676+0000","last_became_active":"2024-04-04T06:56:29.025763+0000","last_became_peered":"2024-04-04T06:56:29.025763+0000","last_unstale":"2024-04-04T06:56:30.697676+0000","last_undegraded":"2024-04-04T06:56:30.697676+0000","last_fullsized":"2024-04-04T06:56:30.697676+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T14:56:36.711210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.696766+0000","last_change":"2024-04-04T06:56:27.994114+0000","last_active":"2024-04-04T06:56:30.696766+0000","last_peered":"2024-04-04T06:56:30.696766+0000","last_clean":"2024-04-04T06:56:30.696766+0000","last_became_active":"2024-04-04T06:56:27.993840+0000","last_became_peered":"2024-04-04T06:56:27.993840+0000","last_unstale":"2024-04-04T06:56:30.696766+0000","last_undegraded":"2024-04-04T06:56:30.696766+0000","last_fullsized":"2024-04-04T06:56:30.696766+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_clean_scrub_stamp":"2024-04-04T06:56:26.956814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T13:32:44.896913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.015501+0000","last_change":"2024-04-04T06:56:29.047339+0000","last_active":"2024-04-04T06:56:30.015501+0000","last_peered":"2024-04-04T06:56:30.015501+0000","last_clean":"2024-04-04T06:56:30.015501+0000","last_became_active":"2024-04-04T06:56:29.047084+0000","last_became_peered":"2024-04-04T06:56:29.047084+0000","last_unstale":"2024-04-04T06:56:30.015501+0000","last_undegraded":"2024-04-04T06:56:30.015501+0000","last_fullsized":"2024-04-04T06:56:30.015501+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T13:04:16.108138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.698907+0000","last_change":"2024-04-04T06:56:28.011081+0000","last_active":"2024-04-04T06:56:30.698907+0000","last_peered":"2024-04-04T06:56:30.698907+0000","last_clean":"2024-04-04T06:56:30.698907+0000","last_became_active":"2024-04-04T06:56:28.010741+0000","last_became_peered":"2024-04-04T06:56:28.010741+0000","last_unstale":"2024-04-04T06:56:30.698907+0000","last_undegraded":"2024-04-04T06:56:30.698907+0000","last_fullsized":"2024-04-04T06:56:30.698907+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_clean_scrub_stamp":"2024-04-04T06:56:26.956814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T08:38:32.735117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.019466+0000","last_change":"2024-04-04T06:56:29.038187+0000","last_active":"2024-04-04T06:56:30.019466+0000","last_peered":"2024-04-04T06:56:30.019466+0000","last_clean":"2024-04-04T06:56:30.019466+0000","last_became_active":"2024-04-04T06:56:29.037716+0000","last_became_peered":"2024-04-04T06:56:29.037716+0000","last_unstale":"2024-04-04T06:56:30.019466+0000","last_undegraded":"2024-04-04T06:56:30.019466+0000","last_fullsized":"2024-04-04T06:56:30.019466+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T08:38:33.741314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.015764+0000","last_change":"2024-04-04T06:56:28.006139+0000","last_active":"2024-04-04T06:56:30.015764+0000","last_peered":"2024-04-04T06:56:30.015764+0000","last_clean":"2024-04-04T06:56:30.015764+0000","last_became_active":"2024-04-04T06:56:28.005763+0000","last_became_peered":"2024-04-04T06:56:28.005763+0000","last_unstale":"2024-04-04T06:56:30.015764+0000","last_undegraded":"2024-04-04T06:56:30.015764+0000","last_fullsized":"2024-04-04T06:56:30.015764+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_clean_scrub_stamp":"2024-04-04T06:56:26.956814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T13:32:44.896913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.699033+0000","last_change":"2024-04-04T06:56:29.058128+0000","last_active":"2024-04-04T06:56:30.699033+0000","last_peered":"2024-04-04T06:56:30.699033+0000","last_clean":"2024-04-04T06:56:30.699033+0000","last_became_active":"2024-04-04T06:56:29.057809+0000","last_became_peered":"2024-04-04T06:56:29.057809+0000","last_unstale":"2024-04-04T06:56:30.699033+0000","last_undegraded":"2024-04-04T06:56:30.699033+0000","last_fullsized":"2024-04-04T06:56:30.699033+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T16:01:05.840859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.020996+0000","last_change":"2024-04-04T06:56:28.012156+0000","last_active":"2024-04-04T06:56:30.020996+0000","last_peered":"2024-04-04T06:56:30.020996+0000","last_clean":"2024-04-04T06:56:30.020996+0000","last_became_active":"2024-04-04T06:56:28.011880+0000","last_became_peered":"2024-04-04T06:56:28.011880+0000","last_unstale":"2024-04-04T06:56:30.020996+0000","last_undegraded":"2024-04-04T06:56:30.020996+0000","last_fullsized":"2024-04-04T06:56:30.020996+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_clean_scrub_stamp":"2024-04-04T06:56:26.956814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T10:21:04.212235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.015724+0000","last_change":"2024-04-04T06:56:29.042619+0000","last_active":"2024-04-04T06:56:30.015724+0000","last_peered":"2024-04-04T06:56:30.015724+0000","last_clean":"2024-04-04T06:56:30.015724+0000","last_became_active":"2024-04-04T06:56:29.042331+0000","last_became_peered":"2024-04-04T06:56:29.042331+0000","last_unstale":"2024-04-04T06:56:30.015724+0000","last_undegraded":"2024-04-04T06:56:30.015724+0000","last_fullsized":"2024-04-04T06:56:30.015724+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T08:11:58.552420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.016292+0000","last_change":"2024-04-04T06:56:28.014328+0000","last_active":"2024-04-04T06:56:30.016292+0000","last_peered":"2024-04-04T06:56:30.016292+0000","last_clean":"2024-04-04T06:56:30.016292+0000","last_became_active":"2024-04-04T06:56:28.014076+0000","last_became_peered":"2024-04-04T06:56:28.014076+0000","last_unstale":"2024-04-04T06:56:30.016292+0000","last_undegraded":"2024-04-04T06:56:30.016292+0000","last_fullsized":"2024-04-04T06:56:30.016292+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_clean_scrub_stamp":"2024-04-04T06:56:26.956814+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T15:15:23.654438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.701803+0000","last_change":"2024-04-04T06:56:29.051193+0000","last_active":"2024-04-04T06:56:30.701803+0000","last_peered":"2024-04-04T06:56:30.701803+0000","last_clean":"2024-04-04T06:56:30.701803+0000","last_became_active":"2024-04-04T06:56:29.045454+0000","last_became_peered":"2024-04-04T06:56:29.045454+0000","last_unstale":"2024-04-04T06:56:30.701803+0000","last_undegraded":"2024-04-04T06:56:30.701803+0000","last_fullsized":"2024-04-04T06:56:30.701803+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T17:04:57.682659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.062601+0000","last_change":"2024-04-04T06:56:28.012644+0000","last_active":"2024-04-04T06:56:30.062601+0000","last_peered":"2024-04-04T06:56:30.062601+0000","last_clean":"2024-04-04T06:56:30.062601+0000","last_became_active":"2024-04-04T06:56:28.012293+0000","last_became_peered":"2024-04-04T06:56:28.012293+0000","last_unstale":"2024-04-04T06:56:30.062601+0000","last_undegraded":"2024-04-04T06:56:30.062601+0000","last_fullsized":"2024-04-04T06:56:30.062601+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_clean_scrub_stamp":"2024-04-04T06:56:26.956814+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T13:32:44.896913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.698639+0000","last_change":"2024-04-04T06:56:29.044040+0000","last_active":"2024-04-04T06:56:30.698639+0000","last_peered":"2024-04-04T06:56:30.698639+0000","last_clean":"2024-04-04T06:56:30.698639+0000","last_became_active":"2024-04-04T06:56:29.042922+0000","last_became_peered":"2024-04-04T06:56:29.042922+0000","last_unstale":"2024-04-04T06:56:30.698639+0000","last_undegraded":"2024-04-04T06:56:30.698639+0000","last_fullsized":"2024-04-04T06:56:30.698639+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T13:04:16.108138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.017156+0000","last_change":"2024-04-04T06:56:28.012453+0000","last_active":"2024-04-04T06:56:30.017156+0000","last_peered":"2024-04-04T06:56:30.017156+0000","last_clean":"2024-04-04T06:56:30.017156+0000","last_became_active":"2024-04-04T06:56:28.011057+0000","last_became_peered":"2024-04-04T06:56:28.011057+0000","last_unstale":"2024-04-04T06:56:30.017156+0000","last_undegraded":"2024-04-04T06:56:30.017156+0000","last_fullsized":"2024-04-04T06:56:30.017156+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_clean_scrub_stamp":"2024-04-04T06:56:26.956814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T08:38:32.735117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.018349+0000","last_change":"2024-04-04T06:56:29.044746+0000","last_active":"2024-04-04T06:56:30.018349+0000","last_peered":"2024-04-04T06:56:30.018349+0000","last_clean":"2024-04-04T06:56:30.018349+0000","last_became_active":"2024-04-04T06:56:29.044423+0000","last_became_peered":"2024-04-04T06:56:29.044423+0000","last_unstale":"2024-04-04T06:56:30.018349+0000","last_undegraded":"2024-04-04T06:56:30.018349+0000","last_fullsized":"2024-04-04T06:56:30.018349+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T10:18:32.922174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.015451+0000","last_change":"2024-04-04T06:56:27.996226+0000","last_active":"2024-04-04T06:56:30.015451+0000","last_peered":"2024-04-04T06:56:30.015451+0000","last_clean":"2024-04-04T06:56:30.015451+0000","last_became_active":"2024-04-04T06:56:27.995835+0000","last_became_peered":"2024-04-04T06:56:27.995835+0000","last_unstale":"2024-04-04T06:56:30.015451+0000","last_undegraded":"2024-04-04T06:56:30.015451+0000","last_fullsized":"2024-04-04T06:56:30.015451+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_clean_scrub_stamp":"2024-04-04T06:56:26.956814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T09:54:19.792854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.701001+0000","last_change":"2024-04-04T06:56:29.056813+0000","last_active":"2024-04-04T06:56:30.701001+0000","last_peered":"2024-04-04T06:56:30.701001+0000","last_clean":"2024-04-04T06:56:30.701001+0000","last_became_active":"2024-04-04T06:56:29.052514+0000","last_became_peered":"2024-04-04T06:56:29.052514+0000","last_unstale":"2024-04-04T06:56:30.701001+0000","last_undegraded":"2024-04-04T06:56:30.701001+0000","last_fullsized":"2024-04-04T06:56:30.701001+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T10:40:36.659855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.015571+0000","last_change":"2024-04-04T06:56:27.999750+0000","last_active":"2024-04-04T06:56:30.015571+0000","last_peered":"2024-04-04T06:56:30.015571+0000","last_clean":"2024-04-04T06:56:30.015571+0000","last_became_active":"2024-04-04T06:56:27.997685+0000","last_became_peered":"2024-04-04T06:56:27.997685+0000","last_unstale":"2024-04-04T06:56:30.015571+0000","last_undegraded":"2024-04-04T06:56:30.015571+0000","last_fullsized":"2024-04-04T06:56:30.015571+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_clean_scrub_stamp":"2024-04-04T06:56:26.956814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T10:18:31.915978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.701301+0000","last_change":"2024-04-04T06:56:29.056179+0000","last_active":"2024-04-04T06:56:30.701301+0000","last_peered":"2024-04-04T06:56:30.701301+0000","last_clean":"2024-04-04T06:56:30.701301+0000","last_became_active":"2024-04-04T06:56:29.055682+0000","last_became_peered":"2024-04-04T06:56:29.055682+0000","last_unstale":"2024-04-04T06:56:30.701301+0000","last_undegraded":"2024-04-04T06:56:30.701301+0000","last_fullsized":"2024-04-04T06:56:30.701301+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T08:11:58.552420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.021102+0000","last_change":"2024-04-04T06:56:28.010871+0000","last_active":"2024-04-04T06:56:30.021102+0000","last_peered":"2024-04-04T06:56:30.021102+0000","last_clean":"2024-04-04T06:56:30.021102+0000","last_became_active":"2024-04-04T06:56:28.010159+0000","last_became_peered":"2024-04-04T06:56:28.010159+0000","last_unstale":"2024-04-04T06:56:30.021102+0000","last_undegraded":"2024-04-04T06:56:30.021102+0000","last_fullsized":"2024-04-04T06:56:30.021102+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_clean_scrub_stamp":"2024-04-04T06:56:26.956814+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T12:35:20.051203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.061957+0000","last_change":"2024-04-04T06:56:29.051332+0000","last_active":"2024-04-04T06:56:30.061957+0000","last_peered":"2024-04-04T06:56:30.061957+0000","last_clean":"2024-04-04T06:56:30.061957+0000","last_became_active":"2024-04-04T06:56:29.051026+0000","last_became_peered":"2024-04-04T06:56:29.051026+0000","last_unstale":"2024-04-04T06:56:30.061957+0000","last_undegraded":"2024-04-04T06:56:30.061957+0000","last_fullsized":"2024-04-04T06:56:30.061957+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T10:04:08.170276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.698934+0000","last_change":"2024-04-04T06:56:29.045951+0000","last_active":"2024-04-04T06:56:30.698934+0000","last_peered":"2024-04-04T06:56:30.698934+0000","last_clean":"2024-04-04T06:56:30.698934+0000","last_became_active":"2024-04-04T06:56:29.044806+0000","last_became_peered":"2024-04-04T06:56:29.044806+0000","last_unstale":"2024-04-04T06:56:30.698934+0000","last_undegraded":"2024-04-04T06:56:30.698934+0000","last_fullsized":"2024-04-04T06:56:30.698934+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T10:24:01.060246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.019571+0000","last_change":"2024-04-04T06:56:28.022012+0000","last_active":"2024-04-04T06:56:30.019571+0000","last_peered":"2024-04-04T06:56:30.019571+0000","last_clean":"2024-04-04T06:56:30.019571+0000","last_became_active":"2024-04-04T06:56:28.021708+0000","last_became_peered":"2024-04-04T06:56:28.021708+0000","last_unstale":"2024-04-04T06:56:30.019571+0000","last_undegraded":"2024-04-04T06:56:30.019571+0000","last_fullsized":"2024-04-04T06:56:30.019571+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_clean_scrub_stamp":"2024-04-04T06:56:26.956814+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T15:15:23.654438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.698972+0000","last_change":"2024-04-04T06:56:29.045589+0000","last_active":"2024-04-04T06:56:30.698972+0000","last_peered":"2024-04-04T06:56:30.698972+0000","last_clean":"2024-04-04T06:56:30.698972+0000","last_became_active":"2024-04-04T06:56:29.045071+0000","last_became_peered":"2024-04-04T06:56:29.045071+0000","last_unstale":"2024-04-04T06:56:30.698972+0000","last_undegraded":"2024-04-04T06:56:30.698972+0000","last_fullsized":"2024-04-04T06:56:30.698972+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T18:38:49.851932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.019137+0000","last_change":"2024-04-04T06:56:28.014130+0000","last_active":"2024-04-04T06:56:30.019137+0000","last_peered":"2024-04-04T06:56:30.019137+0000","last_clean":"2024-04-04T06:56:30.019137+0000","last_became_active":"2024-04-04T06:56:28.013846+0000","last_became_peered":"2024-04-04T06:56:28.013846+0000","last_unstale":"2024-04-04T06:56:30.019137+0000","last_undegraded":"2024-04-04T06:56:30.019137+0000","last_fullsized":"2024-04-04T06:56:30.019137+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_clean_scrub_stamp":"2024-04-04T06:56:26.956814+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T15:09:29.813629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.698978+0000","last_change":"2024-04-04T06:56:29.049076+0000","last_active":"2024-04-04T06:56:30.698978+0000","last_peered":"2024-04-04T06:56:30.698978+0000","last_clean":"2024-04-04T06:56:30.698978+0000","last_became_active":"2024-04-04T06:56:29.048096+0000","last_became_peered":"2024-04-04T06:56:29.048096+0000","last_unstale":"2024-04-04T06:56:30.698978+0000","last_undegraded":"2024-04-04T06:56:30.698978+0000","last_fullsized":"2024-04-04T06:56:30.698978+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T16:44:39.332035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.701741+0000","last_change":"2024-04-04T06:56:27.998042+0000","last_active":"2024-04-04T06:56:30.701741+0000","last_peered":"2024-04-04T06:56:30.701741+0000","last_clean":"2024-04-04T06:56:30.701741+0000","last_became_active":"2024-04-04T06:56:27.996925+0000","last_became_peered":"2024-04-04T06:56:27.996925+0000","last_unstale":"2024-04-04T06:56:30.701741+0000","last_undegraded":"2024-04-04T06:56:30.701741+0000","last_fullsized":"2024-04-04T06:56:30.701741+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_clean_scrub_stamp":"2024-04-04T06:56:26.956814+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T16:13:09.520714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.701597+0000","last_change":"2024-04-04T06:56:29.051673+0000","last_active":"2024-04-04T06:56:30.701597+0000","last_peered":"2024-04-04T06:56:30.701597+0000","last_clean":"2024-04-04T06:56:30.701597+0000","last_became_active":"2024-04-04T06:56:29.051400+0000","last_became_peered":"2024-04-04T06:56:29.051400+0000","last_unstale":"2024-04-04T06:56:30.701597+0000","last_undegraded":"2024-04-04T06:56:30.701597+0000","last_fullsized":"2024-04-04T06:56:30.701597+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:27.963011+0000","last_clean_scrub_stamp":"2024-04-04T06:56:27.963011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T12:11:26.884771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-04T06:56:30.699097+0000","last_change":"2024-04-04T06:56:28.000376+0000","last_active":"2024-04-04T06:56:30.699097+0000","last_peered":"2024-04-04T06:56:30.699097+0000","last_clean":"2024-04-04T06:56:30.699097+0000","last_became_active":"2024-04-04T06:56:27.999779+0000","last_became_peered":"2024-04-04T06:56:27.999779+0000","last_unstale":"2024-04-04T06:56:30.699097+0000","last_undegraded":"2024-04-04T06:56:30.699097+0000","last_fullsized":"2024-04-04T06:56:30.699097+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:26.956814+0000","last_clean_scrub_stamp":"2024-04-04T06:56:26.956814+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T13:47:51.595456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574856,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27808,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344032,"statfs":{"total":96636764160,"available":96608288768,"internally_reserved":0,"allocated":802816,"data_stored":661884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":208896,"data_stored":71024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":71060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574856,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574856,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":70934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":212992,"data_stored":71094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":811008,"data_stored":661940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-04T06:56:39.744 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-04T06:56:39.744 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-04-04T06:56:39.744 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-04-04T06:56:39.744 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-04T06:56:39.983 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.984+0000 7fa5ce400640 1 Processor -- start 2024-04-04T06:56:39.983 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.984+0000 7fa5ce400640 1 -- start start 2024-04-04T06:56:39.984 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.985+0000 7fa5ce400640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fa5c815e630 0x7fa5c80d22c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:39.984 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.985+0000 7fa5ce400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa5c80b9f40 0x7fa5c80cf010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:39.984 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.986+0000 7fa5ce400640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5c80d2c30 con 0x7fa5c80d3cd0 2024-04-04T06:56:39.984 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.986+0000 7fa5ce400640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fa5c80b8380 con 0x7fa5c815e630 2024-04-04T06:56:39.984 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.986+0000 7fa5ce400640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fa5c80d2f10 con 0x7fa5c80b9f40 2024-04-04T06:56:39.985 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.986+0000 7fa5cda00640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fa5c80d3cd0 0x7fa5c8071a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:39570/0 (socket says 172.21.15.72:39570) 2024-04-04T06:56:39.985 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.986+0000 7fa5cda00640 1 -- 172.21.15.72:0/2654889271 learned_addr learned my addr 172.21.15.72:0/2654889271 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-04-04T06:56:39.986 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.986+0000 7fa5cd000640 1 --2- 172.21.15.72:0/2654889271 >> v2:172.21.15.117:3300/0 conn(0x7fa5c815e630 0x7fa5c80d22c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:39.987 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.986+0000 7fa5bfe00640 1 --2- 172.21.15.72:0/2654889271 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa5c80b9f40 0x7fa5c80cf010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:39.987 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.986+0000 7fa5c7e00640 1 -- 172.21.15.72:0/2654889271 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1166678558 0 0) 0x7fa5c80d2c30 con 0x7fa5c80d3cd0 2024-04-04T06:56:39.987 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.986+0000 7fa5c7e00640 1 -- 172.21.15.72:0/2654889271 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa5ac003520 con 0x7fa5c80d3cd0 2024-04-04T06:56:39.987 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.987+0000 7fa5c7e00640 1 -- 172.21.15.72:0/2654889271 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1634952572 0 0) 0x7fa5ac003520 con 0x7fa5c80d3cd0 2024-04-04T06:56:39.987 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.987+0000 7fa5c7e00640 1 -- 172.21.15.72:0/2654889271 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa5c80b9f40 msgr2=0x7fa5c80cf010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:56:39.987 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.987+0000 7fa5c7e00640 1 --2- 172.21.15.72:0/2654889271 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa5c80b9f40 0x7fa5c80cf010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:39.987 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.987+0000 7fa5c7e00640 1 -- 172.21.15.72:0/2654889271 >> v2:172.21.15.117:3300/0 conn(0x7fa5c815e630 msgr2=0x7fa5c80d22c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:56:39.987 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.987+0000 7fa5c7e00640 1 --2- 172.21.15.72:0/2654889271 >> v2:172.21.15.117:3300/0 conn(0x7fa5c815e630 0x7fa5c80d22c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:39.987 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.987+0000 7fa5c7e00640 1 -- 172.21.15.72:0/2654889271 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5c80d31f0 con 0x7fa5c80d3cd0 2024-04-04T06:56:39.987 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.987+0000 7fa5c7e00640 1 -- 172.21.15.72:0/2654889271 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2465650867 0 0) 0x7fa5c00019f0 con 0x7fa5c80d3cd0 2024-04-04T06:56:39.987 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.987+0000 7fa5c7e00640 1 -- 172.21.15.72:0/2654889271 >> v1:172.21.15.72:6789/0 conn(0x7fa5c80d3cd0 legacy=0x7fa5c8071a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:39.987 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.987+0000 7fa5c7e00640 1 --2- 172.21.15.72:0/2654889271 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa5ac0039b0 0x7fa5ac003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:39.987 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.987+0000 7fa5c7e00640 1 --2- 172.21.15.72:0/2654889271 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa5ac004800 0x7fa5ac004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:39.988 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.987+0000 7fa5c7e00640 1 --2- 172.21.15.72:0/2654889271 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa5ac0051c0 0x7fa5ac00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:39.988 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.987+0000 7fa5c7e00640 1 -- 172.21.15.72:0/2654889271 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fa5c80b8380 con 0x7fa5ac0039b0 2024-04-04T06:56:39.988 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.987+0000 7fa5c7e00640 1 -- 172.21.15.72:0/2654889271 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fa5c80d2f10 con 0x7fa5ac0051c0 2024-04-04T06:56:39.988 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.987+0000 7fa5c7e00640 1 -- 172.21.15.72:0/2654889271 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fa5ac00bfe0 con 0x7fa5ac004800 2024-04-04T06:56:39.988 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.987+0000 7fa5bfe00640 1 --2- 172.21.15.72:0/2654889271 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa5c80b9f40 0x7fa5c80cf010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-04T06:56:39.988 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.987+0000 7fa5cd000640 1 --2- 172.21.15.72:0/2654889271 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa5ac0039b0 0x7fa5ac003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:39.988 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.987+0000 7fa5cd000640 1 -- 172.21.15.72:0/2654889271 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa5ac004800 msgr2=0x7fa5ac004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:56:39.988 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.987+0000 7fa5cd000640 1 --2- 172.21.15.72:0/2654889271 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa5ac004800 0x7fa5ac004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:39.988 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.987+0000 7fa5cd000640 1 -- 172.21.15.72:0/2654889271 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa5ac0051c0 msgr2=0x7fa5ac00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:56:39.988 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.987+0000 7fa5cd000640 1 --2- 172.21.15.72:0/2654889271 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa5ac0051c0 0x7fa5ac00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:39.988 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.987+0000 7fa5cd000640 1 -- 172.21.15.72:0/2654889271 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5ac003520 con 0x7fa5ac0039b0 2024-04-04T06:56:39.988 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.988+0000 7fa5cd000640 1 --2- 172.21.15.72:0/2654889271 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa5ac0039b0 0x7fa5ac003dd0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fa5b8009ac0 tx=0x7fa5ac005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cf9ea700335d638 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:39.990 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.989+0000 7fa5c7e00640 1 -- 172.21.15.72:0/2654889271 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5b8039070 con 0x7fa5ac0039b0 2024-04-04T06:56:39.990 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.989+0000 7fa5c7e00640 1 -- 172.21.15.72:0/2654889271 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5b802c710 con 0x7fa5ac0039b0 2024-04-04T06:56:39.990 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.989+0000 7fa5c7e00640 1 -- 172.21.15.72:0/2654889271 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5b8009690 con 0x7fa5ac0039b0 2024-04-04T06:56:39.990 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.989+0000 7fa5ce400640 1 -- 172.21.15.72:0/2654889271 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa5ac0039b0 msgr2=0x7fa5ac003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:39.990 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.989+0000 7fa5ce400640 1 --2- 172.21.15.72:0/2654889271 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa5ac0039b0 0x7fa5ac003dd0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fa5b8009ac0 tx=0x7fa5ac005830 comp rx=0 tx=0).stop 2024-04-04T06:56:39.990 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.989+0000 7fa5cda00640 1 -- 172.21.15.72:0/2654889271 reap_dead start 2024-04-04T06:56:39.990 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.990+0000 7fa5ce400640 1 -- 172.21.15.72:0/2654889271 shutdown_connections 2024-04-04T06:56:39.990 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.990+0000 7fa5ce400640 1 -- 172.21.15.72:0/2654889271 >> 172.21.15.72:0/2654889271 conn(0x7fa5c806b860 msgr2=0x7fa5c806bc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:56:39.990 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.990+0000 7fa5ce400640 1 -- 172.21.15.72:0/2654889271 shutdown_connections 2024-04-04T06:56:39.990 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.990+0000 7fa5ce400640 1 -- 172.21.15.72:0/2654889271 wait complete. 2024-04-04T06:56:39.990 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.991+0000 7fa5ce400640 1 Processor -- start 2024-04-04T06:56:39.990 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.991+0000 7fa5ce400640 1 -- start start 2024-04-04T06:56:39.992 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.992+0000 7fa5ce400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa5ac0039b0 0x7fa5c815fef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:39.992 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.992+0000 7fa5ce400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa5c8161620 0x7fa5c8154e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:39.992 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.992+0000 7fa5ce400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa5c81f7d10 0x7fa5c81f81a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:39.992 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.992+0000 7fa5ce400640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fa5c80d2800 con 0x7fa5c8161620 2024-04-04T06:56:39.993 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.992+0000 7fa5ce400640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fa5c80d37b0 con 0x7fa5ac0039b0 2024-04-04T06:56:39.993 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.992+0000 7fa5ce400640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fa5c80d2980 con 0x7fa5c81f7d10 2024-04-04T06:56:39.993 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.992+0000 7fa5bfe00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa5c8161620 0x7fa5c8154e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:39.993 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.992+0000 7fa5bfe00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa5c8161620 0x7fa5c8154e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:34606/0 (socket says 172.21.15.72:34606) 2024-04-04T06:56:39.993 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.993+0000 7fa5bfe00640 1 -- 172.21.15.72:0/1491284249 learned_addr learned my addr 172.21.15.72:0/1491284249 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:56:39.993 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.993+0000 7fa5cd000640 1 --2- 172.21.15.72:0/1491284249 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa5ac0039b0 0x7fa5c815fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:39.993 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.993+0000 7fa5bfe00640 1 -- 172.21.15.72:0/1491284249 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa5c81f7d10 msgr2=0x7fa5c81f81a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:39.993 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.993+0000 7fa5bfe00640 1 --2- 172.21.15.72:0/1491284249 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa5c81f7d10 0x7fa5c81f81a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:39.993 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.993+0000 7fa5bfe00640 1 -- 172.21.15.72:0/1491284249 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa5ac0039b0 msgr2=0x7fa5c815fef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:39.993 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.993+0000 7fa5bfe00640 1 --2- 172.21.15.72:0/1491284249 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa5ac0039b0 0x7fa5c815fef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:39.993 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.993+0000 7fa5bfe00640 1 -- 172.21.15.72:0/1491284249 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5c815ee50 con 0x7fa5c8161620 2024-04-04T06:56:39.993 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.993+0000 7fa5bfe00640 1 --2- 172.21.15.72:0/1491284249 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa5c8161620 0x7fa5c8154e40 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fa5b0006d40 tx=0x7fa5b000d910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:39.993 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.993+0000 7fa5c5600640 1 -- 172.21.15.72:0/1491284249 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5b0004030 con 0x7fa5c8161620 2024-04-04T06:56:39.993 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.993+0000 7fa5c5600640 1 -- 172.21.15.72:0/1491284249 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5b00041f0 con 0x7fa5c8161620 2024-04-04T06:56:39.993 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.993+0000 7fa5c5600640 1 -- 172.21.15.72:0/1491284249 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5b0003610 con 0x7fa5c8161620 2024-04-04T06:56:39.994 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.993+0000 7fa5ce400640 1 -- 172.21.15.72:0/1491284249 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5c815f130 con 0x7fa5c8161620 2024-04-04T06:56:39.994 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.993+0000 7fa5ce400640 1 -- 172.21.15.72:0/1491284249 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5c815f6f0 con 0x7fa5c8161620 2024-04-04T06:56:39.994 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.995+0000 7fa5ce400640 1 -- 172.21.15.72:0/1491284249 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa5c806c1a0 con 0x7fa5c8161620 2024-04-04T06:56:39.994 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.995+0000 7fa5c5600640 1 -- 172.21.15.72:0/1491284249 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa5b00037b0 con 0x7fa5c8161620 2024-04-04T06:56:39.995 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.996+0000 7fa5c5600640 1 --2- 172.21.15.72:0/1491284249 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fa5a406c8f0 0x7fa5a406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:39.995 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.996+0000 7fa5c5600640 1 -- 172.21.15.72:0/1491284249 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fa5b008bad0 con 0x7fa5c8161620 2024-04-04T06:56:39.995 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.996+0000 7fa5cd000640 1 --2- 172.21.15.72:0/1491284249 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fa5a406c8f0 0x7fa5a406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:39.995 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:39.997+0000 7fa5cd000640 1 --2- 172.21.15.72:0/1491284249 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fa5a406c8f0 0x7fa5a406edb0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fa5b8036000 tx=0x7fa5b8030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:39.999 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:40.001+0000 7fa5c5600640 1 -- 172.21.15.72:0/1491284249 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fa5c806c1a0 con 0x7fa5c8161620 2024-04-04T06:56:40.239 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:40.240+0000 7fa5ce400640 1 -- 172.21.15.72:0/1491284249 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fa5c80d04c0 con 0x7fa5c8161620 2024-04-04T06:56:40.239 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:40.241+0000 7fa5c5600640 1 -- 172.21.15.72:0/1491284249 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7fa5c80d04c0 con 0x7fa5c8161620 2024-04-04T06:56:40.240 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T06:56:40.240 INFO:teuthology.orchestra.run.smithi072.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-04T06:56:40.243 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:40.244+0000 7fa5ce400640 1 -- 172.21.15.72:0/1491284249 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fa5a406c8f0 msgr2=0x7fa5a406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:40.243 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:40.244+0000 7fa5ce400640 1 --2- 172.21.15.72:0/1491284249 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fa5a406c8f0 0x7fa5a406edb0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fa5b8036000 tx=0x7fa5b8030000 comp rx=0 tx=0).stop 2024-04-04T06:56:40.243 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:40.244+0000 7fa5ce400640 1 -- 172.21.15.72:0/1491284249 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa5c8161620 msgr2=0x7fa5c8154e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:40.243 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:40.244+0000 7fa5ce400640 1 --2- 172.21.15.72:0/1491284249 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa5c8161620 0x7fa5c8154e40 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fa5b0006d40 tx=0x7fa5b000d910 comp rx=0 tx=0).stop 2024-04-04T06:56:40.243 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:40.244+0000 7fa5ce400640 1 -- 172.21.15.72:0/1491284249 shutdown_connections 2024-04-04T06:56:40.243 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:40.244+0000 7fa5ce400640 1 --2- 172.21.15.72:0/1491284249 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fa5a406c8f0 0x7fa5a406edb0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:40.243 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:40.244+0000 7fa5ce400640 1 --2- 172.21.15.72:0/1491284249 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa5c81f7d10 0x7fa5c81f81a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:40.243 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:40.244+0000 7fa5ce400640 1 --2- 172.21.15.72:0/1491284249 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa5c8161620 0x7fa5c8154e40 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:40.243 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:40.244+0000 7fa5ce400640 1 --2- 172.21.15.72:0/1491284249 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa5ac0039b0 0x7fa5c815fef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:40.243 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:40.244+0000 7fa5ce400640 1 -- 172.21.15.72:0/1491284249 >> 172.21.15.72:0/1491284249 conn(0x7fa5c806b860 msgr2=0x7fa5c815b850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:56:40.244 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:40.244+0000 7fa5ce400640 1 -- 172.21.15.72:0/1491284249 shutdown_connections 2024-04-04T06:56:40.244 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:40.244+0000 7fa5ce400640 1 -- 172.21.15.72:0/1491284249 wait complete. 2024-04-04T06:56:40.265 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-04-04T06:56:40.266 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-04T06:56:40.449 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:40.450+0000 7efdf9e00640 1 Processor -- start 2024-04-04T06:56:40.449 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:40.450+0000 7efdf9e00640 1 -- start start 2024-04-04T06:56:40.450 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:40.451+0000 7efdf9e00640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7efdf415e5a0 0x7efdf40b75c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:40.450 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:40.451+0000 7efdf9e00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7efdf40b7b00 0x7efdf40d2e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:40.451 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:40.451+0000 7efdf9e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efdf40d3370 0x7efdf40d08e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:40.451 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:40.451+0000 7efdf9e00640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7efdf40d3820 con 0x7efdf415e5a0 2024-04-04T06:56:40.451 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:40.451+0000 7efdf9e00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7efdf40cf7f0 con 0x7efdf40b7b00 2024-04-04T06:56:40.451 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:40.451+0000 7efdf9e00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7efdf40cfad0 con 0x7efdf40d3370 2024-04-04T06:56:40.451 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:40.452+0000 7efdf8a00640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7efdf415e5a0 0x7efdf40b75c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:40.451 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:40.452+0000 7efdf8a00640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7efdf415e5a0 0x7efdf40b75c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:34610/0 (socket says 172.21.15.72:34610) 2024-04-04T06:56:40.451 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:40.452+0000 7efdf8a00640 1 -- 172.21.15.72:0/3953354978 learned_addr learned my addr 172.21.15.72:0/3953354978 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:56:40.451 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:40.452+0000 7efdf3e00640 1 --2- 172.21.15.72:0/3953354978 >> v2:172.21.15.117:3300/0 conn(0x7efdf40b7b00 0x7efdf40d2e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:40.451 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:40.452+0000 7efdf8a00640 1 -- 172.21.15.72:0/3953354978 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efdf40d3370 msgr2=0x7efdf40d08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:56:40.451 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:40.452+0000 7efdf8a00640 1 --2- 172.21.15.72:0/3953354978 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efdf40d3370 0x7efdf40d08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:40.451 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:40.452+0000 7efdf8a00640 1 -- 172.21.15.72:0/3953354978 >> v2:172.21.15.117:3300/0 conn(0x7efdf40b7b00 msgr2=0x7efdf40d2e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:56:40.451 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:40.452+0000 7efdf8a00640 1 --2- 172.21.15.72:0/3953354978 >> v2:172.21.15.117:3300/0 conn(0x7efdf40b7b00 0x7efdf40d2e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:40.451 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:40.452+0000 7efdf8a00640 1 -- 172.21.15.72:0/3953354978 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdf40d2350 con 0x7efdf415e5a0 2024-04-04T06:56:40.452 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:40.453+0000 7efdf8a00640 1 --2- 172.21.15.72:0/3953354978 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efdf415e5a0 0x7efdf40b75c0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7efdf4072be0 tx=0x7efde802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69ec8b47a9a78e10 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:40.453 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:40.453+0000 7efdf3400640 1 -- 172.21.15.72:0/3953354978 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efde8035020 con 0x7efdf415e5a0 2024-04-04T06:56:40.453 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:40.453+0000 7efdf3400640 1 -- 172.21.15.72:0/3953354978 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efde8031870 con 0x7efdf415e5a0 2024-04-04T06:56:40.453 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:40.453+0000 7efdf3400640 1 -- 172.21.15.72:0/3953354978 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efde8031c40 con 0x7efdf415e5a0 2024-04-04T06:56:40.453 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:40.454+0000 7efdf9e00640 1 -- 172.21.15.72:0/3953354978 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efdf415e5a0 msgr2=0x7efdf40b75c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:40.453 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:40.454+0000 7efdf9e00640 1 --2- 172.21.15.72:0/3953354978 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efdf415e5a0 0x7efdf40b75c0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7efdf4072be0 tx=0x7efde802b910 comp rx=0 tx=0).stop 2024-04-04T06:56:40.453 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:40.454+0000 7efdf9e00640 1 -- 172.21.15.72:0/3953354978 shutdown_connections 2024-04-04T06:56:40.453 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:40.454+0000 7efdf9e00640 1 --2- 172.21.15.72:0/3953354978 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efdf40d3370 0x7efdf40d08e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:40.453 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:40.454+0000 7efdf9e00640 1 --2- 172.21.15.72:0/3953354978 >> v2:172.21.15.117:3300/0 conn(0x7efdf40b7b00 0x7efdf40d2e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:40.453 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:40.454+0000 7efdf9e00640 1 --2- 172.21.15.72:0/3953354978 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efdf415e5a0 0x7efdf40b75c0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:40.453 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:40.454+0000 7efdf9e00640 1 -- 172.21.15.72:0/3953354978 >> 172.21.15.72:0/3953354978 conn(0x7efdf406b890 msgr2=0x7efdf406bca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:56:40.453 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:40.454+0000 7efdf9e00640 1 -- 172.21.15.72:0/3953354978 shutdown_connections 2024-04-04T06:56:40.453 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:40.454+0000 7efdf9e00640 1 -- 172.21.15.72:0/3953354978 wait complete. 2024-04-04T06:56:40.454 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:40.456+0000 7efdf9e00640 1 Processor -- start 2024-04-04T06:56:40.454 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:40.456+0000 7efdf9e00640 1 -- start start 2024-04-04T06:56:40.455 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:40.457+0000 7efdf9e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efdf40b7b00 0x7efdf41531f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:40.456 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:40.457+0000 7efdf9e00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efdf40d3370 0x7efdf40aab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:40.456 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:40.457+0000 7efdf9e00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efdf415e5a0 0x7efdf40cd230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:40.456 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:40.457+0000 7efdf9e00640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7efdf415e980 con 0x7efdf40d3370 2024-04-04T06:56:40.456 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:40.457+0000 7efdf9e00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7efdf40d2910 con 0x7efdf415e5a0 2024-04-04T06:56:40.456 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:40.457+0000 7efdf9e00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7efdf40d0e20 con 0x7efdf40b7b00 2024-04-04T06:56:40.456 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:40.457+0000 7efdf3e00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efdf40d3370 0x7efdf40aab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:40.456 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:40.457+0000 7efdf3e00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efdf40d3370 0x7efdf40aab90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:34616/0 (socket says 172.21.15.72:34616) 2024-04-04T06:56:40.456 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:40.457+0000 7efdf3e00640 1 -- 172.21.15.72:0/1318106654 learned_addr learned my addr 172.21.15.72:0/1318106654 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:56:40.456 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:40.457+0000 7efdf9400640 1 --2- 172.21.15.72:0/1318106654 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efdf415e5a0 0x7efdf40cd230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:40.456 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:40.457+0000 7efdf8a00640 1 --2- 172.21.15.72:0/1318106654 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efdf40b7b00 0x7efdf41531f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:40.457 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:40.458+0000 7efdf3e00640 1 -- 172.21.15.72:0/1318106654 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efdf40b7b00 msgr2=0x7efdf41531f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:40.457 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:40.458+0000 7efdf3e00640 1 --2- 172.21.15.72:0/1318106654 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efdf40b7b00 0x7efdf41531f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:40.457 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:40.458+0000 7efdf3e00640 1 -- 172.21.15.72:0/1318106654 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efdf415e5a0 msgr2=0x7efdf40cd230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:40.457 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:40.458+0000 7efdf3e00640 1 --2- 172.21.15.72:0/1318106654 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efdf415e5a0 0x7efdf40cd230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:40.458 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:40.458+0000 7efdf3e00640 1 -- 172.21.15.72:0/1318106654 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdf41f4730 con 0x7efdf40d3370 2024-04-04T06:56:40.458 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:40.458+0000 7efdf3e00640 1 --2- 172.21.15.72:0/1318106654 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efdf40d3370 0x7efdf40aab90 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7efde000d7d0 tx=0x7efde000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:40.458 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:40.458+0000 7efdf0c00640 1 -- 172.21.15.72:0/1318106654 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efde000b6c0 con 0x7efdf40d3370 2024-04-04T06:56:40.458 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:40.458+0000 7efdf0c00640 1 -- 172.21.15.72:0/1318106654 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efde0019070 con 0x7efdf40d3370 2024-04-04T06:56:40.458 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:40.458+0000 7efdf0c00640 1 -- 172.21.15.72:0/1318106654 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efde000bac0 con 0x7efdf40d3370 2024-04-04T06:56:40.458 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:40.458+0000 7efdf9e00640 1 -- 172.21.15.72:0/1318106654 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efdf4153730 con 0x7efdf40d3370 2024-04-04T06:56:40.458 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:40.458+0000 7efdf9e00640 1 -- 172.21.15.72:0/1318106654 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efdf40cc470 con 0x7efdf40d3370 2024-04-04T06:56:40.459 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:40.460+0000 7efdf9e00640 1 -- 172.21.15.72:0/1318106654 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efdf40756c0 con 0x7efdf40d3370 2024-04-04T06:56:40.459 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:40.460+0000 7efdf0c00640 1 -- 172.21.15.72:0/1318106654 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7efde000bc60 con 0x7efdf40d3370 2024-04-04T06:56:40.459 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:40.461+0000 7efdf0c00640 1 --2- 172.21.15.72:0/1318106654 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7efdd406c8f0 0x7efdd406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:40.459 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:40.461+0000 7efdf0c00640 1 -- 172.21.15.72:0/1318106654 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7efde008bfd0 con 0x7efdf40d3370 2024-04-04T06:56:40.459 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:40.461+0000 7efdf8a00640 1 --2- 172.21.15.72:0/1318106654 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7efdd406c8f0 0x7efdd406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:40.460 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:40.462+0000 7efdf8a00640 1 --2- 172.21.15.72:0/1318106654 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7efdd406c8f0 0x7efdd406edb0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7efde8036000 tx=0x7efde803c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:40.464 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:40.466+0000 7efdf0c00640 1 -- 172.21.15.72:0/1318106654 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7efde005a360 con 0x7efdf40d3370 2024-04-04T06:56:40.653 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:40.654+0000 7efdf9e00640 1 -- 172.21.15.72:0/1318106654 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7efdf40d2090 con 0x7efdf40d3370 2024-04-04T06:56:40.654 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:40.655+0000 7efdf0c00640 1 -- 172.21.15.72:0/1318106654 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16581 (secure 0 0 0) 0x7efde0059c60 con 0x7efdf40d3370 2024-04-04T06:56:40.654 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T06:56:40.655 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":20,"fsid":"6708bac2-4f50-49b5-87a9-c390fd333eb3","created":"2024-04-04T06:56:04.282498+0000","modified":"2024-04-04T06:56:30.007371+0000","last_up_change":"2024-04-04T06:56:16.716089+0000","last_in_change":"2024-04-04T06:56:07.768593+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-04T06:56:17.421685+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-04T06:56:26.822661+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-04T06:56:27.429816+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7c345991-5af8-4dc6-a481-28610c40e128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":3889813953},{"type":"v1","addr":"172.21.15.72:6818","nonce":3889813953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":3889813953},{"type":"v1","addr":"172.21.15.72:6821","nonce":3889813953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":3889813953},{"type":"v1","addr":"172.21.15.72:6826","nonce":3889813953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":3889813953},{"type":"v1","addr":"172.21.15.72:6823","nonce":3889813953}]},"public_addr":"172.21.15.72:6818/3889813953","cluster_addr":"172.21.15.72:6821/3889813953","heartbeat_back_addr":"172.21.15.72:6826/3889813953","heartbeat_front_addr":"172.21.15.72:6823/3889813953","state":["exists","up"]},{"osd":1,"uuid":"1b3f7ab2-a56c-488d-a89a-1f3572361c95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":3101663154},{"type":"v1","addr":"172.21.15.72:6801","nonce":3101663154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":3101663154},{"type":"v1","addr":"172.21.15.72:6803","nonce":3101663154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":3101663154},{"type":"v1","addr":"172.21.15.72:6807","nonce":3101663154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":3101663154},{"type":"v1","addr":"172.21.15.72:6805","nonce":3101663154}]},"public_addr":"172.21.15.72:6801/3101663154","cluster_addr":"172.21.15.72:6803/3101663154","heartbeat_back_addr":"172.21.15.72:6807/3101663154","heartbeat_front_addr":"172.21.15.72:6805/3101663154","state":["exists","up"]},{"osd":2,"uuid":"fc9aa512-53df-40d7-ba04-3e6b7dcd1e34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":235374192},{"type":"v1","addr":"172.21.15.72:6809","nonce":235374192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":235374192},{"type":"v1","addr":"172.21.15.72:6811","nonce":235374192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":235374192},{"type":"v1","addr":"172.21.15.72:6815","nonce":235374192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":235374192},{"type":"v1","addr":"172.21.15.72:6813","nonce":235374192}]},"public_addr":"172.21.15.72:6809/235374192","cluster_addr":"172.21.15.72:6811/235374192","heartbeat_back_addr":"172.21.15.72:6815/235374192","heartbeat_front_addr":"172.21.15.72:6813/235374192","state":["exists","up"]},{"osd":3,"uuid":"b4f63eed-dc5b-4aba-bb50-de46eb41492b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6817","nonce":2806631742},{"type":"v1","addr":"172.21.15.72:6819","nonce":2806631742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":2806631742},{"type":"v1","addr":"172.21.15.72:6827","nonce":2806631742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":2806631742},{"type":"v1","addr":"172.21.15.72:6831","nonce":2806631742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":2806631742},{"type":"v1","addr":"172.21.15.72:6829","nonce":2806631742}]},"public_addr":"172.21.15.72:6819/2806631742","cluster_addr":"172.21.15.72:6827/2806631742","heartbeat_back_addr":"172.21.15.72:6831/2806631742","heartbeat_front_addr":"172.21.15.72:6829/2806631742","state":["exists","up"]},{"osd":4,"uuid":"9e985ef8-d711-4172-9286-c54e560895d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":4293536423},{"type":"v1","addr":"172.21.15.117:6825","nonce":4293536423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":4293536423},{"type":"v1","addr":"172.21.15.117:6827","nonce":4293536423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":4293536423},{"type":"v1","addr":"172.21.15.117:6831","nonce":4293536423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":4293536423},{"type":"v1","addr":"172.21.15.117:6829","nonce":4293536423}]},"public_addr":"172.21.15.117:6825/4293536423","cluster_addr":"172.21.15.117:6827/4293536423","heartbeat_back_addr":"172.21.15.117:6831/4293536423","heartbeat_front_addr":"172.21.15.117:6829/4293536423","state":["exists","up"]},{"osd":5,"uuid":"3e9f082b-8d7d-455f-8a96-66d0b4857125","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":684971679},{"type":"v1","addr":"172.21.15.117:6801","nonce":684971679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":684971679},{"type":"v1","addr":"172.21.15.117:6803","nonce":684971679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":684971679},{"type":"v1","addr":"172.21.15.117:6807","nonce":684971679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":684971679},{"type":"v1","addr":"172.21.15.117:6805","nonce":684971679}]},"public_addr":"172.21.15.117:6801/684971679","cluster_addr":"172.21.15.117:6803/684971679","heartbeat_back_addr":"172.21.15.117:6807/684971679","heartbeat_front_addr":"172.21.15.117:6805/684971679","state":["exists","up"]},{"osd":6,"uuid":"bcdafa9f-a870-4398-a38d-ab7697676473","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":2781186528},{"type":"v1","addr":"172.21.15.117:6809","nonce":2781186528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":2781186528},{"type":"v1","addr":"172.21.15.117:6811","nonce":2781186528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":2781186528},{"type":"v1","addr":"172.21.15.117:6815","nonce":2781186528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":2781186528},{"type":"v1","addr":"172.21.15.117:6813","nonce":2781186528}]},"public_addr":"172.21.15.117:6809/2781186528","cluster_addr":"172.21.15.117:6811/2781186528","heartbeat_back_addr":"172.21.15.117:6815/2781186528","heartbeat_front_addr":"172.21.15.117:6813/2781186528","state":["exists","up"]},{"osd":7,"uuid":"b68ec562-ff35-4d2d-a733-c896f8920cfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":617469882},{"type":"v1","addr":"172.21.15.117:6817","nonce":617469882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":617469882},{"type":"v1","addr":"172.21.15.117:6819","nonce":617469882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":617469882},{"type":"v1","addr":"172.21.15.117:6823","nonce":617469882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":617469882},{"type":"v1","addr":"172.21.15.117:6821","nonce":617469882}]},"public_addr":"172.21.15.117:6817/617469882","cluster_addr":"172.21.15.117:6819/617469882","heartbeat_back_addr":"172.21.15.117:6823/617469882","heartbeat_front_addr":"172.21.15.117:6821/617469882","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.347700+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.296619+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.361345+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.093323+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:12.857605+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:12.816090+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.083163+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.121639+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-04T06:56:40.657 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:40.658+0000 7efdf9e00640 1 -- 172.21.15.72:0/1318106654 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7efdd406c8f0 msgr2=0x7efdd406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:40.657 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:40.658+0000 7efdf9e00640 1 --2- 172.21.15.72:0/1318106654 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7efdd406c8f0 0x7efdd406edb0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7efde8036000 tx=0x7efde803c040 comp rx=0 tx=0).stop 2024-04-04T06:56:40.657 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:40.658+0000 7efdf9e00640 1 -- 172.21.15.72:0/1318106654 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efdf40d3370 msgr2=0x7efdf40aab90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:40.657 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:40.658+0000 7efdf9e00640 1 --2- 172.21.15.72:0/1318106654 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efdf40d3370 0x7efdf40aab90 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7efde000d7d0 tx=0x7efde000dc90 comp rx=0 tx=0).stop 2024-04-04T06:56:40.657 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:40.658+0000 7efdf9e00640 1 -- 172.21.15.72:0/1318106654 shutdown_connections 2024-04-04T06:56:40.657 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:40.658+0000 7efdf9e00640 1 --2- 172.21.15.72:0/1318106654 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7efdd406c8f0 0x7efdd406edb0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:40.657 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:40.658+0000 7efdf9e00640 1 --2- 172.21.15.72:0/1318106654 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efdf415e5a0 0x7efdf40cd230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:40.657 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:40.658+0000 7efdf9e00640 1 --2- 172.21.15.72:0/1318106654 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efdf40d3370 0x7efdf40aab90 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:40.657 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:40.658+0000 7efdf9e00640 1 --2- 172.21.15.72:0/1318106654 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efdf40b7b00 0x7efdf41531f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:40.657 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:40.658+0000 7efdf9e00640 1 -- 172.21.15.72:0/1318106654 >> 172.21.15.72:0/1318106654 conn(0x7efdf406b890 msgr2=0x7efdf4160b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:56:40.658 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:40.658+0000 7efdf9e00640 1 -- 172.21.15.72:0/1318106654 shutdown_connections 2024-04-04T06:56:40.658 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:40.658+0000 7efdf9e00640 1 -- 172.21.15.72:0/1318106654 wait complete. 2024-04-04T06:56:40.675 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-04T06:56:17.421685+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-04T06:56:26.822661+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-04T06:56:27.429816+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-04T06:56:40.675 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-04T06:56:40.880 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:40.882+0000 7fa09ba00640 1 Processor -- start 2024-04-04T06:56:40.881 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:40.882+0000 7fa09ba00640 1 -- start start 2024-04-04T06:56:40.883 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:40.883+0000 7fa09ba00640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa09406b470 0x7fa09406b850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:40.883 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:40.883+0000 7fa09ba00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fa0940b3ac0 0x7fa0940b3f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:40.883 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:40.884+0000 7fa09ba00640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa09406bd90 con 0x7fa094071c60 2024-04-04T06:56:40.883 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:40.884+0000 7fa09ba00640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7fa0940b44b0 con 0x7fa09406b470 2024-04-04T06:56:40.883 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:40.884+0000 7fa09ba00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fa0940b46f0 con 0x7fa0940b3ac0 2024-04-04T06:56:40.883 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:40.884+0000 7fa099000640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa09406b470 0x7fa09406b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:40.884 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:40.884+0000 7fa099a00640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fa094071c60 0x7fa094072090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:39584/0 (socket says 172.21.15.72:39584) 2024-04-04T06:56:40.884 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:40.884+0000 7fa099a00640 1 -- 172.21.15.72:0/2507124626 learned_addr learned my addr 172.21.15.72:0/2507124626 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-04-04T06:56:40.884 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:40.884+0000 7fa08be00640 1 --2- 172.21.15.72:0/2507124626 >> v2:172.21.15.117:3300/0 conn(0x7fa0940b3ac0 0x7fa0940b3f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:40.884 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:40.884+0000 7fa099000640 1 -- 172.21.15.72:0/2507124626 >> v2:172.21.15.117:3300/0 conn(0x7fa0940b3ac0 msgr2=0x7fa0940b3f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:56:40.884 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:40.884+0000 7fa099000640 1 --2- 172.21.15.72:0/2507124626 >> v2:172.21.15.117:3300/0 conn(0x7fa0940b3ac0 0x7fa0940b3f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:40.884 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:40.884+0000 7fa099000640 1 -- 172.21.15.72:0/2507124626 >> v1:172.21.15.72:6789/0 conn(0x7fa094071c60 legacy=0x7fa094072090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:40.884 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:40.884+0000 7fa099000640 1 -- 172.21.15.72:0/2507124626 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0941630b0 con 0x7fa09406b470 2024-04-04T06:56:40.884 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:40.884+0000 7fa093e00640 1 -- 172.21.15.72:0/2507124626 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2021999956 0 0) 0x7fa09406bd90 con 0x7fa094071c60 2024-04-04T06:56:40.885 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:40.885+0000 7fa099000640 1 --2- 172.21.15.72:0/2507124626 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa09406b470 0x7fa09406b850 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fa094072cd0 tx=0x7fa08402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32fe56a1e3daa86f server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:40.886 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:40.886+0000 7fa093e00640 1 -- 172.21.15.72:0/2507124626 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0840315a0 con 0x7fa09406b470 2024-04-04T06:56:40.886 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:40.886+0000 7fa093e00640 1 -- 172.21.15.72:0/2507124626 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa084037070 con 0x7fa09406b470 2024-04-04T06:56:40.886 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:40.886+0000 7fa093e00640 1 -- 172.21.15.72:0/2507124626 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa084031960 con 0x7fa09406b470 2024-04-04T06:56:40.886 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:40.886+0000 7fa09ba00640 1 -- 172.21.15.72:0/2507124626 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa09406b470 msgr2=0x7fa09406b850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:40.886 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:40.886+0000 7fa09ba00640 1 --2- 172.21.15.72:0/2507124626 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa09406b470 0x7fa09406b850 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fa094072cd0 tx=0x7fa08402b840 comp rx=0 tx=0).stop 2024-04-04T06:56:40.886 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:40.886+0000 7fa09ba00640 1 -- 172.21.15.72:0/2507124626 shutdown_connections 2024-04-04T06:56:40.886 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:40.886+0000 7fa09ba00640 1 --2- 172.21.15.72:0/2507124626 >> v2:172.21.15.117:3300/0 conn(0x7fa0940b3ac0 0x7fa0940b3f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:40.886 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:40.886+0000 7fa09ba00640 1 --2- 172.21.15.72:0/2507124626 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa09406b470 0x7fa09406b850 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:40.886 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:40.886+0000 7fa09ba00640 1 -- 172.21.15.72:0/2507124626 >> 172.21.15.72:0/2507124626 conn(0x7fa094074b00 msgr2=0x7fa0940b23b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:56:40.886 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:40.886+0000 7fa09ba00640 1 -- 172.21.15.72:0/2507124626 shutdown_connections 2024-04-04T06:56:40.886 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:40.886+0000 7fa09ba00640 1 -- 172.21.15.72:0/2507124626 wait complete. 2024-04-04T06:56:40.887 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:40.888+0000 7fa09ba00640 1 Processor -- start 2024-04-04T06:56:40.887 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:40.888+0000 7fa09ba00640 1 -- start start 2024-04-04T06:56:40.888 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:40.889+0000 7fa09ba00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa09406b470 0x7fa0940c6f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:40.888 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:40.889+0000 7fa09ba00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa094071c60 0x7fa094160600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:40.888 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:40.889+0000 7fa09ba00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa0940b3ac0 0x7fa09415cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:40.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:40.889+0000 7fa09ba00640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fa0941625d0 con 0x7fa09406b470 2024-04-04T06:56:40.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:40.889+0000 7fa09ba00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fa0941622f0 con 0x7fa094071c60 2024-04-04T06:56:40.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:40.889+0000 7fa09ba00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fa0941628b0 con 0x7fa0940b3ac0 2024-04-04T06:56:40.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:40.889+0000 7fa099000640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa09406b470 0x7fa0940c6f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:40.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:40.890+0000 7fa099000640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa09406b470 0x7fa0940c6f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:34642/0 (socket says 172.21.15.72:34642) 2024-04-04T06:56:40.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:40.890+0000 7fa099000640 1 -- 172.21.15.72:0/597430489 learned_addr learned my addr 172.21.15.72:0/597430489 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:56:40.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:40.890+0000 7fa08be00640 1 --2- 172.21.15.72:0/597430489 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa094071c60 0x7fa094160600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:40.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:40.890+0000 7fa099000640 1 -- 172.21.15.72:0/597430489 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa0940b3ac0 msgr2=0x7fa09415cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:40.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:40.890+0000 7fa099a00640 1 --2- 172.21.15.72:0/597430489 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa0940b3ac0 0x7fa09415cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:40.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:40.890+0000 7fa099000640 1 --2- 172.21.15.72:0/597430489 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa0940b3ac0 0x7fa09415cc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:40.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:40.890+0000 7fa099000640 1 -- 172.21.15.72:0/597430489 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa094071c60 msgr2=0x7fa094160600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:40.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:40.890+0000 7fa099000640 1 --2- 172.21.15.72:0/597430489 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa094071c60 0x7fa094160600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:40.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:40.890+0000 7fa099000640 1 -- 172.21.15.72:0/597430489 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0940c61d0 con 0x7fa09406b470 2024-04-04T06:56:40.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:40.890+0000 7fa08be00640 1 --2- 172.21.15.72:0/597430489 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa094071c60 0x7fa094160600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-04T06:56:40.890 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:40.890+0000 7fa099000640 1 --2- 172.21.15.72:0/597430489 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa09406b470 0x7fa0940c6f90 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fa084009890 tx=0x7fa0840046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:40.890 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:40.891+0000 7fa091600640 1 -- 172.21.15.72:0/597430489 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa084032630 con 0x7fa09406b470 2024-04-04T06:56:40.890 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:40.891+0000 7fa091600640 1 -- 172.21.15.72:0/597430489 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0840327d0 con 0x7fa09406b470 2024-04-04T06:56:40.890 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:40.891+0000 7fa091600640 1 -- 172.21.15.72:0/597430489 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa084032ba0 con 0x7fa09406b470 2024-04-04T06:56:40.891 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:40.891+0000 7fa09ba00640 1 -- 172.21.15.72:0/597430489 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0940c64b0 con 0x7fa09406b470 2024-04-04T06:56:40.891 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:40.891+0000 7fa09ba00640 1 -- 172.21.15.72:0/597430489 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa09415d150 con 0x7fa09406b470 2024-04-04T06:56:40.891 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:40.892+0000 7fa09ba00640 1 -- 172.21.15.72:0/597430489 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa094075730 con 0x7fa09406b470 2024-04-04T06:56:40.891 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:40.893+0000 7fa091600640 1 -- 172.21.15.72:0/597430489 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa08403b3f0 con 0x7fa09406b470 2024-04-04T06:56:40.892 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:40.893+0000 7fa091600640 1 --2- 172.21.15.72:0/597430489 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fa07006c8f0 0x7fa07006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:40.892 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:40.893+0000 7fa091600640 1 -- 172.21.15.72:0/597430489 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fa08402f030 con 0x7fa09406b470 2024-04-04T06:56:40.892 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:40.894+0000 7fa08be00640 1 --2- 172.21.15.72:0/597430489 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fa07006c8f0 0x7fa07006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:40.892 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:40.894+0000 7fa08be00640 1 --2- 172.21.15.72:0/597430489 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fa07006c8f0 0x7fa07006edb0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fa07c006fd0 tx=0x7fa07c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:40.900 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:40.902+0000 7fa091600640 1 -- 172.21.15.72:0/597430489 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fa084040070 con 0x7fa09406b470 2024-04-04T06:56:41.100 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:41.101+0000 7fa09ba00640 1 -- 172.21.15.72:0/597430489 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fa094067fa0 con 0x7fa09406b470 2024-04-04T06:56:41.100 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:41.102+0000 7fa091600640 1 -- 172.21.15.72:0/597430489 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) ==== 93+0+10 (secure 0 0 0) 0x7fa08407bea0 con 0x7fa09406b470 2024-04-04T06:56:41.101 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 1 2024-04-04T06:56:41.103 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:41.104+0000 7fa09ba00640 1 -- 172.21.15.72:0/597430489 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fa07006c8f0 msgr2=0x7fa07006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:41.103 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:41.104+0000 7fa09ba00640 1 --2- 172.21.15.72:0/597430489 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fa07006c8f0 0x7fa07006edb0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fa07c006fd0 tx=0x7fa07c008040 comp rx=0 tx=0).stop 2024-04-04T06:56:41.104 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:41.104+0000 7fa09ba00640 1 -- 172.21.15.72:0/597430489 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa09406b470 msgr2=0x7fa0940c6f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:41.104 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:41.104+0000 7fa09ba00640 1 --2- 172.21.15.72:0/597430489 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa09406b470 0x7fa0940c6f90 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fa084009890 tx=0x7fa0840046c0 comp rx=0 tx=0).stop 2024-04-04T06:56:41.104 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:41.105+0000 7fa09ba00640 1 -- 172.21.15.72:0/597430489 shutdown_connections 2024-04-04T06:56:41.104 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:41.105+0000 7fa09ba00640 1 --2- 172.21.15.72:0/597430489 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fa07006c8f0 0x7fa07006edb0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:41.104 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:41.105+0000 7fa09ba00640 1 --2- 172.21.15.72:0/597430489 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa0940b3ac0 0x7fa09415cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:41.104 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:41.105+0000 7fa09ba00640 1 --2- 172.21.15.72:0/597430489 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa094071c60 0x7fa094160600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:41.104 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:41.105+0000 7fa09ba00640 1 --2- 172.21.15.72:0/597430489 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa09406b470 0x7fa0940c6f90 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:41.104 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:41.105+0000 7fa09ba00640 1 -- 172.21.15.72:0/597430489 >> 172.21.15.72:0/597430489 conn(0x7fa094074b00 msgr2=0x7fa094158540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:56:41.104 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:41.105+0000 7fa09ba00640 1 -- 172.21.15.72:0/597430489 shutdown_connections 2024-04-04T06:56:41.104 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:41.105+0000 7fa09ba00640 1 -- 172.21.15.72:0/597430489 wait complete. 2024-04-04T06:56:41.128 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-04T06:56:41.331 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:41.332+0000 7fd9b4400640 1 Processor -- start 2024-04-04T06:56:41.331 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:41.332+0000 7fd9b4400640 1 -- start start 2024-04-04T06:56:41.333 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:41.333+0000 7fd9b4400640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fd9ac0d08b0 0x7fd9ac0cee50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:41.333 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:41.333+0000 7fd9b4400640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd9ac0cd4b0 0x7fd9ac0cf390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:41.333 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:41.334+0000 7fd9b4400640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd9ac074570 con 0x7fd9ac15e690 2024-04-04T06:56:41.333 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:41.334+0000 7fd9b4400640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7fd9ac074850 con 0x7fd9ac0cd4b0 2024-04-04T06:56:41.333 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:41.334+0000 7fd9b4400640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fd9ac074b30 con 0x7fd9ac0d08b0 2024-04-04T06:56:41.333 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:41.334+0000 7fd9b1a00640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fd9ac15e690 0x7fd9ac0d01a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:39590/0 (socket says 172.21.15.72:39590) 2024-04-04T06:56:41.333 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:41.334+0000 7fd9b1a00640 1 -- 172.21.15.72:0/3845800985 learned_addr learned my addr 172.21.15.72:0/3845800985 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-04-04T06:56:41.334 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:41.334+0000 7fd9b2400640 1 --2- 172.21.15.72:0/3845800985 >> v2:172.21.15.72:3300/0 conn(0x7fd9ac0cd4b0 0x7fd9ac0cf390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:41.334 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:41.334+0000 7fd9b1000640 1 --2- 172.21.15.72:0/3845800985 >> v2:172.21.15.117:3300/0 conn(0x7fd9ac0d08b0 0x7fd9ac0cee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:41.334 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:41.334+0000 7fd9abe00640 1 -- 172.21.15.72:0/3845800985 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 682645301 0 0) 0x7fd9ac074570 con 0x7fd9ac15e690 2024-04-04T06:56:41.334 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:41.334+0000 7fd9abe00640 1 -- 172.21.15.72:0/3845800985 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd994003520 con 0x7fd9ac15e690 2024-04-04T06:56:41.334 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:41.335+0000 7fd9b2400640 1 -- 172.21.15.72:0/3845800985 >> v2:172.21.15.117:3300/0 conn(0x7fd9ac0d08b0 msgr2=0x7fd9ac0cee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:56:41.334 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:41.335+0000 7fd9b2400640 1 --2- 172.21.15.72:0/3845800985 >> v2:172.21.15.117:3300/0 conn(0x7fd9ac0d08b0 0x7fd9ac0cee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:41.334 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:41.335+0000 7fd9b2400640 1 -- 172.21.15.72:0/3845800985 >> v1:172.21.15.72:6789/0 conn(0x7fd9ac15e690 legacy=0x7fd9ac0d01a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:41.334 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:41.335+0000 7fd9b2400640 1 -- 172.21.15.72:0/3845800985 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9ac074e10 con 0x7fd9ac0cd4b0 2024-04-04T06:56:41.334 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:41.336+0000 7fd9b2400640 1 --2- 172.21.15.72:0/3845800985 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd9ac0cd4b0 0x7fd9ac0cf390 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fd9ac071f90 tx=0x7fd9a402bec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff85892531cbad94 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:41.336 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:41.336+0000 7fd9abe00640 1 -- 172.21.15.72:0/3845800985 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9a4039070 con 0x7fd9ac0cd4b0 2024-04-04T06:56:41.336 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:41.337+0000 7fd9abe00640 1 -- 172.21.15.72:0/3845800985 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9a402cc70 con 0x7fd9ac0cd4b0 2024-04-04T06:56:41.336 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:41.337+0000 7fd9abe00640 1 -- 172.21.15.72:0/3845800985 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9a4034660 con 0x7fd9ac0cd4b0 2024-04-04T06:56:41.336 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:41.337+0000 7fd9b4400640 1 -- 172.21.15.72:0/3845800985 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd9ac0cd4b0 msgr2=0x7fd9ac0cf390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:41.336 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:41.337+0000 7fd9b4400640 1 --2- 172.21.15.72:0/3845800985 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd9ac0cd4b0 0x7fd9ac0cf390 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fd9ac071f90 tx=0x7fd9a402bec0 comp rx=0 tx=0).stop 2024-04-04T06:56:41.336 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:41.337+0000 7fd9b4400640 1 -- 172.21.15.72:0/3845800985 shutdown_connections 2024-04-04T06:56:41.336 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:41.337+0000 7fd9b4400640 1 --2- 172.21.15.72:0/3845800985 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd9ac0cd4b0 0x7fd9ac0cf390 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:41.336 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:41.337+0000 7fd9b4400640 1 --2- 172.21.15.72:0/3845800985 >> v2:172.21.15.117:3300/0 conn(0x7fd9ac0d08b0 0x7fd9ac0cee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:41.336 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:41.337+0000 7fd9b4400640 1 -- 172.21.15.72:0/3845800985 >> 172.21.15.72:0/3845800985 conn(0x7fd9ac0cda20 msgr2=0x7fd9ac0cde00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:56:41.336 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:41.337+0000 7fd9b4400640 1 -- 172.21.15.72:0/3845800985 shutdown_connections 2024-04-04T06:56:41.336 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:41.337+0000 7fd9b4400640 1 -- 172.21.15.72:0/3845800985 wait complete. 2024-04-04T06:56:41.342 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:41.340+0000 7fd9b4400640 1 Processor -- start 2024-04-04T06:56:41.342 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:41.340+0000 7fd9b4400640 1 -- start start 2024-04-04T06:56:41.344 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:41.342+0000 7fd9b4400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd9ac0cd4b0 0x7fd9ac0b1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:41.344 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:41.342+0000 7fd9b4400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd9ac0d08b0 0x7fd9ac0a0db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:41.344 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:41.342+0000 7fd9b4400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd9ac15e690 0x7fd9ac0a12f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:41.345 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:41.342+0000 7fd9b4400640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fd9ac06b470 con 0x7fd9ac15e690 2024-04-04T06:56:41.345 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:41.342+0000 7fd9b4400640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fd9ac0750f0 con 0x7fd9ac0cd4b0 2024-04-04T06:56:41.345 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:41.342+0000 7fd9b4400640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fd9ac06b5f0 con 0x7fd9ac0d08b0 2024-04-04T06:56:41.345 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:41.342+0000 7fd9b2400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd9ac15e690 0x7fd9ac0a12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:41.345 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:41.342+0000 7fd9b2400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd9ac15e690 0x7fd9ac0a12f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:34654/0 (socket says 172.21.15.72:34654) 2024-04-04T06:56:41.345 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:41.342+0000 7fd9b2400640 1 -- 172.21.15.72:0/3989359988 learned_addr learned my addr 172.21.15.72:0/3989359988 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:56:41.345 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:41.342+0000 7fd9b1a00640 1 --2- 172.21.15.72:0/3989359988 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd9ac0cd4b0 0x7fd9ac0b1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:41.345 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:41.342+0000 7fd9b1000640 1 --2- 172.21.15.72:0/3989359988 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd9ac0d08b0 0x7fd9ac0a0db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:41.346 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:41.342+0000 7fd9b2400640 1 -- 172.21.15.72:0/3989359988 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd9ac0d08b0 msgr2=0x7fd9ac0a0db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:41.346 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:41.343+0000 7fd9b2400640 1 --2- 172.21.15.72:0/3989359988 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd9ac0d08b0 0x7fd9ac0a0db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:41.346 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:41.343+0000 7fd9b2400640 1 -- 172.21.15.72:0/3989359988 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd9ac0cd4b0 msgr2=0x7fd9ac0b1ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:41.346 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:41.343+0000 7fd9b2400640 1 --2- 172.21.15.72:0/3989359988 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd9ac0cd4b0 0x7fd9ac0b1ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:41.346 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:41.343+0000 7fd9b2400640 1 -- 172.21.15.72:0/3989359988 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9ac0c9e40 con 0x7fd9ac15e690 2024-04-04T06:56:41.346 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:41.343+0000 7fd9b1000640 1 --2- 172.21.15.72:0/3989359988 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd9ac0d08b0 0x7fd9ac0a0db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-04T06:56:41.346 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:41.343+0000 7fd9b2400640 1 --2- 172.21.15.72:0/3989359988 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd9ac15e690 0x7fd9ac0a12f0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fd9a4009e80 tx=0x7fd9a4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:41.346 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:41.343+0000 7fd9a9600640 1 -- 172.21.15.72:0/3989359988 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9a4039050 con 0x7fd9ac15e690 2024-04-04T06:56:41.346 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:41.343+0000 7fd9a9600640 1 -- 172.21.15.72:0/3989359988 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9a4045070 con 0x7fd9ac15e690 2024-04-04T06:56:41.346 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:41.343+0000 7fd9b4400640 1 -- 172.21.15.72:0/3989359988 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9ac0ca120 con 0x7fd9ac15e690 2024-04-04T06:56:41.346 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:41.343+0000 7fd9a9600640 1 -- 172.21.15.72:0/3989359988 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9a4009450 con 0x7fd9ac15e690 2024-04-04T06:56:41.346 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:41.343+0000 7fd9b4400640 1 -- 172.21.15.72:0/3989359988 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9ac0ca6e0 con 0x7fd9ac15e690 2024-04-04T06:56:41.346 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:41.345+0000 7fd9b4400640 1 -- 172.21.15.72:0/3989359988 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd9ac158070 con 0x7fd9ac15e690 2024-04-04T06:56:41.347 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:41.345+0000 7fd9a9600640 1 -- 172.21.15.72:0/3989359988 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd9a403e850 con 0x7fd9ac15e690 2024-04-04T06:56:41.347 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:41.346+0000 7fd9a9600640 1 --2- 172.21.15.72:0/3989359988 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fd98c06c8f0 0x7fd98c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:41.347 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:41.346+0000 7fd9a9600640 1 -- 172.21.15.72:0/3989359988 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fd9a40ae710 con 0x7fd9ac15e690 2024-04-04T06:56:41.347 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:41.346+0000 7fd9b1a00640 1 --2- 172.21.15.72:0/3989359988 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fd98c06c8f0 0x7fd98c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:41.347 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:41.347+0000 7fd9b1a00640 1 --2- 172.21.15.72:0/3989359988 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fd98c06c8f0 0x7fd98c06edb0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd9a0007fd0 tx=0x7fd9a0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:41.352 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:41.354+0000 7fd9a9600640 1 -- 172.21.15.72:0/3989359988 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fd9ac158070 con 0x7fd9ac15e690 2024-04-04T06:56:41.578 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:41.579+0000 7fd9b4400640 1 -- 172.21.15.72:0/3989359988 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fd9ac06eed0 con 0x7fd9ac15e690 2024-04-04T06:56:41.578 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:41.580+0000 7fd9a9600640 1 -- 172.21.15.72:0/3989359988 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) ==== 104+0+11 (secure 0 0 0) 0x7fd9ac06eed0 con 0x7fd9ac15e690 2024-04-04T06:56:41.579 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2024-04-04T06:56:41.582 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:41.583+0000 7fd9b4400640 1 -- 172.21.15.72:0/3989359988 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fd98c06c8f0 msgr2=0x7fd98c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:41.582 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:41.583+0000 7fd9b4400640 1 --2- 172.21.15.72:0/3989359988 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fd98c06c8f0 0x7fd98c06edb0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd9a0007fd0 tx=0x7fd9a0009040 comp rx=0 tx=0).stop 2024-04-04T06:56:41.582 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:41.583+0000 7fd9b4400640 1 -- 172.21.15.72:0/3989359988 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd9ac15e690 msgr2=0x7fd9ac0a12f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:41.582 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:41.583+0000 7fd9b4400640 1 --2- 172.21.15.72:0/3989359988 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd9ac15e690 0x7fd9ac0a12f0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fd9a4009e80 tx=0x7fd9a4004a40 comp rx=0 tx=0).stop 2024-04-04T06:56:41.583 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:41.584+0000 7fd9b4400640 1 -- 172.21.15.72:0/3989359988 shutdown_connections 2024-04-04T06:56:41.583 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:41.584+0000 7fd9b4400640 1 --2- 172.21.15.72:0/3989359988 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fd98c06c8f0 0x7fd98c06edb0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:41.583 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:41.584+0000 7fd9b4400640 1 --2- 172.21.15.72:0/3989359988 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd9ac15e690 0x7fd9ac0a12f0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:41.583 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:41.584+0000 7fd9b4400640 1 --2- 172.21.15.72:0/3989359988 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd9ac0d08b0 0x7fd9ac0a0db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:41.583 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:41.584+0000 7fd9b4400640 1 --2- 172.21.15.72:0/3989359988 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd9ac0cd4b0 0x7fd9ac0b1ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:41.583 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:41.584+0000 7fd9b4400640 1 -- 172.21.15.72:0/3989359988 >> 172.21.15.72:0/3989359988 conn(0x7fd9ac0cda20 msgr2=0x7fd9ac06b830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:56:41.583 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:41.584+0000 7fd9b4400640 1 -- 172.21.15.72:0/3989359988 shutdown_connections 2024-04-04T06:56:41.583 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:41.584+0000 7fd9b4400640 1 -- 172.21.15.72:0/3989359988 wait complete. 2024-04-04T06:56:41.605 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-04T06:56:41.806 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:41.807+0000 7f4977c00640 1 Processor -- start 2024-04-04T06:56:41.806 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:41.808+0000 7f4977c00640 1 -- start start 2024-04-04T06:56:41.808 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:41.809+0000 7f4977c00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f497015e6c0 0x7f49700b6390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:41.808 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:41.809+0000 7f4977c00640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f49700b68d0 0x7f49700d2410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:41.808 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:41.809+0000 7f4977c00640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f49700d3100 con 0x7f49700d2950 2024-04-04T06:56:41.808 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:41.809+0000 7f4977c00640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f497015eaa0 con 0x7f49700b68d0 2024-04-04T06:56:41.808 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:41.809+0000 7f4977c00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f49700d33e0 con 0x7f497015e6c0 2024-04-04T06:56:41.809 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:41.810+0000 7f496fe00640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f49700b68d0 0x7f49700d2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:41.809 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:41.810+0000 7f4975c00640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f49700d2950 0x7f49700d4280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:39598/0 (socket says 172.21.15.72:39598) 2024-04-04T06:56:41.809 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:41.810+0000 7f4975c00640 1 -- 172.21.15.72:0/1617389454 learned_addr learned my addr 172.21.15.72:0/1617389454 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-04-04T06:56:41.809 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:41.810+0000 7f4975200640 1 --2- 172.21.15.72:0/1617389454 >> v2:172.21.15.117:3300/0 conn(0x7f497015e6c0 0x7f49700b6390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:41.809 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:41.810+0000 7f496fe00640 1 -- 172.21.15.72:0/1617389454 >> v2:172.21.15.117:3300/0 conn(0x7f497015e6c0 msgr2=0x7f49700b6390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:56:41.809 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:41.810+0000 7f496fe00640 1 --2- 172.21.15.72:0/1617389454 >> v2:172.21.15.117:3300/0 conn(0x7f497015e6c0 0x7f49700b6390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:41.809 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:41.810+0000 7f496fe00640 1 -- 172.21.15.72:0/1617389454 >> v1:172.21.15.72:6789/0 conn(0x7f49700d2950 legacy=0x7f49700d4280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:41.810 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:41.810+0000 7f496fe00640 1 -- 172.21.15.72:0/1617389454 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49700d36c0 con 0x7f49700b68d0 2024-04-04T06:56:41.810 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:41.810+0000 7f496f400640 1 -- 172.21.15.72:0/1617389454 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2097098989 0 0) 0x7f49700d3100 con 0x7f49700d2950 2024-04-04T06:56:41.811 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:41.811+0000 7f496fe00640 1 --2- 172.21.15.72:0/1617389454 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f49700b68d0 0x7f49700d2410 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f49700d5320 tx=0x7f495c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6446a67e23a04986 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:41.811 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:41.811+0000 7f496f400640 1 -- 172.21.15.72:0/1617389454 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f495c035020 con 0x7f49700b68d0 2024-04-04T06:56:41.811 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:41.811+0000 7f496f400640 1 -- 172.21.15.72:0/1617389454 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f495c031830 con 0x7f49700b68d0 2024-04-04T06:56:41.811 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:41.811+0000 7f496f400640 1 -- 172.21.15.72:0/1617389454 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f495c031c00 con 0x7f49700b68d0 2024-04-04T06:56:41.811 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:41.812+0000 7f4977c00640 1 -- 172.21.15.72:0/1617389454 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f49700b68d0 msgr2=0x7f49700d2410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:41.811 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:41.812+0000 7f4977c00640 1 --2- 172.21.15.72:0/1617389454 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f49700b68d0 0x7f49700d2410 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f49700d5320 tx=0x7f495c02b8d0 comp rx=0 tx=0).stop 2024-04-04T06:56:41.811 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:41.812+0000 7f4977c00640 1 -- 172.21.15.72:0/1617389454 shutdown_connections 2024-04-04T06:56:41.811 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:41.812+0000 7f4977c00640 1 --2- 172.21.15.72:0/1617389454 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f49700b68d0 0x7f49700d2410 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:41.812 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:41.812+0000 7f4977c00640 1 --2- 172.21.15.72:0/1617389454 >> v2:172.21.15.117:3300/0 conn(0x7f497015e6c0 0x7f49700b6390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:41.812 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:41.812+0000 7f4977c00640 1 -- 172.21.15.72:0/1617389454 >> 172.21.15.72:0/1617389454 conn(0x7f4970071e80 msgr2=0x7f4970072290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:56:41.812 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:41.812+0000 7f4977c00640 1 -- 172.21.15.72:0/1617389454 shutdown_connections 2024-04-04T06:56:41.812 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:41.813+0000 7f4977c00640 1 -- 172.21.15.72:0/1617389454 wait complete. 2024-04-04T06:56:41.814 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:41.815+0000 7f4977c00640 1 Processor -- start 2024-04-04T06:56:41.814 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:41.815+0000 7f4977c00640 1 -- start start 2024-04-04T06:56:41.816 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:41.817+0000 7f4977c00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f49700b68d0 0x7f49701530b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:41.816 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:41.817+0000 7f4977c00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f49700d2950 0x7f4970153b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:41.816 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:41.817+0000 7f4977c00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f497015e6c0 0x7f49700c9f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:41.816 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:41.817+0000 7f4977c00640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f49700d2d80 con 0x7f497015e6c0 2024-04-04T06:56:41.817 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:41.817+0000 7f4977c00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f49700d3c80 con 0x7f49700d2950 2024-04-04T06:56:41.817 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:41.817+0000 7f4977c00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f49700b8530 con 0x7f49700b68d0 2024-04-04T06:56:41.817 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:41.817+0000 7f4975c00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f497015e6c0 0x7f49700c9f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:41.817 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:41.817+0000 7f4975c00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f497015e6c0 0x7f49700c9f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:34672/0 (socket says 172.21.15.72:34672) 2024-04-04T06:56:41.817 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:41.817+0000 7f4975c00640 1 -- 172.21.15.72:0/2609797403 learned_addr learned my addr 172.21.15.72:0/2609797403 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:56:41.817 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:41.817+0000 7f4975200640 1 --2- 172.21.15.72:0/2609797403 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f49700b68d0 0x7f49701530b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:41.817 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:41.818+0000 7f496fe00640 1 --2- 172.21.15.72:0/2609797403 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f49700d2950 0x7f4970153b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:41.817 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:41.818+0000 7f4975c00640 1 -- 172.21.15.72:0/2609797403 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f49700b68d0 msgr2=0x7f49701530b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:41.817 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:41.818+0000 7f4975c00640 1 --2- 172.21.15.72:0/2609797403 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f49700b68d0 0x7f49701530b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:41.817 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:41.818+0000 7f4975c00640 1 -- 172.21.15.72:0/2609797403 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f49700d2950 msgr2=0x7f4970153b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:41.817 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:41.818+0000 7f4975c00640 1 --2- 172.21.15.72:0/2609797403 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f49700d2950 0x7f4970153b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:41.817 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:41.818+0000 7f4975c00640 1 -- 172.21.15.72:0/2609797403 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49700ca440 con 0x7f497015e6c0 2024-04-04T06:56:41.817 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:41.818+0000 7f4975c00640 1 --2- 172.21.15.72:0/2609797403 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f497015e6c0 0x7f49700c9f00 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f496800c800 tx=0x7f496800ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:41.818 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:41.818+0000 7f496cc00640 1 -- 172.21.15.72:0/2609797403 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4968018070 con 0x7f497015e6c0 2024-04-04T06:56:41.818 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:41.818+0000 7f496cc00640 1 -- 172.21.15.72:0/2609797403 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4968004d80 con 0x7f497015e6c0 2024-04-04T06:56:41.818 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:41.818+0000 7f496cc00640 1 -- 172.21.15.72:0/2609797403 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f496800a880 con 0x7f497015e6c0 2024-04-04T06:56:41.819 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:41.818+0000 7f4977c00640 1 -- 172.21.15.72:0/2609797403 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49701571e0 con 0x7f497015e6c0 2024-04-04T06:56:41.819 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:41.818+0000 7f4977c00640 1 -- 172.21.15.72:0/2609797403 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49701577a0 con 0x7f497015e6c0 2024-04-04T06:56:41.819 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:41.820+0000 7f4977c00640 1 -- 172.21.15.72:0/2609797403 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4970075730 con 0x7f497015e6c0 2024-04-04T06:56:41.819 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:41.821+0000 7f496cc00640 1 -- 172.21.15.72:0/2609797403 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f496800aa20 con 0x7f497015e6c0 2024-04-04T06:56:41.820 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:41.821+0000 7f496cc00640 1 --2- 172.21.15.72:0/2609797403 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f495006c8f0 0x7f495006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:41.820 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:41.822+0000 7f496cc00640 1 -- 172.21.15.72:0/2609797403 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f496808b130 con 0x7f497015e6c0 2024-04-04T06:56:41.820 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:41.822+0000 7f4975200640 1 --2- 172.21.15.72:0/2609797403 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f495006c8f0 0x7f495006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:41.821 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:41.822+0000 7f4975200640 1 --2- 172.21.15.72:0/2609797403 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f495006c8f0 0x7f495006edb0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f4964006fd0 tx=0x7f4964008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:41.825 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:41.826+0000 7f496cc00640 1 -- 172.21.15.72:0/2609797403 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f49700ca440 con 0x7f497015e6c0 2024-04-04T06:56:42.041 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:42.043+0000 7f4977c00640 1 -- 172.21.15.72:0/2609797403 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f4970152e70 con 0x7f497015e6c0 2024-04-04T06:56:42.042 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:42.043+0000 7f496cc00640 1 -- 172.21.15.72:0/2609797403 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) ==== 100+0+11 (secure 0 0 0) 0x7f4968059610 con 0x7f497015e6c0 2024-04-04T06:56:42.042 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 64 2024-04-04T06:56:42.045 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:42.046+0000 7f4977c00640 1 -- 172.21.15.72:0/2609797403 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f495006c8f0 msgr2=0x7f495006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:42.045 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:42.046+0000 7f4977c00640 1 --2- 172.21.15.72:0/2609797403 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f495006c8f0 0x7f495006edb0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f4964006fd0 tx=0x7f4964008040 comp rx=0 tx=0).stop 2024-04-04T06:56:42.045 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:42.046+0000 7f4977c00640 1 -- 172.21.15.72:0/2609797403 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f497015e6c0 msgr2=0x7f49700c9f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:42.045 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:42.046+0000 7f4977c00640 1 --2- 172.21.15.72:0/2609797403 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f497015e6c0 0x7f49700c9f00 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f496800c800 tx=0x7f496800ccc0 comp rx=0 tx=0).stop 2024-04-04T06:56:42.045 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:42.046+0000 7f4977c00640 1 -- 172.21.15.72:0/2609797403 shutdown_connections 2024-04-04T06:56:42.045 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:42.046+0000 7f4977c00640 1 --2- 172.21.15.72:0/2609797403 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f495006c8f0 0x7f495006edb0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:42.045 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:42.046+0000 7f4977c00640 1 --2- 172.21.15.72:0/2609797403 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f497015e6c0 0x7f49700c9f00 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:42.045 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:42.046+0000 7f4977c00640 1 --2- 172.21.15.72:0/2609797403 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f49700d2950 0x7f4970153b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:42.045 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:42.046+0000 7f4977c00640 1 --2- 172.21.15.72:0/2609797403 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f49700b68d0 0x7f49701530b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:42.045 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:42.046+0000 7f4977c00640 1 -- 172.21.15.72:0/2609797403 >> 172.21.15.72:0/2609797403 conn(0x7f4970071e80 msgr2=0x7f497015d750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:56:42.046 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:42.046+0000 7f4977c00640 1 -- 172.21.15.72:0/2609797403 shutdown_connections 2024-04-04T06:56:42.046 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:42.046+0000 7f4977c00640 1 -- 172.21.15.72:0/2609797403 wait complete. 2024-04-04T06:56:42.063 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-04T06:56:42.266 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:42.267+0000 7f6d4b000640 1 Processor -- start 2024-04-04T06:56:42.266 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:42.268+0000 7f6d4b000640 1 -- start start 2024-04-04T06:56:42.268 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:42.269+0000 7f6d4b000640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f6d4415e5a0 0x7f6d440b75c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:42.268 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:42.269+0000 7f6d4b000640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f6d440b7b00 0x7f6d440d2e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:42.268 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:42.269+0000 7f6d4b000640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6d440d3820 con 0x7f6d440d3370 2024-04-04T06:56:42.268 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:42.269+0000 7f6d4b000640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f6d440cf7f0 con 0x7f6d4415e5a0 2024-04-04T06:56:42.268 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:42.269+0000 7f6d4b000640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f6d440cfad0 con 0x7f6d440b7b00 2024-04-04T06:56:42.268 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:42.269+0000 7f6d49c00640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f6d4415e5a0 0x7f6d440b75c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:42.268 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:42.269+0000 7f6d49c00640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f6d4415e5a0 0x7f6d440b75c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:34674/0 (socket says 172.21.15.72:34674) 2024-04-04T06:56:42.268 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:42.269+0000 7f6d49c00640 1 -- 172.21.15.72:0/2424769865 learned_addr learned my addr 172.21.15.72:0/2424769865 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:56:42.269 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:42.270+0000 7f6d49200640 1 --2- 172.21.15.72:0/2424769865 >> v2:172.21.15.117:3300/0 conn(0x7f6d440b7b00 0x7f6d440d2e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:42.269 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:42.270+0000 7f6d49c00640 1 -- 172.21.15.72:0/2424769865 >> v2:172.21.15.117:3300/0 conn(0x7f6d440b7b00 msgr2=0x7f6d440d2e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:56:42.269 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:42.270+0000 7f6d49c00640 1 --2- 172.21.15.72:0/2424769865 >> v2:172.21.15.117:3300/0 conn(0x7f6d440b7b00 0x7f6d440d2e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:42.269 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:42.270+0000 7f6d49c00640 1 -- 172.21.15.72:0/2424769865 >> v1:172.21.15.117:6789/0 conn(0x7f6d440d3370 legacy=0x7f6d440d08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:56:42.269 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:42.270+0000 7f6d49c00640 1 -- 172.21.15.72:0/2424769865 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d440d2350 con 0x7f6d4415e5a0 2024-04-04T06:56:42.270 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:42.271+0000 7f6d49c00640 1 --2- 172.21.15.72:0/2424769865 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6d4415e5a0 0x7f6d440b75c0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f6d44072be0 tx=0x7f6d3802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b60506a6afde292c server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:42.270 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:42.271+0000 7f6d43e00640 1 -- 172.21.15.72:0/2424769865 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d38035020 con 0x7f6d4415e5a0 2024-04-04T06:56:42.270 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:42.271+0000 7f6d43e00640 1 -- 172.21.15.72:0/2424769865 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d38031870 con 0x7f6d4415e5a0 2024-04-04T06:56:42.271 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:42.271+0000 7f6d43e00640 1 -- 172.21.15.72:0/2424769865 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d38031c40 con 0x7f6d4415e5a0 2024-04-04T06:56:42.271 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:42.272+0000 7f6d4b000640 1 -- 172.21.15.72:0/2424769865 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6d4415e5a0 msgr2=0x7f6d440b75c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:42.271 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:42.272+0000 7f6d4b000640 1 --2- 172.21.15.72:0/2424769865 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6d4415e5a0 0x7f6d440b75c0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f6d44072be0 tx=0x7f6d3802b910 comp rx=0 tx=0).stop 2024-04-04T06:56:42.271 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:42.272+0000 7f6d4b000640 1 -- 172.21.15.72:0/2424769865 shutdown_connections 2024-04-04T06:56:42.271 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:42.272+0000 7f6d4b000640 1 --2- 172.21.15.72:0/2424769865 >> v2:172.21.15.117:3300/0 conn(0x7f6d440b7b00 0x7f6d440d2e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:42.272 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:42.272+0000 7f6d4b000640 1 --2- 172.21.15.72:0/2424769865 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6d4415e5a0 0x7f6d440b75c0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:42.272 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:42.272+0000 7f6d4b000640 1 -- 172.21.15.72:0/2424769865 >> 172.21.15.72:0/2424769865 conn(0x7f6d4406b890 msgr2=0x7f6d4406bca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:56:42.272 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:42.272+0000 7f6d4b000640 1 -- 172.21.15.72:0/2424769865 shutdown_connections 2024-04-04T06:56:42.272 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:42.273+0000 7f6d4b000640 1 -- 172.21.15.72:0/2424769865 wait complete. 2024-04-04T06:56:42.273 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:42.275+0000 7f6d4b000640 1 Processor -- start 2024-04-04T06:56:42.274 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:42.275+0000 7f6d4b000640 1 -- start start 2024-04-04T06:56:42.277 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:42.277+0000 7f6d4b000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6d440b7b00 0x7f6d441f47a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:42.277 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:42.277+0000 7f6d4b000640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6d440d3370 0x7f6d441f4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:42.277 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:42.277+0000 7f6d4b000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6d4415e5a0 0x7f6d44155310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:42.277 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:42.277+0000 7f6d4b000640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f6d4415e980 con 0x7f6d440d3370 2024-04-04T06:56:42.277 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:42.277+0000 7f6d4b000640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f6d440d2910 con 0x7f6d440b7b00 2024-04-04T06:56:42.277 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:42.277+0000 7f6d4b000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f6d440d0ff0 con 0x7f6d4415e5a0 2024-04-04T06:56:42.277 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:42.277+0000 7f6d49200640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6d440d3370 0x7f6d441f4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:42.277 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:42.277+0000 7f6d49200640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6d440d3370 0x7f6d441f4ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:34684/0 (socket says 172.21.15.72:34684) 2024-04-04T06:56:42.277 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:42.277+0000 7f6d49200640 1 -- 172.21.15.72:0/3346853894 learned_addr learned my addr 172.21.15.72:0/3346853894 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:56:42.278 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:42.277+0000 7f6d49c00640 1 --2- 172.21.15.72:0/3346853894 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6d440b7b00 0x7f6d441f47a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:42.278 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:42.278+0000 7f6d4a600640 1 --2- 172.21.15.72:0/3346853894 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6d4415e5a0 0x7f6d44155310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:42.278 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:42.278+0000 7f6d49200640 1 -- 172.21.15.72:0/3346853894 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6d4415e5a0 msgr2=0x7f6d44155310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:42.278 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:42.278+0000 7f6d49200640 1 --2- 172.21.15.72:0/3346853894 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6d4415e5a0 0x7f6d44155310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:42.278 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:42.278+0000 7f6d49200640 1 -- 172.21.15.72:0/3346853894 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6d440b7b00 msgr2=0x7f6d441f47a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:42.278 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:42.278+0000 7f6d49200640 1 --2- 172.21.15.72:0/3346853894 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6d440b7b00 0x7f6d441f47a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:42.278 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:42.278+0000 7f6d49200640 1 -- 172.21.15.72:0/3346853894 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d440cd1c0 con 0x7f6d440d3370 2024-04-04T06:56:42.278 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:42.278+0000 7f6d4a600640 1 --2- 172.21.15.72:0/3346853894 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6d4415e5a0 0x7f6d44155310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-04T06:56:42.278 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:42.278+0000 7f6d49200640 1 --2- 172.21.15.72:0/3346853894 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6d440d3370 0x7f6d441f4ce0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f6d3000d7d0 tx=0x7f6d3000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:42.278 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:42.278+0000 7f6d41600640 1 -- 172.21.15.72:0/3346853894 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d3000b6c0 con 0x7f6d440d3370 2024-04-04T06:56:42.278 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:42.278+0000 7f6d41600640 1 -- 172.21.15.72:0/3346853894 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d30019070 con 0x7f6d440d3370 2024-04-04T06:56:42.278 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:42.278+0000 7f6d4b000640 1 -- 172.21.15.72:0/3346853894 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d440cd460 con 0x7f6d440d3370 2024-04-04T06:56:42.278 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:42.278+0000 7f6d41600640 1 -- 172.21.15.72:0/3346853894 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d3000bac0 con 0x7f6d440d3370 2024-04-04T06:56:42.279 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:42.278+0000 7f6d4b000640 1 -- 172.21.15.72:0/3346853894 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d44156060 con 0x7f6d440d3370 2024-04-04T06:56:42.279 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:42.280+0000 7f6d4b000640 1 -- 172.21.15.72:0/3346853894 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d440756c0 con 0x7f6d440d3370 2024-04-04T06:56:42.279 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:42.280+0000 7f6d41600640 1 -- 172.21.15.72:0/3346853894 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6d3000bc60 con 0x7f6d440d3370 2024-04-04T06:56:42.280 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:42.281+0000 7f6d41600640 1 --2- 172.21.15.72:0/3346853894 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f6d2406c8f0 0x7f6d2406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:42.280 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:42.281+0000 7f6d41600640 1 -- 172.21.15.72:0/3346853894 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f6d3008bf60 con 0x7f6d440d3370 2024-04-04T06:56:42.280 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:42.281+0000 7f6d49c00640 1 --2- 172.21.15.72:0/3346853894 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f6d2406c8f0 0x7f6d2406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:42.280 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:42.282+0000 7f6d49c00640 1 --2- 172.21.15.72:0/3346853894 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f6d2406c8f0 0x7f6d2406edb0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f6d38036000 tx=0x7f6d3803c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:42.284 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:42.286+0000 7f6d41600640 1 -- 172.21.15.72:0/3346853894 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f6d3005a420 con 0x7f6d440d3370 2024-04-04T06:56:42.522 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:42.523+0000 7f6d4b000640 1 -- 172.21.15.72:0/3346853894 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6d440d2090 con 0x7f6d440d3370 2024-04-04T06:56:42.523 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:42.524+0000 7f6d41600640 1 -- 172.21.15.72:0/3346853894 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5181 (secure 0 0 0) 0x7f6d30059d20 con 0x7f6d440d3370 2024-04-04T06:56:42.523 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T06:56:42.523 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6834/3570831137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":3570831137},{"type":"v1","addr":"172.21.15.117:6834","nonce":3570831137}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4238,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/1683311500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6833","nonce":1683311500},{"type":"v1","addr":"172.21.15.117:6835","nonce":1683311500}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6835/4150347227","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":4150347227},{"type":"v1","addr":"172.21.15.72:6835","nonce":4150347227}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-04T06:56:28.435113+0000","modified":"2024-04-04T06:56:31.557618+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4263},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4263":{"gid":4263,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.72:6837/2958027127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6836","nonce":2958027127},{"type":"v1","addr":"172.21.15.72:6837","nonce":2958027127}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4263,"qdb_cluster":[4263]},"id":1}]} 2024-04-04T06:56:42.523 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 8 2024-04-04T06:56:42.526 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:42.527+0000 7f6d4b000640 1 -- 172.21.15.72:0/3346853894 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f6d2406c8f0 msgr2=0x7f6d2406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:42.526 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:42.527+0000 7f6d4b000640 1 --2- 172.21.15.72:0/3346853894 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f6d2406c8f0 0x7f6d2406edb0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f6d38036000 tx=0x7f6d3803c040 comp rx=0 tx=0).stop 2024-04-04T06:56:42.526 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:42.527+0000 7f6d4b000640 1 -- 172.21.15.72:0/3346853894 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6d440d3370 msgr2=0x7f6d441f4ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:42.526 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:42.527+0000 7f6d4b000640 1 --2- 172.21.15.72:0/3346853894 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6d440d3370 0x7f6d441f4ce0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f6d3000d7d0 tx=0x7f6d3000dc90 comp rx=0 tx=0).stop 2024-04-04T06:56:42.526 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:42.527+0000 7f6d4b000640 1 -- 172.21.15.72:0/3346853894 shutdown_connections 2024-04-04T06:56:42.526 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:42.527+0000 7f6d4b000640 1 --2- 172.21.15.72:0/3346853894 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f6d2406c8f0 0x7f6d2406edb0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:42.526 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:42.527+0000 7f6d4b000640 1 --2- 172.21.15.72:0/3346853894 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6d4415e5a0 0x7f6d44155310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:42.526 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:42.527+0000 7f6d4b000640 1 --2- 172.21.15.72:0/3346853894 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6d440d3370 0x7f6d441f4ce0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:42.526 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:42.527+0000 7f6d4b000640 1 --2- 172.21.15.72:0/3346853894 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6d440b7b00 0x7f6d441f47a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:42.526 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:42.527+0000 7f6d4b000640 1 -- 172.21.15.72:0/3346853894 >> 172.21.15.72:0/3346853894 conn(0x7f6d4406b890 msgr2=0x7f6d440b5600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:56:42.527 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:42.527+0000 7f6d4b000640 1 -- 172.21.15.72:0/3346853894 shutdown_connections 2024-04-04T06:56:42.527 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:42.527+0000 7f6d4b000640 1 -- 172.21.15.72:0/3346853894 wait complete. 2024-04-04T06:56:42.543 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-04T06:56:42.741 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:42.743+0000 7f1a55000640 1 Processor -- start 2024-04-04T06:56:42.742 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:42.743+0000 7f1a55000640 1 -- start start 2024-04-04T06:56:42.743 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:42.744+0000 7f1a55000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1a500d07d0 0x7f1a500c4ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:42.743 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:42.744+0000 7f1a55000640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a500c5c00 con 0x7f1a5015b230 2024-04-04T06:56:42.743 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:42.744+0000 7f1a55000640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a5015b980 con 0x7f1a500c5530 2024-04-04T06:56:42.743 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:42.744+0000 7f1a55000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f1a500c59e0 con 0x7f1a500d07d0 2024-04-04T06:56:42.743 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:42.745+0000 7f1a4de00640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f1a5015b230 0x7f1a500d00c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:39606/0 (socket says 172.21.15.72:39606) 2024-04-04T06:56:42.743 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:42.745+0000 7f1a4de00640 1 -- 172.21.15.72:0/1889273261 learned_addr learned my addr 172.21.15.72:0/1889273261 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-04-04T06:56:42.745 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:42.745+0000 7f1a47e00640 1 --2- 172.21.15.72:0/1889273261 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1a500d07d0 0x7f1a500c4ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:42.746 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:42.745+0000 7f1a4d400640 1 -- 172.21.15.72:0/1889273261 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1772232890 0 0) 0x7f1a500c5c00 con 0x7f1a5015b230 2024-04-04T06:56:42.746 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:42.745+0000 7f1a4d400640 1 -- 172.21.15.72:0/1889273261 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1a34003520 con 0x7f1a5015b230 2024-04-04T06:56:42.746 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:42.745+0000 7f1a4d400640 1 -- 172.21.15.72:0/1889273261 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 828033248 0 0) 0x7f1a34003520 con 0x7f1a5015b230 2024-04-04T06:56:42.746 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:42.745+0000 7f1a4d400640 1 -- 172.21.15.72:0/1889273261 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1a500d07d0 msgr2=0x7f1a500c4ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:56:42.746 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:42.745+0000 7f1a4d400640 1 --2- 172.21.15.72:0/1889273261 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1a500d07d0 0x7f1a500c4ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:42.746 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:42.745+0000 7f1a4d400640 1 -- 172.21.15.72:0/1889273261 >> v1:172.21.15.117:6789/0 conn(0x7f1a500c5530 legacy=0x7f1a500b3540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:42.746 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:42.745+0000 7f1a4d400640 1 -- 172.21.15.72:0/1889273261 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a5015bc60 con 0x7f1a5015b230 2024-04-04T06:56:42.746 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:42.745+0000 7f1a4d400640 1 -- 172.21.15.72:0/1889273261 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2465650867 0 0) 0x7f1a40001670 con 0x7f1a5015b230 2024-04-04T06:56:42.746 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:42.746+0000 7f1a4d400640 1 -- 172.21.15.72:0/1889273261 >> v1:172.21.15.72:6789/0 conn(0x7f1a5015b230 legacy=0x7f1a500d00c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:42.746 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:42.746+0000 7f1a4d400640 1 --2- 172.21.15.72:0/1889273261 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1a500d07d0 0x7f1a340039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:42.746 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:42.746+0000 7f1a4d400640 1 --2- 172.21.15.72:0/1889273261 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1a34003f60 0x7f1a34004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:42.746 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:42.746+0000 7f1a4d400640 1 --2- 172.21.15.72:0/1889273261 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1a34004d40 0x7f1a340051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:42.747 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:42.746+0000 7f1a4d400640 1 -- 172.21.15.72:0/1889273261 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f1a500c59e0 con 0x7f1a34004d40 2024-04-04T06:56:42.747 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:42.746+0000 7f1a4d400640 1 -- 172.21.15.72:0/1889273261 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f1a3400dcb0 con 0x7f1a34003f60 2024-04-04T06:56:42.747 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:42.746+0000 7f1a4d400640 1 -- 172.21.15.72:0/1889273261 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f1a3400deb0 con 0x7f1a500d07d0 2024-04-04T06:56:42.747 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:42.746+0000 7f1a4e800640 1 --2- 172.21.15.72:0/1889273261 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1a34004d40 0x7f1a340051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:42.747 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:42.746+0000 7f1a47e00640 1 --2- 172.21.15.72:0/1889273261 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1a34003f60 0x7f1a34004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:42.747 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:42.746+0000 7f1a4de00640 1 --2- 172.21.15.72:0/1889273261 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1a500d07d0 0x7f1a340039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:42.747 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:42.746+0000 7f1a4e800640 1 -- 172.21.15.72:0/1889273261 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1a500d07d0 msgr2=0x7f1a340039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:56:42.747 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:42.746+0000 7f1a4e800640 1 --2- 172.21.15.72:0/1889273261 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1a500d07d0 0x7f1a340039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:42.747 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:42.746+0000 7f1a4e800640 1 -- 172.21.15.72:0/1889273261 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1a34003f60 msgr2=0x7f1a34004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:56:42.747 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:42.746+0000 7f1a4e800640 1 --2- 172.21.15.72:0/1889273261 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1a34003f60 0x7f1a34004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:42.747 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:42.746+0000 7f1a4e800640 1 -- 172.21.15.72:0/1889273261 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a34003520 con 0x7f1a34004d40 2024-04-04T06:56:42.747 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:42.746+0000 7f1a47e00640 1 --2- 172.21.15.72:0/1889273261 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1a34003f60 0x7f1a34004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-04T06:56:42.748 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:42.748+0000 7f1a4e800640 1 --2- 172.21.15.72:0/1889273261 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1a34004d40 0x7f1a340051c0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f1a48001e50 tx=0x7f1a34005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af946906b2a770ab server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:42.748 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:42.748+0000 7f1a4d400640 1 -- 172.21.15.72:0/1889273261 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a48001a70 con 0x7f1a34004d40 2024-04-04T06:56:42.749 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:42.748+0000 7f1a4d400640 1 -- 172.21.15.72:0/1889273261 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a48003b70 con 0x7f1a34004d40 2024-04-04T06:56:42.749 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:42.748+0000 7f1a4d400640 1 -- 172.21.15.72:0/1889273261 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a480050d0 con 0x7f1a34004d40 2024-04-04T06:56:42.749 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:42.749+0000 7f1a55000640 1 -- 172.21.15.72:0/1889273261 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1a34004d40 msgr2=0x7f1a340051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:42.749 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:42.749+0000 7f1a55000640 1 --2- 172.21.15.72:0/1889273261 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1a34004d40 0x7f1a340051c0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f1a48001e50 tx=0x7f1a34005830 comp rx=0 tx=0).stop 2024-04-04T06:56:42.749 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:42.749+0000 7f1a4e800640 1 -- 172.21.15.72:0/1889273261 reap_dead start 2024-04-04T06:56:42.749 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:42.749+0000 7f1a55000640 1 -- 172.21.15.72:0/1889273261 shutdown_connections 2024-04-04T06:56:42.749 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:42.749+0000 7f1a55000640 1 -- 172.21.15.72:0/1889273261 >> 172.21.15.72:0/1889273261 conn(0x7f1a5006b470 msgr2=0x7f1a5006b880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:56:42.749 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:42.749+0000 7f1a55000640 1 -- 172.21.15.72:0/1889273261 shutdown_connections 2024-04-04T06:56:42.749 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:42.749+0000 7f1a55000640 1 -- 172.21.15.72:0/1889273261 wait complete. 2024-04-04T06:56:42.750 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:42.751+0000 7f1a55000640 1 Processor -- start 2024-04-04T06:56:42.750 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:42.751+0000 7f1a55000640 1 -- start start 2024-04-04T06:56:42.751 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:42.752+0000 7f1a55000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1a34004d40 0x7f1a5014d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:42.751 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:42.752+0000 7f1a55000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1a50158e40 0x7f1a5014e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:42.751 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:42.752+0000 7f1a55000640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1a5015d650 0x7f1a5015dad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:42.752 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:42.752+0000 7f1a55000640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f1a500cf040 con 0x7f1a5015d650 2024-04-04T06:56:42.752 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:42.752+0000 7f1a55000640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f1a5015c2b0 con 0x7f1a34004d40 2024-04-04T06:56:42.752 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:42.752+0000 7f1a55000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f1a5015b610 con 0x7f1a50158e40 2024-04-04T06:56:42.752 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:42.752+0000 7f1a4e800640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1a5015d650 0x7f1a5015dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:42.752 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:42.752+0000 7f1a4e800640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1a5015d650 0x7f1a5015dad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:34694/0 (socket says 172.21.15.72:34694) 2024-04-04T06:56:42.752 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:42.752+0000 7f1a4e800640 1 -- 172.21.15.72:0/1248021858 learned_addr learned my addr 172.21.15.72:0/1248021858 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:56:42.752 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:42.752+0000 7f1a4de00640 1 --2- 172.21.15.72:0/1248021858 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1a34004d40 0x7f1a5014d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:42.752 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:42.753+0000 7f1a47e00640 1 --2- 172.21.15.72:0/1248021858 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1a50158e40 0x7f1a5014e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:42.752 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:42.753+0000 7f1a4e800640 1 -- 172.21.15.72:0/1248021858 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1a50158e40 msgr2=0x7f1a5014e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:42.752 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:42.753+0000 7f1a4e800640 1 --2- 172.21.15.72:0/1248021858 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1a50158e40 0x7f1a5014e080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:42.752 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:42.753+0000 7f1a4e800640 1 -- 172.21.15.72:0/1248021858 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1a34004d40 msgr2=0x7f1a5014d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:42.752 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:42.753+0000 7f1a4e800640 1 --2- 172.21.15.72:0/1248021858 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1a34004d40 0x7f1a5014d7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:42.752 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:42.753+0000 7f1a4e800640 1 -- 172.21.15.72:0/1248021858 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a50159970 con 0x7f1a5015d650 2024-04-04T06:56:42.752 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:42.753+0000 7f1a4de00640 1 --2- 172.21.15.72:0/1248021858 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1a34004d40 0x7f1a5014d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-04T06:56:42.752 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:42.753+0000 7f1a4e800640 1 --2- 172.21.15.72:0/1248021858 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1a5015d650 0x7f1a5015dad0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f1a48001e50 tx=0x7f1a480014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:42.753 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:42.753+0000 7f1a46000640 1 -- 172.21.15.72:0/1248021858 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a48001a70 con 0x7f1a5015d650 2024-04-04T06:56:42.753 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:42.753+0000 7f1a46000640 1 -- 172.21.15.72:0/1248021858 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a48003d20 con 0x7f1a5015d650 2024-04-04T06:56:42.753 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:42.753+0000 7f1a46000640 1 -- 172.21.15.72:0/1248021858 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a48007db0 con 0x7f1a5015d650 2024-04-04T06:56:42.753 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:42.753+0000 7f1a55000640 1 -- 172.21.15.72:0/1248021858 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a50159c50 con 0x7f1a5015d650 2024-04-04T06:56:42.754 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:42.754+0000 7f1a55000640 1 -- 172.21.15.72:0/1248021858 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a5015a210 con 0x7f1a5015d650 2024-04-04T06:56:42.754 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:42.755+0000 7f1a55000640 1 -- 172.21.15.72:0/1248021858 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a5015e010 con 0x7f1a5015d650 2024-04-04T06:56:42.755 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:42.757+0000 7f1a46000640 1 -- 172.21.15.72:0/1248021858 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1a4802f670 con 0x7f1a5015d650 2024-04-04T06:56:42.756 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:42.757+0000 7f1a46000640 1 --2- 172.21.15.72:0/1248021858 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f1a2c06c8f0 0x7f1a2c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:42.756 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:42.758+0000 7f1a46000640 1 -- 172.21.15.72:0/1248021858 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f1a480acfb0 con 0x7f1a5015d650 2024-04-04T06:56:42.756 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:42.758+0000 7f1a4de00640 1 --2- 172.21.15.72:0/1248021858 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f1a2c06c8f0 0x7f1a2c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:42.757 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:42.758+0000 7f1a4de00640 1 --2- 172.21.15.72:0/1248021858 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f1a2c06c8f0 0x7f1a2c06edb0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f1a40001050 tx=0x7f1a40009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:42.760 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:42.762+0000 7f1a46000640 1 -- 172.21.15.72:0/1248021858 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f1a4804a030 con 0x7f1a5015d650 2024-04-04T06:56:42.961 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:42.963+0000 7f1a55000640 1 -- 172.21.15.72:0/1248021858 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1a50075840 con 0x7f1a5015d650 2024-04-04T06:56:42.963 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:42.965+0000 7f1a46000640 1 -- 172.21.15.72:0/1248021858 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16581 (secure 0 0 0) 0x7f1a48033020 con 0x7f1a5015d650 2024-04-04T06:56:42.964 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T06:56:42.964 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":20,"fsid":"6708bac2-4f50-49b5-87a9-c390fd333eb3","created":"2024-04-04T06:56:04.282498+0000","modified":"2024-04-04T06:56:30.007371+0000","last_up_change":"2024-04-04T06:56:16.716089+0000","last_in_change":"2024-04-04T06:56:07.768593+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-04T06:56:17.421685+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-04T06:56:26.822661+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-04T06:56:27.429816+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7c345991-5af8-4dc6-a481-28610c40e128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":3889813953},{"type":"v1","addr":"172.21.15.72:6818","nonce":3889813953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":3889813953},{"type":"v1","addr":"172.21.15.72:6821","nonce":3889813953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":3889813953},{"type":"v1","addr":"172.21.15.72:6826","nonce":3889813953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":3889813953},{"type":"v1","addr":"172.21.15.72:6823","nonce":3889813953}]},"public_addr":"172.21.15.72:6818/3889813953","cluster_addr":"172.21.15.72:6821/3889813953","heartbeat_back_addr":"172.21.15.72:6826/3889813953","heartbeat_front_addr":"172.21.15.72:6823/3889813953","state":["exists","up"]},{"osd":1,"uuid":"1b3f7ab2-a56c-488d-a89a-1f3572361c95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":3101663154},{"type":"v1","addr":"172.21.15.72:6801","nonce":3101663154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":3101663154},{"type":"v1","addr":"172.21.15.72:6803","nonce":3101663154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":3101663154},{"type":"v1","addr":"172.21.15.72:6807","nonce":3101663154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":3101663154},{"type":"v1","addr":"172.21.15.72:6805","nonce":3101663154}]},"public_addr":"172.21.15.72:6801/3101663154","cluster_addr":"172.21.15.72:6803/3101663154","heartbeat_back_addr":"172.21.15.72:6807/3101663154","heartbeat_front_addr":"172.21.15.72:6805/3101663154","state":["exists","up"]},{"osd":2,"uuid":"fc9aa512-53df-40d7-ba04-3e6b7dcd1e34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":235374192},{"type":"v1","addr":"172.21.15.72:6809","nonce":235374192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":235374192},{"type":"v1","addr":"172.21.15.72:6811","nonce":235374192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":235374192},{"type":"v1","addr":"172.21.15.72:6815","nonce":235374192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":235374192},{"type":"v1","addr":"172.21.15.72:6813","nonce":235374192}]},"public_addr":"172.21.15.72:6809/235374192","cluster_addr":"172.21.15.72:6811/235374192","heartbeat_back_addr":"172.21.15.72:6815/235374192","heartbeat_front_addr":"172.21.15.72:6813/235374192","state":["exists","up"]},{"osd":3,"uuid":"b4f63eed-dc5b-4aba-bb50-de46eb41492b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6817","nonce":2806631742},{"type":"v1","addr":"172.21.15.72:6819","nonce":2806631742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":2806631742},{"type":"v1","addr":"172.21.15.72:6827","nonce":2806631742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":2806631742},{"type":"v1","addr":"172.21.15.72:6831","nonce":2806631742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":2806631742},{"type":"v1","addr":"172.21.15.72:6829","nonce":2806631742}]},"public_addr":"172.21.15.72:6819/2806631742","cluster_addr":"172.21.15.72:6827/2806631742","heartbeat_back_addr":"172.21.15.72:6831/2806631742","heartbeat_front_addr":"172.21.15.72:6829/2806631742","state":["exists","up"]},{"osd":4,"uuid":"9e985ef8-d711-4172-9286-c54e560895d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":4293536423},{"type":"v1","addr":"172.21.15.117:6825","nonce":4293536423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":4293536423},{"type":"v1","addr":"172.21.15.117:6827","nonce":4293536423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":4293536423},{"type":"v1","addr":"172.21.15.117:6831","nonce":4293536423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":4293536423},{"type":"v1","addr":"172.21.15.117:6829","nonce":4293536423}]},"public_addr":"172.21.15.117:6825/4293536423","cluster_addr":"172.21.15.117:6827/4293536423","heartbeat_back_addr":"172.21.15.117:6831/4293536423","heartbeat_front_addr":"172.21.15.117:6829/4293536423","state":["exists","up"]},{"osd":5,"uuid":"3e9f082b-8d7d-455f-8a96-66d0b4857125","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":684971679},{"type":"v1","addr":"172.21.15.117:6801","nonce":684971679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":684971679},{"type":"v1","addr":"172.21.15.117:6803","nonce":684971679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":684971679},{"type":"v1","addr":"172.21.15.117:6807","nonce":684971679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":684971679},{"type":"v1","addr":"172.21.15.117:6805","nonce":684971679}]},"public_addr":"172.21.15.117:6801/684971679","cluster_addr":"172.21.15.117:6803/684971679","heartbeat_back_addr":"172.21.15.117:6807/684971679","heartbeat_front_addr":"172.21.15.117:6805/684971679","state":["exists","up"]},{"osd":6,"uuid":"bcdafa9f-a870-4398-a38d-ab7697676473","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":2781186528},{"type":"v1","addr":"172.21.15.117:6809","nonce":2781186528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":2781186528},{"type":"v1","addr":"172.21.15.117:6811","nonce":2781186528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":2781186528},{"type":"v1","addr":"172.21.15.117:6815","nonce":2781186528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":2781186528},{"type":"v1","addr":"172.21.15.117:6813","nonce":2781186528}]},"public_addr":"172.21.15.117:6809/2781186528","cluster_addr":"172.21.15.117:6811/2781186528","heartbeat_back_addr":"172.21.15.117:6815/2781186528","heartbeat_front_addr":"172.21.15.117:6813/2781186528","state":["exists","up"]},{"osd":7,"uuid":"b68ec562-ff35-4d2d-a733-c896f8920cfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":617469882},{"type":"v1","addr":"172.21.15.117:6817","nonce":617469882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":617469882},{"type":"v1","addr":"172.21.15.117:6819","nonce":617469882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":617469882},{"type":"v1","addr":"172.21.15.117:6823","nonce":617469882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":617469882},{"type":"v1","addr":"172.21.15.117:6821","nonce":617469882}]},"public_addr":"172.21.15.117:6817/617469882","cluster_addr":"172.21.15.117:6819/617469882","heartbeat_back_addr":"172.21.15.117:6823/617469882","heartbeat_front_addr":"172.21.15.117:6821/617469882","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.347700+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.296619+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.361345+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.093323+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:12.857605+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:12.816090+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.083163+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.121639+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-04T06:56:42.966 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:42.967+0000 7f1a55000640 1 -- 172.21.15.72:0/1248021858 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f1a2c06c8f0 msgr2=0x7f1a2c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:42.966 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:42.967+0000 7f1a55000640 1 --2- 172.21.15.72:0/1248021858 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f1a2c06c8f0 0x7f1a2c06edb0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f1a40001050 tx=0x7f1a40009040 comp rx=0 tx=0).stop 2024-04-04T06:56:42.967 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:42.967+0000 7f1a55000640 1 -- 172.21.15.72:0/1248021858 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1a5015d650 msgr2=0x7f1a5015dad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:42.967 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:42.967+0000 7f1a55000640 1 --2- 172.21.15.72:0/1248021858 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1a5015d650 0x7f1a5015dad0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f1a48001e50 tx=0x7f1a480014a0 comp rx=0 tx=0).stop 2024-04-04T06:56:42.967 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:42.968+0000 7f1a55000640 1 -- 172.21.15.72:0/1248021858 shutdown_connections 2024-04-04T06:56:42.967 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:42.968+0000 7f1a55000640 1 --2- 172.21.15.72:0/1248021858 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f1a2c06c8f0 0x7f1a2c06edb0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:42.967 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:42.968+0000 7f1a55000640 1 --2- 172.21.15.72:0/1248021858 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1a5015d650 0x7f1a5015dad0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:42.967 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:42.968+0000 7f1a55000640 1 --2- 172.21.15.72:0/1248021858 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1a50158e40 0x7f1a5014e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:42.967 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:42.968+0000 7f1a55000640 1 --2- 172.21.15.72:0/1248021858 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1a34004d40 0x7f1a5014d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:42.967 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:42.968+0000 7f1a55000640 1 -- 172.21.15.72:0/1248021858 >> 172.21.15.72:0/1248021858 conn(0x7f1a5006b470 msgr2=0x7f1a5006b880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:56:42.967 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:42.968+0000 7f1a55000640 1 -- 172.21.15.72:0/1248021858 shutdown_connections 2024-04-04T06:56:42.967 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:42.968+0000 7f1a55000640 1 -- 172.21.15.72:0/1248021858 wait complete. 2024-04-04T06:56:42.983 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-04T06:56:17.421685+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-04T06:56:26.822661+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-04T06:56:27.429816+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-04T06:56:42.984 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-04T06:56:43.178 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:43.179+0000 7fc45ee00640 1 Processor -- start 2024-04-04T06:56:43.178 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:43.180+0000 7fc45ee00640 1 -- start start 2024-04-04T06:56:43.180 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:43.181+0000 7fc45ee00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fc4580cc430 0x7fc458070010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:43.180 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:43.182+0000 7fc45ee00640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc4580cb2c0 con 0x7fc4580cf350 2024-04-04T06:56:43.180 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:43.182+0000 7fc45ee00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc4580cb5a0 con 0x7fc4580cadc0 2024-04-04T06:56:43.180 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:43.182+0000 7fc45ee00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fc4580cbed0 con 0x7fc4580cc430 2024-04-04T06:56:43.180 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:43.182+0000 7fc45ce00640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fc4580cf350 0x7fc458164d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:39608/0 (socket says 172.21.15.72:39608) 2024-04-04T06:56:43.180 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:43.182+0000 7fc45ce00640 1 -- 172.21.15.72:0/2879146511 learned_addr learned my addr 172.21.15.72:0/2879146511 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-04-04T06:56:43.182 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:43.182+0000 7fc457400640 1 -- 172.21.15.72:0/2879146511 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3413168073 0 0) 0x7fc4580cb2c0 con 0x7fc4580cf350 2024-04-04T06:56:43.182 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:43.182+0000 7fc457400640 1 -- 172.21.15.72:0/2879146511 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc43c003520 con 0x7fc4580cf350 2024-04-04T06:56:43.182 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:43.182+0000 7fc457e00640 1 --2- 172.21.15.72:0/2879146511 >> v2:172.21.15.117:3300/0 conn(0x7fc4580cc430 0x7fc458070010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:43.182 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:43.182+0000 7fc457400640 1 -- 172.21.15.72:0/2879146511 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1676038291 0 0) 0x7fc43c003520 con 0x7fc4580cf350 2024-04-04T06:56:43.182 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:43.182+0000 7fc457400640 1 -- 172.21.15.72:0/2879146511 >> v2:172.21.15.117:3300/0 conn(0x7fc4580cc430 msgr2=0x7fc458070010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:56:43.182 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:43.182+0000 7fc457400640 1 --2- 172.21.15.72:0/2879146511 >> v2:172.21.15.117:3300/0 conn(0x7fc4580cc430 0x7fc458070010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:43.183 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:43.182+0000 7fc457400640 1 -- 172.21.15.72:0/2879146511 >> v1:172.21.15.117:6789/0 conn(0x7fc4580cadc0 legacy=0x7fc4580cc810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:43.183 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:43.183+0000 7fc457400640 1 -- 172.21.15.72:0/2879146511 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4580cb880 con 0x7fc4580cf350 2024-04-04T06:56:43.183 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:43.183+0000 7fc457400640 1 -- 172.21.15.72:0/2879146511 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2465650867 0 0) 0x7fc4500019f0 con 0x7fc4580cf350 2024-04-04T06:56:43.183 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:43.183+0000 7fc457400640 1 -- 172.21.15.72:0/2879146511 >> v1:172.21.15.72:6789/0 conn(0x7fc4580cf350 legacy=0x7fc458164d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:43.183 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:43.183+0000 7fc457400640 1 --2- 172.21.15.72:0/2879146511 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc43c0039b0 0x7fc43c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:43.183 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:43.183+0000 7fc457400640 1 --2- 172.21.15.72:0/2879146511 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc43c004800 0x7fc43c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:43.183 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:43.183+0000 7fc457400640 1 --2- 172.21.15.72:0/2879146511 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc43c0051c0 0x7fc43c00dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:43.183 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:43.183+0000 7fc457400640 1 -- 172.21.15.72:0/2879146511 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fc4580cbed0 con 0x7fc43c0051c0 2024-04-04T06:56:43.183 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:43.183+0000 7fc457400640 1 -- 172.21.15.72:0/2879146511 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fc43c00e320 con 0x7fc43c004800 2024-04-04T06:56:43.183 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:43.183+0000 7fc457400640 1 -- 172.21.15.72:0/2879146511 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fc43c00e520 con 0x7fc43c0039b0 2024-04-04T06:56:43.183 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:43.183+0000 7fc45ce00640 1 --2- 172.21.15.72:0/2879146511 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc43c0051c0 0x7fc43c00dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:43.183 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:43.183+0000 7fc457e00640 1 --2- 172.21.15.72:0/2879146511 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc43c0039b0 0x7fc43c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:43.183 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:43.183+0000 7fc44f400640 1 --2- 172.21.15.72:0/2879146511 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc43c004800 0x7fc43c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:43.183 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:43.183+0000 7fc45ce00640 1 -- 172.21.15.72:0/2879146511 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc43c0039b0 msgr2=0x7fc43c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:56:43.183 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:43.183+0000 7fc45ce00640 1 --2- 172.21.15.72:0/2879146511 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc43c0039b0 0x7fc43c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:43.184 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:43.183+0000 7fc45ce00640 1 -- 172.21.15.72:0/2879146511 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc43c004800 msgr2=0x7fc43c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:56:43.184 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:43.183+0000 7fc45ce00640 1 --2- 172.21.15.72:0/2879146511 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc43c004800 0x7fc43c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:43.184 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:43.183+0000 7fc45ce00640 1 -- 172.21.15.72:0/2879146511 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc43c003520 con 0x7fc43c0051c0 2024-04-04T06:56:43.185 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:43.184+0000 7fc45ce00640 1 -- 172.21.15.72:0/2879146511 reap_dead start 2024-04-04T06:56:43.185 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:43.184+0000 7fc45ce00640 1 --2- 172.21.15.72:0/2879146511 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc43c0051c0 0x7fc43c00dbd0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fc45000a830 tx=0x7fc43c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d15f426e44a50d3 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:43.185 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:43.185+0000 7fc457400640 1 -- 172.21.15.72:0/2879146511 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc45000a480 con 0x7fc43c0051c0 2024-04-04T06:56:43.185 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:43.185+0000 7fc457400640 1 -- 172.21.15.72:0/2879146511 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc450034630 con 0x7fc43c0051c0 2024-04-04T06:56:43.185 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:43.185+0000 7fc457400640 1 -- 172.21.15.72:0/2879146511 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc450034a00 con 0x7fc43c0051c0 2024-04-04T06:56:43.185 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:43.185+0000 7fc45ee00640 1 -- 172.21.15.72:0/2879146511 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc43c0051c0 msgr2=0x7fc43c00dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:43.185 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:43.185+0000 7fc45ee00640 1 --2- 172.21.15.72:0/2879146511 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc43c0051c0 0x7fc43c00dbd0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fc45000a830 tx=0x7fc43c005830 comp rx=0 tx=0).stop 2024-04-04T06:56:43.185 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:43.185+0000 7fc45ee00640 1 -- 172.21.15.72:0/2879146511 shutdown_connections 2024-04-04T06:56:43.185 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:43.185+0000 7fc45ee00640 1 --2- 172.21.15.72:0/2879146511 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc43c0051c0 0x7fc43c00dbd0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:43.185 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:43.185+0000 7fc45ee00640 1 -- 172.21.15.72:0/2879146511 >> 172.21.15.72:0/2879146511 conn(0x7fc4580d0770 msgr2=0x7fc4580d0b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:56:43.185 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:43.185+0000 7fc45ee00640 1 -- 172.21.15.72:0/2879146511 shutdown_connections 2024-04-04T06:56:43.185 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:43.186+0000 7fc45ee00640 1 -- 172.21.15.72:0/2879146511 wait complete. 2024-04-04T06:56:43.186 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:43.187+0000 7fc45ee00640 1 Processor -- start 2024-04-04T06:56:43.186 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:43.188+0000 7fc45ee00640 1 -- start start 2024-04-04T06:56:43.188 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:43.188+0000 7fc45ee00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc43c0051c0 0x7fc4581f3d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:43.188 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:43.188+0000 7fc45ee00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc4580aefd0 0x7fc4581f12f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:43.188 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:43.189+0000 7fc45ee00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc45815b7e0 0x7fc458157ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:43.188 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:43.189+0000 7fc45ee00640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fc45806f430 con 0x7fc43c0051c0 2024-04-04T06:56:43.188 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:43.189+0000 7fc45ee00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fc45806f2b0 con 0x7fc45815b7e0 2024-04-04T06:56:43.188 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:43.189+0000 7fc45ee00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fc4580aff50 con 0x7fc4580aefd0 2024-04-04T06:56:43.188 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:43.189+0000 7fc457e00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc43c0051c0 0x7fc4581f3d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:43.188 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:43.189+0000 7fc457e00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc43c0051c0 0x7fc4581f3d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:34714/0 (socket says 172.21.15.72:34714) 2024-04-04T06:56:43.189 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:43.189+0000 7fc457e00640 1 -- 172.21.15.72:0/3820807705 learned_addr learned my addr 172.21.15.72:0/3820807705 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:56:43.189 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:43.189+0000 7fc457e00640 1 -- 172.21.15.72:0/3820807705 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc4580aefd0 msgr2=0x7fc4581f12f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:43.189 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:43.189+0000 7fc457e00640 1 --2- 172.21.15.72:0/3820807705 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc4580aefd0 0x7fc4581f12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:43.189 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:43.189+0000 7fc457e00640 1 -- 172.21.15.72:0/3820807705 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc45815b7e0 msgr2=0x7fc458157ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:43.189 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:43.189+0000 7fc457e00640 1 --2- 172.21.15.72:0/3820807705 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc45815b7e0 0x7fc458157ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:43.189 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:43.189+0000 7fc457e00640 1 -- 172.21.15.72:0/3820807705 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc45815d290 con 0x7fc43c0051c0 2024-04-04T06:56:43.189 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:43.189+0000 7fc457e00640 1 --2- 172.21.15.72:0/3820807705 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc43c0051c0 0x7fc4581f3d90 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fc44800f580 tx=0x7fc44800fa40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:43.189 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:43.190+0000 7fc454c00640 1 -- 172.21.15.72:0/3820807705 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc448013810 con 0x7fc43c0051c0 2024-04-04T06:56:43.189 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:43.190+0000 7fc454c00640 1 -- 172.21.15.72:0/3820807705 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc44801a070 con 0x7fc43c0051c0 2024-04-04T06:56:43.189 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:43.190+0000 7fc454c00640 1 -- 172.21.15.72:0/3820807705 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc448013bb0 con 0x7fc43c0051c0 2024-04-04T06:56:43.189 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:43.190+0000 7fc45ee00640 1 -- 172.21.15.72:0/3820807705 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4581f44e0 con 0x7fc43c0051c0 2024-04-04T06:56:43.189 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:43.190+0000 7fc45ee00640 1 -- 172.21.15.72:0/3820807705 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4581f4aa0 con 0x7fc43c0051c0 2024-04-04T06:56:43.190 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:43.191+0000 7fc45ee00640 1 -- 172.21.15.72:0/3820807705 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc4580685a0 con 0x7fc43c0051c0 2024-04-04T06:56:43.190 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:43.192+0000 7fc454c00640 1 -- 172.21.15.72:0/3820807705 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc448012070 con 0x7fc43c0051c0 2024-04-04T06:56:43.191 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:43.193+0000 7fc454c00640 1 --2- 172.21.15.72:0/3820807705 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fc43406c920 0x7fc43406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:43.191 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:43.193+0000 7fc454c00640 1 -- 172.21.15.72:0/3820807705 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fc44808ba70 con 0x7fc43c0051c0 2024-04-04T06:56:43.191 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:43.193+0000 7fc44f400640 1 --2- 172.21.15.72:0/3820807705 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fc43406c920 0x7fc43406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:43.192 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:43.193+0000 7fc44f400640 1 --2- 172.21.15.72:0/3820807705 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fc43406c920 0x7fc43406ede0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fc440007fd0 tx=0x7fc440009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:43.200 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:43.201+0000 7fc454c00640 1 -- 172.21.15.72:0/3820807705 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fc44801c310 con 0x7fc43c0051c0 2024-04-04T06:56:43.397 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:43.399+0000 7fc45ee00640 1 -- 172.21.15.72:0/3820807705 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fc458072880 con 0x7fc43c0051c0 2024-04-04T06:56:43.398 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:43.400+0000 7fc454c00640 1 -- 172.21.15.72:0/3820807705 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) ==== 93+0+10 (secure 0 0 0) 0x7fc448059eb0 con 0x7fc43c0051c0 2024-04-04T06:56:43.398 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 1 2024-04-04T06:56:43.401 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:43.402+0000 7fc45ee00640 1 -- 172.21.15.72:0/3820807705 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fc43406c920 msgr2=0x7fc43406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:43.401 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:43.402+0000 7fc45ee00640 1 --2- 172.21.15.72:0/3820807705 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fc43406c920 0x7fc43406ede0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fc440007fd0 tx=0x7fc440009040 comp rx=0 tx=0).stop 2024-04-04T06:56:43.401 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:43.402+0000 7fc45ee00640 1 -- 172.21.15.72:0/3820807705 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc43c0051c0 msgr2=0x7fc4581f3d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:43.402 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:43.402+0000 7fc45ee00640 1 --2- 172.21.15.72:0/3820807705 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc43c0051c0 0x7fc4581f3d90 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fc44800f580 tx=0x7fc44800fa40 comp rx=0 tx=0).stop 2024-04-04T06:56:43.402 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:43.402+0000 7fc45ee00640 1 -- 172.21.15.72:0/3820807705 shutdown_connections 2024-04-04T06:56:43.402 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:43.402+0000 7fc45ee00640 1 --2- 172.21.15.72:0/3820807705 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fc43406c920 0x7fc43406ede0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:43.402 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:43.402+0000 7fc45ee00640 1 --2- 172.21.15.72:0/3820807705 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc45815b7e0 0x7fc458157ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:43.402 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:43.402+0000 7fc45ee00640 1 --2- 172.21.15.72:0/3820807705 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc4580aefd0 0x7fc4581f12f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:43.402 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:43.402+0000 7fc45ee00640 1 --2- 172.21.15.72:0/3820807705 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc43c0051c0 0x7fc4581f3d90 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:43.402 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:43.402+0000 7fc45ee00640 1 -- 172.21.15.72:0/3820807705 >> 172.21.15.72:0/3820807705 conn(0x7fc4580d0770 msgr2=0x7fc4580b0cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:56:43.402 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:43.402+0000 7fc45ee00640 1 -- 172.21.15.72:0/3820807705 shutdown_connections 2024-04-04T06:56:43.402 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:43.402+0000 7fc45ee00640 1 -- 172.21.15.72:0/3820807705 wait complete. 2024-04-04T06:56:43.418 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-04T06:56:43.650 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:43.651+0000 7f6ef4c00640 1 Processor -- start 2024-04-04T06:56:43.650 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:43.651+0000 7f6ef4c00640 1 -- start start 2024-04-04T06:56:43.652 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:43.653+0000 7f6ef4c00640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f6ef00d12b0 0x7f6ef00d1720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:43.652 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:43.653+0000 7f6ef4c00640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ef00d2ea0 con 0x7f6ef015e600 2024-04-04T06:56:43.652 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:43.653+0000 7f6ef4c00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ef00d3180 con 0x7f6ef00b74b0 2024-04-04T06:56:43.652 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:43.653+0000 7f6ef4c00640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f6ef00d1c60 con 0x7f6ef00d12b0 2024-04-04T06:56:43.652 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:43.653+0000 7f6ee7e00640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f6ef00d12b0 0x7f6ef00d1720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:43.652 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:43.653+0000 7f6eede00640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f6ef015e600 0x7f6ef00d2470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:39622/0 (socket says 172.21.15.72:39622) 2024-04-04T06:56:43.652 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:43.653+0000 7f6eede00640 1 -- 172.21.15.72:0/1822279184 learned_addr learned my addr 172.21.15.72:0/1822279184 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-04-04T06:56:43.653 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:43.654+0000 7f6ee7e00640 1 -- 172.21.15.72:0/1822279184 >> v1:172.21.15.117:6789/0 conn(0x7f6ef00b74b0 legacy=0x7f6ef00b78f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:56:43.653 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:43.654+0000 7f6ee7e00640 1 -- 172.21.15.72:0/1822279184 >> v1:172.21.15.72:6789/0 conn(0x7f6ef015e600 legacy=0x7f6ef00d2470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:43.653 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:43.654+0000 7f6ee7e00640 1 -- 172.21.15.72:0/1822279184 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ef00d3460 con 0x7f6ef00d12b0 2024-04-04T06:56:43.653 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:43.654+0000 7f6eed400640 1 -- 172.21.15.72:0/1822279184 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1762849709 0 0) 0x7f6ef00d2ea0 con 0x7f6ef015e600 2024-04-04T06:56:43.654 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:43.655+0000 7f6ee7e00640 1 --2- 172.21.15.72:0/1822279184 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6ef00d12b0 0x7f6ef00d1720 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f6ed80097c0 tx=0x7f6ed802b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da28a5f15cadfc93 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:43.654 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:43.655+0000 7f6eed400640 1 -- 172.21.15.72:0/1822279184 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ed8035020 con 0x7f6ef00d12b0 2024-04-04T06:56:43.654 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:43.655+0000 7f6eed400640 1 -- 172.21.15.72:0/1822279184 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ed8031800 con 0x7f6ef00d12b0 2024-04-04T06:56:43.654 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:43.655+0000 7f6eed400640 1 -- 172.21.15.72:0/1822279184 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ed8031bd0 con 0x7f6ef00d12b0 2024-04-04T06:56:43.655 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:43.656+0000 7f6ef4c00640 1 -- 172.21.15.72:0/1822279184 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6ef00d12b0 msgr2=0x7f6ef00d1720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:43.655 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:43.656+0000 7f6ef4c00640 1 --2- 172.21.15.72:0/1822279184 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6ef00d12b0 0x7f6ef00d1720 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f6ed80097c0 tx=0x7f6ed802b8a0 comp rx=0 tx=0).stop 2024-04-04T06:56:43.655 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:43.656+0000 7f6ef4c00640 1 -- 172.21.15.72:0/1822279184 shutdown_connections 2024-04-04T06:56:43.655 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:43.656+0000 7f6ef4c00640 1 --2- 172.21.15.72:0/1822279184 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6ef00d12b0 0x7f6ef00d1720 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:43.655 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:43.656+0000 7f6ef4c00640 1 -- 172.21.15.72:0/1822279184 >> 172.21.15.72:0/1822279184 conn(0x7f6ef0071eb0 msgr2=0x7f6ef00722c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:56:43.655 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:43.656+0000 7f6ef4c00640 1 -- 172.21.15.72:0/1822279184 shutdown_connections 2024-04-04T06:56:43.655 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:43.656+0000 7f6ef4c00640 1 -- 172.21.15.72:0/1822279184 wait complete. 2024-04-04T06:56:43.656 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:43.658+0000 7f6ef4c00640 1 Processor -- start 2024-04-04T06:56:43.656 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:43.658+0000 7f6ef4c00640 1 -- start start 2024-04-04T06:56:43.658 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:43.659+0000 7f6ef4c00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6ef00b74b0 0x7f6ef01495d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:43.659 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:43.659+0000 7f6ef4c00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6ef00d12b0 0x7f6ef015e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:43.659 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:43.659+0000 7f6ef4c00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6ef015e600 0x7f6ef015ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:43.659 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:43.659+0000 7f6ef4c00640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f6ef00d2b80 con 0x7f6ef00d12b0 2024-04-04T06:56:43.659 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:43.659+0000 7f6ef4c00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f6ef00d3a20 con 0x7f6ef00b74b0 2024-04-04T06:56:43.659 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:43.659+0000 7f6ef4c00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f6ef00d3f40 con 0x7f6ef015e600 2024-04-04T06:56:43.659 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:43.659+0000 7f6ee7e00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6ef00d12b0 0x7f6ef015e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:43.659 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:43.659+0000 7f6ee7e00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6ef00d12b0 0x7f6ef015e9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:34726/0 (socket says 172.21.15.72:34726) 2024-04-04T06:56:43.659 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:43.659+0000 7f6ee7e00640 1 -- 172.21.15.72:0/3568846047 learned_addr learned my addr 172.21.15.72:0/3568846047 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:56:43.659 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:43.659+0000 7f6eede00640 1 --2- 172.21.15.72:0/3568846047 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6ef00b74b0 0x7f6ef01495d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:43.659 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:43.659+0000 7f6eee800640 1 --2- 172.21.15.72:0/3568846047 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6ef015e600 0x7f6ef015ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:43.659 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:43.659+0000 7f6ee7e00640 1 -- 172.21.15.72:0/3568846047 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6ef015e600 msgr2=0x7f6ef015ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:43.659 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:43.659+0000 7f6ee7e00640 1 --2- 172.21.15.72:0/3568846047 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6ef015e600 0x7f6ef015ef20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:43.659 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:43.659+0000 7f6ee7e00640 1 -- 172.21.15.72:0/3568846047 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6ef00b74b0 msgr2=0x7f6ef01495d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:43.660 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:43.659+0000 7f6ee7e00640 1 --2- 172.21.15.72:0/3568846047 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6ef00b74b0 0x7f6ef01495d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:43.660 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:43.659+0000 7f6ee7e00640 1 -- 172.21.15.72:0/3568846047 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ef0149b10 con 0x7f6ef00d12b0 2024-04-04T06:56:43.660 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:43.660+0000 7f6ee7e00640 1 --2- 172.21.15.72:0/3568846047 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6ef00d12b0 0x7f6ef015e9e0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f6ed80098e0 tx=0x7f6ed80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:43.660 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:43.660+0000 7f6ee6000640 1 -- 172.21.15.72:0/3568846047 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ed803bd70 con 0x7f6ef00d12b0 2024-04-04T06:56:43.660 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:43.660+0000 7f6ee6000640 1 -- 172.21.15.72:0/3568846047 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ed80453f0 con 0x7f6ef00d12b0 2024-04-04T06:56:43.660 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:43.660+0000 7f6ee6000640 1 -- 172.21.15.72:0/3568846047 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ed80457e0 con 0x7f6ef00d12b0 2024-04-04T06:56:43.660 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:43.660+0000 7f6ef4c00640 1 -- 172.21.15.72:0/3568846047 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ef01580c0 con 0x7f6ef00d12b0 2024-04-04T06:56:43.660 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:43.660+0000 7f6ef4c00640 1 -- 172.21.15.72:0/3568846047 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ef015f830 con 0x7f6ef00d12b0 2024-04-04T06:56:43.661 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:43.661+0000 7f6ef4c00640 1 -- 172.21.15.72:0/3568846047 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ef0075730 con 0x7f6ef00d12b0 2024-04-04T06:56:43.661 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:43.662+0000 7f6ee6000640 1 -- 172.21.15.72:0/3568846047 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6ed804c060 con 0x7f6ef00d12b0 2024-04-04T06:56:43.661 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:43.663+0000 7f6ee6000640 1 --2- 172.21.15.72:0/3568846047 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f6ecc06c920 0x7f6ecc06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:43.662 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:43.663+0000 7f6ee6000640 1 -- 172.21.15.72:0/3568846047 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f6ed80adc30 con 0x7f6ef00d12b0 2024-04-04T06:56:43.662 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:43.663+0000 7f6eede00640 1 --2- 172.21.15.72:0/3568846047 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f6ecc06c920 0x7f6ecc06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:43.662 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:43.664+0000 7f6eede00640 1 --2- 172.21.15.72:0/3568846047 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f6ecc06c920 0x7f6ecc06ede0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f6ee0000f60 tx=0x7f6ee0007c00 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:43.666 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:43.668+0000 7f6ee6000640 1 -- 172.21.15.72:0/3568846047 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f6ed8040070 con 0x7f6ef00d12b0 2024-04-04T06:56:43.856 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:43.857+0000 7f6ef4c00640 1 -- 172.21.15.72:0/3568846047 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f6ef006c480 con 0x7f6ef00d12b0 2024-04-04T06:56:43.856 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:43.858+0000 7f6ee6000640 1 -- 172.21.15.72:0/3568846047 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) ==== 104+0+11 (secure 0 0 0) 0x7f6ed807bfc0 con 0x7f6ef00d12b0 2024-04-04T06:56:43.856 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2024-04-04T06:56:43.859 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:43.860+0000 7f6ef4c00640 1 -- 172.21.15.72:0/3568846047 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f6ecc06c920 msgr2=0x7f6ecc06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:43.859 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:43.860+0000 7f6ef4c00640 1 --2- 172.21.15.72:0/3568846047 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f6ecc06c920 0x7f6ecc06ede0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f6ee0000f60 tx=0x7f6ee0007c00 comp rx=0 tx=0).stop 2024-04-04T06:56:43.859 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:43.860+0000 7f6ef4c00640 1 -- 172.21.15.72:0/3568846047 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6ef00d12b0 msgr2=0x7f6ef015e9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:43.860 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:43.860+0000 7f6ef4c00640 1 --2- 172.21.15.72:0/3568846047 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6ef00d12b0 0x7f6ef015e9e0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f6ed80098e0 tx=0x7f6ed80046c0 comp rx=0 tx=0).stop 2024-04-04T06:56:43.860 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:43.861+0000 7f6ef4c00640 1 -- 172.21.15.72:0/3568846047 shutdown_connections 2024-04-04T06:56:43.860 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:43.861+0000 7f6ef4c00640 1 --2- 172.21.15.72:0/3568846047 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f6ecc06c920 0x7f6ecc06ede0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:43.860 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:43.861+0000 7f6ef4c00640 1 --2- 172.21.15.72:0/3568846047 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6ef015e600 0x7f6ef015ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:43.860 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:43.861+0000 7f6ef4c00640 1 --2- 172.21.15.72:0/3568846047 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6ef00d12b0 0x7f6ef015e9e0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:43.860 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:43.861+0000 7f6ef4c00640 1 --2- 172.21.15.72:0/3568846047 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6ef00b74b0 0x7f6ef01495d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:43.860 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:43.861+0000 7f6ef4c00640 1 -- 172.21.15.72:0/3568846047 >> 172.21.15.72:0/3568846047 conn(0x7f6ef0071eb0 msgr2=0x7f6ef00d42a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:56:43.860 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:43.861+0000 7f6ef4c00640 1 -- 172.21.15.72:0/3568846047 shutdown_connections 2024-04-04T06:56:43.860 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:43.861+0000 7f6ef4c00640 1 -- 172.21.15.72:0/3568846047 wait complete. 2024-04-04T06:56:43.885 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-04T06:56:44.091 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:44.092+0000 7ff49f200640 1 Processor -- start 2024-04-04T06:56:44.091 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:44.092+0000 7ff49f200640 1 -- start start 2024-04-04T06:56:44.093 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:44.094+0000 7ff49f200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff4a00c7a80 0x7ff4a0162970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:44.093 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:44.094+0000 7ff49f200640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff4a00cf0c0 con 0x7ff4a006c480 2024-04-04T06:56:44.093 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:44.094+0000 7ff49f200640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff4a00cf350 con 0x7ff4a00c76a0 2024-04-04T06:56:44.093 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:44.094+0000 7ff49f200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7ff4a01624e0 con 0x7ff4a00c7a80 2024-04-04T06:56:44.093 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:44.094+0000 7ff49e800640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7ff4a006c480 0x7ff4a0158080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:39636/0 (socket says 172.21.15.72:39636) 2024-04-04T06:56:44.093 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:44.094+0000 7ff49e800640 1 -- 172.21.15.72:0/3238999956 learned_addr learned my addr 172.21.15.72:0/3238999956 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-04-04T06:56:44.095 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:44.095+0000 7ff495400640 1 --2- 172.21.15.72:0/3238999956 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff4a00c7a80 0x7ff4a0162970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:44.095 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:44.095+0000 7ff49d400640 1 -- 172.21.15.72:0/3238999956 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2950644048 0 0) 0x7ff4a00cf0c0 con 0x7ff4a006c480 2024-04-04T06:56:44.095 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:44.095+0000 7ff49d400640 1 -- 172.21.15.72:0/3238999956 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff484003520 con 0x7ff4a006c480 2024-04-04T06:56:44.095 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:44.096+0000 7ff49d400640 1 -- 172.21.15.72:0/3238999956 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4159423268 0 0) 0x7ff484003520 con 0x7ff4a006c480 2024-04-04T06:56:44.095 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:44.096+0000 7ff49d400640 1 -- 172.21.15.72:0/3238999956 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff4a00c7a80 msgr2=0x7ff4a0162970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:56:44.095 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:44.096+0000 7ff49d400640 1 --2- 172.21.15.72:0/3238999956 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff4a00c7a80 0x7ff4a0162970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:44.095 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:44.096+0000 7ff49d400640 1 -- 172.21.15.72:0/3238999956 >> v1:172.21.15.117:6789/0 conn(0x7ff4a00c76a0 legacy=0x7ff4a00ce9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:44.096 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:44.096+0000 7ff49d400640 1 -- 172.21.15.72:0/3238999956 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4a0161e90 con 0x7ff4a006c480 2024-04-04T06:56:44.096 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:44.096+0000 7ff49d400640 1 -- 172.21.15.72:0/3238999956 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2465650867 0 0) 0x7ff498001670 con 0x7ff4a006c480 2024-04-04T06:56:44.096 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:44.096+0000 7ff49d400640 1 -- 172.21.15.72:0/3238999956 >> v1:172.21.15.72:6789/0 conn(0x7ff4a006c480 legacy=0x7ff4a0158080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:44.096 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:44.096+0000 7ff49d400640 1 --2- 172.21.15.72:0/3238999956 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff4840039e0 0x7ff484003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:44.096 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:44.096+0000 7ff49d400640 1 --2- 172.21.15.72:0/3238999956 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff484004800 0x7ff484004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:44.096 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:44.096+0000 7ff49d400640 1 --2- 172.21.15.72:0/3238999956 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff484005180 0x7ff48400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:44.096 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:44.096+0000 7ff49d400640 1 -- 172.21.15.72:0/3238999956 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7ff4a01624e0 con 0x7ff4840039e0 2024-04-04T06:56:44.096 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:44.096+0000 7ff49d400640 1 -- 172.21.15.72:0/3238999956 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7ff48400bf00 con 0x7ff484005180 2024-04-04T06:56:44.096 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:44.096+0000 7ff49d400640 1 -- 172.21.15.72:0/3238999956 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7ff48400c080 con 0x7ff484004800 2024-04-04T06:56:44.096 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:44.096+0000 7ff49de00640 1 --2- 172.21.15.72:0/3238999956 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff4840039e0 0x7ff484003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:44.096 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:44.096+0000 7ff49e800640 1 --2- 172.21.15.72:0/3238999956 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff484005180 0x7ff48400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:44.096 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:44.097+0000 7ff49de00640 1 -- 172.21.15.72:0/3238999956 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff484004800 msgr2=0x7ff484004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:56:44.096 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:44.097+0000 7ff49de00640 1 --2- 172.21.15.72:0/3238999956 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff484004800 0x7ff484004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:44.096 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:44.097+0000 7ff49de00640 1 -- 172.21.15.72:0/3238999956 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff484005180 msgr2=0x7ff48400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:56:44.096 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:44.097+0000 7ff49de00640 1 --2- 172.21.15.72:0/3238999956 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff484005180 0x7ff48400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:44.097 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:44.097+0000 7ff49de00640 1 -- 172.21.15.72:0/3238999956 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff484003520 con 0x7ff4840039e0 2024-04-04T06:56:44.097 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:44.097+0000 7ff49e800640 1 --2- 172.21.15.72:0/3238999956 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff484005180 0x7ff48400b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-04T06:56:44.098 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:44.098+0000 7ff49de00640 1 --2- 172.21.15.72:0/3238999956 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff4840039e0 0x7ff484003e00 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7ff490001e50 tx=0x7ff484005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1343018a5b28a6f2 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:44.098 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:44.098+0000 7ff49d400640 1 -- 172.21.15.72:0/3238999956 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff490001a70 con 0x7ff4840039e0 2024-04-04T06:56:44.098 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:44.098+0000 7ff49d400640 1 -- 172.21.15.72:0/3238999956 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff490003b70 con 0x7ff4840039e0 2024-04-04T06:56:44.098 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:44.098+0000 7ff49d400640 1 -- 172.21.15.72:0/3238999956 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4900050d0 con 0x7ff4840039e0 2024-04-04T06:56:44.098 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:44.098+0000 7ff49f200640 1 -- 172.21.15.72:0/3238999956 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff4840039e0 msgr2=0x7ff484003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:44.098 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:44.098+0000 7ff49f200640 1 --2- 172.21.15.72:0/3238999956 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff4840039e0 0x7ff484003e00 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7ff490001e50 tx=0x7ff484005830 comp rx=0 tx=0).stop 2024-04-04T06:56:44.098 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:44.098+0000 7ff49e800640 1 -- 172.21.15.72:0/3238999956 reap_dead start 2024-04-04T06:56:44.098 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:44.099+0000 7ff49f200640 1 -- 172.21.15.72:0/3238999956 shutdown_connections 2024-04-04T06:56:44.099 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:44.099+0000 7ff49f200640 1 -- 172.21.15.72:0/3238999956 >> 172.21.15.72:0/3238999956 conn(0x7ff4a0072360 msgr2=0x7ff4a0072770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:56:44.099 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:44.099+0000 7ff49f200640 1 -- 172.21.15.72:0/3238999956 shutdown_connections 2024-04-04T06:56:44.099 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:44.099+0000 7ff49f200640 1 -- 172.21.15.72:0/3238999956 wait complete. 2024-04-04T06:56:44.099 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:44.100+0000 7ff49f200640 1 Processor -- start 2024-04-04T06:56:44.099 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:44.101+0000 7ff49f200640 1 -- start start 2024-04-04T06:56:44.101 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:44.101+0000 7ff49f200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff4840039e0 0x7ff4a01e7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:44.101 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:44.101+0000 7ff49f200640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff4a01f7ac0 0x7ff4a00b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:44.101 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:44.101+0000 7ff49f200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff4a00af000 0x7ff4a00b4010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:44.101 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:44.102+0000 7ff49f200640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7ff4a015f560 con 0x7ff4a01f7ac0 2024-04-04T06:56:44.101 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:44.102+0000 7ff49f200640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7ff4a00cf630 con 0x7ff4840039e0 2024-04-04T06:56:44.101 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:44.102+0000 7ff49f200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7ff4a015f6e0 con 0x7ff4a00af000 2024-04-04T06:56:44.101 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:44.102+0000 7ff495400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff4a01f7ac0 0x7ff4a00b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:44.101 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:44.102+0000 7ff495400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff4a01f7ac0 0x7ff4a00b4e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:34740/0 (socket says 172.21.15.72:34740) 2024-04-04T06:56:44.101 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:44.102+0000 7ff495400640 1 -- 172.21.15.72:0/67473739 learned_addr learned my addr 172.21.15.72:0/67473739 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:56:44.101 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:44.102+0000 7ff495400640 1 -- 172.21.15.72:0/67473739 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff4a00af000 msgr2=0x7ff4a00b4010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:44.101 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:44.102+0000 7ff495400640 1 --2- 172.21.15.72:0/67473739 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff4a00af000 0x7ff4a00b4010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:44.101 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:44.102+0000 7ff495400640 1 -- 172.21.15.72:0/67473739 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff4840039e0 msgr2=0x7ff4a01e7910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:44.101 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:44.102+0000 7ff495400640 1 --2- 172.21.15.72:0/67473739 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff4840039e0 0x7ff4a01e7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:44.102 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:44.102+0000 7ff495400640 1 -- 172.21.15.72:0/67473739 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4a01f8080 con 0x7ff4a01f7ac0 2024-04-04T06:56:44.102 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:44.102+0000 7ff495400640 1 --2- 172.21.15.72:0/67473739 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff4a01f7ac0 0x7ff4a00b4e50 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7ff48800e850 tx=0x7ff48800ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:44.102 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:44.103+0000 7ff496a00640 1 -- 172.21.15.72:0/67473739 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff488017070 con 0x7ff4a01f7ac0 2024-04-04T06:56:44.102 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:44.103+0000 7ff496a00640 1 -- 172.21.15.72:0/67473739 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff48800c940 con 0x7ff4a01f7ac0 2024-04-04T06:56:44.103 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:44.103+0000 7ff496a00640 1 -- 172.21.15.72:0/67473739 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff48800cd10 con 0x7ff4a01f7ac0 2024-04-04T06:56:44.103 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:44.103+0000 7ff49f200640 1 -- 172.21.15.72:0/67473739 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4a01f8360 con 0x7ff4a01f7ac0 2024-04-04T06:56:44.103 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:44.103+0000 7ff49f200640 1 -- 172.21.15.72:0/67473739 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4a00b3af0 con 0x7ff4a01f7ac0 2024-04-04T06:56:44.103 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:44.104+0000 7ff49f200640 1 -- 172.21.15.72:0/67473739 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff4a00d0140 con 0x7ff4a01f7ac0 2024-04-04T06:56:44.103 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:44.105+0000 7ff496a00640 1 -- 172.21.15.72:0/67473739 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff48801a070 con 0x7ff4a01f7ac0 2024-04-04T06:56:44.105 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:44.106+0000 7ff496a00640 1 --2- 172.21.15.72:0/67473739 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7ff47c06c920 0x7ff47c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:44.105 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:44.107+0000 7ff496a00640 1 -- 172.21.15.72:0/67473739 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7ff48808b8d0 con 0x7ff4a01f7ac0 2024-04-04T06:56:44.105 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:44.107+0000 7ff49de00640 1 --2- 172.21.15.72:0/67473739 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7ff47c06c920 0x7ff47c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:44.105 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:44.107+0000 7ff49de00640 1 --2- 172.21.15.72:0/67473739 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7ff47c06c920 0x7ff47c06ede0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7ff490034000 tx=0x7ff490030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:44.110 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:44.111+0000 7ff496a00640 1 -- 172.21.15.72:0/67473739 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7ff4a00d0140 con 0x7ff4a01f7ac0 2024-04-04T06:56:44.308 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T06:56:44.314 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T06:56:44.315 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 64 2024-04-04T06:56:44.315 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:44.312+0000 7ff49f200640 1 -- 172.21.15.72:0/67473739 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7ff4a00d0bb0 con 0x7ff4a01f7ac0 2024-04-04T06:56:44.315 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:44.312+0000 7ff496a00640 1 -- 172.21.15.72:0/67473739 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) ==== 100+0+11 (secure 0 0 0) 0x7ff4a00d0bb0 con 0x7ff4a01f7ac0 2024-04-04T06:56:44.315 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:44.315+0000 7ff49f200640 1 -- 172.21.15.72:0/67473739 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7ff47c06c920 msgr2=0x7ff47c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:44.315 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:44.315+0000 7ff49f200640 1 --2- 172.21.15.72:0/67473739 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7ff47c06c920 0x7ff47c06ede0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7ff490034000 tx=0x7ff490030000 comp rx=0 tx=0).stop 2024-04-04T06:56:44.315 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:44.315+0000 7ff49f200640 1 -- 172.21.15.72:0/67473739 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff4a01f7ac0 msgr2=0x7ff4a00b4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:44.316 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:44.315+0000 7ff49f200640 1 --2- 172.21.15.72:0/67473739 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff4a01f7ac0 0x7ff4a00b4e50 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7ff48800e850 tx=0x7ff48800ed10 comp rx=0 tx=0).stop 2024-04-04T06:56:44.316 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:44.315+0000 7ff49f200640 1 -- 172.21.15.72:0/67473739 shutdown_connections 2024-04-04T06:56:44.316 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:44.315+0000 7ff49f200640 1 --2- 172.21.15.72:0/67473739 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7ff47c06c920 0x7ff47c06ede0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:44.316 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:44.315+0000 7ff49f200640 1 --2- 172.21.15.72:0/67473739 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff4a00af000 0x7ff4a00b4010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:44.316 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:44.315+0000 7ff49f200640 1 --2- 172.21.15.72:0/67473739 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff4a01f7ac0 0x7ff4a00b4e50 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:44.316 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:44.315+0000 7ff49f200640 1 --2- 172.21.15.72:0/67473739 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff4840039e0 0x7ff4a01e7910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:44.316 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:44.315+0000 7ff49f200640 1 -- 172.21.15.72:0/67473739 >> 172.21.15.72:0/67473739 conn(0x7ff4a0072360 msgr2=0x7ff4a006fa60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:56:44.316 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:44.315+0000 7ff49f200640 1 -- 172.21.15.72:0/67473739 shutdown_connections 2024-04-04T06:56:44.316 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:44.315+0000 7ff49f200640 1 -- 172.21.15.72:0/67473739 wait complete. 2024-04-04T06:56:44.331 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-04T06:56:44.579 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:44.580+0000 7f61bec00640 1 Processor -- start 2024-04-04T06:56:44.579 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:44.581+0000 7f61bec00640 1 -- start start 2024-04-04T06:56:44.581 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:44.582+0000 7f61bec00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f61b815b230 0x7f61b80d00c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:44.581 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:44.582+0000 7f61bec00640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f61b80d0600 0x7f61b80c4ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:44.581 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:44.582+0000 7f61bec00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61b80c5c00 con 0x7f61b80c5530 2024-04-04T06:56:44.581 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:44.582+0000 7f61bec00640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f61b80c59c0 con 0x7f61b80d0600 2024-04-04T06:56:44.581 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:44.582+0000 7f61bec00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f61b815c2b0 con 0x7f61b815b230 2024-04-04T06:56:44.581 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:44.582+0000 7f61afe00640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f61b80d0600 0x7f61b80c4ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:44.581 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:44.583+0000 7f61afe00640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f61b80d0600 0x7f61b80c4ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:34748/0 (socket says 172.21.15.72:34748) 2024-04-04T06:56:44.581 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:44.583+0000 7f61afe00640 1 -- 172.21.15.72:0/908853273 learned_addr learned my addr 172.21.15.72:0/908853273 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:56:44.582 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:44.583+0000 7f61b7e00640 1 --2- 172.21.15.72:0/908853273 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f61b815b230 0x7f61b80d00c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:44.582 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:44.583+0000 7f61afe00640 1 -- 172.21.15.72:0/908853273 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f61b815b230 msgr2=0x7f61b80d00c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:56:44.582 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:44.583+0000 7f61afe00640 1 --2- 172.21.15.72:0/908853273 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f61b815b230 0x7f61b80d00c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:44.582 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:44.583+0000 7f61afe00640 1 -- 172.21.15.72:0/908853273 >> v1:172.21.15.117:6789/0 conn(0x7f61b80c5530 legacy=0x7f61b815ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:56:44.582 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:44.583+0000 7f61afe00640 1 -- 172.21.15.72:0/908853273 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61b815b980 con 0x7f61b80d0600 2024-04-04T06:56:44.583 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:44.584+0000 7f61afe00640 1 --2- 172.21.15.72:0/908853273 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f61b80d0600 0x7f61b80c4ff0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f61a0009870 tx=0x7f61a002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=979ff97db0ebff7f server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:44.583 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:44.584+0000 7f61b7400640 1 -- 172.21.15.72:0/908853273 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61a0035020 con 0x7f61b80d0600 2024-04-04T06:56:44.583 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:44.584+0000 7f61b7400640 1 -- 172.21.15.72:0/908853273 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61a0031640 con 0x7f61b80d0600 2024-04-04T06:56:44.583 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:44.584+0000 7f61b7400640 1 -- 172.21.15.72:0/908853273 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61a002d040 con 0x7f61b80d0600 2024-04-04T06:56:44.584 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:44.585+0000 7f61bec00640 1 -- 172.21.15.72:0/908853273 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f61b80d0600 msgr2=0x7f61b80c4ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:44.584 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:44.585+0000 7f61bec00640 1 --2- 172.21.15.72:0/908853273 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f61b80d0600 0x7f61b80c4ff0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f61a0009870 tx=0x7f61a002b8f0 comp rx=0 tx=0).stop 2024-04-04T06:56:44.584 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:44.585+0000 7f61bec00640 1 -- 172.21.15.72:0/908853273 shutdown_connections 2024-04-04T06:56:44.584 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:44.585+0000 7f61bec00640 1 --2- 172.21.15.72:0/908853273 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f61b80d0600 0x7f61b80c4ff0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:44.584 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:44.585+0000 7f61bec00640 1 --2- 172.21.15.72:0/908853273 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f61b815b230 0x7f61b80d00c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:44.584 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:44.585+0000 7f61bec00640 1 -- 172.21.15.72:0/908853273 >> 172.21.15.72:0/908853273 conn(0x7f61b806b470 msgr2=0x7f61b806b880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:56:44.584 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:44.585+0000 7f61bec00640 1 -- 172.21.15.72:0/908853273 shutdown_connections 2024-04-04T06:56:44.584 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:44.585+0000 7f61bec00640 1 -- 172.21.15.72:0/908853273 wait complete. 2024-04-04T06:56:44.585 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:44.587+0000 7f61bec00640 1 Processor -- start 2024-04-04T06:56:44.585 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:44.587+0000 7f61bec00640 1 -- start start 2024-04-04T06:56:44.588 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:44.588+0000 7f61bec00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f61b80c5530 0x7f61b80727c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:44.588 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:44.588+0000 7f61bec00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f61b80d0600 0x7f61b8072d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:44.588 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:44.588+0000 7f61bec00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f61b815b230 0x7f61b81f4920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:44.588 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:44.588+0000 7f61bec00640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f61b815bf40 con 0x7f61b815b230 2024-04-04T06:56:44.588 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:44.588+0000 7f61bec00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f61b80d0a40 con 0x7f61b80d0600 2024-04-04T06:56:44.588 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:44.588+0000 7f61bec00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f61b815b610 con 0x7f61b80c5530 2024-04-04T06:56:44.589 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:44.588+0000 7f61bcc00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f61b815b230 0x7f61b81f4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:44.589 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:44.588+0000 7f61bcc00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f61b815b230 0x7f61b81f4920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:34752/0 (socket says 172.21.15.72:34752) 2024-04-04T06:56:44.589 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:44.588+0000 7f61bcc00640 1 -- 172.21.15.72:0/2899760710 learned_addr learned my addr 172.21.15.72:0/2899760710 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:56:44.589 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:44.589+0000 7f61b7e00640 1 --2- 172.21.15.72:0/2899760710 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f61b80c5530 0x7f61b80727c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:44.589 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:44.589+0000 7f61afe00640 1 --2- 172.21.15.72:0/2899760710 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f61b80d0600 0x7f61b8072d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:44.589 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:44.589+0000 7f61bcc00640 1 -- 172.21.15.72:0/2899760710 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f61b80c5530 msgr2=0x7f61b80727c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:44.589 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:44.589+0000 7f61bcc00640 1 --2- 172.21.15.72:0/2899760710 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f61b80c5530 0x7f61b80727c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:44.589 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:44.589+0000 7f61bcc00640 1 -- 172.21.15.72:0/2899760710 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f61b80d0600 msgr2=0x7f61b8072d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:44.589 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:44.589+0000 7f61bcc00640 1 --2- 172.21.15.72:0/2899760710 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f61b80d0600 0x7f61b8072d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:44.589 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:44.589+0000 7f61bcc00640 1 -- 172.21.15.72:0/2899760710 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61b81f7e50 con 0x7f61b815b230 2024-04-04T06:56:44.589 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:44.589+0000 7f61b7e00640 1 --2- 172.21.15.72:0/2899760710 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f61b80c5530 0x7f61b80727c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-04T06:56:44.589 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:44.589+0000 7f61bcc00640 1 --2- 172.21.15.72:0/2899760710 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f61b815b230 0x7f61b81f4920 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f61b000c780 tx=0x7f61b000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:44.589 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:44.589+0000 7f61b4c00640 1 -- 172.21.15.72:0/2899760710 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61b0004b60 con 0x7f61b815b230 2024-04-04T06:56:44.589 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:44.589+0000 7f61b4c00640 1 -- 172.21.15.72:0/2899760710 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61b0004d00 con 0x7f61b815b230 2024-04-04T06:56:44.589 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:44.589+0000 7f61bec00640 1 -- 172.21.15.72:0/2899760710 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61b81f8130 con 0x7f61b815b230 2024-04-04T06:56:44.589 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:44.589+0000 7f61b4c00640 1 -- 172.21.15.72:0/2899760710 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61b000aa90 con 0x7f61b815b230 2024-04-04T06:56:44.590 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:44.590+0000 7f61bec00640 1 -- 172.21.15.72:0/2899760710 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61b81f86f0 con 0x7f61b815b230 2024-04-04T06:56:44.590 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:44.591+0000 7f61bec00640 1 -- 172.21.15.72:0/2899760710 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61b8075840 con 0x7f61b815b230 2024-04-04T06:56:44.590 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:44.592+0000 7f61b4c00640 1 -- 172.21.15.72:0/2899760710 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f61b000ac30 con 0x7f61b815b230 2024-04-04T06:56:44.591 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:44.593+0000 7f61b4c00640 1 --2- 172.21.15.72:0/2899760710 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f619406c920 0x7f619406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:44.592 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:44.593+0000 7f61b4c00640 1 -- 172.21.15.72:0/2899760710 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f61b008bdd0 con 0x7f61b815b230 2024-04-04T06:56:44.592 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:44.593+0000 7f61b7e00640 1 --2- 172.21.15.72:0/2899760710 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f619406c920 0x7f619406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:44.592 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:44.594+0000 7f61b7e00640 1 --2- 172.21.15.72:0/2899760710 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f619406c920 0x7f619406ede0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f61a8006fd0 tx=0x7f61a8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:44.600 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:44.602+0000 7f61b4c00640 1 -- 172.21.15.72:0/2899760710 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f61b0020070 con 0x7f61b815b230 2024-04-04T06:56:44.839 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:44.840+0000 7f61bec00640 1 -- 172.21.15.72:0/2899760710 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f61b806de60 con 0x7f61b815b230 2024-04-04T06:56:44.840 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:44.841+0000 7f61b4c00640 1 -- 172.21.15.72:0/2899760710 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5181 (secure 0 0 0) 0x7f61b008d090 con 0x7f61b815b230 2024-04-04T06:56:44.840 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 8 2024-04-04T06:56:44.840 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T06:56:44.840 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6834/3570831137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":3570831137},{"type":"v1","addr":"172.21.15.117:6834","nonce":3570831137}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4238,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/1683311500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6833","nonce":1683311500},{"type":"v1","addr":"172.21.15.117:6835","nonce":1683311500}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6835/4150347227","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":4150347227},{"type":"v1","addr":"172.21.15.72:6835","nonce":4150347227}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-04T06:56:28.435113+0000","modified":"2024-04-04T06:56:31.557618+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4263},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4263":{"gid":4263,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.72:6837/2958027127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6836","nonce":2958027127},{"type":"v1","addr":"172.21.15.72:6837","nonce":2958027127}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4263,"qdb_cluster":[4263]},"id":1}]} 2024-04-04T06:56:44.842 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:44.843+0000 7f61bec00640 1 -- 172.21.15.72:0/2899760710 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f619406c920 msgr2=0x7f619406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:44.842 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:44.843+0000 7f61bec00640 1 --2- 172.21.15.72:0/2899760710 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f619406c920 0x7f619406ede0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f61a8006fd0 tx=0x7f61a8008040 comp rx=0 tx=0).stop 2024-04-04T06:56:44.842 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:44.843+0000 7f61bec00640 1 -- 172.21.15.72:0/2899760710 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f61b815b230 msgr2=0x7f61b81f4920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:44.842 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:44.843+0000 7f61bec00640 1 --2- 172.21.15.72:0/2899760710 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f61b815b230 0x7f61b81f4920 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f61b000c780 tx=0x7f61b000cc40 comp rx=0 tx=0).stop 2024-04-04T06:56:44.843 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:44.844+0000 7f61bec00640 1 -- 172.21.15.72:0/2899760710 shutdown_connections 2024-04-04T06:56:44.843 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:44.844+0000 7f61bec00640 1 --2- 172.21.15.72:0/2899760710 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f619406c920 0x7f619406ede0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:44.843 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:44.844+0000 7f61bec00640 1 --2- 172.21.15.72:0/2899760710 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f61b815b230 0x7f61b81f4920 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:44.843 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:44.844+0000 7f61bec00640 1 --2- 172.21.15.72:0/2899760710 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f61b80d0600 0x7f61b8072d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:44.843 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:44.844+0000 7f61bec00640 1 --2- 172.21.15.72:0/2899760710 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f61b80c5530 0x7f61b80727c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:44.843 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:44.844+0000 7f61bec00640 1 -- 172.21.15.72:0/2899760710 >> 172.21.15.72:0/2899760710 conn(0x7f61b806b470 msgr2=0x7f61b806b850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:56:44.843 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:44.844+0000 7f61bec00640 1 -- 172.21.15.72:0/2899760710 shutdown_connections 2024-04-04T06:56:44.843 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:44.844+0000 7f61bec00640 1 -- 172.21.15.72:0/2899760710 wait complete. 2024-04-04T06:56:44.861 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-04T06:56:45.052 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:45.053+0000 7fe595e00640 1 Processor -- start 2024-04-04T06:56:45.052 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:45.053+0000 7fe595e00640 1 -- start start 2024-04-04T06:56:45.054 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:45.055+0000 7fe595e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe5900b44e0 0x7fe5900c6fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:45.054 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:45.055+0000 7fe595e00640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe5900b4b00 con 0x7fe59006c4b0 2024-04-04T06:56:45.054 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:45.055+0000 7fe595e00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe5900711a0 con 0x7fe590071c80 2024-04-04T06:56:45.054 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:45.055+0000 7fe595e00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fe590070f50 con 0x7fe5900b44e0 2024-04-04T06:56:45.054 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:45.056+0000 7fe58ea00640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fe59006c4b0 0x7fe59006c890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:39644/0 (socket says 172.21.15.72:39644) 2024-04-04T06:56:45.054 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:45.056+0000 7fe58ea00640 1 -- 172.21.15.72:0/3902837597 learned_addr learned my addr 172.21.15.72:0/3902837597 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-04-04T06:56:45.056 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:45.056+0000 7fe58f400640 1 --2- 172.21.15.72:0/3902837597 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe5900b44e0 0x7fe5900c6fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:45.056 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:45.056+0000 7fe58d600640 1 -- 172.21.15.72:0/3902837597 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 285605588 0 0) 0x7fe5900b4b00 con 0x7fe59006c4b0 2024-04-04T06:56:45.056 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:45.056+0000 7fe58d600640 1 -- 172.21.15.72:0/3902837597 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe570003520 con 0x7fe59006c4b0 2024-04-04T06:56:45.056 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:45.056+0000 7fe58d600640 1 -- 172.21.15.72:0/3902837597 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3891422250 0 0) 0x7fe570003520 con 0x7fe59006c4b0 2024-04-04T06:56:45.056 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:45.056+0000 7fe58d600640 1 -- 172.21.15.72:0/3902837597 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe5900b44e0 msgr2=0x7fe5900c6fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:56:45.057 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:45.056+0000 7fe58d600640 1 --2- 172.21.15.72:0/3902837597 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe5900b44e0 0x7fe5900c6fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:45.057 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:45.056+0000 7fe58d600640 1 -- 172.21.15.72:0/3902837597 >> v1:172.21.15.117:6789/0 conn(0x7fe590071c80 legacy=0x7fe5900b3dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:45.057 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:45.057+0000 7fe58d600640 1 -- 172.21.15.72:0/3902837597 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe590071480 con 0x7fe59006c4b0 2024-04-04T06:56:45.057 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:45.057+0000 7fe58d600640 1 -- 172.21.15.72:0/3902837597 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2465650867 0 0) 0x7fe580001670 con 0x7fe59006c4b0 2024-04-04T06:56:45.057 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:45.057+0000 7fe58d600640 1 -- 172.21.15.72:0/3902837597 >> v1:172.21.15.72:6789/0 conn(0x7fe59006c4b0 legacy=0x7fe59006c890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:45.057 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:45.057+0000 7fe58d600640 1 --2- 172.21.15.72:0/3902837597 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe5700039e0 0x7fe570003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:45.057 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:45.057+0000 7fe58d600640 1 --2- 172.21.15.72:0/3902837597 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe5900b44e0 0x7fe570004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:45.057 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:45.057+0000 7fe58d600640 1 --2- 172.21.15.72:0/3902837597 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe570004d40 0x7fe5700051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:45.057 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:45.057+0000 7fe58d600640 1 -- 172.21.15.72:0/3902837597 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fe590070f50 con 0x7fe570004d40 2024-04-04T06:56:45.057 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:45.057+0000 7fe58d600640 1 -- 172.21.15.72:0/3902837597 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fe57000bb30 con 0x7fe5700039e0 2024-04-04T06:56:45.057 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:45.057+0000 7fe58d600640 1 -- 172.21.15.72:0/3902837597 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fe57000bd30 con 0x7fe5900b44e0 2024-04-04T06:56:45.057 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:45.057+0000 7fe58f400640 1 --2- 172.21.15.72:0/3902837597 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe570004d40 0x7fe5700051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:45.057 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:45.057+0000 7fe58ea00640 1 --2- 172.21.15.72:0/3902837597 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe5700039e0 0x7fe570003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:45.057 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:45.057+0000 7fe58f400640 1 -- 172.21.15.72:0/3902837597 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe5900b44e0 msgr2=0x7fe570004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:56:45.057 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:45.057+0000 7fe58f400640 1 --2- 172.21.15.72:0/3902837597 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe5900b44e0 0x7fe570004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:45.057 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:45.058+0000 7fe58f400640 1 -- 172.21.15.72:0/3902837597 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe5700039e0 msgr2=0x7fe570003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:56:45.058 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:45.058+0000 7fe58f400640 1 --2- 172.21.15.72:0/3902837597 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe5700039e0 0x7fe570003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:45.058 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:45.058+0000 7fe58f400640 1 -- 172.21.15.72:0/3902837597 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe570003520 con 0x7fe570004d40 2024-04-04T06:56:45.059 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:45.059+0000 7fe58f400640 1 --2- 172.21.15.72:0/3902837597 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe570004d40 0x7fe5700051c0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fe588009a90 tx=0x7fe570005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c064e769bf9936d5 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:45.059 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:45.059+0000 7fe58d600640 1 -- 172.21.15.72:0/3902837597 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe588039070 con 0x7fe570004d40 2024-04-04T06:56:45.059 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:45.059+0000 7fe58d600640 1 -- 172.21.15.72:0/3902837597 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe58802c6b0 con 0x7fe570004d40 2024-04-04T06:56:45.059 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:45.059+0000 7fe58d600640 1 -- 172.21.15.72:0/3902837597 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe588009690 con 0x7fe570004d40 2024-04-04T06:56:45.059 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:45.059+0000 7fe595e00640 1 -- 172.21.15.72:0/3902837597 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe570004d40 msgr2=0x7fe5700051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:45.059 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:45.059+0000 7fe595e00640 1 --2- 172.21.15.72:0/3902837597 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe570004d40 0x7fe5700051c0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fe588009a90 tx=0x7fe570005830 comp rx=0 tx=0).stop 2024-04-04T06:56:45.059 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:45.059+0000 7fe58f400640 1 -- 172.21.15.72:0/3902837597 reap_dead start 2024-04-04T06:56:45.059 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:45.060+0000 7fe595e00640 1 -- 172.21.15.72:0/3902837597 shutdown_connections 2024-04-04T06:56:45.059 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:45.060+0000 7fe595e00640 1 -- 172.21.15.72:0/3902837597 >> 172.21.15.72:0/3902837597 conn(0x7fe5900d2110 msgr2=0x7fe5900d2520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:56:45.059 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:45.060+0000 7fe595e00640 1 -- 172.21.15.72:0/3902837597 shutdown_connections 2024-04-04T06:56:45.059 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:45.060+0000 7fe595e00640 1 -- 172.21.15.72:0/3902837597 wait complete. 2024-04-04T06:56:45.060 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:45.061+0000 7fe595e00640 1 Processor -- start 2024-04-04T06:56:45.060 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:45.062+0000 7fe595e00640 1 -- start start 2024-04-04T06:56:45.063 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:45.063+0000 7fe595e00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe570004d40 0x7fe59015b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:45.063 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:45.063+0000 7fe595e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe5900caf90 0x7fe5900cd4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:45.063 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:45.063+0000 7fe595e00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe5900cda00 0x7fe5900c91c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:45.064 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:45.063+0000 7fe595e00640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fe59015c3f0 con 0x7fe5900cda00 2024-04-04T06:56:45.064 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:45.063+0000 7fe595e00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fe59015c270 con 0x7fe570004d40 2024-04-04T06:56:45.064 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:45.063+0000 7fe595e00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fe5900c6fd0 con 0x7fe5900caf90 2024-04-04T06:56:45.064 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:45.064+0000 7fe58f400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe5900cda00 0x7fe5900c91c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:45.064 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:45.064+0000 7fe58f400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe5900cda00 0x7fe5900c91c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:34768/0 (socket says 172.21.15.72:34768) 2024-04-04T06:56:45.064 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:45.064+0000 7fe58f400640 1 -- 172.21.15.72:0/3627654541 learned_addr learned my addr 172.21.15.72:0/3627654541 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:56:45.064 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:45.064+0000 7fe58ea00640 1 --2- 172.21.15.72:0/3627654541 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe570004d40 0x7fe59015b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:45.064 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:45.064+0000 7fe58e000640 1 --2- 172.21.15.72:0/3627654541 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe5900caf90 0x7fe5900cd4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:45.064 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:45.064+0000 7fe58f400640 1 -- 172.21.15.72:0/3627654541 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe5900caf90 msgr2=0x7fe5900cd4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:45.064 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:45.064+0000 7fe58f400640 1 --2- 172.21.15.72:0/3627654541 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe5900caf90 0x7fe5900cd4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:45.064 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:45.064+0000 7fe58f400640 1 -- 172.21.15.72:0/3627654541 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe570004d40 msgr2=0x7fe59015b3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:45.064 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:45.064+0000 7fe58f400640 1 --2- 172.21.15.72:0/3627654541 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe570004d40 0x7fe59015b3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:45.064 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:45.064+0000 7fe58f400640 1 -- 172.21.15.72:0/3627654541 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5900c9ef0 con 0x7fe5900cda00 2024-04-04T06:56:45.064 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:45.064+0000 7fe58e000640 1 --2- 172.21.15.72:0/3627654541 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe5900caf90 0x7fe5900cd4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-04T06:56:45.064 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:45.064+0000 7fe58ea00640 1 --2- 172.21.15.72:0/3627654541 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe570004d40 0x7fe59015b3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-04T06:56:45.065 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:45.064+0000 7fe58f400640 1 --2- 172.21.15.72:0/3627654541 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe5900cda00 0x7fe5900c91c0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fe588009bb0 tx=0x7fe588004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:45.065 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:45.065+0000 7fe587400640 1 -- 172.21.15.72:0/3627654541 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe588039070 con 0x7fe5900cda00 2024-04-04T06:56:45.065 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:45.065+0000 7fe587400640 1 -- 172.21.15.72:0/3627654541 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe588043070 con 0x7fe5900cda00 2024-04-04T06:56:45.065 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:45.065+0000 7fe595e00640 1 -- 172.21.15.72:0/3627654541 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5900ca1d0 con 0x7fe5900cda00 2024-04-04T06:56:45.065 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:45.065+0000 7fe587400640 1 -- 172.21.15.72:0/3627654541 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe588009690 con 0x7fe5900cda00 2024-04-04T06:56:45.065 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:45.065+0000 7fe595e00640 1 -- 172.21.15.72:0/3627654541 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5900ca790 con 0x7fe5900cda00 2024-04-04T06:56:45.065 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:45.066+0000 7fe595e00640 1 -- 172.21.15.72:0/3627654541 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe590075840 con 0x7fe5900cda00 2024-04-04T06:56:45.065 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:45.067+0000 7fe587400640 1 -- 172.21.15.72:0/3627654541 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe588003850 con 0x7fe5900cda00 2024-04-04T06:56:45.066 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:45.068+0000 7fe587400640 1 --2- 172.21.15.72:0/3627654541 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fe56c06c920 0x7fe56c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:45.066 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:45.068+0000 7fe587400640 1 -- 172.21.15.72:0/3627654541 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fe5880acc60 con 0x7fe5900cda00 2024-04-04T06:56:45.066 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:45.068+0000 7fe58ea00640 1 --2- 172.21.15.72:0/3627654541 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fe56c06c920 0x7fe56c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:45.067 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:45.069+0000 7fe58ea00640 1 --2- 172.21.15.72:0/3627654541 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fe56c06c920 0x7fe56c06ede0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fe580001200 tx=0x7fe580001110 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:45.071 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:45.072+0000 7fe587400640 1 -- 172.21.15.72:0/3627654541 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fe58804c020 con 0x7fe5900cda00 2024-04-04T06:56:45.272 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:45.273+0000 7fe595e00640 1 -- 172.21.15.72:0/3627654541 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe59006dab0 con 0x7fe5900cda00 2024-04-04T06:56:45.274 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:45.275+0000 7fe587400640 1 -- 172.21.15.72:0/3627654541 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16581 (secure 0 0 0) 0x7fe58807aff0 con 0x7fe5900cda00 2024-04-04T06:56:45.274 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T06:56:45.274 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":20,"fsid":"6708bac2-4f50-49b5-87a9-c390fd333eb3","created":"2024-04-04T06:56:04.282498+0000","modified":"2024-04-04T06:56:30.007371+0000","last_up_change":"2024-04-04T06:56:16.716089+0000","last_in_change":"2024-04-04T06:56:07.768593+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-04T06:56:17.421685+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-04T06:56:26.822661+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-04T06:56:27.429816+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7c345991-5af8-4dc6-a481-28610c40e128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":3889813953},{"type":"v1","addr":"172.21.15.72:6818","nonce":3889813953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":3889813953},{"type":"v1","addr":"172.21.15.72:6821","nonce":3889813953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":3889813953},{"type":"v1","addr":"172.21.15.72:6826","nonce":3889813953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":3889813953},{"type":"v1","addr":"172.21.15.72:6823","nonce":3889813953}]},"public_addr":"172.21.15.72:6818/3889813953","cluster_addr":"172.21.15.72:6821/3889813953","heartbeat_back_addr":"172.21.15.72:6826/3889813953","heartbeat_front_addr":"172.21.15.72:6823/3889813953","state":["exists","up"]},{"osd":1,"uuid":"1b3f7ab2-a56c-488d-a89a-1f3572361c95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":3101663154},{"type":"v1","addr":"172.21.15.72:6801","nonce":3101663154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":3101663154},{"type":"v1","addr":"172.21.15.72:6803","nonce":3101663154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":3101663154},{"type":"v1","addr":"172.21.15.72:6807","nonce":3101663154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":3101663154},{"type":"v1","addr":"172.21.15.72:6805","nonce":3101663154}]},"public_addr":"172.21.15.72:6801/3101663154","cluster_addr":"172.21.15.72:6803/3101663154","heartbeat_back_addr":"172.21.15.72:6807/3101663154","heartbeat_front_addr":"172.21.15.72:6805/3101663154","state":["exists","up"]},{"osd":2,"uuid":"fc9aa512-53df-40d7-ba04-3e6b7dcd1e34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":235374192},{"type":"v1","addr":"172.21.15.72:6809","nonce":235374192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":235374192},{"type":"v1","addr":"172.21.15.72:6811","nonce":235374192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":235374192},{"type":"v1","addr":"172.21.15.72:6815","nonce":235374192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":235374192},{"type":"v1","addr":"172.21.15.72:6813","nonce":235374192}]},"public_addr":"172.21.15.72:6809/235374192","cluster_addr":"172.21.15.72:6811/235374192","heartbeat_back_addr":"172.21.15.72:6815/235374192","heartbeat_front_addr":"172.21.15.72:6813/235374192","state":["exists","up"]},{"osd":3,"uuid":"b4f63eed-dc5b-4aba-bb50-de46eb41492b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6817","nonce":2806631742},{"type":"v1","addr":"172.21.15.72:6819","nonce":2806631742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":2806631742},{"type":"v1","addr":"172.21.15.72:6827","nonce":2806631742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":2806631742},{"type":"v1","addr":"172.21.15.72:6831","nonce":2806631742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":2806631742},{"type":"v1","addr":"172.21.15.72:6829","nonce":2806631742}]},"public_addr":"172.21.15.72:6819/2806631742","cluster_addr":"172.21.15.72:6827/2806631742","heartbeat_back_addr":"172.21.15.72:6831/2806631742","heartbeat_front_addr":"172.21.15.72:6829/2806631742","state":["exists","up"]},{"osd":4,"uuid":"9e985ef8-d711-4172-9286-c54e560895d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":4293536423},{"type":"v1","addr":"172.21.15.117:6825","nonce":4293536423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":4293536423},{"type":"v1","addr":"172.21.15.117:6827","nonce":4293536423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":4293536423},{"type":"v1","addr":"172.21.15.117:6831","nonce":4293536423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":4293536423},{"type":"v1","addr":"172.21.15.117:6829","nonce":4293536423}]},"public_addr":"172.21.15.117:6825/4293536423","cluster_addr":"172.21.15.117:6827/4293536423","heartbeat_back_addr":"172.21.15.117:6831/4293536423","heartbeat_front_addr":"172.21.15.117:6829/4293536423","state":["exists","up"]},{"osd":5,"uuid":"3e9f082b-8d7d-455f-8a96-66d0b4857125","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":684971679},{"type":"v1","addr":"172.21.15.117:6801","nonce":684971679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":684971679},{"type":"v1","addr":"172.21.15.117:6803","nonce":684971679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":684971679},{"type":"v1","addr":"172.21.15.117:6807","nonce":684971679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":684971679},{"type":"v1","addr":"172.21.15.117:6805","nonce":684971679}]},"public_addr":"172.21.15.117:6801/684971679","cluster_addr":"172.21.15.117:6803/684971679","heartbeat_back_addr":"172.21.15.117:6807/684971679","heartbeat_front_addr":"172.21.15.117:6805/684971679","state":["exists","up"]},{"osd":6,"uuid":"bcdafa9f-a870-4398-a38d-ab7697676473","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":2781186528},{"type":"v1","addr":"172.21.15.117:6809","nonce":2781186528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":2781186528},{"type":"v1","addr":"172.21.15.117:6811","nonce":2781186528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":2781186528},{"type":"v1","addr":"172.21.15.117:6815","nonce":2781186528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":2781186528},{"type":"v1","addr":"172.21.15.117:6813","nonce":2781186528}]},"public_addr":"172.21.15.117:6809/2781186528","cluster_addr":"172.21.15.117:6811/2781186528","heartbeat_back_addr":"172.21.15.117:6815/2781186528","heartbeat_front_addr":"172.21.15.117:6813/2781186528","state":["exists","up"]},{"osd":7,"uuid":"b68ec562-ff35-4d2d-a733-c896f8920cfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":617469882},{"type":"v1","addr":"172.21.15.117:6817","nonce":617469882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":617469882},{"type":"v1","addr":"172.21.15.117:6819","nonce":617469882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":617469882},{"type":"v1","addr":"172.21.15.117:6823","nonce":617469882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":617469882},{"type":"v1","addr":"172.21.15.117:6821","nonce":617469882}]},"public_addr":"172.21.15.117:6817/617469882","cluster_addr":"172.21.15.117:6819/617469882","heartbeat_back_addr":"172.21.15.117:6823/617469882","heartbeat_front_addr":"172.21.15.117:6821/617469882","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.347700+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.296619+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.361345+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.093323+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:12.857605+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:12.816090+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.083163+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.121639+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-04T06:56:45.277 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:45.278+0000 7fe595e00640 1 -- 172.21.15.72:0/3627654541 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fe56c06c920 msgr2=0x7fe56c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:45.277 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:45.278+0000 7fe595e00640 1 --2- 172.21.15.72:0/3627654541 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fe56c06c920 0x7fe56c06ede0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fe580001200 tx=0x7fe580001110 comp rx=0 tx=0).stop 2024-04-04T06:56:45.277 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:45.278+0000 7fe595e00640 1 -- 172.21.15.72:0/3627654541 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe5900cda00 msgr2=0x7fe5900c91c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:45.277 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:45.278+0000 7fe595e00640 1 --2- 172.21.15.72:0/3627654541 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe5900cda00 0x7fe5900c91c0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fe588009bb0 tx=0x7fe588004730 comp rx=0 tx=0).stop 2024-04-04T06:56:45.277 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:45.278+0000 7fe595e00640 1 -- 172.21.15.72:0/3627654541 shutdown_connections 2024-04-04T06:56:45.277 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:45.278+0000 7fe595e00640 1 --2- 172.21.15.72:0/3627654541 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fe56c06c920 0x7fe56c06ede0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:45.278 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:45.278+0000 7fe595e00640 1 --2- 172.21.15.72:0/3627654541 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe5900cda00 0x7fe5900c91c0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:45.278 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:45.278+0000 7fe595e00640 1 --2- 172.21.15.72:0/3627654541 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe5900caf90 0x7fe5900cd4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:45.278 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:45.278+0000 7fe595e00640 1 --2- 172.21.15.72:0/3627654541 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe570004d40 0x7fe59015b3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:45.278 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:45.278+0000 7fe595e00640 1 -- 172.21.15.72:0/3627654541 >> 172.21.15.72:0/3627654541 conn(0x7fe5900d2110 msgr2=0x7fe5901477f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:56:45.278 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:45.278+0000 7fe595e00640 1 -- 172.21.15.72:0/3627654541 shutdown_connections 2024-04-04T06:56:45.278 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:45.278+0000 7fe595e00640 1 -- 172.21.15.72:0/3627654541 wait complete. 2024-04-04T06:56:45.295 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-04T06:56:45.528 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:45.529+0000 7f6657200640 1 Processor -- start 2024-04-04T06:56:45.528 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:45.529+0000 7f6657200640 1 -- start start 2024-04-04T06:56:45.529 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:45.530+0000 7f6657200640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f66580d2e30 0x7f66580d3290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:45.529 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:45.531+0000 7f6657200640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f66580d37d0 con 0x7f665815e5a0 2024-04-04T06:56:45.529 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:45.531+0000 7f6657200640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f66580cf7f0 con 0x7f66580d08e0 2024-04-04T06:56:45.529 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:45.531+0000 7f6657200640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f66580cfad0 con 0x7f66580d2e30 2024-04-04T06:56:45.529 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:45.531+0000 7f6655e00640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f665815e5a0 0x7f66580b75c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:39652/0 (socket says 172.21.15.72:39652) 2024-04-04T06:56:45.530 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:45.531+0000 7f6655e00640 1 -- 172.21.15.72:0/382396546 learned_addr learned my addr 172.21.15.72:0/382396546 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-04-04T06:56:45.530 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:45.531+0000 7f664fe00640 1 --2- 172.21.15.72:0/382396546 >> v2:172.21.15.72:3300/0 conn(0x7f66580d2e30 0x7f66580d3290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:45.530 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:45.531+0000 7f6655400640 1 -- 172.21.15.72:0/382396546 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4083620878 0 0) 0x7f66580d37d0 con 0x7f665815e5a0 2024-04-04T06:56:45.530 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:45.531+0000 7f6655400640 1 -- 172.21.15.72:0/382396546 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f663c003520 con 0x7f665815e5a0 2024-04-04T06:56:45.531 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:45.531+0000 7f664fe00640 1 -- 172.21.15.72:0/382396546 >> v1:172.21.15.117:6789/0 conn(0x7f66580d08e0 legacy=0x7f66580d0d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:56:45.531 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:45.531+0000 7f664fe00640 1 -- 172.21.15.72:0/382396546 >> v1:172.21.15.72:6789/0 conn(0x7f665815e5a0 legacy=0x7f66580b75c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:45.531 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:45.531+0000 7f664fe00640 1 -- 172.21.15.72:0/382396546 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66580d2350 con 0x7f66580d2e30 2024-04-04T06:56:45.532 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:45.532+0000 7f664fe00640 1 --2- 172.21.15.72:0/382396546 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f66580d2e30 0x7f66580d3290 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f66400097a0 tx=0x7f664002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67861b140ca0c237 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:45.532 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:45.533+0000 7f6655400640 1 -- 172.21.15.72:0/382396546 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6640035020 con 0x7f66580d2e30 2024-04-04T06:56:45.532 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:45.533+0000 7f6655400640 1 -- 172.21.15.72:0/382396546 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6640031830 con 0x7f66580d2e30 2024-04-04T06:56:45.532 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:45.533+0000 7f6655400640 1 -- 172.21.15.72:0/382396546 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6640031be0 con 0x7f66580d2e30 2024-04-04T06:56:45.532 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:45.533+0000 7f6657200640 1 -- 172.21.15.72:0/382396546 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f66580d2e30 msgr2=0x7f66580d3290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:45.532 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:45.533+0000 7f6657200640 1 --2- 172.21.15.72:0/382396546 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f66580d2e30 0x7f66580d3290 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f66400097a0 tx=0x7f664002b8d0 comp rx=0 tx=0).stop 2024-04-04T06:56:45.532 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:45.533+0000 7f6657200640 1 -- 172.21.15.72:0/382396546 shutdown_connections 2024-04-04T06:56:45.532 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:45.533+0000 7f6657200640 1 --2- 172.21.15.72:0/382396546 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f66580d2e30 0x7f66580d3290 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:45.533 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:45.533+0000 7f6657200640 1 -- 172.21.15.72:0/382396546 >> 172.21.15.72:0/382396546 conn(0x7f665806b890 msgr2=0x7f665806bca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:56:45.533 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:45.533+0000 7f6657200640 1 -- 172.21.15.72:0/382396546 shutdown_connections 2024-04-04T06:56:45.533 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:45.533+0000 7f6657200640 1 -- 172.21.15.72:0/382396546 wait complete. 2024-04-04T06:56:45.534 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:45.536+0000 7f6657200640 1 Processor -- start 2024-04-04T06:56:45.535 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:45.536+0000 7f6657200640 1 -- start start 2024-04-04T06:56:45.537 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:45.538+0000 7f6657200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f66580d08e0 0x7f6658153740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:45.537 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:45.538+0000 7f6657200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f66580d2e30 0x7f66580ca540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:45.537 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:45.538+0000 7f6657200640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f665815e5a0 0x7f665815cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:45.537 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:45.538+0000 7f6657200640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f66580b7cd0 con 0x7f665815e5a0 2024-04-04T06:56:45.537 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:45.538+0000 7f6657200640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f66580d2910 con 0x7f66580d2e30 2024-04-04T06:56:45.537 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:45.538+0000 7f6657200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f665815e980 con 0x7f66580d08e0 2024-04-04T06:56:45.538 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:45.538+0000 7f6656800640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f665815e5a0 0x7f665815cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:45.538 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:45.538+0000 7f6656800640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f665815e5a0 0x7f665815cbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:34780/0 (socket says 172.21.15.72:34780) 2024-04-04T06:56:45.538 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:45.538+0000 7f6656800640 1 -- 172.21.15.72:0/1269146778 learned_addr learned my addr 172.21.15.72:0/1269146778 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:56:45.538 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:45.538+0000 7f6655e00640 1 --2- 172.21.15.72:0/1269146778 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f66580d08e0 0x7f6658153740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:45.538 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:45.539+0000 7f664fe00640 1 --2- 172.21.15.72:0/1269146778 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f66580d2e30 0x7f66580ca540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:45.538 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:45.539+0000 7f6656800640 1 -- 172.21.15.72:0/1269146778 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f66580d08e0 msgr2=0x7f6658153740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:45.538 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:45.539+0000 7f6656800640 1 --2- 172.21.15.72:0/1269146778 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f66580d08e0 0x7f6658153740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:45.538 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:45.539+0000 7f6656800640 1 -- 172.21.15.72:0/1269146778 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f66580d2e30 msgr2=0x7f66580ca540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:45.538 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:45.539+0000 7f6656800640 1 --2- 172.21.15.72:0/1269146778 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f66580d2e30 0x7f66580ca540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:45.538 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:45.539+0000 7f6656800640 1 -- 172.21.15.72:0/1269146778 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f665815f0d0 con 0x7f665815e5a0 2024-04-04T06:56:45.538 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:45.539+0000 7f664fe00640 1 --2- 172.21.15.72:0/1269146778 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f66580d2e30 0x7f66580ca540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-04T06:56:45.538 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:45.539+0000 7f6656800640 1 --2- 172.21.15.72:0/1269146778 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f665815e5a0 0x7f665815cbe0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f665000c700 tx=0x7f665000cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:45.539 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:45.539+0000 7f664e000640 1 -- 172.21.15.72:0/1269146778 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6650016020 con 0x7f665815e5a0 2024-04-04T06:56:45.539 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:45.539+0000 7f664e000640 1 -- 172.21.15.72:0/1269146778 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f665000aa50 con 0x7f665815e5a0 2024-04-04T06:56:45.539 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:45.539+0000 7f6657200640 1 -- 172.21.15.72:0/1269146778 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f665815f3b0 con 0x7f665815e5a0 2024-04-04T06:56:45.539 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:45.539+0000 7f664e000640 1 -- 172.21.15.72:0/1269146778 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f665000ce10 con 0x7f665815e5a0 2024-04-04T06:56:45.539 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:45.539+0000 7f6657200640 1 -- 172.21.15.72:0/1269146778 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f665815f970 con 0x7f665815e5a0 2024-04-04T06:56:45.540 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:45.541+0000 7f6657200640 1 -- 172.21.15.72:0/1269146778 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66580756c0 con 0x7f665815e5a0 2024-04-04T06:56:45.540 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:45.541+0000 7f664e000640 1 -- 172.21.15.72:0/1269146778 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6650019020 con 0x7f665815e5a0 2024-04-04T06:56:45.541 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:45.542+0000 7f664e000640 1 --2- 172.21.15.72:0/1269146778 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f663406c8f0 0x7f663406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:45.541 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:45.542+0000 7f664e000640 1 -- 172.21.15.72:0/1269146778 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f665008bec0 con 0x7f665815e5a0 2024-04-04T06:56:45.541 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:45.542+0000 7f6655e00640 1 --2- 172.21.15.72:0/1269146778 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f663406c8f0 0x7f663406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:45.541 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:45.543+0000 7f6655e00640 1 --2- 172.21.15.72:0/1269146778 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f663406c8f0 0x7f663406edb0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f6648005880 tx=0x7f6648009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:45.549 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:45.550+0000 7f664e000640 1 -- 172.21.15.72:0/1269146778 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f6650020020 con 0x7f665815e5a0 2024-04-04T06:56:45.959 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:45.961+0000 7f6657200640 1 -- 172.21.15.72:0/1269146778 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f66580d2090 con 0x7f665815e5a0 2024-04-04T06:56:45.960 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:45.962+0000 7f664e000640 1 -- 172.21.15.72:0/1269146778 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5181 (secure 0 0 0) 0x7f665005a2e0 con 0x7f665815e5a0 2024-04-04T06:56:45.961 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T06:56:45.961 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6834/3570831137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":3570831137},{"type":"v1","addr":"172.21.15.117:6834","nonce":3570831137}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4238,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/1683311500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6833","nonce":1683311500},{"type":"v1","addr":"172.21.15.117:6835","nonce":1683311500}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6835/4150347227","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":4150347227},{"type":"v1","addr":"172.21.15.72:6835","nonce":4150347227}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-04T06:56:28.435113+0000","modified":"2024-04-04T06:56:31.557618+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4263},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4263":{"gid":4263,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.72:6837/2958027127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6836","nonce":2958027127},{"type":"v1","addr":"172.21.15.72:6837","nonce":2958027127}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4263,"qdb_cluster":[4263]},"id":1}]} 2024-04-04T06:56:45.961 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 8 2024-04-04T06:56:45.964 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:45.965+0000 7f6657200640 1 -- 172.21.15.72:0/1269146778 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f663406c8f0 msgr2=0x7f663406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:45.964 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:45.965+0000 7f6657200640 1 --2- 172.21.15.72:0/1269146778 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f663406c8f0 0x7f663406edb0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f6648005880 tx=0x7f6648009040 comp rx=0 tx=0).stop 2024-04-04T06:56:45.964 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:45.965+0000 7f6657200640 1 -- 172.21.15.72:0/1269146778 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f665815e5a0 msgr2=0x7f665815cbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:45.964 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:45.965+0000 7f6657200640 1 --2- 172.21.15.72:0/1269146778 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f665815e5a0 0x7f665815cbe0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f665000c700 tx=0x7f665000cbc0 comp rx=0 tx=0).stop 2024-04-04T06:56:45.964 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:45.965+0000 7f6657200640 1 -- 172.21.15.72:0/1269146778 shutdown_connections 2024-04-04T06:56:45.964 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:45.965+0000 7f6657200640 1 --2- 172.21.15.72:0/1269146778 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f663406c8f0 0x7f663406edb0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:45.965 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:45.965+0000 7f6657200640 1 --2- 172.21.15.72:0/1269146778 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f665815e5a0 0x7f665815cbe0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:45.965 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:45.965+0000 7f6657200640 1 --2- 172.21.15.72:0/1269146778 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f66580d2e30 0x7f66580ca540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:45.965 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:45.965+0000 7f6657200640 1 --2- 172.21.15.72:0/1269146778 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f66580d08e0 0x7f6658153740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:45.965 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:45.965+0000 7f6657200640 1 -- 172.21.15.72:0/1269146778 >> 172.21.15.72:0/1269146778 conn(0x7f665806b890 msgr2=0x7f66580b4bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:56:45.965 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:45.966+0000 7f6657200640 1 -- 172.21.15.72:0/1269146778 shutdown_connections 2024-04-04T06:56:45.965 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:45.966+0000 7f6657200640 1 -- 172.21.15.72:0/1269146778 wait complete. 2024-04-04T06:56:46.383 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-04T06:56:28.435113+0000', 'modified': '2024-04-04T06:56:31.557618+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4263}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4263': {'gid': 4263, 'name': 'c', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.72:6837/2958027127', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.72:6836', 'nonce': 2958027127}, {'type': 'v1', 'addr': '172.21.15.72:6837', 'nonce': 2958027127}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4263, 'qdb_cluster': [4263]} 2024-04-04T06:56:46.383 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-04T06:56:46.383 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-04-04T06:56:46.594 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.595+0000 7f0683800640 1 Processor -- start 2024-04-04T06:56:46.594 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.595+0000 7f0683800640 1 -- start start 2024-04-04T06:56:46.596 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.597+0000 7f0683800640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f067c0b9d10 0x7f067c0cf0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:46.596 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.597+0000 7f0683800640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f067c0cf620 0x7f067c0d2d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:46.596 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.597+0000 7f0683800640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f067c06cd30 con 0x7f067c15e590 2024-04-04T06:56:46.596 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.597+0000 7f0683800640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f067c0cfa90 con 0x7f067c0cf620 2024-04-04T06:56:46.596 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.597+0000 7f0683800640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f067c06d010 con 0x7f067c0b9d10 2024-04-04T06:56:46.596 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.597+0000 7f0681800640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f067c0cf620 0x7f067c0d2d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:46.597 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.597+0000 7f0681800640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f067c0cf620 0x7f067c0d2d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:34790/0 (socket says 172.21.15.72:34790) 2024-04-04T06:56:46.597 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.597+0000 7f0681800640 1 -- 172.21.15.72:0/21530540 learned_addr learned my addr 172.21.15.72:0/21530540 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:56:46.597 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.597+0000 7f0673e00640 1 --2- 172.21.15.72:0/21530540 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f067c0b9d10 0x7f067c0cf0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:46.597 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.598+0000 7f0681800640 1 -- 172.21.15.72:0/21530540 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f067c0b9d10 msgr2=0x7f067c0cf0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:56:46.597 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.598+0000 7f0681800640 1 --2- 172.21.15.72:0/21530540 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f067c0b9d10 0x7f067c0cf0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:46.597 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.598+0000 7f0681800640 1 -- 172.21.15.72:0/21530540 >> v1:172.21.15.117:6789/0 conn(0x7f067c15e590 legacy=0x7f067c06c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:46.597 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.598+0000 7f0681800640 1 -- 172.21.15.72:0/21530540 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f067c06d2f0 con 0x7f067c0cf620 2024-04-04T06:56:46.598 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.599+0000 7f0681800640 1 --2- 172.21.15.72:0/21530540 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f067c0cf620 0x7f067c0d2d10 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f0674009870 tx=0x7f067402b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb72f5e103110a19 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:46.598 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.599+0000 7f067be00640 1 -- 172.21.15.72:0/21530540 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0674034070 con 0x7f067c0cf620 2024-04-04T06:56:46.598 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.599+0000 7f067be00640 1 -- 172.21.15.72:0/21530540 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0674030840 con 0x7f067c0cf620 2024-04-04T06:56:46.598 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.599+0000 7f067be00640 1 -- 172.21.15.72:0/21530540 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0674030c10 con 0x7f067c0cf620 2024-04-04T06:56:46.599 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.599+0000 7f0683800640 1 -- 172.21.15.72:0/21530540 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f067c0cf620 msgr2=0x7f067c0d2d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:46.599 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.599+0000 7f0683800640 1 --2- 172.21.15.72:0/21530540 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f067c0cf620 0x7f067c0d2d10 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f0674009870 tx=0x7f067402b980 comp rx=0 tx=0).stop 2024-04-04T06:56:46.599 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.600+0000 7f0683800640 1 -- 172.21.15.72:0/21530540 shutdown_connections 2024-04-04T06:56:46.599 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.600+0000 7f0683800640 1 --2- 172.21.15.72:0/21530540 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f067c0cf620 0x7f067c0d2d10 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:46.599 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.600+0000 7f0683800640 1 --2- 172.21.15.72:0/21530540 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f067c0b9d10 0x7f067c0cf0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:46.599 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.600+0000 7f0683800640 1 -- 172.21.15.72:0/21530540 >> 172.21.15.72:0/21530540 conn(0x7f067c0d0f70 msgr2=0x7f067c0d1380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:56:46.599 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.600+0000 7f0683800640 1 -- 172.21.15.72:0/21530540 shutdown_connections 2024-04-04T06:56:46.599 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.600+0000 7f0683800640 1 -- 172.21.15.72:0/21530540 wait complete. 2024-04-04T06:56:46.600 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.601+0000 7f0683800640 1 Processor -- start 2024-04-04T06:56:46.600 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.601+0000 7f0683800640 1 -- start start 2024-04-04T06:56:46.602 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.602+0000 7f0683800640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f067c0b9d10 0x7f067c14f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:46.602 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.602+0000 7f0683800640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f067c0cf620 0x7f067c0cc6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:46.602 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.602+0000 7f0683800640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f067c15e590 0x7f067c0cd4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:46.603 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.602+0000 7f0683800640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f067c0d3250 con 0x7f067c0cf620 2024-04-04T06:56:46.603 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.602+0000 7f0683800640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f067c15e970 con 0x7f067c15e590 2024-04-04T06:56:46.603 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.602+0000 7f0683800640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f067c0d33d0 con 0x7f067c0b9d10 2024-04-04T06:56:46.603 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.603+0000 7f0673e00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f067c0cf620 0x7f067c0cc6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:46.603 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.603+0000 7f0673e00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f067c0cf620 0x7f067c0cc6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:34792/0 (socket says 172.21.15.72:34792) 2024-04-04T06:56:46.603 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.603+0000 7f0673e00640 1 -- 172.21.15.72:0/2367648845 learned_addr learned my addr 172.21.15.72:0/2367648845 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:56:46.603 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.603+0000 7f0681800640 1 --2- 172.21.15.72:0/2367648845 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f067c15e590 0x7f067c0cd4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:46.603 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.603+0000 7f0680e00640 1 --2- 172.21.15.72:0/2367648845 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f067c0b9d10 0x7f067c14f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:46.603 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.603+0000 7f0673e00640 1 -- 172.21.15.72:0/2367648845 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f067c0b9d10 msgr2=0x7f067c14f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:46.603 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.603+0000 7f0673e00640 1 --2- 172.21.15.72:0/2367648845 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f067c0b9d10 0x7f067c14f6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:46.603 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.603+0000 7f0673e00640 1 -- 172.21.15.72:0/2367648845 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f067c15e590 msgr2=0x7f067c0cd4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:46.603 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.603+0000 7f0673e00640 1 --2- 172.21.15.72:0/2367648845 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f067c15e590 0x7f067c0cd4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:46.603 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.603+0000 7f0673e00640 1 -- 172.21.15.72:0/2367648845 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f067c15a120 con 0x7f067c0cf620 2024-04-04T06:56:46.603 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.603+0000 7f0681800640 1 --2- 172.21.15.72:0/2367648845 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f067c15e590 0x7f067c0cd4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-04T06:56:46.603 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.603+0000 7f0673e00640 1 --2- 172.21.15.72:0/2367648845 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f067c0cf620 0x7f067c0cc6a0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f066400d800 tx=0x7f066400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:46.603 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.604+0000 7f0679600640 1 -- 172.21.15.72:0/2367648845 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f066400b6c0 con 0x7f067c0cf620 2024-04-04T06:56:46.604 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.604+0000 7f0679600640 1 -- 172.21.15.72:0/2367648845 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0664019070 con 0x7f067c0cf620 2024-04-04T06:56:46.604 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.604+0000 7f0683800640 1 -- 172.21.15.72:0/2367648845 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f067c14fc10 con 0x7f067c0cf620 2024-04-04T06:56:46.604 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.604+0000 7f0679600640 1 -- 172.21.15.72:0/2367648845 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f066400ba80 con 0x7f067c0cf620 2024-04-04T06:56:46.604 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.604+0000 7f0683800640 1 -- 172.21.15.72:0/2367648845 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f067c15fd50 con 0x7f067c0cf620 2024-04-04T06:56:46.605 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.607+0000 7f0679600640 1 -- 172.21.15.72:0/2367648845 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f066400bc20 con 0x7f067c0cf620 2024-04-04T06:56:46.606 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.608+0000 7f06865e5740 1 Processor -- start 2024-04-04T06:56:46.606 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.608+0000 7f06865e5740 1 -- start start 2024-04-04T06:56:46.607 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.609+0000 7f0679600640 1 --2- 172.21.15.72:0/2367648845 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f065806c920 0x7f065806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:46.607 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.609+0000 7f0679600640 1 -- 172.21.15.72:0/2367648845 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f066408bf70 con 0x7f067c0cf620 2024-04-04T06:56:46.607 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.609+0000 7f0681800640 1 --2- 172.21.15.72:0/2367648845 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f065806c920 0x7f065806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:46.609 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.609+0000 7f06865e5740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x559e045c1130 0x559e045940d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:46.609 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.609+0000 7f06865e5740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559e045c1510 0x559e045c3ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:46.609 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.609+0000 7f06865e5740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x559e04594610 0x559e045c4400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:46.609 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.609+0000 7f06865e5740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x559e0455bab0 con 0x559e045c1130 2024-04-04T06:56:46.609 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.609+0000 7f06865e5740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x559e044fdfa0 con 0x559e045c1510 2024-04-04T06:56:46.609 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.609+0000 7f06865e5740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x559e044a6560 con 0x559e04594610 2024-04-04T06:56:46.609 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.610+0000 7f0680e00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x559e045c1130 0x559e045940d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:46.609 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.610+0000 7f0680e00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x559e045c1130 0x559e045940d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:34802/0 (socket says 172.21.15.72:34802) 2024-04-04T06:56:46.609 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.610+0000 7f0681800640 1 --2- 172.21.15.72:0/2367648845 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f065806c920 0x7f065806ede0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f0674036000 tx=0x7f067403b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:46.609 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.610+0000 7f0680e00640 1 -- 172.21.15.72:0/3776415881 learned_addr learned my addr 172.21.15.72:0/3776415881 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:56:46.609 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.610+0000 7f0680e00640 1 -- 172.21.15.72:0/3776415881 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x559e04594610 msgr2=0x559e045c4400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:56:46.610 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.610+0000 7f0680e00640 1 --2- 172.21.15.72:0/3776415881 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x559e04594610 0x559e045c4400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:46.610 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.610+0000 7f0673e00640 1 --2- 172.21.15.72:0/3776415881 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559e045c1510 0x559e045c3ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:46.610 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.610+0000 7f0680e00640 1 -- 172.21.15.72:0/3776415881 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559e045c1510 msgr2=0x559e045c3ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:56:46.610 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.610+0000 7f0680e00640 1 --2- 172.21.15.72:0/3776415881 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559e045c1510 0x559e045c3ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:46.610 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.610+0000 7f0680e00640 1 -- 172.21.15.72:0/3776415881 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e042122d0 con 0x559e045c1130 2024-04-04T06:56:46.610 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.610+0000 7f0680e00640 1 --2- 172.21.15.72:0/3776415881 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x559e045c1130 0x559e045940d0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f066c001d00 tx=0x7f066c0021c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77e02b705d08e33a server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:46.610 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.610+0000 7f0671600640 1 -- 172.21.15.72:0/3776415881 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f066c016020 con 0x559e045c1130 2024-04-04T06:56:46.610 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.610+0000 7f0671600640 1 -- 172.21.15.72:0/3776415881 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f066c00dcf0 con 0x559e045c1130 2024-04-04T06:56:46.610 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.610+0000 7f0671600640 1 -- 172.21.15.72:0/3776415881 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f066c0125f0 con 0x559e045c1130 2024-04-04T06:56:46.611 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.611+0000 7f06865e5740 1 -- 172.21.15.72:0/3776415881 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x559e045c1130 msgr2=0x559e045940d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:46.611 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.611+0000 7f06865e5740 1 --2- 172.21.15.72:0/3776415881 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x559e045c1130 0x559e045940d0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f066c001d00 tx=0x7f066c0021c0 comp rx=0 tx=0).stop 2024-04-04T06:56:46.611 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.611+0000 7f06865e5740 1 -- 172.21.15.72:0/3776415881 shutdown_connections 2024-04-04T06:56:46.611 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.611+0000 7f06865e5740 1 --2- 172.21.15.72:0/3776415881 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x559e04594610 0x559e045c4400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:46.611 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.611+0000 7f06865e5740 1 --2- 172.21.15.72:0/3776415881 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559e045c1510 0x559e045c3ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:46.611 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.611+0000 7f06865e5740 1 --2- 172.21.15.72:0/3776415881 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x559e045c1130 0x559e045940d0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:46.612 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.611+0000 7f06865e5740 1 -- 172.21.15.72:0/3776415881 >> 172.21.15.72:0/3776415881 conn(0x559e04596340 msgr2=0x559e045deec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:56:46.612 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.611+0000 7f06865e5740 1 -- 172.21.15.72:0/3776415881 shutdown_connections 2024-04-04T06:56:46.612 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.611+0000 7f06865e5740 1 -- 172.21.15.72:0/3776415881 wait complete. 2024-04-04T06:56:46.612 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.612+0000 7f06865e5740 1 -- start start 2024-04-04T06:56:46.612 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.612+0000 7f06865e5740 1 Processor -- start 2024-04-04T06:56:46.615 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.613+0000 7f06865e5740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x559e045c1130 0x559e045db5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:46.615 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.613+0000 7f06865e5740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559e045c1510 0x559e045dcfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:46.615 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.613+0000 7f06865e5740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x559e045dd4e0 0x559e045c5f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:46.615 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.613+0000 7f06865e5740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x559e044b9920 con 0x559e045dd4e0 2024-04-04T06:56:46.615 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.613+0000 7f06865e5740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x559e044f9f50 con 0x559e045c1510 2024-04-04T06:56:46.615 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.613+0000 7f06865e5740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x559e045988e0 con 0x559e045c1130 2024-04-04T06:56:46.615 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.613+0000 7f06865e5740 10 client.0 _ll_register_callbacks cb 0x559e044b9310 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-04T06:56:46.615 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.613+0000 7f0681800640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x559e045dd4e0 0x559e045c5f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:46.615 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.613+0000 7f0681800640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x559e045dd4e0 0x559e045c5f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:34804/0 (socket says 172.21.15.72:34804) 2024-04-04T06:56:46.615 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.613+0000 7f0681800640 1 -- 172.21.15.72:0/368004458 learned_addr learned my addr 172.21.15.72:0/368004458 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:56:46.615 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.614+0000 7f0673e00640 1 --2- 172.21.15.72:0/368004458 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559e045c1510 0x559e045dcfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:46.615 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.614+0000 7f0680e00640 1 --2- 172.21.15.72:0/368004458 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x559e045c1130 0x559e045db5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:46.615 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.614+0000 7f0681800640 1 -- 172.21.15.72:0/368004458 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x559e045c1130 msgr2=0x559e045db5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:56:46.615 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.614+0000 7f0681800640 1 --2- 172.21.15.72:0/368004458 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x559e045c1130 0x559e045db5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:46.616 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.614+0000 7f0681800640 1 -- 172.21.15.72:0/368004458 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559e045c1510 msgr2=0x559e045dcfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:56:46.616 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.614+0000 7f0681800640 1 --2- 172.21.15.72:0/368004458 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559e045c1510 0x559e045dcfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:46.616 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.614+0000 7f0681800640 1 -- 172.21.15.72:0/368004458 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559e042dc6b0 con 0x559e045dd4e0 2024-04-04T06:56:46.616 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.614+0000 7f0681800640 1 --2- 172.21.15.72:0/368004458 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x559e045dd4e0 0x559e045c5f20 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f0674009990 tx=0x7f06740046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7ac0204bcc4401a server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:46.616 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.614+0000 7f066a000640 10 client.0 ms_handle_connect on v2:172.21.15.72:3300/0 2024-04-04T06:56:46.616 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.614+0000 7f066a000640 1 -- 172.21.15.72:0/368004458 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0674052060 con 0x559e045dd4e0 2024-04-04T06:56:46.616 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.614+0000 7f066a000640 1 -- 172.21.15.72:0/368004458 <== mon.0 v2:172.21.15.72:3300/0 2 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f0674043600 con 0x559e045dd4e0 2024-04-04T06:56:46.616 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.614+0000 7f06865e5740 1 -- 172.21.15.72:0/368004458 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f066c00dcf0 con 0x559e045dd4e0 2024-04-04T06:56:46.616 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.615+0000 7f066a000640 1 -- 172.21.15.72:0/368004458 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7f0674058050 con 0x559e045dd4e0 2024-04-04T06:56:46.616 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.615+0000 7f06865e5740 10 client.4659 fetch_fsmap learned FSMap version 8 2024-04-04T06:56:46.616 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.615+0000 7f06865e5740 1 -- 172.21.15.72:0/368004458 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x559e045db090 con 0x559e045dd4e0 2024-04-04T06:56:46.616 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.615+0000 7f066a000640 1 -- 172.21.15.72:0/368004458 <== mon.0 v2:172.21.15.72:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f066c00dcf0 con 0x559e045dd4e0 2024-04-04T06:56:46.616 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.615+0000 7f066a000640 1 -- 172.21.15.72:0/368004458 <== mon.0 v2:172.21.15.72:3300/0 5 ==== fsmap(e 8) ==== 3494+0+0 (secure 0 0 0) 0x7f0674043800 con 0x559e045dd4e0 2024-04-04T06:56:46.616 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.615+0000 7f06865e5740 10 client.4659 fetch_fsmap finished waiting for FSMap version 8 2024-04-04T06:56:46.616 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.615+0000 7f06865e5740 10 client.4659 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-04T06:56:46.616 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.615+0000 7f06865e5740 20 client.4659 populate_metadata read hostname 'smithi072' 2024-04-04T06:56:46.617 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.615+0000 7f06865e5740 1 --2- 172.21.15.72:0/368004458 >> [v2:172.21.15.72:6836/2958027127,v1:172.21.15.72:6837/2958027127] conn(0x559e045c05b0 0x559e045ef330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:46.617 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.615+0000 7f06865e5740 4 client.4659 mds_command: new command op to 4263 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-04T06:56:46.617 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.615+0000 7f06865e5740 1 -- 172.21.15.72:0/368004458 --> [v2:172.21.15.72:6836/2958027127,v1:172.21.15.72:6837/2958027127] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559e0450b4e0 con 0x559e045c05b0 2024-04-04T06:56:46.617 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.615+0000 7f0680e00640 1 --2- 172.21.15.72:0/368004458 >> [v2:172.21.15.72:6836/2958027127,v1:172.21.15.72:6837/2958027127] conn(0x559e045c05b0 0x559e045ef330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:46.617 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.616+0000 7f0680e00640 1 --2- 172.21.15.72:0/368004458 >> [v2:172.21.15.72:6836/2958027127,v1:172.21.15.72:6837/2958027127] conn(0x559e045c05b0 0x559e045ef330 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fbc5ec210f0ef8ee server_cookie=d7457c64c8c11180 in_seq=0 out_seq=0 2024-04-04T06:56:46.617 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.616+0000 7f066a000640 10 client.4659 ms_handle_connect on v2:172.21.15.72:6836/2958027127 2024-04-04T06:56:46.618 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.617+0000 7f066a000640 1 -- 172.21.15.72:0/368004458 <== mds.0 v2:172.21.15.72:6836/2958027127 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x559e0450b4e0 con 0x559e045c05b0 2024-04-04T06:56:46.618 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.617+0000 7f066a000640 10 client.4659 handle_command_reply: tid=0 2024-04-04T06:56:46.618 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.617+0000 7f06865e5740 1 client.4659 shutdown 2024-04-04T06:56:46.618 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.617+0000 7f06865e5740 1 -- 172.21.15.72:0/368004458 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x559e045dd4e0 msgr2=0x559e045c5f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:46.618 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.617+0000 7f06865e5740 1 --2- 172.21.15.72:0/368004458 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x559e045dd4e0 0x559e045c5f20 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f0674009990 tx=0x7f06740046c0 comp rx=0 tx=0).stop 2024-04-04T06:56:46.619 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.617+0000 7f06865e5740 1 -- 172.21.15.72:0/368004458 shutdown_connections 2024-04-04T06:56:46.619 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.617+0000 7f06865e5740 1 --2- 172.21.15.72:0/368004458 >> [v2:172.21.15.72:6836/2958027127,v1:172.21.15.72:6837/2958027127] conn(0x559e045c05b0 0x559e045ef330 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:46.619 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.617+0000 7f06865e5740 1 --2- 172.21.15.72:0/368004458 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x559e045dd4e0 0x559e045c5f20 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:46.619 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.617+0000 7f06865e5740 1 --2- 172.21.15.72:0/368004458 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559e045c1510 0x559e045dcfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:46.619 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.617+0000 7f06865e5740 1 --2- 172.21.15.72:0/368004458 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x559e045c1130 0x559e045db5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:46.619 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.617+0000 7f06865e5740 1 -- 172.21.15.72:0/368004458 >> 172.21.15.72:0/368004458 conn(0x559e04594610 msgr2=0x559e04592ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:56:46.619 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.617+0000 7f066a000640 0 client.4659 ms_handle_reset on v2:172.21.15.72:6836/2958027127 2024-04-04T06:56:46.619 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.617+0000 7f06865e5740 1 -- 172.21.15.72:0/368004458 shutdown_connections 2024-04-04T06:56:46.619 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.617+0000 7f06865e5740 1 -- 172.21.15.72:0/368004458 wait complete. 2024-04-04T06:56:46.619 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.617+0000 7f06865e5740 20 client.4659 trim_cache size 0 max 16384 2024-04-04T06:56:46.636 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.638+0000 7f06865e5740 1 Processor -- start 2024-04-04T06:56:46.636 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.638+0000 7f06865e5740 1 -- start start 2024-04-04T06:56:46.638 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.639+0000 7f06865e5740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x559e045c1130 0x559e045c06b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:46.638 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.639+0000 7f06865e5740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559e045c1510 0x559e045d8870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:46.639 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.639+0000 7f06865e5740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x559e045dd4e0 0x559e045d8db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:46.639 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.639+0000 7f06865e5740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f067c1ff9f0 con 0x559e045dd4e0 2024-04-04T06:56:46.639 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.639+0000 7f06865e5740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f067c0cc240 con 0x559e045c1510 2024-04-04T06:56:46.639 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.639+0000 7f06865e5740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f067c15b380 con 0x559e045c1130 2024-04-04T06:56:46.639 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.640+0000 7f0681800640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x559e045dd4e0 0x559e045d8db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:46.639 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.640+0000 7f0681800640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x559e045dd4e0 0x559e045d8db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:34818/0 (socket says 172.21.15.72:34818) 2024-04-04T06:56:46.639 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.640+0000 7f0681800640 1 -- 172.21.15.72:0/2696918799 learned_addr learned my addr 172.21.15.72:0/2696918799 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:56:46.639 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.640+0000 7f0681800640 1 -- 172.21.15.72:0/2696918799 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x559e045c1130 msgr2=0x559e045c06b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:56:46.639 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.640+0000 7f0681800640 1 --2- 172.21.15.72:0/2696918799 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x559e045c1130 0x559e045c06b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:46.639 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.640+0000 7f0681800640 1 -- 172.21.15.72:0/2696918799 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559e045c1510 msgr2=0x559e045d8870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:56:46.639 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.640+0000 7f0681800640 1 --2- 172.21.15.72:0/2696918799 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559e045c1510 0x559e045d8870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:46.639 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.640+0000 7f0681800640 1 -- 172.21.15.72:0/2696918799 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e045c4510 con 0x559e045dd4e0 2024-04-04T06:56:46.639 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.640+0000 7f0681800640 1 --2- 172.21.15.72:0/2696918799 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x559e045dd4e0 0x559e045d8db0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f0674043f10 tx=0x7f067404a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa0f002ff5727082 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:46.641 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.640+0000 7f0670c00640 1 -- 172.21.15.72:0/2696918799 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0674061070 con 0x559e045dd4e0 2024-04-04T06:56:46.641 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.640+0000 7f0670c00640 1 -- 172.21.15.72:0/2696918799 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0674004230 con 0x559e045dd4e0 2024-04-04T06:56:46.641 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.641+0000 7f0670c00640 1 -- 172.21.15.72:0/2696918799 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0674034040 con 0x559e045dd4e0 2024-04-04T06:56:46.641 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.641+0000 7f06865e5740 1 -- 172.21.15.72:0/2696918799 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x559e045dd4e0 msgr2=0x559e045d8db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:46.641 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.641+0000 7f06865e5740 1 --2- 172.21.15.72:0/2696918799 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x559e045dd4e0 0x559e045d8db0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f0674043f10 tx=0x7f067404a000 comp rx=0 tx=0).stop 2024-04-04T06:56:46.641 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.641+0000 7f06865e5740 1 -- 172.21.15.72:0/2696918799 shutdown_connections 2024-04-04T06:56:46.641 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.641+0000 7f06865e5740 1 --2- 172.21.15.72:0/2696918799 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x559e045dd4e0 0x559e045d8db0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:46.641 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.641+0000 7f06865e5740 1 --2- 172.21.15.72:0/2696918799 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559e045c1510 0x559e045d8870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:46.641 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.641+0000 7f06865e5740 1 --2- 172.21.15.72:0/2696918799 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x559e045c1130 0x559e045c06b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:46.641 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.641+0000 7f06865e5740 1 -- 172.21.15.72:0/2696918799 >> 172.21.15.72:0/2696918799 conn(0x559e04594610 msgr2=0x559e045c7730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:56:46.641 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.641+0000 7f06865e5740 1 -- 172.21.15.72:0/2696918799 shutdown_connections 2024-04-04T06:56:46.641 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.641+0000 7f06865e5740 1 -- 172.21.15.72:0/2696918799 wait complete. 2024-04-04T06:56:46.641 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.642+0000 7f06865e5740 1 -- start start 2024-04-04T06:56:46.641 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.642+0000 7f06865e5740 1 Processor -- start 2024-04-04T06:56:46.645 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.643+0000 7f06865e5740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x559e045c1130 0x559e045f10a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:46.645 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.643+0000 7f06865e5740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x559e045c1510 0x559e045f3530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:46.645 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.643+0000 7f06865e5740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559e045dd4e0 0x559e045d8870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:46.645 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.643+0000 7f06865e5740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x559e045c6640 con 0x559e045c1510 2024-04-04T06:56:46.645 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.643+0000 7f06865e5740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x559e045c6940 con 0x559e045dd4e0 2024-04-04T06:56:46.645 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.643+0000 7f06865e5740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x559e045f31c0 con 0x559e045c1130 2024-04-04T06:56:46.645 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.643+0000 7f06865e5740 10 client.0 _ll_register_callbacks cb 0x7f0674030cb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-04T06:56:46.645 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.643+0000 7f0673e00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x559e045c1510 0x559e045f3530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:46.645 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.643+0000 7f0673e00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x559e045c1510 0x559e045f3530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:34828/0 (socket says 172.21.15.72:34828) 2024-04-04T06:56:46.645 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.643+0000 7f0673e00640 1 -- 172.21.15.72:0/3689714552 learned_addr learned my addr 172.21.15.72:0/3689714552 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:56:46.645 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.644+0000 7f0680e00640 1 --2- 172.21.15.72:0/3689714552 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x559e045c1130 0x559e045f10a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:46.646 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.644+0000 7f0673e00640 1 -- 172.21.15.72:0/3689714552 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x559e045c1130 msgr2=0x559e045f10a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:56:46.646 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.644+0000 7f0673e00640 1 --2- 172.21.15.72:0/3689714552 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x559e045c1130 0x559e045f10a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:46.646 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.644+0000 7f0681800640 1 --2- 172.21.15.72:0/3689714552 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559e045dd4e0 0x559e045d8870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:46.646 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.644+0000 7f0673e00640 1 -- 172.21.15.72:0/3689714552 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559e045dd4e0 msgr2=0x559e045d8870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:56:46.646 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.644+0000 7f0673e00640 1 --2- 172.21.15.72:0/3689714552 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559e045dd4e0 0x559e045d8870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:46.646 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.644+0000 7f0673e00640 1 -- 172.21.15.72:0/3689714552 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559e045930f0 con 0x559e045c1510 2024-04-04T06:56:46.646 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.644+0000 7f0673e00640 1 --2- 172.21.15.72:0/3689714552 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x559e045c1510 0x559e045f3530 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f0664006fd0 tx=0x7f066405a450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17da56bf9f816bf9 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:46.646 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.644+0000 7f066a000640 10 client.0 ms_handle_connect on v2:172.21.15.72:3300/0 2024-04-04T06:56:46.646 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.644+0000 7f066a000640 1 -- 172.21.15.72:0/3689714552 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0664072020 con 0x559e045c1510 2024-04-04T06:56:46.646 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.644+0000 7f066a000640 1 -- 172.21.15.72:0/3689714552 <== mon.0 v2:172.21.15.72:3300/0 2 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f06640721c0 con 0x559e045c1510 2024-04-04T06:56:46.646 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.644+0000 7f06865e5740 1 -- 172.21.15.72:0/3689714552 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0674004230 con 0x559e045c1510 2024-04-04T06:56:46.646 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.645+0000 7f066a000640 1 -- 172.21.15.72:0/3689714552 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7f0664062870 con 0x559e045c1510 2024-04-04T06:56:46.646 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.645+0000 7f06865e5740 10 client.4665 fetch_fsmap learned FSMap version 8 2024-04-04T06:56:46.646 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.645+0000 7f06865e5740 1 -- 172.21.15.72:0/3689714552 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x559e045f1930 con 0x559e045c1510 2024-04-04T06:56:46.646 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.645+0000 7f066a000640 1 -- 172.21.15.72:0/3689714552 <== mon.0 v2:172.21.15.72:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0674004230 con 0x559e045c1510 2024-04-04T06:56:46.647 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.645+0000 7f066a000640 1 -- 172.21.15.72:0/3689714552 <== mon.0 v2:172.21.15.72:3300/0 5 ==== fsmap(e 8) ==== 3494+0+0 (secure 0 0 0) 0x7f0664013070 con 0x559e045c1510 2024-04-04T06:56:46.647 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.645+0000 7f06865e5740 10 client.4665 fetch_fsmap finished waiting for FSMap version 8 2024-04-04T06:56:46.647 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.645+0000 7f06865e5740 10 client.4665 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-04T06:56:46.647 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.645+0000 7f06865e5740 20 client.4665 populate_metadata read hostname 'smithi072' 2024-04-04T06:56:46.647 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.645+0000 7f06865e5740 1 --2- 172.21.15.72:0/3689714552 >> [v2:172.21.15.72:6836/2958027127,v1:172.21.15.72:6837/2958027127] conn(0x559e045d8f90 0x559e045ead30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:46.647 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.645+0000 7f06865e5740 4 client.4665 mds_command: new command op to 4263 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-04T06:56:46.647 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.645+0000 7f06865e5740 1 -- 172.21.15.72:0/3689714552 --> [v2:172.21.15.72:6836/2958027127,v1:172.21.15.72:6837/2958027127] -- command(tid 0: {"prefix": "status"}) -- 0x559e04505830 con 0x559e045d8f90 2024-04-04T06:56:46.647 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.645+0000 7f0680e00640 1 --2- 172.21.15.72:0/3689714552 >> [v2:172.21.15.72:6836/2958027127,v1:172.21.15.72:6837/2958027127] conn(0x559e045d8f90 0x559e045ead30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:46.647 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.646+0000 7f0680e00640 1 --2- 172.21.15.72:0/3689714552 >> [v2:172.21.15.72:6836/2958027127,v1:172.21.15.72:6837/2958027127] conn(0x559e045d8f90 0x559e045ead30 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=633244b265b09f72 server_cookie=bbecb32f721fe82f in_seq=0 out_seq=0 2024-04-04T06:56:46.647 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.646+0000 7f066a000640 10 client.4665 ms_handle_connect on v2:172.21.15.72:6836/2958027127 2024-04-04T06:56:46.647 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.646+0000 7f066a000640 1 -- 172.21.15.72:0/3689714552 <== mds.0 v2:172.21.15.72:6836/2958027127 1 ==== command_reply(tid 0: 0 ) ==== 8+0+330 (crc 0 0 0) 0x559e04505830 con 0x559e045d8f90 2024-04-04T06:56:46.647 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.646+0000 7f066a000640 10 client.4665 handle_command_reply: tid=0 2024-04-04T06:56:46.647 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.646+0000 7f06865e5740 1 client.4665 shutdown 2024-04-04T06:56:46.647 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.646+0000 7f06865e5740 1 -- 172.21.15.72:0/3689714552 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x559e045c1510 msgr2=0x559e045f3530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:46.647 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.646+0000 7f06865e5740 1 --2- 172.21.15.72:0/3689714552 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x559e045c1510 0x559e045f3530 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f0664006fd0 tx=0x7f066405a450 comp rx=0 tx=0).stop 2024-04-04T06:56:46.648 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.646+0000 7f06865e5740 1 -- 172.21.15.72:0/3689714552 shutdown_connections 2024-04-04T06:56:46.648 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.646+0000 7f06865e5740 1 --2- 172.21.15.72:0/3689714552 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559e045dd4e0 0x559e045d8870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:46.648 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.646+0000 7f06865e5740 1 --2- 172.21.15.72:0/3689714552 >> [v2:172.21.15.72:6836/2958027127,v1:172.21.15.72:6837/2958027127] conn(0x559e045d8f90 0x559e045ead30 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:46.648 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.646+0000 7f06865e5740 1 --2- 172.21.15.72:0/3689714552 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x559e045c1510 0x559e045f3530 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:46.648 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.646+0000 7f06865e5740 1 --2- 172.21.15.72:0/3689714552 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x559e045c1130 0x559e045f10a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:46.648 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.646+0000 7f066a000640 0 client.4665 ms_handle_reset on v2:172.21.15.72:6836/2958027127 2024-04-04T06:56:46.648 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.646+0000 7f06865e5740 1 -- 172.21.15.72:0/3689714552 >> 172.21.15.72:0/3689714552 conn(0x559e04594610 msgr2=0x559e0458f3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:56:46.648 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.646+0000 7f06865e5740 1 -- 172.21.15.72:0/3689714552 shutdown_connections 2024-04-04T06:56:46.648 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.646+0000 7f06865e5740 1 -- 172.21.15.72:0/3689714552 wait complete. 2024-04-04T06:56:46.648 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.646+0000 7f06865e5740 20 client.4665 trim_cache size 0 max 16384 2024-04-04T06:56:46.648 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-04T06:56:46.649 INFO:teuthology.orchestra.run.smithi072.stdout: "cluster_fsid": "6708bac2-4f50-49b5-87a9-c390fd333eb3", 2024-04-04T06:56:46.649 INFO:teuthology.orchestra.run.smithi072.stdout: "whoami": 0, 2024-04-04T06:56:46.649 INFO:teuthology.orchestra.run.smithi072.stdout: "id": 4263, 2024-04-04T06:56:46.649 INFO:teuthology.orchestra.run.smithi072.stdout: "want_state": "up:active", 2024-04-04T06:56:46.649 INFO:teuthology.orchestra.run.smithi072.stdout: "state": "up:active", 2024-04-04T06:56:46.649 INFO:teuthology.orchestra.run.smithi072.stdout: "fs_name": "cephfs", 2024-04-04T06:56:46.649 INFO:teuthology.orchestra.run.smithi072.stdout: "rank_uptime": 17.614281629000001, 2024-04-04T06:56:46.649 INFO:teuthology.orchestra.run.smithi072.stdout: "mdsmap_epoch": 8, 2024-04-04T06:56:46.649 INFO:teuthology.orchestra.run.smithi072.stdout: "osdmap_epoch": 20, 2024-04-04T06:56:46.649 INFO:teuthology.orchestra.run.smithi072.stdout: "osdmap_epoch_barrier": 20, 2024-04-04T06:56:46.649 INFO:teuthology.orchestra.run.smithi072.stdout: "uptime": 22.801819815000002 2024-04-04T06:56:46.649 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-04T06:56:46.650 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.647+0000 7f0683800640 1 -- 172.21.15.72:0/2367648845 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f065806c920 msgr2=0x7f065806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:46.650 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.647+0000 7f0683800640 1 --2- 172.21.15.72:0/2367648845 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f065806c920 0x7f065806ede0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f0674036000 tx=0x7f067403b040 comp rx=0 tx=0).stop 2024-04-04T06:56:46.650 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.647+0000 7f0683800640 1 -- 172.21.15.72:0/2367648845 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f067c0cf620 msgr2=0x7f067c0cc6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:46.650 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.647+0000 7f0683800640 1 --2- 172.21.15.72:0/2367648845 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f067c0cf620 0x7f067c0cc6a0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f066400d800 tx=0x7f066400dcc0 comp rx=0 tx=0).stop 2024-04-04T06:56:46.650 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.647+0000 7f0683800640 1 -- 172.21.15.72:0/2367648845 shutdown_connections 2024-04-04T06:56:46.650 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.647+0000 7f0683800640 1 --2- 172.21.15.72:0/2367648845 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f065806c920 0x7f065806ede0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:46.650 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.647+0000 7f0683800640 1 --2- 172.21.15.72:0/2367648845 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f067c15e590 0x7f067c0cd4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:46.650 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.647+0000 7f0683800640 1 --2- 172.21.15.72:0/2367648845 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f067c0cf620 0x7f067c0cc6a0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:46.651 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.647+0000 7f0683800640 1 --2- 172.21.15.72:0/2367648845 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f067c0b9d10 0x7f067c14f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:46.651 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.647+0000 7f0683800640 1 -- 172.21.15.72:0/2367648845 >> 172.21.15.72:0/2367648845 conn(0x7f067c0d0f70 msgr2=0x7f067c0ced20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:56:46.651 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.647+0000 7f0683800640 1 -- 172.21.15.72:0/2367648845 shutdown_connections 2024-04-04T06:56:46.651 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:46.647+0000 7f0683800640 1 -- 172.21.15.72:0/2367648845 wait complete. 2024-04-04T06:56:46.661 INFO:teuthology.run_tasks:Running task sequential... 2024-04-04T06:56:46.670 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-04-04T06:56:46.670 INFO:teuthology.task.sequential:In sequential, running task print... 2024-04-04T06:56:46.671 INFO:teuthology.task.print:Enabling mgr modules 2024-04-04T06:56:46.671 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-04-04T06:56:46.717 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-04-04T06:56:46.717 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2024-04-04T06:56:46.717 INFO:tasks.ceph_fuse:client.0 config is {} 2024-04-04T06:56:46.717 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-04T06:56:46.717 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-04T06:56:46.717 INFO:tasks.ceph_fuse:client.2 config is {} 2024-04-04T06:56:46.718 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-04T06:56:46.718 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-04-04T06:56:46.718 INFO:tasks.ceph_fuse:client.1 config is {} 2024-04-04T06:56:46.718 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-04T06:56:46.718 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-04-04T06:56:46.718 INFO:tasks.ceph_fuse:client.3 config is {} 2024-04-04T06:56:46.718 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-04T06:56:46.718 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-04-04T06:56:46.718 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-04T06:56:46.718 DEBUG:teuthology.orchestra.run.smithi072:> ip netns list 2024-04-04T06:56:46.771 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-04T06:56:46.771 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip link delete ceph-brx 2024-04-04T06:56:46.855 INFO:teuthology.orchestra.run.smithi072.stderr:Cannot find device "ceph-brx" 2024-04-04T06:56:46.858 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-04T06:56:46.859 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-04T06:56:46.859 DEBUG:teuthology.orchestra.run.smithi117:> ip netns list 2024-04-04T06:56:46.916 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-04T06:56:46.916 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip link delete ceph-brx 2024-04-04T06:56:47.010 INFO:teuthology.orchestra.run.smithi117.stderr:Cannot find device "ceph-brx" 2024-04-04T06:56:47.013 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-04T06:56:47.013 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-04-04T06:56:47.014 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-04T06:56:47.218 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:47.219+0000 7fd09a800640 1 Processor -- start 2024-04-04T06:56:47.218 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:47.219+0000 7fd09a800640 1 -- start start 2024-04-04T06:56:47.220 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:47.221+0000 7fd09a800640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd09415e560 0x7fd0940b7370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:47.220 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:47.221+0000 7fd09a800640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fd0940d2340 0x7fd0940b9d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:47.220 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:47.221+0000 7fd09a800640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0940b7b00 con 0x7fd0940cefd0 2024-04-04T06:56:47.220 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:47.221+0000 7fd09a800640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fd0940b78b0 con 0x7fd0940d2340 2024-04-04T06:56:47.220 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:47.221+0000 7fd09a800640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fd0940b7de0 con 0x7fd09415e560 2024-04-04T06:56:47.220 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:47.221+0000 7fd093e00640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fd0940cefd0 0x7fd0940cf430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:39668/0 (socket says 172.21.15.72:39668) 2024-04-04T06:56:47.220 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:47.221+0000 7fd093e00640 1 -- 172.21.15.72:0/65175673 learned_addr learned my addr 172.21.15.72:0/65175673 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-04-04T06:56:47.220 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:47.221+0000 7fd093400640 1 --2- 172.21.15.72:0/65175673 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd09415e560 0x7fd0940b7370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:47.220 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:47.221+0000 7fd08be00640 1 --2- 172.21.15.72:0/65175673 >> v2:172.21.15.117:3300/0 conn(0x7fd0940d2340 0x7fd0940b9d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:47.222 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:47.222+0000 7fd092a00640 1 -- 172.21.15.72:0/65175673 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3158184235 0 0) 0x7fd0940b7b00 con 0x7fd0940cefd0 2024-04-04T06:56:47.222 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:47.222+0000 7fd092a00640 1 -- 172.21.15.72:0/65175673 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd078003520 con 0x7fd0940cefd0 2024-04-04T06:56:47.222 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:47.222+0000 7fd092a00640 1 -- 172.21.15.72:0/65175673 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2434431684 0 0) 0x7fd078003520 con 0x7fd0940cefd0 2024-04-04T06:56:47.222 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:47.222+0000 7fd092a00640 1 -- 172.21.15.72:0/65175673 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd09415e560 msgr2=0x7fd0940b7370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:56:47.222 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:47.222+0000 7fd092a00640 1 --2- 172.21.15.72:0/65175673 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd09415e560 0x7fd0940b7370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:47.222 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:47.222+0000 7fd092a00640 1 -- 172.21.15.72:0/65175673 >> v2:172.21.15.117:3300/0 conn(0x7fd0940d2340 msgr2=0x7fd0940b9d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:56:47.223 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:47.222+0000 7fd092a00640 1 --2- 172.21.15.72:0/65175673 >> v2:172.21.15.117:3300/0 conn(0x7fd0940d2340 0x7fd0940b9d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:47.223 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:47.222+0000 7fd092a00640 1 -- 172.21.15.72:0/65175673 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0940b80c0 con 0x7fd0940cefd0 2024-04-04T06:56:47.223 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:47.222+0000 7fd092a00640 1 -- 172.21.15.72:0/65175673 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2465650867 0 0) 0x7fd08c0019f0 con 0x7fd0940cefd0 2024-04-04T06:56:47.223 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:47.222+0000 7fd092a00640 1 -- 172.21.15.72:0/65175673 >> v1:172.21.15.72:6789/0 conn(0x7fd0940cefd0 legacy=0x7fd0940cf430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:47.223 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:47.222+0000 7fd092a00640 1 --2- 172.21.15.72:0/65175673 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd0780039b0 0x7fd078003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:47.223 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:47.222+0000 7fd092a00640 1 --2- 172.21.15.72:0/65175673 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd078004800 0x7fd078004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:47.223 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:47.222+0000 7fd092a00640 1 --2- 172.21.15.72:0/65175673 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd09415e560 0x7fd0780051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:47.223 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:47.222+0000 7fd092a00640 1 -- 172.21.15.72:0/65175673 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fd0940b78b0 con 0x7fd0780039b0 2024-04-04T06:56:47.223 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:47.222+0000 7fd092a00640 1 -- 172.21.15.72:0/65175673 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fd0940b7de0 con 0x7fd078004800 2024-04-04T06:56:47.223 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:47.222+0000 7fd092a00640 1 -- 172.21.15.72:0/65175673 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fd07800b9f0 con 0x7fd09415e560 2024-04-04T06:56:47.223 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:47.222+0000 7fd093400640 1 --2- 172.21.15.72:0/65175673 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd0780039b0 0x7fd078003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:47.223 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:47.223+0000 7fd08be00640 1 --2- 172.21.15.72:0/65175673 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd078004800 0x7fd078004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:47.223 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:47.223+0000 7fd093400640 1 -- 172.21.15.72:0/65175673 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd09415e560 msgr2=0x7fd0780051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:56:47.223 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:47.223+0000 7fd093400640 1 --2- 172.21.15.72:0/65175673 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd09415e560 0x7fd0780051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:47.223 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:47.223+0000 7fd093400640 1 -- 172.21.15.72:0/65175673 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd078004800 msgr2=0x7fd078004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:56:47.224 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:47.223+0000 7fd093400640 1 --2- 172.21.15.72:0/65175673 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd078004800 0x7fd078004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:47.224 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:47.223+0000 7fd093400640 1 -- 172.21.15.72:0/65175673 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd078003520 con 0x7fd0780039b0 2024-04-04T06:56:47.225 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:47.224+0000 7fd093400640 1 --2- 172.21.15.72:0/65175673 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd0780039b0 0x7fd078003dd0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fd084009ac0 tx=0x7fd078005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20399368c713ba0f server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:47.225 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:47.224+0000 7fd092a00640 1 -- 172.21.15.72:0/65175673 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd084039070 con 0x7fd0780039b0 2024-04-04T06:56:47.225 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:47.224+0000 7fd092a00640 1 -- 172.21.15.72:0/65175673 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd08402c710 con 0x7fd0780039b0 2024-04-04T06:56:47.225 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:47.224+0000 7fd092a00640 1 -- 172.21.15.72:0/65175673 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd084009690 con 0x7fd0780039b0 2024-04-04T06:56:47.225 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:47.225+0000 7fd09a800640 1 -- 172.21.15.72:0/65175673 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd0780039b0 msgr2=0x7fd078003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:47.225 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:47.225+0000 7fd09a800640 1 --2- 172.21.15.72:0/65175673 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd0780039b0 0x7fd078003dd0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fd084009ac0 tx=0x7fd078005830 comp rx=0 tx=0).stop 2024-04-04T06:56:47.225 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:47.225+0000 7fd093e00640 1 -- 172.21.15.72:0/65175673 reap_dead start 2024-04-04T06:56:47.225 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:47.225+0000 7fd09a800640 1 -- 172.21.15.72:0/65175673 shutdown_connections 2024-04-04T06:56:47.225 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:47.225+0000 7fd09a800640 1 -- 172.21.15.72:0/65175673 >> 172.21.15.72:0/65175673 conn(0x7fd094071eb0 msgr2=0x7fd0940722c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:56:47.225 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:47.225+0000 7fd09a800640 1 -- 172.21.15.72:0/65175673 shutdown_connections 2024-04-04T06:56:47.225 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:47.225+0000 7fd09a800640 1 -- 172.21.15.72:0/65175673 wait complete. 2024-04-04T06:56:47.226 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:47.228+0000 7fd09a800640 1 Processor -- start 2024-04-04T06:56:47.226 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:47.228+0000 7fd09a800640 1 -- start start 2024-04-04T06:56:47.229 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:47.230+0000 7fd09a800640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd0780039b0 0x7fd0940cc1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:47.229 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:47.230+0000 7fd09a800640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd094153340 0x7fd0940ccb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:47.229 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:47.230+0000 7fd09a800640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd0940cd040 0x7fd094161ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:47.229 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:47.230+0000 7fd09a800640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fd0940ba250 con 0x7fd094153340 2024-04-04T06:56:47.229 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:47.230+0000 7fd09a800640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fd0940b8680 con 0x7fd0940cd040 2024-04-04T06:56:47.229 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:47.230+0000 7fd09a800640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fd0940d2780 con 0x7fd0780039b0 2024-04-04T06:56:47.229 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:47.230+0000 7fd08be00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd094153340 0x7fd0940ccb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:47.229 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:47.230+0000 7fd08be00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd094153340 0x7fd0940ccb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:34856/0 (socket says 172.21.15.72:34856) 2024-04-04T06:56:47.229 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:47.230+0000 7fd08be00640 1 -- 172.21.15.72:0/1804723586 learned_addr learned my addr 172.21.15.72:0/1804723586 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:56:47.229 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:47.230+0000 7fd093400640 1 --2- 172.21.15.72:0/1804723586 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd0780039b0 0x7fd0940cc1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:47.229 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:47.230+0000 7fd093e00640 1 --2- 172.21.15.72:0/1804723586 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd0940cd040 0x7fd094161ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:47.229 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:47.230+0000 7fd08be00640 1 -- 172.21.15.72:0/1804723586 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd0780039b0 msgr2=0x7fd0940cc1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:47.230 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:47.230+0000 7fd08be00640 1 --2- 172.21.15.72:0/1804723586 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd0780039b0 0x7fd0940cc1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:47.230 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:47.230+0000 7fd08be00640 1 -- 172.21.15.72:0/1804723586 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd0940cd040 msgr2=0x7fd094161ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:47.230 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:47.230+0000 7fd08be00640 1 --2- 172.21.15.72:0/1804723586 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd0940cd040 0x7fd094161ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:47.230 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:47.230+0000 7fd08be00640 1 -- 172.21.15.72:0/1804723586 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0940cb470 con 0x7fd094153340 2024-04-04T06:56:47.231 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:47.231+0000 7fd08be00640 1 --2- 172.21.15.72:0/1804723586 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd094153340 0x7fd0940ccb00 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fd07c011700 tx=0x7fd07c011bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:47.231 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:47.231+0000 7fd08b400640 1 -- 172.21.15.72:0/1804723586 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd07c00f9c0 con 0x7fd094153340 2024-04-04T06:56:47.231 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:47.231+0000 7fd08b400640 1 -- 172.21.15.72:0/1804723586 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd07c00fb60 con 0x7fd094153340 2024-04-04T06:56:47.231 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:47.231+0000 7fd09a800640 1 -- 172.21.15.72:0/1804723586 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0940cb710 con 0x7fd094153340 2024-04-04T06:56:47.231 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:47.231+0000 7fd08b400640 1 -- 172.21.15.72:0/1804723586 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd07c015460 con 0x7fd094153340 2024-04-04T06:56:47.231 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:47.231+0000 7fd09a800640 1 -- 172.21.15.72:0/1804723586 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0940cd550 con 0x7fd094153340 2024-04-04T06:56:47.231 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:47.233+0000 7fd09a800640 1 -- 172.21.15.72:0/1804723586 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd094075840 con 0x7fd094153340 2024-04-04T06:56:47.232 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:47.233+0000 7fd08b400640 1 -- 172.21.15.72:0/1804723586 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd07c015600 con 0x7fd094153340 2024-04-04T06:56:47.233 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:47.234+0000 7fd08b400640 1 --2- 172.21.15.72:0/1804723586 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fd07006c920 0x7fd07006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:47.233 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:47.234+0000 7fd08b400640 1 -- 172.21.15.72:0/1804723586 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fd07c08c480 con 0x7fd094153340 2024-04-04T06:56:47.233 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:47.234+0000 7fd093400640 1 --2- 172.21.15.72:0/1804723586 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fd07006c920 0x7fd07006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:47.233 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:47.235+0000 7fd093400640 1 --2- 172.21.15.72:0/1804723586 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fd07006c920 0x7fd07006ede0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fd084036000 tx=0x7fd084030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:47.241 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:47.242+0000 7fd08b400640 1 -- 172.21.15.72:0/1804723586 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fd07c019030 con 0x7fd094153340 2024-04-04T06:56:47.487 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:47.489+0000 7fd09a800640 1 -- 172.21.15.72:0/1804723586 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fd0940cbe80 con 0x7fd094153340 2024-04-04T06:56:47.488 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:47.489+0000 7fd08b400640 1 -- 172.21.15.72:0/1804723586 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+73 (secure 0 0 0) 0x7fd07c05a8b0 con 0x7fd094153340 2024-04-04T06:56:47.488 INFO:teuthology.orchestra.run.smithi072.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-04T06:56:47.491 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:47.492+0000 7fd09a800640 1 -- 172.21.15.72:0/1804723586 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fd07006c920 msgr2=0x7fd07006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:47.491 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:47.492+0000 7fd09a800640 1 --2- 172.21.15.72:0/1804723586 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fd07006c920 0x7fd07006ede0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fd084036000 tx=0x7fd084030000 comp rx=0 tx=0).stop 2024-04-04T06:56:47.491 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:47.492+0000 7fd09a800640 1 -- 172.21.15.72:0/1804723586 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd094153340 msgr2=0x7fd0940ccb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:47.491 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:47.492+0000 7fd09a800640 1 --2- 172.21.15.72:0/1804723586 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd094153340 0x7fd0940ccb00 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fd07c011700 tx=0x7fd07c011bc0 comp rx=0 tx=0).stop 2024-04-04T06:56:47.494 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:47.492+0000 7fd09a800640 1 -- 172.21.15.72:0/1804723586 shutdown_connections 2024-04-04T06:56:47.494 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:47.492+0000 7fd09a800640 1 --2- 172.21.15.72:0/1804723586 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fd07006c920 0x7fd07006ede0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:47.494 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:47.492+0000 7fd09a800640 1 --2- 172.21.15.72:0/1804723586 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd0940cd040 0x7fd094161ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:47.494 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:47.492+0000 7fd09a800640 1 --2- 172.21.15.72:0/1804723586 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd094153340 0x7fd0940ccb00 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:47.494 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:47.492+0000 7fd09a800640 1 --2- 172.21.15.72:0/1804723586 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd0780039b0 0x7fd0940cc1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:47.494 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:47.492+0000 7fd09a800640 1 -- 172.21.15.72:0/1804723586 >> 172.21.15.72:0/1804723586 conn(0x7fd094071eb0 msgr2=0x7fd0940cf430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:56:47.494 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:47.493+0000 7fd09a800640 1 -- 172.21.15.72:0/1804723586 shutdown_connections 2024-04-04T06:56:47.494 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:47.493+0000 7fd09a800640 1 -- 172.21.15.72:0/1804723586 wait complete. 2024-04-04T06:56:47.510 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-04T06:56:47.510 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-04T06:56:47.510 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi072.front.sepia.ceph.com 2024-04-04T06:56:47.510 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-04T06:56:47.510 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-04T06:56:47.510 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-04T06:56:47.511 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-04T06:56:47.511 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-04T06:56:47.511 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-04T06:56:47.511 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-04T06:56:47.511 DEBUG:teuthology.orchestra.run.smithi072:> ip addr 2024-04-04T06:56:47.558 INFO:teuthology.orchestra.run.smithi072.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-04T06:56:47.558 INFO:teuthology.orchestra.run.smithi072.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-04T06:56:47.558 INFO:teuthology.orchestra.run.smithi072.stdout: inet 127.0.0.1/8 scope host lo 2024-04-04T06:56:47.558 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2024-04-04T06:56:47.558 INFO:teuthology.orchestra.run.smithi072.stdout: inet6 ::1/128 scope host 2024-04-04T06:56:47.558 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2024-04-04T06:56:47.558 INFO:teuthology.orchestra.run.smithi072.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-04T06:56:47.558 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0c:c4:7a:d8:da:f4 brd ff:ff:ff:ff:ff:ff 2024-04-04T06:56:47.558 INFO:teuthology.orchestra.run.smithi072.stdout: altname enp7s0f0 2024-04-04T06:56:47.559 INFO:teuthology.orchestra.run.smithi072.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-04T06:56:47.559 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0c:c4:7a:d8:da:f5 brd ff:ff:ff:ff:ff:ff 2024-04-04T06:56:47.559 INFO:teuthology.orchestra.run.smithi072.stdout: altname enp7s0f1 2024-04-04T06:56:47.559 INFO:teuthology.orchestra.run.smithi072.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-04T06:56:47.559 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0c:c4:7a:8f:b7:64 brd ff:ff:ff:ff:ff:ff 2024-04-04T06:56:47.559 INFO:teuthology.orchestra.run.smithi072.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-04T06:56:47.559 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0c:c4:7a:8f:b7:65 brd ff:ff:ff:ff:ff:ff 2024-04-04T06:56:47.559 INFO:teuthology.orchestra.run.smithi072.stdout: inet 172.21.15.72/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-04-04T06:56:47.559 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft 42540sec preferred_lft 42540sec 2024-04-04T06:56:47.559 INFO:teuthology.orchestra.run.smithi072.stdout: inet6 fe80::ec4:7aff:fe8f:b765/64 scope link 2024-04-04T06:56:47.559 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2024-04-04T06:56:47.560 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-04T06:56:47.560 DEBUG:teuthology.orchestra.run.smithi072:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-04T06:56:47.560 DEBUG:teuthology.orchestra.run.smithi072:> set -e 2024-04-04T06:56:47.560 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip link add name ceph-brx type bridge 2024-04-04T06:56:47.560 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip addr flush dev ceph-brx 2024-04-04T06:56:47.560 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip link set ceph-brx up 2024-04-04T06:56:47.560 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-04T06:56:47.560 DEBUG:teuthology.orchestra.run.smithi072:> ') 2024-04-04T06:56:47.703 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:47 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-04T06:56:48.201 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-04T06:56:48.212 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-04T06:56:48.212 DEBUG:teuthology.orchestra.run.smithi072:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-04T06:56:48.284 INFO:teuthology.orchestra.run.smithi072.stdout:1 2024-04-04T06:56:48.289 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-04T06:56:48.289 DEBUG:teuthology.orchestra.run.smithi072:> route 2024-04-04T06:56:48.343 INFO:teuthology.orchestra.run.smithi072.stdout:Kernel IP routing table 2024-04-04T06:56:48.343 INFO:teuthology.orchestra.run.smithi072.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-04T06:56:48.343 INFO:teuthology.orchestra.run.smithi072.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-04T06:56:48.344 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-04T06:56:48.344 INFO:teuthology.orchestra.run.smithi072.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-04T06:56:48.344 DEBUG:teuthology.orchestra.run.smithi072:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-04T06:56:48.344 DEBUG:teuthology.orchestra.run.smithi072:> set -e 2024-04-04T06:56:48.344 DEBUG:teuthology.orchestra.run.smithi072:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-04T06:56:48.344 DEBUG:teuthology.orchestra.run.smithi072:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-04T06:56:48.344 DEBUG:teuthology.orchestra.run.smithi072:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-04T06:56:48.345 DEBUG:teuthology.orchestra.run.smithi072:> ') 2024-04-04T06:56:48.441 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:48 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-04T06:56:49.289 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-04T06:56:49.298 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-04T06:56:49.298 DEBUG:teuthology.orchestra.run.smithi072:> ip netns list 2024-04-04T06:56:49.344 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-04T06:56:49.345 DEBUG:teuthology.orchestra.run.smithi072:> ip netns list-id 2024-04-04T06:56:49.432 DEBUG:teuthology.orchestra.run.smithi072:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-04T06:56:49.433 DEBUG:teuthology.orchestra.run.smithi072:> set -e 2024-04-04T06:56:49.433 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-04T06:56:49.433 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-04-04T06:56:49.433 DEBUG:teuthology.orchestra.run.smithi072:> ') 2024-04-04T06:56:49.571 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:49 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-04T06:56:49.653 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-04T06:56:49.662 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-04-04T06:56:49.663 DEBUG:teuthology.orchestra.run.smithi072:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-04T06:56:49.663 DEBUG:teuthology.orchestra.run.smithi072:> set -e 2024-04-04T06:56:49.663 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-04-04T06:56:49.663 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-04T06:56:49.663 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-04-04T06:56:49.663 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-04-04T06:56:49.663 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-04-04T06:56:49.663 DEBUG:teuthology.orchestra.run.smithi072:> ') 2024-04-04T06:56:49.753 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:49 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-04T06:56:49.982 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-04T06:56:49.991 DEBUG:teuthology.orchestra.run.smithi072:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-04T06:56:49.991 DEBUG:teuthology.orchestra.run.smithi072:> set -e 2024-04-04T06:56:49.991 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip link set brx.0 up 2024-04-04T06:56:49.991 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip link set dev brx.0 master ceph-brx 2024-04-04T06:56:49.991 DEBUG:teuthology.orchestra.run.smithi072:> ') 2024-04-04T06:56:50.083 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:50 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-04T06:56:50.189 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-04T06:56:50.197 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-04-04T06:56:50.198 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-04T06:56:50.198 DEBUG:teuthology.orchestra.run.smithi072:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-04T06:56:50.237 INFO:teuthology.orchestra.run.smithi072.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-04T06:56:50.237 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-04T06:56:50.237 DEBUG:teuthology.orchestra.run.smithi072:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-04T06:56:50.326 DEBUG:teuthology.orchestra.run.smithi072:> sudo modprobe fuse 2024-04-04T06:56:50.450 DEBUG:teuthology.orchestra.run.smithi072:> cat /proc/self/mounts | awk '{print $2}' 2024-04-04T06:56:50.492 INFO:teuthology.orchestra.run.smithi072.stdout:/proc 2024-04-04T06:56:50.492 INFO:teuthology.orchestra.run.smithi072.stdout:/sys 2024-04-04T06:56:50.492 INFO:teuthology.orchestra.run.smithi072.stdout:/dev 2024-04-04T06:56:50.492 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/kernel/security 2024-04-04T06:56:50.492 INFO:teuthology.orchestra.run.smithi072.stdout:/dev/shm 2024-04-04T06:56:50.492 INFO:teuthology.orchestra.run.smithi072.stdout:/dev/pts 2024-04-04T06:56:50.492 INFO:teuthology.orchestra.run.smithi072.stdout:/run 2024-04-04T06:56:50.492 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/fs/cgroup 2024-04-04T06:56:50.492 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/fs/pstore 2024-04-04T06:56:50.492 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/fs/bpf 2024-04-04T06:56:50.492 INFO:teuthology.orchestra.run.smithi072.stdout:/ 2024-04-04T06:56:50.492 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/fs/selinux 2024-04-04T06:56:50.493 INFO:teuthology.orchestra.run.smithi072.stdout:/proc/sys/fs/binfmt_misc 2024-04-04T06:56:50.493 INFO:teuthology.orchestra.run.smithi072.stdout:/dev/mqueue 2024-04-04T06:56:50.493 INFO:teuthology.orchestra.run.smithi072.stdout:/dev/hugepages 2024-04-04T06:56:50.493 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/kernel/debug 2024-04-04T06:56:50.493 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/kernel/tracing 2024-04-04T06:56:50.493 INFO:teuthology.orchestra.run.smithi072.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-04T06:56:50.493 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/fs/fuse/connections 2024-04-04T06:56:50.493 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/kernel/config 2024-04-04T06:56:50.493 INFO:teuthology.orchestra.run.smithi072.stdout:/run/credentials/systemd-sysctl.service 2024-04-04T06:56:50.493 INFO:teuthology.orchestra.run.smithi072.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-04T06:56:50.493 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/nfs/rpc_pipefs 2024-04-04T06:56:50.493 INFO:teuthology.orchestra.run.smithi072.stdout:/run/user/1000 2024-04-04T06:56:50.493 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/ceph 2024-04-04T06:56:50.493 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/ceph/osd/ceph-0 2024-04-04T06:56:50.493 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/ceph/osd/ceph-1 2024-04-04T06:56:50.494 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/ceph/osd/ceph-2 2024-04-04T06:56:50.494 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/ceph/osd/ceph-3 2024-04-04T06:56:50.494 INFO:teuthology.orchestra.run.smithi072.stdout:/run/netns 2024-04-04T06:56:50.494 INFO:teuthology.orchestra.run.smithi072.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-04T06:56:50.494 INFO:teuthology.orchestra.run.smithi072.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-04T06:56:50.495 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-04T06:56:50.495 DEBUG:teuthology.orchestra.run.smithi072:> ls /sys/fs/fuse/connections 2024-04-04T06:56:50.583 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-04-04T06:56:50.584 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-04-04T06:56:50.628 DEBUG:teuthology.orchestra.run.smithi072:> sudo modprobe fuse 2024-04-04T06:56:50.710 DEBUG:teuthology.orchestra.run.smithi072:> cat /proc/self/mounts | awk '{print $2}' 2024-04-04T06:56:50.751 INFO:teuthology.orchestra.run.smithi072.stdout:/proc 2024-04-04T06:56:50.751 INFO:teuthology.orchestra.run.smithi072.stdout:/sys 2024-04-04T06:56:50.752 INFO:teuthology.orchestra.run.smithi072.stdout:/dev 2024-04-04T06:56:50.752 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/kernel/security 2024-04-04T06:56:50.752 INFO:teuthology.orchestra.run.smithi072.stdout:/dev/shm 2024-04-04T06:56:50.752 INFO:teuthology.orchestra.run.smithi072.stdout:/dev/pts 2024-04-04T06:56:50.752 INFO:teuthology.orchestra.run.smithi072.stdout:/run 2024-04-04T06:56:50.752 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/fs/cgroup 2024-04-04T06:56:50.752 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/fs/pstore 2024-04-04T06:56:50.752 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/fs/bpf 2024-04-04T06:56:50.752 INFO:teuthology.orchestra.run.smithi072.stdout:/ 2024-04-04T06:56:50.752 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/fs/selinux 2024-04-04T06:56:50.752 INFO:teuthology.orchestra.run.smithi072.stdout:/proc/sys/fs/binfmt_misc 2024-04-04T06:56:50.752 INFO:teuthology.orchestra.run.smithi072.stdout:/dev/mqueue 2024-04-04T06:56:50.752 INFO:teuthology.orchestra.run.smithi072.stdout:/dev/hugepages 2024-04-04T06:56:50.752 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/kernel/debug 2024-04-04T06:56:50.753 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/kernel/tracing 2024-04-04T06:56:50.753 INFO:teuthology.orchestra.run.smithi072.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-04T06:56:50.753 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/fs/fuse/connections 2024-04-04T06:56:50.753 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/kernel/config 2024-04-04T06:56:50.753 INFO:teuthology.orchestra.run.smithi072.stdout:/run/credentials/systemd-sysctl.service 2024-04-04T06:56:50.753 INFO:teuthology.orchestra.run.smithi072.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-04T06:56:50.753 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/nfs/rpc_pipefs 2024-04-04T06:56:50.753 INFO:teuthology.orchestra.run.smithi072.stdout:/run/user/1000 2024-04-04T06:56:50.753 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/ceph 2024-04-04T06:56:50.753 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/ceph/osd/ceph-0 2024-04-04T06:56:50.753 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/ceph/osd/ceph-1 2024-04-04T06:56:50.753 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/ceph/osd/ceph-2 2024-04-04T06:56:50.753 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/ceph/osd/ceph-3 2024-04-04T06:56:50.753 INFO:teuthology.orchestra.run.smithi072.stdout:/run/netns 2024-04-04T06:56:50.754 INFO:teuthology.orchestra.run.smithi072.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-04T06:56:50.754 INFO:teuthology.orchestra.run.smithi072.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-04T06:56:50.755 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-04T06:56:50.755 DEBUG:teuthology.orchestra.run.smithi072:> ls /sys/fs/fuse/connections 2024-04-04T06:56:50.823 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi072.stderr:2024-04-04T06:56:50.823+0000 7ffa6663e480 -1 init, newargv = 0x5602f5c30840 newargc=15 2024-04-04T06:56:50.823 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi072.stderr:ceph-fuse[45288]: starting ceph client 2024-04-04T06:56:50.836 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi072.stderr:ceph-fuse[45288]: starting fuse 2024-04-04T06:56:50.844 INFO:teuthology.orchestra.run.smithi072.stdout:42 2024-04-04T06:56:50.844 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [42] 2024-04-04T06:56:50.844 DEBUG:teuthology.orchestra.run.smithi072:> sudo stdin-killer -- python3 -c ' 2024-04-04T06:56:50.844 DEBUG:teuthology.orchestra.run.smithi072:> import glob 2024-04-04T06:56:50.844 DEBUG:teuthology.orchestra.run.smithi072:> import re 2024-04-04T06:56:50.845 DEBUG:teuthology.orchestra.run.smithi072:> import os 2024-04-04T06:56:50.845 DEBUG:teuthology.orchestra.run.smithi072:> import subprocess 2024-04-04T06:56:50.845 DEBUG:teuthology.orchestra.run.smithi072:> 2024-04-04T06:56:50.845 DEBUG:teuthology.orchestra.run.smithi072:> def _find_admin_socket(client_name): 2024-04-04T06:56:50.845 DEBUG:teuthology.orchestra.run.smithi072:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-04-04T06:56:50.845 DEBUG:teuthology.orchestra.run.smithi072:> files = glob.glob(asok_path) 2024-04-04T06:56:50.845 DEBUG:teuthology.orchestra.run.smithi072:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-04-04T06:56:50.845 DEBUG:teuthology.orchestra.run.smithi072:> 2024-04-04T06:56:50.845 DEBUG:teuthology.orchestra.run.smithi072:> # Given a non-glob path, it better be there 2024-04-04T06:56:50.845 DEBUG:teuthology.orchestra.run.smithi072:> if "*" not in asok_path: 2024-04-04T06:56:50.845 DEBUG:teuthology.orchestra.run.smithi072:> assert(len(files) == 1) 2024-04-04T06:56:50.845 DEBUG:teuthology.orchestra.run.smithi072:> return files[0] 2024-04-04T06:56:50.845 DEBUG:teuthology.orchestra.run.smithi072:> 2024-04-04T06:56:50.845 DEBUG:teuthology.orchestra.run.smithi072:> for f in files: 2024-04-04T06:56:50.845 DEBUG:teuthology.orchestra.run.smithi072:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-04T06:56:50.845 DEBUG:teuthology.orchestra.run.smithi072:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-04T06:56:50.846 DEBUG:teuthology.orchestra.run.smithi072:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-04T06:56:50.846 DEBUG:teuthology.orchestra.run.smithi072:> contents = proc_f.read() 2024-04-04T06:56:50.846 DEBUG:teuthology.orchestra.run.smithi072:> if mountpoint in contents: 2024-04-04T06:56:50.846 DEBUG:teuthology.orchestra.run.smithi072:> return f 2024-04-04T06:56:50.846 DEBUG:teuthology.orchestra.run.smithi072:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-04T06:56:50.846 DEBUG:teuthology.orchestra.run.smithi072:> 2024-04-04T06:56:50.846 DEBUG:teuthology.orchestra.run.smithi072:> print(_find_admin_socket("client.0")) 2024-04-04T06:56:50.846 DEBUG:teuthology.orchestra.run.smithi072:> ' 2024-04-04T06:56:51.031 INFO:teuthology.orchestra.run.smithi072.stdout:/var/run/ceph/ceph-client.0.45288.asok 2024-04-04T06:56:51.035 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-04T06:56:51.046 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.45288.asok 2024-04-04T06:56:51.046 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-04T06:56:51.046 DEBUG:teuthology.orchestra.run.smithi072:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.45288.asok status 2024-04-04T06:56:51.275 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-04T06:56:51.275 INFO:teuthology.orchestra.run.smithi072.stdout: "metadata": { 2024-04-04T06:56:51.275 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph_sha1": "addbc488dc763e752c640619b677f10e0da02c9f", 2024-04-04T06:56:51.275 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph_version": "ceph version 19.0.0-2571-gaddbc488 (addbc488dc763e752c640619b677f10e0da02c9f) squid (dev)", 2024-04-04T06:56:51.275 INFO:teuthology.orchestra.run.smithi072.stdout: "entity_id": "0", 2024-04-04T06:56:51.275 INFO:teuthology.orchestra.run.smithi072.stdout: "hostname": "smithi072", 2024-04-04T06:56:51.275 INFO:teuthology.orchestra.run.smithi072.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-04-04T06:56:51.275 INFO:teuthology.orchestra.run.smithi072.stdout: "pid": "45288", 2024-04-04T06:56:51.275 INFO:teuthology.orchestra.run.smithi072.stdout: "root": "/" 2024-04-04T06:56:51.275 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-04T06:56:51.275 INFO:teuthology.orchestra.run.smithi072.stdout: "dentry_count": 0, 2024-04-04T06:56:51.276 INFO:teuthology.orchestra.run.smithi072.stdout: "dentry_pinned_count": 0, 2024-04-04T06:56:51.276 INFO:teuthology.orchestra.run.smithi072.stdout: "id": 4567, 2024-04-04T06:56:51.276 INFO:teuthology.orchestra.run.smithi072.stdout: "inst": { 2024-04-04T06:56:51.276 INFO:teuthology.orchestra.run.smithi072.stdout: "name": { 2024-04-04T06:56:51.276 INFO:teuthology.orchestra.run.smithi072.stdout: "type": "client", 2024-04-04T06:56:51.276 INFO:teuthology.orchestra.run.smithi072.stdout: "num": 4567 2024-04-04T06:56:51.276 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-04T06:56:51.276 INFO:teuthology.orchestra.run.smithi072.stdout: "addr": { 2024-04-04T06:56:51.276 INFO:teuthology.orchestra.run.smithi072.stdout: "type": "v1", 2024-04-04T06:56:51.276 INFO:teuthology.orchestra.run.smithi072.stdout: "addr": "172.21.15.72:0", 2024-04-04T06:56:51.276 INFO:teuthology.orchestra.run.smithi072.stdout: "nonce": 556692292 2024-04-04T06:56:51.276 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-04T06:56:51.276 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-04T06:56:51.276 INFO:teuthology.orchestra.run.smithi072.stdout: "addr": { 2024-04-04T06:56:51.276 INFO:teuthology.orchestra.run.smithi072.stdout: "type": "v1", 2024-04-04T06:56:51.277 INFO:teuthology.orchestra.run.smithi072.stdout: "addr": "172.21.15.72:0", 2024-04-04T06:56:51.277 INFO:teuthology.orchestra.run.smithi072.stdout: "nonce": 556692292 2024-04-04T06:56:51.277 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-04T06:56:51.277 INFO:teuthology.orchestra.run.smithi072.stdout: "inst_str": "client.4567 172.21.15.72:0/556692292", 2024-04-04T06:56:51.277 INFO:teuthology.orchestra.run.smithi072.stdout: "addr_str": "172.21.15.72:0/556692292", 2024-04-04T06:56:51.277 INFO:teuthology.orchestra.run.smithi072.stdout: "inode_count": 1, 2024-04-04T06:56:51.277 INFO:teuthology.orchestra.run.smithi072.stdout: "mds_epoch": 8, 2024-04-04T06:56:51.277 INFO:teuthology.orchestra.run.smithi072.stdout: "osd_epoch": 20, 2024-04-04T06:56:51.277 INFO:teuthology.orchestra.run.smithi072.stdout: "osd_epoch_barrier": 0, 2024-04-04T06:56:51.277 INFO:teuthology.orchestra.run.smithi072.stdout: "blocklisted": false, 2024-04-04T06:56:51.277 INFO:teuthology.orchestra.run.smithi072.stdout: "fs_name": "cephfs" 2024-04-04T06:56:51.277 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-04T06:56:51.290 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-04T06:56:51.490 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:51.491+0000 7fd102c00640 1 Processor -- start 2024-04-04T06:56:51.490 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:51.491+0000 7fd102c00640 1 -- start start 2024-04-04T06:56:51.492 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:51.493+0000 7fd102c00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd0fc15e630 0x7fd0fc0d22c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:51.492 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:51.493+0000 7fd102c00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fd0fc0b9f40 0x7fd0fc0cf010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:51.492 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:51.493+0000 7fd102c00640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0fc0d2c30 con 0x7fd0fc0d3cd0 2024-04-04T06:56:51.492 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:51.493+0000 7fd102c00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fd0fc0b8380 con 0x7fd0fc0b9f40 2024-04-04T06:56:51.492 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:51.493+0000 7fd102c00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fd0fc0d2f10 con 0x7fd0fc15e630 2024-04-04T06:56:51.493 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:51.493+0000 7fd102200640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fd0fc0d3cd0 0x7fd0fc071a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:47160/0 (socket says 172.21.15.72:47160) 2024-04-04T06:56:51.493 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:51.493+0000 7fd102200640 1 -- 172.21.15.72:0/2949319374 learned_addr learned my addr 172.21.15.72:0/2949319374 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-04-04T06:56:51.493 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:51.493+0000 7fd101800640 1 --2- 172.21.15.72:0/2949319374 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd0fc15e630 0x7fd0fc0d22c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:51.493 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:51.493+0000 7fd100e00640 1 --2- 172.21.15.72:0/2949319374 >> v2:172.21.15.117:3300/0 conn(0x7fd0fc0b9f40 0x7fd0fc0cf010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:51.493 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:51.494+0000 7fd0fbe00640 1 -- 172.21.15.72:0/2949319374 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3793172193 0 0) 0x7fd0fc0d2c30 con 0x7fd0fc0d3cd0 2024-04-04T06:56:51.493 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:51.494+0000 7fd0fbe00640 1 -- 172.21.15.72:0/2949319374 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd0e4003520 con 0x7fd0fc0d3cd0 2024-04-04T06:56:51.494 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:51.494+0000 7fd0fbe00640 1 -- 172.21.15.72:0/2949319374 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3360626326 0 0) 0x7fd0e4003520 con 0x7fd0fc0d3cd0 2024-04-04T06:56:51.494 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:51.494+0000 7fd0fbe00640 1 -- 172.21.15.72:0/2949319374 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd0fc15e630 msgr2=0x7fd0fc0d22c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:56:51.494 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:51.494+0000 7fd0fbe00640 1 --2- 172.21.15.72:0/2949319374 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd0fc15e630 0x7fd0fc0d22c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:51.495 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:51.494+0000 7fd0fbe00640 1 -- 172.21.15.72:0/2949319374 >> v2:172.21.15.117:3300/0 conn(0x7fd0fc0b9f40 msgr2=0x7fd0fc0cf010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:56:51.495 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:51.494+0000 7fd0fbe00640 1 --2- 172.21.15.72:0/2949319374 >> v2:172.21.15.117:3300/0 conn(0x7fd0fc0b9f40 0x7fd0fc0cf010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:51.495 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:51.494+0000 7fd0fbe00640 1 -- 172.21.15.72:0/2949319374 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0fc0d31f0 con 0x7fd0fc0d3cd0 2024-04-04T06:56:51.495 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:51.494+0000 7fd0fbe00640 1 -- 172.21.15.72:0/2949319374 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2465650867 0 0) 0x7fd0f40019f0 con 0x7fd0fc0d3cd0 2024-04-04T06:56:51.495 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:51.494+0000 7fd0fbe00640 1 -- 172.21.15.72:0/2949319374 >> v1:172.21.15.72:6789/0 conn(0x7fd0fc0d3cd0 legacy=0x7fd0fc071a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:51.495 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:51.494+0000 7fd0fbe00640 1 --2- 172.21.15.72:0/2949319374 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd0fc15e630 0x7fd0e40039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:51.495 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:51.495+0000 7fd0fbe00640 1 --2- 172.21.15.72:0/2949319374 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd0e4003f80 0x7fd0e4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:51.495 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:51.495+0000 7fd0fbe00640 1 --2- 172.21.15.72:0/2949319374 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd0e4004d40 0x7fd0e40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:51.495 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:51.495+0000 7fd0fbe00640 1 -- 172.21.15.72:0/2949319374 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fd0fc0b8380 con 0x7fd0e4003f80 2024-04-04T06:56:51.495 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:51.495+0000 7fd0fbe00640 1 -- 172.21.15.72:0/2949319374 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fd0fc0d2f10 con 0x7fd0e4004d40 2024-04-04T06:56:51.496 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:51.495+0000 7fd0fbe00640 1 -- 172.21.15.72:0/2949319374 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fd0e400ba70 con 0x7fd0fc15e630 2024-04-04T06:56:51.496 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:51.495+0000 7fd100e00640 1 --2- 172.21.15.72:0/2949319374 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd0e4003f80 0x7fd0e4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:51.496 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:51.495+0000 7fd101800640 1 --2- 172.21.15.72:0/2949319374 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd0fc15e630 0x7fd0e40039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:51.496 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:51.495+0000 7fd102200640 1 --2- 172.21.15.72:0/2949319374 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd0e4004d40 0x7fd0e40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:51.496 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:51.495+0000 7fd100e00640 1 -- 172.21.15.72:0/2949319374 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd0fc15e630 msgr2=0x7fd0e40039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:56:51.496 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:51.495+0000 7fd100e00640 1 --2- 172.21.15.72:0/2949319374 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd0fc15e630 0x7fd0e40039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:51.496 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:51.495+0000 7fd100e00640 1 -- 172.21.15.72:0/2949319374 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd0e4004d40 msgr2=0x7fd0e40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:56:51.496 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:51.495+0000 7fd100e00640 1 --2- 172.21.15.72:0/2949319374 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd0e4004d40 0x7fd0e40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:51.496 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:51.495+0000 7fd100e00640 1 -- 172.21.15.72:0/2949319374 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0e4003520 con 0x7fd0e4003f80 2024-04-04T06:56:51.498 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:51.496+0000 7fd100e00640 1 --2- 172.21.15.72:0/2949319374 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd0e4003f80 0x7fd0e4004800 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fd0e8009ac0 tx=0x7fd0e4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a989e2c910eb2432 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:51.498 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:51.497+0000 7fd0fbe00640 1 -- 172.21.15.72:0/2949319374 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0e8039070 con 0x7fd0e4003f80 2024-04-04T06:56:51.498 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:51.497+0000 7fd0fbe00640 1 -- 172.21.15.72:0/2949319374 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0e802c710 con 0x7fd0e4003f80 2024-04-04T06:56:51.498 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:51.497+0000 7fd0fbe00640 1 -- 172.21.15.72:0/2949319374 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0e8009690 con 0x7fd0e4003f80 2024-04-04T06:56:51.498 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:51.497+0000 7fd102c00640 1 -- 172.21.15.72:0/2949319374 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd0e4003f80 msgr2=0x7fd0e4004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:51.498 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:51.497+0000 7fd102c00640 1 --2- 172.21.15.72:0/2949319374 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd0e4003f80 0x7fd0e4004800 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fd0e8009ac0 tx=0x7fd0e4005830 comp rx=0 tx=0).stop 2024-04-04T06:56:51.498 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:51.497+0000 7fd102200640 1 -- 172.21.15.72:0/2949319374 reap_dead start 2024-04-04T06:56:51.498 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:51.497+0000 7fd102c00640 1 -- 172.21.15.72:0/2949319374 shutdown_connections 2024-04-04T06:56:51.498 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:51.497+0000 7fd102c00640 1 -- 172.21.15.72:0/2949319374 >> 172.21.15.72:0/2949319374 conn(0x7fd0fc06b860 msgr2=0x7fd0fc06bc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:56:51.498 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:51.497+0000 7fd102c00640 1 -- 172.21.15.72:0/2949319374 shutdown_connections 2024-04-04T06:56:51.499 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:51.498+0000 7fd102c00640 1 -- 172.21.15.72:0/2949319374 wait complete. 2024-04-04T06:56:51.499 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:51.499+0000 7fd102c00640 1 Processor -- start 2024-04-04T06:56:51.499 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:51.499+0000 7fd102c00640 1 -- start start 2024-04-04T06:56:51.501 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:51.500+0000 7fd102c00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd0e4003f80 0x7fd0fc151640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:51.501 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:51.500+0000 7fd102c00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd0fc160930 0x7fd0fc0cd6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:51.501 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:51.500+0000 7fd102c00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd0fc0cdc00 0x7fd0fc0d1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:51.501 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:51.500+0000 7fd102c00640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fd0fc0cf550 con 0x7fd0fc0cdc00 2024-04-04T06:56:51.501 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:51.500+0000 7fd102c00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fd0fc0d37b0 con 0x7fd0fc160930 2024-04-04T06:56:51.501 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:51.500+0000 7fd102c00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fd0fc0cf6d0 con 0x7fd0e4003f80 2024-04-04T06:56:51.501 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:51.501+0000 7fd102200640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd0fc0cdc00 0x7fd0fc0d1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:51.501 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:51.501+0000 7fd102200640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd0fc0cdc00 0x7fd0fc0d1dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:50916/0 (socket says 172.21.15.72:50916) 2024-04-04T06:56:51.501 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:51.501+0000 7fd102200640 1 -- 172.21.15.72:0/3297815831 learned_addr learned my addr 172.21.15.72:0/3297815831 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:56:51.501 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:51.501+0000 7fd100e00640 1 --2- 172.21.15.72:0/3297815831 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd0fc160930 0x7fd0fc0cd6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:51.501 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:51.501+0000 7fd101800640 1 --2- 172.21.15.72:0/3297815831 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd0e4003f80 0x7fd0fc151640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:51.502 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:51.501+0000 7fd102200640 1 -- 172.21.15.72:0/3297815831 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd0e4003f80 msgr2=0x7fd0fc151640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:51.502 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:51.501+0000 7fd102200640 1 --2- 172.21.15.72:0/3297815831 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd0e4003f80 0x7fd0fc151640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:51.502 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:51.501+0000 7fd102200640 1 -- 172.21.15.72:0/3297815831 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd0fc160930 msgr2=0x7fd0fc0cd6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:51.502 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:51.501+0000 7fd102200640 1 --2- 172.21.15.72:0/3297815831 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd0fc160930 0x7fd0fc0cd6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:51.502 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:51.501+0000 7fd102200640 1 -- 172.21.15.72:0/3297815831 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0fc15f890 con 0x7fd0fc0cdc00 2024-04-04T06:56:51.502 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:51.501+0000 7fd100e00640 1 --2- 172.21.15.72:0/3297815831 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd0fc160930 0x7fd0fc0cd6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-04T06:56:51.502 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:51.501+0000 7fd102200640 1 --2- 172.21.15.72:0/3297815831 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd0fc0cdc00 0x7fd0fc0d1dc0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fd0f40013d0 tx=0x7fd0f400e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:51.502 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:51.502+0000 7fd0f9600640 1 -- 172.21.15.72:0/3297815831 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0f400ec10 con 0x7fd0fc0cdc00 2024-04-04T06:56:51.502 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:51.502+0000 7fd0f9600640 1 -- 172.21.15.72:0/3297815831 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0f4018070 con 0x7fd0fc0cdc00 2024-04-04T06:56:51.502 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:51.502+0000 7fd0f9600640 1 -- 172.21.15.72:0/3297815831 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0f4013420 con 0x7fd0fc0cdc00 2024-04-04T06:56:51.502 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:51.502+0000 7fd102c00640 1 -- 172.21.15.72:0/3297815831 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0fc15fb70 con 0x7fd0fc0cdc00 2024-04-04T06:56:51.502 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:51.502+0000 7fd102c00640 1 -- 172.21.15.72:0/3297815831 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0fc160130 con 0x7fd0fc0cdc00 2024-04-04T06:56:51.503 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:51.503+0000 7fd102c00640 1 -- 172.21.15.72:0/3297815831 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd0fc0756c0 con 0x7fd0fc0cdc00 2024-04-04T06:56:51.503 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:51.505+0000 7fd0f9600640 1 -- 172.21.15.72:0/3297815831 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd0f40135c0 con 0x7fd0fc0cdc00 2024-04-04T06:56:51.504 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:51.506+0000 7fd0f9600640 1 --2- 172.21.15.72:0/3297815831 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fd0dc06c8f0 0x7fd0dc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:51.505 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:51.506+0000 7fd0f9600640 1 -- 172.21.15.72:0/3297815831 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fd0f408bfe0 con 0x7fd0fc0cdc00 2024-04-04T06:56:51.505 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:51.506+0000 7fd101800640 1 --2- 172.21.15.72:0/3297815831 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fd0dc06c8f0 0x7fd0dc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:51.505 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:51.507+0000 7fd101800640 1 --2- 172.21.15.72:0/3297815831 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fd0dc06c8f0 0x7fd0dc06edb0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fd0f0009930 tx=0x7fd0f0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:51.510 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:51.512+0000 7fd0f9600640 1 -- 172.21.15.72:0/3297815831 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fd0f405a3b0 con 0x7fd0fc0cdc00 2024-04-04T06:56:51.751 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:51.752+0000 7fd102c00640 1 -- 172.21.15.72:0/3297815831 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fd0fc0d5120 con 0x7fd0fc0cdc00 2024-04-04T06:56:51.751 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:51.753+0000 7fd0f9600640 1 -- 172.21.15.72:0/3297815831 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+73 (secure 0 0 0) 0x7fd0f4059cb0 con 0x7fd0fc0cdc00 2024-04-04T06:56:51.752 INFO:teuthology.orchestra.run.smithi072.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-04T06:56:51.755 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:51.756+0000 7fd102c00640 1 -- 172.21.15.72:0/3297815831 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fd0dc06c8f0 msgr2=0x7fd0dc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:51.755 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:51.756+0000 7fd102c00640 1 --2- 172.21.15.72:0/3297815831 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fd0dc06c8f0 0x7fd0dc06edb0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fd0f0009930 tx=0x7fd0f0008040 comp rx=0 tx=0).stop 2024-04-04T06:56:51.755 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:51.756+0000 7fd102c00640 1 -- 172.21.15.72:0/3297815831 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd0fc0cdc00 msgr2=0x7fd0fc0d1dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:51.755 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:51.756+0000 7fd102c00640 1 --2- 172.21.15.72:0/3297815831 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd0fc0cdc00 0x7fd0fc0d1dc0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fd0f40013d0 tx=0x7fd0f400e530 comp rx=0 tx=0).stop 2024-04-04T06:56:51.755 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:51.756+0000 7fd102c00640 1 -- 172.21.15.72:0/3297815831 shutdown_connections 2024-04-04T06:56:51.755 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:51.756+0000 7fd102c00640 1 --2- 172.21.15.72:0/3297815831 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fd0dc06c8f0 0x7fd0dc06edb0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:51.755 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:51.756+0000 7fd102c00640 1 --2- 172.21.15.72:0/3297815831 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd0fc0cdc00 0x7fd0fc0d1dc0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:51.755 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:51.756+0000 7fd102c00640 1 --2- 172.21.15.72:0/3297815831 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd0fc160930 0x7fd0fc0cd6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:51.755 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:51.756+0000 7fd102c00640 1 --2- 172.21.15.72:0/3297815831 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd0e4003f80 0x7fd0fc151640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:51.755 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:51.756+0000 7fd102c00640 1 -- 172.21.15.72:0/3297815831 >> 172.21.15.72:0/3297815831 conn(0x7fd0fc06b860 msgr2=0x7fd0fc0ca570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:56:51.755 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:51.756+0000 7fd102c00640 1 -- 172.21.15.72:0/3297815831 shutdown_connections 2024-04-04T06:56:51.755 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:51.756+0000 7fd102c00640 1 -- 172.21.15.72:0/3297815831 wait complete. 2024-04-04T06:56:51.779 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-04T06:56:51.779 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-04T06:56:51.779 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi072.front.sepia.ceph.com 2024-04-04T06:56:51.779 INFO:tasks.cephfs.mount:self.client.name = client.2 2024-04-04T06:56:51.780 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-04-04T06:56:51.780 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-04T06:56:51.780 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-04T06:56:51.780 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-04T06:56:51.780 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2024-04-04T06:56:51.780 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-04T06:56:51.780 DEBUG:teuthology.orchestra.run.smithi072:> ip addr 2024-04-04T06:56:51.824 INFO:teuthology.orchestra.run.smithi072.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-04T06:56:51.825 INFO:teuthology.orchestra.run.smithi072.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-04T06:56:51.825 INFO:teuthology.orchestra.run.smithi072.stdout: inet 127.0.0.1/8 scope host lo 2024-04-04T06:56:51.825 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2024-04-04T06:56:51.825 INFO:teuthology.orchestra.run.smithi072.stdout: inet6 ::1/128 scope host 2024-04-04T06:56:51.825 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2024-04-04T06:56:51.825 INFO:teuthology.orchestra.run.smithi072.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-04T06:56:51.825 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0c:c4:7a:d8:da:f4 brd ff:ff:ff:ff:ff:ff 2024-04-04T06:56:51.825 INFO:teuthology.orchestra.run.smithi072.stdout: altname enp7s0f0 2024-04-04T06:56:51.825 INFO:teuthology.orchestra.run.smithi072.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-04T06:56:51.825 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0c:c4:7a:d8:da:f5 brd ff:ff:ff:ff:ff:ff 2024-04-04T06:56:51.825 INFO:teuthology.orchestra.run.smithi072.stdout: altname enp7s0f1 2024-04-04T06:56:51.825 INFO:teuthology.orchestra.run.smithi072.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-04T06:56:51.826 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0c:c4:7a:8f:b7:64 brd ff:ff:ff:ff:ff:ff 2024-04-04T06:56:51.826 INFO:teuthology.orchestra.run.smithi072.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-04T06:56:51.826 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0c:c4:7a:8f:b7:65 brd ff:ff:ff:ff:ff:ff 2024-04-04T06:56:51.826 INFO:teuthology.orchestra.run.smithi072.stdout: inet 172.21.15.72/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-04-04T06:56:51.826 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft 42535sec preferred_lft 42535sec 2024-04-04T06:56:51.826 INFO:teuthology.orchestra.run.smithi072.stdout: inet6 fe80::ec4:7aff:fe8f:b765/64 scope link 2024-04-04T06:56:51.826 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2024-04-04T06:56:51.826 INFO:teuthology.orchestra.run.smithi072.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-04T06:56:51.826 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 26:b3:cf:c4:3e:e9 brd ff:ff:ff:ff:ff:ff 2024-04-04T06:56:51.826 INFO:teuthology.orchestra.run.smithi072.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-04T06:56:51.826 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2024-04-04T06:56:51.826 INFO:teuthology.orchestra.run.smithi072.stdout: inet6 fe80::10cc:28ff:fe50:2df/64 scope link 2024-04-04T06:56:51.826 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2024-04-04T06:56:51.826 INFO:teuthology.orchestra.run.smithi072.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-04T06:56:51.827 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 26:b3:cf:c4:3e:e9 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-04T06:56:51.827 INFO:teuthology.orchestra.run.smithi072.stdout: inet6 fe80::24b3:cfff:fec4:3ee9/64 scope link 2024-04-04T06:56:51.827 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2024-04-04T06:56:51.827 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-04T06:56:51.827 DEBUG:teuthology.orchestra.run.smithi072:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-04T06:56:51.946 INFO:teuthology.orchestra.run.smithi072.stdout:1 2024-04-04T06:56:51.950 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-04T06:56:51.950 DEBUG:teuthology.orchestra.run.smithi072:> route 2024-04-04T06:56:51.999 INFO:teuthology.orchestra.run.smithi072.stdout:Kernel IP routing table 2024-04-04T06:56:51.999 INFO:teuthology.orchestra.run.smithi072.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-04T06:56:51.999 INFO:teuthology.orchestra.run.smithi072.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-04T06:56:51.999 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-04T06:56:51.999 INFO:teuthology.orchestra.run.smithi072.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-04T06:56:51.999 DEBUG:teuthology.orchestra.run.smithi072:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-04T06:56:51.999 DEBUG:teuthology.orchestra.run.smithi072:> set -e 2024-04-04T06:56:51.999 DEBUG:teuthology.orchestra.run.smithi072:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-04T06:56:52.000 DEBUG:teuthology.orchestra.run.smithi072:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-04T06:56:52.000 DEBUG:teuthology.orchestra.run.smithi072:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-04T06:56:52.000 DEBUG:teuthology.orchestra.run.smithi072:> ') 2024-04-04T06:56:52.096 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:52 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-04T06:56:52.230 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-04T06:56:52.240 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-04T06:56:52.240 DEBUG:teuthology.orchestra.run.smithi072:> ip netns list 2024-04-04T06:56:52.281 INFO:teuthology.orchestra.run.smithi072.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-04T06:56:52.282 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-04T06:56:52.282 DEBUG:teuthology.orchestra.run.smithi072:> ip netns list-id 2024-04-04T06:56:52.374 INFO:teuthology.orchestra.run.smithi072.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2024-04-04T06:56:52.376 DEBUG:teuthology.orchestra.run.smithi072:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-04T06:56:52.376 DEBUG:teuthology.orchestra.run.smithi072:> set -e 2024-04-04T06:56:52.376 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-04T06:56:52.376 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2024-04-04T06:56:52.376 DEBUG:teuthology.orchestra.run.smithi072:> ') 2024-04-04T06:56:52.481 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:52 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-04T06:56:52.570 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-04T06:56:52.579 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-04T06:56:52.579 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-04-04T06:56:52.669 INFO:teuthology.orchestra.run.smithi072.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-04T06:56:52.669 INFO:teuthology.orchestra.run.smithi072.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-04T06:56:52.669 INFO:teuthology.orchestra.run.smithi072.stdout: inet 127.0.0.1/8 scope host lo 2024-04-04T06:56:52.669 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2024-04-04T06:56:52.669 INFO:teuthology.orchestra.run.smithi072.stdout: inet6 ::1/128 scope host 2024-04-04T06:56:52.669 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2024-04-04T06:56:52.670 INFO:teuthology.orchestra.run.smithi072.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-04T06:56:52.670 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 16:67:b3:51:dc:da brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-04-04T06:56:52.670 INFO:teuthology.orchestra.run.smithi072.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-04-04T06:56:52.670 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2024-04-04T06:56:52.670 INFO:teuthology.orchestra.run.smithi072.stdout: inet6 fe80::1467:b3ff:fe51:dcda/64 scope link 2024-04-04T06:56:52.670 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2024-04-04T06:56:52.674 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-04T06:56:52.674 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-04-04T06:56:52.757 INFO:teuthology.orchestra.run.smithi072.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-04T06:56:52.757 INFO:teuthology.orchestra.run.smithi072.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-04T06:56:52.757 INFO:teuthology.orchestra.run.smithi072.stdout: inet 127.0.0.1/8 scope host lo 2024-04-04T06:56:52.757 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2024-04-04T06:56:52.758 INFO:teuthology.orchestra.run.smithi072.stdout: inet6 ::1/128 scope host 2024-04-04T06:56:52.758 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2024-04-04T06:56:52.758 INFO:teuthology.orchestra.run.smithi072.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-04T06:56:52.758 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 16:67:b3:51:dc:da brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-04-04T06:56:52.758 INFO:teuthology.orchestra.run.smithi072.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-04-04T06:56:52.758 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2024-04-04T06:56:52.758 INFO:teuthology.orchestra.run.smithi072.stdout: inet6 fe80::1467:b3ff:fe51:dcda/64 scope link 2024-04-04T06:56:52.758 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2024-04-04T06:56:52.761 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2024-04-04T06:56:52.762 DEBUG:teuthology.orchestra.run.smithi072:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-04T06:56:52.762 DEBUG:teuthology.orchestra.run.smithi072:> set -e 2024-04-04T06:56:52.762 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2024-04-04T06:56:52.762 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-04-04T06:56:52.762 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2024-04-04T06:56:52.762 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2024-04-04T06:56:52.762 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2024-04-04T06:56:52.762 DEBUG:teuthology.orchestra.run.smithi072:> ') 2024-04-04T06:56:52.860 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:52 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-04T06:56:53.068 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-04T06:56:53.077 DEBUG:teuthology.orchestra.run.smithi072:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-04T06:56:53.077 DEBUG:teuthology.orchestra.run.smithi072:> set -e 2024-04-04T06:56:53.077 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip link set brx.1 up 2024-04-04T06:56:53.078 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip link set dev brx.1 master ceph-brx 2024-04-04T06:56:53.078 DEBUG:teuthology.orchestra.run.smithi072:> ') 2024-04-04T06:56:53.171 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:53 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-04T06:56:53.282 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-04T06:56:53.291 INFO:tasks.cephfs.fuse_mount:Client client.2 config is {} 2024-04-04T06:56:53.291 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-04T06:56:53.291 DEBUG:teuthology.orchestra.run.smithi072:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2024-04-04T06:56:53.330 INFO:teuthology.orchestra.run.smithi072.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2024-04-04T06:56:53.330 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-04T06:56:53.330 DEBUG:teuthology.orchestra.run.smithi072:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2024-04-04T06:56:53.416 DEBUG:teuthology.orchestra.run.smithi072:> sudo modprobe fuse 2024-04-04T06:56:53.543 DEBUG:teuthology.orchestra.run.smithi072:> cat /proc/self/mounts | awk '{print $2}' 2024-04-04T06:56:53.596 INFO:teuthology.orchestra.run.smithi072.stdout:/proc 2024-04-04T06:56:53.596 INFO:teuthology.orchestra.run.smithi072.stdout:/sys 2024-04-04T06:56:53.596 INFO:teuthology.orchestra.run.smithi072.stdout:/dev 2024-04-04T06:56:53.596 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/kernel/security 2024-04-04T06:56:53.596 INFO:teuthology.orchestra.run.smithi072.stdout:/dev/shm 2024-04-04T06:56:53.596 INFO:teuthology.orchestra.run.smithi072.stdout:/dev/pts 2024-04-04T06:56:53.596 INFO:teuthology.orchestra.run.smithi072.stdout:/run 2024-04-04T06:56:53.596 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/fs/cgroup 2024-04-04T06:56:53.597 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/fs/pstore 2024-04-04T06:56:53.597 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/fs/bpf 2024-04-04T06:56:53.597 INFO:teuthology.orchestra.run.smithi072.stdout:/ 2024-04-04T06:56:53.597 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/fs/selinux 2024-04-04T06:56:53.597 INFO:teuthology.orchestra.run.smithi072.stdout:/proc/sys/fs/binfmt_misc 2024-04-04T06:56:53.597 INFO:teuthology.orchestra.run.smithi072.stdout:/dev/mqueue 2024-04-04T06:56:53.597 INFO:teuthology.orchestra.run.smithi072.stdout:/dev/hugepages 2024-04-04T06:56:53.597 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/kernel/debug 2024-04-04T06:56:53.597 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/kernel/tracing 2024-04-04T06:56:53.597 INFO:teuthology.orchestra.run.smithi072.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-04T06:56:53.597 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/fs/fuse/connections 2024-04-04T06:56:53.597 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/kernel/config 2024-04-04T06:56:53.597 INFO:teuthology.orchestra.run.smithi072.stdout:/run/credentials/systemd-sysctl.service 2024-04-04T06:56:53.597 INFO:teuthology.orchestra.run.smithi072.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-04T06:56:53.597 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/nfs/rpc_pipefs 2024-04-04T06:56:53.598 INFO:teuthology.orchestra.run.smithi072.stdout:/run/user/1000 2024-04-04T06:56:53.598 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/ceph 2024-04-04T06:56:53.598 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/ceph/osd/ceph-0 2024-04-04T06:56:53.598 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/ceph/osd/ceph-1 2024-04-04T06:56:53.598 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/ceph/osd/ceph-2 2024-04-04T06:56:53.598 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/ceph/osd/ceph-3 2024-04-04T06:56:53.598 INFO:teuthology.orchestra.run.smithi072.stdout:/run/netns 2024-04-04T06:56:53.598 INFO:teuthology.orchestra.run.smithi072.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-04T06:56:53.598 INFO:teuthology.orchestra.run.smithi072.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-04T06:56:53.598 INFO:teuthology.orchestra.run.smithi072.stdout:/home/ubuntu/cephtest/mnt.0 2024-04-04T06:56:53.598 INFO:teuthology.orchestra.run.smithi072.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-04T06:56:53.598 INFO:teuthology.orchestra.run.smithi072.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-04T06:56:53.599 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-04T06:56:53.599 DEBUG:teuthology.orchestra.run.smithi072:> ls /sys/fs/fuse/connections 2024-04-04T06:56:53.642 INFO:teuthology.orchestra.run.smithi072.stdout:42 2024-04-04T06:56:53.643 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [42] 2024-04-04T06:56:53.643 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.2 --id 2) 2024-04-04T06:56:53.689 DEBUG:teuthology.orchestra.run.smithi072:> sudo modprobe fuse 2024-04-04T06:56:53.775 DEBUG:teuthology.orchestra.run.smithi072:> cat /proc/self/mounts | awk '{print $2}' 2024-04-04T06:56:53.816 INFO:teuthology.orchestra.run.smithi072.stdout:/proc 2024-04-04T06:56:53.816 INFO:teuthology.orchestra.run.smithi072.stdout:/sys 2024-04-04T06:56:53.817 INFO:teuthology.orchestra.run.smithi072.stdout:/dev 2024-04-04T06:56:53.817 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/kernel/security 2024-04-04T06:56:53.817 INFO:teuthology.orchestra.run.smithi072.stdout:/dev/shm 2024-04-04T06:56:53.817 INFO:teuthology.orchestra.run.smithi072.stdout:/dev/pts 2024-04-04T06:56:53.817 INFO:teuthology.orchestra.run.smithi072.stdout:/run 2024-04-04T06:56:53.817 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/fs/cgroup 2024-04-04T06:56:53.817 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/fs/pstore 2024-04-04T06:56:53.817 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/fs/bpf 2024-04-04T06:56:53.817 INFO:teuthology.orchestra.run.smithi072.stdout:/ 2024-04-04T06:56:53.817 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/fs/selinux 2024-04-04T06:56:53.817 INFO:teuthology.orchestra.run.smithi072.stdout:/proc/sys/fs/binfmt_misc 2024-04-04T06:56:53.817 INFO:teuthology.orchestra.run.smithi072.stdout:/dev/mqueue 2024-04-04T06:56:53.818 INFO:teuthology.orchestra.run.smithi072.stdout:/dev/hugepages 2024-04-04T06:56:53.818 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/kernel/debug 2024-04-04T06:56:53.818 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/kernel/tracing 2024-04-04T06:56:53.818 INFO:teuthology.orchestra.run.smithi072.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-04T06:56:53.818 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/fs/fuse/connections 2024-04-04T06:56:53.818 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/kernel/config 2024-04-04T06:56:53.818 INFO:teuthology.orchestra.run.smithi072.stdout:/run/credentials/systemd-sysctl.service 2024-04-04T06:56:53.818 INFO:teuthology.orchestra.run.smithi072.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-04T06:56:53.818 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/nfs/rpc_pipefs 2024-04-04T06:56:53.818 INFO:teuthology.orchestra.run.smithi072.stdout:/run/user/1000 2024-04-04T06:56:53.818 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/ceph 2024-04-04T06:56:53.818 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/ceph/osd/ceph-0 2024-04-04T06:56:53.819 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/ceph/osd/ceph-1 2024-04-04T06:56:53.819 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/ceph/osd/ceph-2 2024-04-04T06:56:53.819 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/ceph/osd/ceph-3 2024-04-04T06:56:53.819 INFO:teuthology.orchestra.run.smithi072.stdout:/run/netns 2024-04-04T06:56:53.819 INFO:teuthology.orchestra.run.smithi072.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-04T06:56:53.819 INFO:teuthology.orchestra.run.smithi072.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-04T06:56:53.819 INFO:teuthology.orchestra.run.smithi072.stdout:/home/ubuntu/cephtest/mnt.0 2024-04-04T06:56:53.819 INFO:teuthology.orchestra.run.smithi072.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-04T06:56:53.819 INFO:teuthology.orchestra.run.smithi072.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-04T06:56:53.820 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-04T06:56:53.821 DEBUG:teuthology.orchestra.run.smithi072:> ls /sys/fs/fuse/connections 2024-04-04T06:56:53.868 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi072.stderr:2024-04-04T06:56:53.869+0000 7fc1714b5480 -1 init, newargv = 0x5647a02d5d10 newargc=15 2024-04-04T06:56:53.868 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi072.stderr:ceph-fuse[45786]: starting ceph client 2024-04-04T06:56:53.877 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi072.stderr:ceph-fuse[45786]: starting fuse 2024-04-04T06:56:53.905 INFO:teuthology.orchestra.run.smithi072.stdout:42 2024-04-04T06:56:53.905 INFO:teuthology.orchestra.run.smithi072.stdout:43 2024-04-04T06:56:53.905 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [42, 43] 2024-04-04T06:56:53.905 DEBUG:teuthology.orchestra.run.smithi072:> sudo stdin-killer -- python3 -c ' 2024-04-04T06:56:53.905 DEBUG:teuthology.orchestra.run.smithi072:> import glob 2024-04-04T06:56:53.905 DEBUG:teuthology.orchestra.run.smithi072:> import re 2024-04-04T06:56:53.906 DEBUG:teuthology.orchestra.run.smithi072:> import os 2024-04-04T06:56:53.906 DEBUG:teuthology.orchestra.run.smithi072:> import subprocess 2024-04-04T06:56:53.906 DEBUG:teuthology.orchestra.run.smithi072:> 2024-04-04T06:56:53.906 DEBUG:teuthology.orchestra.run.smithi072:> def _find_admin_socket(client_name): 2024-04-04T06:56:53.906 DEBUG:teuthology.orchestra.run.smithi072:> asok_path = "/var/run/ceph/ceph-client.2.*.asok" 2024-04-04T06:56:53.906 DEBUG:teuthology.orchestra.run.smithi072:> files = glob.glob(asok_path) 2024-04-04T06:56:53.906 DEBUG:teuthology.orchestra.run.smithi072:> mountpoint = "/home/ubuntu/cephtest/mnt.2" 2024-04-04T06:56:53.906 DEBUG:teuthology.orchestra.run.smithi072:> 2024-04-04T06:56:53.906 DEBUG:teuthology.orchestra.run.smithi072:> # Given a non-glob path, it better be there 2024-04-04T06:56:53.906 DEBUG:teuthology.orchestra.run.smithi072:> if "*" not in asok_path: 2024-04-04T06:56:53.906 DEBUG:teuthology.orchestra.run.smithi072:> assert(len(files) == 1) 2024-04-04T06:56:53.906 DEBUG:teuthology.orchestra.run.smithi072:> return files[0] 2024-04-04T06:56:53.906 DEBUG:teuthology.orchestra.run.smithi072:> 2024-04-04T06:56:53.907 DEBUG:teuthology.orchestra.run.smithi072:> for f in files: 2024-04-04T06:56:53.907 DEBUG:teuthology.orchestra.run.smithi072:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-04T06:56:53.907 DEBUG:teuthology.orchestra.run.smithi072:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-04T06:56:53.907 DEBUG:teuthology.orchestra.run.smithi072:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-04T06:56:53.907 DEBUG:teuthology.orchestra.run.smithi072:> contents = proc_f.read() 2024-04-04T06:56:53.907 DEBUG:teuthology.orchestra.run.smithi072:> if mountpoint in contents: 2024-04-04T06:56:53.907 DEBUG:teuthology.orchestra.run.smithi072:> return f 2024-04-04T06:56:53.907 DEBUG:teuthology.orchestra.run.smithi072:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-04T06:56:53.907 DEBUG:teuthology.orchestra.run.smithi072:> 2024-04-04T06:56:53.907 DEBUG:teuthology.orchestra.run.smithi072:> print(_find_admin_socket("client.2")) 2024-04-04T06:56:53.907 DEBUG:teuthology.orchestra.run.smithi072:> ' 2024-04-04T06:56:54.099 INFO:teuthology.orchestra.run.smithi072.stdout:/var/run/ceph/ceph-client.2.45786.asok 2024-04-04T06:56:54.104 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-04T06:56:54.116 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.2.45786.asok 2024-04-04T06:56:54.116 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-04T06:56:54.116 DEBUG:teuthology.orchestra.run.smithi072:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.2.45786.asok status 2024-04-04T06:56:54.345 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-04T06:56:54.346 INFO:teuthology.orchestra.run.smithi072.stdout: "metadata": { 2024-04-04T06:56:54.346 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph_sha1": "addbc488dc763e752c640619b677f10e0da02c9f", 2024-04-04T06:56:54.346 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph_version": "ceph version 19.0.0-2571-gaddbc488 (addbc488dc763e752c640619b677f10e0da02c9f) squid (dev)", 2024-04-04T06:56:54.346 INFO:teuthology.orchestra.run.smithi072.stdout: "entity_id": "2", 2024-04-04T06:56:54.346 INFO:teuthology.orchestra.run.smithi072.stdout: "hostname": "smithi072", 2024-04-04T06:56:54.346 INFO:teuthology.orchestra.run.smithi072.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.2", 2024-04-04T06:56:54.346 INFO:teuthology.orchestra.run.smithi072.stdout: "pid": "45786", 2024-04-04T06:56:54.346 INFO:teuthology.orchestra.run.smithi072.stdout: "root": "/" 2024-04-04T06:56:54.346 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-04T06:56:54.346 INFO:teuthology.orchestra.run.smithi072.stdout: "dentry_count": 0, 2024-04-04T06:56:54.346 INFO:teuthology.orchestra.run.smithi072.stdout: "dentry_pinned_count": 0, 2024-04-04T06:56:54.346 INFO:teuthology.orchestra.run.smithi072.stdout: "id": 4686, 2024-04-04T06:56:54.346 INFO:teuthology.orchestra.run.smithi072.stdout: "inst": { 2024-04-04T06:56:54.347 INFO:teuthology.orchestra.run.smithi072.stdout: "name": { 2024-04-04T06:56:54.347 INFO:teuthology.orchestra.run.smithi072.stdout: "type": "client", 2024-04-04T06:56:54.347 INFO:teuthology.orchestra.run.smithi072.stdout: "num": 4686 2024-04-04T06:56:54.347 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-04T06:56:54.347 INFO:teuthology.orchestra.run.smithi072.stdout: "addr": { 2024-04-04T06:56:54.347 INFO:teuthology.orchestra.run.smithi072.stdout: "type": "v1", 2024-04-04T06:56:54.347 INFO:teuthology.orchestra.run.smithi072.stdout: "addr": "192.168.0.2:0", 2024-04-04T06:56:54.347 INFO:teuthology.orchestra.run.smithi072.stdout: "nonce": 886486211 2024-04-04T06:56:54.347 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-04T06:56:54.347 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-04T06:56:54.347 INFO:teuthology.orchestra.run.smithi072.stdout: "addr": { 2024-04-04T06:56:54.347 INFO:teuthology.orchestra.run.smithi072.stdout: "type": "v1", 2024-04-04T06:56:54.347 INFO:teuthology.orchestra.run.smithi072.stdout: "addr": "192.168.0.2:0", 2024-04-04T06:56:54.347 INFO:teuthology.orchestra.run.smithi072.stdout: "nonce": 886486211 2024-04-04T06:56:54.348 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-04T06:56:54.348 INFO:teuthology.orchestra.run.smithi072.stdout: "inst_str": "client.4686 192.168.0.2:0/886486211", 2024-04-04T06:56:54.348 INFO:teuthology.orchestra.run.smithi072.stdout: "addr_str": "192.168.0.2:0/886486211", 2024-04-04T06:56:54.348 INFO:teuthology.orchestra.run.smithi072.stdout: "inode_count": 1, 2024-04-04T06:56:54.348 INFO:teuthology.orchestra.run.smithi072.stdout: "mds_epoch": 8, 2024-04-04T06:56:54.348 INFO:teuthology.orchestra.run.smithi072.stdout: "osd_epoch": 20, 2024-04-04T06:56:54.348 INFO:teuthology.orchestra.run.smithi072.stdout: "osd_epoch_barrier": 0, 2024-04-04T06:56:54.348 INFO:teuthology.orchestra.run.smithi072.stdout: "blocklisted": false, 2024-04-04T06:56:54.348 INFO:teuthology.orchestra.run.smithi072.stdout: "fs_name": "cephfs" 2024-04-04T06:56:54.348 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-04T06:56:54.361 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-04T06:56:54.574 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:54.576+0000 7f6790400640 1 Processor -- start 2024-04-04T06:56:54.575 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:54.576+0000 7f6790400640 1 -- start start 2024-04-04T06:56:54.575 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:54.577+0000 7f6790400640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f67880d00b0 0x7f678806e070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:54.576 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:54.577+0000 7f6790400640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f678806d5b0 con 0x7f67880ce0d0 2024-04-04T06:56:54.576 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:54.577+0000 7f6790400640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67880d0670 con 0x7f67880cdcf0 2024-04-04T06:56:54.576 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:54.577+0000 7f6790400640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f678806dbe0 con 0x7f67880d00b0 2024-04-04T06:56:54.578 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:54.577+0000 7f678e400640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f67880ce0d0 0x7f67880acff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:47166/0 (socket says 172.21.15.72:47166) 2024-04-04T06:56:54.578 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:54.577+0000 7f678e400640 1 -- 172.21.15.72:0/4204097195 learned_addr learned my addr 172.21.15.72:0/4204097195 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-04-04T06:56:54.578 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:54.578+0000 7f678d000640 1 --2- 172.21.15.72:0/4204097195 >> v2:172.21.15.117:3300/0 conn(0x7f67880d00b0 0x7f678806e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:54.578 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:54.578+0000 7f6787e00640 1 -- 172.21.15.72:0/4204097195 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1857988937 0 0) 0x7f678806d5b0 con 0x7f67880ce0d0 2024-04-04T06:56:54.578 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:54.578+0000 7f6787e00640 1 -- 172.21.15.72:0/4204097195 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6770003520 con 0x7f67880ce0d0 2024-04-04T06:56:54.578 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:54.578+0000 7f6787e00640 1 -- 172.21.15.72:0/4204097195 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3109954516 0 0) 0x7f6770003520 con 0x7f67880ce0d0 2024-04-04T06:56:54.578 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:54.578+0000 7f6787e00640 1 -- 172.21.15.72:0/4204097195 >> v2:172.21.15.117:3300/0 conn(0x7f67880d00b0 msgr2=0x7f678806e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:56:54.578 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:54.578+0000 7f6787e00640 1 --2- 172.21.15.72:0/4204097195 >> v2:172.21.15.117:3300/0 conn(0x7f67880d00b0 0x7f678806e070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:54.579 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:54.578+0000 7f6787e00640 1 -- 172.21.15.72:0/4204097195 >> v1:172.21.15.117:6789/0 conn(0x7f67880cdcf0 legacy=0x7f678815c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:54.579 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:54.578+0000 7f6787e00640 1 -- 172.21.15.72:0/4204097195 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67880d0950 con 0x7f67880ce0d0 2024-04-04T06:56:54.579 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:54.578+0000 7f6787e00640 1 -- 172.21.15.72:0/4204097195 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2465650867 0 0) 0x7f67800019f0 con 0x7f67880ce0d0 2024-04-04T06:56:54.579 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:54.578+0000 7f6787e00640 1 -- 172.21.15.72:0/4204097195 >> v1:172.21.15.72:6789/0 conn(0x7f67880ce0d0 legacy=0x7f67880acff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:54.579 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:54.578+0000 7f6787e00640 1 --2- 172.21.15.72:0/4204097195 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f67700039e0 0x7f6770003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:54.579 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:54.579+0000 7f6787e00640 1 --2- 172.21.15.72:0/4204097195 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6770004800 0x7f6770004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:54.579 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:54.579+0000 7f6787e00640 1 --2- 172.21.15.72:0/4204097195 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6770005210 0x7f677000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:54.579 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:54.579+0000 7f6787e00640 1 -- 172.21.15.72:0/4204097195 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f678806dbe0 con 0x7f6770004800 2024-04-04T06:56:54.579 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:54.579+0000 7f6787e00640 1 -- 172.21.15.72:0/4204097195 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f677000c140 con 0x7f6770005210 2024-04-04T06:56:54.579 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:54.579+0000 7f6787e00640 1 -- 172.21.15.72:0/4204097195 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f677000c340 con 0x7f67700039e0 2024-04-04T06:56:54.579 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:54.579+0000 7f678d000640 1 --2- 172.21.15.72:0/4204097195 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6770004800 0x7f6770004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:54.579 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:54.579+0000 7f678e400640 1 --2- 172.21.15.72:0/4204097195 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6770005210 0x7f677000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:54.579 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:54.579+0000 7f678da00640 1 --2- 172.21.15.72:0/4204097195 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f67700039e0 0x7f6770003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:54.579 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:54.579+0000 7f678d000640 1 -- 172.21.15.72:0/4204097195 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f67700039e0 msgr2=0x7f6770003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:56:54.580 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:54.579+0000 7f678d000640 1 --2- 172.21.15.72:0/4204097195 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f67700039e0 0x7f6770003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:54.580 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:54.579+0000 7f678d000640 1 -- 172.21.15.72:0/4204097195 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6770005210 msgr2=0x7f677000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:56:54.580 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:54.579+0000 7f678d000640 1 --2- 172.21.15.72:0/4204097195 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6770005210 0x7f677000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:54.580 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:54.579+0000 7f678e400640 1 -- 172.21.15.72:0/4204097195 reap_dead start 2024-04-04T06:56:54.580 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:54.579+0000 7f678d000640 1 -- 172.21.15.72:0/4204097195 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6770003520 con 0x7f6770004800 2024-04-04T06:56:54.581 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:54.581+0000 7f678d000640 1 --2- 172.21.15.72:0/4204097195 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6770004800 0x7f6770004c80 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f6774009ac0 tx=0x7f6770005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=896dc16e63b7cdf4 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:54.581 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:54.581+0000 7f6787e00640 1 -- 172.21.15.72:0/4204097195 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6774039070 con 0x7f6770004800 2024-04-04T06:56:54.581 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:54.581+0000 7f6787e00640 1 -- 172.21.15.72:0/4204097195 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f677402c6b0 con 0x7f6770004800 2024-04-04T06:56:54.581 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:54.581+0000 7f6787e00640 1 -- 172.21.15.72:0/4204097195 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6774009690 con 0x7f6770004800 2024-04-04T06:56:54.581 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:54.582+0000 7f6790400640 1 -- 172.21.15.72:0/4204097195 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6770004800 msgr2=0x7f6770004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:54.581 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:54.582+0000 7f6790400640 1 --2- 172.21.15.72:0/4204097195 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6770004800 0x7f6770004c80 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f6774009ac0 tx=0x7f6770005830 comp rx=0 tx=0).stop 2024-04-04T06:56:54.581 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:54.582+0000 7f6790400640 1 -- 172.21.15.72:0/4204097195 shutdown_connections 2024-04-04T06:56:54.581 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:54.582+0000 7f6790400640 1 --2- 172.21.15.72:0/4204097195 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6770004800 0x7f6770004c80 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:54.582 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:54.582+0000 7f6790400640 1 -- 172.21.15.72:0/4204097195 >> 172.21.15.72:0/4204097195 conn(0x7f678806b470 msgr2=0x7f678806b880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:56:54.582 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:54.582+0000 7f6790400640 1 -- 172.21.15.72:0/4204097195 shutdown_connections 2024-04-04T06:56:54.582 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:54.582+0000 7f6790400640 1 -- 172.21.15.72:0/4204097195 wait complete. 2024-04-04T06:56:54.583 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:54.585+0000 7f6790400640 1 Processor -- start 2024-04-04T06:56:54.584 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:54.586+0000 7f6790400640 1 -- start start 2024-04-04T06:56:54.586 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:54.587+0000 7f6790400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6770004800 0x7f67881e9c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:54.586 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:54.587+0000 7f6790400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f67881ea140 0x7f67880c3e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:54.586 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:54.587+0000 7f6790400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f67880c4360 0x7f67881e7c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:54.586 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:54.587+0000 7f6790400640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f67880ce6a0 con 0x7f67881ea140 2024-04-04T06:56:54.587 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:54.587+0000 7f6790400640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f67880ce520 con 0x7f6770004800 2024-04-04T06:56:54.587 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:54.587+0000 7f6790400640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f678815b410 con 0x7f67880c4360 2024-04-04T06:56:54.587 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:54.587+0000 7f678d000640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f67881ea140 0x7f67880c3e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:54.587 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:54.587+0000 7f678d000640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f67881ea140 0x7f67880c3e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:50922/0 (socket says 172.21.15.72:50922) 2024-04-04T06:56:54.587 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:54.587+0000 7f678d000640 1 -- 172.21.15.72:0/1025477737 learned_addr learned my addr 172.21.15.72:0/1025477737 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:56:54.587 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:54.588+0000 7f678da00640 1 --2- 172.21.15.72:0/1025477737 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6770004800 0x7f67881e9c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:54.587 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:54.588+0000 7f678d000640 1 -- 172.21.15.72:0/1025477737 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f67880c4360 msgr2=0x7f67881e7c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:54.587 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:54.588+0000 7f678d000640 1 --2- 172.21.15.72:0/1025477737 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f67880c4360 0x7f67881e7c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:54.587 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:54.588+0000 7f678d000640 1 -- 172.21.15.72:0/1025477737 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6770004800 msgr2=0x7f67881e9c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:54.587 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:54.588+0000 7f678d000640 1 --2- 172.21.15.72:0/1025477737 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6770004800 0x7f67881e9c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:54.587 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:54.588+0000 7f678d000640 1 -- 172.21.15.72:0/1025477737 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67880c4bb0 con 0x7f67881ea140 2024-04-04T06:56:54.587 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:54.588+0000 7f678da00640 1 --2- 172.21.15.72:0/1025477737 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6770004800 0x7f67881e9c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-04T06:56:54.588 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:54.588+0000 7f678d000640 1 --2- 172.21.15.72:0/1025477737 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f67881ea140 0x7f67880c3e20 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f6774009ac0 tx=0x7f6774004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:54.588 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:54.588+0000 7f6785600640 1 -- 172.21.15.72:0/1025477737 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6774039050 con 0x7f67881ea140 2024-04-04T06:56:54.588 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:54.588+0000 7f6785600640 1 -- 172.21.15.72:0/1025477737 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6774045070 con 0x7f67881ea140 2024-04-04T06:56:54.588 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:54.588+0000 7f6785600640 1 -- 172.21.15.72:0/1025477737 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67740044e0 con 0x7f67881ea140 2024-04-04T06:56:54.588 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:54.588+0000 7f6790400640 1 -- 172.21.15.72:0/1025477737 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67880c4e90 con 0x7f67881ea140 2024-04-04T06:56:54.588 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:54.589+0000 7f6790400640 1 -- 172.21.15.72:0/1025477737 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67880c5450 con 0x7f67881ea140 2024-04-04T06:56:54.589 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:54.590+0000 7f6790400640 1 -- 172.21.15.72:0/1025477737 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6788075840 con 0x7f67881ea140 2024-04-04T06:56:54.589 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:54.591+0000 7f6785600640 1 -- 172.21.15.72:0/1025477737 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6774003850 con 0x7f67881ea140 2024-04-04T06:56:54.590 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:54.592+0000 7f6785600640 1 --2- 172.21.15.72:0/1025477737 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f676806c8f0 0x7f676806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:54.590 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:54.592+0000 7f6785600640 1 -- 172.21.15.72:0/1025477737 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f67740add50 con 0x7f67881ea140 2024-04-04T06:56:54.590 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:54.592+0000 7f678da00640 1 --2- 172.21.15.72:0/1025477737 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f676806c8f0 0x7f676806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:54.591 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:54.593+0000 7f678da00640 1 --2- 172.21.15.72:0/1025477737 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f676806c8f0 0x7f676806edb0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f677c000c00 tx=0x7f677c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:54.595 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:54.597+0000 7f6785600640 1 -- 172.21.15.72:0/1025477737 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f67740b1030 con 0x7f67881ea140 2024-04-04T06:56:54.837 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:54.839+0000 7f6790400640 1 -- 172.21.15.72:0/1025477737 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f678806d5b0 con 0x7f67881ea140 2024-04-04T06:56:54.838 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:54.839+0000 7f6785600640 1 -- 172.21.15.72:0/1025477737 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+73 (secure 0 0 0) 0x7f677407c2a0 con 0x7f67881ea140 2024-04-04T06:56:54.838 INFO:teuthology.orchestra.run.smithi072.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-04T06:56:54.841 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:54.842+0000 7f6790400640 1 -- 172.21.15.72:0/1025477737 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f676806c8f0 msgr2=0x7f676806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:54.841 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:54.842+0000 7f6790400640 1 --2- 172.21.15.72:0/1025477737 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f676806c8f0 0x7f676806edb0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f677c000c00 tx=0x7f677c009040 comp rx=0 tx=0).stop 2024-04-04T06:56:54.841 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:54.842+0000 7f6790400640 1 -- 172.21.15.72:0/1025477737 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f67881ea140 msgr2=0x7f67880c3e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:54.841 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:54.842+0000 7f6790400640 1 --2- 172.21.15.72:0/1025477737 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f67881ea140 0x7f67880c3e20 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f6774009ac0 tx=0x7f6774004730 comp rx=0 tx=0).stop 2024-04-04T06:56:54.841 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:54.842+0000 7f6790400640 1 -- 172.21.15.72:0/1025477737 shutdown_connections 2024-04-04T06:56:54.841 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:54.842+0000 7f6790400640 1 --2- 172.21.15.72:0/1025477737 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f676806c8f0 0x7f676806edb0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:54.841 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:54.842+0000 7f6790400640 1 --2- 172.21.15.72:0/1025477737 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f67880c4360 0x7f67881e7c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:54.841 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:54.842+0000 7f6790400640 1 --2- 172.21.15.72:0/1025477737 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f67881ea140 0x7f67880c3e20 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:54.841 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:54.842+0000 7f6790400640 1 --2- 172.21.15.72:0/1025477737 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6770004800 0x7f67881e9c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:54.841 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:54.842+0000 7f6790400640 1 -- 172.21.15.72:0/1025477737 >> 172.21.15.72:0/1025477737 conn(0x7f678806b470 msgr2=0x7f6788072a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:56:54.842 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:54.842+0000 7f6790400640 1 -- 172.21.15.72:0/1025477737 shutdown_connections 2024-04-04T06:56:54.842 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:54.842+0000 7f6790400640 1 -- 172.21.15.72:0/1025477737 wait complete. 2024-04-04T06:56:54.865 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-04T06:56:54.865 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-04T06:56:54.865 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi117.front.sepia.ceph.com 2024-04-04T06:56:54.865 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-04-04T06:56:54.865 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-04-04T06:56:54.865 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-04T06:56:54.865 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-04T06:56:54.865 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-04T06:56:54.865 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-04-04T06:56:54.865 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-04T06:56:54.866 DEBUG:teuthology.orchestra.run.smithi117:> ip addr 2024-04-04T06:56:54.923 INFO:teuthology.orchestra.run.smithi117.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-04T06:56:54.923 INFO:teuthology.orchestra.run.smithi117.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-04T06:56:54.923 INFO:teuthology.orchestra.run.smithi117.stdout: inet 127.0.0.1/8 scope host lo 2024-04-04T06:56:54.923 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2024-04-04T06:56:54.923 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 ::1/128 scope host 2024-04-04T06:56:54.923 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2024-04-04T06:56:54.923 INFO:teuthology.orchestra.run.smithi117.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-04T06:56:54.923 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 0c:c4:7a:d8:a8:8a brd ff:ff:ff:ff:ff:ff 2024-04-04T06:56:54.923 INFO:teuthology.orchestra.run.smithi117.stdout: altname enp7s0f0 2024-04-04T06:56:54.923 INFO:teuthology.orchestra.run.smithi117.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-04T06:56:54.924 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 0c:c4:7a:d8:a8:8b brd ff:ff:ff:ff:ff:ff 2024-04-04T06:56:54.924 INFO:teuthology.orchestra.run.smithi117.stdout: altname enp7s0f1 2024-04-04T06:56:54.924 INFO:teuthology.orchestra.run.smithi117.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-04T06:56:54.924 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 0c:c4:7a:8f:44:62 brd ff:ff:ff:ff:ff:ff 2024-04-04T06:56:54.924 INFO:teuthology.orchestra.run.smithi117.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-04T06:56:54.924 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 0c:c4:7a:8f:44:63 brd ff:ff:ff:ff:ff:ff 2024-04-04T06:56:54.924 INFO:teuthology.orchestra.run.smithi117.stdout: inet 172.21.15.117/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-04-04T06:56:54.924 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft 42331sec preferred_lft 42331sec 2024-04-04T06:56:54.924 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 fe80::ec4:7aff:fe8f:4463/64 scope link 2024-04-04T06:56:54.924 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2024-04-04T06:56:54.925 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-04T06:56:54.925 DEBUG:teuthology.orchestra.run.smithi117:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-04T06:56:54.926 DEBUG:teuthology.orchestra.run.smithi117:> set -e 2024-04-04T06:56:54.926 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip link add name ceph-brx type bridge 2024-04-04T06:56:54.926 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip addr flush dev ceph-brx 2024-04-04T06:56:54.926 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip link set ceph-brx up 2024-04-04T06:56:54.926 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-04T06:56:54.926 DEBUG:teuthology.orchestra.run.smithi117:> ') 2024-04-04T06:56:55.034 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:55 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-04T06:56:55.424 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-04T06:56:55.433 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-04T06:56:55.434 DEBUG:teuthology.orchestra.run.smithi117:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-04T06:56:55.507 INFO:teuthology.orchestra.run.smithi117.stdout:1 2024-04-04T06:56:55.511 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-04T06:56:55.511 DEBUG:teuthology.orchestra.run.smithi117:> route 2024-04-04T06:56:55.567 INFO:teuthology.orchestra.run.smithi117.stdout:Kernel IP routing table 2024-04-04T06:56:55.567 INFO:teuthology.orchestra.run.smithi117.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-04T06:56:55.567 INFO:teuthology.orchestra.run.smithi117.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-04T06:56:55.568 INFO:teuthology.orchestra.run.smithi117.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-04T06:56:55.568 INFO:teuthology.orchestra.run.smithi117.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-04T06:56:55.568 DEBUG:teuthology.orchestra.run.smithi117:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-04T06:56:55.568 DEBUG:teuthology.orchestra.run.smithi117:> set -e 2024-04-04T06:56:55.568 DEBUG:teuthology.orchestra.run.smithi117:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-04T06:56:55.568 DEBUG:teuthology.orchestra.run.smithi117:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-04T06:56:55.568 DEBUG:teuthology.orchestra.run.smithi117:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-04T06:56:55.568 DEBUG:teuthology.orchestra.run.smithi117:> ') 2024-04-04T06:56:55.662 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:55 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-04T06:56:56.303 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-04T06:56:56.313 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-04T06:56:56.313 DEBUG:teuthology.orchestra.run.smithi117:> ip netns list 2024-04-04T06:56:56.365 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-04T06:56:56.365 DEBUG:teuthology.orchestra.run.smithi117:> ip netns list-id 2024-04-04T06:56:56.420 DEBUG:teuthology.orchestra.run.smithi117:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-04T06:56:56.421 DEBUG:teuthology.orchestra.run.smithi117:> set -e 2024-04-04T06:56:56.421 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-04T06:56:56.421 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-04-04T06:56:56.421 DEBUG:teuthology.orchestra.run.smithi117:> ') 2024-04-04T06:56:56.527 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:56 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-04T06:56:56.617 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-04T06:56:56.626 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-04-04T06:56:56.627 DEBUG:teuthology.orchestra.run.smithi117:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-04T06:56:56.627 DEBUG:teuthology.orchestra.run.smithi117:> set -e 2024-04-04T06:56:56.627 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-04-04T06:56:56.627 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-04T06:56:56.627 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-04-04T06:56:56.627 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-04-04T06:56:56.627 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-04-04T06:56:56.627 DEBUG:teuthology.orchestra.run.smithi117:> ') 2024-04-04T06:56:56.729 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:56 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-04T06:56:56.965 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-04T06:56:56.974 DEBUG:teuthology.orchestra.run.smithi117:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-04T06:56:56.974 DEBUG:teuthology.orchestra.run.smithi117:> set -e 2024-04-04T06:56:56.974 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip link set brx.0 up 2024-04-04T06:56:56.974 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip link set dev brx.0 master ceph-brx 2024-04-04T06:56:56.974 DEBUG:teuthology.orchestra.run.smithi117:> ') 2024-04-04T06:56:57.073 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:57 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-04T06:56:57.189 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-04T06:56:57.198 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2024-04-04T06:56:57.199 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-04T06:56:57.199 DEBUG:teuthology.orchestra.run.smithi117:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-04-04T06:56:57.240 INFO:teuthology.orchestra.run.smithi117.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-04-04T06:56:57.240 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-04T06:56:57.240 DEBUG:teuthology.orchestra.run.smithi117:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-04-04T06:56:57.330 DEBUG:teuthology.orchestra.run.smithi117:> sudo modprobe fuse 2024-04-04T06:56:57.419 DEBUG:teuthology.orchestra.run.smithi117:> cat /proc/self/mounts | awk '{print $2}' 2024-04-04T06:56:57.473 INFO:teuthology.orchestra.run.smithi117.stdout:/proc 2024-04-04T06:56:57.474 INFO:teuthology.orchestra.run.smithi117.stdout:/sys 2024-04-04T06:56:57.474 INFO:teuthology.orchestra.run.smithi117.stdout:/dev 2024-04-04T06:56:57.474 INFO:teuthology.orchestra.run.smithi117.stdout:/sys/kernel/security 2024-04-04T06:56:57.474 INFO:teuthology.orchestra.run.smithi117.stdout:/dev/shm 2024-04-04T06:56:57.474 INFO:teuthology.orchestra.run.smithi117.stdout:/dev/pts 2024-04-04T06:56:57.474 INFO:teuthology.orchestra.run.smithi117.stdout:/run 2024-04-04T06:56:57.474 INFO:teuthology.orchestra.run.smithi117.stdout:/sys/fs/cgroup 2024-04-04T06:56:57.474 INFO:teuthology.orchestra.run.smithi117.stdout:/sys/fs/pstore 2024-04-04T06:56:57.474 INFO:teuthology.orchestra.run.smithi117.stdout:/sys/fs/bpf 2024-04-04T06:56:57.475 INFO:teuthology.orchestra.run.smithi117.stdout:/ 2024-04-04T06:56:57.475 INFO:teuthology.orchestra.run.smithi117.stdout:/sys/fs/selinux 2024-04-04T06:56:57.475 INFO:teuthology.orchestra.run.smithi117.stdout:/proc/sys/fs/binfmt_misc 2024-04-04T06:56:57.475 INFO:teuthology.orchestra.run.smithi117.stdout:/dev/hugepages 2024-04-04T06:56:57.475 INFO:teuthology.orchestra.run.smithi117.stdout:/dev/mqueue 2024-04-04T06:56:57.475 INFO:teuthology.orchestra.run.smithi117.stdout:/sys/kernel/debug 2024-04-04T06:56:57.475 INFO:teuthology.orchestra.run.smithi117.stdout:/sys/kernel/tracing 2024-04-04T06:56:57.475 INFO:teuthology.orchestra.run.smithi117.stdout:/sys/kernel/config 2024-04-04T06:56:57.475 INFO:teuthology.orchestra.run.smithi117.stdout:/sys/fs/fuse/connections 2024-04-04T06:56:57.475 INFO:teuthology.orchestra.run.smithi117.stdout:/run/credentials/systemd-sysctl.service 2024-04-04T06:56:57.475 INFO:teuthology.orchestra.run.smithi117.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-04T06:56:57.475 INFO:teuthology.orchestra.run.smithi117.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-04T06:56:57.476 INFO:teuthology.orchestra.run.smithi117.stdout:/var/lib/nfs/rpc_pipefs 2024-04-04T06:56:57.476 INFO:teuthology.orchestra.run.smithi117.stdout:/run/user/1000 2024-04-04T06:56:57.476 INFO:teuthology.orchestra.run.smithi117.stdout:/var/lib/ceph 2024-04-04T06:56:57.476 INFO:teuthology.orchestra.run.smithi117.stdout:/var/lib/ceph/osd/ceph-4 2024-04-04T06:56:57.476 INFO:teuthology.orchestra.run.smithi117.stdout:/var/lib/ceph/osd/ceph-5 2024-04-04T06:56:57.476 INFO:teuthology.orchestra.run.smithi117.stdout:/var/lib/ceph/osd/ceph-6 2024-04-04T06:56:57.476 INFO:teuthology.orchestra.run.smithi117.stdout:/var/lib/ceph/osd/ceph-7 2024-04-04T06:56:57.476 INFO:teuthology.orchestra.run.smithi117.stdout:/run/netns 2024-04-04T06:56:57.476 INFO:teuthology.orchestra.run.smithi117.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-04T06:56:57.476 INFO:teuthology.orchestra.run.smithi117.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-04T06:56:57.477 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-04T06:56:57.478 DEBUG:teuthology.orchestra.run.smithi117:> ls /sys/fs/fuse/connections 2024-04-04T06:56:57.530 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-04-04T06:56:57.530 DEBUG:teuthology.orchestra.run.smithi117:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2024-04-04T06:56:57.535 DEBUG:teuthology.orchestra.run.smithi117:> sudo modprobe fuse 2024-04-04T06:56:57.607 DEBUG:teuthology.orchestra.run.smithi117:> cat /proc/self/mounts | awk '{print $2}' 2024-04-04T06:56:57.646 INFO:teuthology.orchestra.run.smithi117.stdout:/proc 2024-04-04T06:56:57.646 INFO:teuthology.orchestra.run.smithi117.stdout:/sys 2024-04-04T06:56:57.646 INFO:teuthology.orchestra.run.smithi117.stdout:/dev 2024-04-04T06:56:57.646 INFO:teuthology.orchestra.run.smithi117.stdout:/sys/kernel/security 2024-04-04T06:56:57.646 INFO:teuthology.orchestra.run.smithi117.stdout:/dev/shm 2024-04-04T06:56:57.646 INFO:teuthology.orchestra.run.smithi117.stdout:/dev/pts 2024-04-04T06:56:57.646 INFO:teuthology.orchestra.run.smithi117.stdout:/run 2024-04-04T06:56:57.646 INFO:teuthology.orchestra.run.smithi117.stdout:/sys/fs/cgroup 2024-04-04T06:56:57.646 INFO:teuthology.orchestra.run.smithi117.stdout:/sys/fs/pstore 2024-04-04T06:56:57.647 INFO:teuthology.orchestra.run.smithi117.stdout:/sys/fs/bpf 2024-04-04T06:56:57.647 INFO:teuthology.orchestra.run.smithi117.stdout:/ 2024-04-04T06:56:57.647 INFO:teuthology.orchestra.run.smithi117.stdout:/sys/fs/selinux 2024-04-04T06:56:57.647 INFO:teuthology.orchestra.run.smithi117.stdout:/proc/sys/fs/binfmt_misc 2024-04-04T06:56:57.647 INFO:teuthology.orchestra.run.smithi117.stdout:/dev/hugepages 2024-04-04T06:56:57.647 INFO:teuthology.orchestra.run.smithi117.stdout:/dev/mqueue 2024-04-04T06:56:57.647 INFO:teuthology.orchestra.run.smithi117.stdout:/sys/kernel/debug 2024-04-04T06:56:57.647 INFO:teuthology.orchestra.run.smithi117.stdout:/sys/kernel/tracing 2024-04-04T06:56:57.647 INFO:teuthology.orchestra.run.smithi117.stdout:/sys/kernel/config 2024-04-04T06:56:57.647 INFO:teuthology.orchestra.run.smithi117.stdout:/sys/fs/fuse/connections 2024-04-04T06:56:57.647 INFO:teuthology.orchestra.run.smithi117.stdout:/run/credentials/systemd-sysctl.service 2024-04-04T06:56:57.647 INFO:teuthology.orchestra.run.smithi117.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-04T06:56:57.647 INFO:teuthology.orchestra.run.smithi117.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-04T06:56:57.648 INFO:teuthology.orchestra.run.smithi117.stdout:/var/lib/nfs/rpc_pipefs 2024-04-04T06:56:57.648 INFO:teuthology.orchestra.run.smithi117.stdout:/run/user/1000 2024-04-04T06:56:57.648 INFO:teuthology.orchestra.run.smithi117.stdout:/var/lib/ceph 2024-04-04T06:56:57.648 INFO:teuthology.orchestra.run.smithi117.stdout:/var/lib/ceph/osd/ceph-4 2024-04-04T06:56:57.648 INFO:teuthology.orchestra.run.smithi117.stdout:/var/lib/ceph/osd/ceph-5 2024-04-04T06:56:57.648 INFO:teuthology.orchestra.run.smithi117.stdout:/var/lib/ceph/osd/ceph-6 2024-04-04T06:56:57.648 INFO:teuthology.orchestra.run.smithi117.stdout:/var/lib/ceph/osd/ceph-7 2024-04-04T06:56:57.648 INFO:teuthology.orchestra.run.smithi117.stdout:/run/netns 2024-04-04T06:56:57.648 INFO:teuthology.orchestra.run.smithi117.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-04T06:56:57.648 INFO:teuthology.orchestra.run.smithi117.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-04T06:56:57.649 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-04T06:56:57.649 DEBUG:teuthology.orchestra.run.smithi117:> ls /sys/fs/fuse/connections 2024-04-04T06:56:57.711 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi117.stderr:2024-04-04T06:56:57.712+0000 7ffab0a37480 -1 init, newargv = 0x56024436e8b0 newargc=15 2024-04-04T06:56:57.711 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi117.stderr:ceph-fuse[43094]: starting ceph client 2024-04-04T06:56:57.723 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi117.stderr:ceph-fuse[43094]: starting fuse 2024-04-04T06:56:57.734 INFO:teuthology.orchestra.run.smithi117.stdout:41 2024-04-04T06:56:57.735 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41] 2024-04-04T06:56:57.735 DEBUG:teuthology.orchestra.run.smithi117:> sudo stdin-killer -- python3 -c ' 2024-04-04T06:56:57.735 DEBUG:teuthology.orchestra.run.smithi117:> import glob 2024-04-04T06:56:57.735 DEBUG:teuthology.orchestra.run.smithi117:> import re 2024-04-04T06:56:57.735 DEBUG:teuthology.orchestra.run.smithi117:> import os 2024-04-04T06:56:57.735 DEBUG:teuthology.orchestra.run.smithi117:> import subprocess 2024-04-04T06:56:57.735 DEBUG:teuthology.orchestra.run.smithi117:> 2024-04-04T06:56:57.735 DEBUG:teuthology.orchestra.run.smithi117:> def _find_admin_socket(client_name): 2024-04-04T06:56:57.735 DEBUG:teuthology.orchestra.run.smithi117:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-04-04T06:56:57.735 DEBUG:teuthology.orchestra.run.smithi117:> files = glob.glob(asok_path) 2024-04-04T06:56:57.735 DEBUG:teuthology.orchestra.run.smithi117:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-04-04T06:56:57.735 DEBUG:teuthology.orchestra.run.smithi117:> 2024-04-04T06:56:57.736 DEBUG:teuthology.orchestra.run.smithi117:> # Given a non-glob path, it better be there 2024-04-04T06:56:57.736 DEBUG:teuthology.orchestra.run.smithi117:> if "*" not in asok_path: 2024-04-04T06:56:57.736 DEBUG:teuthology.orchestra.run.smithi117:> assert(len(files) == 1) 2024-04-04T06:56:57.736 DEBUG:teuthology.orchestra.run.smithi117:> return files[0] 2024-04-04T06:56:57.736 DEBUG:teuthology.orchestra.run.smithi117:> 2024-04-04T06:56:57.736 DEBUG:teuthology.orchestra.run.smithi117:> for f in files: 2024-04-04T06:56:57.736 DEBUG:teuthology.orchestra.run.smithi117:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-04T06:56:57.736 DEBUG:teuthology.orchestra.run.smithi117:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-04T06:56:57.736 DEBUG:teuthology.orchestra.run.smithi117:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-04T06:56:57.736 DEBUG:teuthology.orchestra.run.smithi117:> contents = proc_f.read() 2024-04-04T06:56:57.736 DEBUG:teuthology.orchestra.run.smithi117:> if mountpoint in contents: 2024-04-04T06:56:57.736 DEBUG:teuthology.orchestra.run.smithi117:> return f 2024-04-04T06:56:57.736 DEBUG:teuthology.orchestra.run.smithi117:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-04T06:56:57.736 DEBUG:teuthology.orchestra.run.smithi117:> 2024-04-04T06:56:57.736 DEBUG:teuthology.orchestra.run.smithi117:> print(_find_admin_socket("client.1")) 2024-04-04T06:56:57.736 DEBUG:teuthology.orchestra.run.smithi117:> ' 2024-04-04T06:56:57.930 INFO:teuthology.orchestra.run.smithi117.stdout:/var/run/ceph/ceph-client.1.43094.asok 2024-04-04T06:56:57.934 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-04T06:56:57.947 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.43094.asok 2024-04-04T06:56:57.948 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-04T06:56:57.948 DEBUG:teuthology.orchestra.run.smithi117:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.43094.asok status 2024-04-04T06:56:58.184 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2024-04-04T06:56:58.184 INFO:teuthology.orchestra.run.smithi117.stdout: "metadata": { 2024-04-04T06:56:58.184 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph_sha1": "addbc488dc763e752c640619b677f10e0da02c9f", 2024-04-04T06:56:58.184 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph_version": "ceph version 19.0.0-2571-gaddbc488 (addbc488dc763e752c640619b677f10e0da02c9f) squid (dev)", 2024-04-04T06:56:58.184 INFO:teuthology.orchestra.run.smithi117.stdout: "entity_id": "1", 2024-04-04T06:56:58.184 INFO:teuthology.orchestra.run.smithi117.stdout: "hostname": "smithi117", 2024-04-04T06:56:58.184 INFO:teuthology.orchestra.run.smithi117.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2024-04-04T06:56:58.184 INFO:teuthology.orchestra.run.smithi117.stdout: "pid": "43094", 2024-04-04T06:56:58.185 INFO:teuthology.orchestra.run.smithi117.stdout: "root": "/" 2024-04-04T06:56:58.185 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-04-04T06:56:58.185 INFO:teuthology.orchestra.run.smithi117.stdout: "dentry_count": 0, 2024-04-04T06:56:58.185 INFO:teuthology.orchestra.run.smithi117.stdout: "dentry_pinned_count": 0, 2024-04-04T06:56:58.185 INFO:teuthology.orchestra.run.smithi117.stdout: "id": 4588, 2024-04-04T06:56:58.185 INFO:teuthology.orchestra.run.smithi117.stdout: "inst": { 2024-04-04T06:56:58.185 INFO:teuthology.orchestra.run.smithi117.stdout: "name": { 2024-04-04T06:56:58.185 INFO:teuthology.orchestra.run.smithi117.stdout: "type": "client", 2024-04-04T06:56:58.185 INFO:teuthology.orchestra.run.smithi117.stdout: "num": 4588 2024-04-04T06:56:58.185 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-04-04T06:56:58.185 INFO:teuthology.orchestra.run.smithi117.stdout: "addr": { 2024-04-04T06:56:58.185 INFO:teuthology.orchestra.run.smithi117.stdout: "type": "v1", 2024-04-04T06:56:58.185 INFO:teuthology.orchestra.run.smithi117.stdout: "addr": "192.168.0.1:0", 2024-04-04T06:56:58.185 INFO:teuthology.orchestra.run.smithi117.stdout: "nonce": 3395723411 2024-04-04T06:56:58.186 INFO:teuthology.orchestra.run.smithi117.stdout: } 2024-04-04T06:56:58.186 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-04-04T06:56:58.186 INFO:teuthology.orchestra.run.smithi117.stdout: "addr": { 2024-04-04T06:56:58.186 INFO:teuthology.orchestra.run.smithi117.stdout: "type": "v1", 2024-04-04T06:56:58.186 INFO:teuthology.orchestra.run.smithi117.stdout: "addr": "192.168.0.1:0", 2024-04-04T06:56:58.186 INFO:teuthology.orchestra.run.smithi117.stdout: "nonce": 3395723411 2024-04-04T06:56:58.186 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-04-04T06:56:58.186 INFO:teuthology.orchestra.run.smithi117.stdout: "inst_str": "client.4588 192.168.0.1:0/3395723411", 2024-04-04T06:56:58.186 INFO:teuthology.orchestra.run.smithi117.stdout: "addr_str": "192.168.0.1:0/3395723411", 2024-04-04T06:56:58.186 INFO:teuthology.orchestra.run.smithi117.stdout: "inode_count": 1, 2024-04-04T06:56:58.186 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_epoch": 8, 2024-04-04T06:56:58.186 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_epoch": 20, 2024-04-04T06:56:58.186 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_epoch_barrier": 0, 2024-04-04T06:56:58.186 INFO:teuthology.orchestra.run.smithi117.stdout: "blocklisted": false, 2024-04-04T06:56:58.187 INFO:teuthology.orchestra.run.smithi117.stdout: "fs_name": "cephfs" 2024-04-04T06:56:58.187 INFO:teuthology.orchestra.run.smithi117.stdout:} 2024-04-04T06:56:58.200 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-04T06:56:58.416 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:58.417+0000 7f6c1d400640 1 Processor -- start 2024-04-04T06:56:58.416 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:58.418+0000 7f6c1d400640 1 -- start start 2024-04-04T06:56:58.418 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:58.419+0000 7f6c1d400640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f6c18073570 0x7f6c18071610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:58.418 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:58.419+0000 7f6c1d400640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f6c180ccad0 0x7f6c180ccee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:58.418 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:58.419+0000 7f6c1d400640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c180cd420 con 0x7f6c1806eee0 2024-04-04T06:56:58.418 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:58.419+0000 7f6c1d400640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f6c18073950 con 0x7f6c180ccad0 2024-04-04T06:56:58.418 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:58.419+0000 7f6c1d400640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f6c180cb520 con 0x7f6c18073570 2024-04-04T06:56:58.418 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:58.419+0000 7f6c17200640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f6c180ccad0 0x7f6c180ccee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:58.418 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:58.419+0000 7f6c17200640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f6c180ccad0 0x7f6c180ccee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:50934/0 (socket says 172.21.15.72:50934) 2024-04-04T06:56:58.418 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:58.419+0000 7f6c17200640 1 -- 172.21.15.72:0/1491766284 learned_addr learned my addr 172.21.15.72:0/1491766284 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:56:58.419 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:58.420+0000 7f6c16800640 1 --2- 172.21.15.72:0/1491766284 >> v2:172.21.15.117:3300/0 conn(0x7f6c18073570 0x7f6c18071610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:58.419 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:58.420+0000 7f6c17200640 1 -- 172.21.15.72:0/1491766284 >> v2:172.21.15.117:3300/0 conn(0x7f6c18073570 msgr2=0x7f6c18071610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:56:58.419 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:58.420+0000 7f6c17200640 1 --2- 172.21.15.72:0/1491766284 >> v2:172.21.15.117:3300/0 conn(0x7f6c18073570 0x7f6c18071610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:58.419 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:58.420+0000 7f6c17200640 1 -- 172.21.15.72:0/1491766284 >> v1:172.21.15.117:6789/0 conn(0x7f6c1806eee0 legacy=0x7f6c180b3700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:56:58.419 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:58.420+0000 7f6c17200640 1 -- 172.21.15.72:0/1491766284 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c180b3f50 con 0x7f6c180ccad0 2024-04-04T06:56:58.420 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:58.421+0000 7f6c17200640 1 --2- 172.21.15.72:0/1491766284 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6c180ccad0 0x7f6c180ccee0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f6c1806f770 tx=0x7f6c1002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcff50af4819f049 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:58.420 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:58.421+0000 7f6c15400640 1 -- 172.21.15.72:0/1491766284 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c10034070 con 0x7f6c180ccad0 2024-04-04T06:56:58.420 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:58.421+0000 7f6c15400640 1 -- 172.21.15.72:0/1491766284 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c10030860 con 0x7f6c180ccad0 2024-04-04T06:56:58.420 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:58.421+0000 7f6c15400640 1 -- 172.21.15.72:0/1491766284 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c10030c30 con 0x7f6c180ccad0 2024-04-04T06:56:58.421 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:58.422+0000 7f6c1d400640 1 -- 172.21.15.72:0/1491766284 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6c180ccad0 msgr2=0x7f6c180ccee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:58.421 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:58.422+0000 7f6c1d400640 1 --2- 172.21.15.72:0/1491766284 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6c180ccad0 0x7f6c180ccee0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f6c1806f770 tx=0x7f6c1002b9a0 comp rx=0 tx=0).stop 2024-04-04T06:56:58.421 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:58.422+0000 7f6c1d400640 1 -- 172.21.15.72:0/1491766284 shutdown_connections 2024-04-04T06:56:58.421 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:58.422+0000 7f6c1d400640 1 --2- 172.21.15.72:0/1491766284 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6c180ccad0 0x7f6c180ccee0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:58.421 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:58.422+0000 7f6c1d400640 1 --2- 172.21.15.72:0/1491766284 >> v2:172.21.15.117:3300/0 conn(0x7f6c18073570 0x7f6c18071610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:58.421 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:58.422+0000 7f6c1d400640 1 -- 172.21.15.72:0/1491766284 >> 172.21.15.72:0/1491766284 conn(0x7f6c1806b470 msgr2=0x7f6c1806b880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:56:58.421 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:58.422+0000 7f6c1d400640 1 -- 172.21.15.72:0/1491766284 shutdown_connections 2024-04-04T06:56:58.421 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:58.422+0000 7f6c1d400640 1 -- 172.21.15.72:0/1491766284 wait complete. 2024-04-04T06:56:58.422 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:58.424+0000 7f6c1d400640 1 Processor -- start 2024-04-04T06:56:58.422 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:58.424+0000 7f6c1d400640 1 -- start start 2024-04-04T06:56:58.423 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:58.425+0000 7f6c1d400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6c1806eee0 0x7f6c181f7220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:58.423 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:58.425+0000 7f6c1d400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6c18073570 0x7f6c180aeeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:58.424 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:58.425+0000 7f6c1d400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6c180ccad0 0x7f6c180c9990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:58.424 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:58.425+0000 7f6c1d400640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f6c180b47f0 con 0x7f6c180ccad0 2024-04-04T06:56:58.424 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:58.425+0000 7f6c1d400640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f6c180b4510 con 0x7f6c18073570 2024-04-04T06:56:58.424 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:58.425+0000 7f6c1d400640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f6c180b4970 con 0x7f6c1806eee0 2024-04-04T06:56:58.424 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:58.425+0000 7f6c17200640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6c180ccad0 0x7f6c180c9990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:58.424 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:58.425+0000 7f6c17200640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6c180ccad0 0x7f6c180c9990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:50942/0 (socket says 172.21.15.72:50942) 2024-04-04T06:56:58.424 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:58.425+0000 7f6c17200640 1 -- 172.21.15.72:0/2212385797 learned_addr learned my addr 172.21.15.72:0/2212385797 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:56:58.425 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:58.425+0000 7f6c15e00640 1 --2- 172.21.15.72:0/2212385797 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6c18073570 0x7f6c180aeeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:58.425 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:58.425+0000 7f6c16800640 1 --2- 172.21.15.72:0/2212385797 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6c1806eee0 0x7f6c181f7220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:58.425 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:58.425+0000 7f6c17200640 1 -- 172.21.15.72:0/2212385797 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6c1806eee0 msgr2=0x7f6c181f7220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:58.425 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:58.425+0000 7f6c17200640 1 --2- 172.21.15.72:0/2212385797 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6c1806eee0 0x7f6c181f7220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:58.425 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:58.425+0000 7f6c17200640 1 -- 172.21.15.72:0/2212385797 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6c18073570 msgr2=0x7f6c180aeeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:58.426 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:58.425+0000 7f6c17200640 1 --2- 172.21.15.72:0/2212385797 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6c18073570 0x7f6c180aeeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:58.426 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:58.426+0000 7f6c17200640 1 -- 172.21.15.72:0/2212385797 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c180c8bd0 con 0x7f6c180ccad0 2024-04-04T06:56:58.426 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:58.426+0000 7f6c17200640 1 --2- 172.21.15.72:0/2212385797 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6c180ccad0 0x7f6c180c9990 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f6c1002b9e0 tx=0x7f6c100046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:58.426 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:58.426+0000 7f6c0ea00640 1 -- 172.21.15.72:0/2212385797 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c10034040 con 0x7f6c180ccad0 2024-04-04T06:56:58.426 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:58.426+0000 7f6c0ea00640 1 -- 172.21.15.72:0/2212385797 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c10039d90 con 0x7f6c180ccad0 2024-04-04T06:56:58.426 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:58.426+0000 7f6c0ea00640 1 -- 172.21.15.72:0/2212385797 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c10043630 con 0x7f6c180ccad0 2024-04-04T06:56:58.426 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:58.426+0000 7f6c1d400640 1 -- 172.21.15.72:0/2212385797 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c180c8eb0 con 0x7f6c180ccad0 2024-04-04T06:56:58.426 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:58.426+0000 7f6c1d400640 1 -- 172.21.15.72:0/2212385797 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c181f7760 con 0x7f6c180ccad0 2024-04-04T06:56:58.426 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:58.428+0000 7f6c1d400640 1 -- 172.21.15.72:0/2212385797 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c18075840 con 0x7f6c180ccad0 2024-04-04T06:56:58.427 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:58.428+0000 7f6c0ea00640 1 -- 172.21.15.72:0/2212385797 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6c10037070 con 0x7f6c180ccad0 2024-04-04T06:56:58.428 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:58.430+0000 7f6c0ea00640 1 --2- 172.21.15.72:0/2212385797 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f6bf806c8f0 0x7f6bf806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:56:58.429 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:58.430+0000 7f6c0ea00640 1 -- 172.21.15.72:0/2212385797 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f6c100add90 con 0x7f6c180ccad0 2024-04-04T06:56:58.429 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:58.430+0000 7f6c16800640 1 --2- 172.21.15.72:0/2212385797 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f6bf806c8f0 0x7f6bf806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:56:58.429 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:58.431+0000 7f6c16800640 1 --2- 172.21.15.72:0/2212385797 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f6bf806c8f0 0x7f6bf806edb0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f6c08009f30 tx=0x7f6c0800b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:56:58.432 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:58.434+0000 7f6c0ea00640 1 -- 172.21.15.72:0/2212385797 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f6c1003e070 con 0x7f6c180ccad0 2024-04-04T06:56:58.670 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:58.671+0000 7f6c1d400640 1 -- 172.21.15.72:0/2212385797 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f6c180cc360 con 0x7f6c180ccad0 2024-04-04T06:56:58.670 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:58.672+0000 7f6c0ea00640 1 -- 172.21.15.72:0/2212385797 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+73 (secure 0 0 0) 0x7f6c180cd420 con 0x7f6c180ccad0 2024-04-04T06:56:58.670 INFO:teuthology.orchestra.run.smithi072.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-04T06:56:58.672 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:58.674+0000 7f6c1d400640 1 -- 172.21.15.72:0/2212385797 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f6bf806c8f0 msgr2=0x7f6bf806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:58.673 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:58.674+0000 7f6c1d400640 1 --2- 172.21.15.72:0/2212385797 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f6bf806c8f0 0x7f6bf806edb0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f6c08009f30 tx=0x7f6c0800b040 comp rx=0 tx=0).stop 2024-04-04T06:56:58.673 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:58.674+0000 7f6c1d400640 1 -- 172.21.15.72:0/2212385797 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6c180ccad0 msgr2=0x7f6c180c9990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:56:58.673 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:58.674+0000 7f6c1d400640 1 --2- 172.21.15.72:0/2212385797 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6c180ccad0 0x7f6c180c9990 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f6c1002b9e0 tx=0x7f6c100046c0 comp rx=0 tx=0).stop 2024-04-04T06:56:58.673 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:58.674+0000 7f6c1d400640 1 -- 172.21.15.72:0/2212385797 shutdown_connections 2024-04-04T06:56:58.673 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:58.674+0000 7f6c1d400640 1 --2- 172.21.15.72:0/2212385797 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f6bf806c8f0 0x7f6bf806edb0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:58.673 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:58.674+0000 7f6c1d400640 1 --2- 172.21.15.72:0/2212385797 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6c180ccad0 0x7f6c180c9990 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:58.673 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:58.674+0000 7f6c1d400640 1 --2- 172.21.15.72:0/2212385797 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6c18073570 0x7f6c180aeeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:58.673 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:58.674+0000 7f6c1d400640 1 --2- 172.21.15.72:0/2212385797 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6c1806eee0 0x7f6c181f7220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:56:58.673 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:58.674+0000 7f6c1d400640 1 -- 172.21.15.72:0/2212385797 >> 172.21.15.72:0/2212385797 conn(0x7f6c1806b470 msgr2=0x7f6c1806b850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:56:58.673 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:58.674+0000 7f6c1d400640 1 -- 172.21.15.72:0/2212385797 shutdown_connections 2024-04-04T06:56:58.673 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:56:58.674+0000 7f6c1d400640 1 -- 172.21.15.72:0/2212385797 wait complete. 2024-04-04T06:56:58.691 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-04T06:56:58.691 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-04T06:56:58.691 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi117.front.sepia.ceph.com 2024-04-04T06:56:58.691 INFO:tasks.cephfs.mount:self.client.name = client.3 2024-04-04T06:56:58.691 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-04-04T06:56:58.691 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-04T06:56:58.691 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-04T06:56:58.691 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-04T06:56:58.691 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2024-04-04T06:56:58.691 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-04T06:56:58.692 DEBUG:teuthology.orchestra.run.smithi117:> ip addr 2024-04-04T06:56:58.750 INFO:teuthology.orchestra.run.smithi117.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-04T06:56:58.750 INFO:teuthology.orchestra.run.smithi117.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-04T06:56:58.750 INFO:teuthology.orchestra.run.smithi117.stdout: inet 127.0.0.1/8 scope host lo 2024-04-04T06:56:58.750 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2024-04-04T06:56:58.750 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 ::1/128 scope host 2024-04-04T06:56:58.750 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2024-04-04T06:56:58.750 INFO:teuthology.orchestra.run.smithi117.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-04T06:56:58.750 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 0c:c4:7a:d8:a8:8a brd ff:ff:ff:ff:ff:ff 2024-04-04T06:56:58.750 INFO:teuthology.orchestra.run.smithi117.stdout: altname enp7s0f0 2024-04-04T06:56:58.751 INFO:teuthology.orchestra.run.smithi117.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-04T06:56:58.751 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 0c:c4:7a:d8:a8:8b brd ff:ff:ff:ff:ff:ff 2024-04-04T06:56:58.751 INFO:teuthology.orchestra.run.smithi117.stdout: altname enp7s0f1 2024-04-04T06:56:58.751 INFO:teuthology.orchestra.run.smithi117.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-04T06:56:58.751 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 0c:c4:7a:8f:44:62 brd ff:ff:ff:ff:ff:ff 2024-04-04T06:56:58.751 INFO:teuthology.orchestra.run.smithi117.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-04T06:56:58.751 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 0c:c4:7a:8f:44:63 brd ff:ff:ff:ff:ff:ff 2024-04-04T06:56:58.751 INFO:teuthology.orchestra.run.smithi117.stdout: inet 172.21.15.117/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-04-04T06:56:58.751 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft 42327sec preferred_lft 42327sec 2024-04-04T06:56:58.751 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 fe80::ec4:7aff:fe8f:4463/64 scope link 2024-04-04T06:56:58.751 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2024-04-04T06:56:58.751 INFO:teuthology.orchestra.run.smithi117.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-04T06:56:58.751 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether ba:57:38:c9:37:11 brd ff:ff:ff:ff:ff:ff 2024-04-04T06:56:58.751 INFO:teuthology.orchestra.run.smithi117.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-04T06:56:58.752 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2024-04-04T06:56:58.752 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 fe80::c04e:c8ff:fe85:534e/64 scope link 2024-04-04T06:56:58.752 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2024-04-04T06:56:58.752 INFO:teuthology.orchestra.run.smithi117.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-04T06:56:58.752 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether ba:57:38:c9:37:11 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-04T06:56:58.752 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 fe80::b857:38ff:fec9:3711/64 scope link 2024-04-04T06:56:58.752 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2024-04-04T06:56:58.753 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-04T06:56:58.753 DEBUG:teuthology.orchestra.run.smithi117:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-04T06:56:58.841 INFO:teuthology.orchestra.run.smithi117.stdout:1 2024-04-04T06:56:58.845 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-04T06:56:58.845 DEBUG:teuthology.orchestra.run.smithi117:> route 2024-04-04T06:56:58.899 INFO:teuthology.orchestra.run.smithi117.stdout:Kernel IP routing table 2024-04-04T06:56:58.900 INFO:teuthology.orchestra.run.smithi117.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-04T06:56:58.900 INFO:teuthology.orchestra.run.smithi117.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-04T06:56:58.900 INFO:teuthology.orchestra.run.smithi117.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-04T06:56:58.900 INFO:teuthology.orchestra.run.smithi117.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-04T06:56:58.900 DEBUG:teuthology.orchestra.run.smithi117:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-04T06:56:58.900 DEBUG:teuthology.orchestra.run.smithi117:> set -e 2024-04-04T06:56:58.900 DEBUG:teuthology.orchestra.run.smithi117:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-04T06:56:58.900 DEBUG:teuthology.orchestra.run.smithi117:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-04T06:56:58.900 DEBUG:teuthology.orchestra.run.smithi117:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-04T06:56:58.901 DEBUG:teuthology.orchestra.run.smithi117:> ') 2024-04-04T06:56:59.004 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:59 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-04T06:56:59.132 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-04T06:56:59.142 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-04T06:56:59.142 DEBUG:teuthology.orchestra.run.smithi117:> ip netns list 2024-04-04T06:56:59.193 INFO:teuthology.orchestra.run.smithi117.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-04-04T06:56:59.194 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-04T06:56:59.194 DEBUG:teuthology.orchestra.run.smithi117:> ip netns list-id 2024-04-04T06:56:59.242 INFO:teuthology.orchestra.run.smithi117.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2024-04-04T06:56:59.244 DEBUG:teuthology.orchestra.run.smithi117:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-04T06:56:59.244 DEBUG:teuthology.orchestra.run.smithi117:> set -e 2024-04-04T06:56:59.244 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2024-04-04T06:56:59.244 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2024-04-04T06:56:59.244 DEBUG:teuthology.orchestra.run.smithi117:> ') 2024-04-04T06:56:59.346 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:59 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-04T06:56:59.434 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-04T06:56:59.443 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-04T06:56:59.443 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-04-04T06:56:59.525 INFO:teuthology.orchestra.run.smithi117.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-04T06:56:59.525 INFO:teuthology.orchestra.run.smithi117.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-04T06:56:59.525 INFO:teuthology.orchestra.run.smithi117.stdout: inet 127.0.0.1/8 scope host lo 2024-04-04T06:56:59.526 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2024-04-04T06:56:59.526 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 ::1/128 scope host 2024-04-04T06:56:59.526 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2024-04-04T06:56:59.526 INFO:teuthology.orchestra.run.smithi117.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-04T06:56:59.526 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 32:64:50:23:09:13 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-04-04T06:56:59.526 INFO:teuthology.orchestra.run.smithi117.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-04-04T06:56:59.526 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2024-04-04T06:56:59.526 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 fe80::3064:50ff:fe23:913/64 scope link 2024-04-04T06:56:59.526 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2024-04-04T06:56:59.529 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-04T06:56:59.529 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-04-04T06:56:59.622 INFO:teuthology.orchestra.run.smithi117.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-04T06:56:59.622 INFO:teuthology.orchestra.run.smithi117.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-04T06:56:59.622 INFO:teuthology.orchestra.run.smithi117.stdout: inet 127.0.0.1/8 scope host lo 2024-04-04T06:56:59.622 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2024-04-04T06:56:59.622 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 ::1/128 scope host 2024-04-04T06:56:59.622 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2024-04-04T06:56:59.622 INFO:teuthology.orchestra.run.smithi117.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-04T06:56:59.622 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 32:64:50:23:09:13 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-04-04T06:56:59.623 INFO:teuthology.orchestra.run.smithi117.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-04-04T06:56:59.623 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2024-04-04T06:56:59.623 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 fe80::3064:50ff:fe23:913/64 scope link 2024-04-04T06:56:59.623 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2024-04-04T06:56:59.627 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2024-04-04T06:56:59.627 DEBUG:teuthology.orchestra.run.smithi117:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-04T06:56:59.627 DEBUG:teuthology.orchestra.run.smithi117:> set -e 2024-04-04T06:56:59.627 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2024-04-04T06:56:59.627 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-04-04T06:56:59.627 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2024-04-04T06:56:59.627 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2024-04-04T06:56:59.627 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2024-04-04T06:56:59.627 DEBUG:teuthology.orchestra.run.smithi117:> ') 2024-04-04T06:56:59.734 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:59 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-04T06:56:59.952 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:56:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-04T06:56:59.961 DEBUG:teuthology.orchestra.run.smithi117:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-04T06:56:59.961 DEBUG:teuthology.orchestra.run.smithi117:> set -e 2024-04-04T06:56:59.961 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip link set brx.1 up 2024-04-04T06:56:59.961 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip link set dev brx.1 master ceph-brx 2024-04-04T06:56:59.962 DEBUG:teuthology.orchestra.run.smithi117:> ') 2024-04-04T06:57:00.064 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:57:00 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-04T06:57:00.182 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:57:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-04T06:57:00.191 INFO:tasks.cephfs.fuse_mount:Client client.3 config is {} 2024-04-04T06:57:00.191 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-04T06:57:00.191 DEBUG:teuthology.orchestra.run.smithi117:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2024-04-04T06:57:00.238 INFO:teuthology.orchestra.run.smithi117.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2024-04-04T06:57:00.238 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-04T06:57:00.239 DEBUG:teuthology.orchestra.run.smithi117:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2024-04-04T06:57:00.333 DEBUG:teuthology.orchestra.run.smithi117:> sudo modprobe fuse 2024-04-04T06:57:00.423 DEBUG:teuthology.orchestra.run.smithi117:> cat /proc/self/mounts | awk '{print $2}' 2024-04-04T06:57:00.477 INFO:teuthology.orchestra.run.smithi117.stdout:/proc 2024-04-04T06:57:00.477 INFO:teuthology.orchestra.run.smithi117.stdout:/sys 2024-04-04T06:57:00.477 INFO:teuthology.orchestra.run.smithi117.stdout:/dev 2024-04-04T06:57:00.477 INFO:teuthology.orchestra.run.smithi117.stdout:/sys/kernel/security 2024-04-04T06:57:00.477 INFO:teuthology.orchestra.run.smithi117.stdout:/dev/shm 2024-04-04T06:57:00.477 INFO:teuthology.orchestra.run.smithi117.stdout:/dev/pts 2024-04-04T06:57:00.477 INFO:teuthology.orchestra.run.smithi117.stdout:/run 2024-04-04T06:57:00.477 INFO:teuthology.orchestra.run.smithi117.stdout:/sys/fs/cgroup 2024-04-04T06:57:00.477 INFO:teuthology.orchestra.run.smithi117.stdout:/sys/fs/pstore 2024-04-04T06:57:00.478 INFO:teuthology.orchestra.run.smithi117.stdout:/sys/fs/bpf 2024-04-04T06:57:00.478 INFO:teuthology.orchestra.run.smithi117.stdout:/ 2024-04-04T06:57:00.478 INFO:teuthology.orchestra.run.smithi117.stdout:/sys/fs/selinux 2024-04-04T06:57:00.478 INFO:teuthology.orchestra.run.smithi117.stdout:/proc/sys/fs/binfmt_misc 2024-04-04T06:57:00.478 INFO:teuthology.orchestra.run.smithi117.stdout:/dev/hugepages 2024-04-04T06:57:00.478 INFO:teuthology.orchestra.run.smithi117.stdout:/dev/mqueue 2024-04-04T06:57:00.478 INFO:teuthology.orchestra.run.smithi117.stdout:/sys/kernel/debug 2024-04-04T06:57:00.478 INFO:teuthology.orchestra.run.smithi117.stdout:/sys/kernel/tracing 2024-04-04T06:57:00.478 INFO:teuthology.orchestra.run.smithi117.stdout:/sys/kernel/config 2024-04-04T06:57:00.478 INFO:teuthology.orchestra.run.smithi117.stdout:/sys/fs/fuse/connections 2024-04-04T06:57:00.478 INFO:teuthology.orchestra.run.smithi117.stdout:/run/credentials/systemd-sysctl.service 2024-04-04T06:57:00.478 INFO:teuthology.orchestra.run.smithi117.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-04T06:57:00.478 INFO:teuthology.orchestra.run.smithi117.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-04T06:57:00.478 INFO:teuthology.orchestra.run.smithi117.stdout:/var/lib/nfs/rpc_pipefs 2024-04-04T06:57:00.479 INFO:teuthology.orchestra.run.smithi117.stdout:/run/user/1000 2024-04-04T06:57:00.479 INFO:teuthology.orchestra.run.smithi117.stdout:/var/lib/ceph 2024-04-04T06:57:00.479 INFO:teuthology.orchestra.run.smithi117.stdout:/var/lib/ceph/osd/ceph-4 2024-04-04T06:57:00.479 INFO:teuthology.orchestra.run.smithi117.stdout:/var/lib/ceph/osd/ceph-5 2024-04-04T06:57:00.479 INFO:teuthology.orchestra.run.smithi117.stdout:/var/lib/ceph/osd/ceph-6 2024-04-04T06:57:00.479 INFO:teuthology.orchestra.run.smithi117.stdout:/var/lib/ceph/osd/ceph-7 2024-04-04T06:57:00.479 INFO:teuthology.orchestra.run.smithi117.stdout:/run/netns 2024-04-04T06:57:00.479 INFO:teuthology.orchestra.run.smithi117.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-04T06:57:00.479 INFO:teuthology.orchestra.run.smithi117.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-04T06:57:00.479 INFO:teuthology.orchestra.run.smithi117.stdout:/home/ubuntu/cephtest/mnt.1 2024-04-04T06:57:00.479 INFO:teuthology.orchestra.run.smithi117.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-04-04T06:57:00.479 INFO:teuthology.orchestra.run.smithi117.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-04-04T06:57:00.480 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-04T06:57:00.480 DEBUG:teuthology.orchestra.run.smithi117:> ls /sys/fs/fuse/connections 2024-04-04T06:57:00.531 INFO:teuthology.orchestra.run.smithi117.stdout:41 2024-04-04T06:57:00.531 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [41] 2024-04-04T06:57:00.532 DEBUG:teuthology.orchestra.run.smithi117:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.3 --id 3) 2024-04-04T06:57:00.537 DEBUG:teuthology.orchestra.run.smithi117:> sudo modprobe fuse 2024-04-04T06:57:00.609 DEBUG:teuthology.orchestra.run.smithi117:> cat /proc/self/mounts | awk '{print $2}' 2024-04-04T06:57:00.646 INFO:teuthology.orchestra.run.smithi117.stdout:/proc 2024-04-04T06:57:00.646 INFO:teuthology.orchestra.run.smithi117.stdout:/sys 2024-04-04T06:57:00.647 INFO:teuthology.orchestra.run.smithi117.stdout:/dev 2024-04-04T06:57:00.647 INFO:teuthology.orchestra.run.smithi117.stdout:/sys/kernel/security 2024-04-04T06:57:00.647 INFO:teuthology.orchestra.run.smithi117.stdout:/dev/shm 2024-04-04T06:57:00.647 INFO:teuthology.orchestra.run.smithi117.stdout:/dev/pts 2024-04-04T06:57:00.647 INFO:teuthology.orchestra.run.smithi117.stdout:/run 2024-04-04T06:57:00.647 INFO:teuthology.orchestra.run.smithi117.stdout:/sys/fs/cgroup 2024-04-04T06:57:00.647 INFO:teuthology.orchestra.run.smithi117.stdout:/sys/fs/pstore 2024-04-04T06:57:00.647 INFO:teuthology.orchestra.run.smithi117.stdout:/sys/fs/bpf 2024-04-04T06:57:00.647 INFO:teuthology.orchestra.run.smithi117.stdout:/ 2024-04-04T06:57:00.647 INFO:teuthology.orchestra.run.smithi117.stdout:/sys/fs/selinux 2024-04-04T06:57:00.647 INFO:teuthology.orchestra.run.smithi117.stdout:/proc/sys/fs/binfmt_misc 2024-04-04T06:57:00.647 INFO:teuthology.orchestra.run.smithi117.stdout:/dev/hugepages 2024-04-04T06:57:00.647 INFO:teuthology.orchestra.run.smithi117.stdout:/dev/mqueue 2024-04-04T06:57:00.647 INFO:teuthology.orchestra.run.smithi117.stdout:/sys/kernel/debug 2024-04-04T06:57:00.647 INFO:teuthology.orchestra.run.smithi117.stdout:/sys/kernel/tracing 2024-04-04T06:57:00.648 INFO:teuthology.orchestra.run.smithi117.stdout:/sys/kernel/config 2024-04-04T06:57:00.648 INFO:teuthology.orchestra.run.smithi117.stdout:/sys/fs/fuse/connections 2024-04-04T06:57:00.648 INFO:teuthology.orchestra.run.smithi117.stdout:/run/credentials/systemd-sysctl.service 2024-04-04T06:57:00.648 INFO:teuthology.orchestra.run.smithi117.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-04T06:57:00.648 INFO:teuthology.orchestra.run.smithi117.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-04T06:57:00.648 INFO:teuthology.orchestra.run.smithi117.stdout:/var/lib/nfs/rpc_pipefs 2024-04-04T06:57:00.648 INFO:teuthology.orchestra.run.smithi117.stdout:/run/user/1000 2024-04-04T06:57:00.648 INFO:teuthology.orchestra.run.smithi117.stdout:/var/lib/ceph 2024-04-04T06:57:00.648 INFO:teuthology.orchestra.run.smithi117.stdout:/var/lib/ceph/osd/ceph-4 2024-04-04T06:57:00.648 INFO:teuthology.orchestra.run.smithi117.stdout:/var/lib/ceph/osd/ceph-5 2024-04-04T06:57:00.648 INFO:teuthology.orchestra.run.smithi117.stdout:/var/lib/ceph/osd/ceph-6 2024-04-04T06:57:00.648 INFO:teuthology.orchestra.run.smithi117.stdout:/var/lib/ceph/osd/ceph-7 2024-04-04T06:57:00.648 INFO:teuthology.orchestra.run.smithi117.stdout:/run/netns 2024-04-04T06:57:00.648 INFO:teuthology.orchestra.run.smithi117.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-04T06:57:00.648 INFO:teuthology.orchestra.run.smithi117.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-04T06:57:00.648 INFO:teuthology.orchestra.run.smithi117.stdout:/home/ubuntu/cephtest/mnt.1 2024-04-04T06:57:00.649 INFO:teuthology.orchestra.run.smithi117.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-04-04T06:57:00.649 INFO:teuthology.orchestra.run.smithi117.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-04-04T06:57:00.649 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-04T06:57:00.650 DEBUG:teuthology.orchestra.run.smithi117:> ls /sys/fs/fuse/connections 2024-04-04T06:57:00.714 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi117.stderr:2024-04-04T06:57:00.715+0000 7fd0b484a480 -1 init, newargv = 0x5622330a43f0 newargc=15 2024-04-04T06:57:00.714 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi117.stderr:ceph-fuse[43550]: starting ceph client 2024-04-04T06:57:00.725 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi117.stderr:ceph-fuse[43550]: starting fuse 2024-04-04T06:57:00.735 INFO:teuthology.orchestra.run.smithi117.stdout:41 2024-04-04T06:57:00.735 INFO:teuthology.orchestra.run.smithi117.stdout:43 2024-04-04T06:57:00.735 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41, 43] 2024-04-04T06:57:00.736 DEBUG:teuthology.orchestra.run.smithi117:> sudo stdin-killer -- python3 -c ' 2024-04-04T06:57:00.736 DEBUG:teuthology.orchestra.run.smithi117:> import glob 2024-04-04T06:57:00.736 DEBUG:teuthology.orchestra.run.smithi117:> import re 2024-04-04T06:57:00.736 DEBUG:teuthology.orchestra.run.smithi117:> import os 2024-04-04T06:57:00.736 DEBUG:teuthology.orchestra.run.smithi117:> import subprocess 2024-04-04T06:57:00.736 DEBUG:teuthology.orchestra.run.smithi117:> 2024-04-04T06:57:00.736 DEBUG:teuthology.orchestra.run.smithi117:> def _find_admin_socket(client_name): 2024-04-04T06:57:00.736 DEBUG:teuthology.orchestra.run.smithi117:> asok_path = "/var/run/ceph/ceph-client.3.*.asok" 2024-04-04T06:57:00.736 DEBUG:teuthology.orchestra.run.smithi117:> files = glob.glob(asok_path) 2024-04-04T06:57:00.736 DEBUG:teuthology.orchestra.run.smithi117:> mountpoint = "/home/ubuntu/cephtest/mnt.3" 2024-04-04T06:57:00.736 DEBUG:teuthology.orchestra.run.smithi117:> 2024-04-04T06:57:00.736 DEBUG:teuthology.orchestra.run.smithi117:> # Given a non-glob path, it better be there 2024-04-04T06:57:00.736 DEBUG:teuthology.orchestra.run.smithi117:> if "*" not in asok_path: 2024-04-04T06:57:00.736 DEBUG:teuthology.orchestra.run.smithi117:> assert(len(files) == 1) 2024-04-04T06:57:00.737 DEBUG:teuthology.orchestra.run.smithi117:> return files[0] 2024-04-04T06:57:00.737 DEBUG:teuthology.orchestra.run.smithi117:> 2024-04-04T06:57:00.737 DEBUG:teuthology.orchestra.run.smithi117:> for f in files: 2024-04-04T06:57:00.737 DEBUG:teuthology.orchestra.run.smithi117:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-04T06:57:00.737 DEBUG:teuthology.orchestra.run.smithi117:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-04T06:57:00.737 DEBUG:teuthology.orchestra.run.smithi117:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-04T06:57:00.737 DEBUG:teuthology.orchestra.run.smithi117:> contents = proc_f.read() 2024-04-04T06:57:00.737 DEBUG:teuthology.orchestra.run.smithi117:> if mountpoint in contents: 2024-04-04T06:57:00.737 DEBUG:teuthology.orchestra.run.smithi117:> return f 2024-04-04T06:57:00.737 DEBUG:teuthology.orchestra.run.smithi117:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-04T06:57:00.737 DEBUG:teuthology.orchestra.run.smithi117:> 2024-04-04T06:57:00.737 DEBUG:teuthology.orchestra.run.smithi117:> print(_find_admin_socket("client.3")) 2024-04-04T06:57:00.737 DEBUG:teuthology.orchestra.run.smithi117:> ' 2024-04-04T06:57:00.938 INFO:teuthology.orchestra.run.smithi117.stdout:/var/run/ceph/ceph-client.3.43550.asok 2024-04-04T06:57:00.943 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-04T06:57:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-04T06:57:00.956 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.3.43550.asok 2024-04-04T06:57:00.956 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-04T06:57:00.956 DEBUG:teuthology.orchestra.run.smithi117:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.3.43550.asok status 2024-04-04T06:57:01.185 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2024-04-04T06:57:01.186 INFO:teuthology.orchestra.run.smithi117.stdout: "metadata": { 2024-04-04T06:57:01.186 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph_sha1": "addbc488dc763e752c640619b677f10e0da02c9f", 2024-04-04T06:57:01.186 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph_version": "ceph version 19.0.0-2571-gaddbc488 (addbc488dc763e752c640619b677f10e0da02c9f) squid (dev)", 2024-04-04T06:57:01.186 INFO:teuthology.orchestra.run.smithi117.stdout: "entity_id": "3", 2024-04-04T06:57:01.186 INFO:teuthology.orchestra.run.smithi117.stdout: "hostname": "smithi117", 2024-04-04T06:57:01.186 INFO:teuthology.orchestra.run.smithi117.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.3", 2024-04-04T06:57:01.186 INFO:teuthology.orchestra.run.smithi117.stdout: "pid": "43550", 2024-04-04T06:57:01.186 INFO:teuthology.orchestra.run.smithi117.stdout: "root": "/" 2024-04-04T06:57:01.186 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-04-04T06:57:01.186 INFO:teuthology.orchestra.run.smithi117.stdout: "dentry_count": 0, 2024-04-04T06:57:01.186 INFO:teuthology.orchestra.run.smithi117.stdout: "dentry_pinned_count": 0, 2024-04-04T06:57:01.187 INFO:teuthology.orchestra.run.smithi117.stdout: "id": 4603, 2024-04-04T06:57:01.187 INFO:teuthology.orchestra.run.smithi117.stdout: "inst": { 2024-04-04T06:57:01.187 INFO:teuthology.orchestra.run.smithi117.stdout: "name": { 2024-04-04T06:57:01.187 INFO:teuthology.orchestra.run.smithi117.stdout: "type": "client", 2024-04-04T06:57:01.187 INFO:teuthology.orchestra.run.smithi117.stdout: "num": 4603 2024-04-04T06:57:01.187 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-04-04T06:57:01.187 INFO:teuthology.orchestra.run.smithi117.stdout: "addr": { 2024-04-04T06:57:01.187 INFO:teuthology.orchestra.run.smithi117.stdout: "type": "v1", 2024-04-04T06:57:01.187 INFO:teuthology.orchestra.run.smithi117.stdout: "addr": "192.168.0.2:0", 2024-04-04T06:57:01.187 INFO:teuthology.orchestra.run.smithi117.stdout: "nonce": 1394701977 2024-04-04T06:57:01.187 INFO:teuthology.orchestra.run.smithi117.stdout: } 2024-04-04T06:57:01.187 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-04-04T06:57:01.188 INFO:teuthology.orchestra.run.smithi117.stdout: "addr": { 2024-04-04T06:57:01.188 INFO:teuthology.orchestra.run.smithi117.stdout: "type": "v1", 2024-04-04T06:57:01.188 INFO:teuthology.orchestra.run.smithi117.stdout: "addr": "192.168.0.2:0", 2024-04-04T06:57:01.188 INFO:teuthology.orchestra.run.smithi117.stdout: "nonce": 1394701977 2024-04-04T06:57:01.188 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-04-04T06:57:01.188 INFO:teuthology.orchestra.run.smithi117.stdout: "inst_str": "client.4603 192.168.0.2:0/1394701977", 2024-04-04T06:57:01.188 INFO:teuthology.orchestra.run.smithi117.stdout: "addr_str": "192.168.0.2:0/1394701977", 2024-04-04T06:57:01.188 INFO:teuthology.orchestra.run.smithi117.stdout: "inode_count": 1, 2024-04-04T06:57:01.188 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_epoch": 8, 2024-04-04T06:57:01.188 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_epoch": 20, 2024-04-04T06:57:01.188 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_epoch_barrier": 0, 2024-04-04T06:57:01.189 INFO:teuthology.orchestra.run.smithi117.stdout: "blocklisted": false, 2024-04-04T06:57:01.189 INFO:teuthology.orchestra.run.smithi117.stdout: "fs_name": "cephfs" 2024-04-04T06:57:01.189 INFO:teuthology.orchestra.run.smithi117.stdout:} 2024-04-04T06:57:01.202 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-04T06:57:01.202 DEBUG:teuthology.orchestra.run.smithi072:> stat --file-system '--printf=%T 2024-04-04T06:57:01.202 DEBUG:teuthology.orchestra.run.smithi072:> ' -- /home/ubuntu/cephtest/mnt.0 2024-04-04T06:57:01.258 INFO:teuthology.orchestra.run.smithi072.stdout:fuseblk 2024-04-04T06:57:01.258 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-04-04T06:57:01.258 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-04T06:57:01.258 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-04T06:57:01.348 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-04T06:57:01.349 DEBUG:teuthology.orchestra.run.smithi072:> stat --file-system '--printf=%T 2024-04-04T06:57:01.349 DEBUG:teuthology.orchestra.run.smithi072:> ' -- /home/ubuntu/cephtest/mnt.2 2024-04-04T06:57:01.403 INFO:teuthology.orchestra.run.smithi072.stdout:fuseblk 2024-04-04T06:57:01.403 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.2 2024-04-04T06:57:01.405 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-04T06:57:01.406 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2024-04-04T06:57:01.488 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-04T06:57:01.488 DEBUG:teuthology.orchestra.run.smithi117:> stat --file-system '--printf=%T 2024-04-04T06:57:01.488 DEBUG:teuthology.orchestra.run.smithi117:> ' -- /home/ubuntu/cephtest/mnt.1 2024-04-04T06:57:01.546 INFO:teuthology.orchestra.run.smithi117.stdout:fuseblk 2024-04-04T06:57:01.546 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2024-04-04T06:57:01.547 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-04T06:57:01.547 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-04-04T06:57:01.634 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-04T06:57:01.634 DEBUG:teuthology.orchestra.run.smithi117:> stat --file-system '--printf=%T 2024-04-04T06:57:01.635 DEBUG:teuthology.orchestra.run.smithi117:> ' -- /home/ubuntu/cephtest/mnt.3 2024-04-04T06:57:01.687 INFO:teuthology.orchestra.run.smithi117.stdout:fuseblk 2024-04-04T06:57:01.687 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.3 2024-04-04T06:57:01.688 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-04T06:57:01.688 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2024-04-04T06:57:01.779 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-04-04T06:57:01.797 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-04T06:57:01.998 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:02.000+0000 7f18de800640 1 Processor -- start 2024-04-04T06:57:01.999 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:02.000+0000 7f18de800640 1 -- start start 2024-04-04T06:57:02.000 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:02.001+0000 7f18de800640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f18d815e5a0 0x7f18d80b75c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:02.000 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:02.001+0000 7f18de800640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f18d80cf7f0 con 0x7f18d80d3540 2024-04-04T06:57:02.000 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:02.001+0000 7f18de800640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f18d80cfad0 con 0x7f18d80b7b00 2024-04-04T06:57:02.000 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:02.001+0000 7f18de800640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f18d80d2350 con 0x7f18d815e5a0 2024-04-04T06:57:02.001 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:02.002+0000 7f18dd400640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f18d815e5a0 0x7f18d80b75c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:02.001 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:02.002+0000 7f18dde00640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f18d80d3540 0x7f18d80d08e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:37806/0 (socket says 172.21.15.72:37806) 2024-04-04T06:57:02.001 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:02.002+0000 7f18dde00640 1 -- 172.21.15.72:0/2287197579 learned_addr learned my addr 172.21.15.72:0/2287197579 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-04-04T06:57:02.001 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:02.002+0000 7f18dd400640 1 -- 172.21.15.72:0/2287197579 >> v1:172.21.15.117:6789/0 conn(0x7f18d80b7b00 legacy=0x7f18d80d2e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:57:02.001 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:02.002+0000 7f18d7e00640 1 -- 172.21.15.72:0/2287197579 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3629179853 0 0) 0x7f18d80cf7f0 con 0x7f18d80d3540 2024-04-04T06:57:02.001 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:02.002+0000 7f18dd400640 1 -- 172.21.15.72:0/2287197579 >> v1:172.21.15.72:6789/0 conn(0x7f18d80d3540 legacy=0x7f18d80d08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:02.001 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:02.002+0000 7f18dd400640 1 -- 172.21.15.72:0/2287197579 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18d80d2630 con 0x7f18d815e5a0 2024-04-04T06:57:02.002 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:02.004+0000 7f18dd400640 1 --2- 172.21.15.72:0/2287197579 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f18d815e5a0 0x7f18d80b75c0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f18c80097a0 tx=0x7f18c802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=507f31ab5b30773e server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:02.002 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:02.004+0000 7f18d7e00640 1 -- 172.21.15.72:0/2287197579 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18c8035020 con 0x7f18d815e5a0 2024-04-04T06:57:02.003 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:02.004+0000 7f18d7e00640 1 -- 172.21.15.72:0/2287197579 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18c8031830 con 0x7f18d815e5a0 2024-04-04T06:57:02.003 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:02.004+0000 7f18d7e00640 1 -- 172.21.15.72:0/2287197579 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18c8031c00 con 0x7f18d815e5a0 2024-04-04T06:57:02.003 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:02.005+0000 7f18de800640 1 -- 172.21.15.72:0/2287197579 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f18d815e5a0 msgr2=0x7f18d80b75c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:02.003 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:02.005+0000 7f18de800640 1 --2- 172.21.15.72:0/2287197579 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f18d815e5a0 0x7f18d80b75c0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f18c80097a0 tx=0x7f18c802b8d0 comp rx=0 tx=0).stop 2024-04-04T06:57:02.004 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:02.005+0000 7f18de800640 1 -- 172.21.15.72:0/2287197579 shutdown_connections 2024-04-04T06:57:02.004 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:02.005+0000 7f18de800640 1 --2- 172.21.15.72:0/2287197579 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f18d815e5a0 0x7f18d80b75c0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:02.004 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:02.005+0000 7f18de800640 1 -- 172.21.15.72:0/2287197579 >> 172.21.15.72:0/2287197579 conn(0x7f18d806b890 msgr2=0x7f18d806bca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:02.004 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:02.005+0000 7f18de800640 1 -- 172.21.15.72:0/2287197579 shutdown_connections 2024-04-04T06:57:02.004 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:02.005+0000 7f18de800640 1 -- 172.21.15.72:0/2287197579 wait complete. 2024-04-04T06:57:02.006 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:02.007+0000 7f18de800640 1 Processor -- start 2024-04-04T06:57:02.006 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:02.007+0000 7f18de800640 1 -- start start 2024-04-04T06:57:02.007 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:02.008+0000 7f18de800640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f18d80b7b00 0x7f18d80ccc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:02.008 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:02.008+0000 7f18de800640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f18d80d3540 0x7f18d8153a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:02.008 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:02.008+0000 7f18de800640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f18d815e5a0 0x7f18d80cc070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:02.008 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:02.008+0000 7f18de800640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f18d80d0ff0 con 0x7f18d815e5a0 2024-04-04T06:57:02.008 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:02.008+0000 7f18de800640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f18d815e980 con 0x7f18d80b7b00 2024-04-04T06:57:02.008 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:02.008+0000 7f18de800640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f18d80d1170 con 0x7f18d80d3540 2024-04-04T06:57:02.008 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:02.008+0000 7f18dde00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f18d815e5a0 0x7f18d80cc070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:02.008 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:02.009+0000 7f18dde00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f18d815e5a0 0x7f18d80cc070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48658/0 (socket says 172.21.15.72:48658) 2024-04-04T06:57:02.008 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:02.009+0000 7f18dde00640 1 -- 172.21.15.72:0/3446899312 learned_addr learned my addr 172.21.15.72:0/3446899312 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:57:02.008 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:02.009+0000 7f18dd400640 1 --2- 172.21.15.72:0/3446899312 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f18d80b7b00 0x7f18d80ccc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:02.008 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:02.009+0000 7f18dca00640 1 --2- 172.21.15.72:0/3446899312 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f18d80d3540 0x7f18d8153a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:02.008 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:02.009+0000 7f18dde00640 1 -- 172.21.15.72:0/3446899312 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f18d80d3540 msgr2=0x7f18d8153a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:02.008 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:02.009+0000 7f18dde00640 1 --2- 172.21.15.72:0/3446899312 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f18d80d3540 0x7f18d8153a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:02.008 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:02.009+0000 7f18dde00640 1 -- 172.21.15.72:0/3446899312 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f18d80b7b00 msgr2=0x7f18d80ccc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:02.008 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:02.009+0000 7f18dde00640 1 --2- 172.21.15.72:0/3446899312 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f18d80b7b00 0x7f18d80ccc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:02.009 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:02.009+0000 7f18dde00640 1 -- 172.21.15.72:0/3446899312 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18d80cc5b0 con 0x7f18d815e5a0 2024-04-04T06:57:02.009 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:02.009+0000 7f18dd400640 1 --2- 172.21.15.72:0/3446899312 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f18d80b7b00 0x7f18d80ccc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-04T06:57:02.009 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:02.009+0000 7f18dca00640 1 --2- 172.21.15.72:0/3446899312 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f18d80d3540 0x7f18d8153a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-04T06:57:02.010 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:02.009+0000 7f18dde00640 1 --2- 172.21.15.72:0/3446899312 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f18d815e5a0 0x7f18d80cc070 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f18d000c7b0 tx=0x7f18d000cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:02.010 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:02.010+0000 7f18d5600640 1 -- 172.21.15.72:0/3446899312 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18d0018070 con 0x7f18d815e5a0 2024-04-04T06:57:02.010 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:02.010+0000 7f18d5600640 1 -- 172.21.15.72:0/3446899312 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18d000a640 con 0x7f18d815e5a0 2024-04-04T06:57:02.010 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:02.010+0000 7f18d5600640 1 -- 172.21.15.72:0/3446899312 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18d000aa70 con 0x7f18d815e5a0 2024-04-04T06:57:02.010 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:02.010+0000 7f18de800640 1 -- 172.21.15.72:0/3446899312 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18d80cd290 con 0x7f18d815e5a0 2024-04-04T06:57:02.010 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:02.010+0000 7f18de800640 1 -- 172.21.15.72:0/3446899312 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18d80cd850 con 0x7f18d815e5a0 2024-04-04T06:57:02.010 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:02.011+0000 7f18de800640 1 -- 172.21.15.72:0/3446899312 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18d80756c0 con 0x7f18d815e5a0 2024-04-04T06:57:02.013 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:02.012+0000 7f18d5600640 1 -- 172.21.15.72:0/3446899312 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f18d000ac10 con 0x7f18d815e5a0 2024-04-04T06:57:02.014 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:02.013+0000 7f18d5600640 1 --2- 172.21.15.72:0/3446899312 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f18b806c8f0 0x7f18b806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:02.014 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:02.013+0000 7f18d5600640 1 -- 172.21.15.72:0/3446899312 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f18d008b1e0 con 0x7f18d815e5a0 2024-04-04T06:57:02.015 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:02.013+0000 7f18dd400640 1 --2- 172.21.15.72:0/3446899312 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f18b806c8f0 0x7f18b806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:02.015 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:02.014+0000 7f18dd400640 1 --2- 172.21.15.72:0/3446899312 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f18b806c8f0 0x7f18b806edb0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f18c8036000 tx=0x7f18c8008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:02.016 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:02.018+0000 7f18d5600640 1 -- 172.21.15.72:0/3446899312 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f18d00595f0 con 0x7f18d815e5a0 2024-04-04T06:57:02.236 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:02.237+0000 7f18de800640 1 -- 172.21.15.72:0/3446899312 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f18d80cad10 con 0x7f18d815e5a0 2024-04-04T06:57:02.237 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:02.239+0000 7f18d5600640 1 -- 172.21.15.72:0/3446899312 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16581 (secure 0 0 0) 0x7f18d0058ef0 con 0x7f18d815e5a0 2024-04-04T06:57:02.238 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T06:57:02.238 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":20,"fsid":"6708bac2-4f50-49b5-87a9-c390fd333eb3","created":"2024-04-04T06:56:04.282498+0000","modified":"2024-04-04T06:56:30.007371+0000","last_up_change":"2024-04-04T06:56:16.716089+0000","last_in_change":"2024-04-04T06:56:07.768593+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-04T06:56:17.421685+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-04T06:56:26.822661+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-04T06:56:27.429816+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7c345991-5af8-4dc6-a481-28610c40e128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":3889813953},{"type":"v1","addr":"172.21.15.72:6818","nonce":3889813953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":3889813953},{"type":"v1","addr":"172.21.15.72:6821","nonce":3889813953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":3889813953},{"type":"v1","addr":"172.21.15.72:6826","nonce":3889813953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":3889813953},{"type":"v1","addr":"172.21.15.72:6823","nonce":3889813953}]},"public_addr":"172.21.15.72:6818/3889813953","cluster_addr":"172.21.15.72:6821/3889813953","heartbeat_back_addr":"172.21.15.72:6826/3889813953","heartbeat_front_addr":"172.21.15.72:6823/3889813953","state":["exists","up"]},{"osd":1,"uuid":"1b3f7ab2-a56c-488d-a89a-1f3572361c95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":3101663154},{"type":"v1","addr":"172.21.15.72:6801","nonce":3101663154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":3101663154},{"type":"v1","addr":"172.21.15.72:6803","nonce":3101663154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":3101663154},{"type":"v1","addr":"172.21.15.72:6807","nonce":3101663154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":3101663154},{"type":"v1","addr":"172.21.15.72:6805","nonce":3101663154}]},"public_addr":"172.21.15.72:6801/3101663154","cluster_addr":"172.21.15.72:6803/3101663154","heartbeat_back_addr":"172.21.15.72:6807/3101663154","heartbeat_front_addr":"172.21.15.72:6805/3101663154","state":["exists","up"]},{"osd":2,"uuid":"fc9aa512-53df-40d7-ba04-3e6b7dcd1e34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":235374192},{"type":"v1","addr":"172.21.15.72:6809","nonce":235374192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":235374192},{"type":"v1","addr":"172.21.15.72:6811","nonce":235374192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":235374192},{"type":"v1","addr":"172.21.15.72:6815","nonce":235374192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":235374192},{"type":"v1","addr":"172.21.15.72:6813","nonce":235374192}]},"public_addr":"172.21.15.72:6809/235374192","cluster_addr":"172.21.15.72:6811/235374192","heartbeat_back_addr":"172.21.15.72:6815/235374192","heartbeat_front_addr":"172.21.15.72:6813/235374192","state":["exists","up"]},{"osd":3,"uuid":"b4f63eed-dc5b-4aba-bb50-de46eb41492b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6817","nonce":2806631742},{"type":"v1","addr":"172.21.15.72:6819","nonce":2806631742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":2806631742},{"type":"v1","addr":"172.21.15.72:6827","nonce":2806631742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":2806631742},{"type":"v1","addr":"172.21.15.72:6831","nonce":2806631742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":2806631742},{"type":"v1","addr":"172.21.15.72:6829","nonce":2806631742}]},"public_addr":"172.21.15.72:6819/2806631742","cluster_addr":"172.21.15.72:6827/2806631742","heartbeat_back_addr":"172.21.15.72:6831/2806631742","heartbeat_front_addr":"172.21.15.72:6829/2806631742","state":["exists","up"]},{"osd":4,"uuid":"9e985ef8-d711-4172-9286-c54e560895d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":4293536423},{"type":"v1","addr":"172.21.15.117:6825","nonce":4293536423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":4293536423},{"type":"v1","addr":"172.21.15.117:6827","nonce":4293536423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":4293536423},{"type":"v1","addr":"172.21.15.117:6831","nonce":4293536423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":4293536423},{"type":"v1","addr":"172.21.15.117:6829","nonce":4293536423}]},"public_addr":"172.21.15.117:6825/4293536423","cluster_addr":"172.21.15.117:6827/4293536423","heartbeat_back_addr":"172.21.15.117:6831/4293536423","heartbeat_front_addr":"172.21.15.117:6829/4293536423","state":["exists","up"]},{"osd":5,"uuid":"3e9f082b-8d7d-455f-8a96-66d0b4857125","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":684971679},{"type":"v1","addr":"172.21.15.117:6801","nonce":684971679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":684971679},{"type":"v1","addr":"172.21.15.117:6803","nonce":684971679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":684971679},{"type":"v1","addr":"172.21.15.117:6807","nonce":684971679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":684971679},{"type":"v1","addr":"172.21.15.117:6805","nonce":684971679}]},"public_addr":"172.21.15.117:6801/684971679","cluster_addr":"172.21.15.117:6803/684971679","heartbeat_back_addr":"172.21.15.117:6807/684971679","heartbeat_front_addr":"172.21.15.117:6805/684971679","state":["exists","up"]},{"osd":6,"uuid":"bcdafa9f-a870-4398-a38d-ab7697676473","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":2781186528},{"type":"v1","addr":"172.21.15.117:6809","nonce":2781186528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":2781186528},{"type":"v1","addr":"172.21.15.117:6811","nonce":2781186528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":2781186528},{"type":"v1","addr":"172.21.15.117:6815","nonce":2781186528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":2781186528},{"type":"v1","addr":"172.21.15.117:6813","nonce":2781186528}]},"public_addr":"172.21.15.117:6809/2781186528","cluster_addr":"172.21.15.117:6811/2781186528","heartbeat_back_addr":"172.21.15.117:6815/2781186528","heartbeat_front_addr":"172.21.15.117:6813/2781186528","state":["exists","up"]},{"osd":7,"uuid":"b68ec562-ff35-4d2d-a733-c896f8920cfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":617469882},{"type":"v1","addr":"172.21.15.117:6817","nonce":617469882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":617469882},{"type":"v1","addr":"172.21.15.117:6819","nonce":617469882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":617469882},{"type":"v1","addr":"172.21.15.117:6823","nonce":617469882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":617469882},{"type":"v1","addr":"172.21.15.117:6821","nonce":617469882}]},"public_addr":"172.21.15.117:6817/617469882","cluster_addr":"172.21.15.117:6819/617469882","heartbeat_back_addr":"172.21.15.117:6823/617469882","heartbeat_front_addr":"172.21.15.117:6821/617469882","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.347700+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.296619+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.361345+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.093323+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:12.857605+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:12.816090+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.083163+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.121639+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-04T06:57:02.242 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:02.243+0000 7f18de800640 1 -- 172.21.15.72:0/3446899312 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f18b806c8f0 msgr2=0x7f18b806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:02.242 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:02.243+0000 7f18de800640 1 --2- 172.21.15.72:0/3446899312 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f18b806c8f0 0x7f18b806edb0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f18c8036000 tx=0x7f18c8008030 comp rx=0 tx=0).stop 2024-04-04T06:57:02.242 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:02.243+0000 7f18de800640 1 -- 172.21.15.72:0/3446899312 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f18d815e5a0 msgr2=0x7f18d80cc070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:02.242 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:02.243+0000 7f18de800640 1 --2- 172.21.15.72:0/3446899312 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f18d815e5a0 0x7f18d80cc070 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f18d000c7b0 tx=0x7f18d000cc70 comp rx=0 tx=0).stop 2024-04-04T06:57:02.242 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:02.243+0000 7f18de800640 1 -- 172.21.15.72:0/3446899312 shutdown_connections 2024-04-04T06:57:02.242 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:02.243+0000 7f18de800640 1 --2- 172.21.15.72:0/3446899312 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f18b806c8f0 0x7f18b806edb0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:02.242 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:02.243+0000 7f18de800640 1 --2- 172.21.15.72:0/3446899312 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f18d815e5a0 0x7f18d80cc070 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:02.242 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:02.243+0000 7f18de800640 1 --2- 172.21.15.72:0/3446899312 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f18d80d3540 0x7f18d8153a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:02.243 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:02.243+0000 7f18de800640 1 --2- 172.21.15.72:0/3446899312 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f18d80b7b00 0x7f18d80ccc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:02.243 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:02.243+0000 7f18de800640 1 -- 172.21.15.72:0/3446899312 >> 172.21.15.72:0/3446899312 conn(0x7f18d806b890 msgr2=0x7f18d8154600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:02.243 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:02.243+0000 7f18de800640 1 -- 172.21.15.72:0/3446899312 shutdown_connections 2024-04-04T06:57:02.243 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:02.244+0000 7f18de800640 1 -- 172.21.15.72:0/3446899312 wait complete. 2024-04-04T06:57:02.262 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-04T06:56:17.421685+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-04T06:56:26.822661+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-04T06:56:27.429816+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-04T06:57:02.262 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-04T06:57:02.469 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:02.470+0000 7fa22ba00640 1 Processor -- start 2024-04-04T06:57:02.469 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:02.470+0000 7fa22ba00640 1 -- start start 2024-04-04T06:57:02.470 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:02.472+0000 7fa22ba00640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa22415afb0 0x7fa224071e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:02.470 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:02.472+0000 7fa22ba00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fa2240cf360 0x7fa2240726e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:02.470 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:02.472+0000 7fa22ba00640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2240ced10 con 0x7fa22415b390 2024-04-04T06:57:02.471 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:02.472+0000 7fa22ba00640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7fa224072350 con 0x7fa22415afb0 2024-04-04T06:57:02.471 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:02.472+0000 7fa22ba00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fa22415ece0 con 0x7fa2240cf360 2024-04-04T06:57:02.471 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:02.472+0000 7fa229000640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa22415afb0 0x7fa224071e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:02.472 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:02.472+0000 7fa229a00640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fa22415b390 0x7fa2240cfcd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:37812/0 (socket says 172.21.15.72:37812) 2024-04-04T06:57:02.472 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:02.472+0000 7fa229a00640 1 -- 172.21.15.72:0/124741880 learned_addr learned my addr 172.21.15.72:0/124741880 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-04-04T06:57:02.472 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:02.472+0000 7fa223e00640 1 --2- 172.21.15.72:0/124741880 >> v2:172.21.15.117:3300/0 conn(0x7fa2240cf360 0x7fa2240726e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:02.472 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:02.473+0000 7fa229000640 1 -- 172.21.15.72:0/124741880 >> v2:172.21.15.117:3300/0 conn(0x7fa2240cf360 msgr2=0x7fa2240726e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:57:02.472 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:02.473+0000 7fa229000640 1 --2- 172.21.15.72:0/124741880 >> v2:172.21.15.117:3300/0 conn(0x7fa2240cf360 0x7fa2240726e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:02.472 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:02.473+0000 7fa229000640 1 -- 172.21.15.72:0/124741880 >> v1:172.21.15.72:6789/0 conn(0x7fa22415b390 legacy=0x7fa2240cfcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:02.472 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:02.473+0000 7fa229000640 1 -- 172.21.15.72:0/124741880 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa22415efa0 con 0x7fa22415afb0 2024-04-04T06:57:02.472 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:02.473+0000 7fa223400640 1 -- 172.21.15.72:0/124741880 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3083186727 0 0) 0x7fa2240ced10 con 0x7fa22415b390 2024-04-04T06:57:02.473 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:02.474+0000 7fa229000640 1 --2- 172.21.15.72:0/124741880 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa22415afb0 0x7fa224071e10 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fa2240afc10 tx=0x7fa21802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=197cfe6854515f81 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:02.473 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:02.474+0000 7fa223400640 1 -- 172.21.15.72:0/124741880 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2180315a0 con 0x7fa22415afb0 2024-04-04T06:57:02.473 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:02.474+0000 7fa223400640 1 -- 172.21.15.72:0/124741880 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa218037070 con 0x7fa22415afb0 2024-04-04T06:57:02.473 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:02.474+0000 7fa223400640 1 -- 172.21.15.72:0/124741880 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa218031960 con 0x7fa22415afb0 2024-04-04T06:57:02.473 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:02.475+0000 7fa22ba00640 1 -- 172.21.15.72:0/124741880 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa22415afb0 msgr2=0x7fa224071e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:02.474 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:02.475+0000 7fa22ba00640 1 --2- 172.21.15.72:0/124741880 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa22415afb0 0x7fa224071e10 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fa2240afc10 tx=0x7fa21802b840 comp rx=0 tx=0).stop 2024-04-04T06:57:02.474 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:02.475+0000 7fa22ba00640 1 -- 172.21.15.72:0/124741880 shutdown_connections 2024-04-04T06:57:02.474 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:02.475+0000 7fa22ba00640 1 --2- 172.21.15.72:0/124741880 >> v2:172.21.15.117:3300/0 conn(0x7fa2240cf360 0x7fa2240726e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:02.474 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:02.475+0000 7fa22ba00640 1 --2- 172.21.15.72:0/124741880 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa22415afb0 0x7fa224071e10 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:02.474 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:02.475+0000 7fa22ba00640 1 -- 172.21.15.72:0/124741880 >> 172.21.15.72:0/124741880 conn(0x7fa22406b470 msgr2=0x7fa22406b850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:02.474 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:02.475+0000 7fa22ba00640 1 -- 172.21.15.72:0/124741880 shutdown_connections 2024-04-04T06:57:02.474 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:02.475+0000 7fa22ba00640 1 -- 172.21.15.72:0/124741880 wait complete. 2024-04-04T06:57:02.475 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:02.476+0000 7fa22ba00640 1 Processor -- start 2024-04-04T06:57:02.475 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:02.477+0000 7fa22ba00640 1 -- start start 2024-04-04T06:57:02.478 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:02.477+0000 7fa22ba00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa2240cf360 0x7fa2240ad870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:02.478 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:02.478+0000 7fa22ba00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa22415afb0 0x7fa224154480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:02.478 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:02.478+0000 7fa22ba00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa22415b390 0x7fa22414a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:02.478 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:02.478+0000 7fa22ba00640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fa22415f840 con 0x7fa2240cf360 2024-04-04T06:57:02.478 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:02.478+0000 7fa22ba00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fa22415f340 con 0x7fa22415b390 2024-04-04T06:57:02.478 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:02.478+0000 7fa22ba00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fa22415fb20 con 0x7fa22415afb0 2024-04-04T06:57:02.478 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:02.478+0000 7fa229000640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa2240cf360 0x7fa2240ad870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:02.478 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:02.478+0000 7fa229000640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa2240cf360 0x7fa2240ad870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48668/0 (socket says 172.21.15.72:48668) 2024-04-04T06:57:02.478 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:02.478+0000 7fa229000640 1 -- 172.21.15.72:0/3592759157 learned_addr learned my addr 172.21.15.72:0/3592759157 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:57:02.479 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:02.478+0000 7fa229a00640 1 --2- 172.21.15.72:0/3592759157 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa22415b390 0x7fa22414a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:02.479 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:02.478+0000 7fa229000640 1 -- 172.21.15.72:0/3592759157 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa22415afb0 msgr2=0x7fa224154480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:02.479 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:02.478+0000 7fa229000640 1 --2- 172.21.15.72:0/3592759157 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa22415afb0 0x7fa224154480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:02.479 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:02.478+0000 7fa229000640 1 -- 172.21.15.72:0/3592759157 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa22415b390 msgr2=0x7fa22414a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:02.479 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:02.478+0000 7fa229000640 1 --2- 172.21.15.72:0/3592759157 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa22415b390 0x7fa22414a530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:02.479 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:02.478+0000 7fa229000640 1 -- 172.21.15.72:0/3592759157 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2240af220 con 0x7fa2240cf360 2024-04-04T06:57:02.479 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:02.479+0000 7fa229000640 1 --2- 172.21.15.72:0/3592759157 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa2240cf360 0x7fa2240ad870 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fa218000c00 tx=0x7fa2180046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:02.479 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:02.479+0000 7fa220c00640 1 -- 172.21.15.72:0/3592759157 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa218004230 con 0x7fa2240cf360 2024-04-04T06:57:02.479 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:02.479+0000 7fa220c00640 1 -- 172.21.15.72:0/3592759157 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2180043f0 con 0x7fa2240cf360 2024-04-04T06:57:02.479 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:02.479+0000 7fa220c00640 1 -- 172.21.15.72:0/3592759157 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa218003850 con 0x7fa2240cf360 2024-04-04T06:57:02.479 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:02.479+0000 7fa22ba00640 1 -- 172.21.15.72:0/3592759157 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2240ae180 con 0x7fa2240cf360 2024-04-04T06:57:02.479 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:02.479+0000 7fa22ba00640 1 -- 172.21.15.72:0/3592759157 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2240ae740 con 0x7fa2240cf360 2024-04-04T06:57:02.480 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:02.480+0000 7fa22ba00640 1 -- 172.21.15.72:0/3592759157 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa224075730 con 0x7fa2240cf360 2024-04-04T06:57:02.480 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:02.481+0000 7fa220c00640 1 -- 172.21.15.72:0/3592759157 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa2180039f0 con 0x7fa2240cf360 2024-04-04T06:57:02.481 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:02.482+0000 7fa220c00640 1 --2- 172.21.15.72:0/3592759157 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fa20406c8f0 0x7fa20406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:02.481 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:02.483+0000 7fa220c00640 1 -- 172.21.15.72:0/3592759157 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fa21802f030 con 0x7fa2240cf360 2024-04-04T06:57:02.481 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:02.483+0000 7fa223e00640 1 --2- 172.21.15.72:0/3592759157 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fa20406c8f0 0x7fa20406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:02.482 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:02.483+0000 7fa223e00640 1 --2- 172.21.15.72:0/3592759157 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fa20406c8f0 0x7fa20406edb0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fa22415ec40 tx=0x7fa210008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:02.488 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:02.489+0000 7fa220c00640 1 -- 172.21.15.72:0/3592759157 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fa218041070 con 0x7fa2240cf360 2024-04-04T06:57:02.707 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:02.708+0000 7fa22ba00640 1 -- 172.21.15.72:0/3592759157 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fa224068640 con 0x7fa2240cf360 2024-04-04T06:57:02.708 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:02.709+0000 7fa220c00640 1 -- 172.21.15.72:0/3592759157 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) ==== 93+0+10 (secure 0 0 0) 0x7fa21807c130 con 0x7fa2240cf360 2024-04-04T06:57:02.708 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 1 2024-04-04T06:57:02.711 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:02.712+0000 7fa22ba00640 1 -- 172.21.15.72:0/3592759157 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fa20406c8f0 msgr2=0x7fa20406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:02.711 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:02.712+0000 7fa22ba00640 1 --2- 172.21.15.72:0/3592759157 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fa20406c8f0 0x7fa20406edb0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fa22415ec40 tx=0x7fa210008040 comp rx=0 tx=0).stop 2024-04-04T06:57:02.711 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:02.712+0000 7fa22ba00640 1 -- 172.21.15.72:0/3592759157 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa2240cf360 msgr2=0x7fa2240ad870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:02.711 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:02.712+0000 7fa22ba00640 1 --2- 172.21.15.72:0/3592759157 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa2240cf360 0x7fa2240ad870 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fa218000c00 tx=0x7fa2180046c0 comp rx=0 tx=0).stop 2024-04-04T06:57:02.711 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:02.712+0000 7fa22ba00640 1 -- 172.21.15.72:0/3592759157 shutdown_connections 2024-04-04T06:57:02.711 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:02.712+0000 7fa22ba00640 1 --2- 172.21.15.72:0/3592759157 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fa20406c8f0 0x7fa20406edb0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:02.711 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:02.712+0000 7fa22ba00640 1 --2- 172.21.15.72:0/3592759157 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa22415b390 0x7fa22414a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:02.711 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:02.712+0000 7fa22ba00640 1 --2- 172.21.15.72:0/3592759157 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa22415afb0 0x7fa224154480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:02.711 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:02.712+0000 7fa22ba00640 1 --2- 172.21.15.72:0/3592759157 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa2240cf360 0x7fa2240ad870 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:02.711 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:02.712+0000 7fa22ba00640 1 -- 172.21.15.72:0/3592759157 >> 172.21.15.72:0/3592759157 conn(0x7fa22406b470 msgr2=0x7fa2240cc1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:02.712 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:02.712+0000 7fa22ba00640 1 -- 172.21.15.72:0/3592759157 shutdown_connections 2024-04-04T06:57:02.712 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:02.712+0000 7fa22ba00640 1 -- 172.21.15.72:0/3592759157 wait complete. 2024-04-04T06:57:02.729 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-04T06:57:02.947 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:02.948+0000 7fbc53e00640 1 Processor -- start 2024-04-04T06:57:02.947 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:02.948+0000 7fbc53e00640 1 -- start start 2024-04-04T06:57:02.948 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:02.950+0000 7fbc53e00640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fbc541423e0 0x7fbc540cf640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:02.948 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:02.950+0000 7fbc53e00640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbc54160b40 con 0x7fbc540d0850 2024-04-04T06:57:02.949 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:02.950+0000 7fbc53e00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbc5415ffc0 con 0x7fbc541418f0 2024-04-04T06:57:02.949 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:02.950+0000 7fbc53e00640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7fbc540cfb80 con 0x7fbc541423e0 2024-04-04T06:57:02.949 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:02.950+0000 7fbc53400640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fbc541423e0 0x7fbc540cf640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:02.949 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:02.950+0000 7fbc53400640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fbc541423e0 0x7fbc540cf640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48682/0 (socket says 172.21.15.72:48682) 2024-04-04T06:57:02.949 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:02.950+0000 7fbc53400640 1 -- 172.21.15.72:0/1797542901 learned_addr learned my addr 172.21.15.72:0/1797542901 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:57:02.950 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:02.951+0000 7fbc53400640 1 -- 172.21.15.72:0/1797542901 >> v1:172.21.15.117:6789/0 conn(0x7fbc541418f0 legacy=0x7fbc540d0140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:57:02.950 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:02.951+0000 7fbc53400640 1 -- 172.21.15.72:0/1797542901 >> v1:172.21.15.72:6789/0 conn(0x7fbc540d0850 legacy=0x7fbc54141cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:02.950 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:02.951+0000 7fbc53400640 1 -- 172.21.15.72:0/1797542901 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc541602a0 con 0x7fbc541423e0 2024-04-04T06:57:02.950 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:02.952+0000 7fbc53400640 1 --2- 172.21.15.72:0/1797542901 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbc541423e0 0x7fbc540cf640 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fbc4c009870 tx=0x7fbc4c02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a82f96bf77e84b90 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:02.951 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:02.952+0000 7fbc52000640 1 -- 172.21.15.72:0/1797542901 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc4c034070 con 0x7fbc541423e0 2024-04-04T06:57:02.951 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:02.952+0000 7fbc52000640 1 -- 172.21.15.72:0/1797542901 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc4c030860 con 0x7fbc541423e0 2024-04-04T06:57:02.951 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:02.952+0000 7fbc52000640 1 -- 172.21.15.72:0/1797542901 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc4c030c30 con 0x7fbc541423e0 2024-04-04T06:57:02.952 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:02.953+0000 7fbc53e00640 1 -- 172.21.15.72:0/1797542901 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbc541423e0 msgr2=0x7fbc540cf640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:02.952 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:02.953+0000 7fbc53e00640 1 --2- 172.21.15.72:0/1797542901 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbc541423e0 0x7fbc540cf640 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fbc4c009870 tx=0x7fbc4c02b9a0 comp rx=0 tx=0).stop 2024-04-04T06:57:02.952 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:02.953+0000 7fbc53e00640 1 -- 172.21.15.72:0/1797542901 shutdown_connections 2024-04-04T06:57:02.952 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:02.953+0000 7fbc53e00640 1 --2- 172.21.15.72:0/1797542901 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbc541423e0 0x7fbc540cf640 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:02.952 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:02.953+0000 7fbc53e00640 1 -- 172.21.15.72:0/1797542901 >> 172.21.15.72:0/1797542901 conn(0x7fbc5406b890 msgr2=0x7fbc5406bca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:02.952 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:02.953+0000 7fbc53e00640 1 -- 172.21.15.72:0/1797542901 shutdown_connections 2024-04-04T06:57:02.952 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:02.953+0000 7fbc53e00640 1 -- 172.21.15.72:0/1797542901 wait complete. 2024-04-04T06:57:02.953 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:02.955+0000 7fbc53e00640 1 Processor -- start 2024-04-04T06:57:02.953 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:02.955+0000 7fbc53e00640 1 -- start start 2024-04-04T06:57:02.955 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:02.956+0000 7fbc53e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbc540d0850 0x7fbc540b21c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:02.955 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:02.956+0000 7fbc53e00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbc541418f0 0x7fbc54151ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:02.955 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:02.956+0000 7fbc53e00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbc541423e0 0x7fbc54154f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:02.955 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:02.956+0000 7fbc53e00640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fbc540cc9c0 con 0x7fbc541423e0 2024-04-04T06:57:02.955 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:02.956+0000 7fbc53e00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fbc54160860 con 0x7fbc541418f0 2024-04-04T06:57:02.955 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:02.956+0000 7fbc53e00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fbc5415fc00 con 0x7fbc540d0850 2024-04-04T06:57:02.955 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:02.956+0000 7fbc53400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbc541423e0 0x7fbc54154f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:02.955 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:02.956+0000 7fbc53400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbc541423e0 0x7fbc54154f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48696/0 (socket says 172.21.15.72:48696) 2024-04-04T06:57:02.956 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:02.956+0000 7fbc53400640 1 -- 172.21.15.72:0/721270579 learned_addr learned my addr 172.21.15.72:0/721270579 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:57:02.956 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:02.956+0000 7fbc52a00640 1 --2- 172.21.15.72:0/721270579 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbc540d0850 0x7fbc540b21c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:02.956 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:02.956+0000 7fbc4a000640 1 --2- 172.21.15.72:0/721270579 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbc541418f0 0x7fbc54151ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:02.956 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:02.956+0000 7fbc53400640 1 -- 172.21.15.72:0/721270579 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbc540d0850 msgr2=0x7fbc540b21c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:02.956 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:02.956+0000 7fbc53400640 1 --2- 172.21.15.72:0/721270579 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbc540d0850 0x7fbc540b21c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:02.956 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:02.956+0000 7fbc53400640 1 -- 172.21.15.72:0/721270579 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbc541418f0 msgr2=0x7fbc54151ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:02.956 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:02.956+0000 7fbc53400640 1 --2- 172.21.15.72:0/721270579 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbc541418f0 0x7fbc54151ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:02.956 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:02.956+0000 7fbc53400640 1 -- 172.21.15.72:0/721270579 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc54155ce0 con 0x7fbc541423e0 2024-04-04T06:57:02.956 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:02.956+0000 7fbc52a00640 1 --2- 172.21.15.72:0/721270579 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbc540d0850 0x7fbc540b21c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-04T06:57:02.956 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:02.956+0000 7fbc4a000640 1 --2- 172.21.15.72:0/721270579 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbc541418f0 0x7fbc54151ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-04T06:57:02.956 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:02.957+0000 7fbc53400640 1 --2- 172.21.15.72:0/721270579 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbc541423e0 0x7fbc54154f10 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fbc4c02b9e0 tx=0x7fbc4c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:02.957 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:02.957+0000 7fbc4b400640 1 -- 172.21.15.72:0/721270579 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc4c034040 con 0x7fbc541423e0 2024-04-04T06:57:02.957 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:02.957+0000 7fbc4b400640 1 -- 172.21.15.72:0/721270579 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc4c0433f0 con 0x7fbc541423e0 2024-04-04T06:57:02.957 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:02.957+0000 7fbc4b400640 1 -- 172.21.15.72:0/721270579 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc4c0437e0 con 0x7fbc541423e0 2024-04-04T06:57:02.957 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:02.957+0000 7fbc53e00640 1 -- 172.21.15.72:0/721270579 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc54155f80 con 0x7fbc541423e0 2024-04-04T06:57:02.957 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:02.957+0000 7fbc53e00640 1 -- 172.21.15.72:0/721270579 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc54156540 con 0x7fbc541423e0 2024-04-04T06:57:02.957 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:02.959+0000 7fbc53e00640 1 -- 172.21.15.72:0/721270579 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc540756c0 con 0x7fbc541423e0 2024-04-04T06:57:02.958 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:02.960+0000 7fbc4b400640 1 -- 172.21.15.72:0/721270579 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fbc4c04a060 con 0x7fbc541423e0 2024-04-04T06:57:02.960 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:02.962+0000 7fbc4b400640 1 --2- 172.21.15.72:0/721270579 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fbc3006c8f0 0x7fbc3006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:02.960 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:02.962+0000 7fbc4b400640 1 -- 172.21.15.72:0/721270579 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fbc4c0ade30 con 0x7fbc541423e0 2024-04-04T06:57:02.960 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:02.962+0000 7fbc52a00640 1 --2- 172.21.15.72:0/721270579 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fbc3006c8f0 0x7fbc3006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:02.961 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:02.963+0000 7fbc52a00640 1 --2- 172.21.15.72:0/721270579 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fbc3006c8f0 0x7fbc3006edb0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fbc44004520 tx=0x7fbc44009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:02.965 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:02.966+0000 7fbc4b400640 1 -- 172.21.15.72:0/721270579 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fbc4c03e070 con 0x7fbc541423e0 2024-04-04T06:57:03.162 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:03.164+0000 7fbc53e00640 1 -- 172.21.15.72:0/721270579 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fbc5406f250 con 0x7fbc541423e0 2024-04-04T06:57:03.163 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:03.164+0000 7fbc4b400640 1 -- 172.21.15.72:0/721270579 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) ==== 104+0+11 (secure 0 0 0) 0x7fbc4c07c260 con 0x7fbc541423e0 2024-04-04T06:57:03.164 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2024-04-04T06:57:03.167 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:03.167+0000 7fbc53e00640 1 -- 172.21.15.72:0/721270579 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fbc3006c8f0 msgr2=0x7fbc3006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:03.167 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:03.167+0000 7fbc53e00640 1 --2- 172.21.15.72:0/721270579 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fbc3006c8f0 0x7fbc3006edb0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fbc44004520 tx=0x7fbc44009040 comp rx=0 tx=0).stop 2024-04-04T06:57:03.167 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:03.167+0000 7fbc53e00640 1 -- 172.21.15.72:0/721270579 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbc541423e0 msgr2=0x7fbc54154f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:03.167 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:03.167+0000 7fbc53e00640 1 --2- 172.21.15.72:0/721270579 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbc541423e0 0x7fbc54154f10 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fbc4c02b9e0 tx=0x7fbc4c0046c0 comp rx=0 tx=0).stop 2024-04-04T06:57:03.167 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:03.167+0000 7fbc53e00640 1 -- 172.21.15.72:0/721270579 shutdown_connections 2024-04-04T06:57:03.167 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:03.167+0000 7fbc53e00640 1 --2- 172.21.15.72:0/721270579 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fbc3006c8f0 0x7fbc3006edb0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:03.168 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:03.167+0000 7fbc53e00640 1 --2- 172.21.15.72:0/721270579 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbc541423e0 0x7fbc54154f10 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:03.168 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:03.167+0000 7fbc53e00640 1 --2- 172.21.15.72:0/721270579 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbc541418f0 0x7fbc54151ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:03.168 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:03.167+0000 7fbc53e00640 1 --2- 172.21.15.72:0/721270579 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbc540d0850 0x7fbc540b21c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:03.168 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:03.167+0000 7fbc53e00640 1 -- 172.21.15.72:0/721270579 >> 172.21.15.72:0/721270579 conn(0x7fbc5406b890 msgr2=0x7fbc540d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:03.168 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:03.167+0000 7fbc53e00640 1 -- 172.21.15.72:0/721270579 shutdown_connections 2024-04-04T06:57:03.168 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:03.167+0000 7fbc53e00640 1 -- 172.21.15.72:0/721270579 wait complete. 2024-04-04T06:57:03.185 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-04T06:57:03.393 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:03.394+0000 7f62e4400640 1 Processor -- start 2024-04-04T06:57:03.393 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:03.394+0000 7f62e4400640 1 -- start start 2024-04-04T06:57:03.394 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:03.396+0000 7f62e4400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f62dc145b10 0x7f62dc06d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:03.394 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:03.396+0000 7f62e4400640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f62dc0d0110 0x7f62dc071430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:03.395 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:03.396+0000 7f62e4400640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f62dc145ef0 con 0x7f62dc06dac0 2024-04-04T06:57:03.395 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:03.396+0000 7f62e4400640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f62dc0cea10 con 0x7f62dc0d0110 2024-04-04T06:57:03.395 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:03.396+0000 7f62e4400640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f62dc06e310 con 0x7f62dc145b10 2024-04-04T06:57:03.395 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:03.396+0000 7f62e1000640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f62dc06dac0 0x7f62dc0cfa00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:37830/0 (socket says 172.21.15.72:37830) 2024-04-04T06:57:03.395 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:03.396+0000 7f62e1000640 1 -- 172.21.15.72:0/3060369028 learned_addr learned my addr 172.21.15.72:0/3060369028 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-04-04T06:57:03.397 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:03.396+0000 7f62e1a00640 1 --2- 172.21.15.72:0/3060369028 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f62dc145b10 0x7f62dc06d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:03.397 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:03.397+0000 7f62e2400640 1 --2- 172.21.15.72:0/3060369028 >> v2:172.21.15.117:3300/0 conn(0x7f62dc0d0110 0x7f62dc071430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:03.397 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:03.397+0000 7f62dbe00640 1 -- 172.21.15.72:0/3060369028 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1984318327 0 0) 0x7f62dc145ef0 con 0x7f62dc06dac0 2024-04-04T06:57:03.397 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:03.397+0000 7f62dbe00640 1 -- 172.21.15.72:0/3060369028 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f62c0003520 con 0x7f62dc06dac0 2024-04-04T06:57:03.397 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:03.397+0000 7f62dbe00640 1 -- 172.21.15.72:0/3060369028 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1624175021 0 0) 0x7f62c0003520 con 0x7f62dc06dac0 2024-04-04T06:57:03.397 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:03.397+0000 7f62dbe00640 1 -- 172.21.15.72:0/3060369028 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f62dc145b10 msgr2=0x7f62dc06d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:57:03.397 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:03.397+0000 7f62dbe00640 1 --2- 172.21.15.72:0/3060369028 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f62dc145b10 0x7f62dc06d580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:03.397 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:03.397+0000 7f62dbe00640 1 -- 172.21.15.72:0/3060369028 >> v2:172.21.15.117:3300/0 conn(0x7f62dc0d0110 msgr2=0x7f62dc071430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:57:03.397 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:03.397+0000 7f62dbe00640 1 --2- 172.21.15.72:0/3060369028 >> v2:172.21.15.117:3300/0 conn(0x7f62dc0d0110 0x7f62dc071430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:03.397 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:03.397+0000 7f62dbe00640 1 -- 172.21.15.72:0/3060369028 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62dc0cec40 con 0x7f62dc06dac0 2024-04-04T06:57:03.397 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:03.397+0000 7f62dbe00640 1 -- 172.21.15.72:0/3060369028 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2465650867 0 0) 0x7f62c8001670 con 0x7f62dc06dac0 2024-04-04T06:57:03.397 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:03.397+0000 7f62dbe00640 1 -- 172.21.15.72:0/3060369028 >> v1:172.21.15.72:6789/0 conn(0x7f62dc06dac0 legacy=0x7f62dc0cfa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:03.397 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:03.397+0000 7f62dbe00640 1 --2- 172.21.15.72:0/3060369028 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f62dc145b10 0x7f62c00039d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:03.398 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:03.397+0000 7f62dbe00640 1 --2- 172.21.15.72:0/3060369028 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f62c0003f50 0x7f62c0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:03.398 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:03.397+0000 7f62dbe00640 1 --2- 172.21.15.72:0/3060369028 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f62c0004d40 0x7f62c00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:03.398 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:03.397+0000 7f62dbe00640 1 -- 172.21.15.72:0/3060369028 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f62dc06e310 con 0x7f62c0004d40 2024-04-04T06:57:03.398 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:03.397+0000 7f62dbe00640 1 -- 172.21.15.72:0/3060369028 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f62c000ba70 con 0x7f62c0003f50 2024-04-04T06:57:03.398 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:03.397+0000 7f62dbe00640 1 -- 172.21.15.72:0/3060369028 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f62c000bc70 con 0x7f62dc145b10 2024-04-04T06:57:03.398 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:03.397+0000 7f62e2400640 1 --2- 172.21.15.72:0/3060369028 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f62c0004d40 0x7f62c00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:03.398 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:03.398+0000 7f62e1000640 1 --2- 172.21.15.72:0/3060369028 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f62c0003f50 0x7f62c0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:03.398 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:03.398+0000 7f62e1a00640 1 --2- 172.21.15.72:0/3060369028 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f62dc145b10 0x7f62c00039d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:03.398 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:03.398+0000 7f62e2400640 1 -- 172.21.15.72:0/3060369028 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f62dc145b10 msgr2=0x7f62c00039d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:57:03.398 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:03.398+0000 7f62e2400640 1 --2- 172.21.15.72:0/3060369028 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f62dc145b10 0x7f62c00039d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:03.398 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:03.398+0000 7f62e2400640 1 -- 172.21.15.72:0/3060369028 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f62c0003f50 msgr2=0x7f62c0004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:57:03.398 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:03.398+0000 7f62e2400640 1 --2- 172.21.15.72:0/3060369028 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f62c0003f50 0x7f62c0004800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:03.398 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:03.398+0000 7f62e2400640 1 -- 172.21.15.72:0/3060369028 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62c0003520 con 0x7f62c0004d40 2024-04-04T06:57:03.400 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:03.399+0000 7f62e2400640 1 --2- 172.21.15.72:0/3060369028 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f62c0004d40 0x7f62c00051c0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f62d4007360 tx=0x7f62c0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d7c451d1d4c801d server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:03.400 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:03.399+0000 7f62dbe00640 1 -- 172.21.15.72:0/3060369028 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62d4039070 con 0x7f62c0004d40 2024-04-04T06:57:03.400 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:03.399+0000 7f62dbe00640 1 -- 172.21.15.72:0/3060369028 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62d402ccf0 con 0x7f62c0004d40 2024-04-04T06:57:03.400 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:03.399+0000 7f62dbe00640 1 -- 172.21.15.72:0/3060369028 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62d4009be0 con 0x7f62c0004d40 2024-04-04T06:57:03.400 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:03.400+0000 7f62e4400640 1 -- 172.21.15.72:0/3060369028 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f62c0004d40 msgr2=0x7f62c00051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:03.400 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:03.400+0000 7f62e4400640 1 --2- 172.21.15.72:0/3060369028 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f62c0004d40 0x7f62c00051c0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f62d4007360 tx=0x7f62c0005830 comp rx=0 tx=0).stop 2024-04-04T06:57:03.400 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:03.400+0000 7f62e2400640 1 -- 172.21.15.72:0/3060369028 reap_dead start 2024-04-04T06:57:03.400 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:03.400+0000 7f62e4400640 1 -- 172.21.15.72:0/3060369028 shutdown_connections 2024-04-04T06:57:03.400 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:03.400+0000 7f62e4400640 1 -- 172.21.15.72:0/3060369028 >> 172.21.15.72:0/3060369028 conn(0x7f62dc06b470 msgr2=0x7f62dc06b850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:03.401 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:03.400+0000 7f62e4400640 1 -- 172.21.15.72:0/3060369028 shutdown_connections 2024-04-04T06:57:03.401 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:03.400+0000 7f62e4400640 1 -- 172.21.15.72:0/3060369028 wait complete. 2024-04-04T06:57:03.402 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:03.402+0000 7f62e4400640 1 Processor -- start 2024-04-04T06:57:03.402 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:03.402+0000 7f62e4400640 1 -- start start 2024-04-04T06:57:03.402 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:03.403+0000 7f62e4400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f62c0004d40 0x7f62dc0b23f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:03.402 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:03.403+0000 7f62e4400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f62dc15ebc0 0x7f62dc15b820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:03.402 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:03.403+0000 7f62e4400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f62dc15f040 0x7f62dc15bd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:03.402 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:03.403+0000 7f62e4400640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f62dc0cf4e0 con 0x7f62c0004d40 2024-04-04T06:57:03.402 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:03.403+0000 7f62e4400640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f62dc0cf200 con 0x7f62dc15ebc0 2024-04-04T06:57:03.402 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:03.403+0000 7f62e4400640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f62dc06df40 con 0x7f62dc15f040 2024-04-04T06:57:03.402 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:03.403+0000 7f62e1a00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f62c0004d40 0x7f62dc0b23f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:03.402 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:03.403+0000 7f62e1a00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f62c0004d40 0x7f62dc0b23f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48724/0 (socket says 172.21.15.72:48724) 2024-04-04T06:57:03.402 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:03.403+0000 7f62e1a00640 1 -- 172.21.15.72:0/2894712426 learned_addr learned my addr 172.21.15.72:0/2894712426 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:57:03.403 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:03.404+0000 7f62e1a00640 1 -- 172.21.15.72:0/2894712426 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f62dc15f040 msgr2=0x7f62dc15bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:03.404 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:03.404+0000 7f62e2400640 1 --2- 172.21.15.72:0/2894712426 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f62dc15f040 0x7f62dc15bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:03.404 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:03.404+0000 7f62e1a00640 1 --2- 172.21.15.72:0/2894712426 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f62dc15f040 0x7f62dc15bd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:03.404 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:03.404+0000 7f62e1a00640 1 -- 172.21.15.72:0/2894712426 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f62dc15ebc0 msgr2=0x7f62dc15b820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:03.404 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:03.404+0000 7f62e1a00640 1 --2- 172.21.15.72:0/2894712426 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f62dc15ebc0 0x7f62dc15b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:03.404 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:03.404+0000 7f62e1a00640 1 -- 172.21.15.72:0/2894712426 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62dc0b2930 con 0x7f62c0004d40 2024-04-04T06:57:03.404 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:03.404+0000 7f62e1a00640 1 --2- 172.21.15.72:0/2894712426 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f62c0004d40 0x7f62dc0b23f0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f62cc010890 tx=0x7f62cc010d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:03.404 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:03.404+0000 7f62d9600640 1 -- 172.21.15.72:0/2894712426 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62cc00f040 con 0x7f62c0004d40 2024-04-04T06:57:03.404 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:03.404+0000 7f62d9600640 1 -- 172.21.15.72:0/2894712426 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62cc00eb60 con 0x7f62c0004d40 2024-04-04T06:57:03.404 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:03.404+0000 7f62d9600640 1 -- 172.21.15.72:0/2894712426 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62cc01c400 con 0x7f62c0004d40 2024-04-04T06:57:03.404 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:03.404+0000 7f62e4400640 1 -- 172.21.15.72:0/2894712426 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62dc1e4d10 con 0x7f62c0004d40 2024-04-04T06:57:03.404 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:03.405+0000 7f62e4400640 1 -- 172.21.15.72:0/2894712426 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62dc1e52d0 con 0x7f62c0004d40 2024-04-04T06:57:03.405 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:03.406+0000 7f62e4400640 1 -- 172.21.15.72:0/2894712426 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f62dc075730 con 0x7f62c0004d40 2024-04-04T06:57:03.405 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:03.406+0000 7f62d9600640 1 -- 172.21.15.72:0/2894712426 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f62cc01c5a0 con 0x7f62c0004d40 2024-04-04T06:57:03.406 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:03.407+0000 7f62d9600640 1 --2- 172.21.15.72:0/2894712426 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f62bc06c8f0 0x7f62bc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:03.406 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:03.407+0000 7f62d9600640 1 -- 172.21.15.72:0/2894712426 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f62cc08c280 con 0x7f62c0004d40 2024-04-04T06:57:03.406 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:03.408+0000 7f62e1000640 1 --2- 172.21.15.72:0/2894712426 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f62bc06c8f0 0x7f62bc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:03.407 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:03.408+0000 7f62e1000640 1 --2- 172.21.15.72:0/2894712426 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f62bc06c8f0 0x7f62bc06edb0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f62dc0b0d50 tx=0x7f62c8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:03.413 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:03.415+0000 7f62d9600640 1 -- 172.21.15.72:0/2894712426 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f62cc018030 con 0x7f62c0004d40 2024-04-04T06:57:03.730 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:03.731+0000 7f62e4400640 1 -- 172.21.15.72:0/2894712426 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f62dc0d0c00 con 0x7f62c0004d40 2024-04-04T06:57:03.730 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:03.732+0000 7f62d9600640 1 -- 172.21.15.72:0/2894712426 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) ==== 100+0+11 (secure 0 0 0) 0x7f62cc05a610 con 0x7f62c0004d40 2024-04-04T06:57:03.731 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 64 2024-04-04T06:57:03.733 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:03.734+0000 7f62e4400640 1 -- 172.21.15.72:0/2894712426 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f62bc06c8f0 msgr2=0x7f62bc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:03.733 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:03.734+0000 7f62e4400640 1 --2- 172.21.15.72:0/2894712426 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f62bc06c8f0 0x7f62bc06edb0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f62dc0b0d50 tx=0x7f62c8009040 comp rx=0 tx=0).stop 2024-04-04T06:57:03.733 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:03.734+0000 7f62e4400640 1 -- 172.21.15.72:0/2894712426 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f62c0004d40 msgr2=0x7f62dc0b23f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:03.734 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:03.734+0000 7f62e4400640 1 --2- 172.21.15.72:0/2894712426 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f62c0004d40 0x7f62dc0b23f0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f62cc010890 tx=0x7f62cc010d50 comp rx=0 tx=0).stop 2024-04-04T06:57:03.734 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:03.735+0000 7f62e4400640 1 -- 172.21.15.72:0/2894712426 shutdown_connections 2024-04-04T06:57:03.734 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:03.735+0000 7f62e4400640 1 --2- 172.21.15.72:0/2894712426 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f62bc06c8f0 0x7f62bc06edb0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:03.734 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:03.735+0000 7f62e4400640 1 --2- 172.21.15.72:0/2894712426 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f62dc15f040 0x7f62dc15bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:03.734 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:03.735+0000 7f62e4400640 1 --2- 172.21.15.72:0/2894712426 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f62dc15ebc0 0x7f62dc15b820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:03.734 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:03.735+0000 7f62e4400640 1 --2- 172.21.15.72:0/2894712426 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f62c0004d40 0x7f62dc0b23f0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:03.734 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:03.735+0000 7f62e4400640 1 -- 172.21.15.72:0/2894712426 >> 172.21.15.72:0/2894712426 conn(0x7f62dc06b470 msgr2=0x7f62dc0b4590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:03.734 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:03.735+0000 7f62e4400640 1 -- 172.21.15.72:0/2894712426 shutdown_connections 2024-04-04T06:57:03.734 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:03.735+0000 7f62e4400640 1 -- 172.21.15.72:0/2894712426 wait complete. 2024-04-04T06:57:03.753 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-04T06:57:03.952 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:03.953+0000 7fe585c00640 1 Processor -- start 2024-04-04T06:57:03.952 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:03.953+0000 7fe585c00640 1 -- start start 2024-04-04T06:57:03.953 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:03.954+0000 7fe585c00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe5800b47f0 0x7fe58015ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:03.953 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:03.954+0000 7fe585c00640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe5800b3640 0x7fe58015e300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:03.953 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:03.954+0000 7fe585c00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe5800c6b40 con 0x7fe5800cd060 2024-04-04T06:57:03.953 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:03.954+0000 7fe585c00640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7fe5800998d0 con 0x7fe5800b3640 2024-04-04T06:57:03.953 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:03.954+0000 7fe585c00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fe580099bb0 con 0x7fe5800b47f0 2024-04-04T06:57:03.954 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:03.955+0000 7fe57f400640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe5800b3640 0x7fe58015e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:03.954 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:03.955+0000 7fe57f400640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe5800b3640 0x7fe58015e300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48738/0 (socket says 172.21.15.72:48738) 2024-04-04T06:57:03.955 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:03.955+0000 7fe57f400640 1 -- 172.21.15.72:0/213517196 learned_addr learned my addr 172.21.15.72:0/213517196 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:57:03.955 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:03.955+0000 7fe576000640 1 --2- 172.21.15.72:0/213517196 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe5800b47f0 0x7fe58015ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:03.955 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:03.956+0000 7fe57f400640 1 -- 172.21.15.72:0/213517196 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe5800b47f0 msgr2=0x7fe58015ddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:57:03.955 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:03.956+0000 7fe57f400640 1 --2- 172.21.15.72:0/213517196 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe5800b47f0 0x7fe58015ddc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:03.955 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:03.956+0000 7fe57f400640 1 -- 172.21.15.72:0/213517196 >> v1:172.21.15.117:6789/0 conn(0x7fe5800cd060 legacy=0x7fe5800b40e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:03.955 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:03.956+0000 7fe57f400640 1 -- 172.21.15.72:0/213517196 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5800c6e20 con 0x7fe5800b3640 2024-04-04T06:57:03.957 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:03.957+0000 7fe57f400640 1 --2- 172.21.15.72:0/213517196 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe5800b3640 0x7fe58015e300 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fe578009e50 tx=0x7fe57802bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82da4ee2897b06bd server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:03.957 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:03.957+0000 7fe57e000640 1 -- 172.21.15.72:0/213517196 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe57802cb00 con 0x7fe5800b3640 2024-04-04T06:57:03.957 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:03.957+0000 7fe57e000640 1 -- 172.21.15.72:0/213517196 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe57802cca0 con 0x7fe5800b3640 2024-04-04T06:57:03.957 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:03.957+0000 7fe57e000640 1 -- 172.21.15.72:0/213517196 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe578034610 con 0x7fe5800b3640 2024-04-04T06:57:03.957 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:03.958+0000 7fe585c00640 1 -- 172.21.15.72:0/213517196 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe5800b3640 msgr2=0x7fe58015e300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:03.957 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:03.958+0000 7fe585c00640 1 --2- 172.21.15.72:0/213517196 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe5800b3640 0x7fe58015e300 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fe578009e50 tx=0x7fe57802bf60 comp rx=0 tx=0).stop 2024-04-04T06:57:03.957 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:03.958+0000 7fe585c00640 1 -- 172.21.15.72:0/213517196 shutdown_connections 2024-04-04T06:57:03.957 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:03.958+0000 7fe585c00640 1 --2- 172.21.15.72:0/213517196 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe5800b3640 0x7fe58015e300 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:03.957 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:03.958+0000 7fe585c00640 1 --2- 172.21.15.72:0/213517196 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe5800b47f0 0x7fe58015ddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:03.957 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:03.958+0000 7fe585c00640 1 -- 172.21.15.72:0/213517196 >> 172.21.15.72:0/213517196 conn(0x7fe58006b470 msgr2=0x7fe58006b880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:03.958 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:03.958+0000 7fe585c00640 1 -- 172.21.15.72:0/213517196 shutdown_connections 2024-04-04T06:57:03.958 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:03.958+0000 7fe585c00640 1 -- 172.21.15.72:0/213517196 wait complete. 2024-04-04T06:57:03.958 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:03.959+0000 7fe585c00640 1 Processor -- start 2024-04-04T06:57:03.958 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:03.960+0000 7fe585c00640 1 -- start start 2024-04-04T06:57:03.960 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:03.960+0000 7fe585c00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe5800b3640 0x7fe5801547a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:03.960 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:03.960+0000 7fe585c00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe5800b47f0 0x7fe5800ae100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:03.961 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:03.960+0000 7fe585c00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe5800cd060 0x7fe5800ae640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:03.961 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:03.960+0000 7fe585c00640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fe5800b3080 con 0x7fe5800b47f0 2024-04-04T06:57:03.961 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:03.960+0000 7fe585c00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fe5800cd440 con 0x7fe5800b3640 2024-04-04T06:57:03.961 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:03.960+0000 7fe585c00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fe58015e840 con 0x7fe5800cd060 2024-04-04T06:57:03.961 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:03.961+0000 7fe576000640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe5800b47f0 0x7fe5800ae100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:03.961 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:03.961+0000 7fe576000640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe5800b47f0 0x7fe5800ae100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48752/0 (socket says 172.21.15.72:48752) 2024-04-04T06:57:03.961 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:03.961+0000 7fe576000640 1 -- 172.21.15.72:0/309512796 learned_addr learned my addr 172.21.15.72:0/309512796 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:57:03.961 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:03.961+0000 7fe576000640 1 -- 172.21.15.72:0/309512796 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe5800cd060 msgr2=0x7fe5800ae640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:03.961 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:03.961+0000 7fe576000640 1 --2- 172.21.15.72:0/309512796 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe5800cd060 0x7fe5800ae640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:03.961 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:03.961+0000 7fe576000640 1 -- 172.21.15.72:0/309512796 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe5800b3640 msgr2=0x7fe5801547a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:03.962 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:03.961+0000 7fe576000640 1 --2- 172.21.15.72:0/309512796 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe5800b3640 0x7fe5801547a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:03.962 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:03.961+0000 7fe576000640 1 -- 172.21.15.72:0/309512796 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe580160e80 con 0x7fe5800b47f0 2024-04-04T06:57:03.962 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:03.961+0000 7fe576000640 1 --2- 172.21.15.72:0/309512796 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe5800b47f0 0x7fe5800ae100 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fe56800e9b0 tx=0x7fe56800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:03.962 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:03.962+0000 7fe577400640 1 -- 172.21.15.72:0/309512796 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe568017070 con 0x7fe5800b47f0 2024-04-04T06:57:03.962 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:03.962+0000 7fe577400640 1 -- 172.21.15.72:0/309512796 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe56800c9a0 con 0x7fe5800b47f0 2024-04-04T06:57:03.962 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:03.962+0000 7fe585c00640 1 -- 172.21.15.72:0/309512796 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe580161160 con 0x7fe5800b47f0 2024-04-04T06:57:03.962 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:03.962+0000 7fe577400640 1 -- 172.21.15.72:0/309512796 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe56800cd90 con 0x7fe5800b47f0 2024-04-04T06:57:03.962 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:03.962+0000 7fe585c00640 1 -- 172.21.15.72:0/309512796 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe580161720 con 0x7fe5800b47f0 2024-04-04T06:57:03.963 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:03.963+0000 7fe585c00640 1 -- 172.21.15.72:0/309512796 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe580075840 con 0x7fe5800b47f0 2024-04-04T06:57:03.963 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:03.964+0000 7fe577400640 1 -- 172.21.15.72:0/309512796 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe56801a070 con 0x7fe5800b47f0 2024-04-04T06:57:03.964 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:03.965+0000 7fe577400640 1 --2- 172.21.15.72:0/309512796 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fe55c06c920 0x7fe55c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:03.964 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:03.966+0000 7fe577400640 1 -- 172.21.15.72:0/309512796 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fe56808beb0 con 0x7fe5800b47f0 2024-04-04T06:57:03.964 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:03.966+0000 7fe57ea00640 1 --2- 172.21.15.72:0/309512796 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fe55c06c920 0x7fe55c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:03.965 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:03.966+0000 7fe57ea00640 1 --2- 172.21.15.72:0/309512796 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fe55c06c920 0x7fe55c06ede0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fe570000f60 tx=0x7fe5700079d0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:03.968 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:03.970+0000 7fe577400640 1 -- 172.21.15.72:0/309512796 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fe56805a2d0 con 0x7fe5800b47f0 2024-04-04T06:57:04.167 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:04.168+0000 7fe585c00640 1 -- 172.21.15.72:0/309512796 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe5800ce8a0 con 0x7fe5800b47f0 2024-04-04T06:57:04.169 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:04.170+0000 7fe577400640 1 -- 172.21.15.72:0/309512796 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16581 (secure 0 0 0) 0x7fe568059bd0 con 0x7fe5800b47f0 2024-04-04T06:57:04.169 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T06:57:04.169 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":20,"fsid":"6708bac2-4f50-49b5-87a9-c390fd333eb3","created":"2024-04-04T06:56:04.282498+0000","modified":"2024-04-04T06:56:30.007371+0000","last_up_change":"2024-04-04T06:56:16.716089+0000","last_in_change":"2024-04-04T06:56:07.768593+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-04T06:56:17.421685+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-04T06:56:26.822661+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-04T06:56:27.429816+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7c345991-5af8-4dc6-a481-28610c40e128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":3889813953},{"type":"v1","addr":"172.21.15.72:6818","nonce":3889813953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":3889813953},{"type":"v1","addr":"172.21.15.72:6821","nonce":3889813953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":3889813953},{"type":"v1","addr":"172.21.15.72:6826","nonce":3889813953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":3889813953},{"type":"v1","addr":"172.21.15.72:6823","nonce":3889813953}]},"public_addr":"172.21.15.72:6818/3889813953","cluster_addr":"172.21.15.72:6821/3889813953","heartbeat_back_addr":"172.21.15.72:6826/3889813953","heartbeat_front_addr":"172.21.15.72:6823/3889813953","state":["exists","up"]},{"osd":1,"uuid":"1b3f7ab2-a56c-488d-a89a-1f3572361c95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":3101663154},{"type":"v1","addr":"172.21.15.72:6801","nonce":3101663154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":3101663154},{"type":"v1","addr":"172.21.15.72:6803","nonce":3101663154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":3101663154},{"type":"v1","addr":"172.21.15.72:6807","nonce":3101663154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":3101663154},{"type":"v1","addr":"172.21.15.72:6805","nonce":3101663154}]},"public_addr":"172.21.15.72:6801/3101663154","cluster_addr":"172.21.15.72:6803/3101663154","heartbeat_back_addr":"172.21.15.72:6807/3101663154","heartbeat_front_addr":"172.21.15.72:6805/3101663154","state":["exists","up"]},{"osd":2,"uuid":"fc9aa512-53df-40d7-ba04-3e6b7dcd1e34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":235374192},{"type":"v1","addr":"172.21.15.72:6809","nonce":235374192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":235374192},{"type":"v1","addr":"172.21.15.72:6811","nonce":235374192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":235374192},{"type":"v1","addr":"172.21.15.72:6815","nonce":235374192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":235374192},{"type":"v1","addr":"172.21.15.72:6813","nonce":235374192}]},"public_addr":"172.21.15.72:6809/235374192","cluster_addr":"172.21.15.72:6811/235374192","heartbeat_back_addr":"172.21.15.72:6815/235374192","heartbeat_front_addr":"172.21.15.72:6813/235374192","state":["exists","up"]},{"osd":3,"uuid":"b4f63eed-dc5b-4aba-bb50-de46eb41492b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6817","nonce":2806631742},{"type":"v1","addr":"172.21.15.72:6819","nonce":2806631742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":2806631742},{"type":"v1","addr":"172.21.15.72:6827","nonce":2806631742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":2806631742},{"type":"v1","addr":"172.21.15.72:6831","nonce":2806631742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":2806631742},{"type":"v1","addr":"172.21.15.72:6829","nonce":2806631742}]},"public_addr":"172.21.15.72:6819/2806631742","cluster_addr":"172.21.15.72:6827/2806631742","heartbeat_back_addr":"172.21.15.72:6831/2806631742","heartbeat_front_addr":"172.21.15.72:6829/2806631742","state":["exists","up"]},{"osd":4,"uuid":"9e985ef8-d711-4172-9286-c54e560895d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":4293536423},{"type":"v1","addr":"172.21.15.117:6825","nonce":4293536423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":4293536423},{"type":"v1","addr":"172.21.15.117:6827","nonce":4293536423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":4293536423},{"type":"v1","addr":"172.21.15.117:6831","nonce":4293536423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":4293536423},{"type":"v1","addr":"172.21.15.117:6829","nonce":4293536423}]},"public_addr":"172.21.15.117:6825/4293536423","cluster_addr":"172.21.15.117:6827/4293536423","heartbeat_back_addr":"172.21.15.117:6831/4293536423","heartbeat_front_addr":"172.21.15.117:6829/4293536423","state":["exists","up"]},{"osd":5,"uuid":"3e9f082b-8d7d-455f-8a96-66d0b4857125","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":684971679},{"type":"v1","addr":"172.21.15.117:6801","nonce":684971679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":684971679},{"type":"v1","addr":"172.21.15.117:6803","nonce":684971679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":684971679},{"type":"v1","addr":"172.21.15.117:6807","nonce":684971679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":684971679},{"type":"v1","addr":"172.21.15.117:6805","nonce":684971679}]},"public_addr":"172.21.15.117:6801/684971679","cluster_addr":"172.21.15.117:6803/684971679","heartbeat_back_addr":"172.21.15.117:6807/684971679","heartbeat_front_addr":"172.21.15.117:6805/684971679","state":["exists","up"]},{"osd":6,"uuid":"bcdafa9f-a870-4398-a38d-ab7697676473","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":2781186528},{"type":"v1","addr":"172.21.15.117:6809","nonce":2781186528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":2781186528},{"type":"v1","addr":"172.21.15.117:6811","nonce":2781186528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":2781186528},{"type":"v1","addr":"172.21.15.117:6815","nonce":2781186528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":2781186528},{"type":"v1","addr":"172.21.15.117:6813","nonce":2781186528}]},"public_addr":"172.21.15.117:6809/2781186528","cluster_addr":"172.21.15.117:6811/2781186528","heartbeat_back_addr":"172.21.15.117:6815/2781186528","heartbeat_front_addr":"172.21.15.117:6813/2781186528","state":["exists","up"]},{"osd":7,"uuid":"b68ec562-ff35-4d2d-a733-c896f8920cfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":617469882},{"type":"v1","addr":"172.21.15.117:6817","nonce":617469882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":617469882},{"type":"v1","addr":"172.21.15.117:6819","nonce":617469882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":617469882},{"type":"v1","addr":"172.21.15.117:6823","nonce":617469882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":617469882},{"type":"v1","addr":"172.21.15.117:6821","nonce":617469882}]},"public_addr":"172.21.15.117:6817/617469882","cluster_addr":"172.21.15.117:6819/617469882","heartbeat_back_addr":"172.21.15.117:6823/617469882","heartbeat_front_addr":"172.21.15.117:6821/617469882","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.347700+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.296619+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.361345+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.093323+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:12.857605+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:12.816090+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.083163+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.121639+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-04T06:57:04.172 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:04.172+0000 7fe585c00640 1 -- 172.21.15.72:0/309512796 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fe55c06c920 msgr2=0x7fe55c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:04.172 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:04.172+0000 7fe585c00640 1 --2- 172.21.15.72:0/309512796 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fe55c06c920 0x7fe55c06ede0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fe570000f60 tx=0x7fe5700079d0 comp rx=0 tx=0).stop 2024-04-04T06:57:04.172 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:04.173+0000 7fe585c00640 1 -- 172.21.15.72:0/309512796 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe5800b47f0 msgr2=0x7fe5800ae100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:04.172 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:04.173+0000 7fe585c00640 1 --2- 172.21.15.72:0/309512796 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe5800b47f0 0x7fe5800ae100 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fe56800e9b0 tx=0x7fe56800ee70 comp rx=0 tx=0).stop 2024-04-04T06:57:04.172 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:04.173+0000 7fe585c00640 1 -- 172.21.15.72:0/309512796 shutdown_connections 2024-04-04T06:57:04.172 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:04.173+0000 7fe585c00640 1 --2- 172.21.15.72:0/309512796 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fe55c06c920 0x7fe55c06ede0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:04.172 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:04.173+0000 7fe585c00640 1 --2- 172.21.15.72:0/309512796 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe5800cd060 0x7fe5800ae640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:04.172 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:04.173+0000 7fe585c00640 1 --2- 172.21.15.72:0/309512796 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe5800b47f0 0x7fe5800ae100 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:04.172 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:04.173+0000 7fe585c00640 1 --2- 172.21.15.72:0/309512796 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe5800b3640 0x7fe5801547a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:04.173 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:04.173+0000 7fe585c00640 1 -- 172.21.15.72:0/309512796 >> 172.21.15.72:0/309512796 conn(0x7fe58006b470 msgr2=0x7fe580071510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:04.173 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:04.173+0000 7fe585c00640 1 -- 172.21.15.72:0/309512796 shutdown_connections 2024-04-04T06:57:04.173 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:04.173+0000 7fe585c00640 1 -- 172.21.15.72:0/309512796 wait complete. 2024-04-04T06:57:04.191 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-04T06:56:17.421685+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-04T06:56:26.822661+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-04T06:56:27.429816+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-04T06:57:04.192 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-04T06:57:04.394 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:04.395+0000 7feccd400640 1 Processor -- start 2024-04-04T06:57:04.394 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:04.396+0000 7feccd400640 1 -- start start 2024-04-04T06:57:04.396 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:04.397+0000 7feccd400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fecc80ba010 0x7fecc80cf030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:04.396 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:04.397+0000 7feccd400640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fecc80d3d60 0x7fecc80cf570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:04.396 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:04.397+0000 7feccd400640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fecc80d29f0 con 0x7fecc815e670 2024-04-04T06:57:04.396 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:04.397+0000 7feccd400640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7fecc80b83a0 con 0x7fecc80d3d60 2024-04-04T06:57:04.396 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:04.397+0000 7feccd400640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fecc80d2cc0 con 0x7fecc80ba010 2024-04-04T06:57:04.396 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:04.397+0000 7fecc7200640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fecc80d3d60 0x7fecc80cf570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:04.396 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:04.397+0000 7fecc7200640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fecc80d3d60 0x7fecc80cf570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48768/0 (socket says 172.21.15.72:48768) 2024-04-04T06:57:04.396 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:04.397+0000 7fecc7200640 1 -- 172.21.15.72:0/3586186086 learned_addr learned my addr 172.21.15.72:0/3586186086 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:57:04.396 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:04.397+0000 7fecc5e00640 1 --2- 172.21.15.72:0/3586186086 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fecc80ba010 0x7fecc80cf030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:04.396 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:04.397+0000 7fecc7200640 1 -- 172.21.15.72:0/3586186086 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fecc80ba010 msgr2=0x7fecc80cf030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:57:04.397 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:04.397+0000 7fecc7200640 1 --2- 172.21.15.72:0/3586186086 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fecc80ba010 0x7fecc80cf030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:04.397 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:04.397+0000 7fecc7200640 1 -- 172.21.15.72:0/3586186086 >> v1:172.21.15.117:6789/0 conn(0x7fecc815e670 legacy=0x7fecc80d22e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:57:04.397 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:04.397+0000 7fecc7200640 1 -- 172.21.15.72:0/3586186086 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecc80d2fa0 con 0x7fecc80d3d60 2024-04-04T06:57:04.397 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:04.397+0000 7fecc5e00640 1 --2- 172.21.15.72:0/3586186086 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fecc80ba010 0x7fecc80cf030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-04T06:57:04.397 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:04.398+0000 7fecc7200640 1 --2- 172.21.15.72:0/3586186086 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fecc80d3d60 0x7fecc80cf570 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fecc0009e50 tx=0x7fecc002be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d71aa3084f23e717 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:04.397 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:04.399+0000 7fecc5400640 1 -- 172.21.15.72:0/3586186086 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecc002c9e0 con 0x7fecc80d3d60 2024-04-04T06:57:04.398 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:04.399+0000 7fecc5400640 1 -- 172.21.15.72:0/3586186086 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fecc002cb80 con 0x7fecc80d3d60 2024-04-04T06:57:04.398 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:04.399+0000 7fecc5400640 1 -- 172.21.15.72:0/3586186086 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecc00343f0 con 0x7fecc80d3d60 2024-04-04T06:57:04.398 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:04.399+0000 7feccd400640 1 -- 172.21.15.72:0/3586186086 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fecc80d3d60 msgr2=0x7fecc80cf570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:04.399 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:04.399+0000 7feccd400640 1 --2- 172.21.15.72:0/3586186086 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fecc80d3d60 0x7fecc80cf570 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fecc0009e50 tx=0x7fecc002be40 comp rx=0 tx=0).stop 2024-04-04T06:57:04.399 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:04.400+0000 7feccd400640 1 -- 172.21.15.72:0/3586186086 shutdown_connections 2024-04-04T06:57:04.399 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:04.400+0000 7feccd400640 1 --2- 172.21.15.72:0/3586186086 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fecc80d3d60 0x7fecc80cf570 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:04.399 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:04.400+0000 7feccd400640 1 --2- 172.21.15.72:0/3586186086 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fecc80ba010 0x7fecc80cf030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:04.399 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:04.400+0000 7feccd400640 1 -- 172.21.15.72:0/3586186086 >> 172.21.15.72:0/3586186086 conn(0x7fecc806baa0 msgr2=0x7fecc80d0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:04.399 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:04.400+0000 7feccd400640 1 -- 172.21.15.72:0/3586186086 shutdown_connections 2024-04-04T06:57:04.399 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:04.400+0000 7feccd400640 1 -- 172.21.15.72:0/3586186086 wait complete. 2024-04-04T06:57:04.400 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:04.401+0000 7feccd400640 1 Processor -- start 2024-04-04T06:57:04.400 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:04.401+0000 7feccd400640 1 -- start start 2024-04-04T06:57:04.401 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:04.402+0000 7feccd400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fecc80d3d60 0x7fecc80cdd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:04.401 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:04.402+0000 7feccd400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fecc815e670 0x7fecc80c7d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:04.402 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:04.402+0000 7feccd400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fecc80b87e0 0x7fecc815ea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:04.402 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:04.402+0000 7feccd400640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fecc80b7390 con 0x7fecc80d3d60 2024-04-04T06:57:04.402 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:04.402+0000 7feccd400640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fecc80d3560 con 0x7fecc80b87e0 2024-04-04T06:57:04.402 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:04.402+0000 7feccd400640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fecc80b7510 con 0x7fecc815e670 2024-04-04T06:57:04.402 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:04.403+0000 7fecc6800640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fecc80d3d60 0x7fecc80cdd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:04.402 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:04.403+0000 7fecc6800640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fecc80d3d60 0x7fecc80cdd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48776/0 (socket says 172.21.15.72:48776) 2024-04-04T06:57:04.402 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:04.403+0000 7fecc6800640 1 -- 172.21.15.72:0/3643333087 learned_addr learned my addr 172.21.15.72:0/3643333087 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:57:04.402 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:04.403+0000 7fecc6800640 1 -- 172.21.15.72:0/3643333087 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fecc815e670 msgr2=0x7fecc80c7d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:04.402 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:04.403+0000 7fecc6800640 1 --2- 172.21.15.72:0/3643333087 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fecc815e670 0x7fecc80c7d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:04.402 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:04.403+0000 7fecc6800640 1 -- 172.21.15.72:0/3643333087 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fecc80b87e0 msgr2=0x7fecc815ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:04.402 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:04.403+0000 7fecc6800640 1 --2- 172.21.15.72:0/3643333087 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fecc80b87e0 0x7fecc815ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:04.402 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:04.403+0000 7fecc6800640 1 -- 172.21.15.72:0/3643333087 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecc80c8480 con 0x7fecc80d3d60 2024-04-04T06:57:04.403 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:04.403+0000 7fecc6800640 1 --2- 172.21.15.72:0/3643333087 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fecc80d3d60 0x7fecc80cdd40 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fecb800b3f0 tx=0x7fecb800b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:04.403 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:04.404+0000 7fecbea00640 1 -- 172.21.15.72:0/3643333087 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecb8015020 con 0x7fecc80d3d60 2024-04-04T06:57:04.403 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:04.404+0000 7fecbea00640 1 -- 172.21.15.72:0/3643333087 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fecb8011830 con 0x7fecc80d3d60 2024-04-04T06:57:04.403 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:04.404+0000 7fecbea00640 1 -- 172.21.15.72:0/3643333087 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecb8011c20 con 0x7fecc80d3d60 2024-04-04T06:57:04.404 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:04.404+0000 7feccd400640 1 -- 172.21.15.72:0/3643333087 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fecc80c8760 con 0x7fecc80d3d60 2024-04-04T06:57:04.404 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:04.404+0000 7feccd400640 1 -- 172.21.15.72:0/3643333087 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fecc80c8d20 con 0x7fecc80d3d60 2024-04-04T06:57:04.404 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:04.405+0000 7feccd400640 1 -- 172.21.15.72:0/3643333087 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fecc80685a0 con 0x7fecc80d3d60 2024-04-04T06:57:04.404 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:04.406+0000 7fecbea00640 1 -- 172.21.15.72:0/3643333087 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fecb8018020 con 0x7fecc80d3d60 2024-04-04T06:57:04.405 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:04.407+0000 7fecbea00640 1 --2- 172.21.15.72:0/3643333087 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7feca806c8f0 0x7feca806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:04.405 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:04.407+0000 7fecbea00640 1 -- 172.21.15.72:0/3643333087 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fecb808b830 con 0x7fecc80d3d60 2024-04-04T06:57:04.405 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:04.407+0000 7fecc5e00640 1 --2- 172.21.15.72:0/3643333087 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7feca806c8f0 0x7feca806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:04.406 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:04.408+0000 7fecc5e00640 1 --2- 172.21.15.72:0/3643333087 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7feca806c8f0 0x7feca806edb0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fecb4006fd0 tx=0x7fecb4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:04.411 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:04.412+0000 7fecbea00640 1 -- 172.21.15.72:0/3643333087 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fecb801f030 con 0x7fecc80d3d60 2024-04-04T06:57:04.622 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:04.624+0000 7feccd400640 1 -- 172.21.15.72:0/3643333087 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fecc80d4290 con 0x7fecc80d3d60 2024-04-04T06:57:04.623 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:04.625+0000 7fecbea00640 1 -- 172.21.15.72:0/3643333087 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) ==== 93+0+10 (secure 0 0 0) 0x7fecb80172c0 con 0x7fecc80d3d60 2024-04-04T06:57:04.623 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 1 2024-04-04T06:57:04.627 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:04.628+0000 7feccd400640 1 -- 172.21.15.72:0/3643333087 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7feca806c8f0 msgr2=0x7feca806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:04.627 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:04.628+0000 7feccd400640 1 --2- 172.21.15.72:0/3643333087 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7feca806c8f0 0x7feca806edb0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fecb4006fd0 tx=0x7fecb4008040 comp rx=0 tx=0).stop 2024-04-04T06:57:04.627 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:04.628+0000 7feccd400640 1 -- 172.21.15.72:0/3643333087 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fecc80d3d60 msgr2=0x7fecc80cdd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:04.627 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:04.628+0000 7feccd400640 1 --2- 172.21.15.72:0/3643333087 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fecc80d3d60 0x7fecc80cdd40 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fecb800b3f0 tx=0x7fecb800b8b0 comp rx=0 tx=0).stop 2024-04-04T06:57:04.627 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:04.628+0000 7feccd400640 1 -- 172.21.15.72:0/3643333087 shutdown_connections 2024-04-04T06:57:04.627 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:04.628+0000 7feccd400640 1 --2- 172.21.15.72:0/3643333087 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7feca806c8f0 0x7feca806edb0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:04.627 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:04.628+0000 7feccd400640 1 --2- 172.21.15.72:0/3643333087 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fecc80b87e0 0x7fecc815ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:04.627 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:04.628+0000 7feccd400640 1 --2- 172.21.15.72:0/3643333087 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fecc815e670 0x7fecc80c7d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:04.627 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:04.628+0000 7feccd400640 1 --2- 172.21.15.72:0/3643333087 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fecc80d3d60 0x7fecc80cdd40 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:04.627 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:04.628+0000 7feccd400640 1 -- 172.21.15.72:0/3643333087 >> 172.21.15.72:0/3643333087 conn(0x7fecc806baa0 msgr2=0x7fecc80d4950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:04.627 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:04.628+0000 7feccd400640 1 -- 172.21.15.72:0/3643333087 shutdown_connections 2024-04-04T06:57:04.627 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:04.628+0000 7feccd400640 1 -- 172.21.15.72:0/3643333087 wait complete. 2024-04-04T06:57:04.646 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-04T06:57:04.837 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:04.838+0000 7fcaf4400640 1 Processor -- start 2024-04-04T06:57:04.837 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:04.838+0000 7fcaf4400640 1 -- start start 2024-04-04T06:57:04.838 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:04.839+0000 7fcaf4400640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fcaec0d12b0 0x7fcaec0d1720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:04.838 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:04.839+0000 7fcaf4400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcaec0b74b0 0x7fcaec0b7940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:04.838 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:04.839+0000 7fcaf4400640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcaec0d2ea0 con 0x7fcaec15e600 2024-04-04T06:57:04.838 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:04.839+0000 7fcaf4400640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7fcaec0d1c60 con 0x7fcaec0d12b0 2024-04-04T06:57:04.839 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:04.839+0000 7fcaf4400640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fcaec0d3180 con 0x7fcaec0b74b0 2024-04-04T06:57:04.839 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:04.840+0000 7fcaf1a00640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fcaec15e600 0x7fcaec0d2470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:37844/0 (socket says 172.21.15.72:37844) 2024-04-04T06:57:04.839 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:04.840+0000 7fcaf1a00640 1 -- 172.21.15.72:0/3949046281 learned_addr learned my addr 172.21.15.72:0/3949046281 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-04-04T06:57:04.839 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:04.840+0000 7fcaf1000640 1 --2- 172.21.15.72:0/3949046281 >> v2:172.21.15.72:3300/0 conn(0x7fcaec0d12b0 0x7fcaec0d1720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:04.839 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:04.840+0000 7fcaf2400640 1 --2- 172.21.15.72:0/3949046281 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcaec0b74b0 0x7fcaec0b7940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:04.840 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:04.840+0000 7fcaebe00640 1 -- 172.21.15.72:0/3949046281 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 636399030 0 0) 0x7fcaec0d2ea0 con 0x7fcaec15e600 2024-04-04T06:57:04.840 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:04.840+0000 7fcaf1000640 1 -- 172.21.15.72:0/3949046281 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcaec0b74b0 msgr2=0x7fcaec0b7940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:57:04.840 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:04.840+0000 7fcaf1000640 1 --2- 172.21.15.72:0/3949046281 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcaec0b74b0 0x7fcaec0b7940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:04.840 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:04.840+0000 7fcaf1000640 1 -- 172.21.15.72:0/3949046281 >> v1:172.21.15.72:6789/0 conn(0x7fcaec15e600 legacy=0x7fcaec0d2470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:04.840 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:04.840+0000 7fcaf1000640 1 -- 172.21.15.72:0/3949046281 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcaec0d3460 con 0x7fcaec0d12b0 2024-04-04T06:57:04.840 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:04.841+0000 7fcaf1000640 1 --2- 172.21.15.72:0/3949046281 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcaec0d12b0 0x7fcaec0d1720 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fcad80097c0 tx=0x7fcad802b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44ee1401c112292 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:04.841 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:04.841+0000 7fcaebe00640 1 -- 172.21.15.72:0/3949046281 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcad8035020 con 0x7fcaec0d12b0 2024-04-04T06:57:04.841 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:04.842+0000 7fcaebe00640 1 -- 172.21.15.72:0/3949046281 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcad8031800 con 0x7fcaec0d12b0 2024-04-04T06:57:04.841 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:04.842+0000 7fcaebe00640 1 -- 172.21.15.72:0/3949046281 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcad8031bd0 con 0x7fcaec0d12b0 2024-04-04T06:57:04.841 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:04.842+0000 7fcaf4400640 1 -- 172.21.15.72:0/3949046281 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcaec0d12b0 msgr2=0x7fcaec0d1720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:04.841 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:04.842+0000 7fcaf4400640 1 --2- 172.21.15.72:0/3949046281 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcaec0d12b0 0x7fcaec0d1720 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fcad80097c0 tx=0x7fcad802b8a0 comp rx=0 tx=0).stop 2024-04-04T06:57:04.841 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:04.842+0000 7fcaf4400640 1 -- 172.21.15.72:0/3949046281 shutdown_connections 2024-04-04T06:57:04.842 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:04.842+0000 7fcaf4400640 1 --2- 172.21.15.72:0/3949046281 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcaec0b74b0 0x7fcaec0b7940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:04.842 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:04.842+0000 7fcaf4400640 1 --2- 172.21.15.72:0/3949046281 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcaec0d12b0 0x7fcaec0d1720 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:04.842 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:04.842+0000 7fcaf4400640 1 -- 172.21.15.72:0/3949046281 >> 172.21.15.72:0/3949046281 conn(0x7fcaec071eb0 msgr2=0x7fcaec0722c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:04.842 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:04.842+0000 7fcaf4400640 1 -- 172.21.15.72:0/3949046281 shutdown_connections 2024-04-04T06:57:04.842 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:04.842+0000 7fcaf4400640 1 -- 172.21.15.72:0/3949046281 wait complete. 2024-04-04T06:57:04.843 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:04.845+0000 7fcaf4400640 1 Processor -- start 2024-04-04T06:57:04.843 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:04.845+0000 7fcaf4400640 1 -- start start 2024-04-04T06:57:04.846 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:04.847+0000 7fcaf4400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcaec0b74b0 0x7fcaec1f72d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:04.846 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:04.847+0000 7fcaf4400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcaec0d12b0 0x7fcaec0c85f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:04.846 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:04.847+0000 7fcaf4400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcaec15e600 0x7fcaec0b50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:04.846 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:04.847+0000 7fcaf4400640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fcaec0d2b80 con 0x7fcaec0b74b0 2024-04-04T06:57:04.846 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:04.847+0000 7fcaf4400640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fcaec0d3a20 con 0x7fcaec0d12b0 2024-04-04T06:57:04.846 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:04.847+0000 7fcaf4400640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fcaec0d3f40 con 0x7fcaec15e600 2024-04-04T06:57:04.846 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:04.847+0000 7fcaf1a00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcaec0b74b0 0x7fcaec1f72d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:04.846 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:04.847+0000 7fcaf1a00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcaec0b74b0 0x7fcaec1f72d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48790/0 (socket says 172.21.15.72:48790) 2024-04-04T06:57:04.846 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:04.847+0000 7fcaf1a00640 1 -- 172.21.15.72:0/2638968510 learned_addr learned my addr 172.21.15.72:0/2638968510 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:57:04.846 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:04.847+0000 7fcaf2400640 1 --2- 172.21.15.72:0/2638968510 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcaec15e600 0x7fcaec0b50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:04.847 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:04.847+0000 7fcaf1000640 1 --2- 172.21.15.72:0/2638968510 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcaec0d12b0 0x7fcaec0c85f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:04.847 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:04.847+0000 7fcaf1a00640 1 -- 172.21.15.72:0/2638968510 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcaec15e600 msgr2=0x7fcaec0b50f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:04.847 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:04.847+0000 7fcaf1a00640 1 --2- 172.21.15.72:0/2638968510 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcaec15e600 0x7fcaec0b50f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:04.847 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:04.847+0000 7fcaf1a00640 1 -- 172.21.15.72:0/2638968510 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcaec0d12b0 msgr2=0x7fcaec0c85f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:04.847 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:04.847+0000 7fcaf1a00640 1 --2- 172.21.15.72:0/2638968510 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcaec0d12b0 0x7fcaec0c85f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:04.847 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:04.847+0000 7fcaf1a00640 1 -- 172.21.15.72:0/2638968510 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcaec15fe00 con 0x7fcaec0b74b0 2024-04-04T06:57:04.847 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:04.847+0000 7fcaf1000640 1 --2- 172.21.15.72:0/2638968510 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcaec0d12b0 0x7fcaec0c85f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-04T06:57:04.848 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:04.848+0000 7fcaf1a00640 1 --2- 172.21.15.72:0/2638968510 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcaec0b74b0 0x7fcaec1f72d0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fcae000c430 tx=0x7fcae000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:04.848 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:04.848+0000 7fcae9600640 1 -- 172.21.15.72:0/2638968510 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcae0017070 con 0x7fcaec0b74b0 2024-04-04T06:57:04.848 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:04.848+0000 7fcae9600640 1 -- 172.21.15.72:0/2638968510 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcae0005ce0 con 0x7fcaec0b74b0 2024-04-04T06:57:04.848 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:04.848+0000 7fcaf4400640 1 -- 172.21.15.72:0/2638968510 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcaec1f7d10 con 0x7fcaec0b74b0 2024-04-04T06:57:04.848 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:04.848+0000 7fcae9600640 1 -- 172.21.15.72:0/2638968510 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcae0007310 con 0x7fcaec0b74b0 2024-04-04T06:57:04.848 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:04.848+0000 7fcaf4400640 1 -- 172.21.15.72:0/2638968510 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcaec1f82d0 con 0x7fcaec0b74b0 2024-04-04T06:57:04.848 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:04.849+0000 7fcaf4400640 1 -- 172.21.15.72:0/2638968510 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcaec075730 con 0x7fcaec0b74b0 2024-04-04T06:57:04.849 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:04.850+0000 7fcae9600640 1 -- 172.21.15.72:0/2638968510 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fcae001a070 con 0x7fcaec0b74b0 2024-04-04T06:57:04.850 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:04.852+0000 7fcae9600640 1 --2- 172.21.15.72:0/2638968510 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fcacc06c8f0 0x7fcacc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:04.850 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:04.852+0000 7fcae9600640 1 -- 172.21.15.72:0/2638968510 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fcae008af80 con 0x7fcaec0b74b0 2024-04-04T06:57:04.850 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:04.852+0000 7fcaf1000640 1 --2- 172.21.15.72:0/2638968510 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fcacc06c8f0 0x7fcacc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:04.851 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:04.853+0000 7fcaf1000640 1 --2- 172.21.15.72:0/2638968510 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fcacc06c8f0 0x7fcacc06edb0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fcad8036000 tx=0x7fcad8008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:04.854 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:04.856+0000 7fcae9600640 1 -- 172.21.15.72:0/2638968510 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fcae00593a0 con 0x7fcaec0b74b0 2024-04-04T06:57:05.052 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:05.054+0000 7fcaf4400640 1 -- 172.21.15.72:0/2638968510 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fcaec0b3d70 con 0x7fcaec0b74b0 2024-04-04T06:57:05.053 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:05.055+0000 7fcae9600640 1 -- 172.21.15.72:0/2638968510 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) ==== 104+0+11 (secure 0 0 0) 0x7fcae0058ca0 con 0x7fcaec0b74b0 2024-04-04T06:57:05.053 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2024-04-04T06:57:05.058 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:05.057+0000 7fcaf4400640 1 -- 172.21.15.72:0/2638968510 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fcacc06c8f0 msgr2=0x7fcacc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:05.058 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:05.057+0000 7fcaf4400640 1 --2- 172.21.15.72:0/2638968510 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fcacc06c8f0 0x7fcacc06edb0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fcad8036000 tx=0x7fcad8008030 comp rx=0 tx=0).stop 2024-04-04T06:57:05.058 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:05.057+0000 7fcaf4400640 1 -- 172.21.15.72:0/2638968510 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcaec0b74b0 msgr2=0x7fcaec1f72d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:05.058 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:05.057+0000 7fcaf4400640 1 --2- 172.21.15.72:0/2638968510 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcaec0b74b0 0x7fcaec1f72d0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fcae000c430 tx=0x7fcae000c8f0 comp rx=0 tx=0).stop 2024-04-04T06:57:05.058 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:05.057+0000 7fcaf4400640 1 -- 172.21.15.72:0/2638968510 shutdown_connections 2024-04-04T06:57:05.059 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:05.057+0000 7fcaf4400640 1 --2- 172.21.15.72:0/2638968510 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fcacc06c8f0 0x7fcacc06edb0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:05.059 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:05.057+0000 7fcaf4400640 1 --2- 172.21.15.72:0/2638968510 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcaec15e600 0x7fcaec0b50f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:05.059 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:05.057+0000 7fcaf4400640 1 --2- 172.21.15.72:0/2638968510 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcaec0d12b0 0x7fcaec0c85f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:05.059 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:05.057+0000 7fcaf4400640 1 --2- 172.21.15.72:0/2638968510 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcaec0b74b0 0x7fcaec1f72d0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:05.059 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:05.057+0000 7fcaf4400640 1 -- 172.21.15.72:0/2638968510 >> 172.21.15.72:0/2638968510 conn(0x7fcaec071eb0 msgr2=0x7fcaec0b4010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:05.059 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:05.058+0000 7fcaf4400640 1 -- 172.21.15.72:0/2638968510 shutdown_connections 2024-04-04T06:57:05.059 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:05.058+0000 7fcaf4400640 1 -- 172.21.15.72:0/2638968510 wait complete. 2024-04-04T06:57:05.076 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-04T06:57:05.278 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:05.279+0000 7f465b200640 1 Processor -- start 2024-04-04T06:57:05.278 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:05.279+0000 7f465b200640 1 -- start start 2024-04-04T06:57:05.280 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:05.281+0000 7f465b200640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f465c1418f0 0x7f465c0d0140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:05.280 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:05.281+0000 7f465b200640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f465c160b40 con 0x7f465c1423e0 2024-04-04T06:57:05.280 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:05.281+0000 7f465b200640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f465c15ffc0 con 0x7f465c0d0680 2024-04-04T06:57:05.280 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:05.281+0000 7f465b200640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f465c1602a0 con 0x7f465c1418f0 2024-04-04T06:57:05.280 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:05.281+0000 7f4659e00640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f465c1418f0 0x7f465c0d0140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:05.280 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:05.281+0000 7f465a800640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f465c1423e0 0x7f465c15c9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:37858/0 (socket says 172.21.15.72:37858) 2024-04-04T06:57:05.280 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:05.281+0000 7f465a800640 1 -- 172.21.15.72:0/4197049223 learned_addr learned my addr 172.21.15.72:0/4197049223 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-04-04T06:57:05.281 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:05.282+0000 7f4659e00640 1 -- 172.21.15.72:0/4197049223 >> v1:172.21.15.117:6789/0 conn(0x7f465c0d0680 legacy=0x7f465c141cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:05.281 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:05.282+0000 7f4659e00640 1 -- 172.21.15.72:0/4197049223 >> v1:172.21.15.72:6789/0 conn(0x7f465c1423e0 legacy=0x7f465c15c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:05.281 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:05.282+0000 7f4659e00640 1 -- 172.21.15.72:0/4197049223 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f465c160580 con 0x7f465c1418f0 2024-04-04T06:57:05.281 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:05.282+0000 7f4658a00640 1 -- 172.21.15.72:0/4197049223 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1592869728 0 0) 0x7f465c160b40 con 0x7f465c1423e0 2024-04-04T06:57:05.282 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:05.283+0000 7f4659e00640 1 --2- 172.21.15.72:0/4197049223 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f465c1418f0 0x7f465c0d0140 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f464c0097a0 tx=0x7f464c02b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fdddeaebf175485 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:05.282 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:05.283+0000 7f4658a00640 1 -- 172.21.15.72:0/4197049223 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f464c034070 con 0x7f465c1418f0 2024-04-04T06:57:05.282 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:05.283+0000 7f4658a00640 1 -- 172.21.15.72:0/4197049223 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f464c030610 con 0x7f465c1418f0 2024-04-04T06:57:05.282 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:05.283+0000 7f4658a00640 1 -- 172.21.15.72:0/4197049223 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f464c0309e0 con 0x7f465c1418f0 2024-04-04T06:57:05.283 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:05.284+0000 7f465b200640 1 -- 172.21.15.72:0/4197049223 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f465c1418f0 msgr2=0x7f465c0d0140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:05.283 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:05.284+0000 7f465b200640 1 --2- 172.21.15.72:0/4197049223 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f465c1418f0 0x7f465c0d0140 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f464c0097a0 tx=0x7f464c02b960 comp rx=0 tx=0).stop 2024-04-04T06:57:05.283 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:05.284+0000 7f465b200640 1 -- 172.21.15.72:0/4197049223 shutdown_connections 2024-04-04T06:57:05.283 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:05.284+0000 7f465b200640 1 --2- 172.21.15.72:0/4197049223 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f465c1418f0 0x7f465c0d0140 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:05.283 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:05.284+0000 7f465b200640 1 -- 172.21.15.72:0/4197049223 >> 172.21.15.72:0/4197049223 conn(0x7f465c06b890 msgr2=0x7f465c06bca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:05.283 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:05.284+0000 7f465b200640 1 -- 172.21.15.72:0/4197049223 shutdown_connections 2024-04-04T06:57:05.283 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:05.284+0000 7f465b200640 1 -- 172.21.15.72:0/4197049223 wait complete. 2024-04-04T06:57:05.284 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:05.286+0000 7f465b200640 1 Processor -- start 2024-04-04T06:57:05.284 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:05.286+0000 7f465b200640 1 -- start start 2024-04-04T06:57:05.286 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:05.287+0000 7f465b200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f465c0d0680 0x7f465c0b1c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:05.286 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:05.287+0000 7f465b200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f465c1418f0 0x7f465c1f77c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:05.286 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:05.287+0000 7f465b200640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f465c1423e0 0x7f465c1f7d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:05.286 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:05.287+0000 7f465b200640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f465c15fc00 con 0x7f465c1423e0 2024-04-04T06:57:05.286 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:05.287+0000 7f465b200640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f465c0cc9c0 con 0x7f465c1418f0 2024-04-04T06:57:05.287 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:05.287+0000 7f465b200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f465c15fd80 con 0x7f465c0d0680 2024-04-04T06:57:05.287 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:05.287+0000 7f465a800640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f465c1423e0 0x7f465c1f7d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:05.287 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:05.287+0000 7f465a800640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f465c1423e0 0x7f465c1f7d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48804/0 (socket says 172.21.15.72:48804) 2024-04-04T06:57:05.287 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:05.287+0000 7f465a800640 1 -- 172.21.15.72:0/917822721 learned_addr learned my addr 172.21.15.72:0/917822721 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:57:05.287 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:05.287+0000 7f4659400640 1 --2- 172.21.15.72:0/917822721 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f465c1418f0 0x7f465c1f77c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:05.287 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:05.287+0000 7f4659e00640 1 --2- 172.21.15.72:0/917822721 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f465c0d0680 0x7f465c0b1c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:05.287 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:05.288+0000 7f465a800640 1 -- 172.21.15.72:0/917822721 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f465c0d0680 msgr2=0x7f465c0b1c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:05.287 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:05.288+0000 7f465a800640 1 --2- 172.21.15.72:0/917822721 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f465c0d0680 0x7f465c0b1c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:05.287 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:05.288+0000 7f465a800640 1 -- 172.21.15.72:0/917822721 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f465c1418f0 msgr2=0x7f465c1f77c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:05.287 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:05.288+0000 7f465a800640 1 --2- 172.21.15.72:0/917822721 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f465c1418f0 0x7f465c1f77c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:05.287 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:05.288+0000 7f465a800640 1 -- 172.21.15.72:0/917822721 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f465c1f86d0 con 0x7f465c1423e0 2024-04-04T06:57:05.287 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:05.288+0000 7f465a800640 1 --2- 172.21.15.72:0/917822721 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f465c1423e0 0x7f465c1f7d00 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f465400c730 tx=0x7f465400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:05.288 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:05.288+0000 7f4652000640 1 -- 172.21.15.72:0/917822721 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4654018070 con 0x7f465c1423e0 2024-04-04T06:57:05.288 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:05.288+0000 7f4652000640 1 -- 172.21.15.72:0/917822721 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f465400ce40 con 0x7f465c1423e0 2024-04-04T06:57:05.288 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:05.288+0000 7f4652000640 1 -- 172.21.15.72:0/917822721 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f465400a860 con 0x7f465c1423e0 2024-04-04T06:57:05.288 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:05.288+0000 7f465b200640 1 -- 172.21.15.72:0/917822721 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f465c1541e0 con 0x7f465c1423e0 2024-04-04T06:57:05.288 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:05.288+0000 7f465b200640 1 -- 172.21.15.72:0/917822721 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f465c15e9d0 con 0x7f465c1423e0 2024-04-04T06:57:05.289 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:05.290+0000 7f465b200640 1 -- 172.21.15.72:0/917822721 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f465c0756c0 con 0x7f465c1423e0 2024-04-04T06:57:05.289 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:05.291+0000 7f4652000640 1 -- 172.21.15.72:0/917822721 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f465400aa00 con 0x7f465c1423e0 2024-04-04T06:57:05.290 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:05.291+0000 7f4652000640 1 --2- 172.21.15.72:0/917822721 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f463c06c8f0 0x7f463c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:05.290 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:05.291+0000 7f4652000640 1 -- 172.21.15.72:0/917822721 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f465408b0e0 con 0x7f465c1423e0 2024-04-04T06:57:05.290 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:05.292+0000 7f4659e00640 1 --2- 172.21.15.72:0/917822721 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f463c06c8f0 0x7f463c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:05.291 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:05.292+0000 7f4659e00640 1 --2- 172.21.15.72:0/917822721 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f463c06c8f0 0x7f463c06edb0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f464c036000 tx=0x7f464c008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:05.294 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:05.296+0000 7f4652000640 1 -- 172.21.15.72:0/917822721 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f4654059580 con 0x7f465c1423e0 2024-04-04T06:57:05.525 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:05.526+0000 7f465b200640 1 -- 172.21.15.72:0/917822721 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f465c06f250 con 0x7f465c1423e0 2024-04-04T06:57:05.525 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:05.527+0000 7f4652000640 1 -- 172.21.15.72:0/917822721 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) ==== 100+0+11 (secure 0 0 0) 0x7f4654058e80 con 0x7f465c1423e0 2024-04-04T06:57:05.526 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 64 2024-04-04T06:57:05.528 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:05.529+0000 7f465b200640 1 -- 172.21.15.72:0/917822721 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f463c06c8f0 msgr2=0x7f463c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:05.528 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:05.529+0000 7f465b200640 1 --2- 172.21.15.72:0/917822721 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f463c06c8f0 0x7f463c06edb0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f464c036000 tx=0x7f464c008030 comp rx=0 tx=0).stop 2024-04-04T06:57:05.528 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:05.529+0000 7f465b200640 1 -- 172.21.15.72:0/917822721 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f465c1423e0 msgr2=0x7f465c1f7d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:05.528 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:05.529+0000 7f465b200640 1 --2- 172.21.15.72:0/917822721 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f465c1423e0 0x7f465c1f7d00 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f465400c730 tx=0x7f465400cbf0 comp rx=0 tx=0).stop 2024-04-04T06:57:05.528 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:05.529+0000 7f465b200640 1 -- 172.21.15.72:0/917822721 shutdown_connections 2024-04-04T06:57:05.529 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:05.529+0000 7f465b200640 1 --2- 172.21.15.72:0/917822721 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f463c06c8f0 0x7f463c06edb0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:05.529 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:05.529+0000 7f465b200640 1 --2- 172.21.15.72:0/917822721 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f465c1423e0 0x7f465c1f7d00 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:05.529 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:05.529+0000 7f465b200640 1 --2- 172.21.15.72:0/917822721 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f465c1418f0 0x7f465c1f77c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:05.529 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:05.529+0000 7f465b200640 1 --2- 172.21.15.72:0/917822721 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f465c0d0680 0x7f465c0b1c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:05.529 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:05.530+0000 7f465b200640 1 -- 172.21.15.72:0/917822721 >> 172.21.15.72:0/917822721 conn(0x7f465c06b890 msgr2=0x7f465c06dc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:05.529 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:05.530+0000 7f465b200640 1 -- 172.21.15.72:0/917822721 shutdown_connections 2024-04-04T06:57:05.529 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:05.530+0000 7f465b200640 1 -- 172.21.15.72:0/917822721 wait complete. 2024-04-04T06:57:05.549 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-04T06:57:05.744 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:05.745+0000 7faf6d200640 1 Processor -- start 2024-04-04T06:57:05.744 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:05.745+0000 7faf6d200640 1 -- start start 2024-04-04T06:57:05.745 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:05.747+0000 7faf6d200640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7faf680d07d0 0x7faf680c4ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:05.746 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:05.747+0000 7faf6d200640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7faf680c5530 0x7faf680b3540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:05.746 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:05.747+0000 7faf6d200640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf680c5c00 con 0x7faf6815b230 2024-04-04T06:57:05.746 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:05.747+0000 7faf6d200640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7faf6815c2b0 con 0x7faf680c5530 2024-04-04T06:57:05.746 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:05.747+0000 7faf6d200640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7faf680c59a0 con 0x7faf680d07d0 2024-04-04T06:57:05.746 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:05.747+0000 7faf66800640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7faf680c5530 0x7faf680b3540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:05.746 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:05.747+0000 7faf65e00640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7faf6815b230 0x7faf680d00c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:37870/0 (socket says 172.21.15.72:37870) 2024-04-04T06:57:05.746 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:05.747+0000 7faf65e00640 1 -- 172.21.15.72:0/3547878124 learned_addr learned my addr 172.21.15.72:0/3547878124 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-04-04T06:57:05.747 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:05.747+0000 7faf65400640 1 --2- 172.21.15.72:0/3547878124 >> v2:172.21.15.117:3300/0 conn(0x7faf680d07d0 0x7faf680c4ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:05.747 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:05.748+0000 7faf66800640 1 -- 172.21.15.72:0/3547878124 >> v2:172.21.15.117:3300/0 conn(0x7faf680d07d0 msgr2=0x7faf680c4ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:57:05.747 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:05.748+0000 7faf66800640 1 --2- 172.21.15.72:0/3547878124 >> v2:172.21.15.117:3300/0 conn(0x7faf680d07d0 0x7faf680c4ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:05.747 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:05.748+0000 7faf66800640 1 -- 172.21.15.72:0/3547878124 >> v1:172.21.15.72:6789/0 conn(0x7faf6815b230 legacy=0x7faf680d00c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:05.747 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:05.748+0000 7faf66800640 1 -- 172.21.15.72:0/3547878124 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf6815b980 con 0x7faf680c5530 2024-04-04T06:57:05.747 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:05.748+0000 7faf64a00640 1 -- 172.21.15.72:0/3547878124 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1632823522 0 0) 0x7faf680c5c00 con 0x7faf6815b230 2024-04-04T06:57:05.748 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:05.749+0000 7faf66800640 1 --2- 172.21.15.72:0/3547878124 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faf680c5530 0x7faf680b3540 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7faf68073ac0 tx=0x7faf6002e0d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee31379d09b330d8 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:05.748 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:05.749+0000 7faf64a00640 1 -- 172.21.15.72:0/3547878124 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf6003b070 con 0x7faf680c5530 2024-04-04T06:57:05.748 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:05.749+0000 7faf64a00640 1 -- 172.21.15.72:0/3547878124 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf60036440 con 0x7faf680c5530 2024-04-04T06:57:05.748 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:05.749+0000 7faf64a00640 1 -- 172.21.15.72:0/3547878124 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf60036810 con 0x7faf680c5530 2024-04-04T06:57:05.749 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:05.750+0000 7faf6d200640 1 -- 172.21.15.72:0/3547878124 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faf680c5530 msgr2=0x7faf680b3540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:05.749 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:05.750+0000 7faf6d200640 1 --2- 172.21.15.72:0/3547878124 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faf680c5530 0x7faf680b3540 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7faf68073ac0 tx=0x7faf6002e0d0 comp rx=0 tx=0).stop 2024-04-04T06:57:05.749 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:05.750+0000 7faf6d200640 1 -- 172.21.15.72:0/3547878124 shutdown_connections 2024-04-04T06:57:05.749 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:05.750+0000 7faf6d200640 1 --2- 172.21.15.72:0/3547878124 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faf680c5530 0x7faf680b3540 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:05.749 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:05.750+0000 7faf6d200640 1 --2- 172.21.15.72:0/3547878124 >> v2:172.21.15.117:3300/0 conn(0x7faf680d07d0 0x7faf680c4ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:05.749 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:05.750+0000 7faf6d200640 1 -- 172.21.15.72:0/3547878124 >> 172.21.15.72:0/3547878124 conn(0x7faf6806b470 msgr2=0x7faf6806b880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:05.749 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:05.750+0000 7faf6d200640 1 -- 172.21.15.72:0/3547878124 shutdown_connections 2024-04-04T06:57:05.749 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:05.750+0000 7faf6d200640 1 -- 172.21.15.72:0/3547878124 wait complete. 2024-04-04T06:57:05.750 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:05.751+0000 7faf6d200640 1 Processor -- start 2024-04-04T06:57:05.750 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:05.752+0000 7faf6d200640 1 -- start start 2024-04-04T06:57:05.752 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:05.753+0000 7faf6d200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faf680c5530 0x7faf68153bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:05.752 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:05.753+0000 7faf6d200640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faf680d07d0 0x7faf680b16a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:05.752 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:05.753+0000 7faf6d200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faf6815b230 0x7faf680b0690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:05.752 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:05.753+0000 7faf6d200640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7faf6815b610 con 0x7faf680d07d0 2024-04-04T06:57:05.752 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:05.753+0000 7faf6d200640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7faf6815bf40 con 0x7faf6815b230 2024-04-04T06:57:05.752 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:05.753+0000 7faf6d200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7faf680b3a80 con 0x7faf680c5530 2024-04-04T06:57:05.753 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:05.753+0000 7faf65400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faf680d07d0 0x7faf680b16a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:05.753 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:05.753+0000 7faf65400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faf680d07d0 0x7faf680b16a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48834/0 (socket says 172.21.15.72:48834) 2024-04-04T06:57:05.753 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:05.753+0000 7faf65400640 1 -- 172.21.15.72:0/1941421631 learned_addr learned my addr 172.21.15.72:0/1941421631 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:57:05.753 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:05.753+0000 7faf66800640 1 --2- 172.21.15.72:0/1941421631 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faf6815b230 0x7faf680b0690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:05.753 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:05.753+0000 7faf65400640 1 -- 172.21.15.72:0/1941421631 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faf680c5530 msgr2=0x7faf68153bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:05.753 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:05.753+0000 7faf65e00640 1 --2- 172.21.15.72:0/1941421631 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faf680c5530 0x7faf68153bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:05.753 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:05.753+0000 7faf65400640 1 --2- 172.21.15.72:0/1941421631 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faf680c5530 0x7faf68153bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:05.753 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:05.753+0000 7faf65400640 1 -- 172.21.15.72:0/1941421631 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faf6815b230 msgr2=0x7faf680b0690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:05.753 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:05.753+0000 7faf65400640 1 --2- 172.21.15.72:0/1941421631 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faf6815b230 0x7faf680b0690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:05.753 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:05.753+0000 7faf65400640 1 -- 172.21.15.72:0/1941421631 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf680b0bd0 con 0x7faf680d07d0 2024-04-04T06:57:05.753 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:05.753+0000 7faf66800640 1 --2- 172.21.15.72:0/1941421631 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faf6815b230 0x7faf680b0690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-04T06:57:05.753 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:05.754+0000 7faf65400640 1 --2- 172.21.15.72:0/1941421631 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faf680d07d0 0x7faf680b16a0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7faf5000d800 tx=0x7faf5000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:05.754 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:05.754+0000 7faf5e000640 1 -- 172.21.15.72:0/1941421631 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf5000b6c0 con 0x7faf680d07d0 2024-04-04T06:57:05.754 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:05.754+0000 7faf5e000640 1 -- 172.21.15.72:0/1941421631 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf50019070 con 0x7faf680d07d0 2024-04-04T06:57:05.754 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:05.754+0000 7faf6d200640 1 -- 172.21.15.72:0/1941421631 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf680afbd0 con 0x7faf680d07d0 2024-04-04T06:57:05.754 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:05.754+0000 7faf5e000640 1 -- 172.21.15.72:0/1941421631 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf5000ba80 con 0x7faf680d07d0 2024-04-04T06:57:05.754 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:05.754+0000 7faf6d200640 1 -- 172.21.15.72:0/1941421631 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf680ad340 con 0x7faf680d07d0 2024-04-04T06:57:05.754 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:05.756+0000 7faf6d200640 1 -- 172.21.15.72:0/1941421631 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf68075840 con 0x7faf680d07d0 2024-04-04T06:57:05.755 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:05.756+0000 7faf5e000640 1 -- 172.21.15.72:0/1941421631 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7faf5000bc20 con 0x7faf680d07d0 2024-04-04T06:57:05.756 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:05.758+0000 7faf5e000640 1 --2- 172.21.15.72:0/1941421631 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7faf4406c8f0 0x7faf4406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:05.756 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:05.758+0000 7faf5e000640 1 -- 172.21.15.72:0/1941421631 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7faf5008bff0 con 0x7faf680d07d0 2024-04-04T06:57:05.757 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:05.758+0000 7faf65e00640 1 --2- 172.21.15.72:0/1941421631 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7faf4406c8f0 0x7faf4406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:05.757 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:05.759+0000 7faf65e00640 1 --2- 172.21.15.72:0/1941421631 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7faf4406c8f0 0x7faf4406edb0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7faf58000f60 tx=0x7faf58009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:05.760 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:05.762+0000 7faf5e000640 1 -- 172.21.15.72:0/1941421631 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7faf5005a410 con 0x7faf680d07d0 2024-04-04T06:57:05.959 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:05.960+0000 7faf6d200640 1 -- 172.21.15.72:0/1941421631 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7faf680cc3d0 con 0x7faf680d07d0 2024-04-04T06:57:05.961 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:05.962+0000 7faf5e000640 1 -- 172.21.15.72:0/1941421631 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16581 (secure 0 0 0) 0x7faf50059d10 con 0x7faf680d07d0 2024-04-04T06:57:05.961 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T06:57:05.961 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":20,"fsid":"6708bac2-4f50-49b5-87a9-c390fd333eb3","created":"2024-04-04T06:56:04.282498+0000","modified":"2024-04-04T06:56:30.007371+0000","last_up_change":"2024-04-04T06:56:16.716089+0000","last_in_change":"2024-04-04T06:56:07.768593+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-04T06:56:17.421685+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-04T06:56:26.822661+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-04T06:56:27.429816+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7c345991-5af8-4dc6-a481-28610c40e128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":3889813953},{"type":"v1","addr":"172.21.15.72:6818","nonce":3889813953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":3889813953},{"type":"v1","addr":"172.21.15.72:6821","nonce":3889813953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":3889813953},{"type":"v1","addr":"172.21.15.72:6826","nonce":3889813953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":3889813953},{"type":"v1","addr":"172.21.15.72:6823","nonce":3889813953}]},"public_addr":"172.21.15.72:6818/3889813953","cluster_addr":"172.21.15.72:6821/3889813953","heartbeat_back_addr":"172.21.15.72:6826/3889813953","heartbeat_front_addr":"172.21.15.72:6823/3889813953","state":["exists","up"]},{"osd":1,"uuid":"1b3f7ab2-a56c-488d-a89a-1f3572361c95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":3101663154},{"type":"v1","addr":"172.21.15.72:6801","nonce":3101663154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":3101663154},{"type":"v1","addr":"172.21.15.72:6803","nonce":3101663154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":3101663154},{"type":"v1","addr":"172.21.15.72:6807","nonce":3101663154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":3101663154},{"type":"v1","addr":"172.21.15.72:6805","nonce":3101663154}]},"public_addr":"172.21.15.72:6801/3101663154","cluster_addr":"172.21.15.72:6803/3101663154","heartbeat_back_addr":"172.21.15.72:6807/3101663154","heartbeat_front_addr":"172.21.15.72:6805/3101663154","state":["exists","up"]},{"osd":2,"uuid":"fc9aa512-53df-40d7-ba04-3e6b7dcd1e34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":235374192},{"type":"v1","addr":"172.21.15.72:6809","nonce":235374192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":235374192},{"type":"v1","addr":"172.21.15.72:6811","nonce":235374192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":235374192},{"type":"v1","addr":"172.21.15.72:6815","nonce":235374192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":235374192},{"type":"v1","addr":"172.21.15.72:6813","nonce":235374192}]},"public_addr":"172.21.15.72:6809/235374192","cluster_addr":"172.21.15.72:6811/235374192","heartbeat_back_addr":"172.21.15.72:6815/235374192","heartbeat_front_addr":"172.21.15.72:6813/235374192","state":["exists","up"]},{"osd":3,"uuid":"b4f63eed-dc5b-4aba-bb50-de46eb41492b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6817","nonce":2806631742},{"type":"v1","addr":"172.21.15.72:6819","nonce":2806631742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":2806631742},{"type":"v1","addr":"172.21.15.72:6827","nonce":2806631742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":2806631742},{"type":"v1","addr":"172.21.15.72:6831","nonce":2806631742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":2806631742},{"type":"v1","addr":"172.21.15.72:6829","nonce":2806631742}]},"public_addr":"172.21.15.72:6819/2806631742","cluster_addr":"172.21.15.72:6827/2806631742","heartbeat_back_addr":"172.21.15.72:6831/2806631742","heartbeat_front_addr":"172.21.15.72:6829/2806631742","state":["exists","up"]},{"osd":4,"uuid":"9e985ef8-d711-4172-9286-c54e560895d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":4293536423},{"type":"v1","addr":"172.21.15.117:6825","nonce":4293536423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":4293536423},{"type":"v1","addr":"172.21.15.117:6827","nonce":4293536423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":4293536423},{"type":"v1","addr":"172.21.15.117:6831","nonce":4293536423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":4293536423},{"type":"v1","addr":"172.21.15.117:6829","nonce":4293536423}]},"public_addr":"172.21.15.117:6825/4293536423","cluster_addr":"172.21.15.117:6827/4293536423","heartbeat_back_addr":"172.21.15.117:6831/4293536423","heartbeat_front_addr":"172.21.15.117:6829/4293536423","state":["exists","up"]},{"osd":5,"uuid":"3e9f082b-8d7d-455f-8a96-66d0b4857125","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":684971679},{"type":"v1","addr":"172.21.15.117:6801","nonce":684971679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":684971679},{"type":"v1","addr":"172.21.15.117:6803","nonce":684971679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":684971679},{"type":"v1","addr":"172.21.15.117:6807","nonce":684971679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":684971679},{"type":"v1","addr":"172.21.15.117:6805","nonce":684971679}]},"public_addr":"172.21.15.117:6801/684971679","cluster_addr":"172.21.15.117:6803/684971679","heartbeat_back_addr":"172.21.15.117:6807/684971679","heartbeat_front_addr":"172.21.15.117:6805/684971679","state":["exists","up"]},{"osd":6,"uuid":"bcdafa9f-a870-4398-a38d-ab7697676473","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":2781186528},{"type":"v1","addr":"172.21.15.117:6809","nonce":2781186528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":2781186528},{"type":"v1","addr":"172.21.15.117:6811","nonce":2781186528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":2781186528},{"type":"v1","addr":"172.21.15.117:6815","nonce":2781186528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":2781186528},{"type":"v1","addr":"172.21.15.117:6813","nonce":2781186528}]},"public_addr":"172.21.15.117:6809/2781186528","cluster_addr":"172.21.15.117:6811/2781186528","heartbeat_back_addr":"172.21.15.117:6815/2781186528","heartbeat_front_addr":"172.21.15.117:6813/2781186528","state":["exists","up"]},{"osd":7,"uuid":"b68ec562-ff35-4d2d-a733-c896f8920cfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":617469882},{"type":"v1","addr":"172.21.15.117:6817","nonce":617469882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":617469882},{"type":"v1","addr":"172.21.15.117:6819","nonce":617469882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":617469882},{"type":"v1","addr":"172.21.15.117:6823","nonce":617469882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":617469882},{"type":"v1","addr":"172.21.15.117:6821","nonce":617469882}]},"public_addr":"172.21.15.117:6817/617469882","cluster_addr":"172.21.15.117:6819/617469882","heartbeat_back_addr":"172.21.15.117:6823/617469882","heartbeat_front_addr":"172.21.15.117:6821/617469882","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.347700+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.296619+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.361345+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.093323+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:12.857605+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:12.816090+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.083163+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.121639+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-04T06:57:05.963 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:05.965+0000 7faf6d200640 1 -- 172.21.15.72:0/1941421631 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7faf4406c8f0 msgr2=0x7faf4406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:05.964 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:05.965+0000 7faf6d200640 1 --2- 172.21.15.72:0/1941421631 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7faf4406c8f0 0x7faf4406edb0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7faf58000f60 tx=0x7faf58009040 comp rx=0 tx=0).stop 2024-04-04T06:57:05.964 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:05.965+0000 7faf6d200640 1 -- 172.21.15.72:0/1941421631 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faf680d07d0 msgr2=0x7faf680b16a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:05.964 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:05.965+0000 7faf6d200640 1 --2- 172.21.15.72:0/1941421631 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faf680d07d0 0x7faf680b16a0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7faf5000d800 tx=0x7faf5000dcc0 comp rx=0 tx=0).stop 2024-04-04T06:57:05.964 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:05.965+0000 7faf6d200640 1 -- 172.21.15.72:0/1941421631 shutdown_connections 2024-04-04T06:57:05.964 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:05.965+0000 7faf6d200640 1 --2- 172.21.15.72:0/1941421631 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7faf4406c8f0 0x7faf4406edb0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:05.964 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:05.965+0000 7faf6d200640 1 --2- 172.21.15.72:0/1941421631 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faf6815b230 0x7faf680b0690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:05.964 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:05.965+0000 7faf6d200640 1 --2- 172.21.15.72:0/1941421631 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faf680d07d0 0x7faf680b16a0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:05.964 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:05.965+0000 7faf6d200640 1 --2- 172.21.15.72:0/1941421631 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faf680c5530 0x7faf68153bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:05.964 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:05.965+0000 7faf6d200640 1 -- 172.21.15.72:0/1941421631 >> 172.21.15.72:0/1941421631 conn(0x7faf6806b470 msgr2=0x7faf680d00c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:05.964 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:05.965+0000 7faf6d200640 1 -- 172.21.15.72:0/1941421631 shutdown_connections 2024-04-04T06:57:05.964 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:05.965+0000 7faf6d200640 1 -- 172.21.15.72:0/1941421631 wait complete. 2024-04-04T06:57:05.981 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-04T06:56:17.421685+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-04T06:56:26.822661+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-04T06:56:27.429816+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-04T06:57:05.982 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-04T06:57:06.183 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:06.184+0000 7ff013200640 1 Processor -- start 2024-04-04T06:57:06.183 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:06.184+0000 7ff013200640 1 -- start start 2024-04-04T06:57:06.184 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:06.185+0000 7ff013200640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff00c145b10 0x7ff00c06d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:06.184 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:06.185+0000 7ff013200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff00c06dac0 0x7ff00c0cfa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:06.185 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:06.185+0000 7ff013200640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff00c145ef0 con 0x7ff00c0cff40 2024-04-04T06:57:06.185 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:06.185+0000 7ff013200640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7ff00c0cea10 con 0x7ff00c145b10 2024-04-04T06:57:06.185 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:06.185+0000 7ff013200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7ff00c06e310 con 0x7ff00c06dac0 2024-04-04T06:57:06.185 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:06.186+0000 7ff00be00640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff00c145b10 0x7ff00c06d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:06.185 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:06.186+0000 7ff00be00640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff00c145b10 0x7ff00c06d580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48840/0 (socket says 172.21.15.72:48840) 2024-04-04T06:57:06.185 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:06.186+0000 7ff00be00640 1 -- 172.21.15.72:0/574994985 learned_addr learned my addr 172.21.15.72:0/574994985 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:57:06.186 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:06.186+0000 7ff00b400640 1 --2- 172.21.15.72:0/574994985 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff00c06dac0 0x7ff00c0cfa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:06.186 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:06.186+0000 7ff00be00640 1 -- 172.21.15.72:0/574994985 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff00c06dac0 msgr2=0x7ff00c0cfa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:57:06.186 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:06.186+0000 7ff00be00640 1 --2- 172.21.15.72:0/574994985 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff00c06dac0 0x7ff00c0cfa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:06.186 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:06.186+0000 7ff00be00640 1 -- 172.21.15.72:0/574994985 >> v1:172.21.15.72:6789/0 conn(0x7ff00c0cff40 legacy=0x7ff00c15fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:06.186 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:06.186+0000 7ff00be00640 1 -- 172.21.15.72:0/574994985 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff00c0cec40 con 0x7ff00c145b10 2024-04-04T06:57:06.186 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:06.186+0000 7ff00b400640 1 --2- 172.21.15.72:0/574994985 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff00c06dac0 0x7ff00c0cfa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-04T06:57:06.186 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:06.186+0000 7ff00aa00640 1 -- 172.21.15.72:0/574994985 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1436225904 0 0) 0x7ff00c145ef0 con 0x7ff00c0cff40 2024-04-04T06:57:06.187 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:06.188+0000 7ff00be00640 1 --2- 172.21.15.72:0/574994985 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff00c145b10 0x7ff00c06d580 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7feffc009870 tx=0x7feffc02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25889f17c2eb85e server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:06.187 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:06.188+0000 7ff00aa00640 1 -- 172.21.15.72:0/574994985 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feffc035020 con 0x7ff00c145b10 2024-04-04T06:57:06.187 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:06.188+0000 7ff00aa00640 1 -- 172.21.15.72:0/574994985 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feffc031640 con 0x7ff00c145b10 2024-04-04T06:57:06.188 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:06.188+0000 7ff00aa00640 1 -- 172.21.15.72:0/574994985 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feffc02d040 con 0x7ff00c145b10 2024-04-04T06:57:06.188 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:06.188+0000 7ff013200640 1 -- 172.21.15.72:0/574994985 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff00c145b10 msgr2=0x7ff00c06d580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:06.188 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:06.188+0000 7ff013200640 1 --2- 172.21.15.72:0/574994985 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff00c145b10 0x7ff00c06d580 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7feffc009870 tx=0x7feffc02b8f0 comp rx=0 tx=0).stop 2024-04-04T06:57:06.188 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:06.189+0000 7ff013200640 1 -- 172.21.15.72:0/574994985 shutdown_connections 2024-04-04T06:57:06.188 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:06.189+0000 7ff013200640 1 --2- 172.21.15.72:0/574994985 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff00c06dac0 0x7ff00c0cfa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:06.188 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:06.189+0000 7ff013200640 1 --2- 172.21.15.72:0/574994985 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff00c145b10 0x7ff00c06d580 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:06.188 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:06.189+0000 7ff013200640 1 -- 172.21.15.72:0/574994985 >> 172.21.15.72:0/574994985 conn(0x7ff00c06b470 msgr2=0x7ff00c06b850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:06.188 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:06.189+0000 7ff013200640 1 -- 172.21.15.72:0/574994985 shutdown_connections 2024-04-04T06:57:06.188 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:06.189+0000 7ff013200640 1 -- 172.21.15.72:0/574994985 wait complete. 2024-04-04T06:57:06.189 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:06.190+0000 7ff013200640 1 Processor -- start 2024-04-04T06:57:06.189 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:06.190+0000 7ff013200640 1 -- start start 2024-04-04T06:57:06.190 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:06.191+0000 7ff013200640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff00c06dac0 0x7ff00c140d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:06.191 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:06.191+0000 7ff013200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff00c0cff40 0x7ff00c1595f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:06.191 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:06.191+0000 7ff013200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff00c145b10 0x7ff00c159b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:06.191 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:06.191+0000 7ff013200640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7ff00c0cf4e0 con 0x7ff00c06dac0 2024-04-04T06:57:06.191 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:06.191+0000 7ff013200640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7ff00c0cf200 con 0x7ff00c0cff40 2024-04-04T06:57:06.191 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:06.191+0000 7ff013200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7ff00c06df40 con 0x7ff00c145b10 2024-04-04T06:57:06.191 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:06.192+0000 7ff00be00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff00c06dac0 0x7ff00c140d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:06.191 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:06.192+0000 7ff00be00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff00c06dac0 0x7ff00c140d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48848/0 (socket says 172.21.15.72:48848) 2024-04-04T06:57:06.191 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:06.192+0000 7ff00be00640 1 -- 172.21.15.72:0/265056804 learned_addr learned my addr 172.21.15.72:0/265056804 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:57:06.191 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:06.192+0000 7ff00be00640 1 -- 172.21.15.72:0/265056804 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff00c145b10 msgr2=0x7ff00c159b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:06.191 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:06.192+0000 7ff00b400640 1 --2- 172.21.15.72:0/265056804 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff00c0cff40 0x7ff00c1595f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:06.191 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:06.192+0000 7ff00be00640 1 --2- 172.21.15.72:0/265056804 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff00c145b10 0x7ff00c159b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:06.191 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:06.192+0000 7ff00be00640 1 -- 172.21.15.72:0/265056804 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff00c0cff40 msgr2=0x7ff00c1595f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:06.191 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:06.192+0000 7ff00be00640 1 --2- 172.21.15.72:0/265056804 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff00c0cff40 0x7ff00c1595f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:06.191 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:06.192+0000 7ff00be00640 1 -- 172.21.15.72:0/265056804 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff00c13c830 con 0x7ff00c06dac0 2024-04-04T06:57:06.192 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:06.192+0000 7ff00be00640 1 --2- 172.21.15.72:0/265056804 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff00c06dac0 0x7ff00c140d40 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7feffc000c00 tx=0x7feffc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:06.192 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:06.193+0000 7ff003e00640 1 -- 172.21.15.72:0/265056804 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feffc040070 con 0x7ff00c06dac0 2024-04-04T06:57:06.192 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:06.193+0000 7ff003e00640 1 -- 172.21.15.72:0/265056804 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feffc039bf0 con 0x7ff00c06dac0 2024-04-04T06:57:06.192 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:06.193+0000 7ff003e00640 1 -- 172.21.15.72:0/265056804 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feffc035040 con 0x7ff00c06dac0 2024-04-04T06:57:06.192 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:06.193+0000 7ff013200640 1 -- 172.21.15.72:0/265056804 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff00c13cb10 con 0x7ff00c06dac0 2024-04-04T06:57:06.192 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:06.193+0000 7ff013200640 1 -- 172.21.15.72:0/265056804 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff00c139060 con 0x7ff00c06dac0 2024-04-04T06:57:06.193 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:06.194+0000 7ff013200640 1 -- 172.21.15.72:0/265056804 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff00c075730 con 0x7ff00c06dac0 2024-04-04T06:57:06.193 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:06.195+0000 7ff003e00640 1 -- 172.21.15.72:0/265056804 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7feffc04b060 con 0x7ff00c06dac0 2024-04-04T06:57:06.194 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:06.196+0000 7ff003e00640 1 --2- 172.21.15.72:0/265056804 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fefec06c8f0 0x7fefec06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:06.194 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:06.196+0000 7ff003e00640 1 -- 172.21.15.72:0/265056804 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7feffc0ad5c0 con 0x7ff00c06dac0 2024-04-04T06:57:06.195 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:06.196+0000 7ff00b400640 1 --2- 172.21.15.72:0/265056804 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fefec06c8f0 0x7fefec06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:06.195 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:06.197+0000 7ff00b400640 1 --2- 172.21.15.72:0/265056804 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fefec06c8f0 0x7fefec06edb0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7ff00c0cfab0 tx=0x7feff8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:06.199 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:06.201+0000 7ff003e00640 1 -- 172.21.15.72:0/265056804 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7feffc02f300 con 0x7ff00c06dac0 2024-04-04T06:57:06.482 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:06.483+0000 7ff013200640 1 -- 172.21.15.72:0/265056804 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7ff00c0d0c00 con 0x7ff00c06dac0 2024-04-04T06:57:06.483 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:06.484+0000 7ff003e00640 1 -- 172.21.15.72:0/265056804 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) ==== 93+0+10 (secure 0 0 0) 0x7feffc07b9f0 con 0x7ff00c06dac0 2024-04-04T06:57:06.483 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 1 2024-04-04T06:57:06.486 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:06.488+0000 7ff013200640 1 -- 172.21.15.72:0/265056804 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fefec06c8f0 msgr2=0x7fefec06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:06.486 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:06.488+0000 7ff013200640 1 --2- 172.21.15.72:0/265056804 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fefec06c8f0 0x7fefec06edb0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7ff00c0cfab0 tx=0x7feff8008040 comp rx=0 tx=0).stop 2024-04-04T06:57:06.486 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:06.488+0000 7ff013200640 1 -- 172.21.15.72:0/265056804 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff00c06dac0 msgr2=0x7ff00c140d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:06.487 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:06.488+0000 7ff013200640 1 --2- 172.21.15.72:0/265056804 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff00c06dac0 0x7ff00c140d40 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7feffc000c00 tx=0x7feffc0046c0 comp rx=0 tx=0).stop 2024-04-04T06:57:06.487 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:06.488+0000 7ff013200640 1 -- 172.21.15.72:0/265056804 shutdown_connections 2024-04-04T06:57:06.487 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:06.488+0000 7ff013200640 1 --2- 172.21.15.72:0/265056804 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fefec06c8f0 0x7fefec06edb0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:06.487 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:06.488+0000 7ff013200640 1 --2- 172.21.15.72:0/265056804 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff00c145b10 0x7ff00c159b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:06.487 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:06.488+0000 7ff013200640 1 --2- 172.21.15.72:0/265056804 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff00c0cff40 0x7ff00c1595f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:06.487 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:06.488+0000 7ff013200640 1 --2- 172.21.15.72:0/265056804 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff00c06dac0 0x7ff00c140d40 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:06.488 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:06.488+0000 7ff013200640 1 -- 172.21.15.72:0/265056804 >> 172.21.15.72:0/265056804 conn(0x7ff00c06b470 msgr2=0x7ff00c144cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:06.488 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:06.488+0000 7ff013200640 1 -- 172.21.15.72:0/265056804 shutdown_connections 2024-04-04T06:57:06.488 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:06.488+0000 7ff013200640 1 -- 172.21.15.72:0/265056804 wait complete. 2024-04-04T06:57:06.513 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-04T06:57:06.718 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:06.719+0000 7fb779e00640 1 Processor -- start 2024-04-04T06:57:06.719 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:06.720+0000 7fb779e00640 1 -- start start 2024-04-04T06:57:06.720 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:06.721+0000 7fb779e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb77415b000 0x7fb77406b470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:06.720 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:06.721+0000 7fb779e00640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb77415b3e0 0x7fb7740d02e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:06.720 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:06.721+0000 7fb779e00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fb7740d0820 0x7fb7740b46a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:06.720 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:06.721+0000 7fb779e00640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7fb7740b5340 con 0x7fb77415b3e0 2024-04-04T06:57:06.720 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:06.721+0000 7fb779e00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fb7740b5620 con 0x7fb7740d0820 2024-04-04T06:57:06.720 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:06.721+0000 7fb779e00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fb7740b5900 con 0x7fb77415b000 2024-04-04T06:57:06.721 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:06.722+0000 7fb76a000640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb77415b3e0 0x7fb7740d02e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:06.721 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:06.722+0000 7fb76a000640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb77415b3e0 0x7fb7740d02e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48854/0 (socket says 172.21.15.72:48854) 2024-04-04T06:57:06.721 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:06.722+0000 7fb76a000640 1 -- 172.21.15.72:0/1966981931 learned_addr learned my addr 172.21.15.72:0/1966981931 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:57:06.722 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:06.722+0000 7fb76a000640 1 -- 172.21.15.72:0/1966981931 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb77415b000 msgr2=0x7fb77406b470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:57:06.722 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:06.722+0000 7fb773400640 1 --2- 172.21.15.72:0/1966981931 >> v2:172.21.15.117:3300/0 conn(0x7fb7740d0820 0x7fb7740b46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:06.722 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:06.722+0000 7fb772a00640 1 --2- 172.21.15.72:0/1966981931 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb77415b000 0x7fb77406b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:06.722 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:06.722+0000 7fb76a000640 1 --2- 172.21.15.72:0/1966981931 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb77415b000 0x7fb77406b470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:06.722 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:06.722+0000 7fb76a000640 1 -- 172.21.15.72:0/1966981931 >> v2:172.21.15.117:3300/0 conn(0x7fb7740d0820 msgr2=0x7fb7740b46a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:57:06.722 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:06.722+0000 7fb76a000640 1 --2- 172.21.15.72:0/1966981931 >> v2:172.21.15.117:3300/0 conn(0x7fb7740d0820 0x7fb7740b46a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:06.722 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:06.722+0000 7fb76a000640 1 -- 172.21.15.72:0/1966981931 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7740cec80 con 0x7fb77415b3e0 2024-04-04T06:57:06.722 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:06.722+0000 7fb772a00640 1 --2- 172.21.15.72:0/1966981931 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb77415b000 0x7fb77406b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-04T06:57:06.722 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:06.723+0000 7fb76a000640 1 --2- 172.21.15.72:0/1966981931 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb77415b3e0 0x7fb7740d02e0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fb7740b5830 tx=0x7fb75c02da70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e5fac689ce3ad4a server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:06.723 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:06.724+0000 7fb772000640 1 -- 172.21.15.72:0/1966981931 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb75c02f830 con 0x7fb77415b3e0 2024-04-04T06:57:06.723 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:06.724+0000 7fb772000640 1 -- 172.21.15.72:0/1966981931 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb75c02f9d0 con 0x7fb77415b3e0 2024-04-04T06:57:06.723 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:06.724+0000 7fb772000640 1 -- 172.21.15.72:0/1966981931 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb75c02fda0 con 0x7fb77415b3e0 2024-04-04T06:57:06.723 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:06.724+0000 7fb779e00640 1 -- 172.21.15.72:0/1966981931 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb77415b3e0 msgr2=0x7fb7740d02e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:06.723 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:06.725+0000 7fb779e00640 1 --2- 172.21.15.72:0/1966981931 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb77415b3e0 0x7fb7740d02e0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fb7740b5830 tx=0x7fb75c02da70 comp rx=0 tx=0).stop 2024-04-04T06:57:06.724 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:06.725+0000 7fb779e00640 1 -- 172.21.15.72:0/1966981931 shutdown_connections 2024-04-04T06:57:06.724 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:06.725+0000 7fb779e00640 1 --2- 172.21.15.72:0/1966981931 >> v2:172.21.15.117:3300/0 conn(0x7fb7740d0820 0x7fb7740b46a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:06.724 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:06.725+0000 7fb779e00640 1 --2- 172.21.15.72:0/1966981931 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb77415b3e0 0x7fb7740d02e0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:06.724 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:06.725+0000 7fb779e00640 1 --2- 172.21.15.72:0/1966981931 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb77415b000 0x7fb77406b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:06.724 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:06.725+0000 7fb779e00640 1 -- 172.21.15.72:0/1966981931 >> 172.21.15.72:0/1966981931 conn(0x7fb77406e4c0 msgr2=0x7fb77406e8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:06.724 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:06.725+0000 7fb779e00640 1 -- 172.21.15.72:0/1966981931 shutdown_connections 2024-04-04T06:57:06.724 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:06.725+0000 7fb779e00640 1 -- 172.21.15.72:0/1966981931 wait complete. 2024-04-04T06:57:06.725 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:06.726+0000 7fb779e00640 1 Processor -- start 2024-04-04T06:57:06.725 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:06.727+0000 7fb779e00640 1 -- start start 2024-04-04T06:57:06.727 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:06.727+0000 7fb779e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb7740d0820 0x7fb77414cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:06.727 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:06.727+0000 7fb779e00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb77415b000 0x7fb77415dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:06.727 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:06.728+0000 7fb779e00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb77415b3e0 0x7fb7741e5370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:06.727 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:06.728+0000 7fb779e00640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fb7740b4d60 con 0x7fb77415b000 2024-04-04T06:57:06.727 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:06.728+0000 7fb779e00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fb7740b4be0 con 0x7fb77415b3e0 2024-04-04T06:57:06.727 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:06.728+0000 7fb779e00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fb7740b4ee0 con 0x7fb7740d0820 2024-04-04T06:57:06.727 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:06.728+0000 7fb76a000640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb77415b000 0x7fb77415dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:06.727 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:06.728+0000 7fb76a000640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb77415b000 0x7fb77415dbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48868/0 (socket says 172.21.15.72:48868) 2024-04-04T06:57:06.727 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:06.728+0000 7fb76a000640 1 -- 172.21.15.72:0/2606729409 learned_addr learned my addr 172.21.15.72:0/2606729409 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:57:06.727 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:06.728+0000 7fb76a000640 1 -- 172.21.15.72:0/2606729409 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb7740d0820 msgr2=0x7fb77414cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:06.727 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:06.728+0000 7fb76a000640 1 --2- 172.21.15.72:0/2606729409 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb7740d0820 0x7fb77414cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:06.727 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:06.728+0000 7fb76a000640 1 -- 172.21.15.72:0/2606729409 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb77415b3e0 msgr2=0x7fb7741e5370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:06.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:06.728+0000 7fb76a000640 1 --2- 172.21.15.72:0/2606729409 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb77415b3e0 0x7fb7741e5370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:06.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:06.728+0000 7fb76a000640 1 -- 172.21.15.72:0/2606729409 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb77415b880 con 0x7fb77415b000 2024-04-04T06:57:06.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:06.728+0000 7fb76a000640 1 --2- 172.21.15.72:0/2606729409 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb77415b000 0x7fb77415dbb0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fb75c009930 tx=0x7fb75c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:06.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:06.729+0000 7fb76be00640 1 -- 172.21.15.72:0/2606729409 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb75c047070 con 0x7fb77415b000 2024-04-04T06:57:06.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:06.729+0000 7fb76be00640 1 -- 172.21.15.72:0/2606729409 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb75c039750 con 0x7fb77415b000 2024-04-04T06:57:06.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:06.729+0000 7fb76be00640 1 -- 172.21.15.72:0/2606729409 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb75c039b20 con 0x7fb77415b000 2024-04-04T06:57:06.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:06.729+0000 7fb779e00640 1 -- 172.21.15.72:0/2606729409 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7741e4590 con 0x7fb77415b000 2024-04-04T06:57:06.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:06.729+0000 7fb779e00640 1 -- 172.21.15.72:0/2606729409 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7741e4b50 con 0x7fb77415b000 2024-04-04T06:57:06.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:06.730+0000 7fb779e00640 1 -- 172.21.15.72:0/2606729409 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb774075730 con 0x7fb77415b000 2024-04-04T06:57:06.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:06.731+0000 7fb76be00640 1 -- 172.21.15.72:0/2606729409 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb75c039cc0 con 0x7fb77415b000 2024-04-04T06:57:06.730 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:06.732+0000 7fb76be00640 1 --2- 172.21.15.72:0/2606729409 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fb75006c8f0 0x7fb75006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:06.730 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:06.732+0000 7fb76be00640 1 -- 172.21.15.72:0/2606729409 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fb75c0ad140 con 0x7fb77415b000 2024-04-04T06:57:06.731 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:06.732+0000 7fb772a00640 1 --2- 172.21.15.72:0/2606729409 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fb75006c8f0 0x7fb75006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:06.731 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:06.733+0000 7fb772a00640 1 --2- 172.21.15.72:0/2606729409 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fb75006c8f0 0x7fb75006edb0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fb764006fd0 tx=0x7fb764008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:06.735 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:06.737+0000 7fb76be00640 1 -- 172.21.15.72:0/2606729409 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fb75c07b600 con 0x7fb77415b000 2024-04-04T06:57:07.004 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:07.005+0000 7fb779e00640 1 -- 172.21.15.72:0/2606729409 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fb77406f2f0 con 0x7fb77415b000 2024-04-04T06:57:07.005 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:07.007+0000 7fb76be00640 1 -- 172.21.15.72:0/2606729409 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) ==== 104+0+11 (secure 0 0 0) 0x7fb75c07af00 con 0x7fb77415b000 2024-04-04T06:57:07.005 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2024-04-04T06:57:07.008 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:07.009+0000 7fb779e00640 1 -- 172.21.15.72:0/2606729409 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fb75006c8f0 msgr2=0x7fb75006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:07.009 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:07.010+0000 7fb779e00640 1 --2- 172.21.15.72:0/2606729409 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fb75006c8f0 0x7fb75006edb0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fb764006fd0 tx=0x7fb764008040 comp rx=0 tx=0).stop 2024-04-04T06:57:07.009 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:07.010+0000 7fb779e00640 1 -- 172.21.15.72:0/2606729409 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb77415b000 msgr2=0x7fb77415dbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:07.009 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:07.010+0000 7fb779e00640 1 --2- 172.21.15.72:0/2606729409 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb77415b000 0x7fb77415dbb0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fb75c009930 tx=0x7fb75c0046c0 comp rx=0 tx=0).stop 2024-04-04T06:57:07.009 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:07.010+0000 7fb779e00640 1 -- 172.21.15.72:0/2606729409 shutdown_connections 2024-04-04T06:57:07.009 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:07.010+0000 7fb779e00640 1 --2- 172.21.15.72:0/2606729409 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fb75006c8f0 0x7fb75006edb0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:07.009 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:07.010+0000 7fb779e00640 1 --2- 172.21.15.72:0/2606729409 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb77415b3e0 0x7fb7741e5370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:07.009 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:07.010+0000 7fb779e00640 1 --2- 172.21.15.72:0/2606729409 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb77415b000 0x7fb77415dbb0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:07.009 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:07.010+0000 7fb779e00640 1 --2- 172.21.15.72:0/2606729409 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb7740d0820 0x7fb77414cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:07.009 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:07.010+0000 7fb779e00640 1 -- 172.21.15.72:0/2606729409 >> 172.21.15.72:0/2606729409 conn(0x7fb77406e4c0 msgr2=0x7fb7740b0d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:07.009 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:07.010+0000 7fb779e00640 1 -- 172.21.15.72:0/2606729409 shutdown_connections 2024-04-04T06:57:07.009 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:07.010+0000 7fb779e00640 1 -- 172.21.15.72:0/2606729409 wait complete. 2024-04-04T06:57:07.027 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-04T06:57:07.226 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:07.227+0000 7f4c47c00640 1 Processor -- start 2024-04-04T06:57:07.226 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:07.227+0000 7f4c47c00640 1 -- start start 2024-04-04T06:57:07.227 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:07.229+0000 7f4c47c00640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f4c4015ea70 0x7f4c40067d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:07.227 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:07.229+0000 7f4c47c00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f4c400cd180 0x7f4c400cd5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:07.227 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:07.229+0000 7f4c47c00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c400cb4d0 con 0x7f4c400ce7a0 2024-04-04T06:57:07.227 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:07.229+0000 7f4c47c00640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f4c400cdb10 con 0x7f4c4015ea70 2024-04-04T06:57:07.228 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:07.229+0000 7f4c47c00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f4c40162040 con 0x7f4c400cd180 2024-04-04T06:57:07.228 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:07.229+0000 7f4c3fe00640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f4c4015ea70 0x7f4c40067d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:07.228 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:07.229+0000 7f4c3fe00640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f4c4015ea70 0x7f4c40067d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48878/0 (socket says 172.21.15.72:48878) 2024-04-04T06:57:07.229 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:07.229+0000 7f4c3fe00640 1 -- 172.21.15.72:0/4224250409 learned_addr learned my addr 172.21.15.72:0/4224250409 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:57:07.229 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:07.229+0000 7f4c45c00640 1 --2- 172.21.15.72:0/4224250409 >> v2:172.21.15.117:3300/0 conn(0x7f4c400cd180 0x7f4c400cd5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:07.229 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:07.230+0000 7f4c3fe00640 1 -- 172.21.15.72:0/4224250409 >> v2:172.21.15.117:3300/0 conn(0x7f4c400cd180 msgr2=0x7f4c400cd5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:57:07.229 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:07.230+0000 7f4c3fe00640 1 --2- 172.21.15.72:0/4224250409 >> v2:172.21.15.117:3300/0 conn(0x7f4c400cd180 0x7f4c400cd5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:07.229 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:07.230+0000 7f4c3fe00640 1 -- 172.21.15.72:0/4224250409 >> v1:172.21.15.117:6789/0 conn(0x7f4c400ce7a0 legacy=0x7f4c400cadc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:57:07.229 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:07.230+0000 7f4c3fe00640 1 -- 172.21.15.72:0/4224250409 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c4015f050 con 0x7f4c4015ea70 2024-04-04T06:57:07.229 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:07.231+0000 7f4c3fe00640 1 --2- 172.21.15.72:0/4224250409 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4c4015ea70 0x7f4c40067d20 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f4c400afcd0 tx=0x7f4c2c02b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4acd7043bfd65156 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:07.231 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:07.231+0000 7f4c3f400640 1 -- 172.21.15.72:0/4224250409 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c2c02e070 con 0x7f4c4015ea70 2024-04-04T06:57:07.231 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:07.231+0000 7f4c3f400640 1 -- 172.21.15.72:0/4224250409 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c2c037070 con 0x7f4c4015ea70 2024-04-04T06:57:07.231 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:07.231+0000 7f4c3f400640 1 -- 172.21.15.72:0/4224250409 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c2c031a00 con 0x7f4c4015ea70 2024-04-04T06:57:07.231 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:07.232+0000 7f4c47c00640 1 -- 172.21.15.72:0/4224250409 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4c4015ea70 msgr2=0x7f4c40067d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:07.231 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:07.232+0000 7f4c47c00640 1 --2- 172.21.15.72:0/4224250409 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4c4015ea70 0x7f4c40067d20 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f4c400afcd0 tx=0x7f4c2c02b880 comp rx=0 tx=0).stop 2024-04-04T06:57:07.231 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:07.232+0000 7f4c47c00640 1 -- 172.21.15.72:0/4224250409 shutdown_connections 2024-04-04T06:57:07.231 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:07.232+0000 7f4c47c00640 1 --2- 172.21.15.72:0/4224250409 >> v2:172.21.15.117:3300/0 conn(0x7f4c400cd180 0x7f4c400cd5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:07.231 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:07.232+0000 7f4c47c00640 1 --2- 172.21.15.72:0/4224250409 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4c4015ea70 0x7f4c40067d20 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:07.231 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:07.232+0000 7f4c47c00640 1 -- 172.21.15.72:0/4224250409 >> 172.21.15.72:0/4224250409 conn(0x7f4c4006b470 msgr2=0x7f4c4006b880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:07.232 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:07.232+0000 7f4c47c00640 1 -- 172.21.15.72:0/4224250409 shutdown_connections 2024-04-04T06:57:07.232 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:07.232+0000 7f4c47c00640 1 -- 172.21.15.72:0/4224250409 wait complete. 2024-04-04T06:57:07.232 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:07.234+0000 7f4c47c00640 1 Processor -- start 2024-04-04T06:57:07.232 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:07.234+0000 7f4c47c00640 1 -- start start 2024-04-04T06:57:07.235 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:07.235+0000 7f4c47c00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4c400cd180 0x7f4c400b5c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:07.236 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:07.235+0000 7f4c47c00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4c400ce7a0 0x7f4c400b43b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:07.236 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:07.235+0000 7f4c47c00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4c4015ea70 0x7f4c4006ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:07.236 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:07.235+0000 7f4c47c00640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f4c4015f8f0 con 0x7f4c400ce7a0 2024-04-04T06:57:07.236 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:07.235+0000 7f4c47c00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f4c4015f610 con 0x7f4c4015ea70 2024-04-04T06:57:07.236 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:07.235+0000 7f4c47c00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f4c400ceb80 con 0x7f4c400cd180 2024-04-04T06:57:07.236 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:07.235+0000 7f4c3fe00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4c400ce7a0 0x7f4c400b43b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:07.236 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:07.235+0000 7f4c3fe00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4c400ce7a0 0x7f4c400b43b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48894/0 (socket says 172.21.15.72:48894) 2024-04-04T06:57:07.236 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:07.235+0000 7f4c3fe00640 1 -- 172.21.15.72:0/28534363 learned_addr learned my addr 172.21.15.72:0/28534363 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:57:07.236 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:07.236+0000 7f4c45200640 1 --2- 172.21.15.72:0/28534363 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4c400cd180 0x7f4c400b5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:07.236 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:07.236+0000 7f4c45c00640 1 --2- 172.21.15.72:0/28534363 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4c4015ea70 0x7f4c4006ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:07.236 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:07.236+0000 7f4c3fe00640 1 -- 172.21.15.72:0/28534363 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4c400cd180 msgr2=0x7f4c400b5c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:07.236 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:07.236+0000 7f4c3fe00640 1 --2- 172.21.15.72:0/28534363 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4c400cd180 0x7f4c400b5c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:07.237 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:07.236+0000 7f4c3fe00640 1 -- 172.21.15.72:0/28534363 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4c4015ea70 msgr2=0x7f4c4006ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:07.237 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:07.236+0000 7f4c3fe00640 1 --2- 172.21.15.72:0/28534363 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4c4015ea70 0x7f4c4006ed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:07.237 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:07.236+0000 7f4c3fe00640 1 -- 172.21.15.72:0/28534363 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c400c55e0 con 0x7f4c400ce7a0 2024-04-04T06:57:07.237 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:07.236+0000 7f4c3fe00640 1 --2- 172.21.15.72:0/28534363 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4c400ce7a0 0x7f4c400b43b0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f4c2c02b8c0 tx=0x7f4c2c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:07.237 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:07.237+0000 7f4c3cc00640 1 -- 172.21.15.72:0/28534363 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c2c031ed0 con 0x7f4c400ce7a0 2024-04-04T06:57:07.237 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:07.237+0000 7f4c3cc00640 1 -- 172.21.15.72:0/28534363 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c2c0328a0 con 0x7f4c400ce7a0 2024-04-04T06:57:07.237 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:07.237+0000 7f4c47c00640 1 -- 172.21.15.72:0/28534363 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c400c4320 con 0x7f4c400ce7a0 2024-04-04T06:57:07.237 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:07.237+0000 7f4c3cc00640 1 -- 172.21.15.72:0/28534363 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c2c032c90 con 0x7f4c400ce7a0 2024-04-04T06:57:07.237 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:07.237+0000 7f4c47c00640 1 -- 172.21.15.72:0/28534363 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c400c4bc0 con 0x7f4c400ce7a0 2024-04-04T06:57:07.238 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:07.238+0000 7f4c47c00640 1 -- 172.21.15.72:0/28534363 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c400685a0 con 0x7f4c400ce7a0 2024-04-04T06:57:07.238 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:07.239+0000 7f4c3cc00640 1 -- 172.21.15.72:0/28534363 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4c2c04c060 con 0x7f4c400ce7a0 2024-04-04T06:57:07.238 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:07.240+0000 7f4c3cc00640 1 --2- 172.21.15.72:0/28534363 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f4c2006c8f0 0x7f4c2006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:07.238 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:07.240+0000 7f4c3cc00640 1 -- 172.21.15.72:0/28534363 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f4c2c0ad400 con 0x7f4c400ce7a0 2024-04-04T06:57:07.239 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:07.240+0000 7f4c45200640 1 --2- 172.21.15.72:0/28534363 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f4c2006c8f0 0x7f4c2006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:07.239 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:07.241+0000 7f4c45200640 1 --2- 172.21.15.72:0/28534363 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f4c2006c8f0 0x7f4c2006edb0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f4c34006fd0 tx=0x7f4c34008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:07.242 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:07.244+0000 7f4c3cc00640 1 -- 172.21.15.72:0/28534363 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f4c2c040070 con 0x7f4c400ce7a0 2024-04-04T06:57:07.443 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:07.445+0000 7f4c47c00640 1 -- 172.21.15.72:0/28534363 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f4c400d0840 con 0x7f4c400ce7a0 2024-04-04T06:57:07.444 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:07.446+0000 7f4c3cc00640 1 -- 172.21.15.72:0/28534363 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) ==== 100+0+11 (secure 0 0 0) 0x7f4c2c07b820 con 0x7f4c400ce7a0 2024-04-04T06:57:07.444 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 64 2024-04-04T06:57:07.447 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:07.448+0000 7f4c47c00640 1 -- 172.21.15.72:0/28534363 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f4c2006c8f0 msgr2=0x7f4c2006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:07.447 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:07.448+0000 7f4c47c00640 1 --2- 172.21.15.72:0/28534363 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f4c2006c8f0 0x7f4c2006edb0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f4c34006fd0 tx=0x7f4c34008040 comp rx=0 tx=0).stop 2024-04-04T06:57:07.447 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:07.448+0000 7f4c47c00640 1 -- 172.21.15.72:0/28534363 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4c400ce7a0 msgr2=0x7f4c400b43b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:07.447 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:07.448+0000 7f4c47c00640 1 --2- 172.21.15.72:0/28534363 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4c400ce7a0 0x7f4c400b43b0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f4c2c02b8c0 tx=0x7f4c2c0046c0 comp rx=0 tx=0).stop 2024-04-04T06:57:07.447 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:07.448+0000 7f4c47c00640 1 -- 172.21.15.72:0/28534363 shutdown_connections 2024-04-04T06:57:07.447 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:07.448+0000 7f4c47c00640 1 --2- 172.21.15.72:0/28534363 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f4c2006c8f0 0x7f4c2006edb0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:07.447 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:07.448+0000 7f4c47c00640 1 --2- 172.21.15.72:0/28534363 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4c4015ea70 0x7f4c4006ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:07.447 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:07.448+0000 7f4c47c00640 1 --2- 172.21.15.72:0/28534363 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4c400ce7a0 0x7f4c400b43b0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:07.448 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:07.448+0000 7f4c47c00640 1 --2- 172.21.15.72:0/28534363 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4c400cd180 0x7f4c400b5c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:07.448 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:07.448+0000 7f4c47c00640 1 -- 172.21.15.72:0/28534363 >> 172.21.15.72:0/28534363 conn(0x7f4c4006b470 msgr2=0x7f4c4006dc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:07.448 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:07.449+0000 7f4c47c00640 1 -- 172.21.15.72:0/28534363 shutdown_connections 2024-04-04T06:57:07.448 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:07.449+0000 7f4c47c00640 1 -- 172.21.15.72:0/28534363 wait complete. 2024-04-04T06:57:07.470 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-04T06:57:07.669 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:07.670+0000 7f1db1a00640 1 Processor -- start 2024-04-04T06:57:07.669 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:07.670+0000 7f1db1a00640 1 -- start start 2024-04-04T06:57:07.670 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:07.671+0000 7f1db1a00640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f1dac15c2d0 0x7f1dac071610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:07.671 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:07.671+0000 7f1db1a00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1dac15c6b0 0x7f1dac0c5e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:07.671 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:07.672+0000 7f1db1a00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f1dac0ccb20 0x7f1dac0ccfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:07.671 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:07.672+0000 7f1db1a00640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f1dac0c6fb0 con 0x7f1dac15c2d0 2024-04-04T06:57:07.671 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:07.672+0000 7f1db1a00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f1dac0c6710 con 0x7f1dac0ccb20 2024-04-04T06:57:07.671 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:07.672+0000 7f1db1a00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f1dac0c69f0 con 0x7f1dac15c6b0 2024-04-04T06:57:07.671 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:07.672+0000 7f1daaa00640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f1dac15c2d0 0x7f1dac071610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:07.671 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:07.672+0000 7f1daaa00640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f1dac15c2d0 0x7f1dac071610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48898/0 (socket says 172.21.15.72:48898) 2024-04-04T06:57:07.671 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:07.672+0000 7f1daaa00640 1 -- 172.21.15.72:0/2120849438 learned_addr learned my addr 172.21.15.72:0/2120849438 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:57:07.671 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:07.672+0000 7f1dab400640 1 --2- 172.21.15.72:0/2120849438 >> v2:172.21.15.117:3300/0 conn(0x7f1dac0ccb20 0x7f1dac0ccfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:07.671 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:07.672+0000 7f1daa000640 1 --2- 172.21.15.72:0/2120849438 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1dac15c6b0 0x7f1dac0c5e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:07.672 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:07.673+0000 7f1daaa00640 1 -- 172.21.15.72:0/2120849438 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1dac15c6b0 msgr2=0x7f1dac0c5e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:57:07.672 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:07.673+0000 7f1daaa00640 1 --2- 172.21.15.72:0/2120849438 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1dac15c6b0 0x7f1dac0c5e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:07.672 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:07.673+0000 7f1daaa00640 1 -- 172.21.15.72:0/2120849438 >> v2:172.21.15.117:3300/0 conn(0x7f1dac0ccb20 msgr2=0x7f1dac0ccfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:57:07.672 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:07.673+0000 7f1daaa00640 1 --2- 172.21.15.72:0/2120849438 >> v2:172.21.15.117:3300/0 conn(0x7f1dac0ccb20 0x7f1dac0ccfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:07.672 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:07.673+0000 7f1daaa00640 1 -- 172.21.15.72:0/2120849438 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1dac0c6cd0 con 0x7f1dac15c2d0 2024-04-04T06:57:07.673 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:07.674+0000 7f1daaa00640 1 --2- 172.21.15.72:0/2120849438 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1dac15c2d0 0x7f1dac071610 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f1dac0d10e0 tx=0x7f1d9c02b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e4d2c27dfe8f4f3 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:07.673 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:07.675+0000 7f1da9600640 1 -- 172.21.15.72:0/2120849438 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d9c02e070 con 0x7f1dac15c2d0 2024-04-04T06:57:07.673 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:07.675+0000 7f1da9600640 1 -- 172.21.15.72:0/2120849438 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d9c037070 con 0x7f1dac15c2d0 2024-04-04T06:57:07.673 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:07.675+0000 7f1da9600640 1 -- 172.21.15.72:0/2120849438 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d9c031a00 con 0x7f1dac15c2d0 2024-04-04T06:57:07.674 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:07.675+0000 7f1db1a00640 1 -- 172.21.15.72:0/2120849438 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1dac15c2d0 msgr2=0x7f1dac071610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:07.674 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:07.675+0000 7f1db1a00640 1 --2- 172.21.15.72:0/2120849438 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1dac15c2d0 0x7f1dac071610 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f1dac0d10e0 tx=0x7f1d9c02b880 comp rx=0 tx=0).stop 2024-04-04T06:57:07.675 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:07.676+0000 7f1db1a00640 1 -- 172.21.15.72:0/2120849438 shutdown_connections 2024-04-04T06:57:07.675 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:07.676+0000 7f1db1a00640 1 --2- 172.21.15.72:0/2120849438 >> v2:172.21.15.117:3300/0 conn(0x7f1dac0ccb20 0x7f1dac0ccfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:07.675 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:07.676+0000 7f1db1a00640 1 --2- 172.21.15.72:0/2120849438 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1dac15c6b0 0x7f1dac0c5e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:07.675 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:07.676+0000 7f1db1a00640 1 --2- 172.21.15.72:0/2120849438 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1dac15c2d0 0x7f1dac071610 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:07.675 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:07.676+0000 7f1db1a00640 1 -- 172.21.15.72:0/2120849438 >> 172.21.15.72:0/2120849438 conn(0x7f1dac06b470 msgr2=0x7f1dac06b880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:07.675 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:07.676+0000 7f1db1a00640 1 -- 172.21.15.72:0/2120849438 shutdown_connections 2024-04-04T06:57:07.675 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:07.676+0000 7f1db1a00640 1 -- 172.21.15.72:0/2120849438 wait complete. 2024-04-04T06:57:07.676 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:07.678+0000 7f1db1a00640 1 Processor -- start 2024-04-04T06:57:07.676 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:07.678+0000 7f1db1a00640 1 -- start start 2024-04-04T06:57:07.678 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:07.679+0000 7f1db1a00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1dac0ccb20 0x7f1dac1f00c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:07.678 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:07.679+0000 7f1db1a00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1dac15c2d0 0x7f1dac1532f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:07.678 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:07.679+0000 7f1db1a00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1dac15c6b0 0x7f1dac071c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:07.678 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:07.679+0000 7f1db1a00640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f1dac0b3ea0 con 0x7f1dac15c2d0 2024-04-04T06:57:07.679 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:07.679+0000 7f1db1a00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f1dac0c6390 con 0x7f1dac0ccb20 2024-04-04T06:57:07.679 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:07.679+0000 7f1db1a00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f1dac0b4020 con 0x7f1dac15c6b0 2024-04-04T06:57:07.679 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:07.679+0000 7f1daa000640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1dac15c2d0 0x7f1dac1532f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:07.679 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:07.679+0000 7f1daa000640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1dac15c2d0 0x7f1dac1532f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48900/0 (socket says 172.21.15.72:48900) 2024-04-04T06:57:07.679 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:07.679+0000 7f1daa000640 1 -- 172.21.15.72:0/3517380419 learned_addr learned my addr 172.21.15.72:0/3517380419 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:57:07.679 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:07.679+0000 7f1daaa00640 1 --2- 172.21.15.72:0/3517380419 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1dac0ccb20 0x7f1dac1f00c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:07.679 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:07.680+0000 7f1dab400640 1 --2- 172.21.15.72:0/3517380419 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1dac15c6b0 0x7f1dac071c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:07.679 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:07.680+0000 7f1daa000640 1 -- 172.21.15.72:0/3517380419 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1dac15c6b0 msgr2=0x7f1dac071c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:07.679 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:07.680+0000 7f1daa000640 1 --2- 172.21.15.72:0/3517380419 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1dac15c6b0 0x7f1dac071c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:07.679 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:07.680+0000 7f1daa000640 1 -- 172.21.15.72:0/3517380419 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1dac0ccb20 msgr2=0x7f1dac1f00c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:07.679 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:07.680+0000 7f1daa000640 1 --2- 172.21.15.72:0/3517380419 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1dac0ccb20 0x7f1dac1f00c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:07.679 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:07.680+0000 7f1daa000640 1 -- 172.21.15.72:0/3517380419 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1dac153b40 con 0x7f1dac15c2d0 2024-04-04T06:57:07.680 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:07.680+0000 7f1daa000640 1 --2- 172.21.15.72:0/3517380419 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1dac15c2d0 0x7f1dac1532f0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f1d9800d5f0 tx=0x7f1d9800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:07.680 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:07.680+0000 7f1da2a00640 1 -- 172.21.15.72:0/3517380419 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d980125f0 con 0x7f1dac15c2d0 2024-04-04T06:57:07.681 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:07.680+0000 7f1da2a00640 1 -- 172.21.15.72:0/3517380419 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d98019070 con 0x7f1dac15c2d0 2024-04-04T06:57:07.681 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:07.680+0000 7f1da2a00640 1 -- 172.21.15.72:0/3517380419 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d980129d0 con 0x7f1dac15c2d0 2024-04-04T06:57:07.681 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:07.680+0000 7f1db1a00640 1 -- 172.21.15.72:0/3517380419 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1dac153e20 con 0x7f1dac15c2d0 2024-04-04T06:57:07.681 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:07.681+0000 7f1db1a00640 1 -- 172.21.15.72:0/3517380419 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1dac0cf3c0 con 0x7f1dac15c2d0 2024-04-04T06:57:07.681 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:07.682+0000 7f1db1a00640 1 -- 172.21.15.72:0/3517380419 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1dac0cea80 con 0x7f1dac15c2d0 2024-04-04T06:57:07.681 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:07.683+0000 7f1da2a00640 1 -- 172.21.15.72:0/3517380419 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1d98012b70 con 0x7f1dac15c2d0 2024-04-04T06:57:07.682 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:07.684+0000 7f1da2a00640 1 --2- 172.21.15.72:0/3517380419 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f1d8c06c8f0 0x7f1d8c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:07.682 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:07.684+0000 7f1da2a00640 1 -- 172.21.15.72:0/3517380419 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f1d9808bfb0 con 0x7f1dac15c2d0 2024-04-04T06:57:07.682 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:07.684+0000 7f1daaa00640 1 --2- 172.21.15.72:0/3517380419 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f1d8c06c8f0 0x7f1d8c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:07.683 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:07.685+0000 7f1daaa00640 1 --2- 172.21.15.72:0/3517380419 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f1d8c06c8f0 0x7f1d8c06edb0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f1d9c036000 tx=0x7f1d9c03d040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:07.686 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:07.688+0000 7f1da2a00640 1 -- 172.21.15.72:0/3517380419 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f1dac0cea80 con 0x7f1dac15c2d0 2024-04-04T06:57:07.887 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:07.889+0000 7f1db1a00640 1 -- 172.21.15.72:0/3517380419 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1dac075840 con 0x7f1dac15c2d0 2024-04-04T06:57:07.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:07.890+0000 7f1da2a00640 1 -- 172.21.15.72:0/3517380419 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16581 (secure 0 0 0) 0x7f1d9805a3d0 con 0x7f1dac15c2d0 2024-04-04T06:57:07.889 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T06:57:07.889 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":20,"fsid":"6708bac2-4f50-49b5-87a9-c390fd333eb3","created":"2024-04-04T06:56:04.282498+0000","modified":"2024-04-04T06:56:30.007371+0000","last_up_change":"2024-04-04T06:56:16.716089+0000","last_in_change":"2024-04-04T06:56:07.768593+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-04T06:56:17.421685+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-04T06:56:26.822661+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-04T06:56:27.429816+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7c345991-5af8-4dc6-a481-28610c40e128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":3889813953},{"type":"v1","addr":"172.21.15.72:6818","nonce":3889813953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":3889813953},{"type":"v1","addr":"172.21.15.72:6821","nonce":3889813953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":3889813953},{"type":"v1","addr":"172.21.15.72:6826","nonce":3889813953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":3889813953},{"type":"v1","addr":"172.21.15.72:6823","nonce":3889813953}]},"public_addr":"172.21.15.72:6818/3889813953","cluster_addr":"172.21.15.72:6821/3889813953","heartbeat_back_addr":"172.21.15.72:6826/3889813953","heartbeat_front_addr":"172.21.15.72:6823/3889813953","state":["exists","up"]},{"osd":1,"uuid":"1b3f7ab2-a56c-488d-a89a-1f3572361c95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":3101663154},{"type":"v1","addr":"172.21.15.72:6801","nonce":3101663154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":3101663154},{"type":"v1","addr":"172.21.15.72:6803","nonce":3101663154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":3101663154},{"type":"v1","addr":"172.21.15.72:6807","nonce":3101663154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":3101663154},{"type":"v1","addr":"172.21.15.72:6805","nonce":3101663154}]},"public_addr":"172.21.15.72:6801/3101663154","cluster_addr":"172.21.15.72:6803/3101663154","heartbeat_back_addr":"172.21.15.72:6807/3101663154","heartbeat_front_addr":"172.21.15.72:6805/3101663154","state":["exists","up"]},{"osd":2,"uuid":"fc9aa512-53df-40d7-ba04-3e6b7dcd1e34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":235374192},{"type":"v1","addr":"172.21.15.72:6809","nonce":235374192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":235374192},{"type":"v1","addr":"172.21.15.72:6811","nonce":235374192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":235374192},{"type":"v1","addr":"172.21.15.72:6815","nonce":235374192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":235374192},{"type":"v1","addr":"172.21.15.72:6813","nonce":235374192}]},"public_addr":"172.21.15.72:6809/235374192","cluster_addr":"172.21.15.72:6811/235374192","heartbeat_back_addr":"172.21.15.72:6815/235374192","heartbeat_front_addr":"172.21.15.72:6813/235374192","state":["exists","up"]},{"osd":3,"uuid":"b4f63eed-dc5b-4aba-bb50-de46eb41492b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6817","nonce":2806631742},{"type":"v1","addr":"172.21.15.72:6819","nonce":2806631742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":2806631742},{"type":"v1","addr":"172.21.15.72:6827","nonce":2806631742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":2806631742},{"type":"v1","addr":"172.21.15.72:6831","nonce":2806631742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":2806631742},{"type":"v1","addr":"172.21.15.72:6829","nonce":2806631742}]},"public_addr":"172.21.15.72:6819/2806631742","cluster_addr":"172.21.15.72:6827/2806631742","heartbeat_back_addr":"172.21.15.72:6831/2806631742","heartbeat_front_addr":"172.21.15.72:6829/2806631742","state":["exists","up"]},{"osd":4,"uuid":"9e985ef8-d711-4172-9286-c54e560895d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":4293536423},{"type":"v1","addr":"172.21.15.117:6825","nonce":4293536423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":4293536423},{"type":"v1","addr":"172.21.15.117:6827","nonce":4293536423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":4293536423},{"type":"v1","addr":"172.21.15.117:6831","nonce":4293536423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":4293536423},{"type":"v1","addr":"172.21.15.117:6829","nonce":4293536423}]},"public_addr":"172.21.15.117:6825/4293536423","cluster_addr":"172.21.15.117:6827/4293536423","heartbeat_back_addr":"172.21.15.117:6831/4293536423","heartbeat_front_addr":"172.21.15.117:6829/4293536423","state":["exists","up"]},{"osd":5,"uuid":"3e9f082b-8d7d-455f-8a96-66d0b4857125","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":684971679},{"type":"v1","addr":"172.21.15.117:6801","nonce":684971679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":684971679},{"type":"v1","addr":"172.21.15.117:6803","nonce":684971679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":684971679},{"type":"v1","addr":"172.21.15.117:6807","nonce":684971679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":684971679},{"type":"v1","addr":"172.21.15.117:6805","nonce":684971679}]},"public_addr":"172.21.15.117:6801/684971679","cluster_addr":"172.21.15.117:6803/684971679","heartbeat_back_addr":"172.21.15.117:6807/684971679","heartbeat_front_addr":"172.21.15.117:6805/684971679","state":["exists","up"]},{"osd":6,"uuid":"bcdafa9f-a870-4398-a38d-ab7697676473","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":2781186528},{"type":"v1","addr":"172.21.15.117:6809","nonce":2781186528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":2781186528},{"type":"v1","addr":"172.21.15.117:6811","nonce":2781186528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":2781186528},{"type":"v1","addr":"172.21.15.117:6815","nonce":2781186528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":2781186528},{"type":"v1","addr":"172.21.15.117:6813","nonce":2781186528}]},"public_addr":"172.21.15.117:6809/2781186528","cluster_addr":"172.21.15.117:6811/2781186528","heartbeat_back_addr":"172.21.15.117:6815/2781186528","heartbeat_front_addr":"172.21.15.117:6813/2781186528","state":["exists","up"]},{"osd":7,"uuid":"b68ec562-ff35-4d2d-a733-c896f8920cfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":617469882},{"type":"v1","addr":"172.21.15.117:6817","nonce":617469882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":617469882},{"type":"v1","addr":"172.21.15.117:6819","nonce":617469882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":617469882},{"type":"v1","addr":"172.21.15.117:6823","nonce":617469882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":617469882},{"type":"v1","addr":"172.21.15.117:6821","nonce":617469882}]},"public_addr":"172.21.15.117:6817/617469882","cluster_addr":"172.21.15.117:6819/617469882","heartbeat_back_addr":"172.21.15.117:6823/617469882","heartbeat_front_addr":"172.21.15.117:6821/617469882","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.347700+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.296619+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.361345+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.093323+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:12.857605+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:12.816090+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.083163+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.121639+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-04T06:57:07.892 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:07.893+0000 7f1db1a00640 1 -- 172.21.15.72:0/3517380419 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f1d8c06c8f0 msgr2=0x7f1d8c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:07.892 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:07.893+0000 7f1db1a00640 1 --2- 172.21.15.72:0/3517380419 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f1d8c06c8f0 0x7f1d8c06edb0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f1d9c036000 tx=0x7f1d9c03d040 comp rx=0 tx=0).stop 2024-04-04T06:57:07.892 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:07.893+0000 7f1db1a00640 1 -- 172.21.15.72:0/3517380419 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1dac15c2d0 msgr2=0x7f1dac1532f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:07.892 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:07.893+0000 7f1db1a00640 1 --2- 172.21.15.72:0/3517380419 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1dac15c2d0 0x7f1dac1532f0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f1d9800d5f0 tx=0x7f1d9800dab0 comp rx=0 tx=0).stop 2024-04-04T06:57:07.892 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:07.893+0000 7f1db1a00640 1 -- 172.21.15.72:0/3517380419 shutdown_connections 2024-04-04T06:57:07.892 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:07.893+0000 7f1db1a00640 1 --2- 172.21.15.72:0/3517380419 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f1d8c06c8f0 0x7f1d8c06edb0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:07.892 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:07.893+0000 7f1db1a00640 1 --2- 172.21.15.72:0/3517380419 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1dac15c6b0 0x7f1dac071c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:07.892 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:07.893+0000 7f1db1a00640 1 --2- 172.21.15.72:0/3517380419 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1dac15c2d0 0x7f1dac1532f0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:07.892 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:07.893+0000 7f1db1a00640 1 --2- 172.21.15.72:0/3517380419 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1dac0ccb20 0x7f1dac1f00c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:07.893 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:07.893+0000 7f1db1a00640 1 -- 172.21.15.72:0/3517380419 >> 172.21.15.72:0/3517380419 conn(0x7f1dac06b470 msgr2=0x7f1dac15cd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:07.893 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:07.893+0000 7f1db1a00640 1 -- 172.21.15.72:0/3517380419 shutdown_connections 2024-04-04T06:57:07.893 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:07.893+0000 7f1db1a00640 1 -- 172.21.15.72:0/3517380419 wait complete. 2024-04-04T06:57:07.913 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-04T06:56:17.421685+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-04T06:56:26.822661+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-04T06:56:27.429816+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-04T06:57:07.913 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-04T06:57:08.119 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:08.120+0000 7f36ef000640 1 Processor -- start 2024-04-04T06:57:08.119 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:08.120+0000 7f36ef000640 1 -- start start 2024-04-04T06:57:08.121 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:08.122+0000 7f36ef000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f36e815e600 0x7f36e80d2470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:08.121 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:08.122+0000 7f36ef000640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f36e80d19c0 0x7f36e80b74b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:08.121 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:08.122+0000 7f36ef000640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36e80d2ea0 con 0x7f36e80d29b0 2024-04-04T06:57:08.121 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:08.122+0000 7f36ef000640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f36e80d3180 con 0x7f36e80d19c0 2024-04-04T06:57:08.121 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:08.122+0000 7f36ef000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f36e80d3460 con 0x7f36e815e600 2024-04-04T06:57:08.121 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:08.122+0000 7f36ed000640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f36e80d19c0 0x7f36e80b74b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:08.121 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:08.122+0000 7f36df400640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f36e80d29b0 0x7f36e80d12b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:37894/0 (socket says 172.21.15.72:37894) 2024-04-04T06:57:08.121 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:08.122+0000 7f36df400640 1 -- 172.21.15.72:0/3687546063 learned_addr learned my addr 172.21.15.72:0/3687546063 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-04-04T06:57:08.122 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:08.123+0000 7f36e7e00640 1 --2- 172.21.15.72:0/3687546063 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f36e815e600 0x7f36e80d2470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:08.122 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:08.123+0000 7f36ed000640 1 -- 172.21.15.72:0/3687546063 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f36e815e600 msgr2=0x7f36e80d2470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:57:08.122 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:08.123+0000 7f36ed000640 1 --2- 172.21.15.72:0/3687546063 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f36e815e600 0x7f36e80d2470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:08.122 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:08.123+0000 7f36ed000640 1 -- 172.21.15.72:0/3687546063 >> v1:172.21.15.72:6789/0 conn(0x7f36e80d29b0 legacy=0x7f36e80d12b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:08.122 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:08.123+0000 7f36ed000640 1 -- 172.21.15.72:0/3687546063 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36e80d3740 con 0x7f36e80d19c0 2024-04-04T06:57:08.122 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:08.123+0000 7f36e7400640 1 -- 172.21.15.72:0/3687546063 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3387343724 0 0) 0x7f36e80d2ea0 con 0x7f36e80d29b0 2024-04-04T06:57:08.124 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:08.124+0000 7f36ed000640 1 --2- 172.21.15.72:0/3687546063 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f36e80d19c0 0x7f36e80b74b0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f36e0009d90 tx=0x7f36e002bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=daff9c139ac4cae9 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:08.124 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:08.124+0000 7f36e7400640 1 -- 172.21.15.72:0/3687546063 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36e0039070 con 0x7f36e80d19c0 2024-04-04T06:57:08.124 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:08.124+0000 7f36e7400640 1 -- 172.21.15.72:0/3687546063 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36e002cc50 con 0x7f36e80d19c0 2024-04-04T06:57:08.124 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:08.124+0000 7f36e7400640 1 -- 172.21.15.72:0/3687546063 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36e0034440 con 0x7f36e80d19c0 2024-04-04T06:57:08.124 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:08.125+0000 7f36ef000640 1 -- 172.21.15.72:0/3687546063 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f36e80d19c0 msgr2=0x7f36e80b74b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:08.124 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:08.125+0000 7f36ef000640 1 --2- 172.21.15.72:0/3687546063 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f36e80d19c0 0x7f36e80b74b0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f36e0009d90 tx=0x7f36e002bea0 comp rx=0 tx=0).stop 2024-04-04T06:57:08.124 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:08.125+0000 7f36ef000640 1 -- 172.21.15.72:0/3687546063 shutdown_connections 2024-04-04T06:57:08.124 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:08.125+0000 7f36ef000640 1 --2- 172.21.15.72:0/3687546063 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f36e80d19c0 0x7f36e80b74b0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:08.124 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:08.125+0000 7f36ef000640 1 --2- 172.21.15.72:0/3687546063 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f36e815e600 0x7f36e80d2470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:08.124 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:08.125+0000 7f36ef000640 1 -- 172.21.15.72:0/3687546063 >> 172.21.15.72:0/3687546063 conn(0x7f36e8071eb0 msgr2=0x7f36e80722c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:08.124 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:08.125+0000 7f36ef000640 1 -- 172.21.15.72:0/3687546063 shutdown_connections 2024-04-04T06:57:08.124 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:08.125+0000 7f36ef000640 1 -- 172.21.15.72:0/3687546063 wait complete. 2024-04-04T06:57:08.125 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:08.127+0000 7f36ef000640 1 Processor -- start 2024-04-04T06:57:08.125 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:08.127+0000 7f36ef000640 1 -- start start 2024-04-04T06:57:08.127 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:08.128+0000 7f36ef000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f36e80d19c0 0x7f36e815c580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:08.127 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:08.128+0000 7f36ef000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f36e80d29b0 0x7f36e80c8e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:08.127 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:08.128+0000 7f36ef000640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f36e815e600 0x7f36e8160230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:08.127 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:08.128+0000 7f36ef000640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f36e80b9e60 con 0x7f36e815e600 2024-04-04T06:57:08.127 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:08.128+0000 7f36ef000640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f36e80d3f40 con 0x7f36e80d19c0 2024-04-04T06:57:08.128 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:08.128+0000 7f36ef000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f36e80b9fe0 con 0x7f36e80d29b0 2024-04-04T06:57:08.128 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:08.128+0000 7f36ed000640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f36e815e600 0x7f36e8160230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:08.128 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:08.128+0000 7f36ed000640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f36e815e600 0x7f36e8160230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48914/0 (socket says 172.21.15.72:48914) 2024-04-04T06:57:08.128 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:08.128+0000 7f36ed000640 1 -- 172.21.15.72:0/464563442 learned_addr learned my addr 172.21.15.72:0/464563442 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:57:08.128 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:08.128+0000 7f36e7e00640 1 --2- 172.21.15.72:0/464563442 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f36e80d19c0 0x7f36e815c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:08.128 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:08.128+0000 7f36df400640 1 --2- 172.21.15.72:0/464563442 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f36e80d29b0 0x7f36e80c8e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:08.128 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:08.129+0000 7f36ed000640 1 -- 172.21.15.72:0/464563442 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f36e80d29b0 msgr2=0x7f36e80c8e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:08.128 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:08.129+0000 7f36ed000640 1 --2- 172.21.15.72:0/464563442 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f36e80d29b0 0x7f36e80c8e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:08.128 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:08.129+0000 7f36ed000640 1 -- 172.21.15.72:0/464563442 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f36e80d19c0 msgr2=0x7f36e815c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:08.128 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:08.129+0000 7f36ed000640 1 --2- 172.21.15.72:0/464563442 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f36e80d19c0 0x7f36e815c580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:08.128 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:08.129+0000 7f36ed000640 1 -- 172.21.15.72:0/464563442 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36e81f88a0 con 0x7f36e815e600 2024-04-04T06:57:08.128 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:08.129+0000 7f36df400640 1 --2- 172.21.15.72:0/464563442 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f36e80d29b0 0x7f36e80c8e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-04T06:57:08.128 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:08.129+0000 7f36ed000640 1 --2- 172.21.15.72:0/464563442 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f36e815e600 0x7f36e8160230 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f36e0009d90 tx=0x7f36e0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:08.129 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:08.129+0000 7f36e4c00640 1 -- 172.21.15.72:0/464563442 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36e0039050 con 0x7f36e815e600 2024-04-04T06:57:08.129 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:08.129+0000 7f36e4c00640 1 -- 172.21.15.72:0/464563442 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36e003a040 con 0x7f36e815e600 2024-04-04T06:57:08.129 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:08.129+0000 7f36ef000640 1 -- 172.21.15.72:0/464563442 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36e81f8b10 con 0x7f36e815e600 2024-04-04T06:57:08.130 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:08.129+0000 7f36e4c00640 1 -- 172.21.15.72:0/464563442 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36e002ca50 con 0x7f36e815e600 2024-04-04T06:57:08.130 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:08.129+0000 7f36ef000640 1 -- 172.21.15.72:0/464563442 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36e8155950 con 0x7f36e815e600 2024-04-04T06:57:08.130 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:08.131+0000 7f36ef000640 1 -- 172.21.15.72:0/464563442 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f36e8075730 con 0x7f36e815e600 2024-04-04T06:57:08.130 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:08.131+0000 7f36e4c00640 1 -- 172.21.15.72:0/464563442 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f36e0047030 con 0x7f36e815e600 2024-04-04T06:57:08.131 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:08.132+0000 7f36e4c00640 1 --2- 172.21.15.72:0/464563442 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f36c406c8f0 0x7f36c406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:08.131 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:08.132+0000 7f36e4c00640 1 -- 172.21.15.72:0/464563442 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f36e00ada10 con 0x7f36e815e600 2024-04-04T06:57:08.131 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:08.133+0000 7f36e7e00640 1 --2- 172.21.15.72:0/464563442 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f36c406c8f0 0x7f36c406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:08.132 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:08.133+0000 7f36e7e00640 1 --2- 172.21.15.72:0/464563442 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f36c406c8f0 0x7f36c406edb0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f36d0006fd0 tx=0x7f36d0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:08.137 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:08.139+0000 7f36e4c00640 1 -- 172.21.15.72:0/464563442 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f36e0032e20 con 0x7f36e815e600 2024-04-04T06:57:08.405 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:08.407+0000 7f36ef000640 1 -- 172.21.15.72:0/464563442 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f36e815c360 con 0x7f36e815e600 2024-04-04T06:57:08.406 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:08.407+0000 7f36e4c00640 1 -- 172.21.15.72:0/464563442 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) ==== 93+0+10 (secure 0 0 0) 0x7f36e007be40 con 0x7f36e815e600 2024-04-04T06:57:08.406 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 1 2024-04-04T06:57:08.408 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:08.410+0000 7f36ef000640 1 -- 172.21.15.72:0/464563442 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f36c406c8f0 msgr2=0x7f36c406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:08.409 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:08.410+0000 7f36ef000640 1 --2- 172.21.15.72:0/464563442 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f36c406c8f0 0x7f36c406edb0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f36d0006fd0 tx=0x7f36d0008040 comp rx=0 tx=0).stop 2024-04-04T06:57:08.409 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:08.410+0000 7f36ef000640 1 -- 172.21.15.72:0/464563442 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f36e815e600 msgr2=0x7f36e8160230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:08.409 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:08.410+0000 7f36ef000640 1 --2- 172.21.15.72:0/464563442 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f36e815e600 0x7f36e8160230 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f36e0009d90 tx=0x7f36e0004a40 comp rx=0 tx=0).stop 2024-04-04T06:57:08.409 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:08.410+0000 7f36ef000640 1 -- 172.21.15.72:0/464563442 shutdown_connections 2024-04-04T06:57:08.409 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:08.410+0000 7f36ef000640 1 --2- 172.21.15.72:0/464563442 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f36c406c8f0 0x7f36c406edb0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:08.409 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:08.410+0000 7f36ef000640 1 --2- 172.21.15.72:0/464563442 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f36e815e600 0x7f36e8160230 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:08.409 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:08.410+0000 7f36ef000640 1 --2- 172.21.15.72:0/464563442 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f36e80d29b0 0x7f36e80c8e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:08.409 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:08.410+0000 7f36ef000640 1 --2- 172.21.15.72:0/464563442 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f36e80d19c0 0x7f36e815c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:08.409 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:08.410+0000 7f36ef000640 1 -- 172.21.15.72:0/464563442 >> 172.21.15.72:0/464563442 conn(0x7f36e8071eb0 msgr2=0x7f36e815d4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:08.409 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:08.410+0000 7f36ef000640 1 -- 172.21.15.72:0/464563442 shutdown_connections 2024-04-04T06:57:08.409 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:08.410+0000 7f36ef000640 1 -- 172.21.15.72:0/464563442 wait complete. 2024-04-04T06:57:08.428 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-04T06:57:08.625 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:08.626+0000 7f53bc200640 1 Processor -- start 2024-04-04T06:57:08.625 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:08.627+0000 7f53bc200640 1 -- start start 2024-04-04T06:57:08.627 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:08.628+0000 7f53bc200640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f53b415e4a0 0x7f53b40cfc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:08.627 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:08.628+0000 7f53bc200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f53b40cf1a0 0x7f53b4141e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:08.627 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:08.628+0000 7f53bc200640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f53b41621e0 con 0x7f53b40d0190 2024-04-04T06:57:08.627 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:08.628+0000 7f53bc200640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f53b41624c0 con 0x7f53b415e4a0 2024-04-04T06:57:08.627 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:08.628+0000 7f53bc200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f53b41627a0 con 0x7f53b40cf1a0 2024-04-04T06:57:08.627 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:08.628+0000 7f53b8e00640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f53b40d0190 0x7f53b40cea90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:37910/0 (socket says 172.21.15.72:37910) 2024-04-04T06:57:08.627 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:08.628+0000 7f53b8e00640 1 -- 172.21.15.72:0/2332097315 learned_addr learned my addr 172.21.15.72:0/2332097315 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-04-04T06:57:08.629 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:08.629+0000 7f53b9800640 1 --2- 172.21.15.72:0/2332097315 >> v2:172.21.15.117:3300/0 conn(0x7f53b415e4a0 0x7f53b40cfc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:08.629 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:08.629+0000 7f53b3e00640 1 -- 172.21.15.72:0/2332097315 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3882442511 0 0) 0x7f53b41621e0 con 0x7f53b40d0190 2024-04-04T06:57:08.629 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:08.629+0000 7f53ba200640 1 --2- 172.21.15.72:0/2332097315 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f53b40cf1a0 0x7f53b4141e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:08.629 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:08.629+0000 7f53b3e00640 1 -- 172.21.15.72:0/2332097315 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f539c003520 con 0x7f53b40d0190 2024-04-04T06:57:08.629 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:08.629+0000 7f53b3e00640 1 -- 172.21.15.72:0/2332097315 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1432434170 0 0) 0x7f539c003520 con 0x7f53b40d0190 2024-04-04T06:57:08.629 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:08.629+0000 7f53b3e00640 1 -- 172.21.15.72:0/2332097315 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f53b40cf1a0 msgr2=0x7f53b4141e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:57:08.629 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:08.629+0000 7f53b3e00640 1 --2- 172.21.15.72:0/2332097315 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f53b40cf1a0 0x7f53b4141e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:08.630 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:08.629+0000 7f53b3e00640 1 -- 172.21.15.72:0/2332097315 >> v2:172.21.15.117:3300/0 conn(0x7f53b415e4a0 msgr2=0x7f53b40cfc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:57:08.630 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:08.629+0000 7f53b3e00640 1 --2- 172.21.15.72:0/2332097315 >> v2:172.21.15.117:3300/0 conn(0x7f53b415e4a0 0x7f53b40cfc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:08.630 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:08.629+0000 7f53b3e00640 1 -- 172.21.15.72:0/2332097315 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53b4162a80 con 0x7f53b40d0190 2024-04-04T06:57:08.630 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:08.629+0000 7f53b3e00640 1 -- 172.21.15.72:0/2332097315 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2465650867 0 0) 0x7f53a0001670 con 0x7f53b40d0190 2024-04-04T06:57:08.630 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:08.629+0000 7f53b3e00640 1 -- 172.21.15.72:0/2332097315 >> v1:172.21.15.72:6789/0 conn(0x7f53b40d0190 legacy=0x7f53b40cea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:08.630 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:08.629+0000 7f53b3e00640 1 --2- 172.21.15.72:0/2332097315 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f539c0039b0 0x7f539c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:08.630 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:08.629+0000 7f53b3e00640 1 --2- 172.21.15.72:0/2332097315 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f539c004800 0x7f539c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:08.630 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:08.629+0000 7f53b3e00640 1 --2- 172.21.15.72:0/2332097315 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f53b40cf1a0 0x7f539c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:08.630 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:08.629+0000 7f53b3e00640 1 -- 172.21.15.72:0/2332097315 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f53b41624c0 con 0x7f539c004800 2024-04-04T06:57:08.630 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:08.629+0000 7f53b3e00640 1 -- 172.21.15.72:0/2332097315 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f53b41627a0 con 0x7f539c0039b0 2024-04-04T06:57:08.630 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:08.629+0000 7f53b3e00640 1 -- 172.21.15.72:0/2332097315 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f539c00b9c0 con 0x7f53b40cf1a0 2024-04-04T06:57:08.630 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:08.630+0000 7f53b8e00640 1 --2- 172.21.15.72:0/2332097315 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f539c004800 0x7f539c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:08.630 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:08.630+0000 7f53b9800640 1 --2- 172.21.15.72:0/2332097315 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f539c0039b0 0x7f539c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:08.630 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:08.630+0000 7f53b8e00640 1 -- 172.21.15.72:0/2332097315 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f53b40cf1a0 msgr2=0x7f539c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:57:08.630 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:08.630+0000 7f53b8e00640 1 --2- 172.21.15.72:0/2332097315 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f53b40cf1a0 0x7f539c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:08.631 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:08.630+0000 7f53b8e00640 1 -- 172.21.15.72:0/2332097315 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f539c0039b0 msgr2=0x7f539c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:57:08.631 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:08.630+0000 7f53b8e00640 1 --2- 172.21.15.72:0/2332097315 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f539c0039b0 0x7f539c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:08.631 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:08.630+0000 7f53b8e00640 1 -- 172.21.15.72:0/2332097315 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f539c003520 con 0x7f539c004800 2024-04-04T06:57:08.631 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:08.630+0000 7f53b9800640 1 --2- 172.21.15.72:0/2332097315 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f539c0039b0 0x7f539c003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-04T06:57:08.632 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:08.632+0000 7f53b8e00640 1 --2- 172.21.15.72:0/2332097315 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f539c004800 0x7f539c004c80 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f53a0001050 tx=0x7f539c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44273051410eb6eb server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:08.632 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:08.632+0000 7f53b3e00640 1 -- 172.21.15.72:0/2332097315 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53a0007d70 con 0x7f539c004800 2024-04-04T06:57:08.632 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:08.632+0000 7f53b3e00640 1 -- 172.21.15.72:0/2332097315 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53a0030070 con 0x7f539c004800 2024-04-04T06:57:08.632 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:08.632+0000 7f53b3e00640 1 -- 172.21.15.72:0/2332097315 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53a002cd80 con 0x7f539c004800 2024-04-04T06:57:08.632 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:08.633+0000 7f53bc200640 1 -- 172.21.15.72:0/2332097315 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f539c004800 msgr2=0x7f539c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:08.632 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:08.633+0000 7f53bc200640 1 --2- 172.21.15.72:0/2332097315 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f539c004800 0x7f539c004c80 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f53a0001050 tx=0x7f539c005830 comp rx=0 tx=0).stop 2024-04-04T06:57:08.632 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:08.633+0000 7f53ba200640 1 -- 172.21.15.72:0/2332097315 reap_dead start 2024-04-04T06:57:08.632 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:08.633+0000 7f53bc200640 1 -- 172.21.15.72:0/2332097315 shutdown_connections 2024-04-04T06:57:08.632 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:08.633+0000 7f53bc200640 1 -- 172.21.15.72:0/2332097315 >> 172.21.15.72:0/2332097315 conn(0x7f53b406f640 msgr2=0x7f53b406fa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:08.633 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:08.633+0000 7f53bc200640 1 -- 172.21.15.72:0/2332097315 shutdown_connections 2024-04-04T06:57:08.633 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:08.633+0000 7f53bc200640 1 -- 172.21.15.72:0/2332097315 wait complete. 2024-04-04T06:57:08.633 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:08.635+0000 7f53bc200640 1 Processor -- start 2024-04-04T06:57:08.633 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:08.635+0000 7f53bc200640 1 -- start start 2024-04-04T06:57:08.635 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:08.636+0000 7f53bc200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f539c004800 0x7f53b41558f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:08.635 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:08.636+0000 7f53bc200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f53b4155fa0 0x7f53b4161850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:08.635 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:08.636+0000 7f53bc200640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f53b40b68f0 0x7f53b40b6d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:08.635 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:08.636+0000 7f53bc200640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f53b4141fc0 con 0x7f53b40b68f0 2024-04-04T06:57:08.635 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:08.636+0000 7f53bc200640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f53b4141e40 con 0x7f539c004800 2024-04-04T06:57:08.636 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:08.636+0000 7f53bc200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f53b4142140 con 0x7f53b4155fa0 2024-04-04T06:57:08.636 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:08.636+0000 7f53ba200640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f53b40b68f0 0x7f53b40b6d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:08.636 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:08.636+0000 7f53ba200640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f53b40b68f0 0x7f53b40b6d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48944/0 (socket says 172.21.15.72:48944) 2024-04-04T06:57:08.636 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:08.636+0000 7f53ba200640 1 -- 172.21.15.72:0/1769378198 learned_addr learned my addr 172.21.15.72:0/1769378198 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:57:08.636 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:08.637+0000 7f53b9800640 1 --2- 172.21.15.72:0/1769378198 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f539c004800 0x7f53b41558f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:08.636 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:08.637+0000 7f53ba200640 1 -- 172.21.15.72:0/1769378198 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f53b4155fa0 msgr2=0x7f53b4161850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:08.636 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:08.637+0000 7f53ba200640 1 --2- 172.21.15.72:0/1769378198 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f53b4155fa0 0x7f53b4161850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:08.636 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:08.637+0000 7f53ba200640 1 -- 172.21.15.72:0/1769378198 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f539c004800 msgr2=0x7f53b41558f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:08.636 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:08.637+0000 7f53ba200640 1 --2- 172.21.15.72:0/1769378198 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f539c004800 0x7f53b41558f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:08.636 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:08.637+0000 7f53ba200640 1 -- 172.21.15.72:0/1769378198 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53b40b59d0 con 0x7f53b40b68f0 2024-04-04T06:57:08.637 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:08.637+0000 7f53ba200640 1 --2- 172.21.15.72:0/1769378198 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f53b40b68f0 0x7f53b40b6d80 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f53b40c9100 tx=0x7f53ac00b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:08.637 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:08.637+0000 7f53b1600640 1 -- 172.21.15.72:0/1769378198 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53ac00bce0 con 0x7f53b40b68f0 2024-04-04T06:57:08.637 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:08.637+0000 7f53b1600640 1 -- 172.21.15.72:0/1769378198 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53ac01a070 con 0x7f53b40b68f0 2024-04-04T06:57:08.637 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:08.637+0000 7f53b1600640 1 -- 172.21.15.72:0/1769378198 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53ac014640 con 0x7f53b40b68f0 2024-04-04T06:57:08.637 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:08.637+0000 7f53bc200640 1 -- 172.21.15.72:0/1769378198 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53b40b5cb0 con 0x7f53b40b68f0 2024-04-04T06:57:08.637 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:08.638+0000 7f53bc200640 1 -- 172.21.15.72:0/1769378198 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53b40b56c0 con 0x7f53b40b68f0 2024-04-04T06:57:08.638 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:08.639+0000 7f53bc200640 1 -- 172.21.15.72:0/1769378198 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f53b4075730 con 0x7f53b40b68f0 2024-04-04T06:57:08.638 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:08.640+0000 7f53b1600640 1 -- 172.21.15.72:0/1769378198 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f53ac005d10 con 0x7f53b40b68f0 2024-04-04T06:57:08.639 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:08.641+0000 7f53b1600640 1 --2- 172.21.15.72:0/1769378198 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f539406c8f0 0x7f539406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:08.639 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:08.641+0000 7f53b1600640 1 -- 172.21.15.72:0/1769378198 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f53ac08bb10 con 0x7f53b40b68f0 2024-04-04T06:57:08.639 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:08.641+0000 7f53b9800640 1 --2- 172.21.15.72:0/1769378198 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f539406c8f0 0x7f539406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:08.640 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:08.642+0000 7f53b9800640 1 --2- 172.21.15.72:0/1769378198 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f539406c8f0 0x7f539406edb0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f53a8009aa0 tx=0x7f53a8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:08.644 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:08.645+0000 7f53b1600640 1 -- 172.21.15.72:0/1769378198 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f53ac059f40 con 0x7f53b40b68f0 2024-04-04T06:57:08.835 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:08.836+0000 7f53bc200640 1 -- 172.21.15.72:0/1769378198 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f53b40c5530 con 0x7f53b40b68f0 2024-04-04T06:57:08.835 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:08.837+0000 7f53b1600640 1 -- 172.21.15.72:0/1769378198 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) ==== 104+0+11 (secure 0 0 0) 0x7f53ac059840 con 0x7f53b40b68f0 2024-04-04T06:57:08.835 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2024-04-04T06:57:08.838 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:08.839+0000 7f53bc200640 1 -- 172.21.15.72:0/1769378198 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f539406c8f0 msgr2=0x7f539406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:08.838 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:08.839+0000 7f53bc200640 1 --2- 172.21.15.72:0/1769378198 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f539406c8f0 0x7f539406edb0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f53a8009aa0 tx=0x7f53a8008040 comp rx=0 tx=0).stop 2024-04-04T06:57:08.839 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:08.839+0000 7f53bc200640 1 -- 172.21.15.72:0/1769378198 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f53b40b68f0 msgr2=0x7f53b40b6d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:08.839 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:08.839+0000 7f53bc200640 1 --2- 172.21.15.72:0/1769378198 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f53b40b68f0 0x7f53b40b6d80 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f53b40c9100 tx=0x7f53ac00b480 comp rx=0 tx=0).stop 2024-04-04T06:57:08.839 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:08.840+0000 7f53bc200640 1 -- 172.21.15.72:0/1769378198 shutdown_connections 2024-04-04T06:57:08.839 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:08.840+0000 7f53bc200640 1 --2- 172.21.15.72:0/1769378198 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f539406c8f0 0x7f539406edb0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:08.839 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:08.840+0000 7f53bc200640 1 --2- 172.21.15.72:0/1769378198 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f53b40b68f0 0x7f53b40b6d80 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:08.839 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:08.840+0000 7f53bc200640 1 --2- 172.21.15.72:0/1769378198 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f53b4155fa0 0x7f53b4161850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:08.839 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:08.840+0000 7f53bc200640 1 --2- 172.21.15.72:0/1769378198 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f539c004800 0x7f53b41558f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:08.839 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:08.840+0000 7f53bc200640 1 -- 172.21.15.72:0/1769378198 >> 172.21.15.72:0/1769378198 conn(0x7f53b406f640 msgr2=0x7f53b415c850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:08.839 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:08.840+0000 7f53bc200640 1 -- 172.21.15.72:0/1769378198 shutdown_connections 2024-04-04T06:57:08.839 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:08.840+0000 7f53bc200640 1 -- 172.21.15.72:0/1769378198 wait complete. 2024-04-04T06:57:08.857 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-04T06:57:09.062 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:09.063+0000 7f85de000640 1 Processor -- start 2024-04-04T06:57:09.062 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:09.063+0000 7f85de000640 1 -- start start 2024-04-04T06:57:09.063 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:09.064+0000 7f85de000640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f85d815e190 0x7f85d81629d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:09.063 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:09.065+0000 7f85de000640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f85d8071c70 con 0x7f85d8071340 2024-04-04T06:57:09.063 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:09.065+0000 7f85de000640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f85d8071f50 con 0x7f85d80d0850 2024-04-04T06:57:09.063 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:09.065+0000 7f85de000640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f85d80727f0 con 0x7f85d815e190 2024-04-04T06:57:09.063 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:09.065+0000 7f85dcc00640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f85d815e190 0x7f85d81629d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:09.064 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:09.065+0000 7f85cfe00640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f85d8071340 0x7f85d80d0140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:37912/0 (socket says 172.21.15.72:37912) 2024-04-04T06:57:09.064 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:09.065+0000 7f85cfe00640 1 -- 172.21.15.72:0/1722044912 learned_addr learned my addr 172.21.15.72:0/1722044912 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-04-04T06:57:09.064 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:09.065+0000 7f85d7e00640 1 -- 172.21.15.72:0/1722044912 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4209841544 0 0) 0x7f85d8071c70 con 0x7f85d8071340 2024-04-04T06:57:09.064 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:09.065+0000 7f85d7e00640 1 -- 172.21.15.72:0/1722044912 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f85b8003520 con 0x7f85d8071340 2024-04-04T06:57:09.064 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:09.065+0000 7f85dcc00640 1 -- 172.21.15.72:0/1722044912 >> v1:172.21.15.117:6789/0 conn(0x7f85d80d0850 legacy=0x7f85d80b30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:57:09.064 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:09.065+0000 7f85dcc00640 1 -- 172.21.15.72:0/1722044912 >> v1:172.21.15.72:6789/0 conn(0x7f85d8071340 legacy=0x7f85d80d0140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:09.065 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:09.065+0000 7f85dcc00640 1 -- 172.21.15.72:0/1722044912 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85d8072230 con 0x7f85d815e190 2024-04-04T06:57:09.065 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:09.066+0000 7f85dcc00640 1 --2- 172.21.15.72:0/1722044912 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f85d815e190 0x7f85d81629d0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f85c00097a0 tx=0x7f85c002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4b6740b9a233af9 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:09.065 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:09.067+0000 7f85d7e00640 1 -- 172.21.15.72:0/1722044912 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85c00315a0 con 0x7f85d815e190 2024-04-04T06:57:09.065 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:09.067+0000 7f85d7e00640 1 -- 172.21.15.72:0/1722044912 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85c0037070 con 0x7f85d815e190 2024-04-04T06:57:09.065 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:09.067+0000 7f85d7e00640 1 -- 172.21.15.72:0/1722044912 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85c0031960 con 0x7f85d815e190 2024-04-04T06:57:09.066 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:09.067+0000 7f85de000640 1 -- 172.21.15.72:0/1722044912 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f85d815e190 msgr2=0x7f85d81629d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:09.066 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:09.067+0000 7f85de000640 1 --2- 172.21.15.72:0/1722044912 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f85d815e190 0x7f85d81629d0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f85c00097a0 tx=0x7f85c002b840 comp rx=0 tx=0).stop 2024-04-04T06:57:09.066 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:09.067+0000 7f85de000640 1 -- 172.21.15.72:0/1722044912 shutdown_connections 2024-04-04T06:57:09.066 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:09.067+0000 7f85de000640 1 --2- 172.21.15.72:0/1722044912 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f85d815e190 0x7f85d81629d0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:09.067 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:09.067+0000 7f85de000640 1 -- 172.21.15.72:0/1722044912 >> 172.21.15.72:0/1722044912 conn(0x7f85d806b890 msgr2=0x7f85d806bca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:09.067 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:09.068+0000 7f85de000640 1 -- 172.21.15.72:0/1722044912 shutdown_connections 2024-04-04T06:57:09.067 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:09.068+0000 7f85de000640 1 -- 172.21.15.72:0/1722044912 wait complete. 2024-04-04T06:57:09.068 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:09.069+0000 7f85de000640 1 Processor -- start 2024-04-04T06:57:09.068 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:09.069+0000 7f85de000640 1 -- start start 2024-04-04T06:57:09.069 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:09.070+0000 7f85de000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f85d8071340 0x7f85d814f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:09.069 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:09.070+0000 7f85de000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f85d80d0850 0x7f85d8154250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:09.069 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:09.070+0000 7f85de000640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f85d815e190 0x7f85d8150c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:09.069 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:09.070+0000 7f85de000640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f85d815e570 con 0x7f85d815e190 2024-04-04T06:57:09.069 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:09.070+0000 7f85de000640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f85d806d830 con 0x7f85d8071340 2024-04-04T06:57:09.069 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:09.070+0000 7f85de000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f85d8153800 con 0x7f85d80d0850 2024-04-04T06:57:09.070 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:09.071+0000 7f85dd600640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f85d815e190 0x7f85d8150c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:09.070 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:09.071+0000 7f85dd600640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f85d815e190 0x7f85d8150c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48952/0 (socket says 172.21.15.72:48952) 2024-04-04T06:57:09.070 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:09.071+0000 7f85dd600640 1 -- 172.21.15.72:0/546360851 learned_addr learned my addr 172.21.15.72:0/546360851 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:57:09.071 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:09.071+0000 7f85dcc00640 1 --2- 172.21.15.72:0/546360851 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f85d8071340 0x7f85d814f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:09.071 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:09.071+0000 7f85dd600640 1 -- 172.21.15.72:0/546360851 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f85d80d0850 msgr2=0x7f85d8154250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:09.071 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:09.071+0000 7f85cfe00640 1 --2- 172.21.15.72:0/546360851 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f85d80d0850 0x7f85d8154250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:09.071 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:09.071+0000 7f85dd600640 1 --2- 172.21.15.72:0/546360851 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f85d80d0850 0x7f85d8154250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:09.071 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:09.071+0000 7f85dd600640 1 -- 172.21.15.72:0/546360851 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f85d8071340 msgr2=0x7f85d814f9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:09.071 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:09.071+0000 7f85dd600640 1 --2- 172.21.15.72:0/546360851 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f85d8071340 0x7f85d814f9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:09.071 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:09.071+0000 7f85dd600640 1 -- 172.21.15.72:0/546360851 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85d8151710 con 0x7f85d815e190 2024-04-04T06:57:09.072 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:09.071+0000 7f85dcc00640 1 --2- 172.21.15.72:0/546360851 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f85d8071340 0x7f85d814f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-04T06:57:09.072 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:09.072+0000 7f85dd600640 1 --2- 172.21.15.72:0/546360851 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f85d815e190 0x7f85d8150c70 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f85d000c6d0 tx=0x7f85d000cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:09.072 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:09.072+0000 7f85d5600640 1 -- 172.21.15.72:0/546360851 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85d0016020 con 0x7f85d815e190 2024-04-04T06:57:09.072 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:09.072+0000 7f85d5600640 1 -- 172.21.15.72:0/546360851 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85d000a7e0 con 0x7f85d815e190 2024-04-04T06:57:09.072 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:09.072+0000 7f85d5600640 1 -- 172.21.15.72:0/546360851 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85d000ac10 con 0x7f85d815e190 2024-04-04T06:57:09.072 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:09.072+0000 7f85de000640 1 -- 172.21.15.72:0/546360851 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85d81519f0 con 0x7f85d815e190 2024-04-04T06:57:09.072 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:09.072+0000 7f85de000640 1 -- 172.21.15.72:0/546360851 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85d8153d30 con 0x7f85d815e190 2024-04-04T06:57:09.072 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:09.073+0000 7f85de000640 1 -- 172.21.15.72:0/546360851 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85d80756c0 con 0x7f85d815e190 2024-04-04T06:57:09.072 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:09.074+0000 7f85d5600640 1 -- 172.21.15.72:0/546360851 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f85d0019020 con 0x7f85d815e190 2024-04-04T06:57:09.073 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:09.075+0000 7f85d5600640 1 --2- 172.21.15.72:0/546360851 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f85b406c8f0 0x7f85b406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:09.074 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:09.075+0000 7f85d5600640 1 -- 172.21.15.72:0/546360851 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f85d008bfd0 con 0x7f85d815e190 2024-04-04T06:57:09.074 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:09.075+0000 7f85dcc00640 1 --2- 172.21.15.72:0/546360851 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f85b406c8f0 0x7f85b406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:09.074 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:09.076+0000 7f85dcc00640 1 --2- 172.21.15.72:0/546360851 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f85b406c8f0 0x7f85b406edb0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f85c0036000 tx=0x7f85c0008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:09.082 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:09.084+0000 7f85d5600640 1 -- 172.21.15.72:0/546360851 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f85d0020020 con 0x7f85d815e190 2024-04-04T06:57:09.335 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:09.336+0000 7f85de000640 1 -- 172.21.15.72:0/546360851 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f85d806d610 con 0x7f85d815e190 2024-04-04T06:57:09.336 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:09.337+0000 7f85d5600640 1 -- 172.21.15.72:0/546360851 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) ==== 100+0+11 (secure 0 0 0) 0x7f85d0059da0 con 0x7f85d815e190 2024-04-04T06:57:09.336 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 64 2024-04-04T06:57:09.339 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:09.339+0000 7f85de000640 1 -- 172.21.15.72:0/546360851 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f85b406c8f0 msgr2=0x7f85b406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:09.339 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:09.339+0000 7f85de000640 1 --2- 172.21.15.72:0/546360851 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f85b406c8f0 0x7f85b406edb0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f85c0036000 tx=0x7f85c0008030 comp rx=0 tx=0).stop 2024-04-04T06:57:09.339 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:09.339+0000 7f85de000640 1 -- 172.21.15.72:0/546360851 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f85d815e190 msgr2=0x7f85d8150c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:09.339 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:09.339+0000 7f85de000640 1 --2- 172.21.15.72:0/546360851 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f85d815e190 0x7f85d8150c70 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f85d000c6d0 tx=0x7f85d000cb90 comp rx=0 tx=0).stop 2024-04-04T06:57:09.339 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:09.340+0000 7f85de000640 1 -- 172.21.15.72:0/546360851 shutdown_connections 2024-04-04T06:57:09.339 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:09.340+0000 7f85de000640 1 --2- 172.21.15.72:0/546360851 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f85b406c8f0 0x7f85b406edb0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:09.339 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:09.340+0000 7f85de000640 1 --2- 172.21.15.72:0/546360851 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f85d815e190 0x7f85d8150c70 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:09.339 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:09.340+0000 7f85de000640 1 --2- 172.21.15.72:0/546360851 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f85d80d0850 0x7f85d8154250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:09.339 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:09.340+0000 7f85de000640 1 --2- 172.21.15.72:0/546360851 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f85d8071340 0x7f85d814f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:09.339 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:09.340+0000 7f85de000640 1 -- 172.21.15.72:0/546360851 >> 172.21.15.72:0/546360851 conn(0x7f85d806b890 msgr2=0x7f85d8158830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:09.339 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:09.340+0000 7f85de000640 1 -- 172.21.15.72:0/546360851 shutdown_connections 2024-04-04T06:57:09.339 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:09.340+0000 7f85de000640 1 -- 172.21.15.72:0/546360851 wait complete. 2024-04-04T06:57:09.370 INFO:tasks.cephfs_test_runner:Starting test: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2024-04-04T06:57:09.370 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-04T06:57:09.607 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:09.608+0000 7fb7cf200640 1 Processor -- start 2024-04-04T06:57:09.607 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:09.608+0000 7fb7cf200640 1 -- start start 2024-04-04T06:57:09.609 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:09.610+0000 7fb7cf200640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb7d00cd6b0 0x7fb7d006eb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:09.609 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:09.610+0000 7fb7cf200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb7d006f0c0 0x7fb7d00b2e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:09.609 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:09.610+0000 7fb7cf200640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7d00cf930 con 0x7fb7d0155880 2024-04-04T06:57:09.609 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:09.610+0000 7fb7cf200640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7fb7d006f510 con 0x7fb7d00cd6b0 2024-04-04T06:57:09.609 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:09.610+0000 7fb7cf200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fb7d00cdb60 con 0x7fb7d006f0c0 2024-04-04T06:57:09.609 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:09.610+0000 7fb7c7e00640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb7d00cd6b0 0x7fb7d006eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:09.609 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:09.610+0000 7fb7c7e00640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb7d00cd6b0 0x7fb7d006eb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:33416/0 (socket says 172.21.15.72:33416) 2024-04-04T06:57:09.609 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:09.610+0000 7fb7c7e00640 1 -- 172.21.15.72:0/1790888004 learned_addr learned my addr 172.21.15.72:0/1790888004 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:57:09.609 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:09.610+0000 7fb7ce800640 1 --2- 172.21.15.72:0/1790888004 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb7d006f0c0 0x7fb7d00b2e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:09.610 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:09.610+0000 7fb7c7e00640 1 -- 172.21.15.72:0/1790888004 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb7d006f0c0 msgr2=0x7fb7d00b2e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:57:09.610 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:09.610+0000 7fb7c7e00640 1 --2- 172.21.15.72:0/1790888004 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb7d006f0c0 0x7fb7d00b2e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:09.610 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:09.610+0000 7fb7c7e00640 1 -- 172.21.15.72:0/1790888004 >> v1:172.21.15.117:6789/0 conn(0x7fb7d0155880 legacy=0x7fb7d00cf220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:57:09.610 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:09.610+0000 7fb7c7e00640 1 -- 172.21.15.72:0/1790888004 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7d0155c60 con 0x7fb7d00cd6b0 2024-04-04T06:57:09.610 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:09.610+0000 7fb7ce800640 1 --2- 172.21.15.72:0/1790888004 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb7d006f0c0 0x7fb7d00b2e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-04T06:57:09.611 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:09.611+0000 7fb7c7e00640 1 --2- 172.21.15.72:0/1790888004 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb7d00cd6b0 0x7fb7d006eb80 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fb7b8009870 tx=0x7fb7b802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88178c36e391040a server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:09.611 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:09.612+0000 7fb7cd400640 1 -- 172.21.15.72:0/1790888004 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7b8035020 con 0x7fb7d00cd6b0 2024-04-04T06:57:09.611 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:09.612+0000 7fb7cd400640 1 -- 172.21.15.72:0/1790888004 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7b8031640 con 0x7fb7d00cd6b0 2024-04-04T06:57:09.611 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:09.612+0000 7fb7cd400640 1 -- 172.21.15.72:0/1790888004 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7b802d040 con 0x7fb7d00cd6b0 2024-04-04T06:57:09.612 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:09.612+0000 7fb7cf200640 1 -- 172.21.15.72:0/1790888004 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb7d00cd6b0 msgr2=0x7fb7d006eb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:09.612 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:09.612+0000 7fb7cf200640 1 --2- 172.21.15.72:0/1790888004 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb7d00cd6b0 0x7fb7d006eb80 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fb7b8009870 tx=0x7fb7b802b8f0 comp rx=0 tx=0).stop 2024-04-04T06:57:09.612 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:09.613+0000 7fb7cf200640 1 -- 172.21.15.72:0/1790888004 shutdown_connections 2024-04-04T06:57:09.612 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:09.613+0000 7fb7cf200640 1 --2- 172.21.15.72:0/1790888004 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb7d006f0c0 0x7fb7d00b2e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:09.612 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:09.613+0000 7fb7cf200640 1 --2- 172.21.15.72:0/1790888004 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb7d00cd6b0 0x7fb7d006eb80 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:09.612 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:09.613+0000 7fb7cf200640 1 -- 172.21.15.72:0/1790888004 >> 172.21.15.72:0/1790888004 conn(0x7fb7d00b1840 msgr2=0x7fb7d00b1c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:09.612 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:09.613+0000 7fb7cf200640 1 -- 172.21.15.72:0/1790888004 shutdown_connections 2024-04-04T06:57:09.612 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:09.613+0000 7fb7cf200640 1 -- 172.21.15.72:0/1790888004 wait complete. 2024-04-04T06:57:09.613 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:09.614+0000 7fb7cf200640 1 Processor -- start 2024-04-04T06:57:09.613 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:09.614+0000 7fb7cf200640 1 -- start start 2024-04-04T06:57:09.615 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:09.615+0000 7fb7cf200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb7d006f0c0 0x7fb7d0145090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:09.615 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:09.615+0000 7fb7cf200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb7d00cd6b0 0x7fb7d01482a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:09.615 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:09.615+0000 7fb7cf200640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb7d0155880 0x7fb7d0157d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:09.616 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:09.615+0000 7fb7cf200640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fb7d015c0f0 con 0x7fb7d0155880 2024-04-04T06:57:09.616 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:09.615+0000 7fb7cf200640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fb7d015be10 con 0x7fb7d006f0c0 2024-04-04T06:57:09.616 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:09.615+0000 7fb7cf200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fb7d015c3d0 con 0x7fb7d00cd6b0 2024-04-04T06:57:09.616 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:09.616+0000 7fb7ce800640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb7d0155880 0x7fb7d0157d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:09.616 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:09.616+0000 7fb7ce800640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb7d0155880 0x7fb7d0157d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:33432/0 (socket says 172.21.15.72:33432) 2024-04-04T06:57:09.616 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:09.616+0000 7fb7ce800640 1 -- 172.21.15.72:0/167506932 learned_addr learned my addr 172.21.15.72:0/167506932 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:57:09.616 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:09.616+0000 7fb7cde00640 1 --2- 172.21.15.72:0/167506932 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb7d006f0c0 0x7fb7d0145090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:09.616 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:09.616+0000 7fb7c7e00640 1 --2- 172.21.15.72:0/167506932 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb7d00cd6b0 0x7fb7d01482a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:09.616 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:09.616+0000 7fb7ce800640 1 -- 172.21.15.72:0/167506932 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb7d00cd6b0 msgr2=0x7fb7d01482a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:09.616 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:09.616+0000 7fb7ce800640 1 --2- 172.21.15.72:0/167506932 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb7d00cd6b0 0x7fb7d01482a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:09.616 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:09.616+0000 7fb7ce800640 1 -- 172.21.15.72:0/167506932 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb7d006f0c0 msgr2=0x7fb7d0145090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:09.616 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:09.616+0000 7fb7ce800640 1 --2- 172.21.15.72:0/167506932 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb7d006f0c0 0x7fb7d0145090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:09.616 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:09.616+0000 7fb7ce800640 1 -- 172.21.15.72:0/167506932 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7d0158900 con 0x7fb7d0155880 2024-04-04T06:57:09.617 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:09.616+0000 7fb7cde00640 1 --2- 172.21.15.72:0/167506932 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb7d006f0c0 0x7fb7d0145090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-04T06:57:09.617 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:09.617+0000 7fb7ce800640 1 --2- 172.21.15.72:0/167506932 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb7d0155880 0x7fb7d0157d40 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fb7c800cef0 tx=0x7fb7c800a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:09.617 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:09.617+0000 7fb7c6000640 1 -- 172.21.15.72:0/167506932 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7c801a070 con 0x7fb7d0155880 2024-04-04T06:57:09.617 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:09.617+0000 7fb7c6000640 1 -- 172.21.15.72:0/167506932 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7c800d860 con 0x7fb7d0155880 2024-04-04T06:57:09.617 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:09.617+0000 7fb7c6000640 1 -- 172.21.15.72:0/167506932 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7c800dc50 con 0x7fb7d0155880 2024-04-04T06:57:09.617 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:09.617+0000 7fb7cf200640 1 -- 172.21.15.72:0/167506932 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7d0158be0 con 0x7fb7d0155880 2024-04-04T06:57:09.617 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:09.617+0000 7fb7cf200640 1 -- 172.21.15.72:0/167506932 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7d0147780 con 0x7fb7d0155880 2024-04-04T06:57:09.617 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:09.618+0000 7fb7cf200640 1 -- 172.21.15.72:0/167506932 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb7d00756c0 con 0x7fb7d0155880 2024-04-04T06:57:09.617 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:09.619+0000 7fb7c6000640 1 -- 172.21.15.72:0/167506932 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb7c801d070 con 0x7fb7d0155880 2024-04-04T06:57:09.619 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:09.620+0000 7fb7c6000640 1 --2- 172.21.15.72:0/167506932 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fb7ac06c8f0 0x7fb7ac06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:09.619 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:09.621+0000 7fb7c6000640 1 -- 172.21.15.72:0/167506932 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fb7c808c3f0 con 0x7fb7d0155880 2024-04-04T06:57:09.619 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:09.621+0000 7fb7cde00640 1 --2- 172.21.15.72:0/167506932 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fb7ac06c8f0 0x7fb7ac06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:09.620 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:09.621+0000 7fb7cde00640 1 --2- 172.21.15.72:0/167506932 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fb7ac06c8f0 0x7fb7ac06edb0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fb7c000a830 tx=0x7fb7c0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:09.623 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:09.625+0000 7fb7c6000640 1 -- 172.21.15.72:0/167506932 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fb7c805a8d0 con 0x7fb7d0155880 2024-04-04T06:57:09.824 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:09.826+0000 7fb7cf200640 1 -- 172.21.15.72:0/167506932 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb7d00b1670 con 0x7fb7d0155880 2024-04-04T06:57:09.827 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:09.828+0000 7fb7c6000640 1 -- 172.21.15.72:0/167506932 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16581 (secure 0 0 0) 0x7fb7c805a1d0 con 0x7fb7d0155880 2024-04-04T06:57:09.827 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T06:57:09.828 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":20,"fsid":"6708bac2-4f50-49b5-87a9-c390fd333eb3","created":"2024-04-04T06:56:04.282498+0000","modified":"2024-04-04T06:56:30.007371+0000","last_up_change":"2024-04-04T06:56:16.716089+0000","last_in_change":"2024-04-04T06:56:07.768593+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-04T06:56:17.421685+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-04T06:56:26.822661+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-04T06:56:27.429816+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7c345991-5af8-4dc6-a481-28610c40e128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":3889813953},{"type":"v1","addr":"172.21.15.72:6818","nonce":3889813953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":3889813953},{"type":"v1","addr":"172.21.15.72:6821","nonce":3889813953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":3889813953},{"type":"v1","addr":"172.21.15.72:6826","nonce":3889813953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":3889813953},{"type":"v1","addr":"172.21.15.72:6823","nonce":3889813953}]},"public_addr":"172.21.15.72:6818/3889813953","cluster_addr":"172.21.15.72:6821/3889813953","heartbeat_back_addr":"172.21.15.72:6826/3889813953","heartbeat_front_addr":"172.21.15.72:6823/3889813953","state":["exists","up"]},{"osd":1,"uuid":"1b3f7ab2-a56c-488d-a89a-1f3572361c95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":3101663154},{"type":"v1","addr":"172.21.15.72:6801","nonce":3101663154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":3101663154},{"type":"v1","addr":"172.21.15.72:6803","nonce":3101663154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":3101663154},{"type":"v1","addr":"172.21.15.72:6807","nonce":3101663154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":3101663154},{"type":"v1","addr":"172.21.15.72:6805","nonce":3101663154}]},"public_addr":"172.21.15.72:6801/3101663154","cluster_addr":"172.21.15.72:6803/3101663154","heartbeat_back_addr":"172.21.15.72:6807/3101663154","heartbeat_front_addr":"172.21.15.72:6805/3101663154","state":["exists","up"]},{"osd":2,"uuid":"fc9aa512-53df-40d7-ba04-3e6b7dcd1e34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":235374192},{"type":"v1","addr":"172.21.15.72:6809","nonce":235374192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":235374192},{"type":"v1","addr":"172.21.15.72:6811","nonce":235374192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":235374192},{"type":"v1","addr":"172.21.15.72:6815","nonce":235374192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":235374192},{"type":"v1","addr":"172.21.15.72:6813","nonce":235374192}]},"public_addr":"172.21.15.72:6809/235374192","cluster_addr":"172.21.15.72:6811/235374192","heartbeat_back_addr":"172.21.15.72:6815/235374192","heartbeat_front_addr":"172.21.15.72:6813/235374192","state":["exists","up"]},{"osd":3,"uuid":"b4f63eed-dc5b-4aba-bb50-de46eb41492b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6817","nonce":2806631742},{"type":"v1","addr":"172.21.15.72:6819","nonce":2806631742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":2806631742},{"type":"v1","addr":"172.21.15.72:6827","nonce":2806631742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":2806631742},{"type":"v1","addr":"172.21.15.72:6831","nonce":2806631742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":2806631742},{"type":"v1","addr":"172.21.15.72:6829","nonce":2806631742}]},"public_addr":"172.21.15.72:6819/2806631742","cluster_addr":"172.21.15.72:6827/2806631742","heartbeat_back_addr":"172.21.15.72:6831/2806631742","heartbeat_front_addr":"172.21.15.72:6829/2806631742","state":["exists","up"]},{"osd":4,"uuid":"9e985ef8-d711-4172-9286-c54e560895d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":4293536423},{"type":"v1","addr":"172.21.15.117:6825","nonce":4293536423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":4293536423},{"type":"v1","addr":"172.21.15.117:6827","nonce":4293536423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":4293536423},{"type":"v1","addr":"172.21.15.117:6831","nonce":4293536423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":4293536423},{"type":"v1","addr":"172.21.15.117:6829","nonce":4293536423}]},"public_addr":"172.21.15.117:6825/4293536423","cluster_addr":"172.21.15.117:6827/4293536423","heartbeat_back_addr":"172.21.15.117:6831/4293536423","heartbeat_front_addr":"172.21.15.117:6829/4293536423","state":["exists","up"]},{"osd":5,"uuid":"3e9f082b-8d7d-455f-8a96-66d0b4857125","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":684971679},{"type":"v1","addr":"172.21.15.117:6801","nonce":684971679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":684971679},{"type":"v1","addr":"172.21.15.117:6803","nonce":684971679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":684971679},{"type":"v1","addr":"172.21.15.117:6807","nonce":684971679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":684971679},{"type":"v1","addr":"172.21.15.117:6805","nonce":684971679}]},"public_addr":"172.21.15.117:6801/684971679","cluster_addr":"172.21.15.117:6803/684971679","heartbeat_back_addr":"172.21.15.117:6807/684971679","heartbeat_front_addr":"172.21.15.117:6805/684971679","state":["exists","up"]},{"osd":6,"uuid":"bcdafa9f-a870-4398-a38d-ab7697676473","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":2781186528},{"type":"v1","addr":"172.21.15.117:6809","nonce":2781186528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":2781186528},{"type":"v1","addr":"172.21.15.117:6811","nonce":2781186528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":2781186528},{"type":"v1","addr":"172.21.15.117:6815","nonce":2781186528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":2781186528},{"type":"v1","addr":"172.21.15.117:6813","nonce":2781186528}]},"public_addr":"172.21.15.117:6809/2781186528","cluster_addr":"172.21.15.117:6811/2781186528","heartbeat_back_addr":"172.21.15.117:6815/2781186528","heartbeat_front_addr":"172.21.15.117:6813/2781186528","state":["exists","up"]},{"osd":7,"uuid":"b68ec562-ff35-4d2d-a733-c896f8920cfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":617469882},{"type":"v1","addr":"172.21.15.117:6817","nonce":617469882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":617469882},{"type":"v1","addr":"172.21.15.117:6819","nonce":617469882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":617469882},{"type":"v1","addr":"172.21.15.117:6823","nonce":617469882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":617469882},{"type":"v1","addr":"172.21.15.117:6821","nonce":617469882}]},"public_addr":"172.21.15.117:6817/617469882","cluster_addr":"172.21.15.117:6819/617469882","heartbeat_back_addr":"172.21.15.117:6823/617469882","heartbeat_front_addr":"172.21.15.117:6821/617469882","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.347700+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.296619+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.361345+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.093323+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:12.857605+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:12.816090+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.083163+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.121639+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-04T06:57:09.830 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:09.830+0000 7fb7cf200640 1 -- 172.21.15.72:0/167506932 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fb7ac06c8f0 msgr2=0x7fb7ac06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:09.830 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:09.830+0000 7fb7cf200640 1 --2- 172.21.15.72:0/167506932 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fb7ac06c8f0 0x7fb7ac06edb0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fb7c000a830 tx=0x7fb7c0008040 comp rx=0 tx=0).stop 2024-04-04T06:57:09.830 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:09.830+0000 7fb7cf200640 1 -- 172.21.15.72:0/167506932 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb7d0155880 msgr2=0x7fb7d0157d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:09.830 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:09.830+0000 7fb7cf200640 1 --2- 172.21.15.72:0/167506932 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb7d0155880 0x7fb7d0157d40 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fb7c800cef0 tx=0x7fb7c800a710 comp rx=0 tx=0).stop 2024-04-04T06:57:09.830 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:09.830+0000 7fb7cf200640 1 -- 172.21.15.72:0/167506932 shutdown_connections 2024-04-04T06:57:09.830 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:09.830+0000 7fb7cf200640 1 --2- 172.21.15.72:0/167506932 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fb7ac06c8f0 0x7fb7ac06edb0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:09.830 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:09.830+0000 7fb7cf200640 1 --2- 172.21.15.72:0/167506932 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb7d0155880 0x7fb7d0157d40 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:09.830 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:09.830+0000 7fb7cf200640 1 --2- 172.21.15.72:0/167506932 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb7d00cd6b0 0x7fb7d01482a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:09.831 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:09.830+0000 7fb7cf200640 1 --2- 172.21.15.72:0/167506932 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb7d006f0c0 0x7fb7d0145090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:09.831 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:09.830+0000 7fb7cf200640 1 -- 172.21.15.72:0/167506932 >> 172.21.15.72:0/167506932 conn(0x7fb7d00b1840 msgr2=0x7fb7d00cdd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:09.831 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:09.831+0000 7fb7cf200640 1 -- 172.21.15.72:0/167506932 shutdown_connections 2024-04-04T06:57:09.831 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:09.831+0000 7fb7cf200640 1 -- 172.21.15.72:0/167506932 wait complete. 2024-04-04T06:57:09.848 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-04T06:56:17.421685+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-04T06:56:26.822661+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-04T06:56:27.429816+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-04T06:57:09.848 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-04T06:57:10.057 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.058+0000 7fef29200640 1 Processor -- start 2024-04-04T06:57:10.057 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.059+0000 7fef29200640 1 -- start start 2024-04-04T06:57:10.060 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.061+0000 7fef29200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fef2415e1d0 0x7fef24162760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:10.061 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.061+0000 7fef29200640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fef240d14b0 0x7fef240d4780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:10.061 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.061+0000 7fef29200640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef240d2270 con 0x7fef240d1050 2024-04-04T06:57:10.061 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.062+0000 7fef29200640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7fef24162ca0 con 0x7fef240d14b0 2024-04-04T06:57:10.061 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.062+0000 7fef29200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fef2415e5b0 con 0x7fef2415e1d0 2024-04-04T06:57:10.061 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.062+0000 7fef23e00640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fef240d14b0 0x7fef240d4780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:10.061 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.062+0000 7fef1aa00640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fef240d1050 0x7fef240d4070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:39394/0 (socket says 172.21.15.72:39394) 2024-04-04T06:57:10.061 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.062+0000 7fef1aa00640 1 -- 172.21.15.72:0/3098087570 learned_addr learned my addr 172.21.15.72:0/3098087570 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-04-04T06:57:10.061 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.062+0000 7fef23400640 1 --2- 172.21.15.72:0/3098087570 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fef2415e1d0 0x7fef24162760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:10.062 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.062+0000 7fef23e00640 1 -- 172.21.15.72:0/3098087570 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fef2415e1d0 msgr2=0x7fef24162760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:57:10.062 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.062+0000 7fef23e00640 1 --2- 172.21.15.72:0/3098087570 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fef2415e1d0 0x7fef24162760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:10.062 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.062+0000 7fef23e00640 1 -- 172.21.15.72:0/3098087570 >> v1:172.21.15.72:6789/0 conn(0x7fef240d1050 legacy=0x7fef240d4070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:10.062 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.062+0000 7fef23e00640 1 -- 172.21.15.72:0/3098087570 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef240cf4e0 con 0x7fef240d14b0 2024-04-04T06:57:10.062 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.062+0000 7fef22a00640 1 -- 172.21.15.72:0/3098087570 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4087530059 0 0) 0x7fef240d2270 con 0x7fef240d1050 2024-04-04T06:57:10.062 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.062+0000 7fef23400640 1 --2- 172.21.15.72:0/3098087570 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fef2415e1d0 0x7fef24162760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-04T06:57:10.063 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.064+0000 7fef23e00640 1 --2- 172.21.15.72:0/3098087570 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fef240d14b0 0x7fef240d4780 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fef1c009d90 tx=0x7fef1c02be10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73c4888708b1a08 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:10.063 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.064+0000 7fef22a00640 1 -- 172.21.15.72:0/3098087570 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef1c039070 con 0x7fef240d14b0 2024-04-04T06:57:10.064 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.064+0000 7fef22a00640 1 -- 172.21.15.72:0/3098087570 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef1c02cbc0 con 0x7fef240d14b0 2024-04-04T06:57:10.064 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.064+0000 7fef22a00640 1 -- 172.21.15.72:0/3098087570 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef1c034440 con 0x7fef240d14b0 2024-04-04T06:57:10.064 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.064+0000 7fef29200640 1 -- 172.21.15.72:0/3098087570 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fef240d14b0 msgr2=0x7fef240d4780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:10.064 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.064+0000 7fef29200640 1 --2- 172.21.15.72:0/3098087570 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fef240d14b0 0x7fef240d4780 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fef1c009d90 tx=0x7fef1c02be10 comp rx=0 tx=0).stop 2024-04-04T06:57:10.064 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.065+0000 7fef29200640 1 -- 172.21.15.72:0/3098087570 shutdown_connections 2024-04-04T06:57:10.064 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.065+0000 7fef29200640 1 --2- 172.21.15.72:0/3098087570 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fef240d14b0 0x7fef240d4780 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:10.064 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.065+0000 7fef29200640 1 --2- 172.21.15.72:0/3098087570 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fef2415e1d0 0x7fef24162760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:10.064 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.065+0000 7fef29200640 1 -- 172.21.15.72:0/3098087570 >> 172.21.15.72:0/3098087570 conn(0x7fef2406b8c0 msgr2=0x7fef2406bcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:10.064 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.065+0000 7fef29200640 1 -- 172.21.15.72:0/3098087570 shutdown_connections 2024-04-04T06:57:10.064 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.065+0000 7fef29200640 1 -- 172.21.15.72:0/3098087570 wait complete. 2024-04-04T06:57:10.065 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.067+0000 7fef29200640 1 Processor -- start 2024-04-04T06:57:10.065 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.067+0000 7fef29200640 1 -- start start 2024-04-04T06:57:10.067 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.068+0000 7fef29200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fef240d1050 0x7fef240b8a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:10.067 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.068+0000 7fef29200640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fef240d14b0 0x7fef240cc900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:10.067 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.068+0000 7fef29200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fef2415e1d0 0x7fef2414f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:10.067 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.068+0000 7fef29200640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fef240d3d20 con 0x7fef240d14b0 2024-04-04T06:57:10.067 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.068+0000 7fef29200640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fef240d1940 con 0x7fef2415e1d0 2024-04-04T06:57:10.068 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.068+0000 7fef29200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fef240b3430 con 0x7fef240d1050 2024-04-04T06:57:10.068 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.068+0000 7fef1aa00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fef240d14b0 0x7fef240cc900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:10.068 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.068+0000 7fef1aa00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fef240d14b0 0x7fef240cc900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:33444/0 (socket says 172.21.15.72:33444) 2024-04-04T06:57:10.068 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.068+0000 7fef1aa00640 1 -- 172.21.15.72:0/443710964 learned_addr learned my addr 172.21.15.72:0/443710964 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:57:10.068 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.068+0000 7fef23e00640 1 --2- 172.21.15.72:0/443710964 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fef2415e1d0 0x7fef2414f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:10.068 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.068+0000 7fef23400640 1 --2- 172.21.15.72:0/443710964 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fef240d1050 0x7fef240b8a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:10.068 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.068+0000 7fef1aa00640 1 -- 172.21.15.72:0/443710964 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fef240d1050 msgr2=0x7fef240b8a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:10.068 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.068+0000 7fef1aa00640 1 --2- 172.21.15.72:0/443710964 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fef240d1050 0x7fef240b8a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:10.068 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.068+0000 7fef1aa00640 1 -- 172.21.15.72:0/443710964 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fef2415e1d0 msgr2=0x7fef2414f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:10.068 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.068+0000 7fef1aa00640 1 --2- 172.21.15.72:0/443710964 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fef2415e1d0 0x7fef2414f190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:10.068 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.069+0000 7fef1aa00640 1 -- 172.21.15.72:0/443710964 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef240cd350 con 0x7fef240d14b0 2024-04-04T06:57:10.068 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.069+0000 7fef1aa00640 1 --2- 172.21.15.72:0/443710964 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fef240d14b0 0x7fef240cc900 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fef0c00c400 tx=0x7fef0c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:10.069 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.069+0000 7fef1be00640 1 -- 172.21.15.72:0/443710964 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef0c017070 con 0x7fef240d14b0 2024-04-04T06:57:10.069 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.069+0000 7fef1be00640 1 -- 172.21.15.72:0/443710964 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef0c005ce0 con 0x7fef240d14b0 2024-04-04T06:57:10.069 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.069+0000 7fef29200640 1 -- 172.21.15.72:0/443710964 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef241f72d0 con 0x7fef240d14b0 2024-04-04T06:57:10.070 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.069+0000 7fef1be00640 1 -- 172.21.15.72:0/443710964 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef0c007310 con 0x7fef240d14b0 2024-04-04T06:57:10.070 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.069+0000 7fef29200640 1 -- 172.21.15.72:0/443710964 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef241f7b70 con 0x7fef240d14b0 2024-04-04T06:57:10.070 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.071+0000 7fef29200640 1 -- 172.21.15.72:0/443710964 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef241f74a0 con 0x7fef240d14b0 2024-04-04T06:57:10.070 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.071+0000 7fef1be00640 1 -- 172.21.15.72:0/443710964 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fef0c01a070 con 0x7fef240d14b0 2024-04-04T06:57:10.071 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.072+0000 7fef1be00640 1 --2- 172.21.15.72:0/443710964 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fef0006c8f0 0x7fef0006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:10.071 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.073+0000 7fef1be00640 1 -- 172.21.15.72:0/443710964 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fef0c08af80 con 0x7fef240d14b0 2024-04-04T06:57:10.071 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.073+0000 7fef23400640 1 --2- 172.21.15.72:0/443710964 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fef0006c8f0 0x7fef0006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:10.072 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.073+0000 7fef23400640 1 --2- 172.21.15.72:0/443710964 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fef0006c8f0 0x7fef0006edb0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fef240b9420 tx=0x7fef14008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:10.075 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.077+0000 7fef1be00640 1 -- 172.21.15.72:0/443710964 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fef0c0593b0 con 0x7fef240d14b0 2024-04-04T06:57:10.287 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.288+0000 7fef29200640 1 -- 172.21.15.72:0/443710964 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fef240756c0 con 0x7fef240d14b0 2024-04-04T06:57:10.287 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.289+0000 7fef1be00640 1 -- 172.21.15.72:0/443710964 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) ==== 93+0+10 (secure 0 0 0) 0x7fef0c058cb0 con 0x7fef240d14b0 2024-04-04T06:57:10.288 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 1 2024-04-04T06:57:10.290 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.291+0000 7fef29200640 1 -- 172.21.15.72:0/443710964 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fef0006c8f0 msgr2=0x7fef0006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:10.291 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.292+0000 7fef29200640 1 --2- 172.21.15.72:0/443710964 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fef0006c8f0 0x7fef0006edb0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fef240b9420 tx=0x7fef14008040 comp rx=0 tx=0).stop 2024-04-04T06:57:10.291 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.292+0000 7fef29200640 1 -- 172.21.15.72:0/443710964 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fef240d14b0 msgr2=0x7fef240cc900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:10.291 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.292+0000 7fef29200640 1 --2- 172.21.15.72:0/443710964 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fef240d14b0 0x7fef240cc900 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fef0c00c400 tx=0x7fef0c00c8c0 comp rx=0 tx=0).stop 2024-04-04T06:57:10.291 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.292+0000 7fef29200640 1 -- 172.21.15.72:0/443710964 shutdown_connections 2024-04-04T06:57:10.291 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.292+0000 7fef29200640 1 --2- 172.21.15.72:0/443710964 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fef0006c8f0 0x7fef0006edb0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:10.291 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.292+0000 7fef29200640 1 --2- 172.21.15.72:0/443710964 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fef2415e1d0 0x7fef2414f190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:10.291 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.292+0000 7fef29200640 1 --2- 172.21.15.72:0/443710964 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fef240d14b0 0x7fef240cc900 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:10.291 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.292+0000 7fef29200640 1 --2- 172.21.15.72:0/443710964 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fef240d1050 0x7fef240b8a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:10.291 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.292+0000 7fef29200640 1 -- 172.21.15.72:0/443710964 >> 172.21.15.72:0/443710964 conn(0x7fef2406b8c0 msgr2=0x7fef240b4b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:10.291 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.292+0000 7fef29200640 1 -- 172.21.15.72:0/443710964 shutdown_connections 2024-04-04T06:57:10.291 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.292+0000 7fef29200640 1 -- 172.21.15.72:0/443710964 wait complete. 2024-04-04T06:57:10.308 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-04T06:57:10.493 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.494+0000 7f018f800640 1 Processor -- start 2024-04-04T06:57:10.493 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.494+0000 7f018f800640 1 -- start start 2024-04-04T06:57:10.494 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.496+0000 7f018f800640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0188145b10 0x7f018806d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:10.494 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.496+0000 7f018f800640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f01880d0110 0x7f0188071430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:10.495 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.496+0000 7f018f800640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0188145ef0 con 0x7f018806dac0 2024-04-04T06:57:10.495 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.496+0000 7f018f800640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f01880cea10 con 0x7f0188145b10 2024-04-04T06:57:10.495 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.496+0000 7f018f800640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f018806e310 con 0x7f01880d0110 2024-04-04T06:57:10.495 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.496+0000 7f018ce00640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0188145b10 0x7f018806d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:10.495 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.496+0000 7f018ce00640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0188145b10 0x7f018806d580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:33448/0 (socket says 172.21.15.72:33448) 2024-04-04T06:57:10.495 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.496+0000 7f018ce00640 1 -- 172.21.15.72:0/1804333390 learned_addr learned my addr 172.21.15.72:0/1804333390 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:57:10.496 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.496+0000 7f018d800640 1 --2- 172.21.15.72:0/1804333390 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f01880d0110 0x7f0188071430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:10.496 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.496+0000 7f018ce00640 1 -- 172.21.15.72:0/1804333390 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f01880d0110 msgr2=0x7f0188071430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:57:10.496 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.496+0000 7f018ce00640 1 --2- 172.21.15.72:0/1804333390 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f01880d0110 0x7f0188071430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:10.496 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.496+0000 7f018ce00640 1 -- 172.21.15.72:0/1804333390 >> v1:172.21.15.117:6789/0 conn(0x7f018806dac0 legacy=0x7f01880cfa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:57:10.496 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.496+0000 7f018ce00640 1 -- 172.21.15.72:0/1804333390 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01880cec40 con 0x7f0188145b10 2024-04-04T06:57:10.496 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.497+0000 7f018d800640 1 --2- 172.21.15.72:0/1804333390 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f01880d0110 0x7f0188071430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-04T06:57:10.497 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.499+0000 7f018ce00640 1 --2- 172.21.15.72:0/1804333390 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0188145b10 0x7f018806d580 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f018806e490 tx=0x7f017c02b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccdcb643a9149ca3 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:10.497 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.499+0000 7f0187400640 1 -- 172.21.15.72:0/1804333390 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f017c0317c0 con 0x7f0188145b10 2024-04-04T06:57:10.498 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.499+0000 7f0187400640 1 -- 172.21.15.72:0/1804333390 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f017c037070 con 0x7f0188145b10 2024-04-04T06:57:10.498 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.499+0000 7f0187400640 1 -- 172.21.15.72:0/1804333390 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f017c031b80 con 0x7f0188145b10 2024-04-04T06:57:10.499 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.500+0000 7f018f800640 1 -- 172.21.15.72:0/1804333390 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0188145b10 msgr2=0x7f018806d580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:10.499 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.500+0000 7f018f800640 1 --2- 172.21.15.72:0/1804333390 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0188145b10 0x7f018806d580 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f018806e490 tx=0x7f017c02b860 comp rx=0 tx=0).stop 2024-04-04T06:57:10.499 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.500+0000 7f018f800640 1 -- 172.21.15.72:0/1804333390 shutdown_connections 2024-04-04T06:57:10.499 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.500+0000 7f018f800640 1 --2- 172.21.15.72:0/1804333390 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f01880d0110 0x7f0188071430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:10.499 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.500+0000 7f018f800640 1 --2- 172.21.15.72:0/1804333390 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0188145b10 0x7f018806d580 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:10.499 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.500+0000 7f018f800640 1 -- 172.21.15.72:0/1804333390 >> 172.21.15.72:0/1804333390 conn(0x7f018806b470 msgr2=0x7f018806b850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:10.499 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.500+0000 7f018f800640 1 -- 172.21.15.72:0/1804333390 shutdown_connections 2024-04-04T06:57:10.499 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.500+0000 7f018f800640 1 -- 172.21.15.72:0/1804333390 wait complete. 2024-04-04T06:57:10.500 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.502+0000 7f018f800640 1 Processor -- start 2024-04-04T06:57:10.500 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.502+0000 7f018f800640 1 -- start start 2024-04-04T06:57:10.503 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.504+0000 7f018f800640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f018806dac0 0x7f018815dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:10.503 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.504+0000 7f018f800640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f01880d0110 0x7f0188141d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:10.503 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.504+0000 7f018f800640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0188145b10 0x7f01881422b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:10.503 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.504+0000 7f018f800640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f01880cf4e0 con 0x7f018806dac0 2024-04-04T06:57:10.503 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.504+0000 7f018f800640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f01880cf200 con 0x7f0188145b10 2024-04-04T06:57:10.504 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.504+0000 7f018f800640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f018806df70 con 0x7f01880d0110 2024-04-04T06:57:10.504 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.504+0000 7f018ce00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f018806dac0 0x7f018815dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:10.504 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.504+0000 7f018ce00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f018806dac0 0x7f018815dbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:33456/0 (socket says 172.21.15.72:33456) 2024-04-04T06:57:10.504 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.504+0000 7f018ce00640 1 -- 172.21.15.72:0/4267041204 learned_addr learned my addr 172.21.15.72:0/4267041204 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:57:10.504 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.504+0000 7f0187e00640 1 --2- 172.21.15.72:0/4267041204 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f01880d0110 0x7f0188141d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:10.504 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.504+0000 7f018d800640 1 --2- 172.21.15.72:0/4267041204 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0188145b10 0x7f01881422b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:10.504 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.504+0000 7f018ce00640 1 -- 172.21.15.72:0/4267041204 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f01880d0110 msgr2=0x7f0188141d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:10.504 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.504+0000 7f018ce00640 1 --2- 172.21.15.72:0/4267041204 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f01880d0110 0x7f0188141d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:10.504 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.504+0000 7f018ce00640 1 -- 172.21.15.72:0/4267041204 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0188145b10 msgr2=0x7f01881422b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:10.504 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.504+0000 7f018ce00640 1 --2- 172.21.15.72:0/4267041204 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0188145b10 0x7f01881422b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:10.504 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.504+0000 7f018ce00640 1 -- 172.21.15.72:0/4267041204 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01881f43a0 con 0x7f018806dac0 2024-04-04T06:57:10.504 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.505+0000 7f018ce00640 1 --2- 172.21.15.72:0/4267041204 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f018806dac0 0x7f018815dbe0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f017c000c00 tx=0x7f017c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:10.505 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.505+0000 7f0184c00640 1 -- 172.21.15.72:0/4267041204 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f017c032860 con 0x7f018806dac0 2024-04-04T06:57:10.505 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.505+0000 7f0184c00640 1 -- 172.21.15.72:0/4267041204 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f017c032a00 con 0x7f018806dac0 2024-04-04T06:57:10.505 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.505+0000 7f0184c00640 1 -- 172.21.15.72:0/4267041204 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f017c032dd0 con 0x7f018806dac0 2024-04-04T06:57:10.505 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.505+0000 7f018f800640 1 -- 172.21.15.72:0/4267041204 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01881f4610 con 0x7f018806dac0 2024-04-04T06:57:10.505 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.505+0000 7f018f800640 1 -- 172.21.15.72:0/4267041204 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01881f4bd0 con 0x7f018806dac0 2024-04-04T06:57:10.506 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.507+0000 7f018f800640 1 -- 172.21.15.72:0/4267041204 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0188075730 con 0x7f018806dac0 2024-04-04T06:57:10.506 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.507+0000 7f0184c00640 1 -- 172.21.15.72:0/4267041204 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f017c04c060 con 0x7f018806dac0 2024-04-04T06:57:10.507 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.509+0000 7f0184c00640 1 --2- 172.21.15.72:0/4267041204 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f016806c920 0x7f016806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:10.507 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.509+0000 7f0184c00640 1 -- 172.21.15.72:0/4267041204 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5825+0+0 (secure 0 0 0) 0x7f017c0ad980 con 0x7f018806dac0 2024-04-04T06:57:10.507 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.509+0000 7f0187e00640 1 --2- 172.21.15.72:0/4267041204 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f016806c920 0x7f016806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:10.508 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.510+0000 7f0187e00640 1 --2- 172.21.15.72:0/4267041204 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f016806c920 0x7f016806ede0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f0174006fd0 tx=0x7f0174008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:10.511 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.513+0000 7f0184c00640 1 -- 172.21.15.72:0/4267041204 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f017c040070 con 0x7f018806dac0 2024-04-04T06:57:10.710 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.711+0000 7f018f800640 1 -- 172.21.15.72:0/4267041204 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f018815d2a0 con 0x7f018806dac0 2024-04-04T06:57:10.710 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.712+0000 7f0184c00640 1 -- 172.21.15.72:0/4267041204 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) ==== 104+0+11 (secure 0 0 0) 0x7f017c07b6e0 con 0x7f018806dac0 2024-04-04T06:57:10.711 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2024-04-04T06:57:10.715 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.715+0000 7f018f800640 1 -- 172.21.15.72:0/4267041204 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f016806c920 msgr2=0x7f016806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:10.715 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.715+0000 7f018f800640 1 --2- 172.21.15.72:0/4267041204 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f016806c920 0x7f016806ede0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f0174006fd0 tx=0x7f0174008040 comp rx=0 tx=0).stop 2024-04-04T06:57:10.715 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.715+0000 7f018f800640 1 -- 172.21.15.72:0/4267041204 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f018806dac0 msgr2=0x7f018815dbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:10.715 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.715+0000 7f018f800640 1 --2- 172.21.15.72:0/4267041204 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f018806dac0 0x7f018815dbe0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f017c000c00 tx=0x7f017c0046c0 comp rx=0 tx=0).stop 2024-04-04T06:57:10.715 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.716+0000 7f018f800640 1 -- 172.21.15.72:0/4267041204 shutdown_connections 2024-04-04T06:57:10.715 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.716+0000 7f018f800640 1 --2- 172.21.15.72:0/4267041204 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f016806c920 0x7f016806ede0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:10.715 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.716+0000 7f018f800640 1 --2- 172.21.15.72:0/4267041204 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0188145b10 0x7f01881422b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:10.715 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.716+0000 7f018f800640 1 --2- 172.21.15.72:0/4267041204 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f01880d0110 0x7f0188141d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:10.715 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.716+0000 7f018f800640 1 --2- 172.21.15.72:0/4267041204 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f018806dac0 0x7f018815dbe0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:10.715 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.716+0000 7f018f800640 1 -- 172.21.15.72:0/4267041204 >> 172.21.15.72:0/4267041204 conn(0x7f018806b470 msgr2=0x7f018815a480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:10.715 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.716+0000 7f018f800640 1 -- 172.21.15.72:0/4267041204 shutdown_connections 2024-04-04T06:57:10.715 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.716+0000 7f018f800640 1 -- 172.21.15.72:0/4267041204 wait complete. 2024-04-04T06:57:10.741 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-04T06:57:10.942 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.943+0000 7f3690a00640 1 Processor -- start 2024-04-04T06:57:10.942 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.943+0000 7f3690a00640 1 -- start start 2024-04-04T06:57:10.944 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.945+0000 7f3690a00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f368c15c5c0 0x7f368c071bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:10.944 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.945+0000 7f3690a00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f368c067f70 0x7f368c072130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:10.944 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.945+0000 7f3690a00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f368c0704a0 con 0x7f368c06e950 2024-04-04T06:57:10.944 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.945+0000 7f3690a00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f368c072d40 con 0x7f368c067f70 2024-04-04T06:57:10.944 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.945+0000 7f3690a00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f368c0cae60 con 0x7f368c15c5c0 2024-04-04T06:57:10.944 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.946+0000 7f3689e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f368c15c5c0 0x7f368c071bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:10.945 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.946+0000 7f3689e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f368c15c5c0 0x7f368c071bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.72:54972/0 (socket says 172.21.15.72:54972) 2024-04-04T06:57:10.945 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.946+0000 7f3689e00640 1 -- 172.21.15.72:0/2895358356 learned_addr learned my addr 172.21.15.72:0/2895358356 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:57:10.945 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.946+0000 7f368a800640 1 --2- 172.21.15.72:0/2895358356 >> v2:172.21.15.117:3300/0 conn(0x7f368c067f70 0x7f368c072130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:10.945 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.947+0000 7f3689e00640 1 -- 172.21.15.72:0/2895358356 >> v2:172.21.15.117:3300/0 conn(0x7f368c067f70 msgr2=0x7f368c072130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:57:10.945 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.947+0000 7f3689e00640 1 --2- 172.21.15.72:0/2895358356 >> v2:172.21.15.117:3300/0 conn(0x7f368c067f70 0x7f368c072130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:10.945 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.947+0000 7f3689e00640 1 -- 172.21.15.72:0/2895358356 >> v1:172.21.15.117:6789/0 conn(0x7f368c06e950 legacy=0x7f368c160090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:10.945 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.947+0000 7f3689e00640 1 -- 172.21.15.72:0/2895358356 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f368c0cb140 con 0x7f368c15c5c0 2024-04-04T06:57:10.946 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.948+0000 7f3689e00640 1 --2- 172.21.15.72:0/2895358356 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f368c15c5c0 0x7f368c071bf0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f367c009870 tx=0x7f367c02b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c0f1ccb101a71491 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:10.947 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.948+0000 7f3689400640 1 -- 172.21.15.72:0/2895358356 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f367c034070 con 0x7f368c15c5c0 2024-04-04T06:57:10.947 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.948+0000 7f3689400640 1 -- 172.21.15.72:0/2895358356 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f367c030840 con 0x7f368c15c5c0 2024-04-04T06:57:10.947 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.948+0000 7f3689400640 1 -- 172.21.15.72:0/2895358356 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f367c030c10 con 0x7f368c15c5c0 2024-04-04T06:57:10.948 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.949+0000 7f3690a00640 1 -- 172.21.15.72:0/2895358356 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f368c15c5c0 msgr2=0x7f368c071bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:10.948 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.949+0000 7f3690a00640 1 --2- 172.21.15.72:0/2895358356 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f368c15c5c0 0x7f368c071bf0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f367c009870 tx=0x7f367c02b980 comp rx=0 tx=0).stop 2024-04-04T06:57:10.948 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.949+0000 7f3690a00640 1 -- 172.21.15.72:0/2895358356 shutdown_connections 2024-04-04T06:57:10.948 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.949+0000 7f3690a00640 1 --2- 172.21.15.72:0/2895358356 >> v2:172.21.15.117:3300/0 conn(0x7f368c067f70 0x7f368c072130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:10.948 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.949+0000 7f3690a00640 1 --2- 172.21.15.72:0/2895358356 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f368c15c5c0 0x7f368c071bf0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:10.948 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.949+0000 7f3690a00640 1 -- 172.21.15.72:0/2895358356 >> 172.21.15.72:0/2895358356 conn(0x7f368c0d0770 msgr2=0x7f368c0d0b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:10.948 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.949+0000 7f3690a00640 1 -- 172.21.15.72:0/2895358356 shutdown_connections 2024-04-04T06:57:10.948 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.949+0000 7f3690a00640 1 -- 172.21.15.72:0/2895358356 wait complete. 2024-04-04T06:57:10.949 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.951+0000 7f3690a00640 1 Processor -- start 2024-04-04T06:57:10.949 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.951+0000 7f3690a00640 1 -- start start 2024-04-04T06:57:10.951 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.952+0000 7f3690a00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f368c067f70 0x7f368c14feb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:10.952 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.952+0000 7f3690a00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f368c06e950 0x7f368c0b55d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:10.952 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.952+0000 7f3690a00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f368c15c5c0 0x7f368c159b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:10.952 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.952+0000 7f3690a00640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f368c0700c0 con 0x7f368c067f70 2024-04-04T06:57:10.952 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.952+0000 7f3690a00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f368c0cb700 con 0x7f368c15c5c0 2024-04-04T06:57:10.952 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.952+0000 7f3690a00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f368c070240 con 0x7f368c06e950 2024-04-04T06:57:10.952 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.952+0000 7f3689e00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f368c067f70 0x7f368c14feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:10.952 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.952+0000 7f3689e00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f368c067f70 0x7f368c14feb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:33472/0 (socket says 172.21.15.72:33472) 2024-04-04T06:57:10.952 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.952+0000 7f3689e00640 1 -- 172.21.15.72:0/356964324 learned_addr learned my addr 172.21.15.72:0/356964324 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:57:10.952 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.953+0000 7f3683e00640 1 --2- 172.21.15.72:0/356964324 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f368c06e950 0x7f368c0b55d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:10.952 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.953+0000 7f368a800640 1 --2- 172.21.15.72:0/356964324 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f368c15c5c0 0x7f368c159b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:10.952 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.953+0000 7f3689e00640 1 -- 172.21.15.72:0/356964324 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f368c06e950 msgr2=0x7f368c0b55d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:10.952 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.953+0000 7f3689e00640 1 --2- 172.21.15.72:0/356964324 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f368c06e950 0x7f368c0b55d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:10.952 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.953+0000 7f3689e00640 1 -- 172.21.15.72:0/356964324 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f368c15c5c0 msgr2=0x7f368c159b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:10.953 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.953+0000 7f3689e00640 1 --2- 172.21.15.72:0/356964324 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f368c15c5c0 0x7f368c159b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:10.953 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.953+0000 7f3689e00640 1 -- 172.21.15.72:0/356964324 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f368c158ad0 con 0x7f368c067f70 2024-04-04T06:57:10.953 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.953+0000 7f368a800640 1 --2- 172.21.15.72:0/356964324 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f368c15c5c0 0x7f368c159b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-04T06:57:10.953 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.953+0000 7f3689e00640 1 --2- 172.21.15.72:0/356964324 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f368c067f70 0x7f368c14feb0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f367c0090b0 tx=0x7f367c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:10.954 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.953+0000 7f3682000640 1 -- 172.21.15.72:0/356964324 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f367c034040 con 0x7f368c067f70 2024-04-04T06:57:10.954 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.953+0000 7f3682000640 1 -- 172.21.15.72:0/356964324 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f367c03ada0 con 0x7f368c067f70 2024-04-04T06:57:10.954 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.953+0000 7f3682000640 1 -- 172.21.15.72:0/356964324 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f367c044610 con 0x7f368c067f70 2024-04-04T06:57:10.954 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.953+0000 7f3690a00640 1 -- 172.21.15.72:0/356964324 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f368c158db0 con 0x7f368c067f70 2024-04-04T06:57:10.954 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.954+0000 7f3690a00640 1 -- 172.21.15.72:0/356964324 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f368c159370 con 0x7f368c067f70 2024-04-04T06:57:10.954 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.955+0000 7f3690a00640 1 -- 172.21.15.72:0/356964324 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f368c0685a0 con 0x7f368c067f70 2024-04-04T06:57:10.955 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.956+0000 7f3682000640 1 -- 172.21.15.72:0/356964324 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f367c04b060 con 0x7f368c067f70 2024-04-04T06:57:10.956 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.958+0000 7f3682000640 1 --2- 172.21.15.72:0/356964324 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f366806c8f0 0x7f366806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:10.956 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.958+0000 7f3682000640 1 -- 172.21.15.72:0/356964324 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5825+0+0 (secure 0 0 0) 0x7f367c0adba0 con 0x7f368c067f70 2024-04-04T06:57:10.957 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.958+0000 7f3683e00640 1 --2- 172.21.15.72:0/356964324 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f366806c8f0 0x7f366806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:10.957 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.959+0000 7f3683e00640 1 --2- 172.21.15.72:0/356964324 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f366806c8f0 0x7f366806edb0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f3674007fd0 tx=0x7f3674009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:10.960 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:10.962+0000 7f3682000640 1 -- 172.21.15.72:0/356964324 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f367c03f070 con 0x7f368c067f70 2024-04-04T06:57:11.159 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:11.161+0000 7f3690a00640 1 -- 172.21.15.72:0/356964324 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f368c0729d0 con 0x7f368c067f70 2024-04-04T06:57:11.160 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:11.161+0000 7f3682000640 1 -- 172.21.15.72:0/356964324 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) ==== 100+0+11 (secure 0 0 0) 0x7f367c07c060 con 0x7f368c067f70 2024-04-04T06:57:11.160 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 64 2024-04-04T06:57:11.163 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:11.164+0000 7f3690a00640 1 -- 172.21.15.72:0/356964324 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f366806c8f0 msgr2=0x7f366806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:11.163 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:11.164+0000 7f3690a00640 1 --2- 172.21.15.72:0/356964324 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f366806c8f0 0x7f366806edb0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f3674007fd0 tx=0x7f3674009040 comp rx=0 tx=0).stop 2024-04-04T06:57:11.163 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:11.164+0000 7f3690a00640 1 -- 172.21.15.72:0/356964324 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f368c067f70 msgr2=0x7f368c14feb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:11.163 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:11.164+0000 7f3690a00640 1 --2- 172.21.15.72:0/356964324 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f368c067f70 0x7f368c14feb0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f367c0090b0 tx=0x7f367c0046c0 comp rx=0 tx=0).stop 2024-04-04T06:57:11.163 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:11.164+0000 7f3690a00640 1 -- 172.21.15.72:0/356964324 shutdown_connections 2024-04-04T06:57:11.163 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:11.164+0000 7f3690a00640 1 --2- 172.21.15.72:0/356964324 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f366806c8f0 0x7f366806edb0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:11.163 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:11.164+0000 7f3690a00640 1 --2- 172.21.15.72:0/356964324 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f368c15c5c0 0x7f368c159b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:11.163 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:11.164+0000 7f3690a00640 1 --2- 172.21.15.72:0/356964324 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f368c06e950 0x7f368c0b55d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:11.163 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:11.164+0000 7f3690a00640 1 --2- 172.21.15.72:0/356964324 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f368c067f70 0x7f368c14feb0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:11.163 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:11.164+0000 7f3690a00640 1 -- 172.21.15.72:0/356964324 >> 172.21.15.72:0/356964324 conn(0x7f368c0d0770 msgr2=0x7f368c0b1b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:11.163 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:11.164+0000 7f3690a00640 1 -- 172.21.15.72:0/356964324 shutdown_connections 2024-04-04T06:57:11.163 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:11.164+0000 7f3690a00640 1 -- 172.21.15.72:0/356964324 wait complete. 2024-04-04T06:57:11.182 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic' 2024-04-04T06:57:11.373 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:11.374+0000 7fee8ae00640 1 Processor -- start 2024-04-04T06:57:11.373 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:11.374+0000 7fee8ae00640 1 -- start start 2024-04-04T06:57:11.375 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:11.375+0000 7fee8ae00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fee84073570 0x7fee84071610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:11.375 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:11.375+0000 7fee8ae00640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fee840ccad0 0x7fee840ccee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:11.375 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:11.376+0000 7fee8ae00640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee840cd420 con 0x7fee8406eee0 2024-04-04T06:57:11.375 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:11.376+0000 7fee8ae00640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7fee84073950 con 0x7fee840ccad0 2024-04-04T06:57:11.375 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:11.376+0000 7fee8ae00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fee840cb520 con 0x7fee84073570 2024-04-04T06:57:11.375 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:11.376+0000 7fee88e00640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fee840ccad0 0x7fee840ccee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:11.375 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:11.376+0000 7fee88e00640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fee840ccad0 0x7fee840ccee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:33484/0 (socket says 172.21.15.72:33484) 2024-04-04T06:57:11.375 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:11.376+0000 7fee88e00640 1 -- 172.21.15.72:0/964114252 learned_addr learned my addr 172.21.15.72:0/964114252 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:57:11.375 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:11.376+0000 7fee83e00640 1 --2- 172.21.15.72:0/964114252 >> v2:172.21.15.117:3300/0 conn(0x7fee84073570 0x7fee84071610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:11.375 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:11.376+0000 7fee88e00640 1 -- 172.21.15.72:0/964114252 >> v2:172.21.15.117:3300/0 conn(0x7fee84073570 msgr2=0x7fee84071610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:57:11.375 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:11.376+0000 7fee88e00640 1 --2- 172.21.15.72:0/964114252 >> v2:172.21.15.117:3300/0 conn(0x7fee84073570 0x7fee84071610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:11.376 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:11.376+0000 7fee88e00640 1 -- 172.21.15.72:0/964114252 >> v1:172.21.15.72:6789/0 conn(0x7fee8406eee0 legacy=0x7fee840b3700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:11.376 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:11.376+0000 7fee88e00640 1 -- 172.21.15.72:0/964114252 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee840b3f50 con 0x7fee840ccad0 2024-04-04T06:57:11.376 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:11.378+0000 7fee88e00640 1 --2- 172.21.15.72:0/964114252 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fee840ccad0 0x7fee840ccee0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fee8406f770 tx=0x7fee7c02c010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15ce46de5be4afd6 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:11.376 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:11.378+0000 7fee82a00640 1 -- 172.21.15.72:0/964114252 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee7c02cbb0 con 0x7fee840ccad0 2024-04-04T06:57:11.377 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:11.378+0000 7fee82a00640 1 -- 172.21.15.72:0/964114252 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee7c02cd50 con 0x7fee840ccad0 2024-04-04T06:57:11.377 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:11.378+0000 7fee82a00640 1 -- 172.21.15.72:0/964114252 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee7c034610 con 0x7fee840ccad0 2024-04-04T06:57:11.377 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:11.378+0000 7fee8ae00640 1 -- 172.21.15.72:0/964114252 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fee840ccad0 msgr2=0x7fee840ccee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:11.377 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:11.378+0000 7fee8ae00640 1 --2- 172.21.15.72:0/964114252 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fee840ccad0 0x7fee840ccee0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fee8406f770 tx=0x7fee7c02c010 comp rx=0 tx=0).stop 2024-04-04T06:57:11.378 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:11.379+0000 7fee8ae00640 1 -- 172.21.15.72:0/964114252 shutdown_connections 2024-04-04T06:57:11.378 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:11.379+0000 7fee8ae00640 1 --2- 172.21.15.72:0/964114252 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fee840ccad0 0x7fee840ccee0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:11.378 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:11.379+0000 7fee8ae00640 1 --2- 172.21.15.72:0/964114252 >> v2:172.21.15.117:3300/0 conn(0x7fee84073570 0x7fee84071610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:11.378 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:11.379+0000 7fee8ae00640 1 -- 172.21.15.72:0/964114252 >> 172.21.15.72:0/964114252 conn(0x7fee8406b470 msgr2=0x7fee8406b880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:11.378 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:11.379+0000 7fee8ae00640 1 -- 172.21.15.72:0/964114252 shutdown_connections 2024-04-04T06:57:11.378 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:11.379+0000 7fee8ae00640 1 -- 172.21.15.72:0/964114252 wait complete. 2024-04-04T06:57:11.379 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:11.380+0000 7fee8ae00640 1 Processor -- start 2024-04-04T06:57:11.379 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:11.380+0000 7fee8ae00640 1 -- start start 2024-04-04T06:57:11.381 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:11.381+0000 7fee8ae00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fee8406eee0 0x7fee841f3f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:11.381 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:11.381+0000 7fee8ae00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fee84073570 0x7fee840c5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:11.381 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:11.381+0000 7fee8ae00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fee840ccad0 0x7fee840c5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:11.381 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:11.381+0000 7fee8ae00640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fee840b47f0 con 0x7fee84073570 2024-04-04T06:57:11.381 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:11.381+0000 7fee8ae00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fee840b4510 con 0x7fee8406eee0 2024-04-04T06:57:11.381 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:11.381+0000 7fee8ae00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fee840b4970 con 0x7fee840ccad0 2024-04-04T06:57:11.381 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:11.382+0000 7fee83400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fee84073570 0x7fee840c5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:11.381 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:11.382+0000 7fee83400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fee84073570 0x7fee840c5240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:33498/0 (socket says 172.21.15.72:33498) 2024-04-04T06:57:11.381 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:11.382+0000 7fee83400640 1 -- 172.21.15.72:0/461355861 learned_addr learned my addr 172.21.15.72:0/461355861 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:57:11.381 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:11.382+0000 7fee83e00640 1 --2- 172.21.15.72:0/461355861 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fee8406eee0 0x7fee841f3f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:11.381 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:11.382+0000 7fee83400640 1 -- 172.21.15.72:0/461355861 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fee840ccad0 msgr2=0x7fee840c5780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:11.382 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:11.382+0000 7fee83400640 1 --2- 172.21.15.72:0/461355861 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fee840ccad0 0x7fee840c5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:11.382 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:11.382+0000 7fee83400640 1 -- 172.21.15.72:0/461355861 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fee8406eee0 msgr2=0x7fee841f3f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:11.382 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:11.382+0000 7fee83400640 1 --2- 172.21.15.72:0/461355861 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fee8406eee0 0x7fee841f3f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:11.382 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:11.382+0000 7fee83400640 1 -- 172.21.15.72:0/461355861 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee8415f130 con 0x7fee84073570 2024-04-04T06:57:11.382 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:11.382+0000 7fee83e00640 1 --2- 172.21.15.72:0/461355861 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fee8406eee0 0x7fee841f3f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-04T06:57:11.382 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:11.382+0000 7fee83400640 1 --2- 172.21.15.72:0/461355861 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fee84073570 0x7fee840c5240 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fee7000c400 tx=0x7fee7000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:11.383 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:11.383+0000 7fee7be00640 1 -- 172.21.15.72:0/461355861 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee700052d0 con 0x7fee84073570 2024-04-04T06:57:11.383 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:11.383+0000 7fee7be00640 1 -- 172.21.15.72:0/461355861 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee70005490 con 0x7fee84073570 2024-04-04T06:57:11.383 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:11.383+0000 7fee7be00640 1 -- 172.21.15.72:0/461355861 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee70007260 con 0x7fee84073570 2024-04-04T06:57:11.383 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:11.383+0000 7fee8ae00640 1 -- 172.21.15.72:0/461355861 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee840cf920 con 0x7fee84073570 2024-04-04T06:57:11.383 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:11.383+0000 7fee8ae00640 1 -- 172.21.15.72:0/461355861 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee840c6780 con 0x7fee84073570 2024-04-04T06:57:11.383 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:11.384+0000 7fee8ae00640 1 -- 172.21.15.72:0/461355861 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee8415f300 con 0x7fee84073570 2024-04-04T06:57:11.383 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:11.385+0000 7fee7be00640 1 -- 172.21.15.72:0/461355861 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fee70007400 con 0x7fee84073570 2024-04-04T06:57:11.384 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:11.386+0000 7fee7be00640 1 --2- 172.21.15.72:0/461355861 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fee6406c920 0x7fee6406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:11.384 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:11.386+0000 7fee7be00640 1 -- 172.21.15.72:0/461355861 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7fee7008b050 con 0x7fee84073570 2024-04-04T06:57:11.384 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:11.386+0000 7fee83e00640 1 --2- 172.21.15.72:0/461355861 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fee6406c920 0x7fee6406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:11.385 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:11.387+0000 7fee83e00640 1 --2- 172.21.15.72:0/461355861 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fee6406c920 0x7fee6406ede0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fee74006fd0 tx=0x7fee74008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:11.389 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:11.391+0000 7fee7be00640 1 -- 172.21.15.72:0/461355861 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fee8415f300 con 0x7fee84073570 2024-04-04T06:57:11.661 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:11.662+0000 7fee8ae00640 1 -- 172.21.15.72:0/461355861 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]} v 0) -- 0x7fee840c6a40 con 0x7fee84073570 2024-04-04T06:57:12.268 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:12.270+0000 7fee7be00640 1 -- 172.21.15.72:0/461355861 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]}]=0 v61) ==== 147+0+0 (secure 0 0 0) 0x7fee840cd420 con 0x7fee84073570 2024-04-04T06:57:12.271 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:12.272+0000 7fee8ae00640 1 -- 172.21.15.72:0/461355861 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fee6406c920 msgr2=0x7fee6406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:12.272 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:12.272+0000 7fee8ae00640 1 --2- 172.21.15.72:0/461355861 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fee6406c920 0x7fee6406ede0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fee74006fd0 tx=0x7fee74008040 comp rx=0 tx=0).stop 2024-04-04T06:57:12.272 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:12.273+0000 7fee8ae00640 1 -- 172.21.15.72:0/461355861 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fee84073570 msgr2=0x7fee840c5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:12.272 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:12.273+0000 7fee8ae00640 1 --2- 172.21.15.72:0/461355861 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fee84073570 0x7fee840c5240 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fee7000c400 tx=0x7fee7000c8c0 comp rx=0 tx=0).stop 2024-04-04T06:57:12.272 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:12.273+0000 7fee8ae00640 1 -- 172.21.15.72:0/461355861 shutdown_connections 2024-04-04T06:57:12.272 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:12.273+0000 7fee8ae00640 1 --2- 172.21.15.72:0/461355861 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fee6406c920 0x7fee6406ede0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:12.272 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:12.273+0000 7fee8ae00640 1 --2- 172.21.15.72:0/461355861 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fee840ccad0 0x7fee840c5780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:12.272 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:12.273+0000 7fee8ae00640 1 --2- 172.21.15.72:0/461355861 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fee84073570 0x7fee840c5240 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:12.272 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:12.273+0000 7fee8ae00640 1 --2- 172.21.15.72:0/461355861 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fee8406eee0 0x7fee841f3f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:12.272 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:12.273+0000 7fee8ae00640 1 -- 172.21.15.72:0/461355861 >> 172.21.15.72:0/461355861 conn(0x7fee8406b470 msgr2=0x7fee840b07c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:12.272 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:12.273+0000 7fee8ae00640 1 -- 172.21.15.72:0/461355861 shutdown_connections 2024-04-04T06:57:12.272 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:12.273+0000 7fee8ae00640 1 -- 172.21.15.72:0/461355861 wait complete. 2024-04-04T06:57:12.292 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-04-04T06:57:12.498 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:12.499+0000 7fbfe9c00640 1 Processor -- start 2024-04-04T06:57:12.498 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:12.499+0000 7fbfe9c00640 1 -- start start 2024-04-04T06:57:12.499 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:12.500+0000 7fbfe9c00640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fbfe40b6aa0 0x7fbfe40d2410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:12.499 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:12.500+0000 7fbfe9c00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbfe40d2950 0x7fbfe40b7520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:12.499 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:12.500+0000 7fbfe9c00640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbfe40d3100 con 0x7fbfe415e6c0 2024-04-04T06:57:12.499 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:12.500+0000 7fbfe9c00640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7fbfe415eaa0 con 0x7fbfe40b6aa0 2024-04-04T06:57:12.499 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:12.500+0000 7fbfe9c00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fbfe40d33e0 con 0x7fbfe40d2950 2024-04-04T06:57:12.500 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:12.501+0000 7fbfe2a00640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fbfe415e6c0 0x7fbfe40b6390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:39406/0 (socket says 172.21.15.72:39406) 2024-04-04T06:57:12.500 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:12.501+0000 7fbfe2a00640 1 -- 172.21.15.72:0/3239316661 learned_addr learned my addr 172.21.15.72:0/3239316661 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-04-04T06:57:12.500 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:12.501+0000 7fbfe2000640 1 --2- 172.21.15.72:0/3239316661 >> v2:172.21.15.72:3300/0 conn(0x7fbfe40b6aa0 0x7fbfe40d2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:12.500 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:12.501+0000 7fbfe3400640 1 --2- 172.21.15.72:0/3239316661 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbfe40d2950 0x7fbfe40b7520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:12.501 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:12.501+0000 7fbfe1600640 1 -- 172.21.15.72:0/3239316661 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 834463233 0 0) 0x7fbfe40d3100 con 0x7fbfe415e6c0 2024-04-04T06:57:12.501 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:12.501+0000 7fbfe1600640 1 -- 172.21.15.72:0/3239316661 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbfc8003520 con 0x7fbfe415e6c0 2024-04-04T06:57:12.501 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:12.501+0000 7fbfe1600640 1 -- 172.21.15.72:0/3239316661 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1586192402 0 0) 0x7fbfc8003520 con 0x7fbfe415e6c0 2024-04-04T06:57:12.501 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:12.501+0000 7fbfe2000640 1 -- 172.21.15.72:0/3239316661 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbfe40d2950 msgr2=0x7fbfe40b7520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:57:12.501 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:12.501+0000 7fbfe2000640 1 --2- 172.21.15.72:0/3239316661 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbfe40d2950 0x7fbfe40b7520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:12.501 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:12.501+0000 7fbfe2000640 1 -- 172.21.15.72:0/3239316661 >> v1:172.21.15.72:6789/0 conn(0x7fbfe415e6c0 legacy=0x7fbfe40b6390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:12.501 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:12.501+0000 7fbfe2000640 1 -- 172.21.15.72:0/3239316661 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfe40d36c0 con 0x7fbfe40b6aa0 2024-04-04T06:57:12.502 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:12.502+0000 7fbfe2000640 1 --2- 172.21.15.72:0/3239316661 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbfe40b6aa0 0x7fbfe40d2410 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fbfd00097a0 tx=0x7fbfd002b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b03dbfa48af2346 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:12.502 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:12.503+0000 7fbfe1600640 1 -- 172.21.15.72:0/3239316661 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfd0037070 con 0x7fbfe40b6aa0 2024-04-04T06:57:12.502 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:12.503+0000 7fbfe1600640 1 -- 172.21.15.72:0/3239316661 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbfd0030510 con 0x7fbfe40b6aa0 2024-04-04T06:57:12.502 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:12.503+0000 7fbfe1600640 1 -- 172.21.15.72:0/3239316661 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfd4001670 con 0x7fbfe40b6aa0 2024-04-04T06:57:12.502 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:12.503+0000 7fbfe9c00640 1 -- 172.21.15.72:0/3239316661 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbfe40b6aa0 msgr2=0x7fbfe40d2410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:12.502 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:12.503+0000 7fbfe9c00640 1 --2- 172.21.15.72:0/3239316661 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbfe40b6aa0 0x7fbfe40d2410 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fbfd00097a0 tx=0x7fbfd002b790 comp rx=0 tx=0).stop 2024-04-04T06:57:12.502 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:12.503+0000 7fbfe9c00640 1 -- 172.21.15.72:0/3239316661 shutdown_connections 2024-04-04T06:57:12.502 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:12.503+0000 7fbfe9c00640 1 --2- 172.21.15.72:0/3239316661 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbfe40d2950 0x7fbfe40b7520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:12.503 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:12.503+0000 7fbfe9c00640 1 --2- 172.21.15.72:0/3239316661 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbfe40b6aa0 0x7fbfe40d2410 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:12.503 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:12.503+0000 7fbfe9c00640 1 -- 172.21.15.72:0/3239316661 >> 172.21.15.72:0/3239316661 conn(0x7fbfe4071e80 msgr2=0x7fbfe4072290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:12.503 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:12.504+0000 7fbfe9c00640 1 -- 172.21.15.72:0/3239316661 shutdown_connections 2024-04-04T06:57:12.503 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:12.504+0000 7fbfe9c00640 1 -- 172.21.15.72:0/3239316661 wait complete. 2024-04-04T06:57:12.504 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:12.505+0000 7fbfe9c00640 1 Processor -- start 2024-04-04T06:57:12.504 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:12.505+0000 7fbfe9c00640 1 -- start start 2024-04-04T06:57:12.505 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:12.506+0000 7fbfe9c00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbfe40b6aa0 0x7fbfe41f77e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:12.505 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:12.506+0000 7fbfe9c00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbfe40d2950 0x7fbfe40b8dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:12.505 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:12.506+0000 7fbfe9c00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbfe415e6c0 0x7fbfe40b9310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:12.505 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:12.506+0000 7fbfe9c00640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fbfe40d2d80 con 0x7fbfe415e6c0 2024-04-04T06:57:12.505 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:12.506+0000 7fbfe9c00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fbfe40d3c80 con 0x7fbfe40b6aa0 2024-04-04T06:57:12.505 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:12.506+0000 7fbfe9c00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fbfe40b7a60 con 0x7fbfe40d2950 2024-04-04T06:57:12.505 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:12.507+0000 7fbfe3400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbfe415e6c0 0x7fbfe40b9310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:12.505 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:12.507+0000 7fbfe3400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbfe415e6c0 0x7fbfe40b9310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:33506/0 (socket says 172.21.15.72:33506) 2024-04-04T06:57:12.505 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:12.507+0000 7fbfe3400640 1 -- 172.21.15.72:0/2704498736 learned_addr learned my addr 172.21.15.72:0/2704498736 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:57:12.507 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:12.507+0000 7fbfe2000640 1 --2- 172.21.15.72:0/2704498736 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbfe40d2950 0x7fbfe40b8dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:12.507 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:12.507+0000 7fbfe3400640 1 -- 172.21.15.72:0/2704498736 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbfe40d2950 msgr2=0x7fbfe40b8dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:12.507 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:12.507+0000 7fbfe3400640 1 --2- 172.21.15.72:0/2704498736 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbfe40d2950 0x7fbfe40b8dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:12.507 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:12.507+0000 7fbfe3400640 1 -- 172.21.15.72:0/2704498736 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbfe40b6aa0 msgr2=0x7fbfe41f77e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:12.507 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:12.507+0000 7fbfe3400640 1 --2- 172.21.15.72:0/2704498736 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbfe40b6aa0 0x7fbfe41f77e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:12.508 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:12.507+0000 7fbfe3400640 1 -- 172.21.15.72:0/2704498736 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfe4157060 con 0x7fbfe415e6c0 2024-04-04T06:57:12.508 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:12.507+0000 7fbfe3400640 1 --2- 172.21.15.72:0/2704498736 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbfe415e6c0 0x7fbfe40b9310 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fbfdc00efc0 tx=0x7fbfdc00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:12.508 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:12.507+0000 7fbfdaa00640 1 -- 172.21.15.72:0/2704498736 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfdc018020 con 0x7fbfe415e6c0 2024-04-04T06:57:12.508 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:12.507+0000 7fbfdaa00640 1 -- 172.21.15.72:0/2704498736 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbfdc009b10 con 0x7fbfe415e6c0 2024-04-04T06:57:12.508 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:12.507+0000 7fbfdaa00640 1 -- 172.21.15.72:0/2704498736 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfdc0146c0 con 0x7fbfe415e6c0 2024-04-04T06:57:12.508 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:12.508+0000 7fbfe9c00640 1 -- 172.21.15.72:0/2704498736 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbfe4157340 con 0x7fbfe415e6c0 2024-04-04T06:57:12.508 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:12.508+0000 7fbfe9c00640 1 -- 172.21.15.72:0/2704498736 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbfe40cc440 con 0x7fbfe415e6c0 2024-04-04T06:57:12.508 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:12.509+0000 7fbfe9c00640 1 -- 172.21.15.72:0/2704498736 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbfe4075730 con 0x7fbfe415e6c0 2024-04-04T06:57:12.508 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:12.510+0000 7fbfdaa00640 1 -- 172.21.15.72:0/2704498736 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fbfdc005d10 con 0x7fbfe415e6c0 2024-04-04T06:57:12.510 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:12.511+0000 7fbfdaa00640 1 --2- 172.21.15.72:0/2704498736 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fbfc406c940 0x7fbfc406ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:12.510 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:12.511+0000 7fbfdaa00640 1 -- 172.21.15.72:0/2704498736 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7fbfdc08c5f0 con 0x7fbfe415e6c0 2024-04-04T06:57:12.511 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:12.511+0000 7fbfe2a00640 1 --2- 172.21.15.72:0/2704498736 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fbfc406c940 0x7fbfc406ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:12.511 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:12.512+0000 7fbfe2a00640 1 --2- 172.21.15.72:0/2704498736 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fbfc406c940 0x7fbfc406ee00 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fbfd4005880 tx=0x7fbfd4001080 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:12.514 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:12.515+0000 7fbfdaa00640 1 -- 172.21.15.72:0/2704498736 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fbfdc022070 con 0x7fbfe415e6c0 2024-04-04T06:57:12.702 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:12.703+0000 7fbfe9c00640 1 -- 172.21.15.72:0/2704498736 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7fbfe415c5d0 con 0x7fbfe415e6c0 2024-04-04T06:57:12.706 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:12.707+0000 7fbfdaa00640 1 -- 172.21.15.72:0/2704498736 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) ==== 122+0+0 (secure 0 0 0) 0x7fbfdc010040 con 0x7fbfe415e6c0 2024-04-04T06:57:12.709 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:12.710+0000 7fbfe9c00640 1 -- 172.21.15.72:0/2704498736 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fbfc406c940 msgr2=0x7fbfc406ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:12.709 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:12.710+0000 7fbfe9c00640 1 --2- 172.21.15.72:0/2704498736 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fbfc406c940 0x7fbfc406ee00 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fbfd4005880 tx=0x7fbfd4001080 comp rx=0 tx=0).stop 2024-04-04T06:57:12.709 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:12.710+0000 7fbfe9c00640 1 -- 172.21.15.72:0/2704498736 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbfe415e6c0 msgr2=0x7fbfe40b9310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:12.709 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:12.710+0000 7fbfe9c00640 1 --2- 172.21.15.72:0/2704498736 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbfe415e6c0 0x7fbfe40b9310 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fbfdc00efc0 tx=0x7fbfdc00c490 comp rx=0 tx=0).stop 2024-04-04T06:57:12.709 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:12.710+0000 7fbfe9c00640 1 -- 172.21.15.72:0/2704498736 shutdown_connections 2024-04-04T06:57:12.709 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:12.710+0000 7fbfe9c00640 1 --2- 172.21.15.72:0/2704498736 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fbfc406c940 0x7fbfc406ee00 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:12.710 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:12.710+0000 7fbfe9c00640 1 --2- 172.21.15.72:0/2704498736 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbfe415e6c0 0x7fbfe40b9310 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:12.710 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:12.710+0000 7fbfe9c00640 1 --2- 172.21.15.72:0/2704498736 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbfe40d2950 0x7fbfe40b8dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:12.710 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:12.710+0000 7fbfe9c00640 1 --2- 172.21.15.72:0/2704498736 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbfe40b6aa0 0x7fbfe41f77e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:12.710 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:12.710+0000 7fbfe9c00640 1 -- 172.21.15.72:0/2704498736 >> 172.21.15.72:0/2704498736 conn(0x7fbfe4071e80 msgr2=0x7fbfe415bb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:12.710 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:12.711+0000 7fbfe9c00640 1 -- 172.21.15.72:0/2704498736 shutdown_connections 2024-04-04T06:57:12.710 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:12.711+0000 7fbfe9c00640 1 -- 172.21.15.72:0/2704498736 wait complete. 2024-04-04T06:57:12.733 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-04T06:57:12.733 DEBUG:teuthology.orchestra.run.smithi072:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-04T06:57:12.840 DEBUG:teuthology.orchestra.run.smithi117:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-04T06:57:12.956 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-04T06:57:12.956 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-04-04T06:57:12.956 DEBUG:teuthology.orchestra.run.smithi072:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-04T06:57:13.010 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-04-04T06:57:13.010 DEBUG:teuthology.orchestra.run.smithi072:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-04T06:57:13.057 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-04T06:57:13.297 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:13.298+0000 7fbec7c00640 1 Processor -- start 2024-04-04T06:57:13.297 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:13.298+0000 7fbec7c00640 1 -- start start 2024-04-04T06:57:13.299 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:13.299+0000 7fbec7c00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fbec015c2d0 0x7fbec0071610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:13.299 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:13.299+0000 7fbec7c00640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fbec015c6b0 0x7fbec00c5e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:13.299 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:13.299+0000 7fbec7c00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbec00ccb20 0x7fbec00ccfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:13.299 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:13.299+0000 7fbec7c00640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7fbec00c6fb0 con 0x7fbec015c6b0 2024-04-04T06:57:13.299 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:13.299+0000 7fbec7c00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fbec00c6710 con 0x7fbec015c2d0 2024-04-04T06:57:13.299 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:13.299+0000 7fbec7c00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fbec00c69f0 con 0x7fbec00ccb20 2024-04-04T06:57:13.299 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:13.300+0000 7fbebfe00640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fbec015c6b0 0x7fbec00c5e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:13.299 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:13.300+0000 7fbebfe00640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fbec015c6b0 0x7fbec00c5e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:33520/0 (socket says 172.21.15.72:33520) 2024-04-04T06:57:13.299 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:13.300+0000 7fbebfe00640 1 -- 172.21.15.72:0/3029431492 learned_addr learned my addr 172.21.15.72:0/3029431492 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:57:13.300 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:13.300+0000 7fbec5200640 1 --2- 172.21.15.72:0/3029431492 >> v2:172.21.15.117:3300/0 conn(0x7fbec015c2d0 0x7fbec0071610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:13.300 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:13.300+0000 7fbec5c00640 1 --2- 172.21.15.72:0/3029431492 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbec00ccb20 0x7fbec00ccfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:13.300 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:13.300+0000 7fbebfe00640 1 -- 172.21.15.72:0/3029431492 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbec00ccb20 msgr2=0x7fbec00ccfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:57:13.300 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:13.300+0000 7fbebfe00640 1 --2- 172.21.15.72:0/3029431492 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbec00ccb20 0x7fbec00ccfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:13.300 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:13.300+0000 7fbebfe00640 1 -- 172.21.15.72:0/3029431492 >> v2:172.21.15.117:3300/0 conn(0x7fbec015c2d0 msgr2=0x7fbec0071610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:57:13.300 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:13.300+0000 7fbebfe00640 1 --2- 172.21.15.72:0/3029431492 >> v2:172.21.15.117:3300/0 conn(0x7fbec015c2d0 0x7fbec0071610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:13.300 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:13.300+0000 7fbebfe00640 1 -- 172.21.15.72:0/3029431492 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbec00c6cd0 con 0x7fbec015c6b0 2024-04-04T06:57:13.300 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:13.300+0000 7fbec5c00640 1 --2- 172.21.15.72:0/3029431492 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbec00ccb20 0x7fbec00ccfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-04T06:57:13.301 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:13.301+0000 7fbebfe00640 1 --2- 172.21.15.72:0/3029431492 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbec015c6b0 0x7fbec00c5e50 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fbec006c210 tx=0x7fbeac02b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c545021d562fbba server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:13.301 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:13.302+0000 7fbebf400640 1 -- 172.21.15.72:0/3029431492 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbeac02e070 con 0x7fbec015c6b0 2024-04-04T06:57:13.301 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:13.302+0000 7fbebf400640 1 -- 172.21.15.72:0/3029431492 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbeac037070 con 0x7fbec015c6b0 2024-04-04T06:57:13.302 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:13.302+0000 7fbebf400640 1 -- 172.21.15.72:0/3029431492 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbeac031a00 con 0x7fbec015c6b0 2024-04-04T06:57:13.302 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:13.302+0000 7fbec7c00640 1 -- 172.21.15.72:0/3029431492 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbec015c6b0 msgr2=0x7fbec00c5e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:13.302 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:13.302+0000 7fbec7c00640 1 --2- 172.21.15.72:0/3029431492 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbec015c6b0 0x7fbec00c5e50 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fbec006c210 tx=0x7fbeac02b880 comp rx=0 tx=0).stop 2024-04-04T06:57:13.302 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:13.303+0000 7fbec7c00640 1 -- 172.21.15.72:0/3029431492 shutdown_connections 2024-04-04T06:57:13.302 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:13.303+0000 7fbec7c00640 1 --2- 172.21.15.72:0/3029431492 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbec00ccb20 0x7fbec00ccfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:13.302 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:13.303+0000 7fbec7c00640 1 --2- 172.21.15.72:0/3029431492 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbec015c6b0 0x7fbec00c5e50 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:13.302 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:13.303+0000 7fbec7c00640 1 --2- 172.21.15.72:0/3029431492 >> v2:172.21.15.117:3300/0 conn(0x7fbec015c2d0 0x7fbec0071610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:13.302 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:13.303+0000 7fbec7c00640 1 -- 172.21.15.72:0/3029431492 >> 172.21.15.72:0/3029431492 conn(0x7fbec006b470 msgr2=0x7fbec006b880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:13.302 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:13.303+0000 7fbec7c00640 1 -- 172.21.15.72:0/3029431492 shutdown_connections 2024-04-04T06:57:13.302 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:13.303+0000 7fbec7c00640 1 -- 172.21.15.72:0/3029431492 wait complete. 2024-04-04T06:57:13.303 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:13.304+0000 7fbec7c00640 1 Processor -- start 2024-04-04T06:57:13.303 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:13.305+0000 7fbec7c00640 1 -- start start 2024-04-04T06:57:13.305 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:13.305+0000 7fbec7c00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbec00ccb20 0x7fbec0158270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:13.306 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:13.305+0000 7fbec7c00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbec015c2d0 0x7fbec00d0270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:13.306 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:13.305+0000 7fbec7c00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbec015c6b0 0x7fbec00d07b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:13.306 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:13.305+0000 7fbec7c00640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fbec00b3ea0 con 0x7fbec015c6b0 2024-04-04T06:57:13.306 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:13.305+0000 7fbec7c00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fbec00c6390 con 0x7fbec00ccb20 2024-04-04T06:57:13.306 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:13.306+0000 7fbec7c00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fbec00b4020 con 0x7fbec015c2d0 2024-04-04T06:57:13.306 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:13.306+0000 7fbec5c00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbec015c6b0 0x7fbec00d07b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:13.306 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:13.306+0000 7fbec5c00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbec015c6b0 0x7fbec00d07b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:33522/0 (socket says 172.21.15.72:33522) 2024-04-04T06:57:13.306 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:13.306+0000 7fbec5c00640 1 -- 172.21.15.72:0/4221344 learned_addr learned my addr 172.21.15.72:0/4221344 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:57:13.306 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:13.306+0000 7fbec5200640 1 --2- 172.21.15.72:0/4221344 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbec00ccb20 0x7fbec0158270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:13.306 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:13.306+0000 7fbebfe00640 1 --2- 172.21.15.72:0/4221344 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbec015c2d0 0x7fbec00d0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:13.306 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:13.306+0000 7fbec5c00640 1 -- 172.21.15.72:0/4221344 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbec015c2d0 msgr2=0x7fbec00d0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:13.307 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:13.306+0000 7fbec5c00640 1 --2- 172.21.15.72:0/4221344 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbec015c2d0 0x7fbec00d0270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:13.307 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:13.306+0000 7fbec5c00640 1 -- 172.21.15.72:0/4221344 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbec00ccb20 msgr2=0x7fbec0158270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:13.307 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:13.306+0000 7fbec5c00640 1 --2- 172.21.15.72:0/4221344 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbec00ccb20 0x7fbec0158270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:13.307 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:13.306+0000 7fbec5c00640 1 -- 172.21.15.72:0/4221344 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbec00c92e0 con 0x7fbec015c6b0 2024-04-04T06:57:13.307 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:13.306+0000 7fbebfe00640 1 --2- 172.21.15.72:0/4221344 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbec015c2d0 0x7fbec00d0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-04T06:57:13.307 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:13.306+0000 7fbec5200640 1 --2- 172.21.15.72:0/4221344 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbec00ccb20 0x7fbec0158270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-04T06:57:13.307 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:13.307+0000 7fbec5c00640 1 --2- 172.21.15.72:0/4221344 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbec015c6b0 0x7fbec00d07b0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fbeb800cef0 tx=0x7fbeb800a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:13.307 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:13.307+0000 7fbebcc00640 1 -- 172.21.15.72:0/4221344 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbeb801a070 con 0x7fbec015c6b0 2024-04-04T06:57:13.307 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:13.307+0000 7fbebcc00640 1 -- 172.21.15.72:0/4221344 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbeb800d840 con 0x7fbec015c6b0 2024-04-04T06:57:13.307 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:13.307+0000 7fbec7c00640 1 -- 172.21.15.72:0/4221344 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbec00c95c0 con 0x7fbec015c6b0 2024-04-04T06:57:13.307 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:13.307+0000 7fbebcc00640 1 -- 172.21.15.72:0/4221344 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbeb800dc30 con 0x7fbec015c6b0 2024-04-04T06:57:13.307 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:13.307+0000 7fbec7c00640 1 -- 172.21.15.72:0/4221344 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbec0159250 con 0x7fbec015c6b0 2024-04-04T06:57:13.308 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:13.308+0000 7fbec7c00640 1 -- 172.21.15.72:0/4221344 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbec0075840 con 0x7fbec015c6b0 2024-04-04T06:57:13.308 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:13.309+0000 7fbebcc00640 1 -- 172.21.15.72:0/4221344 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fbeb801d070 con 0x7fbec015c6b0 2024-04-04T06:57:13.309 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:13.310+0000 7fbebcc00640 1 --2- 172.21.15.72:0/4221344 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fbea006c8f0 0x7fbea006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:13.309 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:13.310+0000 7fbebcc00640 1 -- 172.21.15.72:0/4221344 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7fbeb808c3e0 con 0x7fbec015c6b0 2024-04-04T06:57:13.309 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:13.310+0000 7fbec5200640 1 --2- 172.21.15.72:0/4221344 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fbea006c8f0 0x7fbea006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:13.310 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:13.311+0000 7fbec5200640 1 --2- 172.21.15.72:0/4221344 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fbea006c8f0 0x7fbea006edb0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fbeb4006fd0 tx=0x7fbeb4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:13.313 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:13.315+0000 7fbebcc00640 1 -- 172.21.15.72:0/4221344 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fbeb805a780 con 0x7fbec015c6b0 2024-04-04T06:57:13.543 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:13.545+0000 7fbec7c00640 1 -- 172.21.15.72:0/4221344 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbec00ce760 con 0x7fbec015c6b0 2024-04-04T06:57:13.545 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:13.547+0000 7fbebcc00640 1 -- 172.21.15.72:0/4221344 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16831 (secure 0 0 0) 0x7fbeb805a080 con 0x7fbec015c6b0 2024-04-04T06:57:13.546 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T06:57:13.546 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":22,"fsid":"6708bac2-4f50-49b5-87a9-c390fd333eb3","created":"2024-04-04T06:56:04.282498+0000","modified":"2024-04-04T06:57:11.239134+0000","last_up_change":"2024-04-04T06:56:16.716089+0000","last_in_change":"2024-04-04T06:56:07.768593+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-04T06:56:17.421685+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-04T06:56:26.822661+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-04T06:56:27.429816+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7c345991-5af8-4dc6-a481-28610c40e128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":3889813953},{"type":"v1","addr":"172.21.15.72:6818","nonce":3889813953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":3889813953},{"type":"v1","addr":"172.21.15.72:6821","nonce":3889813953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":3889813953},{"type":"v1","addr":"172.21.15.72:6826","nonce":3889813953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":3889813953},{"type":"v1","addr":"172.21.15.72:6823","nonce":3889813953}]},"public_addr":"172.21.15.72:6818/3889813953","cluster_addr":"172.21.15.72:6821/3889813953","heartbeat_back_addr":"172.21.15.72:6826/3889813953","heartbeat_front_addr":"172.21.15.72:6823/3889813953","state":["exists","up"]},{"osd":1,"uuid":"1b3f7ab2-a56c-488d-a89a-1f3572361c95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":3101663154},{"type":"v1","addr":"172.21.15.72:6801","nonce":3101663154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":3101663154},{"type":"v1","addr":"172.21.15.72:6803","nonce":3101663154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":3101663154},{"type":"v1","addr":"172.21.15.72:6807","nonce":3101663154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":3101663154},{"type":"v1","addr":"172.21.15.72:6805","nonce":3101663154}]},"public_addr":"172.21.15.72:6801/3101663154","cluster_addr":"172.21.15.72:6803/3101663154","heartbeat_back_addr":"172.21.15.72:6807/3101663154","heartbeat_front_addr":"172.21.15.72:6805/3101663154","state":["exists","up"]},{"osd":2,"uuid":"fc9aa512-53df-40d7-ba04-3e6b7dcd1e34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":235374192},{"type":"v1","addr":"172.21.15.72:6809","nonce":235374192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":235374192},{"type":"v1","addr":"172.21.15.72:6811","nonce":235374192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":235374192},{"type":"v1","addr":"172.21.15.72:6815","nonce":235374192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":235374192},{"type":"v1","addr":"172.21.15.72:6813","nonce":235374192}]},"public_addr":"172.21.15.72:6809/235374192","cluster_addr":"172.21.15.72:6811/235374192","heartbeat_back_addr":"172.21.15.72:6815/235374192","heartbeat_front_addr":"172.21.15.72:6813/235374192","state":["exists","up"]},{"osd":3,"uuid":"b4f63eed-dc5b-4aba-bb50-de46eb41492b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6817","nonce":2806631742},{"type":"v1","addr":"172.21.15.72:6819","nonce":2806631742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":2806631742},{"type":"v1","addr":"172.21.15.72:6827","nonce":2806631742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":2806631742},{"type":"v1","addr":"172.21.15.72:6831","nonce":2806631742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":2806631742},{"type":"v1","addr":"172.21.15.72:6829","nonce":2806631742}]},"public_addr":"172.21.15.72:6819/2806631742","cluster_addr":"172.21.15.72:6827/2806631742","heartbeat_back_addr":"172.21.15.72:6831/2806631742","heartbeat_front_addr":"172.21.15.72:6829/2806631742","state":["exists","up"]},{"osd":4,"uuid":"9e985ef8-d711-4172-9286-c54e560895d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":4293536423},{"type":"v1","addr":"172.21.15.117:6825","nonce":4293536423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":4293536423},{"type":"v1","addr":"172.21.15.117:6827","nonce":4293536423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":4293536423},{"type":"v1","addr":"172.21.15.117:6831","nonce":4293536423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":4293536423},{"type":"v1","addr":"172.21.15.117:6829","nonce":4293536423}]},"public_addr":"172.21.15.117:6825/4293536423","cluster_addr":"172.21.15.117:6827/4293536423","heartbeat_back_addr":"172.21.15.117:6831/4293536423","heartbeat_front_addr":"172.21.15.117:6829/4293536423","state":["exists","up"]},{"osd":5,"uuid":"3e9f082b-8d7d-455f-8a96-66d0b4857125","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":684971679},{"type":"v1","addr":"172.21.15.117:6801","nonce":684971679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":684971679},{"type":"v1","addr":"172.21.15.117:6803","nonce":684971679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":684971679},{"type":"v1","addr":"172.21.15.117:6807","nonce":684971679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":684971679},{"type":"v1","addr":"172.21.15.117:6805","nonce":684971679}]},"public_addr":"172.21.15.117:6801/684971679","cluster_addr":"172.21.15.117:6803/684971679","heartbeat_back_addr":"172.21.15.117:6807/684971679","heartbeat_front_addr":"172.21.15.117:6805/684971679","state":["exists","up"]},{"osd":6,"uuid":"bcdafa9f-a870-4398-a38d-ab7697676473","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":2781186528},{"type":"v1","addr":"172.21.15.117:6809","nonce":2781186528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":2781186528},{"type":"v1","addr":"172.21.15.117:6811","nonce":2781186528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":2781186528},{"type":"v1","addr":"172.21.15.117:6815","nonce":2781186528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":2781186528},{"type":"v1","addr":"172.21.15.117:6813","nonce":2781186528}]},"public_addr":"172.21.15.117:6809/2781186528","cluster_addr":"172.21.15.117:6811/2781186528","heartbeat_back_addr":"172.21.15.117:6815/2781186528","heartbeat_front_addr":"172.21.15.117:6813/2781186528","state":["exists","up"]},{"osd":7,"uuid":"b68ec562-ff35-4d2d-a733-c896f8920cfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":617469882},{"type":"v1","addr":"172.21.15.117:6817","nonce":617469882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":617469882},{"type":"v1","addr":"172.21.15.117:6819","nonce":617469882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":617469882},{"type":"v1","addr":"172.21.15.117:6823","nonce":617469882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":617469882},{"type":"v1","addr":"172.21.15.117:6821","nonce":617469882}]},"public_addr":"172.21.15.117:6817/617469882","cluster_addr":"172.21.15.117:6819/617469882","heartbeat_back_addr":"172.21.15.117:6823/617469882","heartbeat_front_addr":"172.21.15.117:6821/617469882","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.347700+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.296619+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.361345+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.093323+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:12.857605+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:12.816090+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.083163+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.121639+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.13","mappings":[{"from":7,"to":1}]},{"pgid":"3.19","mappings":[{"from":3,"to":2}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.28","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-04T06:57:13.548 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:13.549+0000 7fbec7c00640 1 -- 172.21.15.72:0/4221344 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fbea006c8f0 msgr2=0x7fbea006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:13.548 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:13.549+0000 7fbec7c00640 1 --2- 172.21.15.72:0/4221344 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fbea006c8f0 0x7fbea006edb0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fbeb4006fd0 tx=0x7fbeb4008040 comp rx=0 tx=0).stop 2024-04-04T06:57:13.548 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:13.549+0000 7fbec7c00640 1 -- 172.21.15.72:0/4221344 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbec015c6b0 msgr2=0x7fbec00d07b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:13.548 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:13.549+0000 7fbec7c00640 1 --2- 172.21.15.72:0/4221344 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbec015c6b0 0x7fbec00d07b0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fbeb800cef0 tx=0x7fbeb800a710 comp rx=0 tx=0).stop 2024-04-04T06:57:13.548 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:13.549+0000 7fbec7c00640 1 -- 172.21.15.72:0/4221344 shutdown_connections 2024-04-04T06:57:13.549 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:13.549+0000 7fbec7c00640 1 --2- 172.21.15.72:0/4221344 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fbea006c8f0 0x7fbea006edb0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:13.549 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:13.549+0000 7fbec7c00640 1 --2- 172.21.15.72:0/4221344 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbec015c6b0 0x7fbec00d07b0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:13.549 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:13.549+0000 7fbec7c00640 1 --2- 172.21.15.72:0/4221344 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbec015c2d0 0x7fbec00d0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:13.549 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:13.549+0000 7fbec7c00640 1 --2- 172.21.15.72:0/4221344 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbec00ccb20 0x7fbec0158270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:13.549 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:13.549+0000 7fbec7c00640 1 -- 172.21.15.72:0/4221344 >> 172.21.15.72:0/4221344 conn(0x7fbec006b470 msgr2=0x7fbec015da50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:13.549 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:13.549+0000 7fbec7c00640 1 -- 172.21.15.72:0/4221344 shutdown_connections 2024-04-04T06:57:13.549 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:13.549+0000 7fbec7c00640 1 -- 172.21.15.72:0/4221344 wait complete. 2024-04-04T06:57:13.565 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-04T06:56:17.421685+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-04T06:56:26.822661+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-04T06:56:27.429816+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-04T06:57:13.566 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-04T06:57:13.789 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:13.790+0000 7f7b18800640 1 Processor -- start 2024-04-04T06:57:13.789 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:13.791+0000 7f7b18800640 1 -- start start 2024-04-04T06:57:13.792 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:13.793+0000 7f7b18800640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f7b1015e6c0 0x7f7b100b6390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:13.792 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:13.793+0000 7f7b18800640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b100d3100 con 0x7f7b100d2b20 2024-04-04T06:57:13.792 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:13.793+0000 7f7b18800640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b100d33e0 con 0x7f7b100b68d0 2024-04-04T06:57:13.792 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:13.793+0000 7f7b18800640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f7b1015eaa0 con 0x7f7b1015e6c0 2024-04-04T06:57:13.792 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:13.794+0000 7f7b15e00640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f7b1015e6c0 0x7f7b100b6390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:13.793 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:13.794+0000 7f7b16800640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f7b100d2b20 0x7f7b100b7520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:39422/0 (socket says 172.21.15.72:39422) 2024-04-04T06:57:13.793 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:13.794+0000 7f7b15e00640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f7b1015e6c0 0x7f7b100b6390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:33530/0 (socket says 172.21.15.72:33530) 2024-04-04T06:57:13.793 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:13.794+0000 7f7b16800640 1 -- 172.21.15.72:0/4051651319 learned_addr learned my addr 172.21.15.72:0/4051651319 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-04-04T06:57:13.793 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:13.794+0000 7f7b15e00640 1 -- 172.21.15.72:0/4051651319 >> v1:172.21.15.117:6789/0 conn(0x7f7b100b68d0 legacy=0x7f7b100d2410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:57:13.793 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:13.794+0000 7f7b15e00640 1 -- 172.21.15.72:0/4051651319 >> v1:172.21.15.72:6789/0 conn(0x7f7b100d2b20 legacy=0x7f7b100b7520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:13.793 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:13.794+0000 7f7b15e00640 1 -- 172.21.15.72:0/4051651319 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b100d36c0 con 0x7f7b1015e6c0 2024-04-04T06:57:13.794 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:13.795+0000 7f7b15e00640 1 --2- 172.21.15.72:0/4051651319 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7b1015e6c0 0x7f7b100b6390 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f7b040097a0 tx=0x7f7b0402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fcbc5923704692 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:13.794 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:13.796+0000 7f7b14a00640 1 -- 172.21.15.72:0/4051651319 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b04035020 con 0x7f7b1015e6c0 2024-04-04T06:57:13.794 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:13.796+0000 7f7b14a00640 1 -- 172.21.15.72:0/4051651319 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b04031830 con 0x7f7b1015e6c0 2024-04-04T06:57:13.794 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:13.796+0000 7f7b14a00640 1 -- 172.21.15.72:0/4051651319 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b04031c00 con 0x7f7b1015e6c0 2024-04-04T06:57:13.795 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:13.796+0000 7f7b18800640 1 -- 172.21.15.72:0/4051651319 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7b1015e6c0 msgr2=0x7f7b100b6390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:13.795 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:13.796+0000 7f7b18800640 1 --2- 172.21.15.72:0/4051651319 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7b1015e6c0 0x7f7b100b6390 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f7b040097a0 tx=0x7f7b0402b8d0 comp rx=0 tx=0).stop 2024-04-04T06:57:13.795 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:13.796+0000 7f7b18800640 1 -- 172.21.15.72:0/4051651319 shutdown_connections 2024-04-04T06:57:13.795 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:13.796+0000 7f7b18800640 1 --2- 172.21.15.72:0/4051651319 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7b1015e6c0 0x7f7b100b6390 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:13.795 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:13.796+0000 7f7b18800640 1 -- 172.21.15.72:0/4051651319 >> 172.21.15.72:0/4051651319 conn(0x7f7b10071e80 msgr2=0x7f7b10072290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:13.795 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:13.796+0000 7f7b18800640 1 -- 172.21.15.72:0/4051651319 shutdown_connections 2024-04-04T06:57:13.796 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:13.796+0000 7f7b18800640 1 -- 172.21.15.72:0/4051651319 wait complete. 2024-04-04T06:57:13.797 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:13.798+0000 7f7b18800640 1 Processor -- start 2024-04-04T06:57:13.797 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:13.798+0000 7f7b18800640 1 -- start start 2024-04-04T06:57:13.798 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:13.799+0000 7f7b18800640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7b100b68d0 0x7f7b101f7940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:13.798 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:13.799+0000 7f7b18800640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7b100d2b20 0x7f7b10161500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:13.798 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:13.799+0000 7f7b18800640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7b1015e6c0 0x7f7b101604c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:13.798 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:13.799+0000 7f7b18800640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f7b100b7c30 con 0x7f7b100d2b20 2024-04-04T06:57:13.798 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:13.799+0000 7f7b18800640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f7b100d3c80 con 0x7f7b1015e6c0 2024-04-04T06:57:13.798 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:13.799+0000 7f7b18800640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f7b100b7db0 con 0x7f7b100b68d0 2024-04-04T06:57:13.798 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:13.799+0000 7f7b15400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7b100d2b20 0x7f7b10161500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:13.798 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:13.800+0000 7f7b15400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7b100d2b20 0x7f7b10161500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:33542/0 (socket says 172.21.15.72:33542) 2024-04-04T06:57:13.798 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:13.800+0000 7f7b15400640 1 -- 172.21.15.72:0/2106351866 learned_addr learned my addr 172.21.15.72:0/2106351866 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:57:13.799 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:13.800+0000 7f7b16800640 1 --2- 172.21.15.72:0/2106351866 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7b1015e6c0 0x7f7b101604c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:13.799 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:13.800+0000 7f7b15e00640 1 --2- 172.21.15.72:0/2106351866 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7b100b68d0 0x7f7b101f7940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:13.799 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:13.800+0000 7f7b15400640 1 -- 172.21.15.72:0/2106351866 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7b100b68d0 msgr2=0x7f7b101f7940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:13.799 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:13.800+0000 7f7b15400640 1 --2- 172.21.15.72:0/2106351866 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7b100b68d0 0x7f7b101f7940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:13.800 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:13.800+0000 7f7b15400640 1 -- 172.21.15.72:0/2106351866 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7b1015e6c0 msgr2=0x7f7b101604c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:13.800 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:13.800+0000 7f7b15400640 1 --2- 172.21.15.72:0/2106351866 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7b1015e6c0 0x7f7b101604c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:13.800 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:13.800+0000 7f7b15400640 1 -- 172.21.15.72:0/2106351866 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b10143540 con 0x7f7b100d2b20 2024-04-04T06:57:13.800 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:13.800+0000 7f7b15400640 1 --2- 172.21.15.72:0/2106351866 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7b100d2b20 0x7f7b10161500 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f7b0000c430 tx=0x7f7b0000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:13.801 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:13.800+0000 7f7b0a000640 1 -- 172.21.15.72:0/2106351866 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b00011790 con 0x7f7b100d2b20 2024-04-04T06:57:13.801 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:13.801+0000 7f7b0a000640 1 -- 172.21.15.72:0/2106351866 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b00017070 con 0x7f7b100d2b20 2024-04-04T06:57:13.801 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:13.801+0000 7f7b0a000640 1 -- 172.21.15.72:0/2106351866 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b00011bb0 con 0x7f7b100d2b20 2024-04-04T06:57:13.801 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:13.801+0000 7f7b18800640 1 -- 172.21.15.72:0/2106351866 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b101f7f20 con 0x7f7b100d2b20 2024-04-04T06:57:13.801 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:13.801+0000 7f7b18800640 1 -- 172.21.15.72:0/2106351866 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b10161a40 con 0x7f7b100d2b20 2024-04-04T06:57:13.801 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:13.802+0000 7f7b18800640 1 -- 172.21.15.72:0/2106351866 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b101f8310 con 0x7f7b100d2b20 2024-04-04T06:57:13.801 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:13.803+0000 7f7b0a000640 1 -- 172.21.15.72:0/2106351866 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7b0001c460 con 0x7f7b100d2b20 2024-04-04T06:57:13.803 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:13.804+0000 7f7b0a000640 1 --2- 172.21.15.72:0/2106351866 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f7af406c940 0x7f7af406ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:13.803 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:13.805+0000 7f7b0a000640 1 -- 172.21.15.72:0/2106351866 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f7b0008b990 con 0x7f7b100d2b20 2024-04-04T06:57:13.803 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:13.805+0000 7f7b15e00640 1 --2- 172.21.15.72:0/2106351866 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f7af406c940 0x7f7af406ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:13.804 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:13.805+0000 7f7b15e00640 1 --2- 172.21.15.72:0/2106351866 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f7af406c940 0x7f7af406ee00 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f7b04036000 tx=0x7f7b04008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:13.807 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:13.809+0000 7f7b0a000640 1 -- 172.21.15.72:0/2106351866 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f7b00059e20 con 0x7f7b100d2b20 2024-04-04T06:57:14.007 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:14.008+0000 7f7b18800640 1 -- 172.21.15.72:0/2106351866 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f7b10075730 con 0x7f7b100d2b20 2024-04-04T06:57:14.008 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:14.009+0000 7f7b0a000640 1 -- 172.21.15.72:0/2106351866 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) ==== 93+0+10 (secure 0 0 0) 0x7f7b00059720 con 0x7f7b100d2b20 2024-04-04T06:57:14.008 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 1 2024-04-04T06:57:14.011 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:14.012+0000 7f7b18800640 1 -- 172.21.15.72:0/2106351866 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f7af406c940 msgr2=0x7f7af406ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:14.011 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:14.012+0000 7f7b18800640 1 --2- 172.21.15.72:0/2106351866 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f7af406c940 0x7f7af406ee00 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f7b04036000 tx=0x7f7b04008030 comp rx=0 tx=0).stop 2024-04-04T06:57:14.011 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:14.012+0000 7f7b18800640 1 -- 172.21.15.72:0/2106351866 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7b100d2b20 msgr2=0x7f7b10161500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:14.011 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:14.012+0000 7f7b18800640 1 --2- 172.21.15.72:0/2106351866 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7b100d2b20 0x7f7b10161500 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f7b0000c430 tx=0x7f7b0000c8f0 comp rx=0 tx=0).stop 2024-04-04T06:57:14.011 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:14.012+0000 7f7b18800640 1 -- 172.21.15.72:0/2106351866 shutdown_connections 2024-04-04T06:57:14.011 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:14.012+0000 7f7b18800640 1 --2- 172.21.15.72:0/2106351866 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f7af406c940 0x7f7af406ee00 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:14.011 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:14.012+0000 7f7b18800640 1 --2- 172.21.15.72:0/2106351866 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7b1015e6c0 0x7f7b101604c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:14.012 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:14.012+0000 7f7b18800640 1 --2- 172.21.15.72:0/2106351866 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7b100d2b20 0x7f7b10161500 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:14.012 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:14.012+0000 7f7b18800640 1 --2- 172.21.15.72:0/2106351866 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7b100b68d0 0x7f7b101f7940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:14.012 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:14.012+0000 7f7b18800640 1 -- 172.21.15.72:0/2106351866 >> 172.21.15.72:0/2106351866 conn(0x7f7b10071e80 msgr2=0x7f7b100b3db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:14.012 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:14.012+0000 7f7b18800640 1 -- 172.21.15.72:0/2106351866 shutdown_connections 2024-04-04T06:57:14.012 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:14.013+0000 7f7b18800640 1 -- 172.21.15.72:0/2106351866 wait complete. 2024-04-04T06:57:14.029 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-04T06:57:14.231 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:14.232+0000 7fd6d7e00640 1 Processor -- start 2024-04-04T06:57:14.232 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:14.233+0000 7fd6d7e00640 1 -- start start 2024-04-04T06:57:14.234 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:14.235+0000 7fd6d7e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd6d815e370 0x7fd6d815f330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:14.234 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:14.235+0000 7fd6d7e00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fd6d80d4b40 0x7fd6d80d1060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:14.234 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:14.235+0000 7fd6d7e00640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd6d80d15a0 0x7fd6d80b2b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:14.234 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:14.235+0000 7fd6d7e00640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7fd6d80ce930 con 0x7fd6d80d15a0 2024-04-04T06:57:14.235 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:14.235+0000 7fd6d7e00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fd6d80d19d0 con 0x7fd6d80d4b40 2024-04-04T06:57:14.235 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:14.235+0000 7fd6d7e00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fd6d815f870 con 0x7fd6d815e370 2024-04-04T06:57:14.235 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:14.235+0000 7fd6d7400640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd6d80d15a0 0x7fd6d80b2b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:14.235 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:14.235+0000 7fd6d7400640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd6d80d15a0 0x7fd6d80b2b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:33556/0 (socket says 172.21.15.72:33556) 2024-04-04T06:57:14.235 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:14.235+0000 7fd6d7400640 1 -- 172.21.15.72:0/4199451103 learned_addr learned my addr 172.21.15.72:0/4199451103 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:57:14.235 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:14.235+0000 7fd6ce000640 1 --2- 172.21.15.72:0/4199451103 >> v2:172.21.15.117:3300/0 conn(0x7fd6d80d4b40 0x7fd6d80d1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:14.235 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:14.235+0000 7fd6d6a00640 1 --2- 172.21.15.72:0/4199451103 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd6d815e370 0x7fd6d815f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:14.235 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:14.236+0000 7fd6d7400640 1 -- 172.21.15.72:0/4199451103 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd6d815e370 msgr2=0x7fd6d815f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:57:14.235 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:14.236+0000 7fd6d7400640 1 --2- 172.21.15.72:0/4199451103 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd6d815e370 0x7fd6d815f330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:14.235 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:14.236+0000 7fd6d7400640 1 -- 172.21.15.72:0/4199451103 >> v2:172.21.15.117:3300/0 conn(0x7fd6d80d4b40 msgr2=0x7fd6d80d1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:57:14.235 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:14.236+0000 7fd6d7400640 1 --2- 172.21.15.72:0/4199451103 >> v2:172.21.15.117:3300/0 conn(0x7fd6d80d4b40 0x7fd6d80d1060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:14.235 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:14.236+0000 7fd6d7400640 1 -- 172.21.15.72:0/4199451103 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6d80ceb80 con 0x7fd6d80d15a0 2024-04-04T06:57:14.236 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:14.237+0000 7fd6d7400640 1 --2- 172.21.15.72:0/4199451103 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd6d80d15a0 0x7fd6d80b2b60 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fd6d80d50e0 tx=0x7fd6d002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afcec599a0e56c65 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:14.236 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:14.237+0000 7fd6d6000640 1 -- 172.21.15.72:0/4199451103 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6d002ca70 con 0x7fd6d80d15a0 2024-04-04T06:57:14.236 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:14.237+0000 7fd6d6000640 1 -- 172.21.15.72:0/4199451103 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6d002cc10 con 0x7fd6d80d15a0 2024-04-04T06:57:14.236 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:14.237+0000 7fd6d6000640 1 -- 172.21.15.72:0/4199451103 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6d00343f0 con 0x7fd6d80d15a0 2024-04-04T06:57:14.237 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:14.238+0000 7fd6d7e00640 1 -- 172.21.15.72:0/4199451103 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd6d80d15a0 msgr2=0x7fd6d80b2b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:14.237 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:14.238+0000 7fd6d7e00640 1 --2- 172.21.15.72:0/4199451103 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd6d80d15a0 0x7fd6d80b2b60 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fd6d80d50e0 tx=0x7fd6d002bed0 comp rx=0 tx=0).stop 2024-04-04T06:57:14.237 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:14.238+0000 7fd6d7e00640 1 -- 172.21.15.72:0/4199451103 shutdown_connections 2024-04-04T06:57:14.237 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:14.238+0000 7fd6d7e00640 1 --2- 172.21.15.72:0/4199451103 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd6d80d15a0 0x7fd6d80b2b60 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:14.237 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:14.238+0000 7fd6d7e00640 1 --2- 172.21.15.72:0/4199451103 >> v2:172.21.15.117:3300/0 conn(0x7fd6d80d4b40 0x7fd6d80d1060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:14.237 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:14.238+0000 7fd6d7e00640 1 --2- 172.21.15.72:0/4199451103 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd6d815e370 0x7fd6d815f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:14.237 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:14.238+0000 7fd6d7e00640 1 -- 172.21.15.72:0/4199451103 >> 172.21.15.72:0/4199451103 conn(0x7fd6d806b890 msgr2=0x7fd6d806bca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:14.237 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:14.238+0000 7fd6d7e00640 1 -- 172.21.15.72:0/4199451103 shutdown_connections 2024-04-04T06:57:14.237 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:14.238+0000 7fd6d7e00640 1 -- 172.21.15.72:0/4199451103 wait complete. 2024-04-04T06:57:14.239 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:14.241+0000 7fd6d7e00640 1 Processor -- start 2024-04-04T06:57:14.239 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:14.241+0000 7fd6d7e00640 1 -- start start 2024-04-04T06:57:14.243 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:14.243+0000 7fd6d7e00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd6d80d15a0 0x7fd6d81461b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:14.243 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:14.243+0000 7fd6d7e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd6d80d4b40 0x7fd6d815ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:14.243 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:14.243+0000 7fd6d7e00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd6d815e370 0x7fd6d815b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:14.243 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:14.243+0000 7fd6d7e00640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fd6d80cf420 con 0x7fd6d815e370 2024-04-04T06:57:14.243 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:14.243+0000 7fd6d7e00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fd6d80cf140 con 0x7fd6d80d15a0 2024-04-04T06:57:14.243 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:14.243+0000 7fd6d7e00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fd6d80cf940 con 0x7fd6d80d4b40 2024-04-04T06:57:14.243 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:14.243+0000 7fd6d7400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd6d815e370 0x7fd6d815b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:14.243 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:14.243+0000 7fd6d7400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd6d815e370 0x7fd6d815b3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:33562/0 (socket says 172.21.15.72:33562) 2024-04-04T06:57:14.243 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:14.243+0000 7fd6d7400640 1 -- 172.21.15.72:0/3868237252 learned_addr learned my addr 172.21.15.72:0/3868237252 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:57:14.243 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:14.243+0000 7fd6d6a00640 1 --2- 172.21.15.72:0/3868237252 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd6d80d15a0 0x7fd6d81461b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:14.243 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:14.243+0000 7fd6d7400640 1 -- 172.21.15.72:0/3868237252 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd6d80d4b40 msgr2=0x7fd6d815ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:14.243 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:14.243+0000 7fd6d7400640 1 --2- 172.21.15.72:0/3868237252 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd6d80d4b40 0x7fd6d815ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:14.244 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:14.243+0000 7fd6d7400640 1 -- 172.21.15.72:0/3868237252 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd6d80d15a0 msgr2=0x7fd6d81461b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:14.244 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:14.243+0000 7fd6d7400640 1 --2- 172.21.15.72:0/3868237252 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd6d80d15a0 0x7fd6d81461b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:14.244 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:14.243+0000 7fd6d7400640 1 -- 172.21.15.72:0/3868237252 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6d81534e0 con 0x7fd6d815e370 2024-04-04T06:57:14.244 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:14.244+0000 7fd6d7400640 1 --2- 172.21.15.72:0/3868237252 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd6d815e370 0x7fd6d815b3c0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fd6d0009f40 tx=0x7fd6d0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:14.244 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:14.244+0000 7fd6cfe00640 1 -- 172.21.15.72:0/3868237252 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6d0043020 con 0x7fd6d815e370 2024-04-04T06:57:14.244 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:14.244+0000 7fd6cfe00640 1 -- 172.21.15.72:0/3868237252 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6d003e450 con 0x7fd6d815e370 2024-04-04T06:57:14.244 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:14.244+0000 7fd6cfe00640 1 -- 172.21.15.72:0/3868237252 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6d0009510 con 0x7fd6d815e370 2024-04-04T06:57:14.244 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:14.244+0000 7fd6d7e00640 1 -- 172.21.15.72:0/3868237252 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6d80cd260 con 0x7fd6d815e370 2024-04-04T06:57:14.244 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:14.244+0000 7fd6d7e00640 1 -- 172.21.15.72:0/3868237252 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6d80ccca0 con 0x7fd6d815e370 2024-04-04T06:57:14.245 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:14.245+0000 7fd6d7e00640 1 -- 172.21.15.72:0/3868237252 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd6d80d0270 con 0x7fd6d815e370 2024-04-04T06:57:14.245 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:14.246+0000 7fd6cfe00640 1 -- 172.21.15.72:0/3868237252 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd6d0046020 con 0x7fd6d815e370 2024-04-04T06:57:14.246 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:14.247+0000 7fd6cfe00640 1 --2- 172.21.15.72:0/3868237252 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fd6b406c8f0 0x7fd6b406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:14.246 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:14.247+0000 7fd6cfe00640 1 -- 172.21.15.72:0/3868237252 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7fd6d00ae360 con 0x7fd6d815e370 2024-04-04T06:57:14.246 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:14.248+0000 7fd6d6a00640 1 --2- 172.21.15.72:0/3868237252 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fd6b406c8f0 0x7fd6b406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:14.247 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:14.248+0000 7fd6d6a00640 1 --2- 172.21.15.72:0/3868237252 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fd6b406c8f0 0x7fd6b406edb0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fd6c8006fd0 tx=0x7fd6c8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:14.251 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:14.253+0000 7fd6cfe00640 1 -- 172.21.15.72:0/3868237252 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fd6d80d0270 con 0x7fd6d815e370 2024-04-04T06:57:14.439 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T06:57:14.447 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T06:57:14.450 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:14.451+0000 7fd6d7e00640 1 -- 172.21.15.72:0/3868237252 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fd6d80685a0 con 0x7fd6d815e370 2024-04-04T06:57:14.450 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:14.452+0000 7fd6cfe00640 1 -- 172.21.15.72:0/3868237252 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) ==== 104+0+11 (secure 0 0 0) 0x7fd6d004d030 con 0x7fd6d815e370 2024-04-04T06:57:14.450 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2024-04-04T06:57:14.452 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:14.454+0000 7fd6d7e00640 1 -- 172.21.15.72:0/3868237252 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fd6b406c8f0 msgr2=0x7fd6b406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:14.453 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:14.454+0000 7fd6d7e00640 1 --2- 172.21.15.72:0/3868237252 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fd6b406c8f0 0x7fd6b406edb0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fd6c8006fd0 tx=0x7fd6c8008040 comp rx=0 tx=0).stop 2024-04-04T06:57:14.453 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:14.454+0000 7fd6d7e00640 1 -- 172.21.15.72:0/3868237252 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd6d815e370 msgr2=0x7fd6d815b3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:14.453 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:14.454+0000 7fd6d7e00640 1 --2- 172.21.15.72:0/3868237252 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd6d815e370 0x7fd6d815b3c0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fd6d0009f40 tx=0x7fd6d0004a40 comp rx=0 tx=0).stop 2024-04-04T06:57:14.453 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:14.454+0000 7fd6d7e00640 1 -- 172.21.15.72:0/3868237252 shutdown_connections 2024-04-04T06:57:14.453 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:14.454+0000 7fd6d7e00640 1 --2- 172.21.15.72:0/3868237252 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fd6b406c8f0 0x7fd6b406edb0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:14.454 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:14.454+0000 7fd6d7e00640 1 --2- 172.21.15.72:0/3868237252 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd6d815e370 0x7fd6d815b3c0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:14.454 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:14.454+0000 7fd6d7e00640 1 --2- 172.21.15.72:0/3868237252 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd6d80d4b40 0x7fd6d815ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:14.454 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:14.454+0000 7fd6d7e00640 1 --2- 172.21.15.72:0/3868237252 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd6d80d15a0 0x7fd6d81461b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:14.454 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:14.454+0000 7fd6d7e00640 1 -- 172.21.15.72:0/3868237252 >> 172.21.15.72:0/3868237252 conn(0x7fd6d806b890 msgr2=0x7fd6d80d2190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:14.454 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:14.454+0000 7fd6d7e00640 1 -- 172.21.15.72:0/3868237252 shutdown_connections 2024-04-04T06:57:14.454 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:14.455+0000 7fd6d7e00640 1 -- 172.21.15.72:0/3868237252 wait complete. 2024-04-04T06:57:14.472 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-04T06:57:14.717 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:14.718+0000 7f93a4a00640 1 Processor -- start 2024-04-04T06:57:14.717 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:14.718+0000 7f93a4a00640 1 -- start start 2024-04-04T06:57:14.718 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:14.720+0000 7f93a4a00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f93a0145b10 0x7f93a006d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:14.719 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:14.720+0000 7f93a4a00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f93a006dac0 0x7f93a00cfa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:14.719 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:14.720+0000 7f93a4a00640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f93a00cff40 0x7f93a00d0370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:14.719 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:14.720+0000 7f93a4a00640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f93a00cea10 con 0x7f93a00cff40 2024-04-04T06:57:14.719 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:14.720+0000 7f93a4a00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f93a006e310 con 0x7f93a0145b10 2024-04-04T06:57:14.719 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:14.720+0000 7f93a4a00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f93a0145ef0 con 0x7f93a006dac0 2024-04-04T06:57:14.719 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:14.720+0000 7f939e800640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f93a00cff40 0x7f93a00d0370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:14.719 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:14.720+0000 7f939e800640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f93a00cff40 0x7f93a00d0370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:33570/0 (socket says 172.21.15.72:33570) 2024-04-04T06:57:14.719 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:14.720+0000 7f939e800640 1 -- 172.21.15.72:0/245649843 learned_addr learned my addr 172.21.15.72:0/245649843 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:57:14.720 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:14.720+0000 7f939de00640 1 --2- 172.21.15.72:0/245649843 >> v2:172.21.15.117:3300/0 conn(0x7f93a0145b10 0x7f93a006d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:14.720 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:14.720+0000 7f939d400640 1 --2- 172.21.15.72:0/245649843 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f93a006dac0 0x7f93a00cfa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:14.720 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:14.721+0000 7f939e800640 1 -- 172.21.15.72:0/245649843 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f93a006dac0 msgr2=0x7f93a00cfa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:57:14.720 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:14.721+0000 7f939e800640 1 --2- 172.21.15.72:0/245649843 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f93a006dac0 0x7f93a00cfa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:14.720 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:14.721+0000 7f939e800640 1 -- 172.21.15.72:0/245649843 >> v2:172.21.15.117:3300/0 conn(0x7f93a0145b10 msgr2=0x7f93a006d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:57:14.720 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:14.721+0000 7f939e800640 1 --2- 172.21.15.72:0/245649843 >> v2:172.21.15.117:3300/0 conn(0x7f93a0145b10 0x7f93a006d580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:14.720 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:14.721+0000 7f939e800640 1 -- 172.21.15.72:0/245649843 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93a00cec40 con 0x7f93a00cff40 2024-04-04T06:57:14.721 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:14.722+0000 7f939e800640 1 --2- 172.21.15.72:0/245649843 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f93a00cff40 0x7f93a00d0370 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f93a006c350 tx=0x7f939802be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52e3e44913b2b3b9 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:14.721 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:14.722+0000 7f939ca00640 1 -- 172.21.15.72:0/245649843 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f939802c9f0 con 0x7f93a00cff40 2024-04-04T06:57:14.721 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:14.722+0000 7f939ca00640 1 -- 172.21.15.72:0/245649843 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f939802cb90 con 0x7f93a00cff40 2024-04-04T06:57:14.721 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:14.722+0000 7f939ca00640 1 -- 172.21.15.72:0/245649843 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93980343f0 con 0x7f93a00cff40 2024-04-04T06:57:14.722 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:14.723+0000 7f93a4a00640 1 -- 172.21.15.72:0/245649843 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f93a00cff40 msgr2=0x7f93a00d0370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:14.722 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:14.723+0000 7f93a4a00640 1 --2- 172.21.15.72:0/245649843 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f93a00cff40 0x7f93a00d0370 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f93a006c350 tx=0x7f939802be50 comp rx=0 tx=0).stop 2024-04-04T06:57:14.722 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:14.723+0000 7f93a4a00640 1 -- 172.21.15.72:0/245649843 shutdown_connections 2024-04-04T06:57:14.722 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:14.723+0000 7f93a4a00640 1 --2- 172.21.15.72:0/245649843 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f93a00cff40 0x7f93a00d0370 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:14.722 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:14.723+0000 7f93a4a00640 1 --2- 172.21.15.72:0/245649843 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f93a006dac0 0x7f93a00cfa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:14.722 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:14.723+0000 7f93a4a00640 1 --2- 172.21.15.72:0/245649843 >> v2:172.21.15.117:3300/0 conn(0x7f93a0145b10 0x7f93a006d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:14.722 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:14.723+0000 7f93a4a00640 1 -- 172.21.15.72:0/245649843 >> 172.21.15.72:0/245649843 conn(0x7f93a006b470 msgr2=0x7f93a006b850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:14.722 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:14.723+0000 7f93a4a00640 1 -- 172.21.15.72:0/245649843 shutdown_connections 2024-04-04T06:57:14.722 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:14.723+0000 7f93a4a00640 1 -- 172.21.15.72:0/245649843 wait complete. 2024-04-04T06:57:14.723 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:14.725+0000 7f93a4a00640 1 Processor -- start 2024-04-04T06:57:14.723 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:14.725+0000 7f93a4a00640 1 -- start start 2024-04-04T06:57:14.725 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:14.726+0000 7f93a4a00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f93a006dac0 0x7f93a013e630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:14.725 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:14.726+0000 7f93a4a00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f93a00cff40 0x7f93a013eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:14.725 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:14.726+0000 7f93a4a00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f93a0145b10 0x7f93a01f5b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:14.725 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:14.726+0000 7f93a4a00640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f93a00cf4e0 con 0x7f93a00cff40 2024-04-04T06:57:14.725 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:14.726+0000 7f93a4a00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f93a00cf200 con 0x7f93a0145b10 2024-04-04T06:57:14.725 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:14.726+0000 7f93a4a00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f93a006df40 con 0x7f93a006dac0 2024-04-04T06:57:14.726 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:14.726+0000 7f939d400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f93a00cff40 0x7f93a013eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:14.726 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:14.726+0000 7f939d400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f93a00cff40 0x7f93a013eb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:33572/0 (socket says 172.21.15.72:33572) 2024-04-04T06:57:14.726 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:14.726+0000 7f939d400640 1 -- 172.21.15.72:0/453379127 learned_addr learned my addr 172.21.15.72:0/453379127 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:57:14.726 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:14.726+0000 7f939e800640 1 --2- 172.21.15.72:0/453379127 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f93a0145b10 0x7f93a01f5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:14.726 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:14.726+0000 7f939de00640 1 --2- 172.21.15.72:0/453379127 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f93a006dac0 0x7f93a013e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:14.726 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:14.726+0000 7f939d400640 1 -- 172.21.15.72:0/453379127 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f93a006dac0 msgr2=0x7f93a013e630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:14.726 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:14.727+0000 7f939d400640 1 --2- 172.21.15.72:0/453379127 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f93a006dac0 0x7f93a013e630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:14.726 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:14.727+0000 7f939d400640 1 -- 172.21.15.72:0/453379127 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f93a0145b10 msgr2=0x7f93a01f5b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:14.726 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:14.727+0000 7f939d400640 1 --2- 172.21.15.72:0/453379127 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f93a0145b10 0x7f93a01f5b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:14.726 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:14.727+0000 7f939d400640 1 -- 172.21.15.72:0/453379127 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93a00ad5c0 con 0x7f93a00cff40 2024-04-04T06:57:14.726 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:14.727+0000 7f939e800640 1 --2- 172.21.15.72:0/453379127 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f93a0145b10 0x7f93a01f5b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-04T06:57:14.726 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:14.727+0000 7f939d400640 1 --2- 172.21.15.72:0/453379127 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f93a00cff40 0x7f93a013eb70 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f938c00d800 tx=0x7f938c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:14.727 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:14.727+0000 7f9396000640 1 -- 172.21.15.72:0/453379127 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f938c018020 con 0x7f93a00cff40 2024-04-04T06:57:14.727 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:14.727+0000 7f9396000640 1 -- 172.21.15.72:0/453379127 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f938c0096a0 con 0x7f93a00cff40 2024-04-04T06:57:14.727 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:14.727+0000 7f9396000640 1 -- 172.21.15.72:0/453379127 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f938c009a70 con 0x7f93a00cff40 2024-04-04T06:57:14.727 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:14.727+0000 7f93a4a00640 1 -- 172.21.15.72:0/453379127 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93a00ad8a0 con 0x7f93a00cff40 2024-04-04T06:57:14.727 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:14.727+0000 7f93a4a00640 1 -- 172.21.15.72:0/453379127 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93a00ade60 con 0x7f93a00cff40 2024-04-04T06:57:14.727 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:14.728+0000 7f93a4a00640 1 -- 172.21.15.72:0/453379127 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f93a0075730 con 0x7f93a00cff40 2024-04-04T06:57:14.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:14.729+0000 7f9396000640 1 -- 172.21.15.72:0/453379127 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f938c01b020 con 0x7f93a00cff40 2024-04-04T06:57:14.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:14.730+0000 7f9396000640 1 --2- 172.21.15.72:0/453379127 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f938006c8f0 0x7f938006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:14.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:14.730+0000 7f9396000640 1 -- 172.21.15.72:0/453379127 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f938c08bf00 con 0x7f93a00cff40 2024-04-04T06:57:14.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:14.731+0000 7f939de00640 1 --2- 172.21.15.72:0/453379127 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f938006c8f0 0x7f938006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:14.730 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:14.731+0000 7f939de00640 1 --2- 172.21.15.72:0/453379127 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f938006c8f0 0x7f938006edb0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f9390006fd0 tx=0x7f9390008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:14.733 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:14.735+0000 7f9396000640 1 -- 172.21.15.72:0/453379127 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f938c022030 con 0x7f93a00cff40 2024-04-04T06:57:14.935 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:14.936+0000 7f93a4a00640 1 -- 172.21.15.72:0/453379127 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f93a00d07a0 con 0x7f93a00cff40 2024-04-04T06:57:14.935 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:14.937+0000 7f9396000640 1 -- 172.21.15.72:0/453379127 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) ==== 100+0+11 (secure 0 0 0) 0x7f938c05a210 con 0x7f93a00cff40 2024-04-04T06:57:14.936 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 64 2024-04-04T06:57:14.938 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:14.939+0000 7f93a4a00640 1 -- 172.21.15.72:0/453379127 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f938006c8f0 msgr2=0x7f938006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:14.938 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:14.939+0000 7f93a4a00640 1 --2- 172.21.15.72:0/453379127 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f938006c8f0 0x7f938006edb0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f9390006fd0 tx=0x7f9390008040 comp rx=0 tx=0).stop 2024-04-04T06:57:14.939 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:14.939+0000 7f93a4a00640 1 -- 172.21.15.72:0/453379127 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f93a00cff40 msgr2=0x7f93a013eb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:14.939 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:14.939+0000 7f93a4a00640 1 --2- 172.21.15.72:0/453379127 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f93a00cff40 0x7f93a013eb70 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f938c00d800 tx=0x7f938c00dcc0 comp rx=0 tx=0).stop 2024-04-04T06:57:14.939 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:14.939+0000 7f93a4a00640 1 -- 172.21.15.72:0/453379127 shutdown_connections 2024-04-04T06:57:14.939 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:14.939+0000 7f93a4a00640 1 --2- 172.21.15.72:0/453379127 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f938006c8f0 0x7f938006edb0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:14.939 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:14.939+0000 7f93a4a00640 1 --2- 172.21.15.72:0/453379127 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f93a0145b10 0x7f93a01f5b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:14.939 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:14.939+0000 7f93a4a00640 1 --2- 172.21.15.72:0/453379127 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f93a00cff40 0x7f93a013eb70 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:14.939 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:14.939+0000 7f93a4a00640 1 --2- 172.21.15.72:0/453379127 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f93a006dac0 0x7f93a013e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:14.939 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:14.939+0000 7f93a4a00640 1 -- 172.21.15.72:0/453379127 >> 172.21.15.72:0/453379127 conn(0x7f93a006b470 msgr2=0x7f93a015a4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:14.939 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:14.940+0000 7f93a4a00640 1 -- 172.21.15.72:0/453379127 shutdown_connections 2024-04-04T06:57:14.939 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:14.940+0000 7f93a4a00640 1 -- 172.21.15.72:0/453379127 wait complete. 2024-04-04T06:57:14.959 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-04T06:57:15.161 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:15.162+0000 7fc04d000640 1 Processor -- start 2024-04-04T06:57:15.161 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:15.162+0000 7fc04d000640 1 -- start start 2024-04-04T06:57:15.162 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:15.164+0000 7fc04d000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc0480b4e40 0x7fc0480c6840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:15.163 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:15.164+0000 7fc04d000640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc04815e590 con 0x7fc048158390 2024-04-04T06:57:15.163 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:15.164+0000 7fc04d000640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0480c6e90 con 0x7fc048158770 2024-04-04T06:57:15.163 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:15.164+0000 7fc04d000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fc04815e830 con 0x7fc0480b4e40 2024-04-04T06:57:15.163 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:15.164+0000 7fc045e00640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fc048158390 0x7fc0480b4730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:39434/0 (socket says 172.21.15.72:39434) 2024-04-04T06:57:15.163 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:15.164+0000 7fc045e00640 1 -- 172.21.15.72:0/2464958055 learned_addr learned my addr 172.21.15.72:0/2464958055 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-04-04T06:57:15.165 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:15.164+0000 7fc045400640 1 --2- 172.21.15.72:0/2464958055 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc0480b4e40 0x7fc0480c6840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:15.165 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:15.165+0000 7fc044a00640 1 -- 172.21.15.72:0/2464958055 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2692379378 0 0) 0x7fc04815e590 con 0x7fc048158390 2024-04-04T06:57:15.165 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:15.165+0000 7fc044a00640 1 -- 172.21.15.72:0/2464958055 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc02c003520 con 0x7fc048158390 2024-04-04T06:57:15.165 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:15.165+0000 7fc044a00640 1 -- 172.21.15.72:0/2464958055 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1046613351 0 0) 0x7fc02c003520 con 0x7fc048158390 2024-04-04T06:57:15.165 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:15.165+0000 7fc044a00640 1 -- 172.21.15.72:0/2464958055 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc0480b4e40 msgr2=0x7fc0480c6840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:57:15.165 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:15.165+0000 7fc044a00640 1 --2- 172.21.15.72:0/2464958055 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc0480b4e40 0x7fc0480c6840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:15.165 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:15.165+0000 7fc044a00640 1 -- 172.21.15.72:0/2464958055 >> v1:172.21.15.117:6789/0 conn(0x7fc048158770 legacy=0x7fc0480cc8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:15.166 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:15.165+0000 7fc044a00640 1 -- 172.21.15.72:0/2464958055 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc04815eb10 con 0x7fc048158390 2024-04-04T06:57:15.166 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:15.165+0000 7fc044a00640 1 -- 172.21.15.72:0/2464958055 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2465650867 0 0) 0x7fc038001670 con 0x7fc048158390 2024-04-04T06:57:15.166 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:15.165+0000 7fc044a00640 1 -- 172.21.15.72:0/2464958055 >> v1:172.21.15.72:6789/0 conn(0x7fc048158390 legacy=0x7fc0480b4730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:15.166 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:15.165+0000 7fc044a00640 1 --2- 172.21.15.72:0/2464958055 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc02c0039e0 0x7fc02c003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:15.166 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:15.165+0000 7fc044a00640 1 --2- 172.21.15.72:0/2464958055 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc0480b4e40 0x7fc02c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:15.166 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:15.165+0000 7fc044a00640 1 --2- 172.21.15.72:0/2464958055 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc02c004d40 0x7fc02c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:15.166 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:15.165+0000 7fc044a00640 1 -- 172.21.15.72:0/2464958055 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fc04815e830 con 0x7fc02c004d40 2024-04-04T06:57:15.166 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:15.165+0000 7fc044a00640 1 -- 172.21.15.72:0/2464958055 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fc02c00dcb0 con 0x7fc02c0039e0 2024-04-04T06:57:15.166 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:15.165+0000 7fc044a00640 1 -- 172.21.15.72:0/2464958055 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fc02c00deb0 con 0x7fc0480b4e40 2024-04-04T06:57:15.166 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:15.165+0000 7fc046800640 1 --2- 172.21.15.72:0/2464958055 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc02c004d40 0x7fc02c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:15.166 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:15.166+0000 7fc045e00640 1 --2- 172.21.15.72:0/2464958055 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc02c0039e0 0x7fc02c003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:15.166 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:15.166+0000 7fc045400640 1 --2- 172.21.15.72:0/2464958055 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc0480b4e40 0x7fc02c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:15.166 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:15.166+0000 7fc046800640 1 -- 172.21.15.72:0/2464958055 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc0480b4e40 msgr2=0x7fc02c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:57:15.167 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:15.166+0000 7fc046800640 1 --2- 172.21.15.72:0/2464958055 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc0480b4e40 0x7fc02c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:15.167 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:15.166+0000 7fc046800640 1 -- 172.21.15.72:0/2464958055 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc02c0039e0 msgr2=0x7fc02c003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:57:15.167 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:15.166+0000 7fc046800640 1 --2- 172.21.15.72:0/2464958055 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc02c0039e0 0x7fc02c003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:15.167 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:15.166+0000 7fc046800640 1 -- 172.21.15.72:0/2464958055 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc02c003520 con 0x7fc02c004d40 2024-04-04T06:57:15.168 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:15.167+0000 7fc046800640 1 --2- 172.21.15.72:0/2464958055 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc02c004d40 0x7fc02c0051c0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fc040001e20 tx=0x7fc02c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65ff3aff16f93b94 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:15.168 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:15.167+0000 7fc044a00640 1 -- 172.21.15.72:0/2464958055 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc040001a70 con 0x7fc02c004d40 2024-04-04T06:57:15.168 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:15.167+0000 7fc044a00640 1 -- 172.21.15.72:0/2464958055 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc040003b70 con 0x7fc02c004d40 2024-04-04T06:57:15.168 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:15.167+0000 7fc044a00640 1 -- 172.21.15.72:0/2464958055 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0400050d0 con 0x7fc02c004d40 2024-04-04T06:57:15.169 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:15.168+0000 7fc04d000640 1 -- 172.21.15.72:0/2464958055 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc02c004d40 msgr2=0x7fc02c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:15.169 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:15.168+0000 7fc04d000640 1 --2- 172.21.15.72:0/2464958055 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc02c004d40 0x7fc02c0051c0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fc040001e20 tx=0x7fc02c005830 comp rx=0 tx=0).stop 2024-04-04T06:57:15.169 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:15.168+0000 7fc046800640 1 -- 172.21.15.72:0/2464958055 reap_dead start 2024-04-04T06:57:15.169 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:15.168+0000 7fc04d000640 1 -- 172.21.15.72:0/2464958055 shutdown_connections 2024-04-04T06:57:15.169 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:15.168+0000 7fc04d000640 1 -- 172.21.15.72:0/2464958055 >> 172.21.15.72:0/2464958055 conn(0x7fc04806b470 msgr2=0x7fc04806b880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:15.169 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:15.168+0000 7fc04d000640 1 -- 172.21.15.72:0/2464958055 shutdown_connections 2024-04-04T06:57:15.169 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:15.168+0000 7fc04d000640 1 -- 172.21.15.72:0/2464958055 wait complete. 2024-04-04T06:57:15.169 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:15.170+0000 7fc04d000640 1 Processor -- start 2024-04-04T06:57:15.169 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:15.170+0000 7fc04d000640 1 -- start start 2024-04-04T06:57:15.171 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:15.171+0000 7fc04d000640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc02c004d40 0x7fc0481f8040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:15.171 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:15.171+0000 7fc04d000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc04809d8a0 0x7fc0481558d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:15.171 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:15.171+0000 7fc04d000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc04815d0e0 0x7fc04815d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:15.171 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:15.171+0000 7fc04d000640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fc04815f490 con 0x7fc02c004d40 2024-04-04T06:57:15.171 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:15.171+0000 7fc04d000640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fc04815f310 con 0x7fc04815d0e0 2024-04-04T06:57:15.172 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:15.171+0000 7fc04d000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fc0480c6840 con 0x7fc04809d8a0 2024-04-04T06:57:15.172 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:15.171+0000 7fc045e00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc02c004d40 0x7fc0481f8040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:15.172 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:15.171+0000 7fc045e00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc02c004d40 0x7fc0481f8040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:33598/0 (socket says 172.21.15.72:33598) 2024-04-04T06:57:15.172 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:15.171+0000 7fc045e00640 1 -- 172.21.15.72:0/645694353 learned_addr learned my addr 172.21.15.72:0/645694353 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:57:15.172 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:15.171+0000 7fc045400640 1 --2- 172.21.15.72:0/645694353 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc04809d8a0 0x7fc0481558d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:15.172 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:15.172+0000 7fc046800640 1 --2- 172.21.15.72:0/645694353 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc04815d0e0 0x7fc04815d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:15.172 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:15.172+0000 7fc045e00640 1 -- 172.21.15.72:0/645694353 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc04809d8a0 msgr2=0x7fc0481558d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:15.172 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:15.172+0000 7fc045e00640 1 --2- 172.21.15.72:0/645694353 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc04809d8a0 0x7fc0481558d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:15.172 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:15.172+0000 7fc045e00640 1 -- 172.21.15.72:0/645694353 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc04815d0e0 msgr2=0x7fc04815d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:15.172 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:15.172+0000 7fc045e00640 1 --2- 172.21.15.72:0/645694353 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc04815d0e0 0x7fc04815d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:15.172 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:15.172+0000 7fc045e00640 1 -- 172.21.15.72:0/645694353 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0481f8890 con 0x7fc02c004d40 2024-04-04T06:57:15.172 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:15.172+0000 7fc046800640 1 --2- 172.21.15.72:0/645694353 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc04815d0e0 0x7fc04815d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-04T06:57:15.172 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:15.172+0000 7fc045400640 1 --2- 172.21.15.72:0/645694353 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc04809d8a0 0x7fc0481558d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-04T06:57:15.172 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:15.172+0000 7fc045e00640 1 --2- 172.21.15.72:0/645694353 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc02c004d40 0x7fc0481f8040 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fc03800e880 tx=0x7fc03800ed40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:15.173 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:15.173+0000 7fc03e000640 1 -- 172.21.15.72:0/645694353 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc03800c870 con 0x7fc02c004d40 2024-04-04T06:57:15.173 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:15.173+0000 7fc03e000640 1 -- 172.21.15.72:0/645694353 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc038018070 con 0x7fc02c004d40 2024-04-04T06:57:15.173 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:15.173+0000 7fc03e000640 1 -- 172.21.15.72:0/645694353 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc03800cc50 con 0x7fc02c004d40 2024-04-04T06:57:15.173 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:15.173+0000 7fc04d000640 1 -- 172.21.15.72:0/645694353 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0481f8b70 con 0x7fc02c004d40 2024-04-04T06:57:15.173 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:15.173+0000 7fc04d000640 1 -- 172.21.15.72:0/645694353 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc04806dbd0 con 0x7fc02c004d40 2024-04-04T06:57:15.173 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:15.174+0000 7fc04d000640 1 -- 172.21.15.72:0/645694353 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc04815daa0 con 0x7fc02c004d40 2024-04-04T06:57:15.173 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:15.175+0000 7fc03e000640 1 -- 172.21.15.72:0/645694353 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc03801d460 con 0x7fc02c004d40 2024-04-04T06:57:15.175 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:15.176+0000 7fc03e000640 1 --2- 172.21.15.72:0/645694353 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fc02806c8f0 0x7fc02806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:15.175 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:15.177+0000 7fc03e000640 1 -- 172.21.15.72:0/645694353 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7fc03808bb40 con 0x7fc02c004d40 2024-04-04T06:57:15.175 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:15.177+0000 7fc045400640 1 --2- 172.21.15.72:0/645694353 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fc02806c8f0 0x7fc02806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:15.176 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:15.177+0000 7fc045400640 1 --2- 172.21.15.72:0/645694353 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fc02806c8f0 0x7fc02806edb0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fc04815cdb0 tx=0x7fc034008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:15.178 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:15.180+0000 7fc03e000640 1 -- 172.21.15.72:0/645694353 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fc038059800 con 0x7fc02c004d40 2024-04-04T06:57:15.396 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:15.397+0000 7fc04d000640 1 -- 172.21.15.72:0/645694353 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fc048075840 con 0x7fc02c004d40 2024-04-04T06:57:15.396 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:15.398+0000 7fc03e000640 1 -- 172.21.15.72:0/645694353 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v22) ==== 80+0+0 (secure 0 0 0) 0x7fc03805db00 con 0x7fc02c004d40 2024-04-04T06:57:15.397 INFO:teuthology.orchestra.run.smithi072.stderr:listed 0 entries 2024-04-04T06:57:15.399 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:15.400+0000 7fc04d000640 1 -- 172.21.15.72:0/645694353 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fc02806c8f0 msgr2=0x7fc02806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:15.399 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:15.400+0000 7fc04d000640 1 --2- 172.21.15.72:0/645694353 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fc02806c8f0 0x7fc02806edb0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fc04815cdb0 tx=0x7fc034008040 comp rx=0 tx=0).stop 2024-04-04T06:57:15.400 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:15.400+0000 7fc04d000640 1 -- 172.21.15.72:0/645694353 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc02c004d40 msgr2=0x7fc0481f8040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:15.400 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:15.400+0000 7fc04d000640 1 --2- 172.21.15.72:0/645694353 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc02c004d40 0x7fc0481f8040 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fc03800e880 tx=0x7fc03800ed40 comp rx=0 tx=0).stop 2024-04-04T06:57:15.400 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:15.401+0000 7fc04d000640 1 -- 172.21.15.72:0/645694353 shutdown_connections 2024-04-04T06:57:15.400 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:15.401+0000 7fc04d000640 1 --2- 172.21.15.72:0/645694353 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fc02806c8f0 0x7fc02806edb0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:15.400 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:15.401+0000 7fc04d000640 1 --2- 172.21.15.72:0/645694353 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc04815d0e0 0x7fc04815d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:15.400 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:15.401+0000 7fc04d000640 1 --2- 172.21.15.72:0/645694353 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc04809d8a0 0x7fc0481558d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:15.400 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:15.401+0000 7fc04d000640 1 --2- 172.21.15.72:0/645694353 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc02c004d40 0x7fc0481f8040 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:15.400 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:15.401+0000 7fc04d000640 1 -- 172.21.15.72:0/645694353 >> 172.21.15.72:0/645694353 conn(0x7fc04806b470 msgr2=0x7fc0480cf250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:15.400 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:15.401+0000 7fc04d000640 1 -- 172.21.15.72:0/645694353 shutdown_connections 2024-04-04T06:57:15.400 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:15.401+0000 7fc04d000640 1 -- 172.21.15.72:0/645694353 wait complete. 2024-04-04T06:57:15.423 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-04-04T06:57:15.423 DEBUG:teuthology.orchestra.run.smithi072:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-04T06:57:15.468 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-04T06:57:15.757 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:15.758+0000 7f3777200640 1 Processor -- start 2024-04-04T06:57:15.757 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:15.758+0000 7f3777200640 1 -- start start 2024-04-04T06:57:15.759 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:15.760+0000 7f3777200640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f37780d2e30 0x7f37780d3290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:15.759 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:15.760+0000 7f3777200640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f37780d08e0 0x7f37780d0d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:15.759 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:15.760+0000 7f3777200640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f37780d12b0 con 0x7f377815e5a0 2024-04-04T06:57:15.760 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:15.760+0000 7f3777200640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f37780d37d0 con 0x7f37780d2e30 2024-04-04T06:57:15.760 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:15.760+0000 7f3777200640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f37780cf7f0 con 0x7f37780d08e0 2024-04-04T06:57:15.760 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:15.760+0000 7f3775400640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f37780d2e30 0x7f37780d3290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:15.760 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:15.761+0000 7f3775e00640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f377815e5a0 0x7f37780b75c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:39448/0 (socket says 172.21.15.72:39448) 2024-04-04T06:57:15.760 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:15.761+0000 7f3775e00640 1 -- 172.21.15.72:0/2560891203 learned_addr learned my addr 172.21.15.72:0/2560891203 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-04-04T06:57:15.760 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:15.761+0000 7f3776800640 1 --2- 172.21.15.72:0/2560891203 >> v2:172.21.15.117:3300/0 conn(0x7f37780d08e0 0x7f37780d0d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:15.760 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:15.761+0000 7f3775400640 1 -- 172.21.15.72:0/2560891203 >> v2:172.21.15.117:3300/0 conn(0x7f37780d08e0 msgr2=0x7f37780d0d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:57:15.760 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:15.761+0000 7f3775400640 1 --2- 172.21.15.72:0/2560891203 >> v2:172.21.15.117:3300/0 conn(0x7f37780d08e0 0x7f37780d0d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:15.760 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:15.761+0000 7f3775400640 1 -- 172.21.15.72:0/2560891203 >> v1:172.21.15.72:6789/0 conn(0x7f377815e5a0 legacy=0x7f37780b75c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:15.760 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:15.761+0000 7f3775400640 1 -- 172.21.15.72:0/2560891203 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37780cfad0 con 0x7f37780d2e30 2024-04-04T06:57:15.760 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:15.762+0000 7f3775400640 1 --2- 172.21.15.72:0/2560891203 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f37780d2e30 0x7f37780d3290 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f37780d4c40 tx=0x7f376402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=903e7e1d2c9baae2 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:15.761 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:15.762+0000 7f3774a00640 1 -- 172.21.15.72:0/2560891203 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3764035020 con 0x7f37780d2e30 2024-04-04T06:57:15.761 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:15.763+0000 7f3774a00640 1 -- 172.21.15.72:0/2560891203 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3764031830 con 0x7f37780d2e30 2024-04-04T06:57:15.761 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:15.763+0000 7f3774a00640 1 -- 172.21.15.72:0/2560891203 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3764031c00 con 0x7f37780d2e30 2024-04-04T06:57:15.762 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:15.763+0000 7f3777200640 1 -- 172.21.15.72:0/2560891203 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f37780d2e30 msgr2=0x7f37780d3290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:15.762 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:15.763+0000 7f3777200640 1 --2- 172.21.15.72:0/2560891203 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f37780d2e30 0x7f37780d3290 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f37780d4c40 tx=0x7f376402b8d0 comp rx=0 tx=0).stop 2024-04-04T06:57:15.762 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:15.763+0000 7f3777200640 1 -- 172.21.15.72:0/2560891203 shutdown_connections 2024-04-04T06:57:15.762 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:15.763+0000 7f3777200640 1 --2- 172.21.15.72:0/2560891203 >> v2:172.21.15.117:3300/0 conn(0x7f37780d08e0 0x7f37780d0d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:15.762 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:15.763+0000 7f3777200640 1 --2- 172.21.15.72:0/2560891203 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f37780d2e30 0x7f37780d3290 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:15.762 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:15.763+0000 7f3777200640 1 -- 172.21.15.72:0/2560891203 >> 172.21.15.72:0/2560891203 conn(0x7f377806b890 msgr2=0x7f377806bca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:15.763 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:15.763+0000 7f3777200640 1 -- 172.21.15.72:0/2560891203 shutdown_connections 2024-04-04T06:57:15.763 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:15.763+0000 7f3777200640 1 -- 172.21.15.72:0/2560891203 wait complete. 2024-04-04T06:57:15.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:15.765+0000 7f3777200640 1 Processor -- start 2024-04-04T06:57:15.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:15.766+0000 7f3777200640 1 -- start start 2024-04-04T06:57:15.767 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:15.767+0000 7f3777200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f37780d08e0 0x7f37780ca0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:15.767 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:15.767+0000 7f3777200640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f37780d2e30 0x7f377814c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:15.767 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:15.767+0000 7f3777200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f377815e5a0 0x7f3778158610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:15.767 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:15.767+0000 7f3777200640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f37780d2910 con 0x7f37780d2e30 2024-04-04T06:57:15.767 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:15.767+0000 7f3777200640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f37780d2630 con 0x7f37780d08e0 2024-04-04T06:57:15.767 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:15.767+0000 7f3777200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f37780b7cd0 con 0x7f377815e5a0 2024-04-04T06:57:15.767 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:15.767+0000 7f3775400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f37780d2e30 0x7f377814c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:15.767 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:15.767+0000 7f3775400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f37780d2e30 0x7f377814c8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:33606/0 (socket says 172.21.15.72:33606) 2024-04-04T06:57:15.767 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:15.767+0000 7f3775400640 1 -- 172.21.15.72:0/2181004393 learned_addr learned my addr 172.21.15.72:0/2181004393 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:57:15.767 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:15.768+0000 7f3775e00640 1 --2- 172.21.15.72:0/2181004393 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f37780d08e0 0x7f37780ca0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:15.767 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:15.768+0000 7f3776800640 1 --2- 172.21.15.72:0/2181004393 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f377815e5a0 0x7f3778158610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:15.767 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:15.768+0000 7f3775400640 1 -- 172.21.15.72:0/2181004393 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f377815e5a0 msgr2=0x7f3778158610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:15.767 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:15.768+0000 7f3775400640 1 --2- 172.21.15.72:0/2181004393 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f377815e5a0 0x7f3778158610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:15.768 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:15.768+0000 7f3775400640 1 -- 172.21.15.72:0/2181004393 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f37780d08e0 msgr2=0x7f37780ca0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:15.768 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:15.768+0000 7f3775400640 1 --2- 172.21.15.72:0/2181004393 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f37780d08e0 0x7f37780ca0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:15.768 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:15.768+0000 7f3775400640 1 -- 172.21.15.72:0/2181004393 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3778158e60 con 0x7f37780d2e30 2024-04-04T06:57:15.768 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:15.768+0000 7f3775400640 1 --2- 172.21.15.72:0/2181004393 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f37780d2e30 0x7f377814c8d0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f3764009890 tx=0x7f37640046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:15.769 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:15.769+0000 7f376e000640 1 -- 172.21.15.72:0/2181004393 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3764041070 con 0x7f37780d2e30 2024-04-04T06:57:15.769 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:15.769+0000 7f376e000640 1 -- 172.21.15.72:0/2181004393 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f376403aa30 con 0x7f37780d2e30 2024-04-04T06:57:15.769 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:15.769+0000 7f3777200640 1 -- 172.21.15.72:0/2181004393 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3778159140 con 0x7f37780d2e30 2024-04-04T06:57:15.769 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:15.769+0000 7f376e000640 1 -- 172.21.15.72:0/2181004393 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3764035040 con 0x7f37780d2e30 2024-04-04T06:57:15.769 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:15.769+0000 7f3777200640 1 -- 172.21.15.72:0/2181004393 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3778159700 con 0x7f37780d2e30 2024-04-04T06:57:15.769 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:15.770+0000 7f3777200640 1 -- 172.21.15.72:0/2181004393 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f37780756c0 con 0x7f37780d2e30 2024-04-04T06:57:15.769 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:15.771+0000 7f376e000640 1 -- 172.21.15.72:0/2181004393 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3764038020 con 0x7f37780d2e30 2024-04-04T06:57:15.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:15.772+0000 7f376e000640 1 --2- 172.21.15.72:0/2181004393 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f375806c8f0 0x7f375806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:15.771 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:15.772+0000 7f376e000640 1 -- 172.21.15.72:0/2181004393 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f37640ad6b0 con 0x7f37780d2e30 2024-04-04T06:57:15.771 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:15.772+0000 7f3775e00640 1 --2- 172.21.15.72:0/2181004393 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f375806c8f0 0x7f375806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:15.771 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:15.773+0000 7f3775e00640 1 --2- 172.21.15.72:0/2181004393 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f375806c8f0 0x7f375806edb0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f37780b9690 tx=0x7f3768009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:15.779 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:15.781+0000 7f376e000640 1 -- 172.21.15.72:0/2181004393 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f376407ba50 con 0x7f37780d2e30 2024-04-04T06:57:15.977 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:15.979+0000 7f3777200640 1 -- 172.21.15.72:0/2181004393 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f37780d2090 con 0x7f37780d2e30 2024-04-04T06:57:15.980 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:15.981+0000 7f376e000640 1 -- 172.21.15.72:0/2181004393 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16831 (secure 0 0 0) 0x7f376407b350 con 0x7f37780d2e30 2024-04-04T06:57:15.980 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T06:57:15.980 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":22,"fsid":"6708bac2-4f50-49b5-87a9-c390fd333eb3","created":"2024-04-04T06:56:04.282498+0000","modified":"2024-04-04T06:57:11.239134+0000","last_up_change":"2024-04-04T06:56:16.716089+0000","last_in_change":"2024-04-04T06:56:07.768593+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-04T06:56:17.421685+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-04T06:56:26.822661+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-04T06:56:27.429816+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7c345991-5af8-4dc6-a481-28610c40e128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":3889813953},{"type":"v1","addr":"172.21.15.72:6818","nonce":3889813953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":3889813953},{"type":"v1","addr":"172.21.15.72:6821","nonce":3889813953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":3889813953},{"type":"v1","addr":"172.21.15.72:6826","nonce":3889813953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":3889813953},{"type":"v1","addr":"172.21.15.72:6823","nonce":3889813953}]},"public_addr":"172.21.15.72:6818/3889813953","cluster_addr":"172.21.15.72:6821/3889813953","heartbeat_back_addr":"172.21.15.72:6826/3889813953","heartbeat_front_addr":"172.21.15.72:6823/3889813953","state":["exists","up"]},{"osd":1,"uuid":"1b3f7ab2-a56c-488d-a89a-1f3572361c95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":3101663154},{"type":"v1","addr":"172.21.15.72:6801","nonce":3101663154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":3101663154},{"type":"v1","addr":"172.21.15.72:6803","nonce":3101663154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":3101663154},{"type":"v1","addr":"172.21.15.72:6807","nonce":3101663154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":3101663154},{"type":"v1","addr":"172.21.15.72:6805","nonce":3101663154}]},"public_addr":"172.21.15.72:6801/3101663154","cluster_addr":"172.21.15.72:6803/3101663154","heartbeat_back_addr":"172.21.15.72:6807/3101663154","heartbeat_front_addr":"172.21.15.72:6805/3101663154","state":["exists","up"]},{"osd":2,"uuid":"fc9aa512-53df-40d7-ba04-3e6b7dcd1e34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":235374192},{"type":"v1","addr":"172.21.15.72:6809","nonce":235374192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":235374192},{"type":"v1","addr":"172.21.15.72:6811","nonce":235374192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":235374192},{"type":"v1","addr":"172.21.15.72:6815","nonce":235374192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":235374192},{"type":"v1","addr":"172.21.15.72:6813","nonce":235374192}]},"public_addr":"172.21.15.72:6809/235374192","cluster_addr":"172.21.15.72:6811/235374192","heartbeat_back_addr":"172.21.15.72:6815/235374192","heartbeat_front_addr":"172.21.15.72:6813/235374192","state":["exists","up"]},{"osd":3,"uuid":"b4f63eed-dc5b-4aba-bb50-de46eb41492b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6817","nonce":2806631742},{"type":"v1","addr":"172.21.15.72:6819","nonce":2806631742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":2806631742},{"type":"v1","addr":"172.21.15.72:6827","nonce":2806631742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":2806631742},{"type":"v1","addr":"172.21.15.72:6831","nonce":2806631742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":2806631742},{"type":"v1","addr":"172.21.15.72:6829","nonce":2806631742}]},"public_addr":"172.21.15.72:6819/2806631742","cluster_addr":"172.21.15.72:6827/2806631742","heartbeat_back_addr":"172.21.15.72:6831/2806631742","heartbeat_front_addr":"172.21.15.72:6829/2806631742","state":["exists","up"]},{"osd":4,"uuid":"9e985ef8-d711-4172-9286-c54e560895d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":4293536423},{"type":"v1","addr":"172.21.15.117:6825","nonce":4293536423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":4293536423},{"type":"v1","addr":"172.21.15.117:6827","nonce":4293536423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":4293536423},{"type":"v1","addr":"172.21.15.117:6831","nonce":4293536423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":4293536423},{"type":"v1","addr":"172.21.15.117:6829","nonce":4293536423}]},"public_addr":"172.21.15.117:6825/4293536423","cluster_addr":"172.21.15.117:6827/4293536423","heartbeat_back_addr":"172.21.15.117:6831/4293536423","heartbeat_front_addr":"172.21.15.117:6829/4293536423","state":["exists","up"]},{"osd":5,"uuid":"3e9f082b-8d7d-455f-8a96-66d0b4857125","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":684971679},{"type":"v1","addr":"172.21.15.117:6801","nonce":684971679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":684971679},{"type":"v1","addr":"172.21.15.117:6803","nonce":684971679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":684971679},{"type":"v1","addr":"172.21.15.117:6807","nonce":684971679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":684971679},{"type":"v1","addr":"172.21.15.117:6805","nonce":684971679}]},"public_addr":"172.21.15.117:6801/684971679","cluster_addr":"172.21.15.117:6803/684971679","heartbeat_back_addr":"172.21.15.117:6807/684971679","heartbeat_front_addr":"172.21.15.117:6805/684971679","state":["exists","up"]},{"osd":6,"uuid":"bcdafa9f-a870-4398-a38d-ab7697676473","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":2781186528},{"type":"v1","addr":"172.21.15.117:6809","nonce":2781186528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":2781186528},{"type":"v1","addr":"172.21.15.117:6811","nonce":2781186528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":2781186528},{"type":"v1","addr":"172.21.15.117:6815","nonce":2781186528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":2781186528},{"type":"v1","addr":"172.21.15.117:6813","nonce":2781186528}]},"public_addr":"172.21.15.117:6809/2781186528","cluster_addr":"172.21.15.117:6811/2781186528","heartbeat_back_addr":"172.21.15.117:6815/2781186528","heartbeat_front_addr":"172.21.15.117:6813/2781186528","state":["exists","up"]},{"osd":7,"uuid":"b68ec562-ff35-4d2d-a733-c896f8920cfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":617469882},{"type":"v1","addr":"172.21.15.117:6817","nonce":617469882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":617469882},{"type":"v1","addr":"172.21.15.117:6819","nonce":617469882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":617469882},{"type":"v1","addr":"172.21.15.117:6823","nonce":617469882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":617469882},{"type":"v1","addr":"172.21.15.117:6821","nonce":617469882}]},"public_addr":"172.21.15.117:6817/617469882","cluster_addr":"172.21.15.117:6819/617469882","heartbeat_back_addr":"172.21.15.117:6823/617469882","heartbeat_front_addr":"172.21.15.117:6821/617469882","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.347700+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.296619+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.361345+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.093323+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:12.857605+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:12.816090+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.083163+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.121639+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.13","mappings":[{"from":7,"to":1}]},{"pgid":"3.19","mappings":[{"from":3,"to":2}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.28","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-04T06:57:15.982 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:15.983+0000 7f3777200640 1 -- 172.21.15.72:0/2181004393 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f375806c8f0 msgr2=0x7f375806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:15.982 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:15.983+0000 7f3777200640 1 --2- 172.21.15.72:0/2181004393 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f375806c8f0 0x7f375806edb0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f37780b9690 tx=0x7f3768009040 comp rx=0 tx=0).stop 2024-04-04T06:57:15.982 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:15.983+0000 7f3777200640 1 -- 172.21.15.72:0/2181004393 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f37780d2e30 msgr2=0x7f377814c8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:15.983 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:15.983+0000 7f3777200640 1 --2- 172.21.15.72:0/2181004393 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f37780d2e30 0x7f377814c8d0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f3764009890 tx=0x7f37640046c0 comp rx=0 tx=0).stop 2024-04-04T06:57:15.983 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:15.983+0000 7f3777200640 1 -- 172.21.15.72:0/2181004393 shutdown_connections 2024-04-04T06:57:15.983 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:15.983+0000 7f3777200640 1 --2- 172.21.15.72:0/2181004393 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f375806c8f0 0x7f375806edb0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:15.983 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:15.983+0000 7f3777200640 1 --2- 172.21.15.72:0/2181004393 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f377815e5a0 0x7f3778158610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:15.983 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:15.983+0000 7f3777200640 1 --2- 172.21.15.72:0/2181004393 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f37780d2e30 0x7f377814c8d0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:15.983 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:15.983+0000 7f3777200640 1 --2- 172.21.15.72:0/2181004393 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f37780d08e0 0x7f37780ca0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:15.983 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:15.983+0000 7f3777200640 1 -- 172.21.15.72:0/2181004393 >> 172.21.15.72:0/2181004393 conn(0x7f377806b890 msgr2=0x7f377815d7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:15.983 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:15.984+0000 7f3777200640 1 -- 172.21.15.72:0/2181004393 shutdown_connections 2024-04-04T06:57:15.983 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:15.984+0000 7f3777200640 1 -- 172.21.15.72:0/2181004393 wait complete. 2024-04-04T06:57:16.002 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-04T06:56:17.421685+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-04T06:56:26.822661+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-04T06:56:27.429816+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-04T06:57:16.002 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-04T06:57:16.209 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:16.210+0000 7f90f0200640 1 Processor -- start 2024-04-04T06:57:16.209 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:16.210+0000 7f90f0200640 1 -- start start 2024-04-04T06:57:16.210 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:16.211+0000 7f90f0200640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f90e8145b10 0x7f90e806d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:16.210 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:16.212+0000 7f90f0200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f90e80d0110 0x7f90e8071430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:16.210 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:16.212+0000 7f90f0200640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f90e8145ef0 con 0x7f90e806dac0 2024-04-04T06:57:16.210 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:16.212+0000 7f90f0200640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f90e80cea10 con 0x7f90e8145b10 2024-04-04T06:57:16.211 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:16.212+0000 7f90f0200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f90e806e310 con 0x7f90e80d0110 2024-04-04T06:57:16.211 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:16.212+0000 7f90ece00640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f90e806dac0 0x7f90e80cfa00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.72:43222/0 (socket says 172.21.15.72:43222) 2024-04-04T06:57:16.211 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:16.212+0000 7f90ece00640 1 -- 172.21.15.72:0/3172817142 learned_addr learned my addr 172.21.15.72:0/3172817142 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-04-04T06:57:16.211 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:16.212+0000 7f90ee200640 1 --2- 172.21.15.72:0/3172817142 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f90e80d0110 0x7f90e8071430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:16.211 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:16.212+0000 7f90ed800640 1 --2- 172.21.15.72:0/3172817142 >> v2:172.21.15.117:3300/0 conn(0x7f90e8145b10 0x7f90e806d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:16.212 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:16.213+0000 7f90ee200640 1 -- 172.21.15.72:0/3172817142 >> v2:172.21.15.117:3300/0 conn(0x7f90e8145b10 msgr2=0x7f90e806d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:57:16.212 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:16.213+0000 7f90ee200640 1 --2- 172.21.15.72:0/3172817142 >> v2:172.21.15.117:3300/0 conn(0x7f90e8145b10 0x7f90e806d580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:16.212 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:16.213+0000 7f90ee200640 1 -- 172.21.15.72:0/3172817142 >> v1:172.21.15.117:6789/0 conn(0x7f90e806dac0 legacy=0x7f90e80cfa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:16.212 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:16.213+0000 7f90ee200640 1 -- 172.21.15.72:0/3172817142 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90e80cec40 con 0x7f90e80d0110 2024-04-04T06:57:16.213 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:16.214+0000 7f90ee200640 1 --2- 172.21.15.72:0/3172817142 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f90e80d0110 0x7f90e8071430 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f90e806e490 tx=0x7f90e002b810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7f64d019e9a3406f server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:16.213 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:16.215+0000 7f90e7e00640 1 -- 172.21.15.72:0/3172817142 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90e0031770 con 0x7f90e80d0110 2024-04-04T06:57:16.213 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:16.215+0000 7f90e7e00640 1 -- 172.21.15.72:0/3172817142 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90e0037070 con 0x7f90e80d0110 2024-04-04T06:57:16.213 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:16.215+0000 7f90e7e00640 1 -- 172.21.15.72:0/3172817142 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90e0031b30 con 0x7f90e80d0110 2024-04-04T06:57:16.214 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:16.215+0000 7f90f0200640 1 -- 172.21.15.72:0/3172817142 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f90e80d0110 msgr2=0x7f90e8071430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:16.214 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:16.215+0000 7f90f0200640 1 --2- 172.21.15.72:0/3172817142 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f90e80d0110 0x7f90e8071430 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f90e806e490 tx=0x7f90e002b810 comp rx=0 tx=0).stop 2024-04-04T06:57:16.215 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:16.215+0000 7f90f0200640 1 -- 172.21.15.72:0/3172817142 shutdown_connections 2024-04-04T06:57:16.215 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:16.215+0000 7f90f0200640 1 --2- 172.21.15.72:0/3172817142 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f90e80d0110 0x7f90e8071430 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:16.215 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:16.215+0000 7f90f0200640 1 --2- 172.21.15.72:0/3172817142 >> v2:172.21.15.117:3300/0 conn(0x7f90e8145b10 0x7f90e806d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:16.215 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:16.215+0000 7f90f0200640 1 -- 172.21.15.72:0/3172817142 >> 172.21.15.72:0/3172817142 conn(0x7f90e806b470 msgr2=0x7f90e806b850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:16.215 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:16.216+0000 7f90f0200640 1 -- 172.21.15.72:0/3172817142 shutdown_connections 2024-04-04T06:57:16.215 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:16.216+0000 7f90f0200640 1 -- 172.21.15.72:0/3172817142 wait complete. 2024-04-04T06:57:16.216 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:16.217+0000 7f90f0200640 1 Processor -- start 2024-04-04T06:57:16.216 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:16.217+0000 7f90f0200640 1 -- start start 2024-04-04T06:57:16.219 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:16.218+0000 7f90f0200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f90e806dac0 0x7f90e8159b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:16.219 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:16.218+0000 7f90f0200640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f90e80d0110 0x7f90e815d830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:16.219 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:16.218+0000 7f90f0200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f90e8145b10 0x7f90e80b0c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:16.219 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:16.218+0000 7f90f0200640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f90e80cf4e0 con 0x7f90e80d0110 2024-04-04T06:57:16.219 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:16.218+0000 7f90f0200640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f90e80cf200 con 0x7f90e8145b10 2024-04-04T06:57:16.219 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:16.218+0000 7f90f0200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f90e806df70 con 0x7f90e806dac0 2024-04-04T06:57:16.219 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:16.219+0000 7f90ece00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f90e80d0110 0x7f90e815d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:16.219 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:16.219+0000 7f90ece00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f90e80d0110 0x7f90e815d830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:33618/0 (socket says 172.21.15.72:33618) 2024-04-04T06:57:16.219 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:16.219+0000 7f90ece00640 1 -- 172.21.15.72:0/1722264527 learned_addr learned my addr 172.21.15.72:0/1722264527 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:57:16.220 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:16.219+0000 7f90ed800640 1 --2- 172.21.15.72:0/1722264527 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f90e806dac0 0x7f90e8159b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:16.220 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:16.219+0000 7f90ee200640 1 --2- 172.21.15.72:0/1722264527 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f90e8145b10 0x7f90e80b0c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:16.220 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:16.219+0000 7f90ece00640 1 -- 172.21.15.72:0/1722264527 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f90e806dac0 msgr2=0x7f90e8159b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:16.220 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:16.219+0000 7f90ece00640 1 --2- 172.21.15.72:0/1722264527 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f90e806dac0 0x7f90e8159b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:16.220 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:16.219+0000 7f90ece00640 1 -- 172.21.15.72:0/1722264527 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f90e8145b10 msgr2=0x7f90e80b0c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:16.220 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:16.219+0000 7f90ece00640 1 --2- 172.21.15.72:0/1722264527 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f90e8145b10 0x7f90e80b0c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:16.220 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:16.219+0000 7f90ece00640 1 -- 172.21.15.72:0/1722264527 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90e815e1a0 con 0x7f90e80d0110 2024-04-04T06:57:16.220 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:16.220+0000 7f90ece00640 1 --2- 172.21.15.72:0/1722264527 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f90e80d0110 0x7f90e815d830 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f90d400c400 tx=0x7f90d400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:16.220 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:16.220+0000 7f90e5600640 1 -- 172.21.15.72:0/1722264527 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90d4017070 con 0x7f90e80d0110 2024-04-04T06:57:16.220 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:16.220+0000 7f90e5600640 1 -- 172.21.15.72:0/1722264527 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90d4005ce0 con 0x7f90e80d0110 2024-04-04T06:57:16.220 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:16.220+0000 7f90e5600640 1 -- 172.21.15.72:0/1722264527 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90d40072f0 con 0x7f90e80d0110 2024-04-04T06:57:16.220 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:16.220+0000 7f90f0200640 1 -- 172.21.15.72:0/1722264527 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90e815e480 con 0x7f90e80d0110 2024-04-04T06:57:16.220 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:16.220+0000 7f90f0200640 1 -- 172.21.15.72:0/1722264527 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90e8139a40 con 0x7f90e80d0110 2024-04-04T06:57:16.221 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:16.221+0000 7f90f0200640 1 -- 172.21.15.72:0/1722264527 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90e8075730 con 0x7f90e80d0110 2024-04-04T06:57:16.221 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:16.222+0000 7f90e5600640 1 -- 172.21.15.72:0/1722264527 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f90d401a070 con 0x7f90e80d0110 2024-04-04T06:57:16.222 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:16.223+0000 7f90e5600640 1 --2- 172.21.15.72:0/1722264527 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f90c806c8f0 0x7f90c806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:16.222 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:16.223+0000 7f90e5600640 1 -- 172.21.15.72:0/1722264527 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f90d408af30 con 0x7f90e80d0110 2024-04-04T06:57:16.222 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:16.224+0000 7f90ed800640 1 --2- 172.21.15.72:0/1722264527 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f90c806c8f0 0x7f90c806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:16.222 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:16.224+0000 7f90ed800640 1 --2- 172.21.15.72:0/1722264527 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f90c806c8f0 0x7f90c806edb0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f90dc0073f0 tx=0x7f90dc00b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:16.226 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:16.228+0000 7f90e5600640 1 -- 172.21.15.72:0/1722264527 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f90d4059370 con 0x7f90e80d0110 2024-04-04T06:57:16.426 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:16.428+0000 7f90f0200640 1 -- 172.21.15.72:0/1722264527 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f90e8139810 con 0x7f90e80d0110 2024-04-04T06:57:16.427 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:16.429+0000 7f90e5600640 1 -- 172.21.15.72:0/1722264527 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) ==== 93+0+10 (secure 0 0 0) 0x7f90d405f030 con 0x7f90e80d0110 2024-04-04T06:57:16.427 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 1 2024-04-04T06:57:16.430 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:16.431+0000 7f90f0200640 1 -- 172.21.15.72:0/1722264527 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f90c806c8f0 msgr2=0x7f90c806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:16.430 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:16.431+0000 7f90f0200640 1 --2- 172.21.15.72:0/1722264527 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f90c806c8f0 0x7f90c806edb0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f90dc0073f0 tx=0x7f90dc00b040 comp rx=0 tx=0).stop 2024-04-04T06:57:16.430 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:16.431+0000 7f90f0200640 1 -- 172.21.15.72:0/1722264527 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f90e80d0110 msgr2=0x7f90e815d830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:16.430 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:16.431+0000 7f90f0200640 1 --2- 172.21.15.72:0/1722264527 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f90e80d0110 0x7f90e815d830 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f90d400c400 tx=0x7f90d400c8c0 comp rx=0 tx=0).stop 2024-04-04T06:57:16.430 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:16.431+0000 7f90f0200640 1 -- 172.21.15.72:0/1722264527 shutdown_connections 2024-04-04T06:57:16.430 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:16.431+0000 7f90f0200640 1 --2- 172.21.15.72:0/1722264527 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f90c806c8f0 0x7f90c806edb0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:16.431 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:16.431+0000 7f90f0200640 1 --2- 172.21.15.72:0/1722264527 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f90e8145b10 0x7f90e80b0c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:16.431 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:16.431+0000 7f90f0200640 1 --2- 172.21.15.72:0/1722264527 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f90e80d0110 0x7f90e815d830 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:16.431 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:16.431+0000 7f90f0200640 1 --2- 172.21.15.72:0/1722264527 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f90e806dac0 0x7f90e8159b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:16.431 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:16.431+0000 7f90f0200640 1 -- 172.21.15.72:0/1722264527 >> 172.21.15.72:0/1722264527 conn(0x7f90e806b470 msgr2=0x7f90e815b7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:16.431 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:16.431+0000 7f90f0200640 1 -- 172.21.15.72:0/1722264527 shutdown_connections 2024-04-04T06:57:16.431 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:16.431+0000 7f90f0200640 1 -- 172.21.15.72:0/1722264527 wait complete. 2024-04-04T06:57:16.450 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-04T06:57:16.651 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:16.652+0000 7f4f21800640 1 Processor -- start 2024-04-04T06:57:16.651 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:16.652+0000 7f4f21800640 1 -- start start 2024-04-04T06:57:16.652 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:16.654+0000 7f4f21800640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f4f1c06dc90 0x7f4f1c0cfa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:16.652 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:16.654+0000 7f4f21800640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4f1c0cff40 0x7f4f1c0d0340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:16.652 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:16.654+0000 7f4f21800640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f1c145ef0 con 0x7f4f1c145b10 2024-04-04T06:57:16.653 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:16.654+0000 7f4f21800640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f4f1c0cea10 con 0x7f4f1c06dc90 2024-04-04T06:57:16.653 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:16.654+0000 7f4f21800640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f4f1c06e310 con 0x7f4f1c0cff40 2024-04-04T06:57:16.653 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:16.654+0000 7f4f1aa00640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f4f1c145b10 0x7f4f1c06d580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:39456/0 (socket says 172.21.15.72:39456) 2024-04-04T06:57:16.653 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:16.654+0000 7f4f1aa00640 1 -- 172.21.15.72:0/2466592083 learned_addr learned my addr 172.21.15.72:0/2466592083 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-04-04T06:57:16.655 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:16.654+0000 7f4f1b400640 1 --2- 172.21.15.72:0/2466592083 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4f1c0cff40 0x7f4f1c0d0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:16.655 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:16.654+0000 7f4f12000640 1 --2- 172.21.15.72:0/2466592083 >> v2:172.21.15.117:3300/0 conn(0x7f4f1c06dc90 0x7f4f1c0cfa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:16.655 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:16.654+0000 7f4f1a000640 1 -- 172.21.15.72:0/2466592083 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2822178652 0 0) 0x7f4f1c145ef0 con 0x7f4f1c145b10 2024-04-04T06:57:16.655 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:16.655+0000 7f4f1a000640 1 -- 172.21.15.72:0/2466592083 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4f00003520 con 0x7f4f1c145b10 2024-04-04T06:57:16.655 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:16.655+0000 7f4f1a000640 1 -- 172.21.15.72:0/2466592083 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3009180768 0 0) 0x7f4f00003520 con 0x7f4f1c145b10 2024-04-04T06:57:16.655 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:16.655+0000 7f4f1a000640 1 -- 172.21.15.72:0/2466592083 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4f1c0cff40 msgr2=0x7f4f1c0d0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:57:16.655 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:16.655+0000 7f4f1a000640 1 --2- 172.21.15.72:0/2466592083 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4f1c0cff40 0x7f4f1c0d0340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:16.655 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:16.655+0000 7f4f1a000640 1 -- 172.21.15.72:0/2466592083 >> v2:172.21.15.117:3300/0 conn(0x7f4f1c06dc90 msgr2=0x7f4f1c0cfa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:57:16.655 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:16.655+0000 7f4f1a000640 1 --2- 172.21.15.72:0/2466592083 >> v2:172.21.15.117:3300/0 conn(0x7f4f1c06dc90 0x7f4f1c0cfa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:16.655 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:16.655+0000 7f4f1a000640 1 -- 172.21.15.72:0/2466592083 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f1c0cec40 con 0x7f4f1c145b10 2024-04-04T06:57:16.656 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:16.655+0000 7f4f1a000640 1 -- 172.21.15.72:0/2466592083 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2465650867 0 0) 0x7f4f0c001a10 con 0x7f4f1c145b10 2024-04-04T06:57:16.656 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:16.655+0000 7f4f1a000640 1 -- 172.21.15.72:0/2466592083 >> v1:172.21.15.72:6789/0 conn(0x7f4f1c145b10 legacy=0x7f4f1c06d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:16.656 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:16.655+0000 7f4f1a000640 1 --2- 172.21.15.72:0/2466592083 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4f1c0cff40 0x7f4f000039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:16.656 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:16.655+0000 7f4f1a000640 1 --2- 172.21.15.72:0/2466592083 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4f00003f80 0x7f4f00004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:16.656 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:16.655+0000 7f4f1a000640 1 --2- 172.21.15.72:0/2466592083 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4f00004d40 0x7f4f000051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:16.656 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:16.655+0000 7f4f1a000640 1 -- 172.21.15.72:0/2466592083 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f4f1c06e310 con 0x7f4f00004d40 2024-04-04T06:57:16.656 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:16.655+0000 7f4f1a000640 1 -- 172.21.15.72:0/2466592083 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f4f0000b9f0 con 0x7f4f00003f80 2024-04-04T06:57:16.656 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:16.655+0000 7f4f1a000640 1 -- 172.21.15.72:0/2466592083 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f4f0000bbf0 con 0x7f4f1c0cff40 2024-04-04T06:57:16.656 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:16.655+0000 7f4f1b400640 1 --2- 172.21.15.72:0/2466592083 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4f00004d40 0x7f4f000051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:16.656 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:16.656+0000 7f4f1aa00640 1 --2- 172.21.15.72:0/2466592083 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4f1c0cff40 0x7f4f000039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:16.656 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:16.656+0000 7f4f12000640 1 --2- 172.21.15.72:0/2466592083 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4f00003f80 0x7f4f00004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:16.656 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:16.656+0000 7f4f1b400640 1 -- 172.21.15.72:0/2466592083 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4f1c0cff40 msgr2=0x7f4f000039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:57:16.656 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:16.656+0000 7f4f1b400640 1 --2- 172.21.15.72:0/2466592083 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4f1c0cff40 0x7f4f000039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:16.656 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:16.656+0000 7f4f1b400640 1 -- 172.21.15.72:0/2466592083 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4f00003f80 msgr2=0x7f4f00004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:57:16.657 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:16.656+0000 7f4f1b400640 1 --2- 172.21.15.72:0/2466592083 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4f00003f80 0x7f4f00004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:16.657 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:16.656+0000 7f4f1b400640 1 -- 172.21.15.72:0/2466592083 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f00003520 con 0x7f4f00004d40 2024-04-04T06:57:16.658 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:16.658+0000 7f4f1b400640 1 --2- 172.21.15.72:0/2466592083 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4f00004d40 0x7f4f000051c0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f4f14009ac0 tx=0x7f4f00005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b0d428afae4b75b server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:16.658 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:16.658+0000 7f4f1a000640 1 -- 172.21.15.72:0/2466592083 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f14039070 con 0x7f4f00004d40 2024-04-04T06:57:16.658 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:16.658+0000 7f4f1a000640 1 -- 172.21.15.72:0/2466592083 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f1402c6b0 con 0x7f4f00004d40 2024-04-04T06:57:16.658 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:16.658+0000 7f4f1a000640 1 -- 172.21.15.72:0/2466592083 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f14009690 con 0x7f4f00004d40 2024-04-04T06:57:16.658 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:16.659+0000 7f4f21800640 1 -- 172.21.15.72:0/2466592083 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4f00004d40 msgr2=0x7f4f000051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:16.658 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:16.659+0000 7f4f21800640 1 --2- 172.21.15.72:0/2466592083 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4f00004d40 0x7f4f000051c0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f4f14009ac0 tx=0x7f4f00005830 comp rx=0 tx=0).stop 2024-04-04T06:57:16.658 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:16.659+0000 7f4f1b400640 1 -- 172.21.15.72:0/2466592083 reap_dead start 2024-04-04T06:57:16.658 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:16.659+0000 7f4f21800640 1 -- 172.21.15.72:0/2466592083 shutdown_connections 2024-04-04T06:57:16.658 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:16.659+0000 7f4f21800640 1 -- 172.21.15.72:0/2466592083 >> 172.21.15.72:0/2466592083 conn(0x7f4f1c06b470 msgr2=0x7f4f1c06b850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:16.659 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:16.659+0000 7f4f21800640 1 -- 172.21.15.72:0/2466592083 shutdown_connections 2024-04-04T06:57:16.659 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:16.659+0000 7f4f21800640 1 -- 172.21.15.72:0/2466592083 wait complete. 2024-04-04T06:57:16.659 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:16.661+0000 7f4f21800640 1 Processor -- start 2024-04-04T06:57:16.659 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:16.661+0000 7f4f21800640 1 -- start start 2024-04-04T06:57:16.661 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:16.662+0000 7f4f21800640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4f00004d40 0x7f4f1c1f6e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:16.661 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:16.662+0000 7f4f21800640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4f1c0b3ee0 0x7f4f1c0b4360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:16.662 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:16.662+0000 7f4f21800640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4f1c0c5100 0x7f4f1c0c55b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:16.662 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:16.662+0000 7f4f21800640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f4f1c0cf4e0 con 0x7f4f00004d40 2024-04-04T06:57:16.662 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:16.662+0000 7f4f21800640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f4f1c0cf200 con 0x7f4f1c0c5100 2024-04-04T06:57:16.662 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:16.662+0000 7f4f21800640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f4f1c0d0340 con 0x7f4f1c0b3ee0 2024-04-04T06:57:16.662 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:16.662+0000 7f4f1aa00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4f00004d40 0x7f4f1c1f6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:16.662 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:16.662+0000 7f4f1aa00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4f00004d40 0x7f4f1c1f6e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:33634/0 (socket says 172.21.15.72:33634) 2024-04-04T06:57:16.662 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:16.662+0000 7f4f1aa00640 1 -- 172.21.15.72:0/2716251800 learned_addr learned my addr 172.21.15.72:0/2716251800 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:57:16.662 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:16.662+0000 7f4f12000640 1 --2- 172.21.15.72:0/2716251800 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4f1c0b3ee0 0x7f4f1c0b4360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:16.662 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:16.663+0000 7f4f1aa00640 1 -- 172.21.15.72:0/2716251800 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4f1c0b3ee0 msgr2=0x7f4f1c0b4360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:16.662 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:16.663+0000 7f4f1b400640 1 --2- 172.21.15.72:0/2716251800 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4f1c0c5100 0x7f4f1c0c55b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:16.662 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:16.663+0000 7f4f1aa00640 1 --2- 172.21.15.72:0/2716251800 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4f1c0b3ee0 0x7f4f1c0b4360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:16.662 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:16.663+0000 7f4f1aa00640 1 -- 172.21.15.72:0/2716251800 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4f1c0c5100 msgr2=0x7f4f1c0c55b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:16.662 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:16.663+0000 7f4f1aa00640 1 --2- 172.21.15.72:0/2716251800 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4f1c0c5100 0x7f4f1c0c55b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:16.663 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:16.663+0000 7f4f1aa00640 1 -- 172.21.15.72:0/2716251800 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f1c0c5e30 con 0x7f4f00004d40 2024-04-04T06:57:16.663 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:16.663+0000 7f4f1b400640 1 --2- 172.21.15.72:0/2716251800 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4f1c0c5100 0x7f4f1c0c55b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-04T06:57:16.663 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:16.663+0000 7f4f1aa00640 1 --2- 172.21.15.72:0/2716251800 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4f00004d40 0x7f4f1c1f6e00 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f4f0c0013d0 tx=0x7f4f0c00e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:16.663 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:16.663+0000 7f4f13400640 1 -- 172.21.15.72:0/2716251800 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f0c013420 con 0x7f4f00004d40 2024-04-04T06:57:16.664 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:16.663+0000 7f4f13400640 1 -- 172.21.15.72:0/2716251800 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f0c018070 con 0x7f4f00004d40 2024-04-04T06:57:16.664 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:16.663+0000 7f4f13400640 1 -- 172.21.15.72:0/2716251800 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f0c013820 con 0x7f4f00004d40 2024-04-04T06:57:16.664 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:16.663+0000 7f4f21800640 1 -- 172.21.15.72:0/2716251800 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f1c0c6110 con 0x7f4f00004d40 2024-04-04T06:57:16.664 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:16.664+0000 7f4f21800640 1 -- 172.21.15.72:0/2716251800 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f1c0c66d0 con 0x7f4f00004d40 2024-04-04T06:57:16.664 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:16.665+0000 7f4f21800640 1 -- 172.21.15.72:0/2716251800 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f1c0b48a0 con 0x7f4f00004d40 2024-04-04T06:57:16.664 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:16.665+0000 7f4f13400640 1 -- 172.21.15.72:0/2716251800 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4f0c0139c0 con 0x7f4f00004d40 2024-04-04T06:57:16.665 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:16.666+0000 7f4f13400640 1 --2- 172.21.15.72:0/2716251800 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f4ef806c920 0x7f4ef806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:16.665 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:16.666+0000 7f4f13400640 1 -- 172.21.15.72:0/2716251800 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f4f0c08c390 con 0x7f4f00004d40 2024-04-04T06:57:16.665 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:16.667+0000 7f4f12000640 1 --2- 172.21.15.72:0/2716251800 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f4ef806c920 0x7f4ef806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:16.665 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:16.667+0000 7f4f12000640 1 --2- 172.21.15.72:0/2716251800 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f4ef806c920 0x7f4ef806ede0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f4f1c0b2cf0 tx=0x7f4f04008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:16.669 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:16.671+0000 7f4f13400640 1 -- 172.21.15.72:0/2716251800 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f4f0c05a730 con 0x7f4f00004d40 2024-04-04T06:57:16.867 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:16.868+0000 7f4f21800640 1 -- 172.21.15.72:0/2716251800 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f4f1c0d0c00 con 0x7f4f00004d40 2024-04-04T06:57:16.867 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:16.869+0000 7f4f13400640 1 -- 172.21.15.72:0/2716251800 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) ==== 104+0+11 (secure 0 0 0) 0x7f4f0c05a030 con 0x7f4f00004d40 2024-04-04T06:57:16.868 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2024-04-04T06:57:16.870 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:16.871+0000 7f4f21800640 1 -- 172.21.15.72:0/2716251800 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f4ef806c920 msgr2=0x7f4ef806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:16.870 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:16.871+0000 7f4f21800640 1 --2- 172.21.15.72:0/2716251800 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f4ef806c920 0x7f4ef806ede0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f4f1c0b2cf0 tx=0x7f4f04008040 comp rx=0 tx=0).stop 2024-04-04T06:57:16.870 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:16.871+0000 7f4f21800640 1 -- 172.21.15.72:0/2716251800 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4f00004d40 msgr2=0x7f4f1c1f6e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:16.870 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:16.871+0000 7f4f21800640 1 --2- 172.21.15.72:0/2716251800 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4f00004d40 0x7f4f1c1f6e00 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f4f0c0013d0 tx=0x7f4f0c00e530 comp rx=0 tx=0).stop 2024-04-04T06:57:16.871 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:16.872+0000 7f4f21800640 1 -- 172.21.15.72:0/2716251800 shutdown_connections 2024-04-04T06:57:16.871 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:16.872+0000 7f4f21800640 1 --2- 172.21.15.72:0/2716251800 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f4ef806c920 0x7f4ef806ede0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:16.871 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:16.872+0000 7f4f21800640 1 --2- 172.21.15.72:0/2716251800 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4f1c0c5100 0x7f4f1c0c55b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:16.871 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:16.872+0000 7f4f21800640 1 --2- 172.21.15.72:0/2716251800 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4f1c0b3ee0 0x7f4f1c0b4360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:16.871 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:16.872+0000 7f4f21800640 1 --2- 172.21.15.72:0/2716251800 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4f00004d40 0x7f4f1c1f6e00 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:16.871 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:16.872+0000 7f4f21800640 1 -- 172.21.15.72:0/2716251800 >> 172.21.15.72:0/2716251800 conn(0x7f4f1c06b470 msgr2=0x7f4f1c15ce20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:16.871 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:16.872+0000 7f4f21800640 1 -- 172.21.15.72:0/2716251800 shutdown_connections 2024-04-04T06:57:16.871 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:16.872+0000 7f4f21800640 1 -- 172.21.15.72:0/2716251800 wait complete. 2024-04-04T06:57:16.890 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-04T06:57:17.082 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:17.083+0000 7f1972200640 1 Processor -- start 2024-04-04T06:57:17.082 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:17.084+0000 7f1972200640 1 -- start start 2024-04-04T06:57:17.084 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:17.085+0000 7f1972200640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f196c15afb0 0x7f196c071e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:17.084 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:17.085+0000 7f1972200640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f196c0cf360 0x7f196c0726e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:17.084 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:17.085+0000 7f1972200640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f196c0ced10 con 0x7f196c15b390 2024-04-04T06:57:17.084 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:17.085+0000 7f1972200640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f196c072350 con 0x7f196c15afb0 2024-04-04T06:57:17.085 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:17.085+0000 7f1972200640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f196c15ece0 con 0x7f196c0cf360 2024-04-04T06:57:17.085 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:17.086+0000 7f196b400640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f196c15afb0 0x7f196c071e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:17.085 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:17.086+0000 7f196b400640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f196c15afb0 0x7f196c071e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:33644/0 (socket says 172.21.15.72:33644) 2024-04-04T06:57:17.085 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:17.086+0000 7f196b400640 1 -- 172.21.15.72:0/1907937633 learned_addr learned my addr 172.21.15.72:0/1907937633 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:57:17.085 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:17.086+0000 7f196b400640 1 -- 172.21.15.72:0/1907937633 >> v2:172.21.15.117:3300/0 conn(0x7f196c0cf360 msgr2=0x7f196c0726e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:57:17.085 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:17.086+0000 7f196b400640 1 --2- 172.21.15.72:0/1907937633 >> v2:172.21.15.117:3300/0 conn(0x7f196c0cf360 0x7f196c0726e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:17.085 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:17.086+0000 7f196b400640 1 -- 172.21.15.72:0/1907937633 >> v1:172.21.15.117:6789/0 conn(0x7f196c15b390 legacy=0x7f196c0cfcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:57:17.086 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:17.086+0000 7f196b400640 1 -- 172.21.15.72:0/1907937633 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f196c15efa0 con 0x7f196c15afb0 2024-04-04T06:57:17.086 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:17.087+0000 7f196b400640 1 --2- 172.21.15.72:0/1907937633 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f196c15afb0 0x7f196c071e10 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f196c0afc10 tx=0x7f195c02be70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe40625370f0fd92 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:17.086 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:17.087+0000 7f196aa00640 1 -- 172.21.15.72:0/1907937633 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f195c02ca10 con 0x7f196c15afb0 2024-04-04T06:57:17.086 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:17.088+0000 7f196aa00640 1 -- 172.21.15.72:0/1907937633 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f195c02cbb0 con 0x7f196c15afb0 2024-04-04T06:57:17.086 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:17.088+0000 7f196aa00640 1 -- 172.21.15.72:0/1907937633 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f195c0343f0 con 0x7f196c15afb0 2024-04-04T06:57:17.087 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:17.088+0000 7f1972200640 1 -- 172.21.15.72:0/1907937633 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f196c15afb0 msgr2=0x7f196c071e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:17.087 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:17.088+0000 7f1972200640 1 --2- 172.21.15.72:0/1907937633 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f196c15afb0 0x7f196c071e10 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f196c0afc10 tx=0x7f195c02be70 comp rx=0 tx=0).stop 2024-04-04T06:57:17.087 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:17.088+0000 7f1972200640 1 -- 172.21.15.72:0/1907937633 shutdown_connections 2024-04-04T06:57:17.087 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:17.088+0000 7f1972200640 1 --2- 172.21.15.72:0/1907937633 >> v2:172.21.15.117:3300/0 conn(0x7f196c0cf360 0x7f196c0726e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:17.088 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:17.088+0000 7f1972200640 1 --2- 172.21.15.72:0/1907937633 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f196c15afb0 0x7f196c071e10 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:17.088 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:17.088+0000 7f1972200640 1 -- 172.21.15.72:0/1907937633 >> 172.21.15.72:0/1907937633 conn(0x7f196c06b470 msgr2=0x7f196c06b850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:17.088 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:17.088+0000 7f1972200640 1 -- 172.21.15.72:0/1907937633 shutdown_connections 2024-04-04T06:57:17.088 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:17.089+0000 7f1972200640 1 -- 172.21.15.72:0/1907937633 wait complete. 2024-04-04T06:57:17.089 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:17.090+0000 7f1972200640 1 Processor -- start 2024-04-04T06:57:17.089 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:17.090+0000 7f1972200640 1 -- start start 2024-04-04T06:57:17.091 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:17.091+0000 7f1972200640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f196c0cf360 0x7f196c14ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:17.091 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:17.091+0000 7f1972200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f196c15afb0 0x7f196c15de30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:17.091 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:17.091+0000 7f1972200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f196c15b390 0x7f196c06d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:17.091 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:17.091+0000 7f1972200640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f196c15f840 con 0x7f196c0cf360 2024-04-04T06:57:17.091 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:17.091+0000 7f1972200640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f196c15f340 con 0x7f196c15afb0 2024-04-04T06:57:17.091 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:17.091+0000 7f1972200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f196c15fb20 con 0x7f196c15b390 2024-04-04T06:57:17.091 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:17.092+0000 7f196b400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f196c0cf360 0x7f196c14ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:17.091 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:17.092+0000 7f196b400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f196c0cf360 0x7f196c14ee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:33652/0 (socket says 172.21.15.72:33652) 2024-04-04T06:57:17.091 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:17.092+0000 7f196b400640 1 -- 172.21.15.72:0/3069574193 learned_addr learned my addr 172.21.15.72:0/3069574193 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:57:17.091 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:17.092+0000 7f196b400640 1 -- 172.21.15.72:0/3069574193 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f196c15b390 msgr2=0x7f196c06d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:17.092 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:17.092+0000 7f196be00640 1 --2- 172.21.15.72:0/3069574193 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f196c15b390 0x7f196c06d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:17.092 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:17.092+0000 7f1962a00640 1 --2- 172.21.15.72:0/3069574193 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f196c15afb0 0x7f196c15de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:17.092 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:17.092+0000 7f196b400640 1 --2- 172.21.15.72:0/3069574193 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f196c15b390 0x7f196c06d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:17.092 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:17.092+0000 7f196b400640 1 -- 172.21.15.72:0/3069574193 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f196c15afb0 msgr2=0x7f196c15de30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:17.092 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:17.092+0000 7f196b400640 1 --2- 172.21.15.72:0/3069574193 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f196c15afb0 0x7f196c15de30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:17.092 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:17.092+0000 7f196b400640 1 -- 172.21.15.72:0/3069574193 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f196c15bca0 con 0x7f196c0cf360 2024-04-04T06:57:17.092 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:17.092+0000 7f196be00640 1 --2- 172.21.15.72:0/3069574193 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f196c15b390 0x7f196c06d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-04T06:57:17.092 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:17.093+0000 7f196b400640 1 --2- 172.21.15.72:0/3069574193 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f196c0cf360 0x7f196c14ee30 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f195c0093e0 tx=0x7f195c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:17.093 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:17.093+0000 7f1963e00640 1 -- 172.21.15.72:0/3069574193 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f195c043020 con 0x7f196c0cf360 2024-04-04T06:57:17.093 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:17.093+0000 7f1963e00640 1 -- 172.21.15.72:0/3069574193 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f195c03e450 con 0x7f196c0cf360 2024-04-04T06:57:17.093 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:17.093+0000 7f1972200640 1 -- 172.21.15.72:0/3069574193 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f196c15bf80 con 0x7f196c0cf360 2024-04-04T06:57:17.093 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:17.093+0000 7f1963e00640 1 -- 172.21.15.72:0/3069574193 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f195c03e840 con 0x7f196c0cf360 2024-04-04T06:57:17.093 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:17.093+0000 7f1972200640 1 -- 172.21.15.72:0/3069574193 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f196c15c540 con 0x7f196c0cf360 2024-04-04T06:57:17.093 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:17.094+0000 7f1972200640 1 -- 172.21.15.72:0/3069574193 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f196c075730 con 0x7f196c0cf360 2024-04-04T06:57:17.095 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:17.096+0000 7f1963e00640 1 -- 172.21.15.72:0/3069574193 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f195c046020 con 0x7f196c0cf360 2024-04-04T06:57:17.096 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:17.097+0000 7f1963e00640 1 --2- 172.21.15.72:0/3069574193 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f194806c8f0 0x7f194806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:17.096 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:17.097+0000 7f1963e00640 1 -- 172.21.15.72:0/3069574193 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f195c0ae5d0 con 0x7f196c0cf360 2024-04-04T06:57:17.096 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:17.098+0000 7f1962a00640 1 --2- 172.21.15.72:0/3069574193 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f194806c8f0 0x7f194806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:17.097 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:17.098+0000 7f1962a00640 1 --2- 172.21.15.72:0/3069574193 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f194806c8f0 0x7f194806edb0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f196c06e2d0 tx=0x7f1954008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:17.100 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:17.102+0000 7f1963e00640 1 -- 172.21.15.72:0/3069574193 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f195c04d030 con 0x7f196c0cf360 2024-04-04T06:57:17.299 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:17.301+0000 7f1972200640 1 -- 172.21.15.72:0/3069574193 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f196c0cfc90 con 0x7f196c0cf360 2024-04-04T06:57:17.300 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:17.301+0000 7f1963e00640 1 -- 172.21.15.72:0/3069574193 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) ==== 100+0+11 (secure 0 0 0) 0x7f195c07c970 con 0x7f196c0cf360 2024-04-04T06:57:17.300 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 64 2024-04-04T06:57:17.303 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:17.304+0000 7f1972200640 1 -- 172.21.15.72:0/3069574193 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f194806c8f0 msgr2=0x7f194806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:17.303 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:17.304+0000 7f1972200640 1 --2- 172.21.15.72:0/3069574193 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f194806c8f0 0x7f194806edb0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f196c06e2d0 tx=0x7f1954008040 comp rx=0 tx=0).stop 2024-04-04T06:57:17.303 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:17.304+0000 7f1972200640 1 -- 172.21.15.72:0/3069574193 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f196c0cf360 msgr2=0x7f196c14ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:17.303 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:17.304+0000 7f1972200640 1 --2- 172.21.15.72:0/3069574193 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f196c0cf360 0x7f196c14ee30 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f195c0093e0 tx=0x7f195c004a40 comp rx=0 tx=0).stop 2024-04-04T06:57:17.304 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:17.304+0000 7f1972200640 1 -- 172.21.15.72:0/3069574193 shutdown_connections 2024-04-04T06:57:17.304 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:17.304+0000 7f1972200640 1 --2- 172.21.15.72:0/3069574193 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f194806c8f0 0x7f194806edb0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:17.304 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:17.304+0000 7f1972200640 1 --2- 172.21.15.72:0/3069574193 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f196c15b390 0x7f196c06d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:17.304 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:17.304+0000 7f1972200640 1 --2- 172.21.15.72:0/3069574193 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f196c15afb0 0x7f196c15de30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:17.304 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:17.304+0000 7f1972200640 1 --2- 172.21.15.72:0/3069574193 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f196c0cf360 0x7f196c14ee30 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:17.304 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:17.304+0000 7f1972200640 1 -- 172.21.15.72:0/3069574193 >> 172.21.15.72:0/3069574193 conn(0x7f196c06b470 msgr2=0x7f196c0b32d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:17.304 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:17.304+0000 7f1972200640 1 -- 172.21.15.72:0/3069574193 shutdown_connections 2024-04-04T06:57:17.304 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:17.304+0000 7f1972200640 1 -- 172.21.15.72:0/3069574193 wait complete. 2024-04-04T06:57:17.327 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-04T06:57:17.529 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:17.530+0000 7f7a79600640 1 Processor -- start 2024-04-04T06:57:17.529 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:17.531+0000 7f7a79600640 1 -- start start 2024-04-04T06:57:17.531 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:17.532+0000 7f7a79600640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f7a7415e520 0x7f7a74161ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:17.531 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:17.532+0000 7f7a79600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7a740cf5f0 0x7f7a740d2d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:17.531 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:17.532+0000 7f7a79600640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a740b73b0 con 0x7f7a740b9ba0 2024-04-04T06:57:17.531 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:17.532+0000 7f7a79600640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f7a74162530 con 0x7f7a7415e520 2024-04-04T06:57:17.531 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:17.532+0000 7f7a79600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f7a7415e900 con 0x7f7a740cf5f0 2024-04-04T06:57:17.531 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:17.532+0000 7f7a72a00640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f7a7415e520 0x7f7a74161ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:17.531 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:17.532+0000 7f7a72a00640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f7a7415e520 0x7f7a74161ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:33664/0 (socket says 172.21.15.72:33664) 2024-04-04T06:57:17.531 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:17.532+0000 7f7a72a00640 1 -- 172.21.15.72:0/242306317 learned_addr learned my addr 172.21.15.72:0/242306317 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:57:17.532 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:17.533+0000 7f7a73400640 1 --2- 172.21.15.72:0/242306317 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7a740cf5f0 0x7f7a740d2d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:17.532 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:17.533+0000 7f7a72a00640 1 -- 172.21.15.72:0/242306317 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7a740cf5f0 msgr2=0x7f7a740d2d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:57:17.532 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:17.533+0000 7f7a72a00640 1 --2- 172.21.15.72:0/242306317 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7a740cf5f0 0x7f7a740d2d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:17.532 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:17.533+0000 7f7a72a00640 1 -- 172.21.15.72:0/242306317 >> v1:172.21.15.117:6789/0 conn(0x7f7a740b9ba0 legacy=0x7f7a740ceee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:57:17.532 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:17.533+0000 7f7a72a00640 1 -- 172.21.15.72:0/242306317 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a741627b0 con 0x7f7a7415e520 2024-04-04T06:57:17.532 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:17.533+0000 7f7a73400640 1 --2- 172.21.15.72:0/242306317 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7a740cf5f0 0x7f7a740d2d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-04T06:57:17.533 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:17.534+0000 7f7a72a00640 1 --2- 172.21.15.72:0/242306317 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7a7415e520 0x7f7a74161ff0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f7a64009870 tx=0x7f7a6402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffed330f5bb589a2 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:17.533 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:17.535+0000 7f7a72000640 1 -- 172.21.15.72:0/242306317 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a64035020 con 0x7f7a7415e520 2024-04-04T06:57:17.533 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:17.535+0000 7f7a72000640 1 -- 172.21.15.72:0/242306317 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a64031640 con 0x7f7a7415e520 2024-04-04T06:57:17.534 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:17.535+0000 7f7a72000640 1 -- 172.21.15.72:0/242306317 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a6402d040 con 0x7f7a7415e520 2024-04-04T06:57:17.534 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:17.536+0000 7f7a79600640 1 -- 172.21.15.72:0/242306317 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7a7415e520 msgr2=0x7f7a74161ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:17.534 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:17.536+0000 7f7a79600640 1 --2- 172.21.15.72:0/242306317 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7a7415e520 0x7f7a74161ff0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f7a64009870 tx=0x7f7a6402b8f0 comp rx=0 tx=0).stop 2024-04-04T06:57:17.534 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:17.536+0000 7f7a79600640 1 -- 172.21.15.72:0/242306317 shutdown_connections 2024-04-04T06:57:17.535 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:17.536+0000 7f7a79600640 1 --2- 172.21.15.72:0/242306317 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7a740cf5f0 0x7f7a740d2d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:17.535 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:17.536+0000 7f7a79600640 1 --2- 172.21.15.72:0/242306317 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7a7415e520 0x7f7a74161ff0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:17.535 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:17.536+0000 7f7a79600640 1 -- 172.21.15.72:0/242306317 >> 172.21.15.72:0/242306317 conn(0x7f7a740d0c90 msgr2=0x7f7a740d1070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:17.535 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:17.536+0000 7f7a79600640 1 -- 172.21.15.72:0/242306317 shutdown_connections 2024-04-04T06:57:17.535 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:17.536+0000 7f7a79600640 1 -- 172.21.15.72:0/242306317 wait complete. 2024-04-04T06:57:17.536 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:17.538+0000 7f7a79600640 1 Processor -- start 2024-04-04T06:57:17.537 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:17.538+0000 7f7a79600640 1 -- start start 2024-04-04T06:57:17.539 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:17.539+0000 7f7a79600640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7a740b9ba0 0x7f7a74157bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:17.539 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:17.539+0000 7f7a79600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7a740cf5f0 0x7f7a741e8070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:17.540 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:17.539+0000 7f7a79600640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7a7415e520 0x7f7a741e85b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:17.540 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:17.539+0000 7f7a79600640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f7a740d27f0 con 0x7f7a7415e520 2024-04-04T06:57:17.540 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:17.539+0000 7f7a79600640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f7a74162d70 con 0x7f7a740b9ba0 2024-04-04T06:57:17.540 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:17.539+0000 7f7a79600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f7a740d3250 con 0x7f7a740cf5f0 2024-04-04T06:57:17.540 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:17.539+0000 7f7a73400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7a7415e520 0x7f7a741e85b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:17.540 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:17.540+0000 7f7a73400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7a7415e520 0x7f7a741e85b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:33678/0 (socket says 172.21.15.72:33678) 2024-04-04T06:57:17.540 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:17.540+0000 7f7a73400640 1 -- 172.21.15.72:0/366411471 learned_addr learned my addr 172.21.15.72:0/366411471 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:57:17.540 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:17.540+0000 7f7a72a00640 1 --2- 172.21.15.72:0/366411471 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7a740b9ba0 0x7f7a74157bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:17.540 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:17.540+0000 7f7a6be00640 1 --2- 172.21.15.72:0/366411471 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7a740cf5f0 0x7f7a741e8070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:17.540 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:17.540+0000 7f7a73400640 1 -- 172.21.15.72:0/366411471 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7a740cf5f0 msgr2=0x7f7a741e8070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:17.540 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:17.540+0000 7f7a73400640 1 --2- 172.21.15.72:0/366411471 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7a740cf5f0 0x7f7a741e8070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:17.540 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:17.540+0000 7f7a73400640 1 -- 172.21.15.72:0/366411471 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7a740b9ba0 msgr2=0x7f7a74157bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:17.540 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:17.540+0000 7f7a73400640 1 --2- 172.21.15.72:0/366411471 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7a740b9ba0 0x7f7a74157bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:17.541 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:17.540+0000 7f7a73400640 1 -- 172.21.15.72:0/366411471 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a7415f740 con 0x7f7a7415e520 2024-04-04T06:57:17.541 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:17.540+0000 7f7a72a00640 1 --2- 172.21.15.72:0/366411471 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7a740b9ba0 0x7f7a74157bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-04T06:57:17.541 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:17.540+0000 7f7a73400640 1 --2- 172.21.15.72:0/366411471 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7a7415e520 0x7f7a741e85b0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f7a6c00ce70 tx=0x7f7a6c00a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:17.541 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:17.541+0000 7f7a6aa00640 1 -- 172.21.15.72:0/366411471 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a6c003b90 con 0x7f7a7415e520 2024-04-04T06:57:17.541 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:17.541+0000 7f7a6aa00640 1 -- 172.21.15.72:0/366411471 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a6c003d50 con 0x7f7a7415e520 2024-04-04T06:57:17.541 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:17.541+0000 7f7a6aa00640 1 -- 172.21.15.72:0/366411471 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a6c004260 con 0x7f7a7415e520 2024-04-04T06:57:17.541 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:17.541+0000 7f7a79600640 1 -- 172.21.15.72:0/366411471 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a7415fa20 con 0x7f7a7415e520 2024-04-04T06:57:17.541 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:17.541+0000 7f7a79600640 1 -- 172.21.15.72:0/366411471 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a74157720 con 0x7f7a7415e520 2024-04-04T06:57:17.542 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:17.542+0000 7f7a79600640 1 -- 172.21.15.72:0/366411471 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a74075840 con 0x7f7a7415e520 2024-04-04T06:57:17.542 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:17.543+0000 7f7a6aa00640 1 -- 172.21.15.72:0/366411471 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7a6c004400 con 0x7f7a7415e520 2024-04-04T06:57:17.543 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:17.544+0000 7f7a6aa00640 1 --2- 172.21.15.72:0/366411471 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f7a5006c8f0 0x7f7a5006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:17.543 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:17.545+0000 7f7a6aa00640 1 -- 172.21.15.72:0/366411471 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f7a6c08c520 con 0x7f7a7415e520 2024-04-04T06:57:17.543 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:17.545+0000 7f7a72a00640 1 --2- 172.21.15.72:0/366411471 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f7a5006c8f0 0x7f7a5006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:17.544 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:17.545+0000 7f7a72a00640 1 --2- 172.21.15.72:0/366411471 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f7a5006c8f0 0x7f7a5006edb0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f7a64036000 tx=0x7f7a6403c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:17.548 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:17.549+0000 7f7a6aa00640 1 -- 172.21.15.72:0/366411471 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f7a6c05a8c0 con 0x7f7a7415e520 2024-04-04T06:57:17.766 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:17.767+0000 7f7a79600640 1 -- 172.21.15.72:0/366411471 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f7a740d1eb0 con 0x7f7a7415e520 2024-04-04T06:57:17.767 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:17.768+0000 7f7a6aa00640 1 -- 172.21.15.72:0/366411471 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v22) ==== 80+0+0 (secure 0 0 0) 0x7f7a6c05a1c0 con 0x7f7a7415e520 2024-04-04T06:57:17.767 INFO:teuthology.orchestra.run.smithi072.stderr:listed 0 entries 2024-04-04T06:57:17.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:17.770+0000 7f7a79600640 1 -- 172.21.15.72:0/366411471 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f7a5006c8f0 msgr2=0x7f7a5006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:17.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:17.770+0000 7f7a79600640 1 --2- 172.21.15.72:0/366411471 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f7a5006c8f0 0x7f7a5006edb0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f7a64036000 tx=0x7f7a6403c040 comp rx=0 tx=0).stop 2024-04-04T06:57:17.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:17.771+0000 7f7a79600640 1 -- 172.21.15.72:0/366411471 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7a7415e520 msgr2=0x7f7a741e85b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:17.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:17.771+0000 7f7a79600640 1 --2- 172.21.15.72:0/366411471 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7a7415e520 0x7f7a741e85b0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f7a6c00ce70 tx=0x7f7a6c00a710 comp rx=0 tx=0).stop 2024-04-04T06:57:17.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:17.771+0000 7f7a79600640 1 -- 172.21.15.72:0/366411471 shutdown_connections 2024-04-04T06:57:17.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:17.771+0000 7f7a79600640 1 --2- 172.21.15.72:0/366411471 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f7a5006c8f0 0x7f7a5006edb0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:17.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:17.771+0000 7f7a79600640 1 --2- 172.21.15.72:0/366411471 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7a7415e520 0x7f7a741e85b0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:17.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:17.771+0000 7f7a79600640 1 --2- 172.21.15.72:0/366411471 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7a740cf5f0 0x7f7a741e8070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:17.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:17.771+0000 7f7a79600640 1 --2- 172.21.15.72:0/366411471 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7a740b9ba0 0x7f7a74157bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:17.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:17.771+0000 7f7a79600640 1 -- 172.21.15.72:0/366411471 >> 172.21.15.72:0/366411471 conn(0x7f7a740d0c90 msgr2=0x7f7a740b5dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:17.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:17.771+0000 7f7a79600640 1 -- 172.21.15.72:0/366411471 shutdown_connections 2024-04-04T06:57:17.771 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:17.771+0000 7f7a79600640 1 -- 172.21.15.72:0/366411471 wait complete. 2024-04-04T06:57:17.789 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi072.front.sepia.ceph.com... 2024-04-04T06:57:17.789 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-04T06:57:17.789 DEBUG:teuthology.orchestra.run.smithi072:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-04-04T06:57:17.873 INFO:teuthology.orchestra.run:waiting for 300 2024-04-04T06:57:17.873 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi072.front.sepia.ceph.com 2024-04-04T06:57:17.873 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-04T06:57:17.873 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-04T06:57:17.927 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-04-04T06:57:17.927 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-04T06:57:17.989 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-04-04T06:57:17.989 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-04T06:57:18.040 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-04T06:57:18.245 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:18.246+0000 7fcb86c00640 1 Processor -- start 2024-04-04T06:57:18.245 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:18.246+0000 7fcb86c00640 1 -- start start 2024-04-04T06:57:18.248 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:18.249+0000 7fcb86c00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fcb800d07d0 0x7fcb800c4ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:18.248 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:18.249+0000 7fcb86c00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcb800c5530 0x7fcb800b3540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:18.248 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:18.249+0000 7fcb86c00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcb800c5c00 con 0x7fcb8015b230 2024-04-04T06:57:18.248 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:18.249+0000 7fcb86c00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fcb800c59e0 con 0x7fcb800d07d0 2024-04-04T06:57:18.248 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:18.249+0000 7fcb86c00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fcb8015c2b0 con 0x7fcb800c5530 2024-04-04T06:57:18.248 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:18.250+0000 7fcb84c00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcb800c5530 0x7fcb800b3540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:18.248 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:18.250+0000 7fcb7fe00640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7fcb8015b230 0x7fcb800d00c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.72:43240/0 (socket says 172.21.15.72:43240) 2024-04-04T06:57:18.248 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:18.250+0000 7fcb77400640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fcb800d07d0 0x7fcb800c4ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:18.249 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:18.250+0000 7fcb7fe00640 1 -- 172.21.15.72:0/1267745505 learned_addr learned my addr 172.21.15.72:0/1267745505 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-04-04T06:57:18.249 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:18.251+0000 7fcb77400640 1 -- 172.21.15.72:0/1267745505 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcb800c5530 msgr2=0x7fcb800b3540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:57:18.249 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:18.251+0000 7fcb77400640 1 --2- 172.21.15.72:0/1267745505 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcb800c5530 0x7fcb800b3540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:18.249 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:18.251+0000 7fcb77400640 1 -- 172.21.15.72:0/1267745505 >> v1:172.21.15.117:6789/0 conn(0x7fcb8015b230 legacy=0x7fcb800d00c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:18.250 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:18.251+0000 7fcb77400640 1 -- 172.21.15.72:0/1267745505 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb8015b980 con 0x7fcb800d07d0 2024-04-04T06:57:18.250 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:18.251+0000 7fcb84c00640 1 --2- 172.21.15.72:0/1267745505 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcb800c5530 0x7fcb800b3540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-04T06:57:18.251 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:18.252+0000 7fcb77400640 1 --2- 172.21.15.72:0/1267745505 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcb800d07d0 0x7fcb800c4ff0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fcb68009d90 tx=0x7fcb6802bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=24d9ec4d2aea5e5b server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:18.251 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:18.253+0000 7fcb7f400640 1 -- 172.21.15.72:0/1267745505 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb68039070 con 0x7fcb800d07d0 2024-04-04T06:57:18.252 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:18.253+0000 7fcb7f400640 1 -- 172.21.15.72:0/1267745505 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb6802cc50 con 0x7fcb800d07d0 2024-04-04T06:57:18.252 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:18.253+0000 7fcb7f400640 1 -- 172.21.15.72:0/1267745505 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb68034440 con 0x7fcb800d07d0 2024-04-04T06:57:18.253 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:18.254+0000 7fcb86c00640 1 -- 172.21.15.72:0/1267745505 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcb800d07d0 msgr2=0x7fcb800c4ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:18.253 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:18.254+0000 7fcb86c00640 1 --2- 172.21.15.72:0/1267745505 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcb800d07d0 0x7fcb800c4ff0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fcb68009d90 tx=0x7fcb6802bea0 comp rx=0 tx=0).stop 2024-04-04T06:57:18.253 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:18.254+0000 7fcb86c00640 1 -- 172.21.15.72:0/1267745505 shutdown_connections 2024-04-04T06:57:18.253 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:18.254+0000 7fcb86c00640 1 --2- 172.21.15.72:0/1267745505 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcb800c5530 0x7fcb800b3540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:18.253 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:18.254+0000 7fcb86c00640 1 --2- 172.21.15.72:0/1267745505 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcb800d07d0 0x7fcb800c4ff0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:18.253 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:18.254+0000 7fcb86c00640 1 -- 172.21.15.72:0/1267745505 >> 172.21.15.72:0/1267745505 conn(0x7fcb8006b470 msgr2=0x7fcb8006b880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:18.253 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:18.254+0000 7fcb86c00640 1 -- 172.21.15.72:0/1267745505 shutdown_connections 2024-04-04T06:57:18.253 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:18.254+0000 7fcb86c00640 1 -- 172.21.15.72:0/1267745505 wait complete. 2024-04-04T06:57:18.256 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:18.257+0000 7fcb86c00640 1 Processor -- start 2024-04-04T06:57:18.256 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:18.258+0000 7fcb86c00640 1 -- start start 2024-04-04T06:57:18.260 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:18.259+0000 7fcb86c00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcb800c5530 0x7fcb801f3420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:18.260 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:18.260+0000 7fcb86c00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcb800d07d0 0x7fcb8014dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:18.260 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:18.260+0000 7fcb86c00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcb8015b230 0x7fcb800b3e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:18.260 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:18.260+0000 7fcb86c00640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fcb8015b610 con 0x7fcb800d07d0 2024-04-04T06:57:18.260 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:18.260+0000 7fcb86c00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fcb8015bf40 con 0x7fcb8015b230 2024-04-04T06:57:18.260 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:18.260+0000 7fcb86c00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fcb800b3a80 con 0x7fcb800c5530 2024-04-04T06:57:18.260 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:18.260+0000 7fcb77400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcb800d07d0 0x7fcb8014dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:18.260 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:18.260+0000 7fcb77400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcb800d07d0 0x7fcb8014dcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:33694/0 (socket says 172.21.15.72:33694) 2024-04-04T06:57:18.260 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:18.260+0000 7fcb77400640 1 -- 172.21.15.72:0/2600123571 learned_addr learned my addr 172.21.15.72:0/2600123571 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:57:18.260 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:18.260+0000 7fcb7fe00640 1 --2- 172.21.15.72:0/2600123571 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcb800c5530 0x7fcb801f3420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:18.261 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:18.260+0000 7fcb84c00640 1 --2- 172.21.15.72:0/2600123571 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcb8015b230 0x7fcb800b3e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:18.261 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:18.260+0000 7fcb77400640 1 -- 172.21.15.72:0/2600123571 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcb800c5530 msgr2=0x7fcb801f3420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:18.261 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:18.260+0000 7fcb77400640 1 --2- 172.21.15.72:0/2600123571 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcb800c5530 0x7fcb801f3420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:18.261 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:18.260+0000 7fcb77400640 1 -- 172.21.15.72:0/2600123571 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcb8015b230 msgr2=0x7fcb800b3e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:18.261 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:18.260+0000 7fcb77400640 1 --2- 172.21.15.72:0/2600123571 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcb8015b230 0x7fcb800b3e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:18.261 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:18.260+0000 7fcb77400640 1 -- 172.21.15.72:0/2600123571 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb800afbd0 con 0x7fcb800d07d0 2024-04-04T06:57:18.261 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:18.260+0000 7fcb84c00640 1 --2- 172.21.15.72:0/2600123571 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcb8015b230 0x7fcb800b3e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-04T06:57:18.261 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:18.261+0000 7fcb77400640 1 --2- 172.21.15.72:0/2600123571 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcb800d07d0 0x7fcb8014dcc0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fcb68009d90 tx=0x7fcb68004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:18.261 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:18.261+0000 7fcb7cc00640 1 -- 172.21.15.72:0/2600123571 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb68039050 con 0x7fcb800d07d0 2024-04-04T06:57:18.261 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:18.261+0000 7fcb7cc00640 1 -- 172.21.15.72:0/2600123571 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb68045070 con 0x7fcb800d07d0 2024-04-04T06:57:18.261 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:18.261+0000 7fcb7cc00640 1 -- 172.21.15.72:0/2600123571 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb6803e610 con 0x7fcb800d07d0 2024-04-04T06:57:18.261 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:18.261+0000 7fcb86c00640 1 -- 172.21.15.72:0/2600123571 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb801f3a00 con 0x7fcb800d07d0 2024-04-04T06:57:18.261 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:18.261+0000 7fcb86c00640 1 -- 172.21.15.72:0/2600123571 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb801f3fc0 con 0x7fcb800d07d0 2024-04-04T06:57:18.262 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:18.262+0000 7fcb86c00640 1 -- 172.21.15.72:0/2600123571 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb801f4300 con 0x7fcb800d07d0 2024-04-04T06:57:18.262 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:18.264+0000 7fcb7cc00640 1 -- 172.21.15.72:0/2600123571 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fcb6803e7b0 con 0x7fcb800d07d0 2024-04-04T06:57:18.263 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:18.265+0000 7fcb7cc00640 1 --2- 172.21.15.72:0/2600123571 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fcb5c06c8f0 0x7fcb5c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:18.263 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:18.265+0000 7fcb7cc00640 1 -- 172.21.15.72:0/2600123571 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7fcb680ae6f0 con 0x7fcb800d07d0 2024-04-04T06:57:18.263 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:18.265+0000 7fcb7fe00640 1 --2- 172.21.15.72:0/2600123571 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fcb5c06c8f0 0x7fcb5c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:18.264 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:18.265+0000 7fcb7fe00640 1 --2- 172.21.15.72:0/2600123571 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fcb5c06c8f0 0x7fcb5c06edb0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fcb70005880 tx=0x7fcb70009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:18.271 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:18.272+0000 7fcb7cc00640 1 -- 172.21.15.72:0/2600123571 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fcb801f4300 con 0x7fcb800d07d0 2024-04-04T06:57:18.488 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:18.489+0000 7fcb86c00640 1 -- 172.21.15.72:0/2600123571 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fcb800735c0 con 0x7fcb800d07d0 2024-04-04T06:57:18.490 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:18.492+0000 7fcb7cc00640 1 -- 172.21.15.72:0/2600123571 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16831 (secure 0 0 0) 0x7fcb6807cb30 con 0x7fcb800d07d0 2024-04-04T06:57:18.491 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T06:57:18.491 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":22,"fsid":"6708bac2-4f50-49b5-87a9-c390fd333eb3","created":"2024-04-04T06:56:04.282498+0000","modified":"2024-04-04T06:57:11.239134+0000","last_up_change":"2024-04-04T06:56:16.716089+0000","last_in_change":"2024-04-04T06:56:07.768593+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-04T06:56:17.421685+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-04T06:56:26.822661+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-04T06:56:27.429816+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7c345991-5af8-4dc6-a481-28610c40e128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":3889813953},{"type":"v1","addr":"172.21.15.72:6818","nonce":3889813953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":3889813953},{"type":"v1","addr":"172.21.15.72:6821","nonce":3889813953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":3889813953},{"type":"v1","addr":"172.21.15.72:6826","nonce":3889813953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":3889813953},{"type":"v1","addr":"172.21.15.72:6823","nonce":3889813953}]},"public_addr":"172.21.15.72:6818/3889813953","cluster_addr":"172.21.15.72:6821/3889813953","heartbeat_back_addr":"172.21.15.72:6826/3889813953","heartbeat_front_addr":"172.21.15.72:6823/3889813953","state":["exists","up"]},{"osd":1,"uuid":"1b3f7ab2-a56c-488d-a89a-1f3572361c95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":3101663154},{"type":"v1","addr":"172.21.15.72:6801","nonce":3101663154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":3101663154},{"type":"v1","addr":"172.21.15.72:6803","nonce":3101663154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":3101663154},{"type":"v1","addr":"172.21.15.72:6807","nonce":3101663154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":3101663154},{"type":"v1","addr":"172.21.15.72:6805","nonce":3101663154}]},"public_addr":"172.21.15.72:6801/3101663154","cluster_addr":"172.21.15.72:6803/3101663154","heartbeat_back_addr":"172.21.15.72:6807/3101663154","heartbeat_front_addr":"172.21.15.72:6805/3101663154","state":["exists","up"]},{"osd":2,"uuid":"fc9aa512-53df-40d7-ba04-3e6b7dcd1e34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":235374192},{"type":"v1","addr":"172.21.15.72:6809","nonce":235374192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":235374192},{"type":"v1","addr":"172.21.15.72:6811","nonce":235374192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":235374192},{"type":"v1","addr":"172.21.15.72:6815","nonce":235374192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":235374192},{"type":"v1","addr":"172.21.15.72:6813","nonce":235374192}]},"public_addr":"172.21.15.72:6809/235374192","cluster_addr":"172.21.15.72:6811/235374192","heartbeat_back_addr":"172.21.15.72:6815/235374192","heartbeat_front_addr":"172.21.15.72:6813/235374192","state":["exists","up"]},{"osd":3,"uuid":"b4f63eed-dc5b-4aba-bb50-de46eb41492b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6817","nonce":2806631742},{"type":"v1","addr":"172.21.15.72:6819","nonce":2806631742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":2806631742},{"type":"v1","addr":"172.21.15.72:6827","nonce":2806631742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":2806631742},{"type":"v1","addr":"172.21.15.72:6831","nonce":2806631742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":2806631742},{"type":"v1","addr":"172.21.15.72:6829","nonce":2806631742}]},"public_addr":"172.21.15.72:6819/2806631742","cluster_addr":"172.21.15.72:6827/2806631742","heartbeat_back_addr":"172.21.15.72:6831/2806631742","heartbeat_front_addr":"172.21.15.72:6829/2806631742","state":["exists","up"]},{"osd":4,"uuid":"9e985ef8-d711-4172-9286-c54e560895d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":4293536423},{"type":"v1","addr":"172.21.15.117:6825","nonce":4293536423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":4293536423},{"type":"v1","addr":"172.21.15.117:6827","nonce":4293536423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":4293536423},{"type":"v1","addr":"172.21.15.117:6831","nonce":4293536423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":4293536423},{"type":"v1","addr":"172.21.15.117:6829","nonce":4293536423}]},"public_addr":"172.21.15.117:6825/4293536423","cluster_addr":"172.21.15.117:6827/4293536423","heartbeat_back_addr":"172.21.15.117:6831/4293536423","heartbeat_front_addr":"172.21.15.117:6829/4293536423","state":["exists","up"]},{"osd":5,"uuid":"3e9f082b-8d7d-455f-8a96-66d0b4857125","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":684971679},{"type":"v1","addr":"172.21.15.117:6801","nonce":684971679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":684971679},{"type":"v1","addr":"172.21.15.117:6803","nonce":684971679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":684971679},{"type":"v1","addr":"172.21.15.117:6807","nonce":684971679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":684971679},{"type":"v1","addr":"172.21.15.117:6805","nonce":684971679}]},"public_addr":"172.21.15.117:6801/684971679","cluster_addr":"172.21.15.117:6803/684971679","heartbeat_back_addr":"172.21.15.117:6807/684971679","heartbeat_front_addr":"172.21.15.117:6805/684971679","state":["exists","up"]},{"osd":6,"uuid":"bcdafa9f-a870-4398-a38d-ab7697676473","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":2781186528},{"type":"v1","addr":"172.21.15.117:6809","nonce":2781186528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":2781186528},{"type":"v1","addr":"172.21.15.117:6811","nonce":2781186528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":2781186528},{"type":"v1","addr":"172.21.15.117:6815","nonce":2781186528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":2781186528},{"type":"v1","addr":"172.21.15.117:6813","nonce":2781186528}]},"public_addr":"172.21.15.117:6809/2781186528","cluster_addr":"172.21.15.117:6811/2781186528","heartbeat_back_addr":"172.21.15.117:6815/2781186528","heartbeat_front_addr":"172.21.15.117:6813/2781186528","state":["exists","up"]},{"osd":7,"uuid":"b68ec562-ff35-4d2d-a733-c896f8920cfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":617469882},{"type":"v1","addr":"172.21.15.117:6817","nonce":617469882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":617469882},{"type":"v1","addr":"172.21.15.117:6819","nonce":617469882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":617469882},{"type":"v1","addr":"172.21.15.117:6823","nonce":617469882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":617469882},{"type":"v1","addr":"172.21.15.117:6821","nonce":617469882}]},"public_addr":"172.21.15.117:6817/617469882","cluster_addr":"172.21.15.117:6819/617469882","heartbeat_back_addr":"172.21.15.117:6823/617469882","heartbeat_front_addr":"172.21.15.117:6821/617469882","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.347700+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.296619+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.361345+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.093323+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:12.857605+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:12.816090+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.083163+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.121639+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.13","mappings":[{"from":7,"to":1}]},{"pgid":"3.19","mappings":[{"from":3,"to":2}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.28","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-04T06:57:18.493 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:18.494+0000 7fcb86c00640 1 -- 172.21.15.72:0/2600123571 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fcb5c06c8f0 msgr2=0x7fcb5c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:18.493 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:18.494+0000 7fcb86c00640 1 --2- 172.21.15.72:0/2600123571 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fcb5c06c8f0 0x7fcb5c06edb0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fcb70005880 tx=0x7fcb70009040 comp rx=0 tx=0).stop 2024-04-04T06:57:18.494 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:18.494+0000 7fcb86c00640 1 -- 172.21.15.72:0/2600123571 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcb800d07d0 msgr2=0x7fcb8014dcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:18.494 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:18.494+0000 7fcb86c00640 1 --2- 172.21.15.72:0/2600123571 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcb800d07d0 0x7fcb8014dcc0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fcb68009d90 tx=0x7fcb68004a40 comp rx=0 tx=0).stop 2024-04-04T06:57:18.494 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:18.494+0000 7fcb86c00640 1 -- 172.21.15.72:0/2600123571 shutdown_connections 2024-04-04T06:57:18.494 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:18.494+0000 7fcb86c00640 1 --2- 172.21.15.72:0/2600123571 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fcb5c06c8f0 0x7fcb5c06edb0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:18.494 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:18.494+0000 7fcb86c00640 1 --2- 172.21.15.72:0/2600123571 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcb8015b230 0x7fcb800b3e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:18.494 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:18.494+0000 7fcb86c00640 1 --2- 172.21.15.72:0/2600123571 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcb800d07d0 0x7fcb8014dcc0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:18.494 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:18.494+0000 7fcb86c00640 1 --2- 172.21.15.72:0/2600123571 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcb800c5530 0x7fcb801f3420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:18.494 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:18.494+0000 7fcb86c00640 1 -- 172.21.15.72:0/2600123571 >> 172.21.15.72:0/2600123571 conn(0x7fcb8006b470 msgr2=0x7fcb8006b850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:18.494 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:18.494+0000 7fcb86c00640 1 -- 172.21.15.72:0/2600123571 shutdown_connections 2024-04-04T06:57:18.494 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:18.495+0000 7fcb86c00640 1 -- 172.21.15.72:0/2600123571 wait complete. 2024-04-04T06:57:18.510 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-04T06:56:17.421685+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-04T06:56:26.822661+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-04T06:56:27.429816+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-04T06:57:18.511 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-04T06:57:18.706 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:18.707+0000 7f8dc9600640 1 Processor -- start 2024-04-04T06:57:18.706 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:18.707+0000 7f8dc9600640 1 -- start start 2024-04-04T06:57:18.709 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:18.710+0000 7f8dc9600640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8dc4145b10 0x7f8dc406d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:18.709 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:18.710+0000 7f8dc9600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8dc40d0110 0x7f8dc4071430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:18.709 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:18.710+0000 7f8dc9600640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8dc4145ef0 con 0x7f8dc406dac0 2024-04-04T06:57:18.709 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:18.710+0000 7f8dc9600640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f8dc40cea10 con 0x7f8dc4145b10 2024-04-04T06:57:18.709 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:18.710+0000 7f8dc9600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f8dc406e310 con 0x7f8dc40d0110 2024-04-04T06:57:18.709 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:18.710+0000 7f8dc2a00640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8dc4145b10 0x7f8dc406d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:18.709 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:18.710+0000 7f8dc2a00640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8dc4145b10 0x7f8dc406d580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:33700/0 (socket says 172.21.15.72:33700) 2024-04-04T06:57:18.710 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:18.710+0000 7f8dc2a00640 1 -- 172.21.15.72:0/1607982861 learned_addr learned my addr 172.21.15.72:0/1607982861 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:57:18.710 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:18.710+0000 7f8dc2a00640 1 -- 172.21.15.72:0/1607982861 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8dc40d0110 msgr2=0x7f8dc4071430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:57:18.710 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:18.710+0000 7f8dc2a00640 1 --2- 172.21.15.72:0/1607982861 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8dc40d0110 0x7f8dc4071430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:18.710 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:18.710+0000 7f8dc2a00640 1 -- 172.21.15.72:0/1607982861 >> v1:172.21.15.117:6789/0 conn(0x7f8dc406dac0 legacy=0x7f8dc40cfa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:57:18.710 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:18.710+0000 7f8dc2a00640 1 -- 172.21.15.72:0/1607982861 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8dc40cec40 con 0x7f8dc4145b10 2024-04-04T06:57:18.710 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:18.711+0000 7f8dc2a00640 1 --2- 172.21.15.72:0/1607982861 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8dc4145b10 0x7f8dc406d580 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f8dc406e490 tx=0x7f8db402b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b3ba124c2b395d1 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:18.711 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:18.712+0000 7f8dc1600640 1 -- 172.21.15.72:0/1607982861 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8db40317c0 con 0x7f8dc4145b10 2024-04-04T06:57:18.711 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:18.712+0000 7f8dc1600640 1 -- 172.21.15.72:0/1607982861 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8db4037070 con 0x7f8dc4145b10 2024-04-04T06:57:18.711 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:18.712+0000 7f8dc1600640 1 -- 172.21.15.72:0/1607982861 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8db4031b80 con 0x7f8dc4145b10 2024-04-04T06:57:18.711 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:18.712+0000 7f8dc9600640 1 -- 172.21.15.72:0/1607982861 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8dc4145b10 msgr2=0x7f8dc406d580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:18.712 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:18.712+0000 7f8dc9600640 1 --2- 172.21.15.72:0/1607982861 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8dc4145b10 0x7f8dc406d580 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f8dc406e490 tx=0x7f8db402b860 comp rx=0 tx=0).stop 2024-04-04T06:57:18.712 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:18.712+0000 7f8dc9600640 1 -- 172.21.15.72:0/1607982861 shutdown_connections 2024-04-04T06:57:18.712 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:18.712+0000 7f8dc9600640 1 --2- 172.21.15.72:0/1607982861 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8dc40d0110 0x7f8dc4071430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:18.712 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:18.712+0000 7f8dc9600640 1 --2- 172.21.15.72:0/1607982861 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8dc4145b10 0x7f8dc406d580 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:18.712 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:18.712+0000 7f8dc9600640 1 -- 172.21.15.72:0/1607982861 >> 172.21.15.72:0/1607982861 conn(0x7f8dc406b470 msgr2=0x7f8dc406b850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:18.712 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:18.713+0000 7f8dc9600640 1 -- 172.21.15.72:0/1607982861 shutdown_connections 2024-04-04T06:57:18.712 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:18.713+0000 7f8dc9600640 1 -- 172.21.15.72:0/1607982861 wait complete. 2024-04-04T06:57:18.713 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:18.714+0000 7f8dc9600640 1 Processor -- start 2024-04-04T06:57:18.713 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:18.714+0000 7f8dc9600640 1 -- start start 2024-04-04T06:57:18.715 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:18.715+0000 7f8dc9600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8dc406dac0 0x7f8dc4142c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:18.715 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:18.715+0000 7f8dc9600640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8dc40d0110 0x7f8dc413df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:18.715 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:18.715+0000 7f8dc9600640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8dc4145b10 0x7f8dc413ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:18.715 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:18.715+0000 7f8dc9600640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f8dc40cf4e0 con 0x7f8dc4145b10 2024-04-04T06:57:18.715 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:18.715+0000 7f8dc9600640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f8dc40cf200 con 0x7f8dc40d0110 2024-04-04T06:57:18.716 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:18.715+0000 7f8dc9600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f8dc406df70 con 0x7f8dc406dac0 2024-04-04T06:57:18.716 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:18.716+0000 7f8dc3400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8dc4145b10 0x7f8dc413ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:18.716 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:18.716+0000 7f8dc3400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8dc4145b10 0x7f8dc413ba70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:33710/0 (socket says 172.21.15.72:33710) 2024-04-04T06:57:18.716 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:18.716+0000 7f8dc3400640 1 -- 172.21.15.72:0/2655072331 learned_addr learned my addr 172.21.15.72:0/2655072331 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:57:18.716 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:18.716+0000 7f8dc2a00640 1 --2- 172.21.15.72:0/2655072331 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8dc406dac0 0x7f8dc4142c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:18.716 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:18.716+0000 7f8dc2000640 1 --2- 172.21.15.72:0/2655072331 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8dc40d0110 0x7f8dc413df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:18.716 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:18.716+0000 7f8dc3400640 1 -- 172.21.15.72:0/2655072331 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8dc406dac0 msgr2=0x7f8dc4142c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:18.716 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:18.716+0000 7f8dc3400640 1 --2- 172.21.15.72:0/2655072331 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8dc406dac0 0x7f8dc4142c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:18.716 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:18.716+0000 7f8dc3400640 1 -- 172.21.15.72:0/2655072331 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8dc40d0110 msgr2=0x7f8dc413df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:18.716 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:18.716+0000 7f8dc3400640 1 --2- 172.21.15.72:0/2655072331 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8dc40d0110 0x7f8dc413df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:18.716 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:18.716+0000 7f8dc3400640 1 -- 172.21.15.72:0/2655072331 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8dc413cee0 con 0x7f8dc4145b10 2024-04-04T06:57:18.716 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:18.716+0000 7f8dc3400640 1 --2- 172.21.15.72:0/2655072331 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8dc4145b10 0x7f8dc413ba70 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f8dbc00ba10 tx=0x7f8dbc00bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:18.716 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:18.716+0000 7f8dbaa00640 1 -- 172.21.15.72:0/2655072331 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dbc019070 con 0x7f8dc4145b10 2024-04-04T06:57:18.717 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:18.716+0000 7f8dbaa00640 1 -- 172.21.15.72:0/2655072331 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8dbc00cae0 con 0x7f8dc4145b10 2024-04-04T06:57:18.717 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:18.717+0000 7f8dc9600640 1 -- 172.21.15.72:0/2655072331 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8dc413d1c0 con 0x7f8dc4145b10 2024-04-04T06:57:18.717 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:18.717+0000 7f8dbaa00640 1 -- 172.21.15.72:0/2655072331 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dbc014440 con 0x7f8dc4145b10 2024-04-04T06:57:18.717 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:18.717+0000 7f8dc9600640 1 -- 172.21.15.72:0/2655072331 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8dc413d780 con 0x7f8dc4145b10 2024-04-04T06:57:18.717 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:18.718+0000 7f8dc9600640 1 -- 172.21.15.72:0/2655072331 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8dc4075730 con 0x7f8dc4145b10 2024-04-04T06:57:18.717 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:18.719+0000 7f8dbaa00640 1 -- 172.21.15.72:0/2655072331 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8dbc01c070 con 0x7f8dc4145b10 2024-04-04T06:57:18.718 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:18.719+0000 7f8dbaa00640 1 --2- 172.21.15.72:0/2655072331 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f8da406c8f0 0x7f8da406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:18.718 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:18.720+0000 7f8dbaa00640 1 -- 172.21.15.72:0/2655072331 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f8dbc08b880 con 0x7f8dc4145b10 2024-04-04T06:57:18.718 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:18.720+0000 7f8dc2a00640 1 --2- 172.21.15.72:0/2655072331 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f8da406c8f0 0x7f8da406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:18.719 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:18.720+0000 7f8dc2a00640 1 --2- 172.21.15.72:0/2655072331 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f8da406c8f0 0x7f8da406edb0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f8db4036000 tx=0x7f8db4008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:18.722 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:18.724+0000 7f8dbaa00640 1 -- 172.21.15.72:0/2655072331 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f8dbc059c30 con 0x7f8dc4145b10 2024-04-04T06:57:18.921 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:18.922+0000 7f8dc9600640 1 -- 172.21.15.72:0/2655072331 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f8dc4072c50 con 0x7f8dc4145b10 2024-04-04T06:57:18.922 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:18.923+0000 7f8dbaa00640 1 -- 172.21.15.72:0/2655072331 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) ==== 93+0+10 (secure 0 0 0) 0x7f8dbc059530 con 0x7f8dc4145b10 2024-04-04T06:57:18.922 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 1 2024-04-04T06:57:18.925 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:18.925+0000 7f8dc9600640 1 -- 172.21.15.72:0/2655072331 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f8da406c8f0 msgr2=0x7f8da406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:18.925 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:18.925+0000 7f8dc9600640 1 --2- 172.21.15.72:0/2655072331 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f8da406c8f0 0x7f8da406edb0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f8db4036000 tx=0x7f8db4008030 comp rx=0 tx=0).stop 2024-04-04T06:57:18.925 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:18.925+0000 7f8dc9600640 1 -- 172.21.15.72:0/2655072331 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8dc4145b10 msgr2=0x7f8dc413ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:18.925 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:18.925+0000 7f8dc9600640 1 --2- 172.21.15.72:0/2655072331 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8dc4145b10 0x7f8dc413ba70 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f8dbc00ba10 tx=0x7f8dbc00bed0 comp rx=0 tx=0).stop 2024-04-04T06:57:18.925 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:18.925+0000 7f8dc9600640 1 -- 172.21.15.72:0/2655072331 shutdown_connections 2024-04-04T06:57:18.926 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:18.925+0000 7f8dc9600640 1 --2- 172.21.15.72:0/2655072331 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f8da406c8f0 0x7f8da406edb0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:18.926 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:18.925+0000 7f8dc9600640 1 --2- 172.21.15.72:0/2655072331 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8dc4145b10 0x7f8dc413ba70 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:18.926 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:18.925+0000 7f8dc9600640 1 --2- 172.21.15.72:0/2655072331 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8dc40d0110 0x7f8dc413df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:18.926 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:18.925+0000 7f8dc9600640 1 --2- 172.21.15.72:0/2655072331 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8dc406dac0 0x7f8dc4142c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:18.926 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:18.925+0000 7f8dc9600640 1 -- 172.21.15.72:0/2655072331 >> 172.21.15.72:0/2655072331 conn(0x7f8dc406b470 msgr2=0x7f8dc415ce20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:18.926 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:18.925+0000 7f8dc9600640 1 -- 172.21.15.72:0/2655072331 shutdown_connections 2024-04-04T06:57:18.927 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:18.925+0000 7f8dc9600640 1 -- 172.21.15.72:0/2655072331 wait complete. 2024-04-04T06:57:18.949 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-04T06:57:19.147 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:19.148+0000 7ff24dc00640 1 Processor -- start 2024-04-04T06:57:19.147 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:19.148+0000 7ff24dc00640 1 -- start start 2024-04-04T06:57:19.148 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:19.149+0000 7ff24dc00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7ff24815e1d0 0x7ff248162760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:19.148 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:19.149+0000 7ff24dc00640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff2480d1050 0x7ff2480d14b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:19.149 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:19.149+0000 7ff24dc00640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2480d2270 con 0x7ff2480d4070 2024-04-04T06:57:19.149 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:19.149+0000 7ff24dc00640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7ff2480d19f0 con 0x7ff2480d1050 2024-04-04T06:57:19.149 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:19.149+0000 7ff24dc00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7ff248162ca0 con 0x7ff24815e1d0 2024-04-04T06:57:19.149 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:19.150+0000 7ff247400640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff2480d1050 0x7ff2480d14b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:19.149 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:19.150+0000 7ff24d200640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7ff2480d4070 0x7ff2480d44e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:39466/0 (socket says 172.21.15.72:39466) 2024-04-04T06:57:19.149 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:19.150+0000 7ff24d200640 1 -- 172.21.15.72:0/2795408160 learned_addr learned my addr 172.21.15.72:0/2795408160 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-04-04T06:57:19.149 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:19.150+0000 7ff247e00640 1 --2- 172.21.15.72:0/2795408160 >> v2:172.21.15.117:3300/0 conn(0x7ff24815e1d0 0x7ff248162760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:19.149 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:19.150+0000 7ff247400640 1 -- 172.21.15.72:0/2795408160 >> v2:172.21.15.117:3300/0 conn(0x7ff24815e1d0 msgr2=0x7ff248162760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:57:19.149 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:19.150+0000 7ff247400640 1 --2- 172.21.15.72:0/2795408160 >> v2:172.21.15.117:3300/0 conn(0x7ff24815e1d0 0x7ff248162760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:19.149 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:19.150+0000 7ff247400640 1 -- 172.21.15.72:0/2795408160 >> v1:172.21.15.72:6789/0 conn(0x7ff2480d4070 legacy=0x7ff2480d44e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:19.149 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:19.150+0000 7ff247400640 1 -- 172.21.15.72:0/2795408160 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff24815e5b0 con 0x7ff2480d1050 2024-04-04T06:57:19.149 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:19.150+0000 7ff246a00640 1 -- 172.21.15.72:0/2795408160 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 830045274 0 0) 0x7ff2480d2270 con 0x7ff2480d4070 2024-04-04T06:57:19.149 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:19.150+0000 7ff247e00640 1 --2- 172.21.15.72:0/2795408160 >> v2:172.21.15.117:3300/0 conn(0x7ff24815e1d0 0x7ff248162760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-04T06:57:19.151 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:19.151+0000 7ff247400640 1 --2- 172.21.15.72:0/2795408160 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff2480d1050 0x7ff2480d14b0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7ff248071d80 tx=0x7ff23402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf2cecfae044568e server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:19.151 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:19.151+0000 7ff246a00640 1 -- 172.21.15.72:0/2795408160 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2340315a0 con 0x7ff2480d1050 2024-04-04T06:57:19.151 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:19.151+0000 7ff246a00640 1 -- 172.21.15.72:0/2795408160 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff234037070 con 0x7ff2480d1050 2024-04-04T06:57:19.151 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:19.151+0000 7ff246a00640 1 -- 172.21.15.72:0/2795408160 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff234031960 con 0x7ff2480d1050 2024-04-04T06:57:19.151 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:19.152+0000 7ff24dc00640 1 -- 172.21.15.72:0/2795408160 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff2480d1050 msgr2=0x7ff2480d14b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:19.151 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:19.152+0000 7ff24dc00640 1 --2- 172.21.15.72:0/2795408160 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff2480d1050 0x7ff2480d14b0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7ff248071d80 tx=0x7ff23402b840 comp rx=0 tx=0).stop 2024-04-04T06:57:19.151 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:19.152+0000 7ff24dc00640 1 -- 172.21.15.72:0/2795408160 shutdown_connections 2024-04-04T06:57:19.151 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:19.152+0000 7ff24dc00640 1 --2- 172.21.15.72:0/2795408160 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff2480d1050 0x7ff2480d14b0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:19.151 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:19.152+0000 7ff24dc00640 1 --2- 172.21.15.72:0/2795408160 >> v2:172.21.15.117:3300/0 conn(0x7ff24815e1d0 0x7ff248162760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:19.151 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:19.152+0000 7ff24dc00640 1 -- 172.21.15.72:0/2795408160 >> 172.21.15.72:0/2795408160 conn(0x7ff24806b8c0 msgr2=0x7ff24806bcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:19.151 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:19.152+0000 7ff24dc00640 1 -- 172.21.15.72:0/2795408160 shutdown_connections 2024-04-04T06:57:19.152 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:19.152+0000 7ff24dc00640 1 -- 172.21.15.72:0/2795408160 wait complete. 2024-04-04T06:57:19.152 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:19.154+0000 7ff24dc00640 1 Processor -- start 2024-04-04T06:57:19.152 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:19.154+0000 7ff24dc00640 1 -- start start 2024-04-04T06:57:19.154 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:19.155+0000 7ff24dc00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff2480d1050 0x7ff24815b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:19.154 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:19.155+0000 7ff24dc00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff2480d4070 0x7ff24815b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:19.154 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:19.155+0000 7ff24dc00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff24815e1d0 0x7ff2481e7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:19.155 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:19.155+0000 7ff24dc00640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7ff2480d3d20 con 0x7ff2480d1050 2024-04-04T06:57:19.155 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:19.155+0000 7ff24dc00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7ff2480d2510 con 0x7ff24815e1d0 2024-04-04T06:57:19.155 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:19.155+0000 7ff24dc00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7ff2480b3430 con 0x7ff2480d4070 2024-04-04T06:57:19.155 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:19.155+0000 7ff247e00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff2480d1050 0x7ff24815b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:19.155 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:19.155+0000 7ff247e00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff2480d1050 0x7ff24815b230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:33738/0 (socket says 172.21.15.72:33738) 2024-04-04T06:57:19.155 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:19.155+0000 7ff247e00640 1 -- 172.21.15.72:0/1819717026 learned_addr learned my addr 172.21.15.72:0/1819717026 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:57:19.155 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:19.155+0000 7ff247e00640 1 -- 172.21.15.72:0/1819717026 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff2480d4070 msgr2=0x7ff24815b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:19.155 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:19.155+0000 7ff247e00640 1 --2- 172.21.15.72:0/1819717026 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff2480d4070 0x7ff24815b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:19.155 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:19.155+0000 7ff247e00640 1 -- 172.21.15.72:0/1819717026 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff24815e1d0 msgr2=0x7ff2481e7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:19.155 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:19.155+0000 7ff247e00640 1 --2- 172.21.15.72:0/1819717026 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff24815e1d0 0x7ff2481e7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:19.155 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:19.155+0000 7ff247e00640 1 -- 172.21.15.72:0/1819717026 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2480cb2f0 con 0x7ff2480d1050 2024-04-04T06:57:19.155 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:19.156+0000 7ff247e00640 1 --2- 172.21.15.72:0/1819717026 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff2480d1050 0x7ff24815b230 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7ff23800c7f0 tx=0x7ff23800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:19.155 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:19.156+0000 7ff23fe00640 1 -- 172.21.15.72:0/1819717026 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff238015070 con 0x7ff2480d1050 2024-04-04T06:57:19.155 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:19.156+0000 7ff24dc00640 1 -- 172.21.15.72:0/1819717026 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2481602a0 con 0x7ff2480d1050 2024-04-04T06:57:19.155 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:19.156+0000 7ff23fe00640 1 -- 172.21.15.72:0/1819717026 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff238007820 con 0x7ff2480d1050 2024-04-04T06:57:19.156 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:19.156+0000 7ff23fe00640 1 -- 172.21.15.72:0/1819717026 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff238007bd0 con 0x7ff2480d1050 2024-04-04T06:57:19.156 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:19.156+0000 7ff24dc00640 1 -- 172.21.15.72:0/1819717026 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2480cb870 con 0x7ff2480d1050 2024-04-04T06:57:19.156 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:19.157+0000 7ff24dc00640 1 -- 172.21.15.72:0/1819717026 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2480cbf90 con 0x7ff2480d1050 2024-04-04T06:57:19.156 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:19.158+0000 7ff23fe00640 1 -- 172.21.15.72:0/1819717026 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff238018070 con 0x7ff2480d1050 2024-04-04T06:57:19.157 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:19.159+0000 7ff23fe00640 1 --2- 172.21.15.72:0/1819717026 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7ff22806c8f0 0x7ff22806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:19.157 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:19.159+0000 7ff23fe00640 1 -- 172.21.15.72:0/1819717026 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7ff23808bd90 con 0x7ff2480d1050 2024-04-04T06:57:19.157 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:19.159+0000 7ff247400640 1 --2- 172.21.15.72:0/1819717026 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7ff22806c8f0 0x7ff22806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:19.158 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:19.160+0000 7ff247400640 1 --2- 172.21.15.72:0/1819717026 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7ff22806c8f0 0x7ff22806edb0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7ff234036000 tx=0x7ff234030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:19.167 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:19.168+0000 7ff23fe00640 1 -- 172.21.15.72:0/1819717026 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7ff23805a0b0 con 0x7ff2480d1050 2024-04-04T06:57:19.366 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:19.368+0000 7ff24dc00640 1 -- 172.21.15.72:0/1819717026 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7ff2480756c0 con 0x7ff2480d1050 2024-04-04T06:57:19.367 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:19.368+0000 7ff23fe00640 1 -- 172.21.15.72:0/1819717026 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) ==== 104+0+11 (secure 0 0 0) 0x7ff2380599b0 con 0x7ff2480d1050 2024-04-04T06:57:19.367 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2024-04-04T06:57:19.370 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:19.371+0000 7ff24dc00640 1 -- 172.21.15.72:0/1819717026 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7ff22806c8f0 msgr2=0x7ff22806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:19.370 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:19.371+0000 7ff24dc00640 1 --2- 172.21.15.72:0/1819717026 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7ff22806c8f0 0x7ff22806edb0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7ff234036000 tx=0x7ff234030000 comp rx=0 tx=0).stop 2024-04-04T06:57:19.370 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:19.371+0000 7ff24dc00640 1 -- 172.21.15.72:0/1819717026 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff2480d1050 msgr2=0x7ff24815b230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:19.370 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:19.371+0000 7ff24dc00640 1 --2- 172.21.15.72:0/1819717026 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff2480d1050 0x7ff24815b230 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7ff23800c7f0 tx=0x7ff23800ccb0 comp rx=0 tx=0).stop 2024-04-04T06:57:19.370 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:19.371+0000 7ff24dc00640 1 -- 172.21.15.72:0/1819717026 shutdown_connections 2024-04-04T06:57:19.370 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:19.371+0000 7ff24dc00640 1 --2- 172.21.15.72:0/1819717026 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7ff22806c8f0 0x7ff22806edb0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:19.370 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:19.371+0000 7ff24dc00640 1 --2- 172.21.15.72:0/1819717026 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff24815e1d0 0x7ff2481e7bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:19.371 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:19.371+0000 7ff24dc00640 1 --2- 172.21.15.72:0/1819717026 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff2480d4070 0x7ff24815b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:19.371 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:19.371+0000 7ff24dc00640 1 --2- 172.21.15.72:0/1819717026 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff2480d1050 0x7ff24815b230 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:19.371 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:19.371+0000 7ff24dc00640 1 -- 172.21.15.72:0/1819717026 >> 172.21.15.72:0/1819717026 conn(0x7ff24806b8c0 msgr2=0x7ff2480b2d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:19.371 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:19.371+0000 7ff24dc00640 1 -- 172.21.15.72:0/1819717026 shutdown_connections 2024-04-04T06:57:19.371 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:19.371+0000 7ff24dc00640 1 -- 172.21.15.72:0/1819717026 wait complete. 2024-04-04T06:57:19.388 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-04T06:57:19.585 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:19.586+0000 7f812f200640 1 Processor -- start 2024-04-04T06:57:19.585 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:19.586+0000 7f812f200640 1 -- start start 2024-04-04T06:57:19.586 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:19.587+0000 7f812f200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f81301418f0 0x7f81300d0140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:19.587 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:19.587+0000 7f812f200640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f81301423e0 0x7f813015c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:19.587 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:19.587+0000 7f812f200640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8130160b40 con 0x7f81300d0680 2024-04-04T06:57:19.587 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:19.587+0000 7f812f200640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f81300d0ae0 con 0x7f81301423e0 2024-04-04T06:57:19.587 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:19.587+0000 7f812f200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f813015ffc0 con 0x7f81301418f0 2024-04-04T06:57:19.587 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:19.588+0000 7f812e800640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f81301423e0 0x7f813015c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:19.587 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:19.588+0000 7f812e800640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f81301423e0 0x7f813015c9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:37162/0 (socket says 172.21.15.72:37162) 2024-04-04T06:57:19.587 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:19.588+0000 7f812e800640 1 -- 172.21.15.72:0/3796829562 learned_addr learned my addr 172.21.15.72:0/3796829562 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:57:19.587 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:19.588+0000 7f812e800640 1 -- 172.21.15.72:0/3796829562 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f81301418f0 msgr2=0x7f81300d0140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:57:19.587 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:19.588+0000 7f812e800640 1 --2- 172.21.15.72:0/3796829562 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f81301418f0 0x7f81300d0140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:19.587 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:19.588+0000 7f812e800640 1 -- 172.21.15.72:0/3796829562 >> v1:172.21.15.117:6789/0 conn(0x7f81300d0680 legacy=0x7f8130141cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:57:19.587 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:19.588+0000 7f812e800640 1 -- 172.21.15.72:0/3796829562 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81301602a0 con 0x7f81301423e0 2024-04-04T06:57:19.589 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:19.589+0000 7f812e800640 1 --2- 172.21.15.72:0/3796829562 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f81301423e0 0x7f813015c9b0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f8128009e50 tx=0x7f812802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f1eff30fb8d9164 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:19.589 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:19.589+0000 7f812ca00640 1 -- 172.21.15.72:0/3796829562 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f812802ca70 con 0x7f81301423e0 2024-04-04T06:57:19.589 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:19.589+0000 7f812ca00640 1 -- 172.21.15.72:0/3796829562 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f812802cc10 con 0x7f81301423e0 2024-04-04T06:57:19.589 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:19.589+0000 7f812ca00640 1 -- 172.21.15.72:0/3796829562 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81280343f0 con 0x7f81301423e0 2024-04-04T06:57:19.589 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:19.590+0000 7f812f200640 1 -- 172.21.15.72:0/3796829562 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f81301423e0 msgr2=0x7f813015c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:19.589 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:19.590+0000 7f812f200640 1 --2- 172.21.15.72:0/3796829562 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f81301423e0 0x7f813015c9b0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f8128009e50 tx=0x7f812802bed0 comp rx=0 tx=0).stop 2024-04-04T06:57:19.589 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:19.590+0000 7f812f200640 1 -- 172.21.15.72:0/3796829562 shutdown_connections 2024-04-04T06:57:19.589 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:19.590+0000 7f812f200640 1 --2- 172.21.15.72:0/3796829562 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f81301423e0 0x7f813015c9b0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:19.589 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:19.590+0000 7f812f200640 1 --2- 172.21.15.72:0/3796829562 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f81301418f0 0x7f81300d0140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:19.589 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:19.590+0000 7f812f200640 1 -- 172.21.15.72:0/3796829562 >> 172.21.15.72:0/3796829562 conn(0x7f813006b890 msgr2=0x7f813006bca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:19.589 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:19.590+0000 7f812f200640 1 -- 172.21.15.72:0/3796829562 shutdown_connections 2024-04-04T06:57:19.589 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:19.590+0000 7f812f200640 1 -- 172.21.15.72:0/3796829562 wait complete. 2024-04-04T06:57:19.590 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:19.592+0000 7f812f200640 1 Processor -- start 2024-04-04T06:57:19.590 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:19.592+0000 7f812f200640 1 -- start start 2024-04-04T06:57:19.593 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:19.593+0000 7f812f200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f81300d0680 0x7f813014fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:19.594 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:19.593+0000 7f812f200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f81301418f0 0x7f813015d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:19.594 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:19.593+0000 7f812f200640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f81301423e0 0x7f813013fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:19.594 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:19.593+0000 7f812f200640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f81300cc9c0 con 0x7f81301423e0 2024-04-04T06:57:19.594 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:19.593+0000 7f812f200640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f8130160860 con 0x7f81300d0680 2024-04-04T06:57:19.594 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:19.593+0000 7f812f200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f813015fc00 con 0x7f81301418f0 2024-04-04T06:57:19.594 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:19.593+0000 7f812e800640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f81301423e0 0x7f813013fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:19.594 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:19.593+0000 7f812e800640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f81301423e0 0x7f813013fcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:37174/0 (socket says 172.21.15.72:37174) 2024-04-04T06:57:19.594 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:19.593+0000 7f812e800640 1 -- 172.21.15.72:0/4157877044 learned_addr learned my addr 172.21.15.72:0/4157877044 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:57:19.594 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:19.593+0000 7f812de00640 1 --2- 172.21.15.72:0/4157877044 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f81300d0680 0x7f813014fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:19.594 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:19.593+0000 7f812d400640 1 --2- 172.21.15.72:0/4157877044 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f81301418f0 0x7f813015d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:19.595 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:19.593+0000 7f812e800640 1 -- 172.21.15.72:0/4157877044 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f81301418f0 msgr2=0x7f813015d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:19.595 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:19.594+0000 7f812e800640 1 --2- 172.21.15.72:0/4157877044 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f81301418f0 0x7f813015d2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:19.595 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:19.594+0000 7f812e800640 1 -- 172.21.15.72:0/4157877044 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f81300d0680 msgr2=0x7f813014fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:19.595 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:19.594+0000 7f812e800640 1 --2- 172.21.15.72:0/4157877044 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f81300d0680 0x7f813014fd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:19.595 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:19.594+0000 7f812e800640 1 -- 172.21.15.72:0/4157877044 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8130072ae0 con 0x7f81301423e0 2024-04-04T06:57:19.595 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:19.594+0000 7f812de00640 1 --2- 172.21.15.72:0/4157877044 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f81300d0680 0x7f813014fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-04T06:57:19.595 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:19.594+0000 7f812d400640 1 --2- 172.21.15.72:0/4157877044 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f81301418f0 0x7f813015d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-04T06:57:19.595 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:19.594+0000 7f812e800640 1 --2- 172.21.15.72:0/4157877044 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f81301423e0 0x7f813013fcd0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f8128036040 tx=0x7f8128004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:19.595 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:19.594+0000 7f8126000640 1 -- 172.21.15.72:0/4157877044 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8128043020 con 0x7f81301423e0 2024-04-04T06:57:19.595 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:19.594+0000 7f8126000640 1 -- 172.21.15.72:0/4157877044 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f812803e450 con 0x7f81301423e0 2024-04-04T06:57:19.595 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:19.594+0000 7f8126000640 1 -- 172.21.15.72:0/4157877044 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f812803e820 con 0x7f81301423e0 2024-04-04T06:57:19.595 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:19.594+0000 7f812f200640 1 -- 172.21.15.72:0/4157877044 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81301503c0 con 0x7f81301423e0 2024-04-04T06:57:19.595 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:19.594+0000 7f812f200640 1 -- 172.21.15.72:0/4157877044 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f813015e420 con 0x7f81301423e0 2024-04-04T06:57:19.596 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:19.596+0000 7f812f200640 1 -- 172.21.15.72:0/4157877044 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81300756c0 con 0x7f81301423e0 2024-04-04T06:57:19.596 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:19.596+0000 7f8126000640 1 -- 172.21.15.72:0/4157877044 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8128046020 con 0x7f81301423e0 2024-04-04T06:57:19.597 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:19.597+0000 7f8126000640 1 --2- 172.21.15.72:0/4157877044 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f811006c8f0 0x7f811006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:19.597 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:19.597+0000 7f8126000640 1 -- 172.21.15.72:0/4157877044 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f81280ae5c0 con 0x7f81301423e0 2024-04-04T06:57:19.597 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:19.597+0000 7f812de00640 1 --2- 172.21.15.72:0/4157877044 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f811006c8f0 0x7f811006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:19.597 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:19.598+0000 7f812de00640 1 --2- 172.21.15.72:0/4157877044 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f811006c8f0 0x7f811006edb0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f8120006fd0 tx=0x7f8120008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:19.600 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:19.601+0000 7f8126000640 1 -- 172.21.15.72:0/4157877044 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f812804d030 con 0x7f81301423e0 2024-04-04T06:57:19.828 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:19.829+0000 7f812f200640 1 -- 172.21.15.72:0/4157877044 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f8130142190 con 0x7f81301423e0 2024-04-04T06:57:19.829 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:19.830+0000 7f8126000640 1 -- 172.21.15.72:0/4157877044 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) ==== 100+0+11 (secure 0 0 0) 0x7f812807c8d0 con 0x7f81301423e0 2024-04-04T06:57:19.829 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 64 2024-04-04T06:57:19.834 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:19.832+0000 7f812f200640 1 -- 172.21.15.72:0/4157877044 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f811006c8f0 msgr2=0x7f811006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:19.834 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:19.832+0000 7f812f200640 1 --2- 172.21.15.72:0/4157877044 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f811006c8f0 0x7f811006edb0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f8120006fd0 tx=0x7f8120008040 comp rx=0 tx=0).stop 2024-04-04T06:57:19.834 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:19.832+0000 7f812f200640 1 -- 172.21.15.72:0/4157877044 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f81301423e0 msgr2=0x7f813013fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:19.834 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:19.832+0000 7f812f200640 1 --2- 172.21.15.72:0/4157877044 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f81301423e0 0x7f813013fcd0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f8128036040 tx=0x7f8128004a40 comp rx=0 tx=0).stop 2024-04-04T06:57:19.834 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:19.832+0000 7f812f200640 1 -- 172.21.15.72:0/4157877044 shutdown_connections 2024-04-04T06:57:19.834 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:19.833+0000 7f812f200640 1 --2- 172.21.15.72:0/4157877044 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f811006c8f0 0x7f811006edb0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:19.834 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:19.833+0000 7f812f200640 1 --2- 172.21.15.72:0/4157877044 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f81301423e0 0x7f813013fcd0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:19.834 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:19.833+0000 7f812f200640 1 --2- 172.21.15.72:0/4157877044 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f81301418f0 0x7f813015d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:19.834 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:19.833+0000 7f812f200640 1 --2- 172.21.15.72:0/4157877044 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f81300d0680 0x7f813014fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:19.834 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:19.833+0000 7f812f200640 1 -- 172.21.15.72:0/4157877044 >> 172.21.15.72:0/4157877044 conn(0x7f813006b890 msgr2=0x7f81300b3db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:19.835 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:19.833+0000 7f812f200640 1 -- 172.21.15.72:0/4157877044 shutdown_connections 2024-04-04T06:57:19.835 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:19.833+0000 7f812f200640 1 -- 172.21.15.72:0/4157877044 wait complete. 2024-04-04T06:57:19.848 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-04T06:57:20.046 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:20.047+0000 7fe981a00640 1 Processor -- start 2024-04-04T06:57:20.046 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:20.047+0000 7fe981a00640 1 -- start start 2024-04-04T06:57:20.047 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:20.049+0000 7fe981a00640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe97c0d1510 0x7fe97c0c7750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:20.048 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:20.049+0000 7fe981a00640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe97c0b4930 con 0x7fe97c06cc90 2024-04-04T06:57:20.048 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:20.049+0000 7fe981a00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe97c0cff10 con 0x7fe97c15e6d0 2024-04-04T06:57:20.048 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:20.049+0000 7fe981a00640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7fe97c0cfcc0 con 0x7fe97c0d1510 2024-04-04T06:57:20.048 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:20.049+0000 7fe97a000640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fe97c06cc90 0x7fe97c0c7040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:40112/0 (socket says 172.21.15.72:40112) 2024-04-04T06:57:20.048 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:20.049+0000 7fe97a000640 1 -- 172.21.15.72:0/906104137 learned_addr learned my addr 172.21.15.72:0/906104137 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-04-04T06:57:20.048 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:20.049+0000 7fe97b400640 1 --2- 172.21.15.72:0/906104137 >> v2:172.21.15.72:3300/0 conn(0x7fe97c0d1510 0x7fe97c0c7750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:20.049 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:20.049+0000 7fe979600640 1 -- 172.21.15.72:0/906104137 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2411680353 0 0) 0x7fe97c0b4930 con 0x7fe97c06cc90 2024-04-04T06:57:20.049 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:20.049+0000 7fe979600640 1 -- 172.21.15.72:0/906104137 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe960003520 con 0x7fe97c06cc90 2024-04-04T06:57:20.049 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:20.049+0000 7fe97b400640 1 -- 172.21.15.72:0/906104137 >> v1:172.21.15.117:6789/0 conn(0x7fe97c15e6d0 legacy=0x7fe97c06c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:20.049 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:20.050+0000 7fe97b400640 1 -- 172.21.15.72:0/906104137 >> v1:172.21.15.72:6789/0 conn(0x7fe97c06cc90 legacy=0x7fe97c0c7040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:20.049 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:20.050+0000 7fe97b400640 1 -- 172.21.15.72:0/906104137 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe97c0d01f0 con 0x7fe97c0d1510 2024-04-04T06:57:20.049 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:20.051+0000 7fe97b400640 1 --2- 172.21.15.72:0/906104137 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe97c0d1510 0x7fe97c0c7750 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fe974009d90 tx=0x7fe97402beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e56550b727adf30 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:20.050 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:20.051+0000 7fe979600640 1 -- 172.21.15.72:0/906104137 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe974039070 con 0x7fe97c0d1510 2024-04-04T06:57:20.050 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:20.051+0000 7fe979600640 1 -- 172.21.15.72:0/906104137 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe97402cc60 con 0x7fe97c0d1510 2024-04-04T06:57:20.050 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:20.051+0000 7fe979600640 1 -- 172.21.15.72:0/906104137 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe974034660 con 0x7fe97c0d1510 2024-04-04T06:57:20.050 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:20.051+0000 7fe981a00640 1 -- 172.21.15.72:0/906104137 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe97c0d1510 msgr2=0x7fe97c0c7750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:20.051 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:20.051+0000 7fe981a00640 1 --2- 172.21.15.72:0/906104137 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe97c0d1510 0x7fe97c0c7750 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fe974009d90 tx=0x7fe97402beb0 comp rx=0 tx=0).stop 2024-04-04T06:57:20.051 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:20.052+0000 7fe981a00640 1 -- 172.21.15.72:0/906104137 shutdown_connections 2024-04-04T06:57:20.051 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:20.052+0000 7fe981a00640 1 --2- 172.21.15.72:0/906104137 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe97c0d1510 0x7fe97c0c7750 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:20.051 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:20.052+0000 7fe981a00640 1 -- 172.21.15.72:0/906104137 >> 172.21.15.72:0/906104137 conn(0x7fe97c0d2180 msgr2=0x7fe97c0d2560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:20.051 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:20.052+0000 7fe981a00640 1 -- 172.21.15.72:0/906104137 shutdown_connections 2024-04-04T06:57:20.051 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:20.052+0000 7fe981a00640 1 -- 172.21.15.72:0/906104137 wait complete. 2024-04-04T06:57:20.052 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:20.054+0000 7fe981a00640 1 Processor -- start 2024-04-04T06:57:20.052 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:20.054+0000 7fe981a00640 1 -- start start 2024-04-04T06:57:20.055 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:20.054+0000 7fe981a00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe97c06cc90 0x7fe97c14cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:20.055 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:20.055+0000 7fe981a00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe97c0d1510 0x7fe97c0b5310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:20.055 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:20.055+0000 7fe981a00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe97c15e6d0 0x7fe97c0b6ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:20.055 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:20.055+0000 7fe981a00640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fe97c0d0a90 con 0x7fe97c15e6d0 2024-04-04T06:57:20.055 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:20.055+0000 7fe981a00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fe97c0d07b0 con 0x7fe97c06cc90 2024-04-04T06:57:20.055 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:20.055+0000 7fe981a00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fe97c0d0fb0 con 0x7fe97c0d1510 2024-04-04T06:57:20.055 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:20.055+0000 7fe97b400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe97c15e6d0 0x7fe97c0b6ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:20.055 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:20.055+0000 7fe97b400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe97c15e6d0 0x7fe97c0b6ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:37190/0 (socket says 172.21.15.72:37190) 2024-04-04T06:57:20.055 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:20.055+0000 7fe97b400640 1 -- 172.21.15.72:0/1769707574 learned_addr learned my addr 172.21.15.72:0/1769707574 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:57:20.055 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:20.055+0000 7fe97a000640 1 --2- 172.21.15.72:0/1769707574 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe97c0d1510 0x7fe97c0b5310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:20.055 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:20.055+0000 7fe97b400640 1 -- 172.21.15.72:0/1769707574 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe97c0d1510 msgr2=0x7fe97c0b5310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:20.055 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:20.055+0000 7fe97b400640 1 --2- 172.21.15.72:0/1769707574 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe97c0d1510 0x7fe97c0b5310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:20.056 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:20.055+0000 7fe97b400640 1 -- 172.21.15.72:0/1769707574 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe97c06cc90 msgr2=0x7fe97c14cba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:20.056 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:20.055+0000 7fe97aa00640 1 --2- 172.21.15.72:0/1769707574 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe97c06cc90 0x7fe97c14cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:20.056 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:20.055+0000 7fe97b400640 1 --2- 172.21.15.72:0/1769707574 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe97c06cc90 0x7fe97c14cba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:20.056 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:20.055+0000 7fe97b400640 1 -- 172.21.15.72:0/1769707574 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe97c15f8a0 con 0x7fe97c15e6d0 2024-04-04T06:57:20.056 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:20.055+0000 7fe97a000640 1 --2- 172.21.15.72:0/1769707574 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe97c0d1510 0x7fe97c0b5310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-04T06:57:20.056 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:20.056+0000 7fe97b400640 1 --2- 172.21.15.72:0/1769707574 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe97c15e6d0 0x7fe97c0b6ec0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fe974009d90 tx=0x7fe974004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:20.056 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:20.056+0000 7fe972a00640 1 -- 172.21.15.72:0/1769707574 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe974039050 con 0x7fe97c15e6d0 2024-04-04T06:57:20.056 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:20.056+0000 7fe972a00640 1 -- 172.21.15.72:0/1769707574 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe974045070 con 0x7fe97c15e6d0 2024-04-04T06:57:20.056 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:20.056+0000 7fe972a00640 1 -- 172.21.15.72:0/1769707574 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe974009450 con 0x7fe97c15e6d0 2024-04-04T06:57:20.056 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:20.056+0000 7fe981a00640 1 -- 172.21.15.72:0/1769707574 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe97c15fb30 con 0x7fe97c15e6d0 2024-04-04T06:57:20.056 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:20.056+0000 7fe981a00640 1 -- 172.21.15.72:0/1769707574 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe97c1603d0 con 0x7fe97c15e6d0 2024-04-04T06:57:20.057 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:20.058+0000 7fe981a00640 1 -- 172.21.15.72:0/1769707574 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe97c075840 con 0x7fe97c15e6d0 2024-04-04T06:57:20.057 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:20.058+0000 7fe972a00640 1 -- 172.21.15.72:0/1769707574 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe97403e850 con 0x7fe97c15e6d0 2024-04-04T06:57:20.058 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:20.060+0000 7fe972a00640 1 --2- 172.21.15.72:0/1769707574 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fe95c06c8f0 0x7fe95c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:20.059 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:20.060+0000 7fe972a00640 1 -- 172.21.15.72:0/1769707574 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7fe9740ae880 con 0x7fe97c15e6d0 2024-04-04T06:57:20.059 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:20.060+0000 7fe97aa00640 1 --2- 172.21.15.72:0/1769707574 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fe95c06c8f0 0x7fe95c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:20.059 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:20.061+0000 7fe97aa00640 1 --2- 172.21.15.72:0/1769707574 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fe95c06c8f0 0x7fe95c06edb0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fe96c000f60 tx=0x7fe96c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:20.064 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:20.066+0000 7fe972a00640 1 -- 172.21.15.72:0/1769707574 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fe974032e20 con 0x7fe97c15e6d0 2024-04-04T06:57:20.278 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:20.279+0000 7fe981a00640 1 -- 172.21.15.72:0/1769707574 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fe97c0d2d90 con 0x7fe97c15e6d0 2024-04-04T06:57:20.279 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:20.280+0000 7fe972a00640 1 -- 172.21.15.72:0/1769707574 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v22) ==== 80+0+0 (secure 0 0 0) 0x7fe97407cc20 con 0x7fe97c15e6d0 2024-04-04T06:57:20.279 INFO:teuthology.orchestra.run.smithi072.stderr:listed 0 entries 2024-04-04T06:57:20.282 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:20.283+0000 7fe981a00640 1 -- 172.21.15.72:0/1769707574 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fe95c06c8f0 msgr2=0x7fe95c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:20.282 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:20.283+0000 7fe981a00640 1 --2- 172.21.15.72:0/1769707574 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fe95c06c8f0 0x7fe95c06edb0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fe96c000f60 tx=0x7fe96c009040 comp rx=0 tx=0).stop 2024-04-04T06:57:20.282 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:20.283+0000 7fe981a00640 1 -- 172.21.15.72:0/1769707574 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe97c15e6d0 msgr2=0x7fe97c0b6ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:20.282 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:20.283+0000 7fe981a00640 1 --2- 172.21.15.72:0/1769707574 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe97c15e6d0 0x7fe97c0b6ec0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fe974009d90 tx=0x7fe974004a40 comp rx=0 tx=0).stop 2024-04-04T06:57:20.282 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:20.283+0000 7fe981a00640 1 -- 172.21.15.72:0/1769707574 shutdown_connections 2024-04-04T06:57:20.282 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:20.283+0000 7fe981a00640 1 --2- 172.21.15.72:0/1769707574 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fe95c06c8f0 0x7fe95c06edb0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:20.282 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:20.283+0000 7fe981a00640 1 --2- 172.21.15.72:0/1769707574 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe97c15e6d0 0x7fe97c0b6ec0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:20.283 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:20.283+0000 7fe981a00640 1 --2- 172.21.15.72:0/1769707574 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe97c0d1510 0x7fe97c0b5310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:20.283 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:20.283+0000 7fe981a00640 1 --2- 172.21.15.72:0/1769707574 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe97c06cc90 0x7fe97c14cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:20.283 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:20.283+0000 7fe981a00640 1 -- 172.21.15.72:0/1769707574 >> 172.21.15.72:0/1769707574 conn(0x7fe97c0d2180 msgr2=0x7fe97c0c8200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:20.283 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:20.283+0000 7fe981a00640 1 -- 172.21.15.72:0/1769707574 shutdown_connections 2024-04-04T06:57:20.283 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:20.283+0000 7fe981a00640 1 -- 172.21.15.72:0/1769707574 wait complete. 2024-04-04T06:57:20.303 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-04-04T06:57:20.303 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-04T06:57:20.358 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-04T06:57:20.577 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:20.578+0000 7f92fec00640 1 Processor -- start 2024-04-04T06:57:20.577 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:20.578+0000 7f92fec00640 1 -- start start 2024-04-04T06:57:20.579 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:20.580+0000 7f92fec00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f92f8158390 0x7f92f80c6840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:20.579 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:20.580+0000 7f92fec00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f92f8158770 0x7f92f80b3a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:20.579 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:20.580+0000 7f92fec00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f92f815e590 con 0x7f92f80b4730 2024-04-04T06:57:20.579 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:20.580+0000 7f92fec00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f92f80b3fd0 con 0x7f92f8158390 2024-04-04T06:57:20.579 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:20.580+0000 7f92fec00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f92f80c6e90 con 0x7f92f8158770 2024-04-04T06:57:20.580 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:20.581+0000 7f92ef400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f92f8158770 0x7f92f80b3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:20.580 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:20.581+0000 7f92ef400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f92f8158770 0x7f92f80b3a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.72:47834/0 (socket says 172.21.15.72:47834) 2024-04-04T06:57:20.580 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:20.581+0000 7f92ef400640 1 -- 172.21.15.72:0/1939282356 learned_addr learned my addr 172.21.15.72:0/1939282356 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:57:20.580 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:20.581+0000 7f92f7e00640 1 --2- 172.21.15.72:0/1939282356 >> v2:172.21.15.117:3300/0 conn(0x7f92f8158390 0x7f92f80c6840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:20.580 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:20.581+0000 7f92f7e00640 1 -- 172.21.15.72:0/1939282356 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f92f8158770 msgr2=0x7f92f80b3a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:57:20.580 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:20.581+0000 7f92f7e00640 1 --2- 172.21.15.72:0/1939282356 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f92f8158770 0x7f92f80b3a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:20.581 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:20.581+0000 7f92f7e00640 1 -- 172.21.15.72:0/1939282356 >> v1:172.21.15.117:6789/0 conn(0x7f92f80b4730 legacy=0x7f92f80cc8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:20.581 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:20.581+0000 7f92f7e00640 1 -- 172.21.15.72:0/1939282356 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92f815e830 con 0x7f92f8158390 2024-04-04T06:57:20.581 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:20.583+0000 7f92f7e00640 1 --2- 172.21.15.72:0/1939282356 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f92f8158390 0x7f92f80c6840 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f92e800bd40 tx=0x7f92e802de40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6ccecd8b46f74308 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:20.582 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:20.583+0000 7f92f7400640 1 -- 172.21.15.72:0/1939282356 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92e803b070 con 0x7f92f8158390 2024-04-04T06:57:20.582 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:20.583+0000 7f92f7400640 1 -- 172.21.15.72:0/1939282356 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92e802ebf0 con 0x7f92f8158390 2024-04-04T06:57:20.582 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:20.583+0000 7f92f7400640 1 -- 172.21.15.72:0/1939282356 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92e8036440 con 0x7f92f8158390 2024-04-04T06:57:20.592 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:20.584+0000 7f92fec00640 1 -- 172.21.15.72:0/1939282356 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f92f8158390 msgr2=0x7f92f80c6840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:20.592 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:20.584+0000 7f92fec00640 1 --2- 172.21.15.72:0/1939282356 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f92f8158390 0x7f92f80c6840 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f92e800bd40 tx=0x7f92e802de40 comp rx=0 tx=0).stop 2024-04-04T06:57:20.592 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:20.584+0000 7f92fec00640 1 -- 172.21.15.72:0/1939282356 shutdown_connections 2024-04-04T06:57:20.592 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:20.584+0000 7f92fec00640 1 --2- 172.21.15.72:0/1939282356 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f92f8158770 0x7f92f80b3a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:20.592 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:20.584+0000 7f92fec00640 1 --2- 172.21.15.72:0/1939282356 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f92f8158390 0x7f92f80c6840 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:20.592 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:20.584+0000 7f92fec00640 1 -- 172.21.15.72:0/1939282356 >> 172.21.15.72:0/1939282356 conn(0x7f92f806b470 msgr2=0x7f92f806b880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:20.592 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:20.584+0000 7f92fec00640 1 -- 172.21.15.72:0/1939282356 shutdown_connections 2024-04-04T06:57:20.592 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:20.584+0000 7f92fec00640 1 -- 172.21.15.72:0/1939282356 wait complete. 2024-04-04T06:57:20.593 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:20.587+0000 7f92fec00640 1 Processor -- start 2024-04-04T06:57:20.593 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:20.587+0000 7f92fec00640 1 -- start start 2024-04-04T06:57:20.593 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:20.589+0000 7f92fec00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f92f80b4730 0x7f92f8071510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:20.593 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:20.589+0000 7f92fec00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f92f8158390 0x7f92f81576d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:20.593 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:20.589+0000 7f92fec00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f92f8158770 0x7f92f806eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:20.593 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:20.589+0000 7f92fec00640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f92f815f310 con 0x7f92f8158390 2024-04-04T06:57:20.593 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:20.589+0000 7f92fec00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f92f815edf0 con 0x7f92f8158770 2024-04-04T06:57:20.593 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:20.589+0000 7f92fec00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f92f815f490 con 0x7f92f80b4730 2024-04-04T06:57:20.593 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:20.589+0000 7f92ef400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f92f8158390 0x7f92f81576d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:20.593 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:20.589+0000 7f92ef400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f92f8158390 0x7f92f81576d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:37204/0 (socket says 172.21.15.72:37204) 2024-04-04T06:57:20.593 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:20.589+0000 7f92ef400640 1 -- 172.21.15.72:0/2503337078 learned_addr learned my addr 172.21.15.72:0/2503337078 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:57:20.593 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:20.589+0000 7f92fcc00640 1 --2- 172.21.15.72:0/2503337078 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f92f8158770 0x7f92f806eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:20.593 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:20.590+0000 7f92f7e00640 1 --2- 172.21.15.72:0/2503337078 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f92f80b4730 0x7f92f8071510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:20.593 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:20.590+0000 7f92ef400640 1 -- 172.21.15.72:0/2503337078 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f92f80b4730 msgr2=0x7f92f8071510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:20.593 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:20.590+0000 7f92ef400640 1 --2- 172.21.15.72:0/2503337078 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f92f80b4730 0x7f92f8071510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:20.593 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:20.590+0000 7f92ef400640 1 -- 172.21.15.72:0/2503337078 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f92f8158770 msgr2=0x7f92f806eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:20.594 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:20.590+0000 7f92ef400640 1 --2- 172.21.15.72:0/2503337078 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f92f8158770 0x7f92f806eb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:20.594 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:20.590+0000 7f92ef400640 1 -- 172.21.15.72:0/2503337078 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92f81f5220 con 0x7f92f8158390 2024-04-04T06:57:20.594 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:20.590+0000 7f92f7e00640 1 --2- 172.21.15.72:0/2503337078 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f92f80b4730 0x7f92f8071510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-04T06:57:20.594 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:20.590+0000 7f92ef400640 1 --2- 172.21.15.72:0/2503337078 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f92f8158390 0x7f92f81576d0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f92e000e930 tx=0x7f92e000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:20.594 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:20.590+0000 7f92f4c00640 1 -- 172.21.15.72:0/2503337078 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92e0017070 con 0x7f92f8158390 2024-04-04T06:57:20.594 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:20.590+0000 7f92f4c00640 1 -- 172.21.15.72:0/2503337078 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92e000ca00 con 0x7f92f8158390 2024-04-04T06:57:20.594 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:20.590+0000 7f92fec00640 1 -- 172.21.15.72:0/2503337078 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92f81f4f40 con 0x7f92f8158390 2024-04-04T06:57:20.594 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:20.590+0000 7f92f4c00640 1 -- 172.21.15.72:0/2503337078 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92e000cdd0 con 0x7f92f8158390 2024-04-04T06:57:20.594 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:20.591+0000 7f92fec00640 1 -- 172.21.15.72:0/2503337078 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92f80b1600 con 0x7f92f8158390 2024-04-04T06:57:20.594 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:20.592+0000 7f92fec00640 1 -- 172.21.15.72:0/2503337078 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92f8075840 con 0x7f92f8158390 2024-04-04T06:57:20.594 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:20.593+0000 7f92f4c00640 1 -- 172.21.15.72:0/2503337078 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f92e001a070 con 0x7f92f8158390 2024-04-04T06:57:20.595 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:20.594+0000 7f92f4c00640 1 --2- 172.21.15.72:0/2503337078 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f92d406c8f0 0x7f92d406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:20.595 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:20.594+0000 7f92f4c00640 1 -- 172.21.15.72:0/2503337078 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f92e008bcc0 con 0x7f92f8158390 2024-04-04T06:57:20.595 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:20.594+0000 7f92f7e00640 1 --2- 172.21.15.72:0/2503337078 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f92d406c8f0 0x7f92d406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:20.595 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:20.595+0000 7f92f7e00640 1 --2- 172.21.15.72:0/2503337078 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f92d406c8f0 0x7f92d406edb0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f92e8038000 tx=0x7f92e8032000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:20.599 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:20.601+0000 7f92f4c00640 1 -- 172.21.15.72:0/2503337078 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f92e0092080 con 0x7f92f8158390 2024-04-04T06:57:20.906 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:20.908+0000 7f92fec00640 1 -- 172.21.15.72:0/2503337078 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f92f80b3870 con 0x7f92f8158390 2024-04-04T06:57:20.908 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:20.910+0000 7f92f4c00640 1 -- 172.21.15.72:0/2503337078 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16831 (secure 0 0 0) 0x7f92e0059fd0 con 0x7f92f8158390 2024-04-04T06:57:20.909 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T06:57:20.909 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":22,"fsid":"6708bac2-4f50-49b5-87a9-c390fd333eb3","created":"2024-04-04T06:56:04.282498+0000","modified":"2024-04-04T06:57:11.239134+0000","last_up_change":"2024-04-04T06:56:16.716089+0000","last_in_change":"2024-04-04T06:56:07.768593+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-04T06:56:17.421685+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-04T06:56:26.822661+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-04T06:56:27.429816+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7c345991-5af8-4dc6-a481-28610c40e128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":3889813953},{"type":"v1","addr":"172.21.15.72:6818","nonce":3889813953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":3889813953},{"type":"v1","addr":"172.21.15.72:6821","nonce":3889813953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":3889813953},{"type":"v1","addr":"172.21.15.72:6826","nonce":3889813953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":3889813953},{"type":"v1","addr":"172.21.15.72:6823","nonce":3889813953}]},"public_addr":"172.21.15.72:6818/3889813953","cluster_addr":"172.21.15.72:6821/3889813953","heartbeat_back_addr":"172.21.15.72:6826/3889813953","heartbeat_front_addr":"172.21.15.72:6823/3889813953","state":["exists","up"]},{"osd":1,"uuid":"1b3f7ab2-a56c-488d-a89a-1f3572361c95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":3101663154},{"type":"v1","addr":"172.21.15.72:6801","nonce":3101663154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":3101663154},{"type":"v1","addr":"172.21.15.72:6803","nonce":3101663154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":3101663154},{"type":"v1","addr":"172.21.15.72:6807","nonce":3101663154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":3101663154},{"type":"v1","addr":"172.21.15.72:6805","nonce":3101663154}]},"public_addr":"172.21.15.72:6801/3101663154","cluster_addr":"172.21.15.72:6803/3101663154","heartbeat_back_addr":"172.21.15.72:6807/3101663154","heartbeat_front_addr":"172.21.15.72:6805/3101663154","state":["exists","up"]},{"osd":2,"uuid":"fc9aa512-53df-40d7-ba04-3e6b7dcd1e34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":235374192},{"type":"v1","addr":"172.21.15.72:6809","nonce":235374192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":235374192},{"type":"v1","addr":"172.21.15.72:6811","nonce":235374192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":235374192},{"type":"v1","addr":"172.21.15.72:6815","nonce":235374192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":235374192},{"type":"v1","addr":"172.21.15.72:6813","nonce":235374192}]},"public_addr":"172.21.15.72:6809/235374192","cluster_addr":"172.21.15.72:6811/235374192","heartbeat_back_addr":"172.21.15.72:6815/235374192","heartbeat_front_addr":"172.21.15.72:6813/235374192","state":["exists","up"]},{"osd":3,"uuid":"b4f63eed-dc5b-4aba-bb50-de46eb41492b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6817","nonce":2806631742},{"type":"v1","addr":"172.21.15.72:6819","nonce":2806631742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":2806631742},{"type":"v1","addr":"172.21.15.72:6827","nonce":2806631742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":2806631742},{"type":"v1","addr":"172.21.15.72:6831","nonce":2806631742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":2806631742},{"type":"v1","addr":"172.21.15.72:6829","nonce":2806631742}]},"public_addr":"172.21.15.72:6819/2806631742","cluster_addr":"172.21.15.72:6827/2806631742","heartbeat_back_addr":"172.21.15.72:6831/2806631742","heartbeat_front_addr":"172.21.15.72:6829/2806631742","state":["exists","up"]},{"osd":4,"uuid":"9e985ef8-d711-4172-9286-c54e560895d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":4293536423},{"type":"v1","addr":"172.21.15.117:6825","nonce":4293536423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":4293536423},{"type":"v1","addr":"172.21.15.117:6827","nonce":4293536423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":4293536423},{"type":"v1","addr":"172.21.15.117:6831","nonce":4293536423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":4293536423},{"type":"v1","addr":"172.21.15.117:6829","nonce":4293536423}]},"public_addr":"172.21.15.117:6825/4293536423","cluster_addr":"172.21.15.117:6827/4293536423","heartbeat_back_addr":"172.21.15.117:6831/4293536423","heartbeat_front_addr":"172.21.15.117:6829/4293536423","state":["exists","up"]},{"osd":5,"uuid":"3e9f082b-8d7d-455f-8a96-66d0b4857125","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":684971679},{"type":"v1","addr":"172.21.15.117:6801","nonce":684971679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":684971679},{"type":"v1","addr":"172.21.15.117:6803","nonce":684971679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":684971679},{"type":"v1","addr":"172.21.15.117:6807","nonce":684971679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":684971679},{"type":"v1","addr":"172.21.15.117:6805","nonce":684971679}]},"public_addr":"172.21.15.117:6801/684971679","cluster_addr":"172.21.15.117:6803/684971679","heartbeat_back_addr":"172.21.15.117:6807/684971679","heartbeat_front_addr":"172.21.15.117:6805/684971679","state":["exists","up"]},{"osd":6,"uuid":"bcdafa9f-a870-4398-a38d-ab7697676473","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":2781186528},{"type":"v1","addr":"172.21.15.117:6809","nonce":2781186528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":2781186528},{"type":"v1","addr":"172.21.15.117:6811","nonce":2781186528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":2781186528},{"type":"v1","addr":"172.21.15.117:6815","nonce":2781186528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":2781186528},{"type":"v1","addr":"172.21.15.117:6813","nonce":2781186528}]},"public_addr":"172.21.15.117:6809/2781186528","cluster_addr":"172.21.15.117:6811/2781186528","heartbeat_back_addr":"172.21.15.117:6815/2781186528","heartbeat_front_addr":"172.21.15.117:6813/2781186528","state":["exists","up"]},{"osd":7,"uuid":"b68ec562-ff35-4d2d-a733-c896f8920cfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":617469882},{"type":"v1","addr":"172.21.15.117:6817","nonce":617469882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":617469882},{"type":"v1","addr":"172.21.15.117:6819","nonce":617469882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":617469882},{"type":"v1","addr":"172.21.15.117:6823","nonce":617469882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":617469882},{"type":"v1","addr":"172.21.15.117:6821","nonce":617469882}]},"public_addr":"172.21.15.117:6817/617469882","cluster_addr":"172.21.15.117:6819/617469882","heartbeat_back_addr":"172.21.15.117:6823/617469882","heartbeat_front_addr":"172.21.15.117:6821/617469882","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.347700+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.296619+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.361345+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.093323+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:12.857605+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:12.816090+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.083163+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.121639+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.13","mappings":[{"from":7,"to":1}]},{"pgid":"3.19","mappings":[{"from":3,"to":2}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.28","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-04T06:57:20.912 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:20.913+0000 7f92fec00640 1 -- 172.21.15.72:0/2503337078 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f92d406c8f0 msgr2=0x7f92d406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:20.913 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:20.913+0000 7f92fec00640 1 --2- 172.21.15.72:0/2503337078 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f92d406c8f0 0x7f92d406edb0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f92e8038000 tx=0x7f92e8032000 comp rx=0 tx=0).stop 2024-04-04T06:57:20.913 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:20.913+0000 7f92fec00640 1 -- 172.21.15.72:0/2503337078 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f92f8158390 msgr2=0x7f92f81576d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:20.913 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:20.913+0000 7f92fec00640 1 --2- 172.21.15.72:0/2503337078 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f92f8158390 0x7f92f81576d0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f92e000e930 tx=0x7f92e000edf0 comp rx=0 tx=0).stop 2024-04-04T06:57:20.913 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:20.914+0000 7f92fec00640 1 -- 172.21.15.72:0/2503337078 shutdown_connections 2024-04-04T06:57:20.913 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:20.914+0000 7f92fec00640 1 --2- 172.21.15.72:0/2503337078 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f92d406c8f0 0x7f92d406edb0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:20.913 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:20.914+0000 7f92fec00640 1 --2- 172.21.15.72:0/2503337078 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f92f8158770 0x7f92f806eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:20.913 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:20.914+0000 7f92fec00640 1 --2- 172.21.15.72:0/2503337078 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f92f8158390 0x7f92f81576d0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:20.913 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:20.914+0000 7f92fec00640 1 --2- 172.21.15.72:0/2503337078 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f92f80b4730 0x7f92f8071510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:20.913 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:20.914+0000 7f92fec00640 1 -- 172.21.15.72:0/2503337078 >> 172.21.15.72:0/2503337078 conn(0x7f92f806b470 msgr2=0x7f92f80cb050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:20.913 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:20.914+0000 7f92fec00640 1 -- 172.21.15.72:0/2503337078 shutdown_connections 2024-04-04T06:57:20.913 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:20.914+0000 7f92fec00640 1 -- 172.21.15.72:0/2503337078 wait complete. 2024-04-04T06:57:20.938 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-04T06:56:17.421685+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-04T06:56:26.822661+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-04T06:56:27.429816+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-04T06:57:20.939 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-04T06:57:21.144 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:21.145+0000 7f59d0a00640 1 Processor -- start 2024-04-04T06:57:21.144 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:21.145+0000 7f59d0a00640 1 -- start start 2024-04-04T06:57:21.146 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:21.146+0000 7f59d0a00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f59cc145b10 0x7f59cc06d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:21.146 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:21.146+0000 7f59d0a00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f59cc0d0110 0x7f59cc071430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:21.146 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:21.146+0000 7f59d0a00640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59cc145ef0 con 0x7f59cc06dac0 2024-04-04T06:57:21.146 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:21.147+0000 7f59d0a00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f59cc0cea10 con 0x7f59cc145b10 2024-04-04T06:57:21.146 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:21.147+0000 7f59d0a00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f59cc06e310 con 0x7f59cc0d0110 2024-04-04T06:57:21.146 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:21.147+0000 7f59c9400640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f59cc06dac0 0x7f59cc0cfa00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:40122/0 (socket says 172.21.15.72:40122) 2024-04-04T06:57:21.146 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:21.147+0000 7f59c9400640 1 -- 172.21.15.72:0/1207284173 learned_addr learned my addr 172.21.15.72:0/1207284173 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-04-04T06:57:21.146 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:21.147+0000 7f59c9e00640 1 --2- 172.21.15.72:0/1207284173 >> v2:172.21.15.117:3300/0 conn(0x7f59cc145b10 0x7f59cc06d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:21.146 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:21.147+0000 7f59ca800640 1 --2- 172.21.15.72:0/1207284173 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f59cc0d0110 0x7f59cc071430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:21.147 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:21.147+0000 7f59c8a00640 1 -- 172.21.15.72:0/1207284173 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2146752302 0 0) 0x7f59cc145ef0 con 0x7f59cc06dac0 2024-04-04T06:57:21.147 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:21.148+0000 7f59c8a00640 1 -- 172.21.15.72:0/1207284173 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f59b0003520 con 0x7f59cc06dac0 2024-04-04T06:57:21.147 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:21.148+0000 7f59c8a00640 1 -- 172.21.15.72:0/1207284173 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 397886933 0 0) 0x7f59b0003520 con 0x7f59cc06dac0 2024-04-04T06:57:21.147 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:21.148+0000 7f59c9e00640 1 -- 172.21.15.72:0/1207284173 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f59cc0d0110 msgr2=0x7f59cc071430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:57:21.147 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:21.148+0000 7f59c9e00640 1 --2- 172.21.15.72:0/1207284173 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f59cc0d0110 0x7f59cc071430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:21.147 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:21.148+0000 7f59c9e00640 1 -- 172.21.15.72:0/1207284173 >> v1:172.21.15.72:6789/0 conn(0x7f59cc06dac0 legacy=0x7f59cc0cfa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:21.147 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:21.148+0000 7f59c9e00640 1 -- 172.21.15.72:0/1207284173 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59cc0cec40 con 0x7f59cc145b10 2024-04-04T06:57:21.148 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:21.149+0000 7f59c9e00640 1 --2- 172.21.15.72:0/1207284173 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f59cc145b10 0x7f59cc06d580 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f59cc06e490 tx=0x7f59bc02b6f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e50c90b523b23067 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:21.148 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:21.150+0000 7f59c8a00640 1 -- 172.21.15.72:0/1207284173 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59bc037070 con 0x7f59cc145b10 2024-04-04T06:57:21.148 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:21.150+0000 7f59c8a00640 1 -- 172.21.15.72:0/1207284173 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59bc030510 con 0x7f59cc145b10 2024-04-04T06:57:21.148 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:21.150+0000 7f59c8a00640 1 -- 172.21.15.72:0/1207284173 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59b8001670 con 0x7f59cc145b10 2024-04-04T06:57:21.149 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:21.150+0000 7f59d0a00640 1 -- 172.21.15.72:0/1207284173 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f59cc145b10 msgr2=0x7f59cc06d580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:21.149 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:21.150+0000 7f59d0a00640 1 --2- 172.21.15.72:0/1207284173 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f59cc145b10 0x7f59cc06d580 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f59cc06e490 tx=0x7f59bc02b6f0 comp rx=0 tx=0).stop 2024-04-04T06:57:21.149 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:21.150+0000 7f59d0a00640 1 -- 172.21.15.72:0/1207284173 shutdown_connections 2024-04-04T06:57:21.150 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:21.151+0000 7f59d0a00640 1 --2- 172.21.15.72:0/1207284173 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f59cc0d0110 0x7f59cc071430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:21.150 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:21.151+0000 7f59d0a00640 1 --2- 172.21.15.72:0/1207284173 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f59cc145b10 0x7f59cc06d580 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:21.150 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:21.151+0000 7f59d0a00640 1 -- 172.21.15.72:0/1207284173 >> 172.21.15.72:0/1207284173 conn(0x7f59cc06b470 msgr2=0x7f59cc06b850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:21.150 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:21.151+0000 7f59d0a00640 1 -- 172.21.15.72:0/1207284173 shutdown_connections 2024-04-04T06:57:21.150 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:21.151+0000 7f59d0a00640 1 -- 172.21.15.72:0/1207284173 wait complete. 2024-04-04T06:57:21.152 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:21.153+0000 7f59d0a00640 1 Processor -- start 2024-04-04T06:57:21.152 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:21.153+0000 7f59d0a00640 1 -- start start 2024-04-04T06:57:21.154 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:21.155+0000 7f59d0a00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f59cc06dac0 0x7f59cc13afb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:21.154 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:21.155+0000 7f59d0a00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f59cc0d0110 0x7f59cc1405b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:21.154 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:21.155+0000 7f59d0a00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f59cc145b10 0x7f59cc140af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:21.155 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:21.155+0000 7f59d0a00640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f59cc0cf4e0 con 0x7f59cc06dac0 2024-04-04T06:57:21.155 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:21.155+0000 7f59d0a00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f59cc0cf200 con 0x7f59cc0d0110 2024-04-04T06:57:21.155 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:21.155+0000 7f59d0a00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f59cc06df70 con 0x7f59cc145b10 2024-04-04T06:57:21.155 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:21.155+0000 7f59c9e00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f59cc06dac0 0x7f59cc13afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:21.155 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:21.155+0000 7f59c9e00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f59cc06dac0 0x7f59cc13afb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:37214/0 (socket says 172.21.15.72:37214) 2024-04-04T06:57:21.155 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:21.155+0000 7f59c9e00640 1 -- 172.21.15.72:0/1192091591 learned_addr learned my addr 172.21.15.72:0/1192091591 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:57:21.155 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:21.156+0000 7f59c9400640 1 --2- 172.21.15.72:0/1192091591 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f59cc0d0110 0x7f59cc1405b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:21.155 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:21.156+0000 7f59c9e00640 1 -- 172.21.15.72:0/1192091591 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f59cc145b10 msgr2=0x7f59cc140af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:21.155 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:21.156+0000 7f59c9e00640 1 --2- 172.21.15.72:0/1192091591 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f59cc145b10 0x7f59cc140af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:21.156 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:21.156+0000 7f59c9e00640 1 -- 172.21.15.72:0/1192091591 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f59cc0d0110 msgr2=0x7f59cc1405b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:21.156 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:21.156+0000 7f59c9e00640 1 --2- 172.21.15.72:0/1192091591 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f59cc0d0110 0x7f59cc1405b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:21.156 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:21.156+0000 7f59c9e00640 1 -- 172.21.15.72:0/1192091591 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59cc13b4f0 con 0x7f59cc06dac0 2024-04-04T06:57:21.156 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:21.156+0000 7f59c9400640 1 --2- 172.21.15.72:0/1192091591 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f59cc0d0110 0x7f59cc1405b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-04T06:57:21.157 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:21.156+0000 7f59c9e00640 1 --2- 172.21.15.72:0/1192091591 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f59cc06dac0 0x7f59cc13afb0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f59bc035040 tx=0x7f59bc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:21.157 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:21.156+0000 7f59c2000640 1 -- 172.21.15.72:0/1192091591 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59bc040020 con 0x7f59cc06dac0 2024-04-04T06:57:21.157 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:21.156+0000 7f59c2000640 1 -- 172.21.15.72:0/1192091591 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59bc038040 con 0x7f59cc06dac0 2024-04-04T06:57:21.157 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:21.156+0000 7f59c2000640 1 -- 172.21.15.72:0/1192091591 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59bc037070 con 0x7f59cc06dac0 2024-04-04T06:57:21.157 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:21.156+0000 7f59d0a00640 1 -- 172.21.15.72:0/1192091591 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59cc141350 con 0x7f59cc06dac0 2024-04-04T06:57:21.157 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:21.157+0000 7f59d0a00640 1 -- 172.21.15.72:0/1192091591 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59cc141910 con 0x7f59cc06dac0 2024-04-04T06:57:21.157 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:21.158+0000 7f59d0a00640 1 -- 172.21.15.72:0/1192091591 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59cc075730 con 0x7f59cc06dac0 2024-04-04T06:57:21.158 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:21.160+0000 7f59c2000640 1 -- 172.21.15.72:0/1192091591 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f59bc043020 con 0x7f59cc06dac0 2024-04-04T06:57:21.159 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:21.161+0000 7f59c2000640 1 --2- 172.21.15.72:0/1192091591 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f59ac06c8f0 0x7f59ac06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:21.159 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:21.161+0000 7f59c2000640 1 -- 172.21.15.72:0/1192091591 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f59bc0acfe0 con 0x7f59cc06dac0 2024-04-04T06:57:21.160 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:21.161+0000 7f59c9400640 1 --2- 172.21.15.72:0/1192091591 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f59ac06c8f0 0x7f59ac06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:21.160 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:21.162+0000 7f59c9400640 1 --2- 172.21.15.72:0/1192091591 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f59ac06c8f0 0x7f59ac06edb0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f59b8001380 tx=0x7f59b8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:21.164 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:21.165+0000 7f59c2000640 1 -- 172.21.15.72:0/1192091591 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f59bc04a030 con 0x7f59cc06dac0 2024-04-04T06:57:21.364 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:21.366+0000 7f59d0a00640 1 -- 172.21.15.72:0/1192091591 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f59cc0d0c00 con 0x7f59cc06dac0 2024-04-04T06:57:21.365 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:21.366+0000 7f59c2000640 1 -- 172.21.15.72:0/1192091591 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) ==== 93+0+10 (secure 0 0 0) 0x7f59bc07b400 con 0x7f59cc06dac0 2024-04-04T06:57:21.365 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 1 2024-04-04T06:57:21.368 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:21.369+0000 7f59d0a00640 1 -- 172.21.15.72:0/1192091591 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f59ac06c8f0 msgr2=0x7f59ac06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:21.368 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:21.369+0000 7f59d0a00640 1 --2- 172.21.15.72:0/1192091591 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f59ac06c8f0 0x7f59ac06edb0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f59b8001380 tx=0x7f59b8009040 comp rx=0 tx=0).stop 2024-04-04T06:57:21.368 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:21.369+0000 7f59d0a00640 1 -- 172.21.15.72:0/1192091591 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f59cc06dac0 msgr2=0x7f59cc13afb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:21.368 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:21.369+0000 7f59d0a00640 1 --2- 172.21.15.72:0/1192091591 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f59cc06dac0 0x7f59cc13afb0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f59bc035040 tx=0x7f59bc0046c0 comp rx=0 tx=0).stop 2024-04-04T06:57:21.368 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:21.369+0000 7f59d0a00640 1 -- 172.21.15.72:0/1192091591 shutdown_connections 2024-04-04T06:57:21.368 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:21.369+0000 7f59d0a00640 1 --2- 172.21.15.72:0/1192091591 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f59ac06c8f0 0x7f59ac06edb0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:21.368 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:21.369+0000 7f59d0a00640 1 --2- 172.21.15.72:0/1192091591 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f59cc145b10 0x7f59cc140af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:21.368 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:21.369+0000 7f59d0a00640 1 --2- 172.21.15.72:0/1192091591 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f59cc0d0110 0x7f59cc1405b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:21.368 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:21.369+0000 7f59d0a00640 1 --2- 172.21.15.72:0/1192091591 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f59cc06dac0 0x7f59cc13afb0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:21.368 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:21.369+0000 7f59d0a00640 1 -- 172.21.15.72:0/1192091591 >> 172.21.15.72:0/1192091591 conn(0x7f59cc06b470 msgr2=0x7f59cc0aee00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:21.368 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:21.369+0000 7f59d0a00640 1 -- 172.21.15.72:0/1192091591 shutdown_connections 2024-04-04T06:57:21.368 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:21.369+0000 7f59d0a00640 1 -- 172.21.15.72:0/1192091591 wait complete. 2024-04-04T06:57:21.384 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-04T06:57:21.585 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:21.586+0000 7f7caaa00640 1 Processor -- start 2024-04-04T06:57:21.585 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:21.587+0000 7f7caaa00640 1 -- start start 2024-04-04T06:57:21.588 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:21.589+0000 7f7caaa00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7ca415e6c0 0x7f7ca40b6390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:21.588 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:21.589+0000 7f7caaa00640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ca40d3100 con 0x7f7ca40b68d0 2024-04-04T06:57:21.588 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:21.589+0000 7f7caaa00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ca40d33e0 con 0x7f7ca40d2b20 2024-04-04T06:57:21.588 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:21.589+0000 7f7caaa00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f7ca40b6d30 con 0x7f7ca415e6c0 2024-04-04T06:57:21.588 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:21.590+0000 7f7c9b400640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f7ca40b68d0 0x7f7ca40d2410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:40132/0 (socket says 172.21.15.72:40132) 2024-04-04T06:57:21.588 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:21.590+0000 7f7c9b400640 1 -- 172.21.15.72:0/2455945933 learned_addr learned my addr 172.21.15.72:0/2455945933 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-04-04T06:57:21.590 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:21.590+0000 7f7ca3e00640 1 --2- 172.21.15.72:0/2455945933 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7ca415e6c0 0x7f7ca40b6390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:21.590 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:21.590+0000 7f7ca3400640 1 -- 172.21.15.72:0/2455945933 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3906570183 0 0) 0x7f7ca40d3100 con 0x7f7ca40b68d0 2024-04-04T06:57:21.590 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:21.590+0000 7f7ca3400640 1 -- 172.21.15.72:0/2455945933 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7c88003520 con 0x7f7ca40b68d0 2024-04-04T06:57:21.591 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:21.590+0000 7f7ca3400640 1 -- 172.21.15.72:0/2455945933 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4230586696 0 0) 0x7f7c88003520 con 0x7f7ca40b68d0 2024-04-04T06:57:21.591 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:21.590+0000 7f7ca3400640 1 -- 172.21.15.72:0/2455945933 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7ca415e6c0 msgr2=0x7f7ca40b6390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:57:21.591 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:21.591+0000 7f7ca3400640 1 --2- 172.21.15.72:0/2455945933 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7ca415e6c0 0x7f7ca40b6390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:21.591 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:21.591+0000 7f7ca3400640 1 -- 172.21.15.72:0/2455945933 >> v1:172.21.15.117:6789/0 conn(0x7f7ca40d2b20 legacy=0x7f7ca40b7520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:57:21.591 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:21.591+0000 7f7ca3400640 1 -- 172.21.15.72:0/2455945933 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ca40d36c0 con 0x7f7ca40b68d0 2024-04-04T06:57:21.591 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:21.591+0000 7f7ca3400640 1 -- 172.21.15.72:0/2455945933 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2465650867 0 0) 0x7f7c8c0019f0 con 0x7f7ca40b68d0 2024-04-04T06:57:21.591 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:21.591+0000 7f7ca3400640 1 -- 172.21.15.72:0/2455945933 >> v1:172.21.15.72:6789/0 conn(0x7f7ca40b68d0 legacy=0x7f7ca40d2410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:21.591 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:21.591+0000 7f7ca3400640 1 --2- 172.21.15.72:0/2455945933 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7c880039e0 0x7f7c88003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:21.591 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:21.591+0000 7f7ca3400640 1 --2- 172.21.15.72:0/2455945933 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7c88004800 0x7f7c88004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:21.591 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:21.591+0000 7f7ca3400640 1 --2- 172.21.15.72:0/2455945933 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7c880051c0 0x7f7c8800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:21.591 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:21.591+0000 7f7ca3400640 1 -- 172.21.15.72:0/2455945933 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f7c8800bfb0 con 0x7f7c880051c0 2024-04-04T06:57:21.591 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:21.591+0000 7f7ca3400640 1 -- 172.21.15.72:0/2455945933 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f7c8800c160 con 0x7f7c88004800 2024-04-04T06:57:21.591 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:21.591+0000 7f7ca3400640 1 -- 172.21.15.72:0/2455945933 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f7c8800c360 con 0x7f7c880039e0 2024-04-04T06:57:21.591 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:21.591+0000 7f7ca8a00640 1 --2- 172.21.15.72:0/2455945933 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7c880051c0 0x7f7c8800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:21.592 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:21.591+0000 7f7ca3e00640 1 --2- 172.21.15.72:0/2455945933 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7c880039e0 0x7f7c88003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:21.592 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:21.591+0000 7f7c9b400640 1 --2- 172.21.15.72:0/2455945933 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7c88004800 0x7f7c88004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:21.592 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:21.591+0000 7f7ca8a00640 1 -- 172.21.15.72:0/2455945933 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7c880039e0 msgr2=0x7f7c88003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:57:21.592 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:21.591+0000 7f7ca8a00640 1 --2- 172.21.15.72:0/2455945933 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7c880039e0 0x7f7c88003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:21.592 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:21.591+0000 7f7ca8a00640 1 -- 172.21.15.72:0/2455945933 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7c88004800 msgr2=0x7f7c88004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:57:21.592 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:21.591+0000 7f7ca8a00640 1 --2- 172.21.15.72:0/2455945933 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7c88004800 0x7f7c88004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:21.592 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:21.591+0000 7f7ca8a00640 1 -- 172.21.15.72:0/2455945933 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c88003520 con 0x7f7c880051c0 2024-04-04T06:57:21.592 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:21.592+0000 7f7c9b400640 1 --2- 172.21.15.72:0/2455945933 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7c88004800 0x7f7c88004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-04T06:57:21.593 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:21.592+0000 7f7ca8a00640 1 --2- 172.21.15.72:0/2455945933 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7c880051c0 0x7f7c8800b9c0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f7c9c003db0 tx=0x7f7c88005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f82d157ecf0dd00 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:21.593 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:21.593+0000 7f7ca3400640 1 -- 172.21.15.72:0/2455945933 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c9c037070 con 0x7f7c880051c0 2024-04-04T06:57:21.593 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:21.593+0000 7f7ca3400640 1 -- 172.21.15.72:0/2455945933 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c9c032600 con 0x7f7c880051c0 2024-04-04T06:57:21.594 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:21.593+0000 7f7ca3400640 1 -- 172.21.15.72:0/2455945933 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c9c003980 con 0x7f7c880051c0 2024-04-04T06:57:21.594 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:21.593+0000 7f7caaa00640 1 -- 172.21.15.72:0/2455945933 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7c880051c0 msgr2=0x7f7c8800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:21.594 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:21.593+0000 7f7caaa00640 1 --2- 172.21.15.72:0/2455945933 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7c880051c0 0x7f7c8800b9c0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f7c9c003db0 tx=0x7f7c88005830 comp rx=0 tx=0).stop 2024-04-04T06:57:21.594 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:21.593+0000 7f7ca8a00640 1 -- 172.21.15.72:0/2455945933 reap_dead start 2024-04-04T06:57:21.594 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:21.593+0000 7f7caaa00640 1 -- 172.21.15.72:0/2455945933 shutdown_connections 2024-04-04T06:57:21.594 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:21.593+0000 7f7caaa00640 1 -- 172.21.15.72:0/2455945933 >> 172.21.15.72:0/2455945933 conn(0x7f7ca4071e80 msgr2=0x7f7ca4072290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:21.594 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:21.594+0000 7f7caaa00640 1 -- 172.21.15.72:0/2455945933 shutdown_connections 2024-04-04T06:57:21.594 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:21.594+0000 7f7caaa00640 1 -- 172.21.15.72:0/2455945933 wait complete. 2024-04-04T06:57:21.596 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:21.595+0000 7f7caaa00640 1 Processor -- start 2024-04-04T06:57:21.596 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:21.595+0000 7f7caaa00640 1 -- start start 2024-04-04T06:57:21.596 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:21.596+0000 7f7caaa00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7c880051c0 0x7f7ca40c97d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:21.596 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:21.596+0000 7f7caaa00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7ca40b7520 0x7f7ca415ec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:21.597 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:21.596+0000 7f7caaa00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7ca40b79a0 0x7f7ca415f160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:21.597 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:21.596+0000 7f7caaa00640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f7ca40d3c80 con 0x7f7ca40b79a0 2024-04-04T06:57:21.597 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:21.596+0000 7f7caaa00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f7ca415eaa0 con 0x7f7c880051c0 2024-04-04T06:57:21.597 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:21.596+0000 7f7caaa00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f7ca40b6390 con 0x7f7ca40b7520 2024-04-04T06:57:21.597 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:21.597+0000 7f7ca8a00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7ca40b79a0 0x7f7ca415f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:21.597 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:21.597+0000 7f7ca8a00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7ca40b79a0 0x7f7ca415f160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:37224/0 (socket says 172.21.15.72:37224) 2024-04-04T06:57:21.597 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:21.597+0000 7f7ca8a00640 1 -- 172.21.15.72:0/1045472026 learned_addr learned my addr 172.21.15.72:0/1045472026 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:57:21.597 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:21.597+0000 7f7c9b400640 1 --2- 172.21.15.72:0/1045472026 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7ca40b7520 0x7f7ca415ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:21.597 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:21.597+0000 7f7ca8a00640 1 -- 172.21.15.72:0/1045472026 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7ca40b7520 msgr2=0x7f7ca415ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:21.597 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:21.597+0000 7f7ca8a00640 1 --2- 172.21.15.72:0/1045472026 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7ca40b7520 0x7f7ca415ec20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:21.597 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:21.597+0000 7f7ca8a00640 1 -- 172.21.15.72:0/1045472026 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7c880051c0 msgr2=0x7f7ca40c97d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:21.597 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:21.597+0000 7f7ca3e00640 1 --2- 172.21.15.72:0/1045472026 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7c880051c0 0x7f7ca40c97d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:21.597 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:21.597+0000 7f7ca8a00640 1 --2- 172.21.15.72:0/1045472026 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7c880051c0 0x7f7ca40c97d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:21.598 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:21.597+0000 7f7ca8a00640 1 -- 172.21.15.72:0/1045472026 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ca40b7f70 con 0x7f7ca40b79a0 2024-04-04T06:57:21.598 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:21.597+0000 7f7ca8a00640 1 --2- 172.21.15.72:0/1045472026 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7ca40b79a0 0x7f7ca415f160 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f7c9c003db0 tx=0x7f7c9c0036f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:21.598 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:21.598+0000 7f7ca0c00640 1 -- 172.21.15.72:0/1045472026 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c9c037070 con 0x7f7ca40b79a0 2024-04-04T06:57:21.598 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:21.598+0000 7f7ca0c00640 1 -- 172.21.15.72:0/1045472026 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c9c038040 con 0x7f7ca40b79a0 2024-04-04T06:57:21.598 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:21.598+0000 7f7caaa00640 1 -- 172.21.15.72:0/1045472026 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ca40b8250 con 0x7f7ca40b79a0 2024-04-04T06:57:21.598 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:21.598+0000 7f7ca0c00640 1 -- 172.21.15.72:0/1045472026 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c9c003980 con 0x7f7ca40b79a0 2024-04-04T06:57:21.598 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:21.598+0000 7f7caaa00640 1 -- 172.21.15.72:0/1045472026 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ca40b8810 con 0x7f7ca40b79a0 2024-04-04T06:57:21.598 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:21.599+0000 7f7caaa00640 1 -- 172.21.15.72:0/1045472026 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ca4075730 con 0x7f7ca40b79a0 2024-04-04T06:57:21.598 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:21.600+0000 7f7ca0c00640 1 -- 172.21.15.72:0/1045472026 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7c9c031a80 con 0x7f7ca40b79a0 2024-04-04T06:57:21.600 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:21.601+0000 7f7ca0c00640 1 --2- 172.21.15.72:0/1045472026 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f7c8006c8f0 0x7f7c8006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:21.600 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:21.601+0000 7f7ca0c00640 1 -- 172.21.15.72:0/1045472026 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f7c9c0ad460 con 0x7f7ca40b79a0 2024-04-04T06:57:21.600 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:21.602+0000 7f7ca3e00640 1 --2- 172.21.15.72:0/1045472026 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f7c8006c8f0 0x7f7c8006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:21.601 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:21.602+0000 7f7ca3e00640 1 --2- 172.21.15.72:0/1045472026 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f7c8006c8f0 0x7f7c8006edb0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f7ca40d5320 tx=0x7f7c94008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:21.604 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:21.606+0000 7f7ca0c00640 1 -- 172.21.15.72:0/1045472026 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f7c9c07b280 con 0x7f7ca40b79a0 2024-04-04T06:57:21.803 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:21.804+0000 7f7caaa00640 1 -- 172.21.15.72:0/1045472026 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f7ca40b45c0 con 0x7f7ca40b79a0 2024-04-04T06:57:21.803 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:21.805+0000 7f7ca0c00640 1 -- 172.21.15.72:0/1045472026 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) ==== 104+0+11 (secure 0 0 0) 0x7f7c9c07f580 con 0x7f7ca40b79a0 2024-04-04T06:57:21.804 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2024-04-04T06:57:21.807 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:21.808+0000 7f7caaa00640 1 -- 172.21.15.72:0/1045472026 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f7c8006c8f0 msgr2=0x7f7c8006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:21.807 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:21.808+0000 7f7caaa00640 1 --2- 172.21.15.72:0/1045472026 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f7c8006c8f0 0x7f7c8006edb0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f7ca40d5320 tx=0x7f7c94008040 comp rx=0 tx=0).stop 2024-04-04T06:57:21.807 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:21.808+0000 7f7caaa00640 1 -- 172.21.15.72:0/1045472026 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7ca40b79a0 msgr2=0x7f7ca415f160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:21.807 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:21.808+0000 7f7caaa00640 1 --2- 172.21.15.72:0/1045472026 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7ca40b79a0 0x7f7ca415f160 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f7c9c003db0 tx=0x7f7c9c0036f0 comp rx=0 tx=0).stop 2024-04-04T06:57:21.807 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:21.808+0000 7f7caaa00640 1 -- 172.21.15.72:0/1045472026 shutdown_connections 2024-04-04T06:57:21.807 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:21.808+0000 7f7caaa00640 1 --2- 172.21.15.72:0/1045472026 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f7c8006c8f0 0x7f7c8006edb0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:21.807 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:21.808+0000 7f7caaa00640 1 --2- 172.21.15.72:0/1045472026 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7ca40b79a0 0x7f7ca415f160 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:21.807 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:21.808+0000 7f7caaa00640 1 --2- 172.21.15.72:0/1045472026 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7ca40b7520 0x7f7ca415ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:21.807 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:21.808+0000 7f7caaa00640 1 --2- 172.21.15.72:0/1045472026 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7c880051c0 0x7f7ca40c97d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:21.807 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:21.808+0000 7f7caaa00640 1 -- 172.21.15.72:0/1045472026 >> 172.21.15.72:0/1045472026 conn(0x7f7ca4071e80 msgr2=0x7f7ca40d48a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:21.807 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:21.808+0000 7f7caaa00640 1 -- 172.21.15.72:0/1045472026 shutdown_connections 2024-04-04T06:57:21.808 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:21.808+0000 7f7caaa00640 1 -- 172.21.15.72:0/1045472026 wait complete. 2024-04-04T06:57:21.826 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-04T06:57:22.022 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:22.023+0000 7fbd2d200640 1 Processor -- start 2024-04-04T06:57:22.022 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:22.023+0000 7fbd2d200640 1 -- start start 2024-04-04T06:57:22.023 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:22.025+0000 7fbd2d200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbd2815e370 0x7fbd2815f330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:22.023 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:22.025+0000 7fbd2d200640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fbd280d1770 0x7fbd280b2b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:22.023 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:22.025+0000 7fbd2d200640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd2815f870 con 0x7fbd280d4b40 2024-04-04T06:57:22.023 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:22.025+0000 7fbd2d200640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fbd280ce930 con 0x7fbd280d1770 2024-04-04T06:57:22.024 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:22.025+0000 7fbd2d200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fbd280d31a0 con 0x7fbd2815e370 2024-04-04T06:57:22.024 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:22.026+0000 7fbd27400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbd2815e370 0x7fbd2815f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:22.024 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:22.026+0000 7fbd1fe00640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7fbd280d4b40 0x7fbd280d1060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.72:52788/0 (socket says 172.21.15.72:52788) 2024-04-04T06:57:22.024 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:22.026+0000 7fbd1fe00640 1 -- 172.21.15.72:0/130005741 learned_addr learned my addr 172.21.15.72:0/130005741 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-04-04T06:57:22.024 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:22.026+0000 7fbd27400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbd2815e370 0x7fbd2815f330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.72:47902/0 (socket says 172.21.15.72:47902) 2024-04-04T06:57:22.024 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:22.026+0000 7fbd27e00640 1 --2- 172.21.15.72:0/130005741 >> v2:172.21.15.117:3300/0 conn(0x7fbd280d1770 0x7fbd280b2b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:22.025 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:22.026+0000 7fbd26a00640 1 -- 172.21.15.72:0/130005741 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 897979615 0 0) 0x7fbd2815f870 con 0x7fbd280d4b40 2024-04-04T06:57:22.025 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:22.026+0000 7fbd26a00640 1 -- 172.21.15.72:0/130005741 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbd0c003520 con 0x7fbd280d4b40 2024-04-04T06:57:22.025 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:22.026+0000 7fbd27400640 1 -- 172.21.15.72:0/130005741 >> v2:172.21.15.117:3300/0 conn(0x7fbd280d1770 msgr2=0x7fbd280b2b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:57:22.025 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:22.026+0000 7fbd27400640 1 --2- 172.21.15.72:0/130005741 >> v2:172.21.15.117:3300/0 conn(0x7fbd280d1770 0x7fbd280b2b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:22.025 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:22.026+0000 7fbd27400640 1 -- 172.21.15.72:0/130005741 >> v1:172.21.15.117:6789/0 conn(0x7fbd280d4b40 legacy=0x7fbd280d1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:22.025 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:22.027+0000 7fbd27400640 1 -- 172.21.15.72:0/130005741 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd280ceb80 con 0x7fbd2815e370 2024-04-04T06:57:22.027 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:22.028+0000 7fbd27400640 1 --2- 172.21.15.72:0/130005741 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbd2815e370 0x7fbd2815f330 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fbd180097a0 tx=0x7fbd1802b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fcb71d7741068067 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:22.027 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:22.029+0000 7fbd26a00640 1 -- 172.21.15.72:0/130005741 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd18035020 con 0x7fbd2815e370 2024-04-04T06:57:22.027 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:22.029+0000 7fbd26a00640 1 -- 172.21.15.72:0/130005741 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd18031830 con 0x7fbd2815e370 2024-04-04T06:57:22.027 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:22.029+0000 7fbd26a00640 1 -- 172.21.15.72:0/130005741 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd18031c00 con 0x7fbd2815e370 2024-04-04T06:57:22.028 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:22.029+0000 7fbd2d200640 1 -- 172.21.15.72:0/130005741 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbd2815e370 msgr2=0x7fbd2815f330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:22.028 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:22.029+0000 7fbd2d200640 1 --2- 172.21.15.72:0/130005741 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbd2815e370 0x7fbd2815f330 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fbd180097a0 tx=0x7fbd1802b8d0 comp rx=0 tx=0).stop 2024-04-04T06:57:22.028 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:22.029+0000 7fbd2d200640 1 -- 172.21.15.72:0/130005741 shutdown_connections 2024-04-04T06:57:22.028 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:22.029+0000 7fbd2d200640 1 --2- 172.21.15.72:0/130005741 >> v2:172.21.15.117:3300/0 conn(0x7fbd280d1770 0x7fbd280b2b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:22.028 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:22.029+0000 7fbd2d200640 1 --2- 172.21.15.72:0/130005741 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbd2815e370 0x7fbd2815f330 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:22.028 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:22.029+0000 7fbd2d200640 1 -- 172.21.15.72:0/130005741 >> 172.21.15.72:0/130005741 conn(0x7fbd2806b890 msgr2=0x7fbd2806bca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:22.029 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:22.029+0000 7fbd2d200640 1 -- 172.21.15.72:0/130005741 shutdown_connections 2024-04-04T06:57:22.029 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:22.030+0000 7fbd2d200640 1 -- 172.21.15.72:0/130005741 wait complete. 2024-04-04T06:57:22.030 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:22.031+0000 7fbd2d200640 1 Processor -- start 2024-04-04T06:57:22.030 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:22.031+0000 7fbd2d200640 1 -- start start 2024-04-04T06:57:22.031 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:22.032+0000 7fbd2d200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbd280d1770 0x7fbd28161d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:22.031 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:22.032+0000 7fbd2d200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbd280d4b40 0x7fbd280cd790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:22.031 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:22.032+0000 7fbd2d200640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbd2815e370 0x7fbd281510a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:22.031 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:22.032+0000 7fbd2d200640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fbd280cf420 con 0x7fbd2815e370 2024-04-04T06:57:22.031 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:22.032+0000 7fbd2d200640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fbd280cf140 con 0x7fbd280d1770 2024-04-04T06:57:22.031 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:22.032+0000 7fbd2d200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fbd280cf940 con 0x7fbd280d4b40 2024-04-04T06:57:22.031 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:22.032+0000 7fbd27e00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbd2815e370 0x7fbd281510a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:22.031 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:22.033+0000 7fbd27e00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbd2815e370 0x7fbd281510a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:37240/0 (socket says 172.21.15.72:37240) 2024-04-04T06:57:22.032 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:22.033+0000 7fbd27e00640 1 -- 172.21.15.72:0/2656511436 learned_addr learned my addr 172.21.15.72:0/2656511436 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:57:22.033 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:22.033+0000 7fbd1fe00640 1 --2- 172.21.15.72:0/2656511436 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbd280d4b40 0x7fbd280cd790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:22.033 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:22.033+0000 7fbd27400640 1 --2- 172.21.15.72:0/2656511436 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbd280d1770 0x7fbd28161d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:22.033 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:22.033+0000 7fbd27e00640 1 -- 172.21.15.72:0/2656511436 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbd280d4b40 msgr2=0x7fbd280cd790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:22.033 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:22.033+0000 7fbd27e00640 1 --2- 172.21.15.72:0/2656511436 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbd280d4b40 0x7fbd280cd790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:22.033 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:22.033+0000 7fbd27e00640 1 -- 172.21.15.72:0/2656511436 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbd280d1770 msgr2=0x7fbd28161d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:22.033 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:22.033+0000 7fbd27e00640 1 --2- 172.21.15.72:0/2656511436 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbd280d1770 0x7fbd28161d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:22.033 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:22.033+0000 7fbd27e00640 1 -- 172.21.15.72:0/2656511436 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd280c9310 con 0x7fbd2815e370 2024-04-04T06:57:22.033 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:22.033+0000 7fbd27e00640 1 --2- 172.21.15.72:0/2656511436 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbd2815e370 0x7fbd281510a0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fbd2000efc0 tx=0x7fbd2000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:22.033 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:22.034+0000 7fbd1f400640 1 -- 172.21.15.72:0/2656511436 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd20018020 con 0x7fbd2815e370 2024-04-04T06:57:22.033 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:22.034+0000 7fbd1f400640 1 -- 172.21.15.72:0/2656511436 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd2000cd40 con 0x7fbd2815e370 2024-04-04T06:57:22.033 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:22.034+0000 7fbd2d200640 1 -- 172.21.15.72:0/2656511436 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd280c98a0 con 0x7fbd2815e370 2024-04-04T06:57:22.033 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:22.034+0000 7fbd1f400640 1 -- 172.21.15.72:0/2656511436 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd200146c0 con 0x7fbd2815e370 2024-04-04T06:57:22.033 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:22.034+0000 7fbd2d200640 1 -- 172.21.15.72:0/2656511436 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd280c9e60 con 0x7fbd2815e370 2024-04-04T06:57:22.034 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:22.035+0000 7fbd2d200640 1 -- 172.21.15.72:0/2656511436 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd280685a0 con 0x7fbd2815e370 2024-04-04T06:57:22.034 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:22.036+0000 7fbd1f400640 1 -- 172.21.15.72:0/2656511436 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fbd20005d10 con 0x7fbd2815e370 2024-04-04T06:57:22.036 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:22.037+0000 7fbd1f400640 1 --2- 172.21.15.72:0/2656511436 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fbd0406c8f0 0x7fbd0406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:22.036 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:22.037+0000 7fbd1f400640 1 -- 172.21.15.72:0/2656511436 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7fbd2008cce0 con 0x7fbd2815e370 2024-04-04T06:57:22.036 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:22.037+0000 7fbd27400640 1 --2- 172.21.15.72:0/2656511436 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fbd0406c8f0 0x7fbd0406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:22.036 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:22.038+0000 7fbd27400640 1 --2- 172.21.15.72:0/2656511436 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fbd0406c8f0 0x7fbd0406edb0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fbd18036000 tx=0x7fbd1803c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:22.040 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:22.042+0000 7fbd1f400640 1 -- 172.21.15.72:0/2656511436 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fbd20022030 con 0x7fbd2815e370 2024-04-04T06:57:22.240 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:22.241+0000 7fbd2d200640 1 -- 172.21.15.72:0/2656511436 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fbd280d1f70 con 0x7fbd2815e370 2024-04-04T06:57:22.240 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:22.242+0000 7fbd1f400640 1 -- 172.21.15.72:0/2656511436 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) ==== 100+0+11 (secure 0 0 0) 0x7fbd20010040 con 0x7fbd2815e370 2024-04-04T06:57:22.241 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 64 2024-04-04T06:57:22.244 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:22.244+0000 7fbd2d200640 1 -- 172.21.15.72:0/2656511436 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fbd0406c8f0 msgr2=0x7fbd0406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:22.244 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:22.244+0000 7fbd2d200640 1 --2- 172.21.15.72:0/2656511436 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fbd0406c8f0 0x7fbd0406edb0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fbd18036000 tx=0x7fbd1803c040 comp rx=0 tx=0).stop 2024-04-04T06:57:22.244 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:22.244+0000 7fbd2d200640 1 -- 172.21.15.72:0/2656511436 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbd2815e370 msgr2=0x7fbd281510a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:22.244 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:22.244+0000 7fbd2d200640 1 --2- 172.21.15.72:0/2656511436 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbd2815e370 0x7fbd281510a0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fbd2000efc0 tx=0x7fbd2000c490 comp rx=0 tx=0).stop 2024-04-04T06:57:22.244 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:22.245+0000 7fbd2d200640 1 -- 172.21.15.72:0/2656511436 shutdown_connections 2024-04-04T06:57:22.244 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:22.245+0000 7fbd2d200640 1 --2- 172.21.15.72:0/2656511436 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fbd0406c8f0 0x7fbd0406edb0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:22.244 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:22.245+0000 7fbd2d200640 1 --2- 172.21.15.72:0/2656511436 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbd2815e370 0x7fbd281510a0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:22.244 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:22.245+0000 7fbd2d200640 1 --2- 172.21.15.72:0/2656511436 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbd280d4b40 0x7fbd280cd790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:22.244 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:22.245+0000 7fbd2d200640 1 --2- 172.21.15.72:0/2656511436 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbd280d1770 0x7fbd28161d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:22.244 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:22.245+0000 7fbd2d200640 1 -- 172.21.15.72:0/2656511436 >> 172.21.15.72:0/2656511436 conn(0x7fbd2806b890 msgr2=0x7fbd280d4100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:22.244 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:22.245+0000 7fbd2d200640 1 -- 172.21.15.72:0/2656511436 shutdown_connections 2024-04-04T06:57:22.244 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:22.245+0000 7fbd2d200640 1 -- 172.21.15.72:0/2656511436 wait complete. 2024-04-04T06:57:22.261 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-04T06:57:22.456 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:22.457+0000 7f8981c00640 1 Processor -- start 2024-04-04T06:57:22.456 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:22.458+0000 7f8981c00640 1 -- start start 2024-04-04T06:57:22.458 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:22.459+0000 7f8981c00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f897c071610 0x7f897c0c5e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:22.458 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:22.459+0000 7f8981c00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f897c0ccb20 0x7f897c0ccfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:22.458 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:22.459+0000 7f8981c00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f897c0c6710 con 0x7f897c15c2d0 2024-04-04T06:57:22.458 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:22.459+0000 7f8981c00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f897c0c6fb0 con 0x7f897c0ccb20 2024-04-04T06:57:22.458 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:22.459+0000 7f8981c00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f897c0c69f0 con 0x7f897c071610 2024-04-04T06:57:22.459 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:22.460+0000 7f8972000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f897c071610 0x7f897c0c5e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:22.459 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:22.460+0000 7f8972000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f897c071610 0x7f897c0c5e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.72:47916/0 (socket says 172.21.15.72:47916) 2024-04-04T06:57:22.459 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:22.460+0000 7f8972000640 1 -- 172.21.15.72:0/2948430957 learned_addr learned my addr 172.21.15.72:0/2948430957 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:57:22.459 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:22.460+0000 7f897b400640 1 --2- 172.21.15.72:0/2948430957 >> v2:172.21.15.117:3300/0 conn(0x7f897c0ccb20 0x7f897c0ccfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:22.459 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:22.461+0000 7f8972000640 1 -- 172.21.15.72:0/2948430957 >> v2:172.21.15.117:3300/0 conn(0x7f897c0ccb20 msgr2=0x7f897c0ccfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:57:22.460 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:22.461+0000 7f8972000640 1 --2- 172.21.15.72:0/2948430957 >> v2:172.21.15.117:3300/0 conn(0x7f897c0ccb20 0x7f897c0ccfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:22.460 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:22.461+0000 7f8972000640 1 -- 172.21.15.72:0/2948430957 >> v1:172.21.15.117:6789/0 conn(0x7f897c15c2d0 legacy=0x7f897c15c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:22.460 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:22.461+0000 7f8972000640 1 -- 172.21.15.72:0/2948430957 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f897c0c6cd0 con 0x7f897c071610 2024-04-04T06:57:22.460 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:22.461+0000 7f897a000640 1 -- 172.21.15.72:0/2948430957 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 564240692 0 0) 0x7f897c0c6710 con 0x7f897c15c2d0 2024-04-04T06:57:22.461 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:22.462+0000 7f8972000640 1 --2- 172.21.15.72:0/2948430957 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f897c071610 0x7f897c0c5e50 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f8964009870 tx=0x7f896402b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f87a6bf4f8a564d5 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:22.461 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:22.463+0000 7f897a000640 1 -- 172.21.15.72:0/2948430957 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8964035020 con 0x7f897c071610 2024-04-04T06:57:22.461 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:22.463+0000 7f897a000640 1 -- 172.21.15.72:0/2948430957 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8964031640 con 0x7f897c071610 2024-04-04T06:57:22.461 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:22.463+0000 7f897a000640 1 -- 172.21.15.72:0/2948430957 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f896402d040 con 0x7f897c071610 2024-04-04T06:57:22.462 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:22.463+0000 7f8981c00640 1 -- 172.21.15.72:0/2948430957 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f897c071610 msgr2=0x7f897c0c5e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:22.462 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:22.463+0000 7f8981c00640 1 --2- 172.21.15.72:0/2948430957 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f897c071610 0x7f897c0c5e50 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f8964009870 tx=0x7f896402b8f0 comp rx=0 tx=0).stop 2024-04-04T06:57:22.462 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:22.463+0000 7f8981c00640 1 -- 172.21.15.72:0/2948430957 shutdown_connections 2024-04-04T06:57:22.462 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:22.463+0000 7f8981c00640 1 --2- 172.21.15.72:0/2948430957 >> v2:172.21.15.117:3300/0 conn(0x7f897c0ccb20 0x7f897c0ccfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:22.462 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:22.463+0000 7f8981c00640 1 --2- 172.21.15.72:0/2948430957 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f897c071610 0x7f897c0c5e50 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:22.462 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:22.463+0000 7f8981c00640 1 -- 172.21.15.72:0/2948430957 >> 172.21.15.72:0/2948430957 conn(0x7f897c06b470 msgr2=0x7f897c06b880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:22.463 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:22.463+0000 7f8981c00640 1 -- 172.21.15.72:0/2948430957 shutdown_connections 2024-04-04T06:57:22.463 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:22.463+0000 7f8981c00640 1 -- 172.21.15.72:0/2948430957 wait complete. 2024-04-04T06:57:22.464 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:22.465+0000 7f8981c00640 1 Processor -- start 2024-04-04T06:57:22.464 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:22.465+0000 7f8981c00640 1 -- start start 2024-04-04T06:57:22.466 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:22.466+0000 7f8981c00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f897c071610 0x7f897c158290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:22.466 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:22.466+0000 7f8981c00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f897c0ccb20 0x7f897c15a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:22.466 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:22.466+0000 7f8981c00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f897c15c2d0 0x7f897c0cfee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:22.466 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:22.466+0000 7f8981c00640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f897c0b4020 con 0x7f897c071610 2024-04-04T06:57:22.466 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:22.466+0000 7f8981c00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f897c0b3ea0 con 0x7f897c15c2d0 2024-04-04T06:57:22.466 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:22.466+0000 7f8981c00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f897c0b41a0 con 0x7f897c0ccb20 2024-04-04T06:57:22.467 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:22.466+0000 7f897aa00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f897c071610 0x7f897c158290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:22.467 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:22.466+0000 7f897aa00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f897c071610 0x7f897c158290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:37250/0 (socket says 172.21.15.72:37250) 2024-04-04T06:57:22.467 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:22.466+0000 7f897aa00640 1 -- 172.21.15.72:0/3867550808 learned_addr learned my addr 172.21.15.72:0/3867550808 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:57:22.467 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:22.467+0000 7f897b400640 1 --2- 172.21.15.72:0/3867550808 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f897c15c2d0 0x7f897c0cfee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:22.467 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:22.467+0000 7f8972000640 1 --2- 172.21.15.72:0/3867550808 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f897c0ccb20 0x7f897c15a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:22.467 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:22.467+0000 7f897aa00640 1 -- 172.21.15.72:0/3867550808 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f897c0ccb20 msgr2=0x7f897c15a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:22.467 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:22.467+0000 7f897aa00640 1 --2- 172.21.15.72:0/3867550808 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f897c0ccb20 0x7f897c15a280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:22.467 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:22.467+0000 7f897aa00640 1 -- 172.21.15.72:0/3867550808 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f897c15c2d0 msgr2=0x7f897c0cfee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:22.467 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:22.467+0000 7f897aa00640 1 --2- 172.21.15.72:0/3867550808 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f897c15c2d0 0x7f897c0cfee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:22.467 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:22.467+0000 7f897aa00640 1 -- 172.21.15.72:0/3867550808 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f897c1587d0 con 0x7f897c071610 2024-04-04T06:57:22.467 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:22.467+0000 7f897aa00640 1 --2- 172.21.15.72:0/3867550808 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f897c071610 0x7f897c158290 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f896c00c440 tx=0x7f896c00c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:22.467 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:22.467+0000 7f8973400640 1 -- 172.21.15.72:0/3867550808 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f896c017070 con 0x7f897c071610 2024-04-04T06:57:22.467 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:22.467+0000 7f8973400640 1 -- 172.21.15.72:0/3867550808 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f896c005480 con 0x7f897c071610 2024-04-04T06:57:22.467 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:22.467+0000 7f8973400640 1 -- 172.21.15.72:0/3867550808 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f896c003830 con 0x7f897c071610 2024-04-04T06:57:22.468 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:22.467+0000 7f8981c00640 1 -- 172.21.15.72:0/3867550808 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f897c0ad060 con 0x7f897c071610 2024-04-04T06:57:22.468 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:22.468+0000 7f8981c00640 1 -- 172.21.15.72:0/3867550808 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f897c0ad300 con 0x7f897c071610 2024-04-04T06:57:22.468 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:22.469+0000 7f8981c00640 1 -- 172.21.15.72:0/3867550808 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f897c075840 con 0x7f897c071610 2024-04-04T06:57:22.468 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:22.470+0000 7f8973400640 1 -- 172.21.15.72:0/3867550808 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f896c01a070 con 0x7f897c071610 2024-04-04T06:57:22.469 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:22.470+0000 7f8973400640 1 --2- 172.21.15.72:0/3867550808 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f895806c8f0 0x7f895806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:22.469 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:22.471+0000 7f8973400640 1 -- 172.21.15.72:0/3867550808 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f896c08afa0 con 0x7f897c071610 2024-04-04T06:57:22.469 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:22.471+0000 7f8972000640 1 --2- 172.21.15.72:0/3867550808 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f895806c8f0 0x7f895806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:22.470 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:22.471+0000 7f8972000640 1 --2- 172.21.15.72:0/3867550808 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f895806c8f0 0x7f895806edb0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f8964036000 tx=0x7f8964008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:22.477 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:22.479+0000 7f8973400640 1 -- 172.21.15.72:0/3867550808 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f897c1587d0 con 0x7f897c071610 2024-04-04T06:57:22.689 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:22.690+0000 7f8981c00640 1 -- 172.21.15.72:0/3867550808 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f897c0ce760 con 0x7f897c071610 2024-04-04T06:57:22.689 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:22.691+0000 7f8973400640 1 -- 172.21.15.72:0/3867550808 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v22) ==== 80+0+0 (secure 0 0 0) 0x7f896c0592b0 con 0x7f897c071610 2024-04-04T06:57:22.689 INFO:teuthology.orchestra.run.smithi072.stderr:listed 0 entries 2024-04-04T06:57:22.692 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:22.693+0000 7f8981c00640 1 -- 172.21.15.72:0/3867550808 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f895806c8f0 msgr2=0x7f895806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:22.692 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:22.693+0000 7f8981c00640 1 --2- 172.21.15.72:0/3867550808 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f895806c8f0 0x7f895806edb0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f8964036000 tx=0x7f8964008030 comp rx=0 tx=0).stop 2024-04-04T06:57:22.692 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:22.693+0000 7f8981c00640 1 -- 172.21.15.72:0/3867550808 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f897c071610 msgr2=0x7f897c158290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:22.692 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:22.693+0000 7f8981c00640 1 --2- 172.21.15.72:0/3867550808 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f897c071610 0x7f897c158290 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f896c00c440 tx=0x7f896c00c900 comp rx=0 tx=0).stop 2024-04-04T06:57:22.692 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:22.693+0000 7f8981c00640 1 -- 172.21.15.72:0/3867550808 shutdown_connections 2024-04-04T06:57:22.693 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:22.693+0000 7f8981c00640 1 --2- 172.21.15.72:0/3867550808 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f895806c8f0 0x7f895806edb0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:22.693 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:22.693+0000 7f8981c00640 1 --2- 172.21.15.72:0/3867550808 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f897c15c2d0 0x7f897c0cfee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:22.693 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:22.694+0000 7f8981c00640 1 --2- 172.21.15.72:0/3867550808 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f897c0ccb20 0x7f897c15a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:22.693 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:22.694+0000 7f8981c00640 1 --2- 172.21.15.72:0/3867550808 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f897c071610 0x7f897c158290 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:22.693 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:22.694+0000 7f8981c00640 1 -- 172.21.15.72:0/3867550808 >> 172.21.15.72:0/3867550808 conn(0x7f897c06b470 msgr2=0x7f897c15b6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:22.693 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:22.694+0000 7f8981c00640 1 -- 172.21.15.72:0/3867550808 shutdown_connections 2024-04-04T06:57:22.693 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:22.694+0000 7f8981c00640 1 -- 172.21.15.72:0/3867550808 wait complete. 2024-04-04T06:57:22.715 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi117.front.sepia.ceph.com... 2024-04-04T06:57:22.715 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-04T06:57:22.715 DEBUG:teuthology.orchestra.run.smithi117:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2024-04-04T06:57:22.815 INFO:teuthology.orchestra.run:waiting for 300 2024-04-04T06:57:22.816 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi117.front.sepia.ceph.com 2024-04-04T06:57:22.816 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-04T06:57:22.816 DEBUG:teuthology.orchestra.run.smithi117:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-04-04T06:57:22.872 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-04-04T06:57:22.872 DEBUG:teuthology.orchestra.run.smithi072:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-04T06:57:22.924 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-04-04T06:57:22.925 DEBUG:teuthology.orchestra.run.smithi072:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-04T06:57:23.015 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-04T06:57:23.246 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:23.247+0000 7f192cc00640 1 Processor -- start 2024-04-04T06:57:23.246 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:23.247+0000 7f192cc00640 1 -- start start 2024-04-04T06:57:23.247 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:23.248+0000 7f192cc00640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f192815c2d0 0x7f1928071610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:23.247 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:23.248+0000 7f192cc00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f192815c6b0 0x7f19280c5e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:23.248 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:23.249+0000 7f192cc00640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f19280c6710 con 0x7f19280ccb20 2024-04-04T06:57:23.248 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:23.249+0000 7f192cc00640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f19280c6fb0 con 0x7f192815c2d0 2024-04-04T06:57:23.248 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:23.249+0000 7f192cc00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f19280c69f0 con 0x7f192815c6b0 2024-04-04T06:57:23.248 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:23.249+0000 7f1926800640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f19280ccb20 0x7f19280b3ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:40142/0 (socket says 172.21.15.72:40142) 2024-04-04T06:57:23.248 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:23.249+0000 7f1926800640 1 -- 172.21.15.72:0/98321091 learned_addr learned my addr 172.21.15.72:0/98321091 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-04-04T06:57:23.248 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:23.249+0000 7f1925e00640 1 --2- 172.21.15.72:0/98321091 >> v2:172.21.15.72:3300/0 conn(0x7f192815c2d0 0x7f1928071610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:23.249 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:23.249+0000 7f191fe00640 1 --2- 172.21.15.72:0/98321091 >> v2:172.21.15.117:3300/0 conn(0x7f192815c6b0 0x7f19280c5e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:23.249 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:23.249+0000 7f1925e00640 1 -- 172.21.15.72:0/98321091 >> v2:172.21.15.117:3300/0 conn(0x7f192815c6b0 msgr2=0x7f19280c5e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:57:23.249 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:23.249+0000 7f1925e00640 1 --2- 172.21.15.72:0/98321091 >> v2:172.21.15.117:3300/0 conn(0x7f192815c6b0 0x7f19280c5e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:23.249 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:23.249+0000 7f1925e00640 1 -- 172.21.15.72:0/98321091 >> v1:172.21.15.72:6789/0 conn(0x7f19280ccb20 legacy=0x7f19280b3ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:23.249 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:23.250+0000 7f1925e00640 1 -- 172.21.15.72:0/98321091 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19280c6cd0 con 0x7f192815c2d0 2024-04-04T06:57:23.249 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:23.250+0000 7f1925400640 1 -- 172.21.15.72:0/98321091 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1116491710 0 0) 0x7f19280c6710 con 0x7f19280ccb20 2024-04-04T06:57:23.249 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:23.251+0000 7f1925e00640 1 --2- 172.21.15.72:0/98321091 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f192815c2d0 0x7f1928071610 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f1928073600 tx=0x7f191802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ded863d025a400d8 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:23.250 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:23.251+0000 7f1925400640 1 -- 172.21.15.72:0/98321091 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19180315a0 con 0x7f192815c2d0 2024-04-04T06:57:23.250 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:23.251+0000 7f1925400640 1 -- 172.21.15.72:0/98321091 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1918037070 con 0x7f192815c2d0 2024-04-04T06:57:23.250 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:23.251+0000 7f1925400640 1 -- 172.21.15.72:0/98321091 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1918031960 con 0x7f192815c2d0 2024-04-04T06:57:23.250 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:23.252+0000 7f192cc00640 1 -- 172.21.15.72:0/98321091 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f192815c2d0 msgr2=0x7f1928071610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:23.251 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:23.252+0000 7f192cc00640 1 --2- 172.21.15.72:0/98321091 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f192815c2d0 0x7f1928071610 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f1928073600 tx=0x7f191802b840 comp rx=0 tx=0).stop 2024-04-04T06:57:23.251 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:23.252+0000 7f192cc00640 1 -- 172.21.15.72:0/98321091 shutdown_connections 2024-04-04T06:57:23.251 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:23.252+0000 7f192cc00640 1 --2- 172.21.15.72:0/98321091 >> v2:172.21.15.117:3300/0 conn(0x7f192815c6b0 0x7f19280c5e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:23.251 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:23.252+0000 7f192cc00640 1 --2- 172.21.15.72:0/98321091 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f192815c2d0 0x7f1928071610 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:23.251 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:23.252+0000 7f192cc00640 1 -- 172.21.15.72:0/98321091 >> 172.21.15.72:0/98321091 conn(0x7f192806b470 msgr2=0x7f192806b880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:23.251 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:23.252+0000 7f192cc00640 1 -- 172.21.15.72:0/98321091 shutdown_connections 2024-04-04T06:57:23.251 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:23.252+0000 7f192cc00640 1 -- 172.21.15.72:0/98321091 wait complete. 2024-04-04T06:57:23.252 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:23.254+0000 7f192cc00640 1 Processor -- start 2024-04-04T06:57:23.252 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:23.254+0000 7f192cc00640 1 -- start start 2024-04-04T06:57:23.253 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:23.255+0000 7f192cc00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f19280ccb20 0x7f1928151870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:23.254 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:23.255+0000 7f192cc00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f192815c2d0 0x7f19280c7200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:23.254 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:23.255+0000 7f192cc00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f192815c6b0 0x7f1928072690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:23.254 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:23.255+0000 7f192cc00640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f19280ccf60 con 0x7f19280ccb20 2024-04-04T06:57:23.254 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:23.255+0000 7f192cc00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f19280c6390 con 0x7f192815c2d0 2024-04-04T06:57:23.254 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:23.255+0000 7f192cc00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f19280cd0e0 con 0x7f192815c6b0 2024-04-04T06:57:23.254 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:23.255+0000 7f1925e00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f19280ccb20 0x7f1928151870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:23.254 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:23.255+0000 7f1925e00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f19280ccb20 0x7f1928151870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:37270/0 (socket says 172.21.15.72:37270) 2024-04-04T06:57:23.254 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:23.255+0000 7f1925e00640 1 -- 172.21.15.72:0/2335536571 learned_addr learned my addr 172.21.15.72:0/2335536571 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:57:23.255 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:23.255+0000 7f1925e00640 1 -- 172.21.15.72:0/2335536571 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f192815c6b0 msgr2=0x7f1928072690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:23.255 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:23.255+0000 7f1925e00640 1 --2- 172.21.15.72:0/2335536571 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f192815c6b0 0x7f1928072690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:23.255 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:23.255+0000 7f1925e00640 1 -- 172.21.15.72:0/2335536571 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f192815c2d0 msgr2=0x7f19280c7200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:23.256 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:23.255+0000 7f191fe00640 1 --2- 172.21.15.72:0/2335536571 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f192815c2d0 0x7f19280c7200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:23.256 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:23.256+0000 7f1925e00640 1 --2- 172.21.15.72:0/2335536571 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f192815c2d0 0x7f19280c7200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:23.256 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:23.256+0000 7f1925e00640 1 -- 172.21.15.72:0/2335536571 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19280c7bc0 con 0x7f19280ccb20 2024-04-04T06:57:23.256 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:23.256+0000 7f1925e00640 1 --2- 172.21.15.72:0/2335536571 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f19280ccb20 0x7f1928151870 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f1918000c00 tx=0x7f19180046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:23.256 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:23.256+0000 7f191e000640 1 -- 172.21.15.72:0/2335536571 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1918032840 con 0x7f19280ccb20 2024-04-04T06:57:23.256 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:23.256+0000 7f191e000640 1 -- 172.21.15.72:0/2335536571 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1918032a00 con 0x7f19280ccb20 2024-04-04T06:57:23.256 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:23.256+0000 7f191e000640 1 -- 172.21.15.72:0/2335536571 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1918032df0 con 0x7f19280ccb20 2024-04-04T06:57:23.256 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:23.256+0000 7f192cc00640 1 -- 172.21.15.72:0/2335536571 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19280c7ea0 con 0x7f19280ccb20 2024-04-04T06:57:23.256 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:23.256+0000 7f192cc00640 1 -- 172.21.15.72:0/2335536571 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19280c8460 con 0x7f19280ccb20 2024-04-04T06:57:23.256 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:23.258+0000 7f192cc00640 1 -- 172.21.15.72:0/2335536571 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1928075840 con 0x7f19280ccb20 2024-04-04T06:57:23.257 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:23.259+0000 7f191e000640 1 -- 172.21.15.72:0/2335536571 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f191804c020 con 0x7f19280ccb20 2024-04-04T06:57:23.258 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:23.260+0000 7f191e000640 1 --2- 172.21.15.72:0/2335536571 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f190406c8f0 0x7f190406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:23.259 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:23.260+0000 7f191e000640 1 -- 172.21.15.72:0/2335536571 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f191802f020 con 0x7f19280ccb20 2024-04-04T06:57:23.259 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:23.260+0000 7f191fe00640 1 --2- 172.21.15.72:0/2335536571 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f190406c8f0 0x7f190406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:23.259 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:23.261+0000 7f191fe00640 1 --2- 172.21.15.72:0/2335536571 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f190406c8f0 0x7f190406edb0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f1910006fd0 tx=0x7f1910008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:23.262 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:23.264+0000 7f191e000640 1 -- 172.21.15.72:0/2335536571 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f1918040070 con 0x7f19280ccb20 2024-04-04T06:57:23.496 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:23.497+0000 7f192cc00640 1 -- 172.21.15.72:0/2335536571 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f19280ce760 con 0x7f19280ccb20 2024-04-04T06:57:23.498 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:23.499+0000 7f191e000640 1 -- 172.21.15.72:0/2335536571 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16831 (secure 0 0 0) 0x7f191807bcd0 con 0x7f19280ccb20 2024-04-04T06:57:23.498 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T06:57:23.498 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":22,"fsid":"6708bac2-4f50-49b5-87a9-c390fd333eb3","created":"2024-04-04T06:56:04.282498+0000","modified":"2024-04-04T06:57:11.239134+0000","last_up_change":"2024-04-04T06:56:16.716089+0000","last_in_change":"2024-04-04T06:56:07.768593+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-04T06:56:17.421685+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-04T06:56:26.822661+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-04T06:56:27.429816+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7c345991-5af8-4dc6-a481-28610c40e128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":3889813953},{"type":"v1","addr":"172.21.15.72:6818","nonce":3889813953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":3889813953},{"type":"v1","addr":"172.21.15.72:6821","nonce":3889813953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":3889813953},{"type":"v1","addr":"172.21.15.72:6826","nonce":3889813953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":3889813953},{"type":"v1","addr":"172.21.15.72:6823","nonce":3889813953}]},"public_addr":"172.21.15.72:6818/3889813953","cluster_addr":"172.21.15.72:6821/3889813953","heartbeat_back_addr":"172.21.15.72:6826/3889813953","heartbeat_front_addr":"172.21.15.72:6823/3889813953","state":["exists","up"]},{"osd":1,"uuid":"1b3f7ab2-a56c-488d-a89a-1f3572361c95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":3101663154},{"type":"v1","addr":"172.21.15.72:6801","nonce":3101663154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":3101663154},{"type":"v1","addr":"172.21.15.72:6803","nonce":3101663154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":3101663154},{"type":"v1","addr":"172.21.15.72:6807","nonce":3101663154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":3101663154},{"type":"v1","addr":"172.21.15.72:6805","nonce":3101663154}]},"public_addr":"172.21.15.72:6801/3101663154","cluster_addr":"172.21.15.72:6803/3101663154","heartbeat_back_addr":"172.21.15.72:6807/3101663154","heartbeat_front_addr":"172.21.15.72:6805/3101663154","state":["exists","up"]},{"osd":2,"uuid":"fc9aa512-53df-40d7-ba04-3e6b7dcd1e34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":235374192},{"type":"v1","addr":"172.21.15.72:6809","nonce":235374192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":235374192},{"type":"v1","addr":"172.21.15.72:6811","nonce":235374192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":235374192},{"type":"v1","addr":"172.21.15.72:6815","nonce":235374192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":235374192},{"type":"v1","addr":"172.21.15.72:6813","nonce":235374192}]},"public_addr":"172.21.15.72:6809/235374192","cluster_addr":"172.21.15.72:6811/235374192","heartbeat_back_addr":"172.21.15.72:6815/235374192","heartbeat_front_addr":"172.21.15.72:6813/235374192","state":["exists","up"]},{"osd":3,"uuid":"b4f63eed-dc5b-4aba-bb50-de46eb41492b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6817","nonce":2806631742},{"type":"v1","addr":"172.21.15.72:6819","nonce":2806631742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":2806631742},{"type":"v1","addr":"172.21.15.72:6827","nonce":2806631742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":2806631742},{"type":"v1","addr":"172.21.15.72:6831","nonce":2806631742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":2806631742},{"type":"v1","addr":"172.21.15.72:6829","nonce":2806631742}]},"public_addr":"172.21.15.72:6819/2806631742","cluster_addr":"172.21.15.72:6827/2806631742","heartbeat_back_addr":"172.21.15.72:6831/2806631742","heartbeat_front_addr":"172.21.15.72:6829/2806631742","state":["exists","up"]},{"osd":4,"uuid":"9e985ef8-d711-4172-9286-c54e560895d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":4293536423},{"type":"v1","addr":"172.21.15.117:6825","nonce":4293536423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":4293536423},{"type":"v1","addr":"172.21.15.117:6827","nonce":4293536423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":4293536423},{"type":"v1","addr":"172.21.15.117:6831","nonce":4293536423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":4293536423},{"type":"v1","addr":"172.21.15.117:6829","nonce":4293536423}]},"public_addr":"172.21.15.117:6825/4293536423","cluster_addr":"172.21.15.117:6827/4293536423","heartbeat_back_addr":"172.21.15.117:6831/4293536423","heartbeat_front_addr":"172.21.15.117:6829/4293536423","state":["exists","up"]},{"osd":5,"uuid":"3e9f082b-8d7d-455f-8a96-66d0b4857125","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":684971679},{"type":"v1","addr":"172.21.15.117:6801","nonce":684971679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":684971679},{"type":"v1","addr":"172.21.15.117:6803","nonce":684971679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":684971679},{"type":"v1","addr":"172.21.15.117:6807","nonce":684971679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":684971679},{"type":"v1","addr":"172.21.15.117:6805","nonce":684971679}]},"public_addr":"172.21.15.117:6801/684971679","cluster_addr":"172.21.15.117:6803/684971679","heartbeat_back_addr":"172.21.15.117:6807/684971679","heartbeat_front_addr":"172.21.15.117:6805/684971679","state":["exists","up"]},{"osd":6,"uuid":"bcdafa9f-a870-4398-a38d-ab7697676473","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":2781186528},{"type":"v1","addr":"172.21.15.117:6809","nonce":2781186528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":2781186528},{"type":"v1","addr":"172.21.15.117:6811","nonce":2781186528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":2781186528},{"type":"v1","addr":"172.21.15.117:6815","nonce":2781186528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":2781186528},{"type":"v1","addr":"172.21.15.117:6813","nonce":2781186528}]},"public_addr":"172.21.15.117:6809/2781186528","cluster_addr":"172.21.15.117:6811/2781186528","heartbeat_back_addr":"172.21.15.117:6815/2781186528","heartbeat_front_addr":"172.21.15.117:6813/2781186528","state":["exists","up"]},{"osd":7,"uuid":"b68ec562-ff35-4d2d-a733-c896f8920cfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":617469882},{"type":"v1","addr":"172.21.15.117:6817","nonce":617469882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":617469882},{"type":"v1","addr":"172.21.15.117:6819","nonce":617469882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":617469882},{"type":"v1","addr":"172.21.15.117:6823","nonce":617469882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":617469882},{"type":"v1","addr":"172.21.15.117:6821","nonce":617469882}]},"public_addr":"172.21.15.117:6817/617469882","cluster_addr":"172.21.15.117:6819/617469882","heartbeat_back_addr":"172.21.15.117:6823/617469882","heartbeat_front_addr":"172.21.15.117:6821/617469882","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.347700+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.296619+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.361345+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.093323+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:12.857605+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:12.816090+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.083163+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.121639+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.13","mappings":[{"from":7,"to":1}]},{"pgid":"3.19","mappings":[{"from":3,"to":2}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.28","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-04T06:57:23.500 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:23.502+0000 7f192cc00640 1 -- 172.21.15.72:0/2335536571 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f190406c8f0 msgr2=0x7f190406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:23.501 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:23.502+0000 7f192cc00640 1 --2- 172.21.15.72:0/2335536571 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f190406c8f0 0x7f190406edb0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f1910006fd0 tx=0x7f1910008040 comp rx=0 tx=0).stop 2024-04-04T06:57:23.501 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:23.502+0000 7f192cc00640 1 -- 172.21.15.72:0/2335536571 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f19280ccb20 msgr2=0x7f1928151870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:23.501 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:23.502+0000 7f192cc00640 1 --2- 172.21.15.72:0/2335536571 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f19280ccb20 0x7f1928151870 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f1918000c00 tx=0x7f19180046c0 comp rx=0 tx=0).stop 2024-04-04T06:57:23.501 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:23.502+0000 7f192cc00640 1 -- 172.21.15.72:0/2335536571 shutdown_connections 2024-04-04T06:57:23.501 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:23.502+0000 7f192cc00640 1 --2- 172.21.15.72:0/2335536571 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f190406c8f0 0x7f190406edb0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:23.501 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:23.502+0000 7f192cc00640 1 --2- 172.21.15.72:0/2335536571 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f192815c6b0 0x7f1928072690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:23.501 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:23.502+0000 7f192cc00640 1 --2- 172.21.15.72:0/2335536571 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f192815c2d0 0x7f19280c7200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:23.501 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:23.502+0000 7f192cc00640 1 --2- 172.21.15.72:0/2335536571 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f19280ccb20 0x7f1928151870 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:23.501 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:23.502+0000 7f192cc00640 1 -- 172.21.15.72:0/2335536571 >> 172.21.15.72:0/2335536571 conn(0x7f192806b470 msgr2=0x7f19280b4af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:23.501 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:23.502+0000 7f192cc00640 1 -- 172.21.15.72:0/2335536571 shutdown_connections 2024-04-04T06:57:23.501 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:23.502+0000 7f192cc00640 1 -- 172.21.15.72:0/2335536571 wait complete. 2024-04-04T06:57:23.520 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-04T06:56:17.421685+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-04T06:56:26.822661+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-04T06:56:27.429816+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-04T06:57:23.520 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-04T06:57:23.722 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:23.723+0000 7f5521800640 1 Processor -- start 2024-04-04T06:57:23.722 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:23.723+0000 7f5521800640 1 -- start start 2024-04-04T06:57:23.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:23.724+0000 7f5521800640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f551c0d0890 0x7f551c06d340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:23.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:23.724+0000 7f5521800640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f551c072100 con 0x7f551c151710 2024-04-04T06:57:23.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:23.724+0000 7f5521800640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f551c0723e0 con 0x7f551c151af0 2024-04-04T06:57:23.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:23.725+0000 7f5521800640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f551c071ee0 con 0x7f551c0d0890 2024-04-04T06:57:23.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:23.725+0000 7f551aa00640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f551c151710 0x7f551c0717d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:40152/0 (socket says 172.21.15.72:40152) 2024-04-04T06:57:23.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:23.725+0000 7f551aa00640 1 -- 172.21.15.72:0/3556316498 learned_addr learned my addr 172.21.15.72:0/3556316498 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-04-04T06:57:23.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:23.725+0000 7f551a000640 1 --2- 172.21.15.72:0/3556316498 >> v2:172.21.15.117:3300/0 conn(0x7f551c0d0890 0x7f551c06d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:23.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:23.725+0000 7f5519600640 1 -- 172.21.15.72:0/3556316498 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4230968067 0 0) 0x7f551c072100 con 0x7f551c151710 2024-04-04T06:57:23.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:23.725+0000 7f5519600640 1 -- 172.21.15.72:0/3556316498 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5500003520 con 0x7f551c151710 2024-04-04T06:57:23.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:23.726+0000 7f5519600640 1 -- 172.21.15.72:0/3556316498 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2880380415 0 0) 0x7f5500003520 con 0x7f551c151710 2024-04-04T06:57:23.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:23.726+0000 7f5519600640 1 -- 172.21.15.72:0/3556316498 >> v2:172.21.15.117:3300/0 conn(0x7f551c0d0890 msgr2=0x7f551c06d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:57:23.730 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:23.726+0000 7f5519600640 1 --2- 172.21.15.72:0/3556316498 >> v2:172.21.15.117:3300/0 conn(0x7f551c0d0890 0x7f551c06d340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:23.730 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:23.726+0000 7f5519600640 1 -- 172.21.15.72:0/3556316498 >> v1:172.21.15.117:6789/0 conn(0x7f551c151af0 legacy=0x7f551c0b3420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:23.730 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:23.726+0000 7f5519600640 1 -- 172.21.15.72:0/3556316498 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f551c0726c0 con 0x7f551c151710 2024-04-04T06:57:23.730 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:23.726+0000 7f5519600640 1 -- 172.21.15.72:0/3556316498 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2465650867 0 0) 0x7f550c001670 con 0x7f551c151710 2024-04-04T06:57:23.730 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:23.726+0000 7f5519600640 1 -- 172.21.15.72:0/3556316498 >> v1:172.21.15.72:6789/0 conn(0x7f551c151710 legacy=0x7f551c0717d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:23.730 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:23.726+0000 7f5519600640 1 --2- 172.21.15.72:0/3556316498 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5500003a00 0x7f5500003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:23.731 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:23.726+0000 7f5519600640 1 --2- 172.21.15.72:0/3556316498 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5500004800 0x7f5500004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:23.731 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:23.726+0000 7f5519600640 1 --2- 172.21.15.72:0/3556316498 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f55000051c0 0x7f550000dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:23.731 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:23.726+0000 7f5519600640 1 -- 172.21.15.72:0/3556316498 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f551c071ee0 con 0x7f5500004800 2024-04-04T06:57:23.731 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:23.726+0000 7f5519600640 1 -- 172.21.15.72:0/3556316498 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f550000e2d0 con 0x7f5500003a00 2024-04-04T06:57:23.731 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:23.726+0000 7f5519600640 1 -- 172.21.15.72:0/3556316498 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f550000e4d0 con 0x7f55000051c0 2024-04-04T06:57:23.731 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:23.726+0000 7f551a000640 1 --2- 172.21.15.72:0/3556316498 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5500004800 0x7f5500004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:23.731 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:23.727+0000 7f551b400640 1 --2- 172.21.15.72:0/3556316498 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f55000051c0 0x7f550000dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:23.731 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:23.727+0000 7f551a000640 1 -- 172.21.15.72:0/3556316498 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f55000051c0 msgr2=0x7f550000dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:57:23.731 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:23.727+0000 7f551a000640 1 --2- 172.21.15.72:0/3556316498 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f55000051c0 0x7f550000dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:23.731 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:23.727+0000 7f551a000640 1 -- 172.21.15.72:0/3556316498 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5500003a00 msgr2=0x7f5500003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:57:23.732 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:23.727+0000 7f551a000640 1 --2- 172.21.15.72:0/3556316498 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5500003a00 0x7f5500003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:23.732 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:23.727+0000 7f551a000640 1 -- 172.21.15.72:0/3556316498 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5500003520 con 0x7f5500004800 2024-04-04T06:57:23.732 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:23.727+0000 7f551b400640 1 -- 172.21.15.72:0/3556316498 reap_dead start 2024-04-04T06:57:23.732 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:23.728+0000 7f551a000640 1 --2- 172.21.15.72:0/3556316498 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5500004800 0x7f5500004c80 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f5504009ac0 tx=0x7f5500005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2ad1b449b00a35b server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:23.732 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:23.728+0000 7f5519600640 1 -- 172.21.15.72:0/3556316498 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5504039070 con 0x7f5500004800 2024-04-04T06:57:23.732 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:23.728+0000 7f5519600640 1 -- 172.21.15.72:0/3556316498 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f550402c6b0 con 0x7f5500004800 2024-04-04T06:57:23.732 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:23.728+0000 7f5519600640 1 -- 172.21.15.72:0/3556316498 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5504009690 con 0x7f5500004800 2024-04-04T06:57:23.732 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:23.729+0000 7f5521800640 1 -- 172.21.15.72:0/3556316498 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5500004800 msgr2=0x7f5500004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:23.732 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:23.729+0000 7f5521800640 1 --2- 172.21.15.72:0/3556316498 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5500004800 0x7f5500004c80 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f5504009ac0 tx=0x7f5500005830 comp rx=0 tx=0).stop 2024-04-04T06:57:23.732 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:23.729+0000 7f5521800640 1 -- 172.21.15.72:0/3556316498 shutdown_connections 2024-04-04T06:57:23.732 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:23.729+0000 7f5521800640 1 --2- 172.21.15.72:0/3556316498 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5500004800 0x7f5500004c80 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:23.732 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:23.729+0000 7f5521800640 1 -- 172.21.15.72:0/3556316498 >> 172.21.15.72:0/3556316498 conn(0x7f551c06b470 msgr2=0x7f551c06b850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:23.732 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:23.729+0000 7f5521800640 1 -- 172.21.15.72:0/3556316498 shutdown_connections 2024-04-04T06:57:23.732 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:23.729+0000 7f5521800640 1 -- 172.21.15.72:0/3556316498 wait complete. 2024-04-04T06:57:23.735 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:23.731+0000 7f5521800640 1 Processor -- start 2024-04-04T06:57:23.735 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:23.731+0000 7f5521800640 1 -- start start 2024-04-04T06:57:23.735 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:23.732+0000 7f5521800640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5500004800 0x7f551c1f4d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:23.735 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:23.732+0000 7f5521800640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f551c0b1f20 0x7f551c1f7760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:23.735 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:23.732+0000 7f5521800640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f551c0b23a0 0x7f551c1f7ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:23.735 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:23.732+0000 7f5521800640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f551c071950 con 0x7f551c0b1f20 2024-04-04T06:57:23.735 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:23.732+0000 7f5521800640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f551c0717d0 con 0x7f5500004800 2024-04-04T06:57:23.735 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:23.732+0000 7f5521800640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f551c071ad0 con 0x7f551c0b23a0 2024-04-04T06:57:23.735 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:23.732+0000 7f551a000640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f551c0b1f20 0x7f551c1f7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:23.735 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:23.732+0000 7f551a000640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f551c0b1f20 0x7f551c1f7760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:37298/0 (socket says 172.21.15.72:37298) 2024-04-04T06:57:23.735 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:23.732+0000 7f551a000640 1 -- 172.21.15.72:0/2596559178 learned_addr learned my addr 172.21.15.72:0/2596559178 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:57:23.735 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:23.732+0000 7f551a000640 1 -- 172.21.15.72:0/2596559178 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f551c0b23a0 msgr2=0x7f551c1f7ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:23.735 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:23.732+0000 7f551b400640 1 --2- 172.21.15.72:0/2596559178 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f551c0b23a0 0x7f551c1f7ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:23.736 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:23.732+0000 7f551a000640 1 --2- 172.21.15.72:0/2596559178 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f551c0b23a0 0x7f551c1f7ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:23.736 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:23.732+0000 7f551a000640 1 -- 172.21.15.72:0/2596559178 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5500004800 msgr2=0x7f551c1f4d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:23.736 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:23.732+0000 7f551aa00640 1 --2- 172.21.15.72:0/2596559178 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5500004800 0x7f551c1f4d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:23.736 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:23.732+0000 7f551a000640 1 --2- 172.21.15.72:0/2596559178 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5500004800 0x7f551c1f4d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:23.736 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:23.732+0000 7f551a000640 1 -- 172.21.15.72:0/2596559178 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f551c1f8370 con 0x7f551c0b1f20 2024-04-04T06:57:23.736 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:23.733+0000 7f551a000640 1 --2- 172.21.15.72:0/2596559178 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f551c0b1f20 0x7f551c1f7760 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f5504009ac0 tx=0x7f5504004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:23.736 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:23.733+0000 7f5512a00640 1 -- 172.21.15.72:0/2596559178 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5504039050 con 0x7f551c0b1f20 2024-04-04T06:57:23.736 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:23.733+0000 7f5512a00640 1 -- 172.21.15.72:0/2596559178 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5504045070 con 0x7f551c0b1f20 2024-04-04T06:57:23.737 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:23.733+0000 7f5512a00640 1 -- 172.21.15.72:0/2596559178 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55040044e0 con 0x7f551c0b1f20 2024-04-04T06:57:23.737 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:23.733+0000 7f5521800640 1 -- 172.21.15.72:0/2596559178 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f551c1f8650 con 0x7f551c0b1f20 2024-04-04T06:57:23.737 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:23.733+0000 7f5521800640 1 -- 172.21.15.72:0/2596559178 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f551c1f4560 con 0x7f551c0b1f20 2024-04-04T06:57:23.737 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:23.735+0000 7f5521800640 1 -- 172.21.15.72:0/2596559178 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f551c075730 con 0x7f551c0b1f20 2024-04-04T06:57:23.737 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:23.736+0000 7f5512a00640 1 -- 172.21.15.72:0/2596559178 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5504003a50 con 0x7f551c0b1f20 2024-04-04T06:57:23.738 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:23.737+0000 7f5512a00640 1 --2- 172.21.15.72:0/2596559178 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f54f806c8f0 0x7f54f806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:23.738 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:23.738+0000 7f5512a00640 1 -- 172.21.15.72:0/2596559178 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f55040adfb0 con 0x7f551c0b1f20 2024-04-04T06:57:23.738 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:23.738+0000 7f551aa00640 1 --2- 172.21.15.72:0/2596559178 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f54f806c8f0 0x7f54f806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:23.738 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:23.739+0000 7f551aa00640 1 --2- 172.21.15.72:0/2596559178 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f54f806c8f0 0x7f54f806edb0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f550c0079b0 tx=0x7f550c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:23.739 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:23.740+0000 7f5512a00640 1 -- 172.21.15.72:0/2596559178 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f550404e020 con 0x7f551c0b1f20 2024-04-04T06:57:24.021 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:24.022+0000 7f5521800640 1 -- 172.21.15.72:0/2596559178 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f551c15dbe0 con 0x7f551c0b1f20 2024-04-04T06:57:24.021 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:24.023+0000 7f5512a00640 1 -- 172.21.15.72:0/2596559178 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) ==== 93+0+10 (secure 0 0 0) 0x7f550407c460 con 0x7f551c0b1f20 2024-04-04T06:57:24.021 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 1 2024-04-04T06:57:24.024 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:24.025+0000 7f5521800640 1 -- 172.21.15.72:0/2596559178 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f54f806c8f0 msgr2=0x7f54f806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:24.024 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:24.025+0000 7f5521800640 1 --2- 172.21.15.72:0/2596559178 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f54f806c8f0 0x7f54f806edb0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f550c0079b0 tx=0x7f550c009040 comp rx=0 tx=0).stop 2024-04-04T06:57:24.024 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:24.025+0000 7f5521800640 1 -- 172.21.15.72:0/2596559178 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f551c0b1f20 msgr2=0x7f551c1f7760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:24.024 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:24.025+0000 7f5521800640 1 --2- 172.21.15.72:0/2596559178 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f551c0b1f20 0x7f551c1f7760 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f5504009ac0 tx=0x7f5504004730 comp rx=0 tx=0).stop 2024-04-04T06:57:24.024 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:24.025+0000 7f5521800640 1 -- 172.21.15.72:0/2596559178 shutdown_connections 2024-04-04T06:57:24.025 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:24.025+0000 7f5521800640 1 --2- 172.21.15.72:0/2596559178 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f54f806c8f0 0x7f54f806edb0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:24.025 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:24.025+0000 7f5521800640 1 --2- 172.21.15.72:0/2596559178 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f551c0b23a0 0x7f551c1f7ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:24.025 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:24.025+0000 7f5521800640 1 --2- 172.21.15.72:0/2596559178 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f551c0b1f20 0x7f551c1f7760 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:24.025 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:24.025+0000 7f5521800640 1 --2- 172.21.15.72:0/2596559178 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5500004800 0x7f551c1f4d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:24.025 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:24.025+0000 7f5521800640 1 -- 172.21.15.72:0/2596559178 >> 172.21.15.72:0/2596559178 conn(0x7f551c06b470 msgr2=0x7f551c15c010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:24.025 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:24.026+0000 7f5521800640 1 -- 172.21.15.72:0/2596559178 shutdown_connections 2024-04-04T06:57:24.025 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:24.026+0000 7f5521800640 1 -- 172.21.15.72:0/2596559178 wait complete. 2024-04-04T06:57:24.044 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-04T06:57:24.236 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:24.237+0000 7ffaab200640 1 Processor -- start 2024-04-04T06:57:24.236 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:24.237+0000 7ffaab200640 1 -- start start 2024-04-04T06:57:24.238 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:24.239+0000 7ffaab200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffaac1458b0 0x7ffaac15fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:24.238 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:24.239+0000 7ffaab200640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ffaac160100 0x7ffaac06c480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:24.238 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:24.239+0000 7ffaab200640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffaac160a10 con 0x7ffaac06c9c0 2024-04-04T06:57:24.238 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:24.239+0000 7ffaab200640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7ffaac06ce20 con 0x7ffaac160100 2024-04-04T06:57:24.238 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:24.239+0000 7ffaab200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7ffaac0cf0a0 con 0x7ffaac1458b0 2024-04-04T06:57:24.238 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:24.239+0000 7ffaaa800640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7ffaac06c9c0 0x7ffaac0744d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:40158/0 (socket says 172.21.15.72:40158) 2024-04-04T06:57:24.238 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:24.239+0000 7ffaaa800640 1 -- 172.21.15.72:0/3335488487 learned_addr learned my addr 172.21.15.72:0/3335488487 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-04-04T06:57:24.239 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:24.239+0000 7ffaa9400640 1 --2- 172.21.15.72:0/3335488487 >> v2:172.21.15.72:3300/0 conn(0x7ffaac160100 0x7ffaac06c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:24.239 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:24.239+0000 7ffaa9e00640 1 --2- 172.21.15.72:0/3335488487 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffaac1458b0 0x7ffaac15fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:24.239 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:24.240+0000 7ffaa9400640 1 -- 172.21.15.72:0/3335488487 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffaac1458b0 msgr2=0x7ffaac15fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:57:24.239 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:24.240+0000 7ffaa9400640 1 --2- 172.21.15.72:0/3335488487 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffaac1458b0 0x7ffaac15fbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:24.239 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:24.240+0000 7ffaa9400640 1 -- 172.21.15.72:0/3335488487 >> v1:172.21.15.72:6789/0 conn(0x7ffaac06c9c0 legacy=0x7ffaac0744d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:24.239 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:24.240+0000 7ffaa9400640 1 -- 172.21.15.72:0/3335488487 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffaac0cb6d0 con 0x7ffaac160100 2024-04-04T06:57:24.240 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:24.241+0000 7ffaa9400640 1 --2- 172.21.15.72:0/3335488487 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffaac160100 0x7ffaac06c480 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7ffa980097a0 tx=0x7ffa9802b820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d110301db75067f6 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:24.240 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:24.241+0000 7ffaa8a00640 1 -- 172.21.15.72:0/3335488487 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa98031780 con 0x7ffaac160100 2024-04-04T06:57:24.240 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:24.241+0000 7ffaa8a00640 1 -- 172.21.15.72:0/3335488487 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa98037070 con 0x7ffaac160100 2024-04-04T06:57:24.240 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:24.241+0000 7ffaa8a00640 1 -- 172.21.15.72:0/3335488487 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa98031b40 con 0x7ffaac160100 2024-04-04T06:57:24.241 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:24.242+0000 7ffaab200640 1 -- 172.21.15.72:0/3335488487 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffaac160100 msgr2=0x7ffaac06c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:24.241 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:24.242+0000 7ffaab200640 1 --2- 172.21.15.72:0/3335488487 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffaac160100 0x7ffaac06c480 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7ffa980097a0 tx=0x7ffa9802b820 comp rx=0 tx=0).stop 2024-04-04T06:57:24.241 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:24.243+0000 7ffaab200640 1 -- 172.21.15.72:0/3335488487 shutdown_connections 2024-04-04T06:57:24.242 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:24.243+0000 7ffaab200640 1 --2- 172.21.15.72:0/3335488487 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffaac160100 0x7ffaac06c480 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:24.242 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:24.243+0000 7ffaab200640 1 --2- 172.21.15.72:0/3335488487 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffaac1458b0 0x7ffaac15fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:24.242 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:24.243+0000 7ffaab200640 1 -- 172.21.15.72:0/3335488487 >> 172.21.15.72:0/3335488487 conn(0x7ffaac072360 msgr2=0x7ffaac072770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:24.242 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:24.243+0000 7ffaab200640 1 -- 172.21.15.72:0/3335488487 shutdown_connections 2024-04-04T06:57:24.242 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:24.243+0000 7ffaab200640 1 -- 172.21.15.72:0/3335488487 wait complete. 2024-04-04T06:57:24.243 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:24.245+0000 7ffaab200640 1 Processor -- start 2024-04-04T06:57:24.244 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:24.245+0000 7ffaab200640 1 -- start start 2024-04-04T06:57:24.246 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:24.246+0000 7ffaab200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffaac06c9c0 0x7ffaac0b3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:24.246 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:24.246+0000 7ffaab200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffaac1458b0 0x7ffaac06bc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:24.247 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:24.246+0000 7ffaab200640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffaac160100 0x7ffaac0b62e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:24.247 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:24.246+0000 7ffaab200640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7ffaac0ced30 con 0x7ffaac160100 2024-04-04T06:57:24.247 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:24.246+0000 7ffaab200640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7ffaac0cea50 con 0x7ffaac06c9c0 2024-04-04T06:57:24.247 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:24.246+0000 7ffaab200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7ffaac145c90 con 0x7ffaac1458b0 2024-04-04T06:57:24.247 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:24.247+0000 7ffaaa800640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffaac160100 0x7ffaac0b62e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:24.247 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:24.247+0000 7ffaaa800640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffaac160100 0x7ffaac0b62e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:37316/0 (socket says 172.21.15.72:37316) 2024-04-04T06:57:24.247 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:24.247+0000 7ffaaa800640 1 -- 172.21.15.72:0/2880646756 learned_addr learned my addr 172.21.15.72:0/2880646756 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:57:24.247 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:24.247+0000 7ffaa9400640 1 --2- 172.21.15.72:0/2880646756 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffaac1458b0 0x7ffaac06bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:24.247 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:24.247+0000 7ffaa9e00640 1 --2- 172.21.15.72:0/2880646756 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffaac06c9c0 0x7ffaac0b3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:24.247 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:24.247+0000 7ffaaa800640 1 -- 172.21.15.72:0/2880646756 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffaac1458b0 msgr2=0x7ffaac06bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:24.247 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:24.247+0000 7ffaaa800640 1 --2- 172.21.15.72:0/2880646756 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffaac1458b0 0x7ffaac06bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:24.247 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:24.247+0000 7ffaaa800640 1 -- 172.21.15.72:0/2880646756 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffaac06c9c0 msgr2=0x7ffaac0b3a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:24.248 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:24.247+0000 7ffaaa800640 1 --2- 172.21.15.72:0/2880646756 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffaac06c9c0 0x7ffaac0b3a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:24.248 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:24.247+0000 7ffaaa800640 1 -- 172.21.15.72:0/2880646756 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffaac0c5e20 con 0x7ffaac160100 2024-04-04T06:57:24.248 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:24.247+0000 7ffaa9400640 1 --2- 172.21.15.72:0/2880646756 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffaac1458b0 0x7ffaac06bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-04T06:57:24.248 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:24.247+0000 7ffaa9e00640 1 --2- 172.21.15.72:0/2880646756 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffaac06c9c0 0x7ffaac0b3a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-04T06:57:24.248 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:24.247+0000 7ffaaa800640 1 --2- 172.21.15.72:0/2880646756 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffaac160100 0x7ffaac0b62e0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7ffaa400cbf0 tx=0x7ffaa400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:24.248 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:24.248+0000 7ffaa2000640 1 -- 172.21.15.72:0/2880646756 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaa4017070 con 0x7ffaac160100 2024-04-04T06:57:24.248 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:24.248+0000 7ffaa2000640 1 -- 172.21.15.72:0/2880646756 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffaa400ad40 con 0x7ffaac160100 2024-04-04T06:57:24.248 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:24.248+0000 7ffaa2000640 1 -- 172.21.15.72:0/2880646756 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaa4012600 con 0x7ffaac160100 2024-04-04T06:57:24.248 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:24.248+0000 7ffaab200640 1 -- 172.21.15.72:0/2880646756 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffaac0c6100 con 0x7ffaac160100 2024-04-04T06:57:24.248 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:24.248+0000 7ffaab200640 1 -- 172.21.15.72:0/2880646756 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffaac0c66c0 con 0x7ffaac160100 2024-04-04T06:57:24.249 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:24.249+0000 7ffaab200640 1 -- 172.21.15.72:0/2880646756 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffaac0685a0 con 0x7ffaac160100 2024-04-04T06:57:24.249 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:24.250+0000 7ffaa2000640 1 -- 172.21.15.72:0/2880646756 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ffaa401a070 con 0x7ffaac160100 2024-04-04T06:57:24.250 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:24.252+0000 7ffaa2000640 1 --2- 172.21.15.72:0/2880646756 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7ffa8c06c8f0 0x7ffa8c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:24.250 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:24.252+0000 7ffaa2000640 1 -- 172.21.15.72:0/2880646756 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7ffaa408b810 con 0x7ffaac160100 2024-04-04T06:57:24.250 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:24.252+0000 7ffaa9e00640 1 --2- 172.21.15.72:0/2880646756 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7ffa8c06c8f0 0x7ffa8c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:24.251 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:24.252+0000 7ffaa9e00640 1 --2- 172.21.15.72:0/2880646756 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7ffa8c06c8f0 0x7ffa8c06edb0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7ffa9c009ac0 tx=0x7ffa9c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:24.255 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:24.256+0000 7ffaa2000640 1 -- 172.21.15.72:0/2880646756 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7ffaa4059600 con 0x7ffaac160100 2024-04-04T06:57:24.460 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:24.461+0000 7ffaab200640 1 -- 172.21.15.72:0/2880646756 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7ffaac073490 con 0x7ffaac160100 2024-04-04T06:57:24.461 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:24.462+0000 7ffaa2000640 1 -- 172.21.15.72:0/2880646756 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) ==== 104+0+11 (secure 0 0 0) 0x7ffaa405d900 con 0x7ffaac160100 2024-04-04T06:57:24.461 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2024-04-04T06:57:24.464 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:24.465+0000 7ffaab200640 1 -- 172.21.15.72:0/2880646756 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7ffa8c06c8f0 msgr2=0x7ffa8c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:24.464 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:24.465+0000 7ffaab200640 1 --2- 172.21.15.72:0/2880646756 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7ffa8c06c8f0 0x7ffa8c06edb0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7ffa9c009ac0 tx=0x7ffa9c008040 comp rx=0 tx=0).stop 2024-04-04T06:57:24.465 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:24.465+0000 7ffaab200640 1 -- 172.21.15.72:0/2880646756 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffaac160100 msgr2=0x7ffaac0b62e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:24.465 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:24.465+0000 7ffaab200640 1 --2- 172.21.15.72:0/2880646756 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffaac160100 0x7ffaac0b62e0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7ffaa400cbf0 tx=0x7ffaa400a430 comp rx=0 tx=0).stop 2024-04-04T06:57:24.465 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:24.465+0000 7ffaab200640 1 -- 172.21.15.72:0/2880646756 shutdown_connections 2024-04-04T06:57:24.465 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:24.465+0000 7ffaab200640 1 --2- 172.21.15.72:0/2880646756 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7ffa8c06c8f0 0x7ffa8c06edb0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:24.465 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:24.465+0000 7ffaab200640 1 --2- 172.21.15.72:0/2880646756 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffaac160100 0x7ffaac0b62e0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:24.465 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:24.465+0000 7ffaab200640 1 --2- 172.21.15.72:0/2880646756 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffaac1458b0 0x7ffaac06bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:24.465 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:24.465+0000 7ffaab200640 1 --2- 172.21.15.72:0/2880646756 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffaac06c9c0 0x7ffaac0b3a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:24.465 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:24.465+0000 7ffaab200640 1 -- 172.21.15.72:0/2880646756 >> 172.21.15.72:0/2880646756 conn(0x7ffaac072360 msgr2=0x7ffaac0b2020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:24.465 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:24.465+0000 7ffaab200640 1 -- 172.21.15.72:0/2880646756 shutdown_connections 2024-04-04T06:57:24.465 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:24.465+0000 7ffaab200640 1 -- 172.21.15.72:0/2880646756 wait complete. 2024-04-04T06:57:24.483 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-04T06:57:24.698 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:24.700+0000 7f01fd800640 1 Processor -- start 2024-04-04T06:57:24.699 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:24.700+0000 7f01fd800640 1 -- start start 2024-04-04T06:57:24.700 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:24.701+0000 7f01fd800640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f01f80b6aa0 0x7f01f80d2410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:24.700 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:24.701+0000 7f01fd800640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f01f80d2950 0x7f01f80b7520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:24.700 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:24.701+0000 7f01fd800640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f01f80d3100 con 0x7f01f815e6c0 2024-04-04T06:57:24.700 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:24.701+0000 7f01fd800640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f01f815eaa0 con 0x7f01f80b6aa0 2024-04-04T06:57:24.700 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:24.701+0000 7f01fd800640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f01f80d33e0 con 0x7f01f80d2950 2024-04-04T06:57:24.700 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:24.702+0000 7f01efe00640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f01f80b6aa0 0x7f01f80d2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:24.701 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:24.702+0000 7f01efe00640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f01f80b6aa0 0x7f01f80d2410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:37320/0 (socket says 172.21.15.72:37320) 2024-04-04T06:57:24.701 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:24.702+0000 7f01efe00640 1 -- 172.21.15.72:0/3003389075 learned_addr learned my addr 172.21.15.72:0/3003389075 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:57:24.702 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:24.702+0000 7f01efe00640 1 -- 172.21.15.72:0/3003389075 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f01f80d2950 msgr2=0x7f01f80b7520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:57:24.702 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:24.702+0000 7f01f7400640 1 --2- 172.21.15.72:0/3003389075 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f01f80d2950 0x7f01f80b7520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:24.702 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:24.702+0000 7f01efe00640 1 --2- 172.21.15.72:0/3003389075 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f01f80d2950 0x7f01f80b7520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:24.702 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:24.702+0000 7f01efe00640 1 -- 172.21.15.72:0/3003389075 >> v1:172.21.15.117:6789/0 conn(0x7f01f815e6c0 legacy=0x7f01f80b6390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:57:24.702 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:24.702+0000 7f01efe00640 1 -- 172.21.15.72:0/3003389075 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01f80d36c0 con 0x7f01f80b6aa0 2024-04-04T06:57:24.702 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:24.702+0000 7f01f7400640 1 --2- 172.21.15.72:0/3003389075 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f01f80d2950 0x7f01f80b7520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-04T06:57:24.702 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:24.703+0000 7f01efe00640 1 --2- 172.21.15.72:0/3003389075 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f01f80b6aa0 0x7f01f80d2410 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f01e0009870 tx=0x7f01e002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=153e9f312f90b041 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:24.703 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:24.704+0000 7f01f6000640 1 -- 172.21.15.72:0/3003389075 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01e0035020 con 0x7f01f80b6aa0 2024-04-04T06:57:24.703 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:24.704+0000 7f01f6000640 1 -- 172.21.15.72:0/3003389075 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01e0031640 con 0x7f01f80b6aa0 2024-04-04T06:57:24.703 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:24.704+0000 7f01f6000640 1 -- 172.21.15.72:0/3003389075 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01e002d040 con 0x7f01f80b6aa0 2024-04-04T06:57:24.703 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:24.704+0000 7f01fd800640 1 -- 172.21.15.72:0/3003389075 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f01f80b6aa0 msgr2=0x7f01f80d2410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:24.703 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:24.704+0000 7f01fd800640 1 --2- 172.21.15.72:0/3003389075 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f01f80b6aa0 0x7f01f80d2410 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f01e0009870 tx=0x7f01e002b8f0 comp rx=0 tx=0).stop 2024-04-04T06:57:24.703 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:24.704+0000 7f01fd800640 1 -- 172.21.15.72:0/3003389075 shutdown_connections 2024-04-04T06:57:24.703 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:24.704+0000 7f01fd800640 1 --2- 172.21.15.72:0/3003389075 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f01f80d2950 0x7f01f80b7520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:24.703 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:24.704+0000 7f01fd800640 1 --2- 172.21.15.72:0/3003389075 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f01f80b6aa0 0x7f01f80d2410 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:24.703 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:24.704+0000 7f01fd800640 1 -- 172.21.15.72:0/3003389075 >> 172.21.15.72:0/3003389075 conn(0x7f01f8071e80 msgr2=0x7f01f8072290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:24.704 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:24.704+0000 7f01fd800640 1 -- 172.21.15.72:0/3003389075 shutdown_connections 2024-04-04T06:57:24.704 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:24.705+0000 7f01fd800640 1 -- 172.21.15.72:0/3003389075 wait complete. 2024-04-04T06:57:24.705 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:24.706+0000 7f01fd800640 1 Processor -- start 2024-04-04T06:57:24.705 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:24.706+0000 7f01fd800640 1 -- start start 2024-04-04T06:57:24.706 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:24.707+0000 7f01fd800640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f01f80b6aa0 0x7f01f81f7410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:24.706 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:24.707+0000 7f01fd800640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f01f80d2950 0x7f01f81f5770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:24.706 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:24.707+0000 7f01fd800640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f01f815e6c0 0x7f01f8160850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:24.706 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:24.707+0000 7f01fd800640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f01f80d2d80 con 0x7f01f815e6c0 2024-04-04T06:57:24.706 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:24.707+0000 7f01fd800640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f01f80d3c80 con 0x7f01f80d2950 2024-04-04T06:57:24.706 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:24.707+0000 7f01fd800640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f01f80b7a60 con 0x7f01f80b6aa0 2024-04-04T06:57:24.706 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:24.707+0000 7f01f7400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f01f815e6c0 0x7f01f8160850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:24.706 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:24.707+0000 7f01f7400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f01f815e6c0 0x7f01f8160850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:37334/0 (socket says 172.21.15.72:37334) 2024-04-04T06:57:24.707 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:24.708+0000 7f01f7400640 1 -- 172.21.15.72:0/865823670 learned_addr learned my addr 172.21.15.72:0/865823670 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:57:24.708 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:24.708+0000 7f01f7400640 1 -- 172.21.15.72:0/865823670 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f01f80b6aa0 msgr2=0x7f01f81f7410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:24.708 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:24.708+0000 7f01f6a00640 1 --2- 172.21.15.72:0/865823670 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f01f80b6aa0 0x7f01f81f7410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:24.708 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:24.708+0000 7f01efe00640 1 --2- 172.21.15.72:0/865823670 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f01f80d2950 0x7f01f81f5770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:24.708 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:24.708+0000 7f01f7400640 1 --2- 172.21.15.72:0/865823670 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f01f80b6aa0 0x7f01f81f7410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:24.708 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:24.708+0000 7f01f7400640 1 -- 172.21.15.72:0/865823670 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f01f80d2950 msgr2=0x7f01f81f5770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:24.708 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:24.708+0000 7f01f7400640 1 --2- 172.21.15.72:0/865823670 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f01f80d2950 0x7f01f81f5770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:24.708 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:24.708+0000 7f01f7400640 1 -- 172.21.15.72:0/865823670 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01f81f7950 con 0x7f01f815e6c0 2024-04-04T06:57:24.708 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:24.708+0000 7f01f6a00640 1 --2- 172.21.15.72:0/865823670 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f01f80b6aa0 0x7f01f81f7410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-04T06:57:24.708 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:24.708+0000 7f01f7400640 1 --2- 172.21.15.72:0/865823670 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f01f815e6c0 0x7f01f8160850 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f01f000ce40 tx=0x7f01f000a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:24.709 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:24.709+0000 7f01eea00640 1 -- 172.21.15.72:0/865823670 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01f001a070 con 0x7f01f815e6c0 2024-04-04T06:57:24.709 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:24.709+0000 7f01eea00640 1 -- 172.21.15.72:0/865823670 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01f000d840 con 0x7f01f815e6c0 2024-04-04T06:57:24.709 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:24.709+0000 7f01eea00640 1 -- 172.21.15.72:0/865823670 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01f000dc30 con 0x7f01f815e6c0 2024-04-04T06:57:24.709 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:24.709+0000 7f01fd800640 1 -- 172.21.15.72:0/865823670 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01f81563a0 con 0x7f01f815e6c0 2024-04-04T06:57:24.709 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:24.709+0000 7f01fd800640 1 -- 172.21.15.72:0/865823670 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01f8156960 con 0x7f01f815e6c0 2024-04-04T06:57:24.709 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:24.710+0000 7f01fd800640 1 -- 172.21.15.72:0/865823670 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01f8075730 con 0x7f01f815e6c0 2024-04-04T06:57:24.710 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:24.711+0000 7f01eea00640 1 -- 172.21.15.72:0/865823670 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f01f001d070 con 0x7f01f815e6c0 2024-04-04T06:57:24.711 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:24.712+0000 7f01eea00640 1 --2- 172.21.15.72:0/865823670 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f01d406c8f0 0x7f01d406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:24.711 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:24.712+0000 7f01eea00640 1 -- 172.21.15.72:0/865823670 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f01f008c480 con 0x7f01f815e6c0 2024-04-04T06:57:24.711 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:24.712+0000 7f01f6a00640 1 --2- 172.21.15.72:0/865823670 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f01d406c8f0 0x7f01d406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:24.711 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:24.713+0000 7f01f6a00640 1 --2- 172.21.15.72:0/865823670 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f01d406c8f0 0x7f01d406edb0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f01f814fbd0 tx=0x7f01e8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:24.720 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:24.721+0000 7f01eea00640 1 -- 172.21.15.72:0/865823670 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f01f81f7950 con 0x7f01f815e6c0 2024-04-04T06:57:24.918 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:24.919+0000 7f01fd800640 1 -- 172.21.15.72:0/865823670 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f01f80b98e0 con 0x7f01f815e6c0 2024-04-04T06:57:24.919 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:24.920+0000 7f01eea00640 1 -- 172.21.15.72:0/865823670 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) ==== 100+0+11 (secure 0 0 0) 0x7f01f005a790 con 0x7f01f815e6c0 2024-04-04T06:57:24.919 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 64 2024-04-04T06:57:24.922 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:24.923+0000 7f01fd800640 1 -- 172.21.15.72:0/865823670 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f01d406c8f0 msgr2=0x7f01d406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:24.922 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:24.923+0000 7f01fd800640 1 --2- 172.21.15.72:0/865823670 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f01d406c8f0 0x7f01d406edb0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f01f814fbd0 tx=0x7f01e8008040 comp rx=0 tx=0).stop 2024-04-04T06:57:24.922 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:24.923+0000 7f01fd800640 1 -- 172.21.15.72:0/865823670 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f01f815e6c0 msgr2=0x7f01f8160850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:24.922 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:24.923+0000 7f01fd800640 1 --2- 172.21.15.72:0/865823670 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f01f815e6c0 0x7f01f8160850 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f01f000ce40 tx=0x7f01f000a710 comp rx=0 tx=0).stop 2024-04-04T06:57:24.922 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:24.923+0000 7f01fd800640 1 -- 172.21.15.72:0/865823670 shutdown_connections 2024-04-04T06:57:24.922 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:24.923+0000 7f01fd800640 1 --2- 172.21.15.72:0/865823670 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f01d406c8f0 0x7f01d406edb0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:24.922 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:24.923+0000 7f01fd800640 1 --2- 172.21.15.72:0/865823670 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f01f815e6c0 0x7f01f8160850 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:24.922 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:24.923+0000 7f01fd800640 1 --2- 172.21.15.72:0/865823670 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f01f80d2950 0x7f01f81f5770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:24.922 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:24.923+0000 7f01fd800640 1 --2- 172.21.15.72:0/865823670 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f01f80b6aa0 0x7f01f81f7410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:24.922 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:24.923+0000 7f01fd800640 1 -- 172.21.15.72:0/865823670 >> 172.21.15.72:0/865823670 conn(0x7f01f8071e80 msgr2=0x7f01f80b7f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:24.923 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:24.923+0000 7f01fd800640 1 -- 172.21.15.72:0/865823670 shutdown_connections 2024-04-04T06:57:24.923 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:24.923+0000 7f01fd800640 1 -- 172.21.15.72:0/865823670 wait complete. 2024-04-04T06:57:24.941 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-04T06:57:25.148 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:25.149+0000 7fe2da400640 1 Processor -- start 2024-04-04T06:57:25.148 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:25.149+0000 7fe2da400640 1 -- start start 2024-04-04T06:57:25.150 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:25.151+0000 7fe2da400640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe2d4156a80 0x7fe2d406c480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:25.150 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:25.151+0000 7fe2da400640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe2d413ff00 con 0x7fe2d415fdb0 2024-04-04T06:57:25.150 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:25.151+0000 7fe2da400640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe2d41602b0 con 0x7fe2d41566a0 2024-04-04T06:57:25.150 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:25.151+0000 7fe2da400640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7fe2d40cb8c0 con 0x7fe2d4156a80 2024-04-04T06:57:25.150 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:25.151+0000 7fe2caa00640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe2d4156a80 0x7fe2d406c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:25.150 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:25.151+0000 7fe2d3e00640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fe2d415fdb0 0x7fe2d415cc80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:40170/0 (socket says 172.21.15.72:40170) 2024-04-04T06:57:25.150 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:25.151+0000 7fe2d3e00640 1 -- 172.21.15.72:0/1566989592 learned_addr learned my addr 172.21.15.72:0/1566989592 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-04-04T06:57:25.151 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:25.152+0000 7fe2caa00640 1 -- 172.21.15.72:0/1566989592 >> v1:172.21.15.117:6789/0 conn(0x7fe2d41566a0 legacy=0x7fe2d4142370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:25.151 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:25.152+0000 7fe2caa00640 1 -- 172.21.15.72:0/1566989592 >> v1:172.21.15.72:6789/0 conn(0x7fe2d415fdb0 legacy=0x7fe2d415cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:25.151 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:25.152+0000 7fe2caa00640 1 -- 172.21.15.72:0/1566989592 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2d4160590 con 0x7fe2d4156a80 2024-04-04T06:57:25.152 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:25.153+0000 7fe2caa00640 1 --2- 172.21.15.72:0/1566989592 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe2d4156a80 0x7fe2d406c480 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fe2bc0097a0 tx=0x7fe2bc02b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff5716c95fd98acc server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:25.153 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:25.153+0000 7fe2d2a00640 1 -- 172.21.15.72:0/1566989592 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2bc034070 con 0x7fe2d4156a80 2024-04-04T06:57:25.153 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:25.153+0000 7fe2d2a00640 1 -- 172.21.15.72:0/1566989592 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2bc030610 con 0x7fe2d4156a80 2024-04-04T06:57:25.153 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:25.153+0000 7fe2d2a00640 1 -- 172.21.15.72:0/1566989592 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2bc0309e0 con 0x7fe2d4156a80 2024-04-04T06:57:25.154 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:25.154+0000 7fe2da400640 1 -- 172.21.15.72:0/1566989592 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe2d4156a80 msgr2=0x7fe2d406c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:25.155 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:25.154+0000 7fe2da400640 1 --2- 172.21.15.72:0/1566989592 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe2d4156a80 0x7fe2d406c480 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fe2bc0097a0 tx=0x7fe2bc02b960 comp rx=0 tx=0).stop 2024-04-04T06:57:25.155 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:25.154+0000 7fe2da400640 1 -- 172.21.15.72:0/1566989592 shutdown_connections 2024-04-04T06:57:25.155 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:25.154+0000 7fe2da400640 1 --2- 172.21.15.72:0/1566989592 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe2d4156a80 0x7fe2d406c480 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:25.155 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:25.154+0000 7fe2da400640 1 -- 172.21.15.72:0/1566989592 >> 172.21.15.72:0/1566989592 conn(0x7fe2d4072470 msgr2=0x7fe2d4072880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:25.155 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:25.154+0000 7fe2da400640 1 -- 172.21.15.72:0/1566989592 shutdown_connections 2024-04-04T06:57:25.155 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:25.154+0000 7fe2da400640 1 -- 172.21.15.72:0/1566989592 wait complete. 2024-04-04T06:57:25.155 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:25.156+0000 7fe2da400640 1 Processor -- start 2024-04-04T06:57:25.155 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:25.156+0000 7fe2da400640 1 -- start start 2024-04-04T06:57:25.157 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:25.157+0000 7fe2da400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe2d41566a0 0x7fe2d4138910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:25.157 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:25.157+0000 7fe2da400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe2d4156a80 0x7fe2d415f420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:25.157 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:25.157+0000 7fe2da400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe2d415fdb0 0x7fe2d415ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:25.158 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:25.157+0000 7fe2da400640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fe2d4160b50 con 0x7fe2d41566a0 2024-04-04T06:57:25.158 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:25.157+0000 7fe2da400640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fe2d415c7c0 con 0x7fe2d4156a80 2024-04-04T06:57:25.158 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:25.157+0000 7fe2da400640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fe2d413f930 con 0x7fe2d415fdb0 2024-04-04T06:57:25.158 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:25.157+0000 7fe2d3400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe2d41566a0 0x7fe2d4138910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:25.158 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:25.157+0000 7fe2d3400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe2d41566a0 0x7fe2d4138910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:37352/0 (socket says 172.21.15.72:37352) 2024-04-04T06:57:25.158 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:25.157+0000 7fe2d3400640 1 -- 172.21.15.72:0/537271216 learned_addr learned my addr 172.21.15.72:0/537271216 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:57:25.158 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:25.158+0000 7fe2caa00640 1 --2- 172.21.15.72:0/537271216 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe2d4156a80 0x7fe2d415f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:25.158 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:25.158+0000 7fe2d3e00640 1 --2- 172.21.15.72:0/537271216 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe2d415fdb0 0x7fe2d415ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:25.158 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:25.158+0000 7fe2d3400640 1 -- 172.21.15.72:0/537271216 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe2d415fdb0 msgr2=0x7fe2d415ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:25.158 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:25.158+0000 7fe2d3400640 1 --2- 172.21.15.72:0/537271216 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe2d415fdb0 0x7fe2d415ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:25.158 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:25.158+0000 7fe2d3400640 1 -- 172.21.15.72:0/537271216 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe2d4156a80 msgr2=0x7fe2d415f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:25.158 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:25.158+0000 7fe2d3400640 1 --2- 172.21.15.72:0/537271216 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe2d4156a80 0x7fe2d415f420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:25.158 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:25.158+0000 7fe2d3400640 1 -- 172.21.15.72:0/537271216 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2d4138e50 con 0x7fe2d41566a0 2024-04-04T06:57:25.159 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:25.158+0000 7fe2d3e00640 1 --2- 172.21.15.72:0/537271216 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe2d415fdb0 0x7fe2d415ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-04T06:57:25.159 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:25.158+0000 7fe2d3400640 1 --2- 172.21.15.72:0/537271216 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe2d41566a0 0x7fe2d4138910 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fe2c400c730 tx=0x7fe2c400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:25.159 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:25.158+0000 7fe2cbe00640 1 -- 172.21.15.72:0/537271216 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2c4016020 con 0x7fe2d41566a0 2024-04-04T06:57:25.159 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:25.158+0000 7fe2cbe00640 1 -- 172.21.15.72:0/537271216 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2c4006d50 con 0x7fe2d41566a0 2024-04-04T06:57:25.159 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:25.158+0000 7fe2cbe00640 1 -- 172.21.15.72:0/537271216 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2c4003bb0 con 0x7fe2d41566a0 2024-04-04T06:57:25.159 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:25.159+0000 7fe2da400640 1 -- 172.21.15.72:0/537271216 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2d40cf040 con 0x7fe2d41566a0 2024-04-04T06:57:25.159 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:25.159+0000 7fe2da400640 1 -- 172.21.15.72:0/537271216 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2d40cf600 con 0x7fe2d41566a0 2024-04-04T06:57:25.160 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:25.160+0000 7fe2da400640 1 -- 172.21.15.72:0/537271216 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2d4075840 con 0x7fe2d41566a0 2024-04-04T06:57:25.160 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:25.161+0000 7fe2cbe00640 1 -- 172.21.15.72:0/537271216 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe2c400a850 con 0x7fe2d41566a0 2024-04-04T06:57:25.160 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:25.162+0000 7fe2cbe00640 1 --2- 172.21.15.72:0/537271216 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fe2b006c8f0 0x7fe2b006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:25.160 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:25.162+0000 7fe2cbe00640 1 -- 172.21.15.72:0/537271216 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7fe2c408b8c0 con 0x7fe2d41566a0 2024-04-04T06:57:25.161 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:25.162+0000 7fe2caa00640 1 --2- 172.21.15.72:0/537271216 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fe2b006c8f0 0x7fe2b006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:25.161 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:25.163+0000 7fe2caa00640 1 --2- 172.21.15.72:0/537271216 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fe2b006c8f0 0x7fe2b006edb0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fe2bc036000 tx=0x7fe2bc03b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:25.169 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:25.171+0000 7fe2cbe00640 1 -- 172.21.15.72:0/537271216 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fe2c4020020 con 0x7fe2d41566a0 2024-04-04T06:57:25.383 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:25.384+0000 7fe2da400640 1 -- 172.21.15.72:0/537271216 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fe2d40c7cc0 con 0x7fe2d41566a0 2024-04-04T06:57:25.383 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:25.385+0000 7fe2cbe00640 1 -- 172.21.15.72:0/537271216 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v22) ==== 80+0+0 (secure 0 0 0) 0x7fe2c4019310 con 0x7fe2d41566a0 2024-04-04T06:57:25.383 INFO:teuthology.orchestra.run.smithi072.stderr:listed 0 entries 2024-04-04T06:57:25.387 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:25.388+0000 7fe2da400640 1 -- 172.21.15.72:0/537271216 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fe2b006c8f0 msgr2=0x7fe2b006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:25.387 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:25.388+0000 7fe2da400640 1 --2- 172.21.15.72:0/537271216 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fe2b006c8f0 0x7fe2b006edb0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fe2bc036000 tx=0x7fe2bc03b040 comp rx=0 tx=0).stop 2024-04-04T06:57:25.387 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:25.388+0000 7fe2da400640 1 -- 172.21.15.72:0/537271216 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe2d41566a0 msgr2=0x7fe2d4138910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:25.387 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:25.388+0000 7fe2da400640 1 --2- 172.21.15.72:0/537271216 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe2d41566a0 0x7fe2d4138910 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fe2c400c730 tx=0x7fe2c400cbf0 comp rx=0 tx=0).stop 2024-04-04T06:57:25.387 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:25.388+0000 7fe2da400640 1 -- 172.21.15.72:0/537271216 shutdown_connections 2024-04-04T06:57:25.387 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:25.388+0000 7fe2da400640 1 --2- 172.21.15.72:0/537271216 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fe2b006c8f0 0x7fe2b006edb0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:25.387 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:25.388+0000 7fe2da400640 1 --2- 172.21.15.72:0/537271216 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe2d415fdb0 0x7fe2d415ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:25.387 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:25.388+0000 7fe2da400640 1 --2- 172.21.15.72:0/537271216 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe2d4156a80 0x7fe2d415f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:25.388 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:25.388+0000 7fe2da400640 1 --2- 172.21.15.72:0/537271216 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe2d41566a0 0x7fe2d4138910 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:25.388 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:25.388+0000 7fe2da400640 1 -- 172.21.15.72:0/537271216 >> 172.21.15.72:0/537271216 conn(0x7fe2d4072470 msgr2=0x7fe2d40b0d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:25.388 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:25.388+0000 7fe2da400640 1 -- 172.21.15.72:0/537271216 shutdown_connections 2024-04-04T06:57:25.388 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:25.388+0000 7fe2da400640 1 -- 172.21.15.72:0/537271216 wait complete. 2024-04-04T06:57:25.406 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-04-04T06:57:25.406 DEBUG:teuthology.orchestra.run.smithi072:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-04T06:57:25.452 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-04T06:57:25.707 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:25.708+0000 7ff873400640 1 Processor -- start 2024-04-04T06:57:25.707 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:25.708+0000 7ff873400640 1 -- start start 2024-04-04T06:57:25.708 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:25.709+0000 7ff873400640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff86c15b230 0x7ff86c0d00c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:25.709 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:25.709+0000 7ff873400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff86c0c5700 0x7ff86c0b3540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:25.709 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:25.709+0000 7ff873400640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff86c0c5c00 con 0x7ff86c0d0600 2024-04-04T06:57:25.709 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:25.709+0000 7ff873400640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7ff86c15c2b0 con 0x7ff86c15b230 2024-04-04T06:57:25.709 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:25.709+0000 7ff873400640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7ff86c0d0a40 con 0x7ff86c0c5700 2024-04-04T06:57:25.709 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:25.710+0000 7ff86be00640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7ff86c0d0600 0x7ff86c0c4ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:40186/0 (socket says 172.21.15.72:40186) 2024-04-04T06:57:25.709 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:25.710+0000 7ff86be00640 1 -- 172.21.15.72:0/2779640421 learned_addr learned my addr 172.21.15.72:0/2779640421 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-04-04T06:57:25.709 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:25.710+0000 7ff870a00640 1 --2- 172.21.15.72:0/2779640421 >> v2:172.21.15.72:3300/0 conn(0x7ff86c15b230 0x7ff86c0d00c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:25.709 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:25.710+0000 7ff871400640 1 --2- 172.21.15.72:0/2779640421 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff86c0c5700 0x7ff86c0b3540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:25.710 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:25.710+0000 7ff870a00640 1 -- 172.21.15.72:0/2779640421 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff86c0c5700 msgr2=0x7ff86c0b3540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:57:25.710 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:25.710+0000 7ff870a00640 1 --2- 172.21.15.72:0/2779640421 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff86c0c5700 0x7ff86c0b3540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:25.710 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:25.710+0000 7ff870a00640 1 -- 172.21.15.72:0/2779640421 >> v1:172.21.15.72:6789/0 conn(0x7ff86c0d0600 legacy=0x7ff86c0c4ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:25.710 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:25.710+0000 7ff870a00640 1 -- 172.21.15.72:0/2779640421 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff86c15b980 con 0x7ff86c15b230 2024-04-04T06:57:25.711 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:25.712+0000 7ff870a00640 1 --2- 172.21.15.72:0/2779640421 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff86c15b230 0x7ff86c0d00c0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7ff8540097a0 tx=0x7ff85402b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffee5919f281e82c server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:25.711 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:25.713+0000 7ff86b400640 1 -- 172.21.15.72:0/2779640421 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff854035020 con 0x7ff86c15b230 2024-04-04T06:57:25.711 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:25.713+0000 7ff86b400640 1 -- 172.21.15.72:0/2779640421 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff854031810 con 0x7ff86c15b230 2024-04-04T06:57:25.712 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:25.713+0000 7ff86b400640 1 -- 172.21.15.72:0/2779640421 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff854031be0 con 0x7ff86c15b230 2024-04-04T06:57:25.712 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:25.714+0000 7ff873400640 1 -- 172.21.15.72:0/2779640421 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff86c15b230 msgr2=0x7ff86c0d00c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:25.713 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:25.714+0000 7ff873400640 1 --2- 172.21.15.72:0/2779640421 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff86c15b230 0x7ff86c0d00c0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7ff8540097a0 tx=0x7ff85402b8b0 comp rx=0 tx=0).stop 2024-04-04T06:57:25.713 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:25.714+0000 7ff873400640 1 -- 172.21.15.72:0/2779640421 shutdown_connections 2024-04-04T06:57:25.713 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:25.714+0000 7ff873400640 1 --2- 172.21.15.72:0/2779640421 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff86c0c5700 0x7ff86c0b3540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:25.713 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:25.714+0000 7ff873400640 1 --2- 172.21.15.72:0/2779640421 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff86c15b230 0x7ff86c0d00c0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:25.713 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:25.714+0000 7ff873400640 1 -- 172.21.15.72:0/2779640421 >> 172.21.15.72:0/2779640421 conn(0x7ff86c06b470 msgr2=0x7ff86c06b880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:25.713 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:25.714+0000 7ff873400640 1 -- 172.21.15.72:0/2779640421 shutdown_connections 2024-04-04T06:57:25.713 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:25.714+0000 7ff873400640 1 -- 172.21.15.72:0/2779640421 wait complete. 2024-04-04T06:57:25.715 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:25.717+0000 7ff873400640 1 Processor -- start 2024-04-04T06:57:25.715 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:25.717+0000 7ff873400640 1 -- start start 2024-04-04T06:57:25.719 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:25.718+0000 7ff873400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff86c0c5700 0x7ff86c146170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:25.719 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:25.718+0000 7ff873400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff86c0d0600 0x7ff86c0c7200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:25.719 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:25.718+0000 7ff873400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff86c15b230 0x7ff86c1f5910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:25.719 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:25.718+0000 7ff873400640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7ff86c15b610 con 0x7ff86c0c5700 2024-04-04T06:57:25.719 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:25.718+0000 7ff873400640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7ff86c15bf40 con 0x7ff86c15b230 2024-04-04T06:57:25.719 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:25.718+0000 7ff873400640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7ff86c0b3a80 con 0x7ff86c0d0600 2024-04-04T06:57:25.719 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:25.719+0000 7ff870a00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff86c0c5700 0x7ff86c146170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:25.719 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:25.719+0000 7ff870a00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff86c0c5700 0x7ff86c146170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:37360/0 (socket says 172.21.15.72:37360) 2024-04-04T06:57:25.719 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:25.719+0000 7ff870a00640 1 -- 172.21.15.72:0/2898612183 learned_addr learned my addr 172.21.15.72:0/2898612183 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:57:25.719 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:25.719+0000 7ff870a00640 1 -- 172.21.15.72:0/2898612183 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff86c0d0600 msgr2=0x7ff86c0c7200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:25.719 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:25.719+0000 7ff870a00640 1 --2- 172.21.15.72:0/2898612183 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff86c0d0600 0x7ff86c0c7200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:25.719 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:25.719+0000 7ff870a00640 1 -- 172.21.15.72:0/2898612183 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff86c15b230 msgr2=0x7ff86c1f5910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:25.719 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:25.719+0000 7ff870a00640 1 --2- 172.21.15.72:0/2898612183 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff86c15b230 0x7ff86c1f5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:25.720 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:25.719+0000 7ff870a00640 1 -- 172.21.15.72:0/2898612183 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff86c0c99b0 con 0x7ff86c0c5700 2024-04-04T06:57:25.720 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:25.719+0000 7ff870a00640 1 --2- 172.21.15.72:0/2898612183 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff86c0c5700 0x7ff86c146170 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7ff8540098c0 tx=0x7ff8540046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:25.720 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:25.720+0000 7ff868c00640 1 -- 172.21.15.72:0/2898612183 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff854040070 con 0x7ff86c0c5700 2024-04-04T06:57:25.720 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:25.720+0000 7ff868c00640 1 -- 172.21.15.72:0/2898612183 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff85403e070 con 0x7ff86c0c5700 2024-04-04T06:57:25.720 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:25.720+0000 7ff873400640 1 -- 172.21.15.72:0/2898612183 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff86c0c9c90 con 0x7ff86c0c5700 2024-04-04T06:57:25.720 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:25.720+0000 7ff868c00640 1 -- 172.21.15.72:0/2898612183 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff854035040 con 0x7ff86c0c5700 2024-04-04T06:57:25.720 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:25.720+0000 7ff873400640 1 -- 172.21.15.72:0/2898612183 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff86c0716b0 con 0x7ff86c0c5700 2024-04-04T06:57:25.720 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:25.721+0000 7ff873400640 1 -- 172.21.15.72:0/2898612183 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff86c075840 con 0x7ff86c0c5700 2024-04-04T06:57:25.721 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:25.722+0000 7ff868c00640 1 -- 172.21.15.72:0/2898612183 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff854038020 con 0x7ff86c0c5700 2024-04-04T06:57:25.722 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:25.723+0000 7ff868c00640 1 --2- 172.21.15.72:0/2898612183 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7ff84806c8f0 0x7ff84806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:25.722 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:25.723+0000 7ff868c00640 1 -- 172.21.15.72:0/2898612183 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7ff8540ad500 con 0x7ff86c0c5700 2024-04-04T06:57:25.722 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:25.723+0000 7ff86be00640 1 --2- 172.21.15.72:0/2898612183 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7ff84806c8f0 0x7ff84806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:25.722 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:25.724+0000 7ff86be00640 1 --2- 172.21.15.72:0/2898612183 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7ff84806c8f0 0x7ff84806edb0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7ff85c0012e0 tx=0x7ff85c001630 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:25.726 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:25.728+0000 7ff868c00640 1 -- 172.21.15.72:0/2898612183 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7ff85407b810 con 0x7ff86c0c5700 2024-04-04T06:57:26.009 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:26.011+0000 7ff873400640 1 -- 172.21.15.72:0/2898612183 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff86c06f930 con 0x7ff86c0c5700 2024-04-04T06:57:26.012 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:26.013+0000 7ff868c00640 1 -- 172.21.15.72:0/2898612183 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16831 (secure 0 0 0) 0x7ff85407b110 con 0x7ff86c0c5700 2024-04-04T06:57:26.012 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T06:57:26.012 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":22,"fsid":"6708bac2-4f50-49b5-87a9-c390fd333eb3","created":"2024-04-04T06:56:04.282498+0000","modified":"2024-04-04T06:57:11.239134+0000","last_up_change":"2024-04-04T06:56:16.716089+0000","last_in_change":"2024-04-04T06:56:07.768593+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-04T06:56:17.421685+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-04T06:56:26.822661+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-04T06:56:27.429816+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7c345991-5af8-4dc6-a481-28610c40e128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":3889813953},{"type":"v1","addr":"172.21.15.72:6818","nonce":3889813953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":3889813953},{"type":"v1","addr":"172.21.15.72:6821","nonce":3889813953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":3889813953},{"type":"v1","addr":"172.21.15.72:6826","nonce":3889813953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":3889813953},{"type":"v1","addr":"172.21.15.72:6823","nonce":3889813953}]},"public_addr":"172.21.15.72:6818/3889813953","cluster_addr":"172.21.15.72:6821/3889813953","heartbeat_back_addr":"172.21.15.72:6826/3889813953","heartbeat_front_addr":"172.21.15.72:6823/3889813953","state":["exists","up"]},{"osd":1,"uuid":"1b3f7ab2-a56c-488d-a89a-1f3572361c95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":3101663154},{"type":"v1","addr":"172.21.15.72:6801","nonce":3101663154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":3101663154},{"type":"v1","addr":"172.21.15.72:6803","nonce":3101663154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":3101663154},{"type":"v1","addr":"172.21.15.72:6807","nonce":3101663154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":3101663154},{"type":"v1","addr":"172.21.15.72:6805","nonce":3101663154}]},"public_addr":"172.21.15.72:6801/3101663154","cluster_addr":"172.21.15.72:6803/3101663154","heartbeat_back_addr":"172.21.15.72:6807/3101663154","heartbeat_front_addr":"172.21.15.72:6805/3101663154","state":["exists","up"]},{"osd":2,"uuid":"fc9aa512-53df-40d7-ba04-3e6b7dcd1e34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":235374192},{"type":"v1","addr":"172.21.15.72:6809","nonce":235374192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":235374192},{"type":"v1","addr":"172.21.15.72:6811","nonce":235374192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":235374192},{"type":"v1","addr":"172.21.15.72:6815","nonce":235374192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":235374192},{"type":"v1","addr":"172.21.15.72:6813","nonce":235374192}]},"public_addr":"172.21.15.72:6809/235374192","cluster_addr":"172.21.15.72:6811/235374192","heartbeat_back_addr":"172.21.15.72:6815/235374192","heartbeat_front_addr":"172.21.15.72:6813/235374192","state":["exists","up"]},{"osd":3,"uuid":"b4f63eed-dc5b-4aba-bb50-de46eb41492b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6817","nonce":2806631742},{"type":"v1","addr":"172.21.15.72:6819","nonce":2806631742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":2806631742},{"type":"v1","addr":"172.21.15.72:6827","nonce":2806631742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":2806631742},{"type":"v1","addr":"172.21.15.72:6831","nonce":2806631742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":2806631742},{"type":"v1","addr":"172.21.15.72:6829","nonce":2806631742}]},"public_addr":"172.21.15.72:6819/2806631742","cluster_addr":"172.21.15.72:6827/2806631742","heartbeat_back_addr":"172.21.15.72:6831/2806631742","heartbeat_front_addr":"172.21.15.72:6829/2806631742","state":["exists","up"]},{"osd":4,"uuid":"9e985ef8-d711-4172-9286-c54e560895d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":4293536423},{"type":"v1","addr":"172.21.15.117:6825","nonce":4293536423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":4293536423},{"type":"v1","addr":"172.21.15.117:6827","nonce":4293536423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":4293536423},{"type":"v1","addr":"172.21.15.117:6831","nonce":4293536423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":4293536423},{"type":"v1","addr":"172.21.15.117:6829","nonce":4293536423}]},"public_addr":"172.21.15.117:6825/4293536423","cluster_addr":"172.21.15.117:6827/4293536423","heartbeat_back_addr":"172.21.15.117:6831/4293536423","heartbeat_front_addr":"172.21.15.117:6829/4293536423","state":["exists","up"]},{"osd":5,"uuid":"3e9f082b-8d7d-455f-8a96-66d0b4857125","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":684971679},{"type":"v1","addr":"172.21.15.117:6801","nonce":684971679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":684971679},{"type":"v1","addr":"172.21.15.117:6803","nonce":684971679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":684971679},{"type":"v1","addr":"172.21.15.117:6807","nonce":684971679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":684971679},{"type":"v1","addr":"172.21.15.117:6805","nonce":684971679}]},"public_addr":"172.21.15.117:6801/684971679","cluster_addr":"172.21.15.117:6803/684971679","heartbeat_back_addr":"172.21.15.117:6807/684971679","heartbeat_front_addr":"172.21.15.117:6805/684971679","state":["exists","up"]},{"osd":6,"uuid":"bcdafa9f-a870-4398-a38d-ab7697676473","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":2781186528},{"type":"v1","addr":"172.21.15.117:6809","nonce":2781186528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":2781186528},{"type":"v1","addr":"172.21.15.117:6811","nonce":2781186528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":2781186528},{"type":"v1","addr":"172.21.15.117:6815","nonce":2781186528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":2781186528},{"type":"v1","addr":"172.21.15.117:6813","nonce":2781186528}]},"public_addr":"172.21.15.117:6809/2781186528","cluster_addr":"172.21.15.117:6811/2781186528","heartbeat_back_addr":"172.21.15.117:6815/2781186528","heartbeat_front_addr":"172.21.15.117:6813/2781186528","state":["exists","up"]},{"osd":7,"uuid":"b68ec562-ff35-4d2d-a733-c896f8920cfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":617469882},{"type":"v1","addr":"172.21.15.117:6817","nonce":617469882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":617469882},{"type":"v1","addr":"172.21.15.117:6819","nonce":617469882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":617469882},{"type":"v1","addr":"172.21.15.117:6823","nonce":617469882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":617469882},{"type":"v1","addr":"172.21.15.117:6821","nonce":617469882}]},"public_addr":"172.21.15.117:6817/617469882","cluster_addr":"172.21.15.117:6819/617469882","heartbeat_back_addr":"172.21.15.117:6823/617469882","heartbeat_front_addr":"172.21.15.117:6821/617469882","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.347700+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.296619+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.361345+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.093323+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:12.857605+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:12.816090+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.083163+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.121639+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.13","mappings":[{"from":7,"to":1}]},{"pgid":"3.19","mappings":[{"from":3,"to":2}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.28","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-04T06:57:26.016 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:26.016+0000 7ff873400640 1 -- 172.21.15.72:0/2898612183 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7ff84806c8f0 msgr2=0x7ff84806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:26.016 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:26.016+0000 7ff873400640 1 --2- 172.21.15.72:0/2898612183 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7ff84806c8f0 0x7ff84806edb0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7ff85c0012e0 tx=0x7ff85c001630 comp rx=0 tx=0).stop 2024-04-04T06:57:26.016 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:26.016+0000 7ff873400640 1 -- 172.21.15.72:0/2898612183 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff86c0c5700 msgr2=0x7ff86c146170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:26.016 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:26.016+0000 7ff873400640 1 --2- 172.21.15.72:0/2898612183 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff86c0c5700 0x7ff86c146170 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7ff8540098c0 tx=0x7ff8540046c0 comp rx=0 tx=0).stop 2024-04-04T06:57:26.016 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:26.017+0000 7ff873400640 1 -- 172.21.15.72:0/2898612183 shutdown_connections 2024-04-04T06:57:26.016 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:26.017+0000 7ff873400640 1 --2- 172.21.15.72:0/2898612183 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7ff84806c8f0 0x7ff84806edb0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:26.016 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:26.017+0000 7ff873400640 1 --2- 172.21.15.72:0/2898612183 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff86c15b230 0x7ff86c1f5910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:26.016 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:26.017+0000 7ff873400640 1 --2- 172.21.15.72:0/2898612183 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff86c0d0600 0x7ff86c0c7200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:26.016 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:26.017+0000 7ff873400640 1 --2- 172.21.15.72:0/2898612183 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff86c0c5700 0x7ff86c146170 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:26.016 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:26.017+0000 7ff873400640 1 -- 172.21.15.72:0/2898612183 >> 172.21.15.72:0/2898612183 conn(0x7ff86c06b470 msgr2=0x7ff86c0c4ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:26.016 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:26.017+0000 7ff873400640 1 -- 172.21.15.72:0/2898612183 shutdown_connections 2024-04-04T06:57:26.016 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:26.017+0000 7ff873400640 1 -- 172.21.15.72:0/2898612183 wait complete. 2024-04-04T06:57:26.036 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-04T06:56:17.421685+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-04T06:56:26.822661+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-04T06:56:27.429816+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-04T06:57:26.037 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-04T06:57:26.248 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:26.249+0000 7f73d6800640 1 Processor -- start 2024-04-04T06:57:26.248 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:26.249+0000 7f73d6800640 1 -- start start 2024-04-04T06:57:26.252 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:26.251+0000 7f73d6800640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f73d00d0850 0x7f73d0141cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:26.252 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:26.251+0000 7f73d6800640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f73d0160b40 con 0x7f73d0142210 2024-04-04T06:57:26.253 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:26.251+0000 7f73d6800640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f73d015ffc0 con 0x7f73d01418f0 2024-04-04T06:57:26.253 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:26.251+0000 7f73d6800640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f73d01602a0 con 0x7f73d00d0850 2024-04-04T06:57:26.253 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:26.251+0000 7f73d5e00640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f73d0142210 0x7f73d015c9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:40188/0 (socket says 172.21.15.72:40188) 2024-04-04T06:57:26.253 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:26.251+0000 7f73d5e00640 1 -- 172.21.15.72:0/78048599 learned_addr learned my addr 172.21.15.72:0/78048599 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-04-04T06:57:26.253 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:26.251+0000 7f73d4a00640 1 --2- 172.21.15.72:0/78048599 >> v2:172.21.15.117:3300/0 conn(0x7f73d00d0850 0x7f73d0141cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:26.253 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:26.251+0000 7f73cfe00640 1 -- 172.21.15.72:0/78048599 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2614146337 0 0) 0x7f73d0160b40 con 0x7f73d0142210 2024-04-04T06:57:26.253 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:26.252+0000 7f73cfe00640 1 -- 172.21.15.72:0/78048599 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f73b8003520 con 0x7f73d0142210 2024-04-04T06:57:26.253 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:26.252+0000 7f73cfe00640 1 -- 172.21.15.72:0/78048599 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2670257442 0 0) 0x7f73b8003520 con 0x7f73d0142210 2024-04-04T06:57:26.253 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:26.252+0000 7f73cfe00640 1 -- 172.21.15.72:0/78048599 >> v2:172.21.15.117:3300/0 conn(0x7f73d00d0850 msgr2=0x7f73d0141cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:57:26.254 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:26.252+0000 7f73cfe00640 1 --2- 172.21.15.72:0/78048599 >> v2:172.21.15.117:3300/0 conn(0x7f73d00d0850 0x7f73d0141cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:26.254 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:26.252+0000 7f73cfe00640 1 -- 172.21.15.72:0/78048599 >> v1:172.21.15.117:6789/0 conn(0x7f73d01418f0 legacy=0x7f73d00d0140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:26.254 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:26.252+0000 7f73cfe00640 1 -- 172.21.15.72:0/78048599 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73d0160580 con 0x7f73d0142210 2024-04-04T06:57:26.254 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:26.252+0000 7f73cfe00640 1 -- 172.21.15.72:0/78048599 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2465650867 0 0) 0x7f73c80019f0 con 0x7f73d0142210 2024-04-04T06:57:26.254 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:26.252+0000 7f73d4a00640 1 --2- 172.21.15.72:0/78048599 >> v2:172.21.15.117:3300/0 conn(0x7f73d00d0850 0x7f73d0141cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-04T06:57:26.254 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:26.252+0000 7f73cfe00640 1 -- 172.21.15.72:0/78048599 >> v1:172.21.15.72:6789/0 conn(0x7f73d0142210 legacy=0x7f73d015c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:26.254 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:26.252+0000 7f73cfe00640 1 --2- 172.21.15.72:0/78048599 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f73b80039b0 0x7f73b8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:26.254 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:26.252+0000 7f73cfe00640 1 --2- 172.21.15.72:0/78048599 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f73b8004800 0x7f73b8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:26.254 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:26.252+0000 7f73cfe00640 1 --2- 172.21.15.72:0/78048599 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f73b80051c0 0x7f73b800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:26.254 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:26.252+0000 7f73cfe00640 1 -- 172.21.15.72:0/78048599 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f73d01602a0 con 0x7f73b80039b0 2024-04-04T06:57:26.254 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:26.252+0000 7f73cfe00640 1 -- 172.21.15.72:0/78048599 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f73b800c110 con 0x7f73b8004800 2024-04-04T06:57:26.254 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:26.252+0000 7f73cfe00640 1 -- 172.21.15.72:0/78048599 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f73b800c310 con 0x7f73b80051c0 2024-04-04T06:57:26.254 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:26.252+0000 7f73d5400640 1 --2- 172.21.15.72:0/78048599 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f73b80039b0 0x7f73b8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:26.255 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:26.253+0000 7f73d4a00640 1 --2- 172.21.15.72:0/78048599 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f73b8004800 0x7f73b8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:26.255 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:26.253+0000 7f73d5e00640 1 --2- 172.21.15.72:0/78048599 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f73b80051c0 0x7f73b800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:26.255 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:26.253+0000 7f73d5400640 1 -- 172.21.15.72:0/78048599 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f73b80051c0 msgr2=0x7f73b800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:57:26.255 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:26.253+0000 7f73d5400640 1 --2- 172.21.15.72:0/78048599 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f73b80051c0 0x7f73b800b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:26.255 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:26.253+0000 7f73d5400640 1 -- 172.21.15.72:0/78048599 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f73b8004800 msgr2=0x7f73b8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:57:26.255 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:26.253+0000 7f73d5400640 1 --2- 172.21.15.72:0/78048599 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f73b8004800 0x7f73b8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:26.255 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:26.253+0000 7f73d5400640 1 -- 172.21.15.72:0/78048599 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73b8003520 con 0x7f73b80039b0 2024-04-04T06:57:26.255 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:26.253+0000 7f73d4a00640 1 --2- 172.21.15.72:0/78048599 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f73b8004800 0x7f73b8004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-04T06:57:26.255 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:26.253+0000 7f73d5e00640 1 -- 172.21.15.72:0/78048599 reap_dead start 2024-04-04T06:57:26.256 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:26.255+0000 7f73d5400640 1 --2- 172.21.15.72:0/78048599 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f73b80039b0 0x7f73b8003dd0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f73c4001750 tx=0x7f73b8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=899ec12e04c0ba01 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:26.257 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:26.255+0000 7f73cfe00640 1 -- 172.21.15.72:0/78048599 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73c4001370 con 0x7f73b80039b0 2024-04-04T06:57:26.257 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:26.255+0000 7f73cfe00640 1 -- 172.21.15.72:0/78048599 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73c40052d0 con 0x7f73b80039b0 2024-04-04T06:57:26.257 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:26.255+0000 7f73cfe00640 1 -- 172.21.15.72:0/78048599 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73c4003830 con 0x7f73b80039b0 2024-04-04T06:57:26.257 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:26.255+0000 7f73d6800640 1 -- 172.21.15.72:0/78048599 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f73b80039b0 msgr2=0x7f73b8003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:26.257 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:26.255+0000 7f73d6800640 1 --2- 172.21.15.72:0/78048599 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f73b80039b0 0x7f73b8003dd0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f73c4001750 tx=0x7f73b8005830 comp rx=0 tx=0).stop 2024-04-04T06:57:26.257 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:26.256+0000 7f73d6800640 1 -- 172.21.15.72:0/78048599 shutdown_connections 2024-04-04T06:57:26.257 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:26.256+0000 7f73d6800640 1 --2- 172.21.15.72:0/78048599 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f73b80039b0 0x7f73b8003dd0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:26.257 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:26.256+0000 7f73d6800640 1 -- 172.21.15.72:0/78048599 >> 172.21.15.72:0/78048599 conn(0x7f73d006b890 msgr2=0x7f73d006bca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:26.257 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:26.256+0000 7f73d6800640 1 -- 172.21.15.72:0/78048599 shutdown_connections 2024-04-04T06:57:26.257 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:26.256+0000 7f73d6800640 1 -- 172.21.15.72:0/78048599 wait complete. 2024-04-04T06:57:26.257 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:26.257+0000 7f73d6800640 1 Processor -- start 2024-04-04T06:57:26.257 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:26.258+0000 7f73d6800640 1 -- start start 2024-04-04T06:57:26.259 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:26.258+0000 7f73d6800640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f73b80039b0 0x7f73d015b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:26.259 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:26.258+0000 7f73d6800640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f73d01e6370 0x7f73d00b4900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:26.259 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:26.258+0000 7f73d6800640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f73d0140e70 0x7f73d0138330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:26.259 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:26.258+0000 7f73d6800640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f73d015fc00 con 0x7f73d0140e70 2024-04-04T06:57:26.259 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:26.258+0000 7f73d6800640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f73d00cc9c0 con 0x7f73d01e6370 2024-04-04T06:57:26.259 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:26.258+0000 7f73d6800640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f73d015fd80 con 0x7f73b80039b0 2024-04-04T06:57:26.260 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:26.259+0000 7f73d5e00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f73d0140e70 0x7f73d0138330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:26.260 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:26.259+0000 7f73d5e00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f73d0140e70 0x7f73d0138330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:37386/0 (socket says 172.21.15.72:37386) 2024-04-04T06:57:26.260 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:26.259+0000 7f73d5e00640 1 -- 172.21.15.72:0/559707291 learned_addr learned my addr 172.21.15.72:0/559707291 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:57:26.260 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:26.259+0000 7f73d5400640 1 --2- 172.21.15.72:0/559707291 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f73b80039b0 0x7f73d015b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:26.260 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:26.259+0000 7f73d4a00640 1 --2- 172.21.15.72:0/559707291 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f73d01e6370 0x7f73d00b4900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:26.260 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:26.259+0000 7f73d5e00640 1 -- 172.21.15.72:0/559707291 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f73b80039b0 msgr2=0x7f73d015b650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:26.260 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:26.259+0000 7f73d5e00640 1 --2- 172.21.15.72:0/559707291 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f73b80039b0 0x7f73d015b650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:26.260 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:26.259+0000 7f73d5e00640 1 -- 172.21.15.72:0/559707291 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f73d01e6370 msgr2=0x7f73d00b4900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:26.260 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:26.259+0000 7f73d5e00640 1 --2- 172.21.15.72:0/559707291 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f73d01e6370 0x7f73d00b4900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:26.260 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:26.259+0000 7f73d5e00640 1 -- 172.21.15.72:0/559707291 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73d015bb90 con 0x7f73d0140e70 2024-04-04T06:57:26.260 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:26.259+0000 7f73d4a00640 1 --2- 172.21.15.72:0/559707291 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f73d01e6370 0x7f73d00b4900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-04T06:57:26.260 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:26.259+0000 7f73d5e00640 1 --2- 172.21.15.72:0/559707291 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f73d0140e70 0x7f73d0138330 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f73c8001580 tx=0x7f73c800b4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:26.260 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:26.260+0000 7f73cd600640 1 -- 172.21.15.72:0/559707291 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73c8004d60 con 0x7f73d0140e70 2024-04-04T06:57:26.260 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:26.260+0000 7f73cd600640 1 -- 172.21.15.72:0/559707291 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73c800bb00 con 0x7f73d0140e70 2024-04-04T06:57:26.261 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:26.260+0000 7f73cd600640 1 -- 172.21.15.72:0/559707291 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73c8007070 con 0x7f73d0140e70 2024-04-04T06:57:26.261 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:26.260+0000 7f73d6800640 1 -- 172.21.15.72:0/559707291 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73d00b4e40 con 0x7f73d0140e70 2024-04-04T06:57:26.261 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:26.260+0000 7f73d6800640 1 -- 172.21.15.72:0/559707291 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73d01e5f30 con 0x7f73d0140e70 2024-04-04T06:57:26.262 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:26.261+0000 7f73d6800640 1 -- 172.21.15.72:0/559707291 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f73d00756c0 con 0x7f73d0140e70 2024-04-04T06:57:26.262 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:26.262+0000 7f73cd600640 1 -- 172.21.15.72:0/559707291 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f73c801b060 con 0x7f73d0140e70 2024-04-04T06:57:26.262 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:26.263+0000 7f73cd600640 1 --2- 172.21.15.72:0/559707291 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f73b006c8f0 0x7f73b006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:26.262 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:26.263+0000 7f73cd600640 1 -- 172.21.15.72:0/559707291 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f73c808bcb0 con 0x7f73d0140e70 2024-04-04T06:57:26.262 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:26.263+0000 7f73d5400640 1 --2- 172.21.15.72:0/559707291 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f73b006c8f0 0x7f73b006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:26.263 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:26.264+0000 7f73d5400640 1 --2- 172.21.15.72:0/559707291 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f73b006c8f0 0x7f73b006edb0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f73c4033000 tx=0x7f73c4009030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:26.271 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:26.272+0000 7f73cd600640 1 -- 172.21.15.72:0/559707291 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f73d015bb90 con 0x7f73d0140e70 2024-04-04T06:57:26.477 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:26.478+0000 7f73d6800640 1 -- 172.21.15.72:0/559707291 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f73d006f250 con 0x7f73d0140e70 2024-04-04T06:57:26.478 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:26.479+0000 7f73cd600640 1 -- 172.21.15.72:0/559707291 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) ==== 93+0+10 (secure 0 0 0) 0x7f73c805a060 con 0x7f73d0140e70 2024-04-04T06:57:26.478 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 1 2024-04-04T06:57:26.481 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:26.482+0000 7f73d6800640 1 -- 172.21.15.72:0/559707291 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f73b006c8f0 msgr2=0x7f73b006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:26.481 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:26.482+0000 7f73d6800640 1 --2- 172.21.15.72:0/559707291 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f73b006c8f0 0x7f73b006edb0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f73c4033000 tx=0x7f73c4009030 comp rx=0 tx=0).stop 2024-04-04T06:57:26.481 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:26.482+0000 7f73d6800640 1 -- 172.21.15.72:0/559707291 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f73d0140e70 msgr2=0x7f73d0138330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:26.481 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:26.482+0000 7f73d6800640 1 --2- 172.21.15.72:0/559707291 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f73d0140e70 0x7f73d0138330 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f73c8001580 tx=0x7f73c800b4a0 comp rx=0 tx=0).stop 2024-04-04T06:57:26.481 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:26.482+0000 7f73d6800640 1 -- 172.21.15.72:0/559707291 shutdown_connections 2024-04-04T06:57:26.481 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:26.482+0000 7f73d6800640 1 --2- 172.21.15.72:0/559707291 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f73b006c8f0 0x7f73b006edb0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:26.482 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:26.482+0000 7f73d6800640 1 --2- 172.21.15.72:0/559707291 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f73d0140e70 0x7f73d0138330 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:26.482 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:26.482+0000 7f73d6800640 1 --2- 172.21.15.72:0/559707291 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f73d01e6370 0x7f73d00b4900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:26.482 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:26.482+0000 7f73d6800640 1 --2- 172.21.15.72:0/559707291 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f73b80039b0 0x7f73d015b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:26.482 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:26.482+0000 7f73d6800640 1 -- 172.21.15.72:0/559707291 >> 172.21.15.72:0/559707291 conn(0x7f73d006b890 msgr2=0x7f73d00cf4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:26.482 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:26.482+0000 7f73d6800640 1 -- 172.21.15.72:0/559707291 shutdown_connections 2024-04-04T06:57:26.482 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:26.482+0000 7f73d6800640 1 -- 172.21.15.72:0/559707291 wait complete. 2024-04-04T06:57:26.500 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-04T06:57:26.700 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:26.701+0000 7fc29a000640 1 Processor -- start 2024-04-04T06:57:26.700 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:26.701+0000 7fc29a000640 1 -- start start 2024-04-04T06:57:26.702 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:26.703+0000 7fc29a000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc29415e650 0x7fc2940b9e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:26.702 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:26.703+0000 7fc29a000640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc2940d4970 0x7fc2940d2e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:26.702 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:26.703+0000 7fc29a000640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc2940d13f0 con 0x7fc2940d0b80 2024-04-04T06:57:26.702 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:26.703+0000 7fc29a000640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7fc2940d29b0 con 0x7fc2940d4970 2024-04-04T06:57:26.702 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:26.703+0000 7fc29a000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fc2940d16d0 con 0x7fc29415e650 2024-04-04T06:57:26.702 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:26.703+0000 7fc28be00640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fc2940d0b80 0x7fc2940d4260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:40200/0 (socket says 172.21.15.72:40200) 2024-04-04T06:57:26.702 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:26.703+0000 7fc28be00640 1 -- 172.21.15.72:0/48588227 learned_addr learned my addr 172.21.15.72:0/48588227 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-04-04T06:57:26.702 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:26.703+0000 7fc293e00640 1 --2- 172.21.15.72:0/48588227 >> v2:172.21.15.72:3300/0 conn(0x7fc2940d4970 0x7fc2940d2e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:26.703 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:26.704+0000 7fc293400640 1 --2- 172.21.15.72:0/48588227 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc29415e650 0x7fc2940b9e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:26.703 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:26.704+0000 7fc292a00640 1 -- 172.21.15.72:0/48588227 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 286431320 0 0) 0x7fc2940d13f0 con 0x7fc2940d0b80 2024-04-04T06:57:26.703 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:26.704+0000 7fc292a00640 1 -- 172.21.15.72:0/48588227 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc278003520 con 0x7fc2940d0b80 2024-04-04T06:57:26.703 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:26.704+0000 7fc293e00640 1 -- 172.21.15.72:0/48588227 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc29415e650 msgr2=0x7fc2940b9e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:57:26.703 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:26.704+0000 7fc293e00640 1 --2- 172.21.15.72:0/48588227 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc29415e650 0x7fc2940b9e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:26.704 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:26.704+0000 7fc293e00640 1 -- 172.21.15.72:0/48588227 >> v1:172.21.15.72:6789/0 conn(0x7fc2940d0b80 legacy=0x7fc2940d4260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:26.704 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:26.704+0000 7fc293e00640 1 -- 172.21.15.72:0/48588227 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2940d19b0 con 0x7fc2940d4970 2024-04-04T06:57:26.704 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:26.704+0000 7fc293400640 1 --2- 172.21.15.72:0/48588227 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc29415e650 0x7fc2940b9e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-04T06:57:26.705 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:26.705+0000 7fc293e00640 1 --2- 172.21.15.72:0/48588227 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc2940d4970 0x7fc2940d2e40 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fc28c009d90 tx=0x7fc28c02be10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a66e9cb3b62bde4b server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:26.705 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:26.705+0000 7fc292a00640 1 -- 172.21.15.72:0/48588227 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc28c039070 con 0x7fc2940d4970 2024-04-04T06:57:26.705 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:26.705+0000 7fc292a00640 1 -- 172.21.15.72:0/48588227 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc28c02cbc0 con 0x7fc2940d4970 2024-04-04T06:57:26.705 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:26.705+0000 7fc292a00640 1 -- 172.21.15.72:0/48588227 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc28c034440 con 0x7fc2940d4970 2024-04-04T06:57:26.705 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:26.706+0000 7fc29a000640 1 -- 172.21.15.72:0/48588227 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc2940d4970 msgr2=0x7fc2940d2e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:26.705 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:26.706+0000 7fc29a000640 1 --2- 172.21.15.72:0/48588227 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc2940d4970 0x7fc2940d2e40 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fc28c009d90 tx=0x7fc28c02be10 comp rx=0 tx=0).stop 2024-04-04T06:57:26.705 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:26.706+0000 7fc29a000640 1 -- 172.21.15.72:0/48588227 shutdown_connections 2024-04-04T06:57:26.705 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:26.706+0000 7fc29a000640 1 --2- 172.21.15.72:0/48588227 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc2940d4970 0x7fc2940d2e40 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:26.705 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:26.706+0000 7fc29a000640 1 --2- 172.21.15.72:0/48588227 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc29415e650 0x7fc2940b9e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:26.706 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:26.706+0000 7fc29a000640 1 -- 172.21.15.72:0/48588227 >> 172.21.15.72:0/48588227 conn(0x7fc29406b470 msgr2=0x7fc29406b880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:26.706 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:26.706+0000 7fc29a000640 1 -- 172.21.15.72:0/48588227 shutdown_connections 2024-04-04T06:57:26.706 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:26.706+0000 7fc29a000640 1 -- 172.21.15.72:0/48588227 wait complete. 2024-04-04T06:57:26.707 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:26.709+0000 7fc29a000640 1 Processor -- start 2024-04-04T06:57:26.707 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:26.709+0000 7fc29a000640 1 -- start start 2024-04-04T06:57:26.711 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:26.711+0000 7fc29a000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc2940d0b80 0x7fc2941f7800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:26.711 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:26.711+0000 7fc29a000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc2940d4970 0x7fc294155f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:26.711 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:26.711+0000 7fc29a000640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc29415e650 0x7fc2940cbbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:26.711 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:26.711+0000 7fc29a000640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fc2940d1180 con 0x7fc29415e650 2024-04-04T06:57:26.711 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:26.711+0000 7fc29a000640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fc2940d1000 con 0x7fc2940d0b80 2024-04-04T06:57:26.711 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:26.711+0000 7fc29a000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fc2940d3380 con 0x7fc2940d4970 2024-04-04T06:57:26.711 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:26.711+0000 7fc293e00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc29415e650 0x7fc2940cbbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:26.711 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:26.711+0000 7fc293e00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc29415e650 0x7fc2940cbbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:37400/0 (socket says 172.21.15.72:37400) 2024-04-04T06:57:26.711 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:26.711+0000 7fc293e00640 1 -- 172.21.15.72:0/2923084289 learned_addr learned my addr 172.21.15.72:0/2923084289 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:57:26.711 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:26.711+0000 7fc293400640 1 --2- 172.21.15.72:0/2923084289 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc2940d0b80 0x7fc2941f7800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:26.711 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:26.711+0000 7fc28be00640 1 --2- 172.21.15.72:0/2923084289 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc2940d4970 0x7fc294155f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:26.712 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:26.711+0000 7fc293e00640 1 -- 172.21.15.72:0/2923084289 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc2940d4970 msgr2=0x7fc294155f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:26.712 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:26.711+0000 7fc293e00640 1 --2- 172.21.15.72:0/2923084289 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc2940d4970 0x7fc294155f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:26.712 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:26.711+0000 7fc293e00640 1 -- 172.21.15.72:0/2923084289 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc2940d0b80 msgr2=0x7fc2941f7800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:26.712 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:26.711+0000 7fc293e00640 1 --2- 172.21.15.72:0/2923084289 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc2940d0b80 0x7fc2941f7800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:26.712 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:26.711+0000 7fc293e00640 1 -- 172.21.15.72:0/2923084289 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2941551a0 con 0x7fc29415e650 2024-04-04T06:57:26.712 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:26.711+0000 7fc28be00640 1 --2- 172.21.15.72:0/2923084289 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc2940d4970 0x7fc294155f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-04T06:57:26.712 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:26.711+0000 7fc293400640 1 --2- 172.21.15.72:0/2923084289 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc2940d0b80 0x7fc2941f7800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-04T06:57:26.712 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:26.712+0000 7fc293e00640 1 --2- 172.21.15.72:0/2923084289 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc29415e650 0x7fc2940cbbf0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fc28c009d90 tx=0x7fc28c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:26.712 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:26.712+0000 7fc28b400640 1 -- 172.21.15.72:0/2923084289 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc28c039050 con 0x7fc29415e650 2024-04-04T06:57:26.712 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:26.712+0000 7fc28b400640 1 -- 172.21.15.72:0/2923084289 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc28c045070 con 0x7fc29415e650 2024-04-04T06:57:26.712 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:26.712+0000 7fc29a000640 1 -- 172.21.15.72:0/2923084289 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2941f4d00 con 0x7fc29415e650 2024-04-04T06:57:26.712 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:26.712+0000 7fc28b400640 1 -- 172.21.15.72:0/2923084289 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc28c03e830 con 0x7fc29415e650 2024-04-04T06:57:26.712 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:26.712+0000 7fc29a000640 1 -- 172.21.15.72:0/2923084289 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc294155720 con 0x7fc29415e650 2024-04-04T06:57:26.713 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:26.713+0000 7fc29a000640 1 -- 172.21.15.72:0/2923084289 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc294075730 con 0x7fc29415e650 2024-04-04T06:57:26.713 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:26.714+0000 7fc28b400640 1 -- 172.21.15.72:0/2923084289 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc28c03e9d0 con 0x7fc29415e650 2024-04-04T06:57:26.714 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:26.715+0000 7fc28b400640 1 --2- 172.21.15.72:0/2923084289 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fc27006c8f0 0x7fc27006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:26.714 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:26.715+0000 7fc28b400640 1 -- 172.21.15.72:0/2923084289 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7fc28c0aea00 con 0x7fc29415e650 2024-04-04T06:57:26.714 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:26.716+0000 7fc293400640 1 --2- 172.21.15.72:0/2923084289 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fc27006c8f0 0x7fc27006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:26.715 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:26.717+0000 7fc293400640 1 --2- 172.21.15.72:0/2923084289 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fc27006c8f0 0x7fc27006edb0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fc284006fd0 tx=0x7fc284008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:26.719 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:26.720+0000 7fc28b400640 1 -- 172.21.15.72:0/2923084289 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fc28c07cf60 con 0x7fc29415e650 2024-04-04T06:57:26.915 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:26.917+0000 7fc29a000640 1 -- 172.21.15.72:0/2923084289 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fc2940d1fe0 con 0x7fc29415e650 2024-04-04T06:57:26.916 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:26.917+0000 7fc28b400640 1 -- 172.21.15.72:0/2923084289 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) ==== 104+0+11 (secure 0 0 0) 0x7fc28c07c860 con 0x7fc29415e650 2024-04-04T06:57:26.916 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2024-04-04T06:57:26.919 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:26.920+0000 7fc29a000640 1 -- 172.21.15.72:0/2923084289 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fc27006c8f0 msgr2=0x7fc27006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:26.919 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:26.920+0000 7fc29a000640 1 --2- 172.21.15.72:0/2923084289 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fc27006c8f0 0x7fc27006edb0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fc284006fd0 tx=0x7fc284008040 comp rx=0 tx=0).stop 2024-04-04T06:57:26.919 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:26.920+0000 7fc29a000640 1 -- 172.21.15.72:0/2923084289 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc29415e650 msgr2=0x7fc2940cbbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:26.919 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:26.920+0000 7fc29a000640 1 --2- 172.21.15.72:0/2923084289 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc29415e650 0x7fc2940cbbf0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fc28c009d90 tx=0x7fc28c004a40 comp rx=0 tx=0).stop 2024-04-04T06:57:26.919 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:26.920+0000 7fc29a000640 1 -- 172.21.15.72:0/2923084289 shutdown_connections 2024-04-04T06:57:26.919 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:26.920+0000 7fc29a000640 1 --2- 172.21.15.72:0/2923084289 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fc27006c8f0 0x7fc27006edb0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:26.919 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:26.920+0000 7fc29a000640 1 --2- 172.21.15.72:0/2923084289 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc29415e650 0x7fc2940cbbf0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:26.919 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:26.920+0000 7fc29a000640 1 --2- 172.21.15.72:0/2923084289 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc2940d4970 0x7fc294155f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:26.919 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:26.920+0000 7fc29a000640 1 --2- 172.21.15.72:0/2923084289 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc2940d0b80 0x7fc2941f7800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:26.919 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:26.920+0000 7fc29a000640 1 -- 172.21.15.72:0/2923084289 >> 172.21.15.72:0/2923084289 conn(0x7fc29406b470 msgr2=0x7fc2940b7680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:26.920 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:26.920+0000 7fc29a000640 1 -- 172.21.15.72:0/2923084289 shutdown_connections 2024-04-04T06:57:26.920 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:26.920+0000 7fc29a000640 1 -- 172.21.15.72:0/2923084289 wait complete. 2024-04-04T06:57:26.939 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-04T06:57:27.198 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:27.199+0000 7f568a600640 1 Processor -- start 2024-04-04T06:57:27.198 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:27.200+0000 7f568a600640 1 -- start start 2024-04-04T06:57:27.199 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:27.201+0000 7f568a600640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f56840d2a30 0x7f56840d08d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:27.199 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:27.201+0000 7f568a600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f56840cde10 0x7f56840b1570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:27.204 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:27.201+0000 7f568a600640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56840d0e10 con 0x7f56840d04f0 2024-04-04T06:57:27.204 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:27.201+0000 7f568a600640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f56840cd980 con 0x7f56840d2a30 2024-04-04T06:57:27.204 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:27.201+0000 7f568a600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f56840cd050 con 0x7f56840cde10 2024-04-04T06:57:27.204 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:27.201+0000 7f5689200640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f56840d04f0 0x7f56840cf1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:40214/0 (socket says 172.21.15.72:40214) 2024-04-04T06:57:27.204 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:27.201+0000 7f5683e00640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f56840d2a30 0x7f56840d08d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:27.204 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:27.201+0000 7f5689200640 1 -- 172.21.15.72:0/3655788254 learned_addr learned my addr 172.21.15.72:0/3655788254 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-04-04T06:57:27.204 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:27.202+0000 7f5689c00640 1 --2- 172.21.15.72:0/3655788254 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f56840cde10 0x7f56840b1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:27.204 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:27.202+0000 7f5683e00640 1 -- 172.21.15.72:0/3655788254 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f56840cde10 msgr2=0x7f56840b1570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:57:27.204 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:27.202+0000 7f5683e00640 1 --2- 172.21.15.72:0/3655788254 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f56840cde10 0x7f56840b1570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:27.204 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:27.202+0000 7f5683e00640 1 -- 172.21.15.72:0/3655788254 >> v1:172.21.15.72:6789/0 conn(0x7f56840d04f0 legacy=0x7f56840cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:27.205 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:27.202+0000 7f5683e00640 1 -- 172.21.15.72:0/3655788254 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56840cd330 con 0x7f56840d2a30 2024-04-04T06:57:27.205 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:27.202+0000 7f5689c00640 1 --2- 172.21.15.72:0/3655788254 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f56840cde10 0x7f56840b1570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-04T06:57:27.205 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:27.202+0000 7f5683400640 1 -- 172.21.15.72:0/3655788254 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3848505439 0 0) 0x7f56840d0e10 con 0x7f56840d04f0 2024-04-04T06:57:27.205 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:27.203+0000 7f5683e00640 1 --2- 172.21.15.72:0/3655788254 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f56840d2a30 0x7f56840d08d0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f5670009d90 tx=0x7f567002bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=676b78dae3eab2a2 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:27.205 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:27.203+0000 7f5683400640 1 -- 172.21.15.72:0/3655788254 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5670039070 con 0x7f56840d2a30 2024-04-04T06:57:27.205 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:27.203+0000 7f5683400640 1 -- 172.21.15.72:0/3655788254 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f567002cc50 con 0x7f56840d2a30 2024-04-04T06:57:27.205 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:27.203+0000 7f5683400640 1 -- 172.21.15.72:0/3655788254 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5670034440 con 0x7f56840d2a30 2024-04-04T06:57:27.205 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:27.204+0000 7f568a600640 1 -- 172.21.15.72:0/3655788254 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f56840d2a30 msgr2=0x7f56840d08d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:27.205 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:27.204+0000 7f568a600640 1 --2- 172.21.15.72:0/3655788254 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f56840d2a30 0x7f56840d08d0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f5670009d90 tx=0x7f567002bea0 comp rx=0 tx=0).stop 2024-04-04T06:57:27.205 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:27.204+0000 7f568a600640 1 -- 172.21.15.72:0/3655788254 shutdown_connections 2024-04-04T06:57:27.205 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:27.204+0000 7f568a600640 1 --2- 172.21.15.72:0/3655788254 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f56840cde10 0x7f56840b1570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:27.205 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:27.204+0000 7f568a600640 1 --2- 172.21.15.72:0/3655788254 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f56840d2a30 0x7f56840d08d0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:27.205 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:27.204+0000 7f568a600640 1 -- 172.21.15.72:0/3655788254 >> 172.21.15.72:0/3655788254 conn(0x7f56840d1f10 msgr2=0x7f56840d2320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:27.205 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:27.204+0000 7f568a600640 1 -- 172.21.15.72:0/3655788254 shutdown_connections 2024-04-04T06:57:27.206 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:27.204+0000 7f568a600640 1 -- 172.21.15.72:0/3655788254 wait complete. 2024-04-04T06:57:27.208 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:27.206+0000 7f568a600640 1 Processor -- start 2024-04-04T06:57:27.208 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:27.206+0000 7f568a600640 1 -- start start 2024-04-04T06:57:27.208 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:27.207+0000 7f568a600640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f56840cde10 0x7f5684153910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:27.208 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:27.207+0000 7f568a600640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f56840d04f0 0x7f5684154100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:27.208 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:27.207+0000 7f568a600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f56840d2a30 0x7f568406c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:27.208 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:27.207+0000 7f568a600640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f568415c870 con 0x7f56840d04f0 2024-04-04T06:57:27.208 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:27.207+0000 7f568a600640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f56840ccd00 con 0x7f56840cde10 2024-04-04T06:57:27.208 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:27.207+0000 7f568a600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f56840ce2a0 con 0x7f56840d2a30 2024-04-04T06:57:27.208 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:27.207+0000 7f5683e00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f56840d04f0 0x7f5684154100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:27.208 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:27.207+0000 7f5683e00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f56840d04f0 0x7f5684154100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:37412/0 (socket says 172.21.15.72:37412) 2024-04-04T06:57:27.208 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:27.207+0000 7f5683e00640 1 -- 172.21.15.72:0/491407453 learned_addr learned my addr 172.21.15.72:0/491407453 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:57:27.208 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:27.208+0000 7f5689200640 1 --2- 172.21.15.72:0/491407453 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f56840cde10 0x7f5684153910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:27.208 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:27.208+0000 7f5689c00640 1 --2- 172.21.15.72:0/491407453 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f56840d2a30 0x7f568406c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:27.209 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:27.208+0000 7f5683e00640 1 -- 172.21.15.72:0/491407453 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f56840d2a30 msgr2=0x7f568406c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:27.209 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:27.208+0000 7f5683e00640 1 --2- 172.21.15.72:0/491407453 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f56840d2a30 0x7f568406c4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:27.209 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:27.208+0000 7f5683e00640 1 -- 172.21.15.72:0/491407453 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f56840cde10 msgr2=0x7f5684153910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:27.209 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:27.208+0000 7f5683e00640 1 --2- 172.21.15.72:0/491407453 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f56840cde10 0x7f5684153910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:27.209 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:27.208+0000 7f5683e00640 1 -- 172.21.15.72:0/491407453 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56840c9530 con 0x7f56840d04f0 2024-04-04T06:57:27.209 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:27.208+0000 7f5689c00640 1 --2- 172.21.15.72:0/491407453 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f56840d2a30 0x7f568406c4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-04T06:57:27.209 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:27.208+0000 7f5683e00640 1 --2- 172.21.15.72:0/491407453 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f56840d04f0 0x7f5684154100 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f5670037040 tx=0x7f5670004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:27.209 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:27.208+0000 7f5680c00640 1 -- 172.21.15.72:0/491407453 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5670039050 con 0x7f56840d04f0 2024-04-04T06:57:27.209 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:27.208+0000 7f5680c00640 1 -- 172.21.15.72:0/491407453 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f567003a040 con 0x7f56840d04f0 2024-04-04T06:57:27.209 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:27.208+0000 7f5680c00640 1 -- 172.21.15.72:0/491407453 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f567002ca50 con 0x7f56840d04f0 2024-04-04T06:57:27.209 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:27.208+0000 7f568a600640 1 -- 172.21.15.72:0/491407453 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56840c9810 con 0x7f56840d04f0 2024-04-04T06:57:27.209 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:27.209+0000 7f568a600640 1 -- 172.21.15.72:0/491407453 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56840c9dd0 con 0x7f56840d04f0 2024-04-04T06:57:27.210 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:27.210+0000 7f568a600640 1 -- 172.21.15.72:0/491407453 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56840685a0 con 0x7f56840d04f0 2024-04-04T06:57:27.210 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:27.211+0000 7f5680c00640 1 -- 172.21.15.72:0/491407453 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5670047020 con 0x7f56840d04f0 2024-04-04T06:57:27.210 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:27.211+0000 7f5680c00640 1 --2- 172.21.15.72:0/491407453 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f566406c8f0 0x7f566406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:27.210 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:27.212+0000 7f5680c00640 1 -- 172.21.15.72:0/491407453 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f56700ade30 con 0x7f56840d04f0 2024-04-04T06:57:27.210 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:27.212+0000 7f5689200640 1 --2- 172.21.15.72:0/491407453 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f566406c8f0 0x7f566406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:27.211 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:27.213+0000 7f5689200640 1 --2- 172.21.15.72:0/491407453 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f566406c8f0 0x7f566406edb0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f5674000f60 tx=0x7f5674007b50 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:27.215 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:27.216+0000 7f5680c00640 1 -- 172.21.15.72:0/491407453 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f567004e020 con 0x7f56840d04f0 2024-04-04T06:57:27.445 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:27.447+0000 7f568a600640 1 -- 172.21.15.72:0/491407453 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f56841549d0 con 0x7f56840d04f0 2024-04-04T06:57:27.446 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:27.447+0000 7f5680c00640 1 -- 172.21.15.72:0/491407453 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) ==== 100+0+11 (secure 0 0 0) 0x7f567007c140 con 0x7f56840d04f0 2024-04-04T06:57:27.446 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 64 2024-04-04T06:57:27.449 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:27.450+0000 7f568a600640 1 -- 172.21.15.72:0/491407453 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f566406c8f0 msgr2=0x7f566406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:27.450 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:27.451+0000 7f568a600640 1 --2- 172.21.15.72:0/491407453 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f566406c8f0 0x7f566406edb0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f5674000f60 tx=0x7f5674007b50 comp rx=0 tx=0).stop 2024-04-04T06:57:27.450 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:27.451+0000 7f568a600640 1 -- 172.21.15.72:0/491407453 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f56840d04f0 msgr2=0x7f5684154100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:27.450 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:27.451+0000 7f568a600640 1 --2- 172.21.15.72:0/491407453 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f56840d04f0 0x7f5684154100 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f5670037040 tx=0x7f5670004a40 comp rx=0 tx=0).stop 2024-04-04T06:57:27.450 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:27.451+0000 7f568a600640 1 -- 172.21.15.72:0/491407453 shutdown_connections 2024-04-04T06:57:27.450 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:27.451+0000 7f568a600640 1 --2- 172.21.15.72:0/491407453 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f566406c8f0 0x7f566406edb0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:27.450 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:27.451+0000 7f568a600640 1 --2- 172.21.15.72:0/491407453 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f56840d2a30 0x7f568406c4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:27.450 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:27.451+0000 7f568a600640 1 --2- 172.21.15.72:0/491407453 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f56840d04f0 0x7f5684154100 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:27.450 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:27.451+0000 7f568a600640 1 --2- 172.21.15.72:0/491407453 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f56840cde10 0x7f5684153910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:27.450 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:27.451+0000 7f568a600640 1 -- 172.21.15.72:0/491407453 >> 172.21.15.72:0/491407453 conn(0x7f56840d1f10 msgr2=0x7f56840c58f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:27.450 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:27.451+0000 7f568a600640 1 -- 172.21.15.72:0/491407453 shutdown_connections 2024-04-04T06:57:27.450 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:27.451+0000 7f568a600640 1 -- 172.21.15.72:0/491407453 wait complete. 2024-04-04T06:57:27.470 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-04T06:57:27.678 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:27.679+0000 7f2905e00640 1 Processor -- start 2024-04-04T06:57:27.679 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:27.680+0000 7f2905e00640 1 -- start start 2024-04-04T06:57:27.681 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:27.682+0000 7f2905e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f290015e560 0x7f29000d2420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:27.681 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:27.682+0000 7f2905e00640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f290015e940 con 0x7f29000d2960 2024-04-04T06:57:27.681 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:27.682+0000 7f2905e00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f29000d2e00 con 0x7f29000b9e00 2024-04-04T06:57:27.681 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:27.683+0000 7f2905e00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f29000d30e0 con 0x7f290015e560 2024-04-04T06:57:27.681 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:27.683+0000 7f28ff400640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f29000d2960 0x7f29000b7510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:40218/0 (socket says 172.21.15.72:40218) 2024-04-04T06:57:27.681 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:27.683+0000 7f28ff400640 1 -- 172.21.15.72:0/1851627430 learned_addr learned my addr 172.21.15.72:0/1851627430 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-04-04T06:57:27.683 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:27.683+0000 7f28fea00640 1 --2- 172.21.15.72:0/1851627430 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f290015e560 0x7f29000d2420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:27.684 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:27.683+0000 7f28fd600640 1 -- 172.21.15.72:0/1851627430 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1472331300 0 0) 0x7f290015e940 con 0x7f29000d2960 2024-04-04T06:57:27.684 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:27.683+0000 7f28fd600640 1 -- 172.21.15.72:0/1851627430 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f28e4003520 con 0x7f29000d2960 2024-04-04T06:57:27.684 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:27.684+0000 7f28fd600640 1 -- 172.21.15.72:0/1851627430 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3981724401 0 0) 0x7f28e4003520 con 0x7f29000d2960 2024-04-04T06:57:27.684 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:27.684+0000 7f28fd600640 1 -- 172.21.15.72:0/1851627430 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f290015e560 msgr2=0x7f29000d2420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:57:27.684 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:27.684+0000 7f28fd600640 1 --2- 172.21.15.72:0/1851627430 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f290015e560 0x7f29000d2420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:27.684 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:27.684+0000 7f28fd600640 1 -- 172.21.15.72:0/1851627430 >> v1:172.21.15.117:6789/0 conn(0x7f29000b9e00 legacy=0x7f29000d12d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:27.684 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:27.684+0000 7f28fd600640 1 -- 172.21.15.72:0/1851627430 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29000d33c0 con 0x7f29000d2960 2024-04-04T06:57:27.684 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:27.684+0000 7f28fd600640 1 -- 172.21.15.72:0/1851627430 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2465650867 0 0) 0x7f28f8001690 con 0x7f29000d2960 2024-04-04T06:57:27.684 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:27.684+0000 7f28fd600640 1 -- 172.21.15.72:0/1851627430 >> v1:172.21.15.72:6789/0 conn(0x7f29000d2960 legacy=0x7f29000b7510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:27.684 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:27.684+0000 7f28fd600640 1 --2- 172.21.15.72:0/1851627430 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f28e40039e0 0x7f28e4003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:27.684 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:27.684+0000 7f28fd600640 1 --2- 172.21.15.72:0/1851627430 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f290015e560 0x7f28e4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:27.684 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:27.684+0000 7f28fd600640 1 --2- 172.21.15.72:0/1851627430 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f28e4004d40 0x7f28e40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:27.684 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:27.684+0000 7f28fd600640 1 -- 172.21.15.72:0/1851627430 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f29000d30e0 con 0x7f28e40039e0 2024-04-04T06:57:27.685 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:27.684+0000 7f28fd600640 1 -- 172.21.15.72:0/1851627430 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f28e400baa0 con 0x7f28e4004d40 2024-04-04T06:57:27.685 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:27.684+0000 7f28fd600640 1 -- 172.21.15.72:0/1851627430 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f28e400bca0 con 0x7f290015e560 2024-04-04T06:57:27.685 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:27.684+0000 7f28fea00640 1 --2- 172.21.15.72:0/1851627430 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f28e40039e0 0x7f28e4003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:27.685 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:27.684+0000 7f28fe000640 1 --2- 172.21.15.72:0/1851627430 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f290015e560 0x7f28e4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:27.685 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:27.684+0000 7f28ff400640 1 --2- 172.21.15.72:0/1851627430 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f28e4004d40 0x7f28e40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:27.685 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:27.684+0000 7f28fea00640 1 -- 172.21.15.72:0/1851627430 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f290015e560 msgr2=0x7f28e4004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:57:27.685 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:27.685+0000 7f28fea00640 1 --2- 172.21.15.72:0/1851627430 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f290015e560 0x7f28e4004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:27.685 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:27.685+0000 7f28fea00640 1 -- 172.21.15.72:0/1851627430 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f28e4004d40 msgr2=0x7f28e40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:57:27.685 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:27.685+0000 7f28fea00640 1 --2- 172.21.15.72:0/1851627430 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f28e4004d40 0x7f28e40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:27.685 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:27.685+0000 7f28fea00640 1 -- 172.21.15.72:0/1851627430 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28e4003520 con 0x7f28e40039e0 2024-04-04T06:57:27.685 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:27.685+0000 7f28ff400640 1 --2- 172.21.15.72:0/1851627430 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f28e4004d40 0x7f28e40051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-04T06:57:27.686 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:27.686+0000 7f28fea00640 1 --2- 172.21.15.72:0/1851627430 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f28e40039e0 0x7f28e4003e00 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f28f0009f90 tx=0x7f28e4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb56feca2b8b19fc server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:27.687 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:27.686+0000 7f28fd600640 1 -- 172.21.15.72:0/1851627430 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28f0039070 con 0x7f28e40039e0 2024-04-04T06:57:27.687 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:27.686+0000 7f28fd600640 1 -- 172.21.15.72:0/1851627430 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28f002cbd0 con 0x7f28e40039e0 2024-04-04T06:57:27.687 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:27.686+0000 7f28fd600640 1 -- 172.21.15.72:0/1851627430 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28f0009c10 con 0x7f28e40039e0 2024-04-04T06:57:27.687 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:27.686+0000 7f2905e00640 1 -- 172.21.15.72:0/1851627430 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f28e40039e0 msgr2=0x7f28e4003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:27.687 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:27.686+0000 7f2905e00640 1 --2- 172.21.15.72:0/1851627430 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f28e40039e0 0x7f28e4003e00 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f28f0009f90 tx=0x7f28e4005830 comp rx=0 tx=0).stop 2024-04-04T06:57:27.687 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:27.687+0000 7f28ff400640 1 -- 172.21.15.72:0/1851627430 reap_dead start 2024-04-04T06:57:27.687 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:27.687+0000 7f2905e00640 1 -- 172.21.15.72:0/1851627430 shutdown_connections 2024-04-04T06:57:27.687 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:27.687+0000 7f2905e00640 1 -- 172.21.15.72:0/1851627430 >> 172.21.15.72:0/1851627430 conn(0x7f2900071e80 msgr2=0x7f2900072290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:27.687 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:27.687+0000 7f2905e00640 1 -- 172.21.15.72:0/1851627430 shutdown_connections 2024-04-04T06:57:27.687 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:27.687+0000 7f2905e00640 1 -- 172.21.15.72:0/1851627430 wait complete. 2024-04-04T06:57:27.688 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:27.688+0000 7f2905e00640 1 Processor -- start 2024-04-04T06:57:27.689 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:27.689+0000 7f2905e00640 1 -- start start 2024-04-04T06:57:27.689 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:27.689+0000 7f2905e00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f28e40039e0 0x7f29001f4630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:27.689 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:27.689+0000 7f2905e00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2900160570 0x7f29000ca5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:27.689 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:27.689+0000 7f2905e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2900148290 0x7f2900148720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:27.689 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:27.689+0000 7f2905e00640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f29000d19e0 con 0x7f28e40039e0 2024-04-04T06:57:27.689 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:27.689+0000 7f2905e00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f29000d3980 con 0x7f2900160570 2024-04-04T06:57:27.689 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:27.689+0000 7f2905e00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f29000d1b60 con 0x7f2900148290 2024-04-04T06:57:27.689 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:27.690+0000 7f28fea00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f28e40039e0 0x7f29001f4630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:27.689 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:27.690+0000 7f28fea00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f28e40039e0 0x7f29001f4630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:37438/0 (socket says 172.21.15.72:37438) 2024-04-04T06:57:27.689 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:27.690+0000 7f28fea00640 1 -- 172.21.15.72:0/2784597819 learned_addr learned my addr 172.21.15.72:0/2784597819 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:57:27.689 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:27.690+0000 7f28fe000640 1 --2- 172.21.15.72:0/2784597819 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2900160570 0x7f29000ca5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:27.689 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:27.690+0000 7f28ff400640 1 --2- 172.21.15.72:0/2784597819 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2900148290 0x7f2900148720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:27.690 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:27.690+0000 7f28fea00640 1 -- 172.21.15.72:0/2784597819 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2900148290 msgr2=0x7f2900148720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:27.690 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:27.690+0000 7f28fea00640 1 --2- 172.21.15.72:0/2784597819 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2900148290 0x7f2900148720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:27.691 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:27.690+0000 7f28fea00640 1 -- 172.21.15.72:0/2784597819 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2900160570 msgr2=0x7f29000ca5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:27.691 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:27.690+0000 7f28fea00640 1 --2- 172.21.15.72:0/2784597819 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2900160570 0x7f29000ca5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:27.691 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:27.690+0000 7f28fea00640 1 -- 172.21.15.72:0/2784597819 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2900155760 con 0x7f28e40039e0 2024-04-04T06:57:27.691 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:27.691+0000 7f28fea00640 1 --2- 172.21.15.72:0/2784597819 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f28e40039e0 0x7f29001f4630 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f28f0009f90 tx=0x7f28f0009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:27.691 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:27.691+0000 7f28f7400640 1 -- 172.21.15.72:0/2784597819 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28f0039050 con 0x7f28e40039e0 2024-04-04T06:57:27.691 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:27.691+0000 7f28f7400640 1 -- 172.21.15.72:0/2784597819 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28f003a040 con 0x7f28e40039e0 2024-04-04T06:57:27.691 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:27.691+0000 7f28f7400640 1 -- 172.21.15.72:0/2784597819 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28f0009c10 con 0x7f28e40039e0 2024-04-04T06:57:27.691 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:27.691+0000 7f2905e00640 1 -- 172.21.15.72:0/2784597819 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2900156bb0 con 0x7f28e40039e0 2024-04-04T06:57:27.691 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:27.691+0000 7f2905e00640 1 -- 172.21.15.72:0/2784597819 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2900160d10 con 0x7f28e40039e0 2024-04-04T06:57:27.691 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:27.692+0000 7f2905e00640 1 -- 172.21.15.72:0/2784597819 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29000d2670 con 0x7f28e40039e0 2024-04-04T06:57:27.692 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:27.693+0000 7f28f7400640 1 -- 172.21.15.72:0/2784597819 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f28f0047030 con 0x7f28e40039e0 2024-04-04T06:57:27.693 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:27.694+0000 7f28f7400640 1 --2- 172.21.15.72:0/2784597819 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f28dc06c920 0x7f28dc06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:27.693 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:27.694+0000 7f28f7400640 1 -- 172.21.15.72:0/2784597819 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f28f00adea0 con 0x7f28e40039e0 2024-04-04T06:57:27.693 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:27.695+0000 7f28fe000640 1 --2- 172.21.15.72:0/2784597819 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f28dc06c920 0x7f28dc06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:27.694 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:27.695+0000 7f28fe000640 1 --2- 172.21.15.72:0/2784597819 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f28dc06c920 0x7f28dc06ede0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f29000b8060 tx=0x7f28e8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:27.698 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:27.699+0000 7f28f7400640 1 -- 172.21.15.72:0/2784597819 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f29000d2670 con 0x7f28e40039e0 2024-04-04T06:57:27.911 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:27.912+0000 7f2905e00640 1 -- 172.21.15.72:0/2784597819 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f29000b7db0 con 0x7f28e40039e0 2024-04-04T06:57:27.911 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:27.913+0000 7f28f7400640 1 -- 172.21.15.72:0/2784597819 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v22) ==== 80+0+0 (secure 0 0 0) 0x7f28f004e060 con 0x7f28e40039e0 2024-04-04T06:57:27.912 INFO:teuthology.orchestra.run.smithi072.stderr:listed 0 entries 2024-04-04T06:57:27.915 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:27.915+0000 7f2905e00640 1 -- 172.21.15.72:0/2784597819 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f28dc06c920 msgr2=0x7f28dc06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:27.915 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:27.915+0000 7f2905e00640 1 --2- 172.21.15.72:0/2784597819 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f28dc06c920 0x7f28dc06ede0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f29000b8060 tx=0x7f28e8009040 comp rx=0 tx=0).stop 2024-04-04T06:57:27.915 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:27.915+0000 7f2905e00640 1 -- 172.21.15.72:0/2784597819 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f28e40039e0 msgr2=0x7f29001f4630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:27.915 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:27.915+0000 7f2905e00640 1 --2- 172.21.15.72:0/2784597819 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f28e40039e0 0x7f29001f4630 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f28f0009f90 tx=0x7f28f0009750 comp rx=0 tx=0).stop 2024-04-04T06:57:27.915 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:27.915+0000 7f2905e00640 1 -- 172.21.15.72:0/2784597819 shutdown_connections 2024-04-04T06:57:27.915 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:27.915+0000 7f2905e00640 1 --2- 172.21.15.72:0/2784597819 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f28dc06c920 0x7f28dc06ede0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:27.915 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:27.915+0000 7f2905e00640 1 --2- 172.21.15.72:0/2784597819 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2900148290 0x7f2900148720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:27.915 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:27.915+0000 7f2905e00640 1 --2- 172.21.15.72:0/2784597819 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2900160570 0x7f29000ca5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:27.915 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:27.915+0000 7f2905e00640 1 --2- 172.21.15.72:0/2784597819 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f28e40039e0 0x7f29001f4630 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:27.915 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:27.915+0000 7f2905e00640 1 -- 172.21.15.72:0/2784597819 >> 172.21.15.72:0/2784597819 conn(0x7f2900071e80 msgr2=0x7f2900072290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:27.915 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:27.915+0000 7f2905e00640 1 -- 172.21.15.72:0/2784597819 shutdown_connections 2024-04-04T06:57:27.915 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:27.916+0000 7f2905e00640 1 -- 172.21.15.72:0/2784597819 wait complete. 2024-04-04T06:57:27.934 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi072.front.sepia.ceph.com... 2024-04-04T06:57:27.934 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-04T06:57:27.934 DEBUG:teuthology.orchestra.run.smithi072:> sudo fusermount -u /home/ubuntu/cephtest/mnt.2 2024-04-04T06:57:28.018 INFO:teuthology.orchestra.run:waiting for 300 2024-04-04T06:57:28.019 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi072.front.sepia.ceph.com 2024-04-04T06:57:28.019 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-04T06:57:28.019 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-04-04T06:57:28.064 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-04-04T06:57:28.064 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-04T06:57:28.120 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-04-04T06:57:28.121 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-04T06:57:28.170 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-04T06:57:28.374 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:28.375+0000 7f2796a00640 1 Processor -- start 2024-04-04T06:57:28.375 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:28.376+0000 7f2796a00640 1 -- start start 2024-04-04T06:57:28.376 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:28.377+0000 7f2796a00640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f27900cec60 0x7f27900cf0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:28.376 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:28.378+0000 7f2796a00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f27900d3030 0x7f27900d34c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:28.376 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:28.378+0000 7f2796a00640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f27900d2590 con 0x7f279015e560 2024-04-04T06:57:28.377 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:28.378+0000 7f2796a00640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f2790162540 con 0x7f27900cec60 2024-04-04T06:57:28.377 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:28.378+0000 7f2796a00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f27900cf600 con 0x7f27900d3030 2024-04-04T06:57:28.377 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:28.378+0000 7f2795600640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f279015e560 0x7f27900b75d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:40224/0 (socket says 172.21.15.72:40224) 2024-04-04T06:57:28.377 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:28.378+0000 7f2795600640 1 -- 172.21.15.72:0/3351774294 learned_addr learned my addr 172.21.15.72:0/3351774294 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-04-04T06:57:28.377 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:28.378+0000 7f2794c00640 1 --2- 172.21.15.72:0/3351774294 >> v2:172.21.15.72:3300/0 conn(0x7f27900cec60 0x7f27900cf0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:28.378 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:28.378+0000 7f2796000640 1 --2- 172.21.15.72:0/3351774294 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f27900d3030 0x7f27900d34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:28.378 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:28.378+0000 7f278fe00640 1 -- 172.21.15.72:0/3351774294 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 500807821 0 0) 0x7f27900d2590 con 0x7f279015e560 2024-04-04T06:57:28.378 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:28.378+0000 7f2794c00640 1 -- 172.21.15.72:0/3351774294 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f27900d3030 msgr2=0x7f27900d34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:57:28.378 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:28.378+0000 7f2794c00640 1 --2- 172.21.15.72:0/3351774294 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f27900d3030 0x7f27900d34c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:28.378 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:28.378+0000 7f2794c00640 1 -- 172.21.15.72:0/3351774294 >> v1:172.21.15.72:6789/0 conn(0x7f279015e560 legacy=0x7f27900b75d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:28.378 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:28.378+0000 7f2794c00640 1 -- 172.21.15.72:0/3351774294 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27900cf840 con 0x7f27900cec60 2024-04-04T06:57:28.379 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:28.379+0000 7f2794c00640 1 --2- 172.21.15.72:0/3351774294 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f27900cec60 0x7f27900cf0c0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f277c0097a0 tx=0x7f277c02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddf8c3e6762b084e server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:28.379 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:28.380+0000 7f278fe00640 1 -- 172.21.15.72:0/3351774294 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f277c0315a0 con 0x7f27900cec60 2024-04-04T06:57:28.379 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:28.380+0000 7f278fe00640 1 -- 172.21.15.72:0/3351774294 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f277c037070 con 0x7f27900cec60 2024-04-04T06:57:28.380 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:28.380+0000 7f278fe00640 1 -- 172.21.15.72:0/3351774294 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f277c031960 con 0x7f27900cec60 2024-04-04T06:57:28.380 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:28.380+0000 7f2796a00640 1 -- 172.21.15.72:0/3351774294 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f27900cec60 msgr2=0x7f27900cf0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:28.380 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:28.380+0000 7f2796a00640 1 --2- 172.21.15.72:0/3351774294 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f27900cec60 0x7f27900cf0c0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f277c0097a0 tx=0x7f277c02b840 comp rx=0 tx=0).stop 2024-04-04T06:57:28.380 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:28.380+0000 7f2796a00640 1 -- 172.21.15.72:0/3351774294 shutdown_connections 2024-04-04T06:57:28.380 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:28.380+0000 7f2796a00640 1 --2- 172.21.15.72:0/3351774294 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f27900d3030 0x7f27900d34c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:28.380 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:28.380+0000 7f2796a00640 1 --2- 172.21.15.72:0/3351774294 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f27900cec60 0x7f27900cf0c0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:28.380 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:28.380+0000 7f2796a00640 1 -- 172.21.15.72:0/3351774294 >> 172.21.15.72:0/3351774294 conn(0x7f27900b5c40 msgr2=0x7f27900b6050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:28.380 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:28.380+0000 7f2796a00640 1 -- 172.21.15.72:0/3351774294 shutdown_connections 2024-04-04T06:57:28.380 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:28.381+0000 7f2796a00640 1 -- 172.21.15.72:0/3351774294 wait complete. 2024-04-04T06:57:28.381 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:28.382+0000 7f2796a00640 1 Processor -- start 2024-04-04T06:57:28.381 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:28.382+0000 7f2796a00640 1 -- start start 2024-04-04T06:57:28.382 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:28.383+0000 7f2796a00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f27900cec60 0x7f279014fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:28.382 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:28.383+0000 7f2796a00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f27900d3030 0x7f279014f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:28.382 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:28.383+0000 7f2796a00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f279015e560 0x7f27900ab990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:28.382 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:28.383+0000 7f2796a00640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f27900cfb20 con 0x7f279015e560 2024-04-04T06:57:28.382 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:28.383+0000 7f2796a00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f27900d2ba0 con 0x7f27900cec60 2024-04-04T06:57:28.383 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:28.383+0000 7f2796a00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f27900cfca0 con 0x7f27900d3030 2024-04-04T06:57:28.383 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:28.384+0000 7f2796000640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f279015e560 0x7f27900ab990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:28.383 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:28.384+0000 7f2796000640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f279015e560 0x7f27900ab990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:37454/0 (socket says 172.21.15.72:37454) 2024-04-04T06:57:28.383 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:28.384+0000 7f2796000640 1 -- 172.21.15.72:0/2486091012 learned_addr learned my addr 172.21.15.72:0/2486091012 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:57:28.384 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:28.384+0000 7f2796000640 1 -- 172.21.15.72:0/2486091012 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f27900d3030 msgr2=0x7f279014f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:28.385 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:28.384+0000 7f2794c00640 1 --2- 172.21.15.72:0/2486091012 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f27900d3030 0x7f279014f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:28.385 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:28.384+0000 7f2795600640 1 --2- 172.21.15.72:0/2486091012 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f27900cec60 0x7f279014fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:28.385 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:28.384+0000 7f2796000640 1 --2- 172.21.15.72:0/2486091012 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f27900d3030 0x7f279014f5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:28.385 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:28.384+0000 7f2796000640 1 -- 172.21.15.72:0/2486091012 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f27900cec60 msgr2=0x7f279014fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:28.385 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:28.384+0000 7f2796000640 1 --2- 172.21.15.72:0/2486091012 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f27900cec60 0x7f279014fdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:28.385 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:28.384+0000 7f2796000640 1 -- 172.21.15.72:0/2486091012 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f279014fae0 con 0x7f279015e560 2024-04-04T06:57:28.385 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:28.384+0000 7f2795600640 1 --2- 172.21.15.72:0/2486091012 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f27900cec60 0x7f279014fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-04T06:57:28.385 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:28.385+0000 7f2796000640 1 --2- 172.21.15.72:0/2486091012 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f279015e560 0x7f27900ab990 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f278800cda0 tx=0x7f278800a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:28.385 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:28.385+0000 7f278d600640 1 -- 172.21.15.72:0/2486091012 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2788003b90 con 0x7f279015e560 2024-04-04T06:57:28.386 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:28.385+0000 7f278d600640 1 -- 172.21.15.72:0/2486091012 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2788003d30 con 0x7f279015e560 2024-04-04T06:57:28.386 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:28.385+0000 7f2796a00640 1 -- 172.21.15.72:0/2486091012 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27900ac370 con 0x7f279015e560 2024-04-04T06:57:28.386 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:28.385+0000 7f278d600640 1 -- 172.21.15.72:0/2486091012 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2788004240 con 0x7f279015e560 2024-04-04T06:57:28.386 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:28.385+0000 7f2796a00640 1 -- 172.21.15.72:0/2486091012 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f279015edc0 con 0x7f279015e560 2024-04-04T06:57:28.386 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:28.386+0000 7f2796a00640 1 -- 172.21.15.72:0/2486091012 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f27900685a0 con 0x7f279015e560 2024-04-04T06:57:28.387 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:28.387+0000 7f278d600640 1 -- 172.21.15.72:0/2486091012 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f27880043e0 con 0x7f279015e560 2024-04-04T06:57:28.387 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:28.388+0000 7f278d600640 1 --2- 172.21.15.72:0/2486091012 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f277006c920 0x7f277006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:28.387 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:28.388+0000 7f278d600640 1 -- 172.21.15.72:0/2486091012 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f278808c670 con 0x7f279015e560 2024-04-04T06:57:28.387 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:28.388+0000 7f2795600640 1 --2- 172.21.15.72:0/2486091012 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f277006c920 0x7f277006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:28.388 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:28.389+0000 7f2795600640 1 --2- 172.21.15.72:0/2486091012 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f277006c920 0x7f277006ede0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f2784000f60 tx=0x7f2784009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:28.391 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:28.392+0000 7f278d600640 1 -- 172.21.15.72:0/2486091012 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f279014fae0 con 0x7f279015e560 2024-04-04T06:57:28.590 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:28.592+0000 7f2796a00640 1 -- 172.21.15.72:0/2486091012 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f27900d20a0 con 0x7f279015e560 2024-04-04T06:57:28.593 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:28.594+0000 7f278d600640 1 -- 172.21.15.72:0/2486091012 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16831 (secure 0 0 0) 0x7f278805aa20 con 0x7f279015e560 2024-04-04T06:57:28.593 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T06:57:28.594 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":22,"fsid":"6708bac2-4f50-49b5-87a9-c390fd333eb3","created":"2024-04-04T06:56:04.282498+0000","modified":"2024-04-04T06:57:11.239134+0000","last_up_change":"2024-04-04T06:56:16.716089+0000","last_in_change":"2024-04-04T06:56:07.768593+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-04T06:56:17.421685+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-04T06:56:26.822661+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-04T06:56:27.429816+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7c345991-5af8-4dc6-a481-28610c40e128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":3889813953},{"type":"v1","addr":"172.21.15.72:6818","nonce":3889813953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":3889813953},{"type":"v1","addr":"172.21.15.72:6821","nonce":3889813953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":3889813953},{"type":"v1","addr":"172.21.15.72:6826","nonce":3889813953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":3889813953},{"type":"v1","addr":"172.21.15.72:6823","nonce":3889813953}]},"public_addr":"172.21.15.72:6818/3889813953","cluster_addr":"172.21.15.72:6821/3889813953","heartbeat_back_addr":"172.21.15.72:6826/3889813953","heartbeat_front_addr":"172.21.15.72:6823/3889813953","state":["exists","up"]},{"osd":1,"uuid":"1b3f7ab2-a56c-488d-a89a-1f3572361c95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":3101663154},{"type":"v1","addr":"172.21.15.72:6801","nonce":3101663154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":3101663154},{"type":"v1","addr":"172.21.15.72:6803","nonce":3101663154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":3101663154},{"type":"v1","addr":"172.21.15.72:6807","nonce":3101663154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":3101663154},{"type":"v1","addr":"172.21.15.72:6805","nonce":3101663154}]},"public_addr":"172.21.15.72:6801/3101663154","cluster_addr":"172.21.15.72:6803/3101663154","heartbeat_back_addr":"172.21.15.72:6807/3101663154","heartbeat_front_addr":"172.21.15.72:6805/3101663154","state":["exists","up"]},{"osd":2,"uuid":"fc9aa512-53df-40d7-ba04-3e6b7dcd1e34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":235374192},{"type":"v1","addr":"172.21.15.72:6809","nonce":235374192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":235374192},{"type":"v1","addr":"172.21.15.72:6811","nonce":235374192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":235374192},{"type":"v1","addr":"172.21.15.72:6815","nonce":235374192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":235374192},{"type":"v1","addr":"172.21.15.72:6813","nonce":235374192}]},"public_addr":"172.21.15.72:6809/235374192","cluster_addr":"172.21.15.72:6811/235374192","heartbeat_back_addr":"172.21.15.72:6815/235374192","heartbeat_front_addr":"172.21.15.72:6813/235374192","state":["exists","up"]},{"osd":3,"uuid":"b4f63eed-dc5b-4aba-bb50-de46eb41492b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6817","nonce":2806631742},{"type":"v1","addr":"172.21.15.72:6819","nonce":2806631742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":2806631742},{"type":"v1","addr":"172.21.15.72:6827","nonce":2806631742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":2806631742},{"type":"v1","addr":"172.21.15.72:6831","nonce":2806631742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":2806631742},{"type":"v1","addr":"172.21.15.72:6829","nonce":2806631742}]},"public_addr":"172.21.15.72:6819/2806631742","cluster_addr":"172.21.15.72:6827/2806631742","heartbeat_back_addr":"172.21.15.72:6831/2806631742","heartbeat_front_addr":"172.21.15.72:6829/2806631742","state":["exists","up"]},{"osd":4,"uuid":"9e985ef8-d711-4172-9286-c54e560895d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":4293536423},{"type":"v1","addr":"172.21.15.117:6825","nonce":4293536423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":4293536423},{"type":"v1","addr":"172.21.15.117:6827","nonce":4293536423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":4293536423},{"type":"v1","addr":"172.21.15.117:6831","nonce":4293536423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":4293536423},{"type":"v1","addr":"172.21.15.117:6829","nonce":4293536423}]},"public_addr":"172.21.15.117:6825/4293536423","cluster_addr":"172.21.15.117:6827/4293536423","heartbeat_back_addr":"172.21.15.117:6831/4293536423","heartbeat_front_addr":"172.21.15.117:6829/4293536423","state":["exists","up"]},{"osd":5,"uuid":"3e9f082b-8d7d-455f-8a96-66d0b4857125","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":684971679},{"type":"v1","addr":"172.21.15.117:6801","nonce":684971679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":684971679},{"type":"v1","addr":"172.21.15.117:6803","nonce":684971679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":684971679},{"type":"v1","addr":"172.21.15.117:6807","nonce":684971679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":684971679},{"type":"v1","addr":"172.21.15.117:6805","nonce":684971679}]},"public_addr":"172.21.15.117:6801/684971679","cluster_addr":"172.21.15.117:6803/684971679","heartbeat_back_addr":"172.21.15.117:6807/684971679","heartbeat_front_addr":"172.21.15.117:6805/684971679","state":["exists","up"]},{"osd":6,"uuid":"bcdafa9f-a870-4398-a38d-ab7697676473","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":2781186528},{"type":"v1","addr":"172.21.15.117:6809","nonce":2781186528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":2781186528},{"type":"v1","addr":"172.21.15.117:6811","nonce":2781186528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":2781186528},{"type":"v1","addr":"172.21.15.117:6815","nonce":2781186528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":2781186528},{"type":"v1","addr":"172.21.15.117:6813","nonce":2781186528}]},"public_addr":"172.21.15.117:6809/2781186528","cluster_addr":"172.21.15.117:6811/2781186528","heartbeat_back_addr":"172.21.15.117:6815/2781186528","heartbeat_front_addr":"172.21.15.117:6813/2781186528","state":["exists","up"]},{"osd":7,"uuid":"b68ec562-ff35-4d2d-a733-c896f8920cfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":617469882},{"type":"v1","addr":"172.21.15.117:6817","nonce":617469882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":617469882},{"type":"v1","addr":"172.21.15.117:6819","nonce":617469882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":617469882},{"type":"v1","addr":"172.21.15.117:6823","nonce":617469882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":617469882},{"type":"v1","addr":"172.21.15.117:6821","nonce":617469882}]},"public_addr":"172.21.15.117:6817/617469882","cluster_addr":"172.21.15.117:6819/617469882","heartbeat_back_addr":"172.21.15.117:6823/617469882","heartbeat_front_addr":"172.21.15.117:6821/617469882","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.347700+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.296619+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.361345+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.093323+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:12.857605+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:12.816090+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.083163+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.121639+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.13","mappings":[{"from":7,"to":1}]},{"pgid":"3.19","mappings":[{"from":3,"to":2}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.28","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-04T06:57:28.596 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:28.597+0000 7f2796a00640 1 -- 172.21.15.72:0/2486091012 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f277006c920 msgr2=0x7f277006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:28.596 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:28.597+0000 7f2796a00640 1 --2- 172.21.15.72:0/2486091012 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f277006c920 0x7f277006ede0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f2784000f60 tx=0x7f2784009040 comp rx=0 tx=0).stop 2024-04-04T06:57:28.596 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:28.597+0000 7f2796a00640 1 -- 172.21.15.72:0/2486091012 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f279015e560 msgr2=0x7f27900ab990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:28.596 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:28.597+0000 7f2796a00640 1 --2- 172.21.15.72:0/2486091012 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f279015e560 0x7f27900ab990 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f278800cda0 tx=0x7f278800a660 comp rx=0 tx=0).stop 2024-04-04T06:57:28.596 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:28.597+0000 7f2796a00640 1 -- 172.21.15.72:0/2486091012 shutdown_connections 2024-04-04T06:57:28.596 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:28.597+0000 7f2796a00640 1 --2- 172.21.15.72:0/2486091012 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f277006c920 0x7f277006ede0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:28.597 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:28.597+0000 7f2796a00640 1 --2- 172.21.15.72:0/2486091012 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f279015e560 0x7f27900ab990 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:28.597 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:28.597+0000 7f2796a00640 1 --2- 172.21.15.72:0/2486091012 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f27900d3030 0x7f279014f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:28.597 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:28.597+0000 7f2796a00640 1 --2- 172.21.15.72:0/2486091012 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f27900cec60 0x7f279014fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:28.597 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:28.597+0000 7f2796a00640 1 -- 172.21.15.72:0/2486091012 >> 172.21.15.72:0/2486091012 conn(0x7f27900b5c40 msgr2=0x7f27901626d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:28.597 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:28.597+0000 7f2796a00640 1 -- 172.21.15.72:0/2486091012 shutdown_connections 2024-04-04T06:57:28.597 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:28.597+0000 7f2796a00640 1 -- 172.21.15.72:0/2486091012 wait complete. 2024-04-04T06:57:28.615 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-04T06:56:17.421685+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-04T06:56:26.822661+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-04T06:56:27.429816+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-04T06:57:28.615 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-04T06:57:28.826 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:28.827+0000 7f0aff200640 1 Processor -- start 2024-04-04T06:57:28.826 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:28.827+0000 7f0aff200640 1 -- start start 2024-04-04T06:57:28.828 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:28.829+0000 7f0aff200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0b0015e1d0 0x7f0b00162760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:28.828 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:28.829+0000 7f0aff200640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0b000d14b0 0x7f0b000d4780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:28.828 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:28.829+0000 7f0aff200640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b000d2270 con 0x7f0b000d1050 2024-04-04T06:57:28.828 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:28.829+0000 7f0aff200640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f0b00162ca0 con 0x7f0b000d14b0 2024-04-04T06:57:28.829 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:28.829+0000 7f0aff200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f0b0015e5b0 con 0x7f0b0015e1d0 2024-04-04T06:57:28.829 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:28.830+0000 7f0afe800640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0b000d14b0 0x7f0b000d4780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:28.829 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:28.830+0000 7f0afe800640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0b000d14b0 0x7f0b000d4780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:37468/0 (socket says 172.21.15.72:37468) 2024-04-04T06:57:28.829 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:28.830+0000 7f0afe800640 1 -- 172.21.15.72:0/1420364268 learned_addr learned my addr 172.21.15.72:0/1420364268 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:57:28.829 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:28.830+0000 7f0afe800640 1 -- 172.21.15.72:0/1420364268 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0b0015e1d0 msgr2=0x7f0b00162760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:57:28.829 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:28.830+0000 7f0afde00640 1 --2- 172.21.15.72:0/1420364268 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0b0015e1d0 0x7f0b00162760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:28.830 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:28.830+0000 7f0afe800640 1 --2- 172.21.15.72:0/1420364268 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0b0015e1d0 0x7f0b00162760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:28.830 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:28.830+0000 7f0afe800640 1 -- 172.21.15.72:0/1420364268 >> v1:172.21.15.117:6789/0 conn(0x7f0b000d1050 legacy=0x7f0b000d4070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:57:28.830 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:28.830+0000 7f0afe800640 1 -- 172.21.15.72:0/1420364268 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b000cf4e0 con 0x7f0b000d14b0 2024-04-04T06:57:28.830 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:28.831+0000 7f0afe800640 1 --2- 172.21.15.72:0/1420364268 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0b000d14b0 0x7f0b000d4780 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f0b000d0880 tx=0x7f0af802be00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c584857ee8a1ad28 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:28.830 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:28.832+0000 7f0afd400640 1 -- 172.21.15.72:0/1420364268 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0af802c9a0 con 0x7f0b000d14b0 2024-04-04T06:57:28.831 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:28.832+0000 7f0afd400640 1 -- 172.21.15.72:0/1420364268 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0af802cb40 con 0x7f0b000d14b0 2024-04-04T06:57:28.831 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:28.832+0000 7f0afd400640 1 -- 172.21.15.72:0/1420364268 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0af80343f0 con 0x7f0b000d14b0 2024-04-04T06:57:28.831 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:28.833+0000 7f0aff200640 1 -- 172.21.15.72:0/1420364268 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0b000d14b0 msgr2=0x7f0b000d4780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:28.832 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:28.833+0000 7f0aff200640 1 --2- 172.21.15.72:0/1420364268 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0b000d14b0 0x7f0b000d4780 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f0b000d0880 tx=0x7f0af802be00 comp rx=0 tx=0).stop 2024-04-04T06:57:28.832 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:28.833+0000 7f0aff200640 1 -- 172.21.15.72:0/1420364268 shutdown_connections 2024-04-04T06:57:28.832 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:28.833+0000 7f0aff200640 1 --2- 172.21.15.72:0/1420364268 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0b000d14b0 0x7f0b000d4780 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:28.832 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:28.833+0000 7f0aff200640 1 --2- 172.21.15.72:0/1420364268 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0b0015e1d0 0x7f0b00162760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:28.832 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:28.833+0000 7f0aff200640 1 -- 172.21.15.72:0/1420364268 >> 172.21.15.72:0/1420364268 conn(0x7f0b0006b8c0 msgr2=0x7f0b0006bcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:28.832 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:28.833+0000 7f0aff200640 1 -- 172.21.15.72:0/1420364268 shutdown_connections 2024-04-04T06:57:28.832 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:28.833+0000 7f0aff200640 1 -- 172.21.15.72:0/1420364268 wait complete. 2024-04-04T06:57:28.834 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:28.835+0000 7f0aff200640 1 Processor -- start 2024-04-04T06:57:28.834 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:28.836+0000 7f0aff200640 1 -- start start 2024-04-04T06:57:28.836 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:28.837+0000 7f0aff200640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0b000d1050 0x7f0b001609e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:28.836 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:28.837+0000 7f0aff200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0b000d14b0 0x7f0b000cb1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:28.836 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:28.837+0000 7f0aff200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0b0015e1d0 0x7f0b00152d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:28.836 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:28.837+0000 7f0aff200640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f0b000d3d20 con 0x7f0b000d1050 2024-04-04T06:57:28.836 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:28.837+0000 7f0aff200640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f0b000d1940 con 0x7f0b000d14b0 2024-04-04T06:57:28.836 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:28.837+0000 7f0aff200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f0b000b3430 con 0x7f0b0015e1d0 2024-04-04T06:57:28.837 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:28.837+0000 7f0afde00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0b000d1050 0x7f0b001609e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:28.837 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:28.838+0000 7f0afde00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0b000d1050 0x7f0b001609e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:37472/0 (socket says 172.21.15.72:37472) 2024-04-04T06:57:28.837 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:28.838+0000 7f0afde00640 1 -- 172.21.15.72:0/1815143118 learned_addr learned my addr 172.21.15.72:0/1815143118 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:57:28.838 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:28.838+0000 7f0afde00640 1 -- 172.21.15.72:0/1815143118 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0b0015e1d0 msgr2=0x7f0b00152d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:28.838 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:28.838+0000 7f0afde00640 1 --2- 172.21.15.72:0/1815143118 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0b0015e1d0 0x7f0b00152d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:28.838 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:28.838+0000 7f0afde00640 1 -- 172.21.15.72:0/1815143118 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0b000d14b0 msgr2=0x7f0b000cb1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:28.838 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:28.838+0000 7f0afde00640 1 --2- 172.21.15.72:0/1815143118 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0b000d14b0 0x7f0b000cb1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:28.838 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:28.838+0000 7f0afde00640 1 -- 172.21.15.72:0/1815143118 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b000cc4f0 con 0x7f0b000d1050 2024-04-04T06:57:28.838 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:28.838+0000 7f0afde00640 1 --2- 172.21.15.72:0/1815143118 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0b000d1050 0x7f0b001609e0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f0af000c820 tx=0x7f0af000cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:28.838 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:28.839+0000 7f0af6000640 1 -- 172.21.15.72:0/1815143118 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0af0015070 con 0x7f0b000d1050 2024-04-04T06:57:28.838 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:28.839+0000 7f0af6000640 1 -- 172.21.15.72:0/1815143118 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0af0004240 con 0x7f0b000d1050 2024-04-04T06:57:28.839 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:28.839+0000 7f0aff200640 1 -- 172.21.15.72:0/1815143118 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b00153280 con 0x7f0b000d1050 2024-04-04T06:57:28.839 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:28.839+0000 7f0af6000640 1 -- 172.21.15.72:0/1815143118 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0af000ce10 con 0x7f0b000d1050 2024-04-04T06:57:28.839 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:28.839+0000 7f0aff200640 1 -- 172.21.15.72:0/1815143118 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b000cbbc0 con 0x7f0b000d1050 2024-04-04T06:57:28.842 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:28.840+0000 7f0aff200640 1 -- 172.21.15.72:0/1815143118 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b000756c0 con 0x7f0b000d1050 2024-04-04T06:57:28.842 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:28.841+0000 7f0af6000640 1 -- 172.21.15.72:0/1815143118 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0af0007830 con 0x7f0b000d1050 2024-04-04T06:57:28.842 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:28.842+0000 7f0af6000640 1 --2- 172.21.15.72:0/1815143118 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f0adc06c8f0 0x7f0adc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:28.842 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:28.842+0000 7f0af6000640 1 -- 172.21.15.72:0/1815143118 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f0af008baf0 con 0x7f0b000d1050 2024-04-04T06:57:28.842 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:28.843+0000 7f0af7e00640 1 --2- 172.21.15.72:0/1815143118 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f0adc06c8f0 0x7f0adc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:28.842 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:28.843+0000 7f0af7e00640 1 --2- 172.21.15.72:0/1815143118 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f0adc06c8f0 0x7f0adc06edb0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f0ae8006fd0 tx=0x7f0ae8006bc0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:28.845 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:28.847+0000 7f0af6000640 1 -- 172.21.15.72:0/1815143118 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f0b00153280 con 0x7f0b000d1050 2024-04-04T06:57:29.043 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:29.044+0000 7f0aff200640 1 -- 172.21.15.72:0/1815143118 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f0b000d1d80 con 0x7f0b000d1050 2024-04-04T06:57:29.044 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:29.045+0000 7f0af6000640 1 -- 172.21.15.72:0/1815143118 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) ==== 93+0+10 (secure 0 0 0) 0x7f0af0059ea0 con 0x7f0b000d1050 2024-04-04T06:57:29.044 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 1 2024-04-04T06:57:29.047 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:29.048+0000 7f0aff200640 1 -- 172.21.15.72:0/1815143118 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f0adc06c8f0 msgr2=0x7f0adc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:29.047 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:29.048+0000 7f0aff200640 1 --2- 172.21.15.72:0/1815143118 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f0adc06c8f0 0x7f0adc06edb0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f0ae8006fd0 tx=0x7f0ae8006bc0 comp rx=0 tx=0).stop 2024-04-04T06:57:29.047 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:29.048+0000 7f0aff200640 1 -- 172.21.15.72:0/1815143118 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0b000d1050 msgr2=0x7f0b001609e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:29.047 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:29.048+0000 7f0aff200640 1 --2- 172.21.15.72:0/1815143118 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0b000d1050 0x7f0b001609e0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f0af000c820 tx=0x7f0af000cce0 comp rx=0 tx=0).stop 2024-04-04T06:57:29.047 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:29.048+0000 7f0aff200640 1 -- 172.21.15.72:0/1815143118 shutdown_connections 2024-04-04T06:57:29.047 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:29.048+0000 7f0aff200640 1 --2- 172.21.15.72:0/1815143118 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f0adc06c8f0 0x7f0adc06edb0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:29.047 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:29.048+0000 7f0aff200640 1 --2- 172.21.15.72:0/1815143118 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0b0015e1d0 0x7f0b00152d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:29.047 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:29.048+0000 7f0aff200640 1 --2- 172.21.15.72:0/1815143118 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0b000d14b0 0x7f0b000cb1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:29.047 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:29.048+0000 7f0aff200640 1 --2- 172.21.15.72:0/1815143118 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0b000d1050 0x7f0b001609e0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:29.048 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:29.048+0000 7f0aff200640 1 -- 172.21.15.72:0/1815143118 >> 172.21.15.72:0/1815143118 conn(0x7f0b0006b8c0 msgr2=0x7f0b000b45c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:29.048 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:29.048+0000 7f0aff200640 1 -- 172.21.15.72:0/1815143118 shutdown_connections 2024-04-04T06:57:29.048 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:29.048+0000 7f0aff200640 1 -- 172.21.15.72:0/1815143118 wait complete. 2024-04-04T06:57:29.065 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-04T06:57:29.275 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:29.276+0000 7f4e40800640 1 Processor -- start 2024-04-04T06:57:29.275 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:29.276+0000 7f4e40800640 1 -- start start 2024-04-04T06:57:29.276 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:29.277+0000 7f4e40800640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4e3815e6c0 0x7f4e380b6390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:29.276 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:29.277+0000 7f4e40800640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f4e380b68d0 0x7f4e380d2410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:29.276 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:29.277+0000 7f4e40800640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4e380d3100 con 0x7f4e380d2950 2024-04-04T06:57:29.276 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:29.277+0000 7f4e40800640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f4e380b6d30 con 0x7f4e380b68d0 2024-04-04T06:57:29.276 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:29.277+0000 7f4e40800640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f4e3815eaa0 con 0x7f4e3815e6c0 2024-04-04T06:57:29.277 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:29.278+0000 7f4e3de00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4e3815e6c0 0x7f4e380b6390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:29.277 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:29.278+0000 7f4e3de00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4e3815e6c0 0x7f4e380b6390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.72:48188/0 (socket says 172.21.15.72:48188) 2024-04-04T06:57:29.277 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:29.278+0000 7f4e3de00640 1 -- 172.21.15.72:0/1017355640 learned_addr learned my addr 172.21.15.72:0/1017355640 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:57:29.277 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:29.278+0000 7f4e3d400640 1 --2- 172.21.15.72:0/1017355640 >> v2:172.21.15.117:3300/0 conn(0x7f4e380b68d0 0x7f4e380d2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:29.277 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:29.279+0000 7f4e3de00640 1 -- 172.21.15.72:0/1017355640 >> v2:172.21.15.117:3300/0 conn(0x7f4e380b68d0 msgr2=0x7f4e380d2410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:57:29.277 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:29.279+0000 7f4e3de00640 1 --2- 172.21.15.72:0/1017355640 >> v2:172.21.15.117:3300/0 conn(0x7f4e380b68d0 0x7f4e380d2410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:29.278 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:29.279+0000 7f4e3de00640 1 -- 172.21.15.72:0/1017355640 >> v1:172.21.15.117:6789/0 conn(0x7f4e380d2950 legacy=0x7f4e380d4280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:29.278 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:29.279+0000 7f4e3de00640 1 -- 172.21.15.72:0/1017355640 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e380d33e0 con 0x7f4e3815e6c0 2024-04-04T06:57:29.278 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:29.280+0000 7f4e3de00640 1 --2- 172.21.15.72:0/1017355640 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4e3815e6c0 0x7f4e380b6390 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f4e2c009870 tx=0x7f4e2c02b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ebe1261665964a18 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:29.279 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:29.280+0000 7f4e3ca00640 1 -- 172.21.15.72:0/1017355640 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e2c034070 con 0x7f4e3815e6c0 2024-04-04T06:57:29.279 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:29.280+0000 7f4e3ca00640 1 -- 172.21.15.72:0/1017355640 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e2c030840 con 0x7f4e3815e6c0 2024-04-04T06:57:29.279 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:29.281+0000 7f4e3ca00640 1 -- 172.21.15.72:0/1017355640 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e2c030c10 con 0x7f4e3815e6c0 2024-04-04T06:57:29.280 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:29.281+0000 7f4e40800640 1 -- 172.21.15.72:0/1017355640 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4e3815e6c0 msgr2=0x7f4e380b6390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:29.280 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:29.281+0000 7f4e40800640 1 --2- 172.21.15.72:0/1017355640 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4e3815e6c0 0x7f4e380b6390 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f4e2c009870 tx=0x7f4e2c02b980 comp rx=0 tx=0).stop 2024-04-04T06:57:29.280 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:29.281+0000 7f4e40800640 1 -- 172.21.15.72:0/1017355640 shutdown_connections 2024-04-04T06:57:29.280 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:29.281+0000 7f4e40800640 1 --2- 172.21.15.72:0/1017355640 >> v2:172.21.15.117:3300/0 conn(0x7f4e380b68d0 0x7f4e380d2410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:29.280 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:29.281+0000 7f4e40800640 1 --2- 172.21.15.72:0/1017355640 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4e3815e6c0 0x7f4e380b6390 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:29.280 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:29.281+0000 7f4e40800640 1 -- 172.21.15.72:0/1017355640 >> 172.21.15.72:0/1017355640 conn(0x7f4e38071e80 msgr2=0x7f4e38072290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:29.280 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:29.281+0000 7f4e40800640 1 -- 172.21.15.72:0/1017355640 shutdown_connections 2024-04-04T06:57:29.280 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:29.281+0000 7f4e40800640 1 -- 172.21.15.72:0/1017355640 wait complete. 2024-04-04T06:57:29.281 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:29.283+0000 7f4e40800640 1 Processor -- start 2024-04-04T06:57:29.281 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:29.283+0000 7f4e40800640 1 -- start start 2024-04-04T06:57:29.283 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:29.284+0000 7f4e40800640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4e380b68d0 0x7f4e381f4bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:29.283 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:29.284+0000 7f4e40800640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4e380d2950 0x7f4e38150c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:29.283 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:29.284+0000 7f4e40800640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4e3815e6c0 0x7f4e38151160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:29.283 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:29.284+0000 7f4e40800640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f4e380d3c80 con 0x7f4e380b68d0 2024-04-04T06:57:29.283 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:29.284+0000 7f4e40800640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f4e380d39a0 con 0x7f4e380d2950 2024-04-04T06:57:29.283 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:29.284+0000 7f4e40800640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f4e380d2de0 con 0x7f4e3815e6c0 2024-04-04T06:57:29.283 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:29.284+0000 7f4e3de00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4e380b68d0 0x7f4e381f4bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:29.283 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:29.284+0000 7f4e3de00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4e380b68d0 0x7f4e381f4bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:38614/0 (socket says 172.21.15.72:38614) 2024-04-04T06:57:29.283 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:29.284+0000 7f4e3de00640 1 -- 172.21.15.72:0/3945949006 learned_addr learned my addr 172.21.15.72:0/3945949006 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:57:29.284 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:29.285+0000 7f4e3d400640 1 --2- 172.21.15.72:0/3945949006 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4e380d2950 0x7f4e38150c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:29.285 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:29.285+0000 7f4e3e800640 1 --2- 172.21.15.72:0/3945949006 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4e3815e6c0 0x7f4e38151160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:29.285 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:29.285+0000 7f4e3de00640 1 -- 172.21.15.72:0/3945949006 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4e3815e6c0 msgr2=0x7f4e38151160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:29.285 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:29.285+0000 7f4e3de00640 1 --2- 172.21.15.72:0/3945949006 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4e3815e6c0 0x7f4e38151160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:29.285 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:29.285+0000 7f4e3de00640 1 -- 172.21.15.72:0/3945949006 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4e380d2950 msgr2=0x7f4e38150c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:29.285 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:29.285+0000 7f4e3de00640 1 --2- 172.21.15.72:0/3945949006 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4e380d2950 0x7f4e38150c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:29.285 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:29.285+0000 7f4e3de00640 1 -- 172.21.15.72:0/3945949006 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e381f4560 con 0x7f4e380b68d0 2024-04-04T06:57:29.285 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:29.285+0000 7f4e3e800640 1 --2- 172.21.15.72:0/3945949006 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4e3815e6c0 0x7f4e38151160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-04T06:57:29.285 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:29.285+0000 7f4e3de00640 1 --2- 172.21.15.72:0/3945949006 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4e380b68d0 0x7f4e381f4bd0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f4e2c02b9c0 tx=0x7f4e2c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:29.285 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:29.285+0000 7f4e32000640 1 -- 172.21.15.72:0/3945949006 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e2c034040 con 0x7f4e380b68d0 2024-04-04T06:57:29.285 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:29.285+0000 7f4e32000640 1 -- 172.21.15.72:0/3945949006 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e2c030640 con 0x7f4e380b68d0 2024-04-04T06:57:29.285 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:29.286+0000 7f4e40800640 1 -- 172.21.15.72:0/3945949006 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e3814cea0 con 0x7f4e380b68d0 2024-04-04T06:57:29.285 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:29.286+0000 7f4e32000640 1 -- 172.21.15.72:0/3945949006 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e2c0423f0 con 0x7f4e380b68d0 2024-04-04T06:57:29.285 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:29.286+0000 7f4e40800640 1 -- 172.21.15.72:0/3945949006 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e3814d460 con 0x7f4e380b68d0 2024-04-04T06:57:29.286 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:29.287+0000 7f4e40800640 1 -- 172.21.15.72:0/3945949006 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e38075730 con 0x7f4e380b68d0 2024-04-04T06:57:29.286 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:29.288+0000 7f4e32000640 1 -- 172.21.15.72:0/3945949006 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4e2c037070 con 0x7f4e380b68d0 2024-04-04T06:57:29.288 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:29.289+0000 7f4e32000640 1 --2- 172.21.15.72:0/3945949006 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f4e1c06c8f0 0x7f4e1c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:29.288 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:29.290+0000 7f4e32000640 1 -- 172.21.15.72:0/3945949006 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f4e2c0addf0 con 0x7f4e380b68d0 2024-04-04T06:57:29.288 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:29.290+0000 7f4e3d400640 1 --2- 172.21.15.72:0/3945949006 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f4e1c06c8f0 0x7f4e1c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:29.289 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:29.290+0000 7f4e3d400640 1 --2- 172.21.15.72:0/3945949006 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f4e1c06c8f0 0x7f4e1c06edb0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f4e38161310 tx=0x7f4e28008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:29.292 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:29.294+0000 7f4e32000640 1 -- 172.21.15.72:0/3945949006 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f4e2c07c100 con 0x7f4e380b68d0 2024-04-04T06:57:29.495 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:29.496+0000 7f4e40800640 1 -- 172.21.15.72:0/3945949006 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f4e381f5110 con 0x7f4e380b68d0 2024-04-04T06:57:29.495 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:29.497+0000 7f4e32000640 1 -- 172.21.15.72:0/3945949006 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) ==== 104+0+11 (secure 0 0 0) 0x7f4e2c07ba00 con 0x7f4e380b68d0 2024-04-04T06:57:29.496 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2024-04-04T06:57:29.498 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:29.499+0000 7f4e40800640 1 -- 172.21.15.72:0/3945949006 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f4e1c06c8f0 msgr2=0x7f4e1c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:29.498 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:29.499+0000 7f4e40800640 1 --2- 172.21.15.72:0/3945949006 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f4e1c06c8f0 0x7f4e1c06edb0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f4e38161310 tx=0x7f4e28008040 comp rx=0 tx=0).stop 2024-04-04T06:57:29.498 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:29.499+0000 7f4e40800640 1 -- 172.21.15.72:0/3945949006 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4e380b68d0 msgr2=0x7f4e381f4bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:29.499 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:29.499+0000 7f4e40800640 1 --2- 172.21.15.72:0/3945949006 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4e380b68d0 0x7f4e381f4bd0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f4e2c02b9c0 tx=0x7f4e2c0046c0 comp rx=0 tx=0).stop 2024-04-04T06:57:29.499 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:29.499+0000 7f4e40800640 1 -- 172.21.15.72:0/3945949006 shutdown_connections 2024-04-04T06:57:29.499 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:29.499+0000 7f4e40800640 1 --2- 172.21.15.72:0/3945949006 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f4e1c06c8f0 0x7f4e1c06edb0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:29.499 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:29.499+0000 7f4e40800640 1 --2- 172.21.15.72:0/3945949006 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4e3815e6c0 0x7f4e38151160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:29.499 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:29.499+0000 7f4e40800640 1 --2- 172.21.15.72:0/3945949006 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4e380d2950 0x7f4e38150c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:29.499 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:29.499+0000 7f4e40800640 1 --2- 172.21.15.72:0/3945949006 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4e380b68d0 0x7f4e381f4bd0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:29.499 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:29.499+0000 7f4e40800640 1 -- 172.21.15.72:0/3945949006 >> 172.21.15.72:0/3945949006 conn(0x7f4e38071e80 msgr2=0x7f4e380cf030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:29.499 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:29.499+0000 7f4e40800640 1 -- 172.21.15.72:0/3945949006 shutdown_connections 2024-04-04T06:57:29.499 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:29.500+0000 7f4e40800640 1 -- 172.21.15.72:0/3945949006 wait complete. 2024-04-04T06:57:29.515 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-04T06:57:29.718 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:29.719+0000 7fbb6ea00640 1 Processor -- start 2024-04-04T06:57:29.718 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:29.719+0000 7fbb6ea00640 1 -- start start 2024-04-04T06:57:29.719 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:29.720+0000 7fbb6ea00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbb6815afb0 0x7fbb68071e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:29.719 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:29.721+0000 7fbb6ea00640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb6815ece0 con 0x7fbb680cf360 2024-04-04T06:57:29.719 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:29.721+0000 7fbb6ea00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb6815efa0 con 0x7fbb6815b390 2024-04-04T06:57:29.720 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:29.721+0000 7fbb6ea00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fbb68072350 con 0x7fbb6815afb0 2024-04-04T06:57:29.720 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:29.721+0000 7fbb5f400640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fbb680cf360 0x7fbb680726e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:52244/0 (socket says 172.21.15.72:52244) 2024-04-04T06:57:29.720 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:29.721+0000 7fbb5f400640 1 -- 172.21.15.72:0/1497097991 learned_addr learned my addr 172.21.15.72:0/1497097991 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-04-04T06:57:29.722 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:29.721+0000 7fbb67e00640 1 --2- 172.21.15.72:0/1497097991 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbb6815afb0 0x7fbb68071e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:29.722 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:29.721+0000 7fbb67400640 1 -- 172.21.15.72:0/1497097991 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3704422550 0 0) 0x7fbb6815ece0 con 0x7fbb680cf360 2024-04-04T06:57:29.722 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:29.721+0000 7fbb67400640 1 -- 172.21.15.72:0/1497097991 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbb4c003520 con 0x7fbb680cf360 2024-04-04T06:57:29.722 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:29.722+0000 7fbb67400640 1 -- 172.21.15.72:0/1497097991 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 645316622 0 0) 0x7fbb4c003520 con 0x7fbb680cf360 2024-04-04T06:57:29.722 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:29.722+0000 7fbb67400640 1 -- 172.21.15.72:0/1497097991 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbb6815afb0 msgr2=0x7fbb68071e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:57:29.722 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:29.722+0000 7fbb67400640 1 --2- 172.21.15.72:0/1497097991 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbb6815afb0 0x7fbb68071e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:29.722 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:29.722+0000 7fbb67400640 1 -- 172.21.15.72:0/1497097991 >> v1:172.21.15.117:6789/0 conn(0x7fbb6815b390 legacy=0x7fbb680cdd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:29.722 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:29.722+0000 7fbb67400640 1 -- 172.21.15.72:0/1497097991 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb6815f280 con 0x7fbb680cf360 2024-04-04T06:57:29.722 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:29.722+0000 7fbb67400640 1 -- 172.21.15.72:0/1497097991 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2465650867 0 0) 0x7fbb500019f0 con 0x7fbb680cf360 2024-04-04T06:57:29.722 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:29.722+0000 7fbb67400640 1 -- 172.21.15.72:0/1497097991 >> v1:172.21.15.72:6789/0 conn(0x7fbb680cf360 legacy=0x7fbb680726e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:29.722 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:29.722+0000 7fbb67400640 1 --2- 172.21.15.72:0/1497097991 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbb4c0039e0 0x7fbb4c003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:29.722 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:29.722+0000 7fbb67400640 1 --2- 172.21.15.72:0/1497097991 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbb4c004800 0x7fbb4c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:29.723 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:29.722+0000 7fbb67400640 1 --2- 172.21.15.72:0/1497097991 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbb6815afb0 0x7fbb4c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:29.723 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:29.722+0000 7fbb67400640 1 -- 172.21.15.72:0/1497097991 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fbb68072350 con 0x7fbb4c0039e0 2024-04-04T06:57:29.723 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:29.722+0000 7fbb67400640 1 -- 172.21.15.72:0/1497097991 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fbb4c00baa0 con 0x7fbb4c004800 2024-04-04T06:57:29.723 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:29.722+0000 7fbb67400640 1 -- 172.21.15.72:0/1497097991 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fbb4c00deb0 con 0x7fbb6815afb0 2024-04-04T06:57:29.723 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:29.722+0000 7fbb67e00640 1 --2- 172.21.15.72:0/1497097991 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbb4c0039e0 0x7fbb4c003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:29.723 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:29.723+0000 7fbb5f400640 1 --2- 172.21.15.72:0/1497097991 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbb4c004800 0x7fbb4c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:29.723 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:29.723+0000 7fbb6ca00640 1 --2- 172.21.15.72:0/1497097991 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbb6815afb0 0x7fbb4c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:29.723 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:29.723+0000 7fbb67e00640 1 -- 172.21.15.72:0/1497097991 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbb6815afb0 msgr2=0x7fbb4c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:57:29.723 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:29.723+0000 7fbb67e00640 1 --2- 172.21.15.72:0/1497097991 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbb6815afb0 0x7fbb4c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:29.723 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:29.723+0000 7fbb67e00640 1 -- 172.21.15.72:0/1497097991 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbb4c004800 msgr2=0x7fbb4c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:57:29.723 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:29.723+0000 7fbb67e00640 1 --2- 172.21.15.72:0/1497097991 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbb4c004800 0x7fbb4c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:29.723 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:29.723+0000 7fbb67e00640 1 -- 172.21.15.72:0/1497097991 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb4c003520 con 0x7fbb4c0039e0 2024-04-04T06:57:29.723 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:29.723+0000 7fbb5f400640 1 --2- 172.21.15.72:0/1497097991 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbb4c004800 0x7fbb4c004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-04T06:57:29.723 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:29.723+0000 7fbb6ca00640 1 --2- 172.21.15.72:0/1497097991 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbb6815afb0 0x7fbb4c0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-04T06:57:29.724 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:29.724+0000 7fbb67e00640 1 --2- 172.21.15.72:0/1497097991 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbb4c0039e0 0x7fbb4c003e00 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fbb58009a90 tx=0x7fbb4c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cefaa7e118600ed6 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:29.725 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:29.724+0000 7fbb67400640 1 -- 172.21.15.72:0/1497097991 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb58039070 con 0x7fbb4c0039e0 2024-04-04T06:57:29.725 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:29.724+0000 7fbb67400640 1 -- 172.21.15.72:0/1497097991 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb5802c660 con 0x7fbb4c0039e0 2024-04-04T06:57:29.725 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:29.724+0000 7fbb67400640 1 -- 172.21.15.72:0/1497097991 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb58009690 con 0x7fbb4c0039e0 2024-04-04T06:57:29.725 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:29.725+0000 7fbb6ea00640 1 -- 172.21.15.72:0/1497097991 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbb4c0039e0 msgr2=0x7fbb4c003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:29.725 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:29.725+0000 7fbb6ea00640 1 --2- 172.21.15.72:0/1497097991 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbb4c0039e0 0x7fbb4c003e00 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fbb58009a90 tx=0x7fbb4c005830 comp rx=0 tx=0).stop 2024-04-04T06:57:29.725 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:29.725+0000 7fbb6ca00640 1 -- 172.21.15.72:0/1497097991 reap_dead start 2024-04-04T06:57:29.725 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:29.725+0000 7fbb6ea00640 1 -- 172.21.15.72:0/1497097991 shutdown_connections 2024-04-04T06:57:29.725 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:29.725+0000 7fbb6ea00640 1 -- 172.21.15.72:0/1497097991 >> 172.21.15.72:0/1497097991 conn(0x7fbb6806b470 msgr2=0x7fbb6806b850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:29.725 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:29.725+0000 7fbb6ea00640 1 -- 172.21.15.72:0/1497097991 shutdown_connections 2024-04-04T06:57:29.725 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:29.725+0000 7fbb6ea00640 1 -- 172.21.15.72:0/1497097991 wait complete. 2024-04-04T06:57:29.726 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:29.727+0000 7fbb6ea00640 1 Processor -- start 2024-04-04T06:57:29.726 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:29.727+0000 7fbb6ea00640 1 -- start start 2024-04-04T06:57:29.727 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:29.728+0000 7fbb6ea00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbb4c0039e0 0x7fbb6815e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:29.727 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:29.728+0000 7fbb6ea00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbb6814a580 0x7fbb681f0990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:29.727 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:29.728+0000 7fbb6ea00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbb681f0ed0 0x7fbb680b1630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:29.727 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:29.728+0000 7fbb6ea00640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fbb6815fb20 con 0x7fbb4c0039e0 2024-04-04T06:57:29.727 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:29.728+0000 7fbb6ea00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fbb6815f840 con 0x7fbb6814a580 2024-04-04T06:57:29.727 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:29.728+0000 7fbb6ea00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fbb680b2fd0 con 0x7fbb681f0ed0 2024-04-04T06:57:29.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:29.728+0000 7fbb67e00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbb4c0039e0 0x7fbb6815e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:29.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:29.728+0000 7fbb67e00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbb4c0039e0 0x7fbb6815e2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:38630/0 (socket says 172.21.15.72:38630) 2024-04-04T06:57:29.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:29.728+0000 7fbb67e00640 1 -- 172.21.15.72:0/673150275 learned_addr learned my addr 172.21.15.72:0/673150275 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:57:29.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:29.728+0000 7fbb67e00640 1 -- 172.21.15.72:0/673150275 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbb681f0ed0 msgr2=0x7fbb680b1630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:29.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:29.728+0000 7fbb67e00640 1 --2- 172.21.15.72:0/673150275 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbb681f0ed0 0x7fbb680b1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:29.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:29.728+0000 7fbb67e00640 1 -- 172.21.15.72:0/673150275 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbb6814a580 msgr2=0x7fbb681f0990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:29.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:29.728+0000 7fbb67e00640 1 --2- 172.21.15.72:0/673150275 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbb6814a580 0x7fbb681f0990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:29.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:29.728+0000 7fbb67e00640 1 -- 172.21.15.72:0/673150275 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb6815d240 con 0x7fbb4c0039e0 2024-04-04T06:57:29.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:29.729+0000 7fbb67e00640 1 --2- 172.21.15.72:0/673150275 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbb4c0039e0 0x7fbb6815e2e0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fbb58000c00 tx=0x7fbb58004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:29.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:29.729+0000 7fbb64c00640 1 -- 172.21.15.72:0/673150275 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb58042020 con 0x7fbb4c0039e0 2024-04-04T06:57:29.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:29.729+0000 7fbb64c00640 1 -- 172.21.15.72:0/673150275 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb5803a040 con 0x7fbb4c0039e0 2024-04-04T06:57:29.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:29.729+0000 7fbb64c00640 1 -- 172.21.15.72:0/673150275 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb58039070 con 0x7fbb4c0039e0 2024-04-04T06:57:29.730 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:29.729+0000 7fbb6ea00640 1 -- 172.21.15.72:0/673150275 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb6815d520 con 0x7fbb4c0039e0 2024-04-04T06:57:29.730 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:29.729+0000 7fbb6ea00640 1 -- 172.21.15.72:0/673150275 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb6815dae0 con 0x7fbb4c0039e0 2024-04-04T06:57:29.730 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:29.730+0000 7fbb6ea00640 1 -- 172.21.15.72:0/673150275 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb68075730 con 0x7fbb4c0039e0 2024-04-04T06:57:29.731 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:29.732+0000 7fbb64c00640 1 -- 172.21.15.72:0/673150275 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fbb58045020 con 0x7fbb4c0039e0 2024-04-04T06:57:29.731 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:29.733+0000 7fbb64c00640 1 --2- 172.21.15.72:0/673150275 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fbb4406c920 0x7fbb4406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:29.732 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:29.733+0000 7fbb64c00640 1 -- 172.21.15.72:0/673150275 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7fbb580acb60 con 0x7fbb4c0039e0 2024-04-04T06:57:29.732 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:29.733+0000 7fbb5f400640 1 --2- 172.21.15.72:0/673150275 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fbb4406c920 0x7fbb4406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:29.732 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:29.734+0000 7fbb5f400640 1 --2- 172.21.15.72:0/673150275 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fbb4406c920 0x7fbb4406ede0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fbb50001b60 tx=0x7fbb50009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:29.736 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:29.738+0000 7fbb64c00640 1 -- 172.21.15.72:0/673150275 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fbb5804c020 con 0x7fbb4c0039e0 2024-04-04T06:57:29.934 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:29.935+0000 7fbb6ea00640 1 -- 172.21.15.72:0/673150275 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fbb680cfac0 con 0x7fbb4c0039e0 2024-04-04T06:57:29.935 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:29.936+0000 7fbb64c00640 1 -- 172.21.15.72:0/673150275 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) ==== 100+0+11 (secure 0 0 0) 0x7fbb5807af80 con 0x7fbb4c0039e0 2024-04-04T06:57:29.935 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 64 2024-04-04T06:57:29.938 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:29.939+0000 7fbb6ea00640 1 -- 172.21.15.72:0/673150275 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fbb4406c920 msgr2=0x7fbb4406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:29.938 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:29.939+0000 7fbb6ea00640 1 --2- 172.21.15.72:0/673150275 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fbb4406c920 0x7fbb4406ede0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fbb50001b60 tx=0x7fbb50009040 comp rx=0 tx=0).stop 2024-04-04T06:57:29.938 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:29.939+0000 7fbb6ea00640 1 -- 172.21.15.72:0/673150275 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbb4c0039e0 msgr2=0x7fbb6815e2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:29.938 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:29.939+0000 7fbb6ea00640 1 --2- 172.21.15.72:0/673150275 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbb4c0039e0 0x7fbb6815e2e0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fbb58000c00 tx=0x7fbb58004730 comp rx=0 tx=0).stop 2024-04-04T06:57:29.938 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:29.939+0000 7fbb6ea00640 1 -- 172.21.15.72:0/673150275 shutdown_connections 2024-04-04T06:57:29.938 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:29.939+0000 7fbb6ea00640 1 --2- 172.21.15.72:0/673150275 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fbb4406c920 0x7fbb4406ede0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:29.938 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:29.939+0000 7fbb6ea00640 1 --2- 172.21.15.72:0/673150275 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbb681f0ed0 0x7fbb680b1630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:29.938 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:29.939+0000 7fbb6ea00640 1 --2- 172.21.15.72:0/673150275 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbb6814a580 0x7fbb681f0990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:29.938 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:29.939+0000 7fbb6ea00640 1 --2- 172.21.15.72:0/673150275 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbb4c0039e0 0x7fbb6815e2e0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:29.938 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:29.939+0000 7fbb6ea00640 1 -- 172.21.15.72:0/673150275 >> 172.21.15.72:0/673150275 conn(0x7fbb6806b470 msgr2=0x7fbb68154d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:29.938 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:29.939+0000 7fbb6ea00640 1 -- 172.21.15.72:0/673150275 shutdown_connections 2024-04-04T06:57:29.938 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:29.939+0000 7fbb6ea00640 1 -- 172.21.15.72:0/673150275 wait complete. 2024-04-04T06:57:29.957 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-04T06:57:30.178 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:30.179+0000 7f2c86000640 1 Processor -- start 2024-04-04T06:57:30.179 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:30.180+0000 7f2c86000640 1 -- start start 2024-04-04T06:57:30.180 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:30.181+0000 7f2c86000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2c8015e5a0 0x7f2c800b75c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:30.180 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:30.181+0000 7f2c86000640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2c800cf7f0 con 0x7f2c800b7b00 2024-04-04T06:57:30.180 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:30.181+0000 7f2c86000640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2c800cfad0 con 0x7f2c800d3540 2024-04-04T06:57:30.180 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:30.181+0000 7f2c86000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f2c800d2350 con 0x7f2c8015e5a0 2024-04-04T06:57:30.180 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:30.181+0000 7f2c7fe00640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f2c800b7b00 0x7f2c800d2e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:52252/0 (socket says 172.21.15.72:52252) 2024-04-04T06:57:30.180 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:30.181+0000 7f2c7fe00640 1 -- 172.21.15.72:0/4204701132 learned_addr learned my addr 172.21.15.72:0/4204701132 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-04-04T06:57:30.182 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:30.182+0000 7f2c84c00640 1 --2- 172.21.15.72:0/4204701132 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2c8015e5a0 0x7f2c800b75c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:30.182 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:30.182+0000 7f2c7f400640 1 -- 172.21.15.72:0/4204701132 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 366965894 0 0) 0x7f2c800cf7f0 con 0x7f2c800b7b00 2024-04-04T06:57:30.182 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:30.182+0000 7f2c7f400640 1 -- 172.21.15.72:0/4204701132 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2c64003520 con 0x7f2c800b7b00 2024-04-04T06:57:30.182 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:30.182+0000 7f2c7f400640 1 -- 172.21.15.72:0/4204701132 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3813606163 0 0) 0x7f2c64003520 con 0x7f2c800b7b00 2024-04-04T06:57:30.182 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:30.182+0000 7f2c7f400640 1 -- 172.21.15.72:0/4204701132 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2c8015e5a0 msgr2=0x7f2c800b75c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:57:30.182 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:30.182+0000 7f2c7f400640 1 --2- 172.21.15.72:0/4204701132 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2c8015e5a0 0x7f2c800b75c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:30.182 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:30.182+0000 7f2c7f400640 1 -- 172.21.15.72:0/4204701132 >> v1:172.21.15.117:6789/0 conn(0x7f2c800d3540 legacy=0x7f2c800d08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:30.182 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:30.182+0000 7f2c7f400640 1 -- 172.21.15.72:0/4204701132 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c800d2630 con 0x7f2c800b7b00 2024-04-04T06:57:30.183 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:30.182+0000 7f2c7f400640 1 -- 172.21.15.72:0/4204701132 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2465650867 0 0) 0x7f2c6c001670 con 0x7f2c800b7b00 2024-04-04T06:57:30.183 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:30.182+0000 7f2c7f400640 1 -- 172.21.15.72:0/4204701132 >> v1:172.21.15.72:6789/0 conn(0x7f2c800b7b00 legacy=0x7f2c800d2e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:30.183 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:30.182+0000 7f2c7f400640 1 --2- 172.21.15.72:0/4204701132 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2c640039e0 0x7f2c64003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:30.183 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:30.182+0000 7f2c7f400640 1 --2- 172.21.15.72:0/4204701132 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2c8015e5a0 0x7f2c64004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:30.183 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:30.183+0000 7f2c7f400640 1 --2- 172.21.15.72:0/4204701132 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2c64004d40 0x7f2c640051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:30.183 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:30.183+0000 7f2c7f400640 1 -- 172.21.15.72:0/4204701132 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f2c800d2350 con 0x7f2c640039e0 2024-04-04T06:57:30.183 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:30.183+0000 7f2c7f400640 1 -- 172.21.15.72:0/4204701132 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f2c6400ba70 con 0x7f2c64004d40 2024-04-04T06:57:30.183 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:30.183+0000 7f2c7f400640 1 -- 172.21.15.72:0/4204701132 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f2c6400bc70 con 0x7f2c8015e5a0 2024-04-04T06:57:30.183 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:30.183+0000 7f2c84c00640 1 --2- 172.21.15.72:0/4204701132 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2c640039e0 0x7f2c64003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:30.183 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:30.183+0000 7f2c84c00640 1 -- 172.21.15.72:0/4204701132 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2c8015e5a0 msgr2=0x7f2c64004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:57:30.183 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:30.183+0000 7f2c84c00640 1 --2- 172.21.15.72:0/4204701132 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2c8015e5a0 0x7f2c64004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:30.183 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:30.183+0000 7f2c84c00640 1 -- 172.21.15.72:0/4204701132 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2c64004d40 msgr2=0x7f2c640051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:57:30.183 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:30.183+0000 7f2c84c00640 1 --2- 172.21.15.72:0/4204701132 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2c64004d40 0x7f2c640051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:30.183 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:30.183+0000 7f2c84c00640 1 -- 172.21.15.72:0/4204701132 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c64003520 con 0x7f2c640039e0 2024-04-04T06:57:30.184 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:30.184+0000 7f2c84c00640 1 --2- 172.21.15.72:0/4204701132 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2c640039e0 0x7f2c64003e00 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f2c70009f90 tx=0x7f2c64005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f8e67b85e3ebd09 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:30.184 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:30.184+0000 7f2c7f400640 1 -- 172.21.15.72:0/4204701132 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c70039070 con 0x7f2c640039e0 2024-04-04T06:57:30.185 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:30.184+0000 7f2c7f400640 1 -- 172.21.15.72:0/4204701132 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c7002cc20 con 0x7f2c640039e0 2024-04-04T06:57:30.185 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:30.184+0000 7f2c7f400640 1 -- 172.21.15.72:0/4204701132 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c70009c10 con 0x7f2c640039e0 2024-04-04T06:57:30.185 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:30.185+0000 7f2c86000640 1 -- 172.21.15.72:0/4204701132 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2c640039e0 msgr2=0x7f2c64003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:30.185 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:30.185+0000 7f2c86000640 1 --2- 172.21.15.72:0/4204701132 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2c640039e0 0x7f2c64003e00 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f2c70009f90 tx=0x7f2c64005830 comp rx=0 tx=0).stop 2024-04-04T06:57:30.185 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:30.185+0000 7f2c85600640 1 -- 172.21.15.72:0/4204701132 reap_dead start 2024-04-04T06:57:30.185 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:30.185+0000 7f2c86000640 1 -- 172.21.15.72:0/4204701132 shutdown_connections 2024-04-04T06:57:30.185 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:30.185+0000 7f2c86000640 1 -- 172.21.15.72:0/4204701132 >> 172.21.15.72:0/4204701132 conn(0x7f2c8006b890 msgr2=0x7f2c8006bca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:30.185 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:30.185+0000 7f2c86000640 1 -- 172.21.15.72:0/4204701132 shutdown_connections 2024-04-04T06:57:30.185 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:30.185+0000 7f2c86000640 1 -- 172.21.15.72:0/4204701132 wait complete. 2024-04-04T06:57:30.186 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:30.187+0000 7f2c86000640 1 Processor -- start 2024-04-04T06:57:30.186 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:30.187+0000 7f2c86000640 1 -- start start 2024-04-04T06:57:30.188 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:30.188+0000 7f2c86000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2c640039e0 0x7f2c800cd8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:30.188 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:30.188+0000 7f2c86000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2c8015eb00 0x7f2c80160700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:30.188 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:30.188+0000 7f2c86000640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2c80160c40 0x7f2c801610c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:30.188 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:30.188+0000 7f2c86000640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f2c800d0ff0 con 0x7f2c80160c40 2024-04-04T06:57:30.188 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:30.188+0000 7f2c86000640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f2c8015e980 con 0x7f2c8015eb00 2024-04-04T06:57:30.189 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:30.188+0000 7f2c86000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f2c800d1170 con 0x7f2c640039e0 2024-04-04T06:57:30.189 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:30.188+0000 7f2c85600640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2c80160c40 0x7f2c801610c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:30.189 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:30.188+0000 7f2c85600640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2c80160c40 0x7f2c801610c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:38642/0 (socket says 172.21.15.72:38642) 2024-04-04T06:57:30.189 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:30.188+0000 7f2c85600640 1 -- 172.21.15.72:0/3342042156 learned_addr learned my addr 172.21.15.72:0/3342042156 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:57:30.189 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:30.188+0000 7f2c84c00640 1 --2- 172.21.15.72:0/3342042156 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2c640039e0 0x7f2c800cd8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:30.189 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:30.188+0000 7f2c7fe00640 1 --2- 172.21.15.72:0/3342042156 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2c8015eb00 0x7f2c80160700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:30.189 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:30.189+0000 7f2c85600640 1 -- 172.21.15.72:0/3342042156 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2c640039e0 msgr2=0x7f2c800cd8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:30.189 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:30.189+0000 7f2c85600640 1 --2- 172.21.15.72:0/3342042156 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2c640039e0 0x7f2c800cd8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:30.189 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:30.189+0000 7f2c85600640 1 -- 172.21.15.72:0/3342042156 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2c8015eb00 msgr2=0x7f2c80160700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:30.189 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:30.189+0000 7f2c85600640 1 --2- 172.21.15.72:0/3342042156 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2c8015eb00 0x7f2c80160700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:30.189 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:30.189+0000 7f2c85600640 1 -- 172.21.15.72:0/3342042156 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c800cc2a0 con 0x7f2c80160c40 2024-04-04T06:57:30.190 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:30.189+0000 7f2c84c00640 1 --2- 172.21.15.72:0/3342042156 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2c640039e0 0x7f2c800cd8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-04T06:57:30.190 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:30.189+0000 7f2c85600640 1 --2- 172.21.15.72:0/3342042156 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2c80160c40 0x7f2c801610c0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f2c800ce8b0 tx=0x7f2c7800c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:30.190 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:30.189+0000 7f2c7cc00640 1 -- 172.21.15.72:0/3342042156 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c7800cea0 con 0x7f2c80160c40 2024-04-04T06:57:30.190 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:30.189+0000 7f2c7cc00640 1 -- 172.21.15.72:0/3342042156 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c78007500 con 0x7f2c80160c40 2024-04-04T06:57:30.190 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:30.189+0000 7f2c86000640 1 -- 172.21.15.72:0/3342042156 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c80161600 con 0x7f2c80160c40 2024-04-04T06:57:30.190 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:30.189+0000 7f2c7cc00640 1 -- 172.21.15.72:0/3342042156 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c78004260 con 0x7f2c80160c40 2024-04-04T06:57:30.190 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:30.190+0000 7f2c86000640 1 -- 172.21.15.72:0/3342042156 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c800cc820 con 0x7f2c80160c40 2024-04-04T06:57:30.191 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:30.191+0000 7f2c86000640 1 -- 172.21.15.72:0/3342042156 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c800756c0 con 0x7f2c80160c40 2024-04-04T06:57:30.191 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:30.191+0000 7f2c7cc00640 1 -- 172.21.15.72:0/3342042156 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2c780057c0 con 0x7f2c80160c40 2024-04-04T06:57:30.191 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:30.192+0000 7f2c7cc00640 1 --2- 172.21.15.72:0/3342042156 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f2c6006c8f0 0x7f2c6006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:30.191 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:30.192+0000 7f2c7cc00640 1 -- 172.21.15.72:0/3342042156 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f2c7808add0 con 0x7f2c80160c40 2024-04-04T06:57:30.191 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:30.193+0000 7f2c84c00640 1 --2- 172.21.15.72:0/3342042156 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f2c6006c8f0 0x7f2c6006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:30.192 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:30.193+0000 7f2c84c00640 1 --2- 172.21.15.72:0/3342042156 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f2c6006c8f0 0x7f2c6006edb0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f2c70036000 tx=0x7f2c7002e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:30.195 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:30.197+0000 7f2c7cc00640 1 -- 172.21.15.72:0/3342042156 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f2c780590e0 con 0x7f2c80160c40 2024-04-04T06:57:30.410 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:30.412+0000 7f2c86000640 1 -- 172.21.15.72:0/3342042156 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f2c800d2090 con 0x7f2c80160c40 2024-04-04T06:57:30.411 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:30.412+0000 7f2c7cc00640 1 -- 172.21.15.72:0/3342042156 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v22) ==== 80+0+0 (secure 0 0 0) 0x7f2c78007e00 con 0x7f2c80160c40 2024-04-04T06:57:30.411 INFO:teuthology.orchestra.run.smithi072.stderr:listed 0 entries 2024-04-04T06:57:30.414 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:30.415+0000 7f2c86000640 1 -- 172.21.15.72:0/3342042156 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f2c6006c8f0 msgr2=0x7f2c6006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:30.414 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:30.415+0000 7f2c86000640 1 --2- 172.21.15.72:0/3342042156 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f2c6006c8f0 0x7f2c6006edb0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f2c70036000 tx=0x7f2c7002e000 comp rx=0 tx=0).stop 2024-04-04T06:57:30.415 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:30.415+0000 7f2c86000640 1 -- 172.21.15.72:0/3342042156 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2c80160c40 msgr2=0x7f2c801610c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:30.415 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:30.415+0000 7f2c86000640 1 --2- 172.21.15.72:0/3342042156 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2c80160c40 0x7f2c801610c0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f2c800ce8b0 tx=0x7f2c7800c820 comp rx=0 tx=0).stop 2024-04-04T06:57:30.415 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:30.415+0000 7f2c86000640 1 -- 172.21.15.72:0/3342042156 shutdown_connections 2024-04-04T06:57:30.415 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:30.415+0000 7f2c86000640 1 --2- 172.21.15.72:0/3342042156 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f2c6006c8f0 0x7f2c6006edb0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:30.415 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:30.415+0000 7f2c86000640 1 --2- 172.21.15.72:0/3342042156 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2c80160c40 0x7f2c801610c0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:30.415 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:30.415+0000 7f2c86000640 1 --2- 172.21.15.72:0/3342042156 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2c8015eb00 0x7f2c80160700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:30.415 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:30.415+0000 7f2c86000640 1 --2- 172.21.15.72:0/3342042156 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2c640039e0 0x7f2c800cd8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:30.416 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:30.415+0000 7f2c86000640 1 -- 172.21.15.72:0/3342042156 >> 172.21.15.72:0/3342042156 conn(0x7f2c8006b890 msgr2=0x7f2c801577c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:30.416 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:30.415+0000 7f2c86000640 1 -- 172.21.15.72:0/3342042156 shutdown_connections 2024-04-04T06:57:30.416 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:30.415+0000 7f2c86000640 1 -- 172.21.15.72:0/3342042156 wait complete. 2024-04-04T06:57:30.432 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-04-04T06:57:30.432 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-04T06:57:30.489 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-04T06:57:30.701 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:30.702+0000 7f0fc2200640 1 Processor -- start 2024-04-04T06:57:30.701 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:30.703+0000 7f0fc2200640 1 -- start start 2024-04-04T06:57:30.703 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:30.704+0000 7f0fc2200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0fbc0b35a0 0x7f0fbc0d23b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:30.703 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:30.704+0000 7f0fc2200640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0fbc0d1900 0x7f0fbc0d28f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:30.703 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:30.704+0000 7f0fc2200640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0fbc0ba0c0 con 0x7f0fbc15e520 2024-04-04T06:57:30.703 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:30.704+0000 7f0fc2200640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f0fbc0d4230 con 0x7f0fbc0d1900 2024-04-04T06:57:30.704 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:30.704+0000 7f0fc2200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f0fbc0d4ad0 con 0x7f0fbc0b35a0 2024-04-04T06:57:30.704 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:30.705+0000 7f0fbbe00640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0fbc0d1900 0x7f0fbc0d28f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:30.704 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:30.705+0000 7f0fbbe00640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0fbc0d1900 0x7f0fbc0d28f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:38654/0 (socket says 172.21.15.72:38654) 2024-04-04T06:57:30.704 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:30.705+0000 7f0fbbe00640 1 -- 172.21.15.72:0/2253246358 learned_addr learned my addr 172.21.15.72:0/2253246358 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:57:30.704 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:30.705+0000 7f0fbaa00640 1 --2- 172.21.15.72:0/2253246358 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0fbc0b35a0 0x7f0fbc0d23b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:30.704 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:30.705+0000 7f0fbbe00640 1 -- 172.21.15.72:0/2253246358 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0fbc0b35a0 msgr2=0x7f0fbc0d23b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:57:30.705 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:30.705+0000 7f0fbbe00640 1 --2- 172.21.15.72:0/2253246358 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0fbc0b35a0 0x7f0fbc0d23b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:30.705 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:30.705+0000 7f0fbbe00640 1 -- 172.21.15.72:0/2253246358 >> v1:172.21.15.117:6789/0 conn(0x7f0fbc15e520 legacy=0x7f0fbc0d11f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:57:30.705 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:30.705+0000 7f0fbbe00640 1 -- 172.21.15.72:0/2253246358 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fbc0d4480 con 0x7f0fbc0d1900 2024-04-04T06:57:30.706 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:30.707+0000 7f0fbbe00640 1 --2- 172.21.15.72:0/2253246358 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0fbc0d1900 0x7f0fbc0d28f0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f0fbc0ce880 tx=0x7f0fb402be90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff8c404d2376172b server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:30.707 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:30.708+0000 7f0fba000640 1 -- 172.21.15.72:0/2253246358 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fb402ca30 con 0x7f0fbc0d1900 2024-04-04T06:57:30.707 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:30.708+0000 7f0fba000640 1 -- 172.21.15.72:0/2253246358 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0fb402cbd0 con 0x7f0fbc0d1900 2024-04-04T06:57:30.707 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:30.708+0000 7f0fba000640 1 -- 172.21.15.72:0/2253246358 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fb40343f0 con 0x7f0fbc0d1900 2024-04-04T06:57:30.708 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:30.708+0000 7f0fc2200640 1 -- 172.21.15.72:0/2253246358 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0fbc0d1900 msgr2=0x7f0fbc0d28f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:30.708 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:30.708+0000 7f0fc2200640 1 --2- 172.21.15.72:0/2253246358 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0fbc0d1900 0x7f0fbc0d28f0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f0fbc0ce880 tx=0x7f0fb402be90 comp rx=0 tx=0).stop 2024-04-04T06:57:30.708 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:30.708+0000 7f0fc2200640 1 -- 172.21.15.72:0/2253246358 shutdown_connections 2024-04-04T06:57:30.708 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:30.708+0000 7f0fc2200640 1 --2- 172.21.15.72:0/2253246358 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0fbc0d1900 0x7f0fbc0d28f0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:30.708 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:30.708+0000 7f0fc2200640 1 --2- 172.21.15.72:0/2253246358 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0fbc0b35a0 0x7f0fbc0d23b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:30.708 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:30.708+0000 7f0fc2200640 1 -- 172.21.15.72:0/2253246358 >> 172.21.15.72:0/2253246358 conn(0x7f0fbc071eb0 msgr2=0x7f0fbc0722c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:30.708 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:30.709+0000 7f0fc2200640 1 -- 172.21.15.72:0/2253246358 shutdown_connections 2024-04-04T06:57:30.708 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:30.709+0000 7f0fc2200640 1 -- 172.21.15.72:0/2253246358 wait complete. 2024-04-04T06:57:30.709 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:30.710+0000 7f0fc2200640 1 Processor -- start 2024-04-04T06:57:30.709 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:30.710+0000 7f0fc2200640 1 -- start start 2024-04-04T06:57:30.711 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:30.711+0000 7f0fc2200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0fbc0b35a0 0x7f0fbc1f70a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:30.711 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:30.711+0000 7f0fc2200640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0fbc0d1900 0x7f0fbc160140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:30.712 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:30.711+0000 7f0fc2200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0fbc15e520 0x7f0fbc1f40d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:30.712 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:30.711+0000 7f0fc2200640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f0fbc0d4f60 con 0x7f0fbc0d1900 2024-04-04T06:57:30.712 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:30.711+0000 7f0fc2200640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f0fbc0b9bc0 con 0x7f0fbc0b35a0 2024-04-04T06:57:30.712 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:30.711+0000 7f0fc2200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f0fbc0cccf0 con 0x7f0fbc15e520 2024-04-04T06:57:30.712 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:30.711+0000 7f0fbaa00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0fbc0d1900 0x7f0fbc160140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:30.712 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:30.712+0000 7f0fbaa00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0fbc0d1900 0x7f0fbc160140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:38660/0 (socket says 172.21.15.72:38660) 2024-04-04T06:57:30.712 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:30.712+0000 7f0fbaa00640 1 -- 172.21.15.72:0/3887298761 learned_addr learned my addr 172.21.15.72:0/3887298761 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:57:30.712 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:30.712+0000 7f0fbaa00640 1 -- 172.21.15.72:0/3887298761 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0fbc15e520 msgr2=0x7f0fbc1f40d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:30.712 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:30.712+0000 7f0fbaa00640 1 --2- 172.21.15.72:0/3887298761 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0fbc15e520 0x7f0fbc1f40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:30.712 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:30.712+0000 7f0fbaa00640 1 -- 172.21.15.72:0/3887298761 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0fbc0b35a0 msgr2=0x7f0fbc1f70a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:30.712 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:30.712+0000 7f0fbb400640 1 --2- 172.21.15.72:0/3887298761 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0fbc0b35a0 0x7f0fbc1f70a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:30.712 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:30.712+0000 7f0fbaa00640 1 --2- 172.21.15.72:0/3887298761 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0fbc0b35a0 0x7f0fbc1f70a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:30.712 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:30.712+0000 7f0fbaa00640 1 -- 172.21.15.72:0/3887298761 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fbc160960 con 0x7f0fbc0d1900 2024-04-04T06:57:30.713 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:30.712+0000 7f0fbb400640 1 --2- 172.21.15.72:0/3887298761 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0fbc0b35a0 0x7f0fbc1f70a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-04T06:57:30.713 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:30.712+0000 7f0fbaa00640 1 --2- 172.21.15.72:0/3887298761 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0fbc0d1900 0x7f0fbc160140 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f0fa800d7d0 tx=0x7f0fa800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:30.713 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:30.713+0000 7f0fb3400640 1 -- 172.21.15.72:0/3887298761 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fa800b6c0 con 0x7f0fbc0d1900 2024-04-04T06:57:30.713 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:30.713+0000 7f0fb3400640 1 -- 172.21.15.72:0/3887298761 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0fa8019070 con 0x7f0fbc0d1900 2024-04-04T06:57:30.713 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:30.713+0000 7f0fb3400640 1 -- 172.21.15.72:0/3887298761 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fa800ba80 con 0x7f0fbc0d1900 2024-04-04T06:57:30.713 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:30.713+0000 7f0fc2200640 1 -- 172.21.15.72:0/3887298761 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0fbc0cc3c0 con 0x7f0fbc0d1900 2024-04-04T06:57:30.713 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:30.713+0000 7f0fc2200640 1 -- 172.21.15.72:0/3887298761 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0fbc0cc980 con 0x7f0fbc0d1900 2024-04-04T06:57:30.713 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:30.714+0000 7f0fc2200640 1 -- 172.21.15.72:0/3887298761 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0fbc0687b0 con 0x7f0fbc0d1900 2024-04-04T06:57:30.714 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:30.716+0000 7f0fb3400640 1 -- 172.21.15.72:0/3887298761 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0fa800bc20 con 0x7f0fbc0d1900 2024-04-04T06:57:30.715 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:30.717+0000 7f0fb3400640 1 --2- 172.21.15.72:0/3887298761 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f0f9c06c8f0 0x7f0f9c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:30.715 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:30.717+0000 7f0fb3400640 1 -- 172.21.15.72:0/3887298761 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f0fa808c0d0 con 0x7f0fbc0d1900 2024-04-04T06:57:30.716 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:30.717+0000 7f0fbb400640 1 --2- 172.21.15.72:0/3887298761 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f0f9c06c8f0 0x7f0f9c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:30.716 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:30.718+0000 7f0fbb400640 1 --2- 172.21.15.72:0/3887298761 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f0f9c06c8f0 0x7f0f9c06edb0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f0fac00a830 tx=0x7f0fac008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:30.721 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:30.722+0000 7f0fb3400640 1 -- 172.21.15.72:0/3887298761 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f0fbc0687b0 con 0x7f0fbc0d1900 2024-04-04T06:57:30.921 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:30.922+0000 7f0fc2200640 1 -- 172.21.15.72:0/3887298761 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0fbc075840 con 0x7f0fbc0d1900 2024-04-04T06:57:30.922 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:30.924+0000 7f0fb3400640 1 -- 172.21.15.72:0/3887298761 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16831 (secure 0 0 0) 0x7f0fa805a3e0 con 0x7f0fbc0d1900 2024-04-04T06:57:30.923 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T06:57:30.923 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":22,"fsid":"6708bac2-4f50-49b5-87a9-c390fd333eb3","created":"2024-04-04T06:56:04.282498+0000","modified":"2024-04-04T06:57:11.239134+0000","last_up_change":"2024-04-04T06:56:16.716089+0000","last_in_change":"2024-04-04T06:56:07.768593+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-04T06:56:17.421685+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-04T06:56:26.822661+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-04T06:56:27.429816+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7c345991-5af8-4dc6-a481-28610c40e128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":3889813953},{"type":"v1","addr":"172.21.15.72:6818","nonce":3889813953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":3889813953},{"type":"v1","addr":"172.21.15.72:6821","nonce":3889813953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":3889813953},{"type":"v1","addr":"172.21.15.72:6826","nonce":3889813953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":3889813953},{"type":"v1","addr":"172.21.15.72:6823","nonce":3889813953}]},"public_addr":"172.21.15.72:6818/3889813953","cluster_addr":"172.21.15.72:6821/3889813953","heartbeat_back_addr":"172.21.15.72:6826/3889813953","heartbeat_front_addr":"172.21.15.72:6823/3889813953","state":["exists","up"]},{"osd":1,"uuid":"1b3f7ab2-a56c-488d-a89a-1f3572361c95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":3101663154},{"type":"v1","addr":"172.21.15.72:6801","nonce":3101663154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":3101663154},{"type":"v1","addr":"172.21.15.72:6803","nonce":3101663154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":3101663154},{"type":"v1","addr":"172.21.15.72:6807","nonce":3101663154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":3101663154},{"type":"v1","addr":"172.21.15.72:6805","nonce":3101663154}]},"public_addr":"172.21.15.72:6801/3101663154","cluster_addr":"172.21.15.72:6803/3101663154","heartbeat_back_addr":"172.21.15.72:6807/3101663154","heartbeat_front_addr":"172.21.15.72:6805/3101663154","state":["exists","up"]},{"osd":2,"uuid":"fc9aa512-53df-40d7-ba04-3e6b7dcd1e34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":235374192},{"type":"v1","addr":"172.21.15.72:6809","nonce":235374192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":235374192},{"type":"v1","addr":"172.21.15.72:6811","nonce":235374192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":235374192},{"type":"v1","addr":"172.21.15.72:6815","nonce":235374192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":235374192},{"type":"v1","addr":"172.21.15.72:6813","nonce":235374192}]},"public_addr":"172.21.15.72:6809/235374192","cluster_addr":"172.21.15.72:6811/235374192","heartbeat_back_addr":"172.21.15.72:6815/235374192","heartbeat_front_addr":"172.21.15.72:6813/235374192","state":["exists","up"]},{"osd":3,"uuid":"b4f63eed-dc5b-4aba-bb50-de46eb41492b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6817","nonce":2806631742},{"type":"v1","addr":"172.21.15.72:6819","nonce":2806631742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":2806631742},{"type":"v1","addr":"172.21.15.72:6827","nonce":2806631742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":2806631742},{"type":"v1","addr":"172.21.15.72:6831","nonce":2806631742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":2806631742},{"type":"v1","addr":"172.21.15.72:6829","nonce":2806631742}]},"public_addr":"172.21.15.72:6819/2806631742","cluster_addr":"172.21.15.72:6827/2806631742","heartbeat_back_addr":"172.21.15.72:6831/2806631742","heartbeat_front_addr":"172.21.15.72:6829/2806631742","state":["exists","up"]},{"osd":4,"uuid":"9e985ef8-d711-4172-9286-c54e560895d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":4293536423},{"type":"v1","addr":"172.21.15.117:6825","nonce":4293536423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":4293536423},{"type":"v1","addr":"172.21.15.117:6827","nonce":4293536423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":4293536423},{"type":"v1","addr":"172.21.15.117:6831","nonce":4293536423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":4293536423},{"type":"v1","addr":"172.21.15.117:6829","nonce":4293536423}]},"public_addr":"172.21.15.117:6825/4293536423","cluster_addr":"172.21.15.117:6827/4293536423","heartbeat_back_addr":"172.21.15.117:6831/4293536423","heartbeat_front_addr":"172.21.15.117:6829/4293536423","state":["exists","up"]},{"osd":5,"uuid":"3e9f082b-8d7d-455f-8a96-66d0b4857125","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":684971679},{"type":"v1","addr":"172.21.15.117:6801","nonce":684971679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":684971679},{"type":"v1","addr":"172.21.15.117:6803","nonce":684971679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":684971679},{"type":"v1","addr":"172.21.15.117:6807","nonce":684971679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":684971679},{"type":"v1","addr":"172.21.15.117:6805","nonce":684971679}]},"public_addr":"172.21.15.117:6801/684971679","cluster_addr":"172.21.15.117:6803/684971679","heartbeat_back_addr":"172.21.15.117:6807/684971679","heartbeat_front_addr":"172.21.15.117:6805/684971679","state":["exists","up"]},{"osd":6,"uuid":"bcdafa9f-a870-4398-a38d-ab7697676473","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":2781186528},{"type":"v1","addr":"172.21.15.117:6809","nonce":2781186528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":2781186528},{"type":"v1","addr":"172.21.15.117:6811","nonce":2781186528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":2781186528},{"type":"v1","addr":"172.21.15.117:6815","nonce":2781186528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":2781186528},{"type":"v1","addr":"172.21.15.117:6813","nonce":2781186528}]},"public_addr":"172.21.15.117:6809/2781186528","cluster_addr":"172.21.15.117:6811/2781186528","heartbeat_back_addr":"172.21.15.117:6815/2781186528","heartbeat_front_addr":"172.21.15.117:6813/2781186528","state":["exists","up"]},{"osd":7,"uuid":"b68ec562-ff35-4d2d-a733-c896f8920cfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":617469882},{"type":"v1","addr":"172.21.15.117:6817","nonce":617469882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":617469882},{"type":"v1","addr":"172.21.15.117:6819","nonce":617469882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":617469882},{"type":"v1","addr":"172.21.15.117:6823","nonce":617469882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":617469882},{"type":"v1","addr":"172.21.15.117:6821","nonce":617469882}]},"public_addr":"172.21.15.117:6817/617469882","cluster_addr":"172.21.15.117:6819/617469882","heartbeat_back_addr":"172.21.15.117:6823/617469882","heartbeat_front_addr":"172.21.15.117:6821/617469882","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.347700+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.296619+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.361345+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.093323+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:12.857605+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:12.816090+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.083163+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.121639+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.13","mappings":[{"from":7,"to":1}]},{"pgid":"3.19","mappings":[{"from":3,"to":2}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.28","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-04T06:57:30.925 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:30.926+0000 7f0fc2200640 1 -- 172.21.15.72:0/3887298761 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f0f9c06c8f0 msgr2=0x7f0f9c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:30.925 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:30.926+0000 7f0fc2200640 1 --2- 172.21.15.72:0/3887298761 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f0f9c06c8f0 0x7f0f9c06edb0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f0fac00a830 tx=0x7f0fac008040 comp rx=0 tx=0).stop 2024-04-04T06:57:30.926 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:30.926+0000 7f0fc2200640 1 -- 172.21.15.72:0/3887298761 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0fbc0d1900 msgr2=0x7f0fbc160140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:30.926 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:30.926+0000 7f0fc2200640 1 --2- 172.21.15.72:0/3887298761 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0fbc0d1900 0x7f0fbc160140 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f0fa800d7d0 tx=0x7f0fa800dc90 comp rx=0 tx=0).stop 2024-04-04T06:57:30.926 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:30.926+0000 7f0fc2200640 1 -- 172.21.15.72:0/3887298761 shutdown_connections 2024-04-04T06:57:30.926 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:30.926+0000 7f0fc2200640 1 --2- 172.21.15.72:0/3887298761 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f0f9c06c8f0 0x7f0f9c06edb0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:30.926 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:30.926+0000 7f0fc2200640 1 --2- 172.21.15.72:0/3887298761 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0fbc15e520 0x7f0fbc1f40d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:30.926 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:30.926+0000 7f0fc2200640 1 --2- 172.21.15.72:0/3887298761 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0fbc0d1900 0x7f0fbc160140 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:30.926 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:30.926+0000 7f0fc2200640 1 --2- 172.21.15.72:0/3887298761 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0fbc0b35a0 0x7f0fbc1f70a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:30.926 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:30.926+0000 7f0fc2200640 1 -- 172.21.15.72:0/3887298761 >> 172.21.15.72:0/3887298761 conn(0x7f0fbc071eb0 msgr2=0x7f0fbc0b4d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:30.926 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:30.927+0000 7f0fc2200640 1 -- 172.21.15.72:0/3887298761 shutdown_connections 2024-04-04T06:57:30.926 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:30.927+0000 7f0fc2200640 1 -- 172.21.15.72:0/3887298761 wait complete. 2024-04-04T06:57:30.944 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-04T06:56:17.421685+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-04T06:56:26.822661+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-04T06:56:27.429816+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-04T06:57:30.944 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-04T06:57:31.149 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:31.150+0000 7f4749c00640 1 Processor -- start 2024-04-04T06:57:31.149 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:31.150+0000 7f4749c00640 1 -- start start 2024-04-04T06:57:31.151 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:31.152+0000 7f4749c00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f474415e4a0 0x7f47440cfc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:31.151 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:31.152+0000 7f4749c00640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47441621e0 con 0x7f47440cf1a0 2024-04-04T06:57:31.151 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:31.152+0000 7f4749c00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47441624c0 con 0x7f47440d0190 2024-04-04T06:57:31.151 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:31.152+0000 7f4749c00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f47441627a0 con 0x7f474415e4a0 2024-04-04T06:57:31.151 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:31.152+0000 7f4743400640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f47440cf1a0 0x7f4744141e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:52266/0 (socket says 172.21.15.72:52266) 2024-04-04T06:57:31.151 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:31.152+0000 7f4743400640 1 -- 172.21.15.72:0/607292242 learned_addr learned my addr 172.21.15.72:0/607292242 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-04-04T06:57:31.153 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:31.153+0000 7f4742a00640 1 --2- 172.21.15.72:0/607292242 >> v2:172.21.15.117:3300/0 conn(0x7f474415e4a0 0x7f47440cfc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:31.153 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:31.153+0000 7f4742000640 1 -- 172.21.15.72:0/607292242 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1911754830 0 0) 0x7f47441621e0 con 0x7f47440cf1a0 2024-04-04T06:57:31.153 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:31.153+0000 7f4742000640 1 -- 172.21.15.72:0/607292242 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4728003520 con 0x7f47440cf1a0 2024-04-04T06:57:31.153 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:31.153+0000 7f4742000640 1 -- 172.21.15.72:0/607292242 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3669340132 0 0) 0x7f4728003520 con 0x7f47440cf1a0 2024-04-04T06:57:31.153 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:31.153+0000 7f4742000640 1 -- 172.21.15.72:0/607292242 >> v2:172.21.15.117:3300/0 conn(0x7f474415e4a0 msgr2=0x7f47440cfc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:57:31.153 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:31.153+0000 7f4742000640 1 --2- 172.21.15.72:0/607292242 >> v2:172.21.15.117:3300/0 conn(0x7f474415e4a0 0x7f47440cfc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:31.153 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:31.153+0000 7f4742000640 1 -- 172.21.15.72:0/607292242 >> v1:172.21.15.117:6789/0 conn(0x7f47440d0190 legacy=0x7f47440cea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:31.153 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:31.153+0000 7f4742000640 1 -- 172.21.15.72:0/607292242 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4744162a80 con 0x7f47440cf1a0 2024-04-04T06:57:31.153 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:31.153+0000 7f4742000640 1 -- 172.21.15.72:0/607292242 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2465650867 0 0) 0x7f473c0019f0 con 0x7f47440cf1a0 2024-04-04T06:57:31.153 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:31.153+0000 7f4742000640 1 -- 172.21.15.72:0/607292242 >> v1:172.21.15.72:6789/0 conn(0x7f47440cf1a0 legacy=0x7f4744141e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:31.153 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:31.153+0000 7f4742000640 1 --2- 172.21.15.72:0/607292242 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f47280039b0 0x7f4728003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:31.153 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:31.153+0000 7f4742000640 1 --2- 172.21.15.72:0/607292242 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4728004800 0x7f4728004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:31.153 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:31.153+0000 7f4742000640 1 --2- 172.21.15.72:0/607292242 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f47280051c0 0x7f472800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:31.154 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:31.153+0000 7f4742000640 1 -- 172.21.15.72:0/607292242 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f47441627a0 con 0x7f47280051c0 2024-04-04T06:57:31.154 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:31.153+0000 7f4742000640 1 -- 172.21.15.72:0/607292242 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f472800c060 con 0x7f47280039b0 2024-04-04T06:57:31.154 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:31.153+0000 7f4742000640 1 -- 172.21.15.72:0/607292242 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f472800c260 con 0x7f4728004800 2024-04-04T06:57:31.154 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:31.154+0000 7f4743400640 1 --2- 172.21.15.72:0/607292242 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f47280051c0 0x7f472800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:31.154 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:31.154+0000 7f4743400640 1 -- 172.21.15.72:0/607292242 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4728004800 msgr2=0x7f4728004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:57:31.154 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:31.154+0000 7f4743400640 1 --2- 172.21.15.72:0/607292242 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4728004800 0x7f4728004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:31.154 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:31.154+0000 7f4743400640 1 -- 172.21.15.72:0/607292242 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f47280039b0 msgr2=0x7f4728003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:57:31.154 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:31.154+0000 7f4743400640 1 --2- 172.21.15.72:0/607292242 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f47280039b0 0x7f4728003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:31.154 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:31.154+0000 7f4743400640 1 -- 172.21.15.72:0/607292242 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4728003520 con 0x7f47280051c0 2024-04-04T06:57:31.155 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:31.155+0000 7f4743400640 1 -- 172.21.15.72:0/607292242 reap_dead start 2024-04-04T06:57:31.155 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:31.155+0000 7f4743400640 1 --2- 172.21.15.72:0/607292242 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f47280051c0 0x7f472800b9c0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f473c00a840 tx=0x7f4728005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ddb663d46bf21af server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:31.155 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:31.155+0000 7f4742000640 1 -- 172.21.15.72:0/607292242 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f473c00a460 con 0x7f47280051c0 2024-04-04T06:57:31.155 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:31.155+0000 7f4742000640 1 -- 172.21.15.72:0/607292242 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f473c034650 con 0x7f47280051c0 2024-04-04T06:57:31.155 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:31.155+0000 7f4742000640 1 -- 172.21.15.72:0/607292242 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f473c034a40 con 0x7f47280051c0 2024-04-04T06:57:31.156 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:31.156+0000 7f4749c00640 1 -- 172.21.15.72:0/607292242 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f47280051c0 msgr2=0x7f472800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:31.156 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:31.156+0000 7f4749c00640 1 --2- 172.21.15.72:0/607292242 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f47280051c0 0x7f472800b9c0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f473c00a840 tx=0x7f4728005830 comp rx=0 tx=0).stop 2024-04-04T06:57:31.156 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:31.156+0000 7f4749c00640 1 -- 172.21.15.72:0/607292242 shutdown_connections 2024-04-04T06:57:31.156 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:31.156+0000 7f4749c00640 1 --2- 172.21.15.72:0/607292242 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f47280051c0 0x7f472800b9c0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:31.156 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:31.156+0000 7f4749c00640 1 -- 172.21.15.72:0/607292242 >> 172.21.15.72:0/607292242 conn(0x7f474406f640 msgr2=0x7f474406fa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:31.156 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:31.156+0000 7f4749c00640 1 -- 172.21.15.72:0/607292242 shutdown_connections 2024-04-04T06:57:31.156 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:31.156+0000 7f4749c00640 1 -- 172.21.15.72:0/607292242 wait complete. 2024-04-04T06:57:31.156 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:31.158+0000 7f4749c00640 1 Processor -- start 2024-04-04T06:57:31.157 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:31.158+0000 7f4749c00640 1 -- start start 2024-04-04T06:57:31.158 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:31.159+0000 7f4749c00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f47280051c0 0x7f4744153f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:31.158 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:31.159+0000 7f4749c00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4744152b80 0x7f47440b6b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:31.158 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:31.159+0000 7f4749c00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f47440b70b0 0x7f47440b5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:31.158 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:31.159+0000 7f4749c00640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f47440cfc50 con 0x7f4744152b80 2024-04-04T06:57:31.158 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:31.159+0000 7f4749c00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f47440cfdd0 con 0x7f47280051c0 2024-04-04T06:57:31.158 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:31.159+0000 7f4749c00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f47440cff50 con 0x7f47440b70b0 2024-04-04T06:57:31.158 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:31.159+0000 7f473be00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4744152b80 0x7f47440b6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:31.158 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:31.159+0000 7f473be00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4744152b80 0x7f47440b6b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:38668/0 (socket says 172.21.15.72:38668) 2024-04-04T06:57:31.158 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:31.159+0000 7f473be00640 1 -- 172.21.15.72:0/2920760090 learned_addr learned my addr 172.21.15.72:0/2920760090 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:57:31.160 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:31.160+0000 7f4742a00640 1 --2- 172.21.15.72:0/2920760090 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f47280051c0 0x7f4744153f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:31.160 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:31.160+0000 7f473be00640 1 -- 172.21.15.72:0/2920760090 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f47440b70b0 msgr2=0x7f47440b5710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:31.160 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:31.160+0000 7f473be00640 1 --2- 172.21.15.72:0/2920760090 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f47440b70b0 0x7f47440b5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:31.160 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:31.160+0000 7f473be00640 1 -- 172.21.15.72:0/2920760090 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f47280051c0 msgr2=0x7f4744153f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:31.160 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:31.160+0000 7f473be00640 1 --2- 172.21.15.72:0/2920760090 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f47280051c0 0x7f4744153f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:31.160 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:31.160+0000 7f473be00640 1 -- 172.21.15.72:0/2920760090 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47441616b0 con 0x7f4744152b80 2024-04-04T06:57:31.160 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:31.160+0000 7f473be00640 1 --2- 172.21.15.72:0/2920760090 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4744152b80 0x7f47440b6b70 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f472c00c530 tx=0x7f472c00c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:31.160 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:31.160+0000 7f473aa00640 1 -- 172.21.15.72:0/2920760090 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f472c0052d0 con 0x7f4744152b80 2024-04-04T06:57:31.160 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:31.160+0000 7f473aa00640 1 -- 172.21.15.72:0/2920760090 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f472c005470 con 0x7f4744152b80 2024-04-04T06:57:31.160 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:31.160+0000 7f473aa00640 1 -- 172.21.15.72:0/2920760090 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f472c012870 con 0x7f4744152b80 2024-04-04T06:57:31.160 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:31.161+0000 7f4749c00640 1 -- 172.21.15.72:0/2920760090 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47441544a0 con 0x7f4744152b80 2024-04-04T06:57:31.160 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:31.161+0000 7f4749c00640 1 -- 172.21.15.72:0/2920760090 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f474415f080 con 0x7f4744152b80 2024-04-04T06:57:31.161 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:31.162+0000 7f4749c00640 1 -- 172.21.15.72:0/2920760090 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47440b74d0 con 0x7f4744152b80 2024-04-04T06:57:31.161 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:31.163+0000 7f473aa00640 1 -- 172.21.15.72:0/2920760090 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f472c012a10 con 0x7f4744152b80 2024-04-04T06:57:31.163 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:31.164+0000 7f473aa00640 1 --2- 172.21.15.72:0/2920760090 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f472006c8f0 0x7f472006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:31.163 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:31.164+0000 7f473aa00640 1 -- 172.21.15.72:0/2920760090 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f472c08b840 con 0x7f4744152b80 2024-04-04T06:57:31.163 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:31.165+0000 7f4742a00640 1 --2- 172.21.15.72:0/2920760090 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f472006c8f0 0x7f472006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:31.164 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:31.165+0000 7f4742a00640 1 --2- 172.21.15.72:0/2920760090 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f472006c8f0 0x7f472006edb0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f4734009a50 tx=0x7f4734008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:31.167 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:31.168+0000 7f473aa00640 1 -- 172.21.15.72:0/2920760090 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f47441616b0 con 0x7f4744152b80 2024-04-04T06:57:31.365 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:31.366+0000 7f4749c00640 1 -- 172.21.15.72:0/2920760090 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f4744070160 con 0x7f4744152b80 2024-04-04T06:57:31.366 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:31.367+0000 7f473aa00640 1 -- 172.21.15.72:0/2920760090 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) ==== 93+0+10 (secure 0 0 0) 0x7f472c059bf0 con 0x7f4744152b80 2024-04-04T06:57:31.366 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 1 2024-04-04T06:57:31.369 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:31.370+0000 7f4749c00640 1 -- 172.21.15.72:0/2920760090 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f472006c8f0 msgr2=0x7f472006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:31.369 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:31.370+0000 7f4749c00640 1 --2- 172.21.15.72:0/2920760090 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f472006c8f0 0x7f472006edb0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f4734009a50 tx=0x7f4734008040 comp rx=0 tx=0).stop 2024-04-04T06:57:31.369 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:31.370+0000 7f4749c00640 1 -- 172.21.15.72:0/2920760090 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4744152b80 msgr2=0x7f47440b6b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:31.369 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:31.370+0000 7f4749c00640 1 --2- 172.21.15.72:0/2920760090 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4744152b80 0x7f47440b6b70 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f472c00c530 tx=0x7f472c00c9f0 comp rx=0 tx=0).stop 2024-04-04T06:57:31.369 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:31.370+0000 7f4749c00640 1 -- 172.21.15.72:0/2920760090 shutdown_connections 2024-04-04T06:57:31.369 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:31.370+0000 7f4749c00640 1 --2- 172.21.15.72:0/2920760090 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f472006c8f0 0x7f472006edb0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:31.369 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:31.370+0000 7f4749c00640 1 --2- 172.21.15.72:0/2920760090 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f47440b70b0 0x7f47440b5710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:31.369 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:31.370+0000 7f4749c00640 1 --2- 172.21.15.72:0/2920760090 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4744152b80 0x7f47440b6b70 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:31.369 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:31.370+0000 7f4749c00640 1 --2- 172.21.15.72:0/2920760090 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f47280051c0 0x7f4744153f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:31.369 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:31.370+0000 7f4749c00640 1 -- 172.21.15.72:0/2920760090 >> 172.21.15.72:0/2920760090 conn(0x7f474406f640 msgr2=0x7f4744071510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:31.369 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:31.370+0000 7f4749c00640 1 -- 172.21.15.72:0/2920760090 shutdown_connections 2024-04-04T06:57:31.370 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:31.370+0000 7f4749c00640 1 -- 172.21.15.72:0/2920760090 wait complete. 2024-04-04T06:57:31.388 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-04T06:57:31.651 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:31.652+0000 7f9131600640 1 Processor -- start 2024-04-04T06:57:31.651 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:31.652+0000 7f9131600640 1 -- start start 2024-04-04T06:57:31.654 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:31.654+0000 7f9131600640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f912c0b4170 0x7f912c15b500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:31.654 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:31.654+0000 7f9131600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f912c0d0800 0x7f912c0726b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:31.654 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:31.654+0000 7f9131600640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f912c15be50 con 0x7f912c0d0420 2024-04-04T06:57:31.654 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:31.654+0000 7f9131600640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f912c15c410 con 0x7f912c0b4170 2024-04-04T06:57:31.654 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:31.654+0000 7f9131600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f912c15c130 con 0x7f912c0d0800 2024-04-04T06:57:31.654 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:31.655+0000 7f912b400640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f912c0b4170 0x7f912c15b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:31.654 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:31.655+0000 7f912b400640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f912c0b4170 0x7f912c15b500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:38672/0 (socket says 172.21.15.72:38672) 2024-04-04T06:57:31.654 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:31.655+0000 7f912b400640 1 -- 172.21.15.72:0/1292965723 learned_addr learned my addr 172.21.15.72:0/1292965723 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:57:31.654 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:31.655+0000 7f9130c00640 1 --2- 172.21.15.72:0/1292965723 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f912c0d0800 0x7f912c0726b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:31.654 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:31.655+0000 7f912b400640 1 -- 172.21.15.72:0/1292965723 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f912c0d0800 msgr2=0x7f912c0726b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:57:31.654 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:31.655+0000 7f912b400640 1 --2- 172.21.15.72:0/1292965723 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f912c0d0800 0x7f912c0726b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:31.654 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:31.655+0000 7f912b400640 1 -- 172.21.15.72:0/1292965723 >> v1:172.21.15.117:6789/0 conn(0x7f912c0d0420 legacy=0x7f912c15f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:57:31.655 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:31.655+0000 7f912b400640 1 -- 172.21.15.72:0/1292965723 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f912c15ec20 con 0x7f912c0b4170 2024-04-04T06:57:31.655 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:31.656+0000 7f912b400640 1 --2- 172.21.15.72:0/1292965723 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f912c0b4170 0x7f912c15b500 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f9118009870 tx=0x7f911802b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99d14b290ff81e2c server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:31.655 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:31.656+0000 7f912aa00640 1 -- 172.21.15.72:0/1292965723 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91180317c0 con 0x7f912c0b4170 2024-04-04T06:57:31.655 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:31.657+0000 7f912aa00640 1 -- 172.21.15.72:0/1292965723 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9118037070 con 0x7f912c0b4170 2024-04-04T06:57:31.655 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:31.657+0000 7f912aa00640 1 -- 172.21.15.72:0/1292965723 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9118031b80 con 0x7f912c0b4170 2024-04-04T06:57:31.656 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:31.657+0000 7f9131600640 1 -- 172.21.15.72:0/1292965723 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f912c0b4170 msgr2=0x7f912c15b500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:31.656 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:31.657+0000 7f9131600640 1 --2- 172.21.15.72:0/1292965723 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f912c0b4170 0x7f912c15b500 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f9118009870 tx=0x7f911802b860 comp rx=0 tx=0).stop 2024-04-04T06:57:31.657 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:31.657+0000 7f9131600640 1 -- 172.21.15.72:0/1292965723 shutdown_connections 2024-04-04T06:57:31.657 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:31.657+0000 7f9131600640 1 --2- 172.21.15.72:0/1292965723 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f912c0d0800 0x7f912c0726b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:31.657 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:31.657+0000 7f9131600640 1 --2- 172.21.15.72:0/1292965723 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f912c0b4170 0x7f912c15b500 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:31.657 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:31.657+0000 7f9131600640 1 -- 172.21.15.72:0/1292965723 >> 172.21.15.72:0/1292965723 conn(0x7f912c06b890 msgr2=0x7f912c06bca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:31.657 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:31.657+0000 7f9131600640 1 -- 172.21.15.72:0/1292965723 shutdown_connections 2024-04-04T06:57:31.657 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:31.657+0000 7f9131600640 1 -- 172.21.15.72:0/1292965723 wait complete. 2024-04-04T06:57:31.659 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:31.660+0000 7f9131600640 1 Processor -- start 2024-04-04T06:57:31.659 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:31.660+0000 7f9131600640 1 -- start start 2024-04-04T06:57:31.661 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:31.662+0000 7f9131600640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f912c0b4170 0x7f912c14f670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:31.662 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:31.662+0000 7f9131600640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f912c0d0420 0x7f912c1408e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:31.662 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:31.662+0000 7f9131600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f912c0d0800 0x7f912c150cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:31.662 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:31.662+0000 7f9131600640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f912c15bbc0 con 0x7f912c0d0420 2024-04-04T06:57:31.662 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:31.662+0000 7f9131600640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f912c15ba40 con 0x7f912c0b4170 2024-04-04T06:57:31.662 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:31.662+0000 7f9131600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f912c072bf0 con 0x7f912c0d0800 2024-04-04T06:57:31.662 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:31.662+0000 7f912b400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f912c0d0420 0x7f912c1408e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:31.662 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:31.662+0000 7f912b400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f912c0d0420 0x7f912c1408e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:38680/0 (socket says 172.21.15.72:38680) 2024-04-04T06:57:31.662 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:31.662+0000 7f912b400640 1 -- 172.21.15.72:0/1914868003 learned_addr learned my addr 172.21.15.72:0/1914868003 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:57:31.662 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:31.662+0000 7f912be00640 1 --2- 172.21.15.72:0/1914868003 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f912c0b4170 0x7f912c14f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:31.662 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:31.663+0000 7f9130c00640 1 --2- 172.21.15.72:0/1914868003 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f912c0d0800 0x7f912c150cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:31.662 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:31.663+0000 7f912b400640 1 -- 172.21.15.72:0/1914868003 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f912c0d0800 msgr2=0x7f912c150cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:31.662 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:31.663+0000 7f912b400640 1 --2- 172.21.15.72:0/1914868003 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f912c0d0800 0x7f912c150cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:31.663 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:31.663+0000 7f912b400640 1 -- 172.21.15.72:0/1914868003 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f912c0b4170 msgr2=0x7f912c14f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:31.663 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:31.663+0000 7f912b400640 1 --2- 172.21.15.72:0/1914868003 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f912c0b4170 0x7f912c14f670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:31.663 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:31.663+0000 7f912b400640 1 -- 172.21.15.72:0/1914868003 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f912c14fc50 con 0x7f912c0d0420 2024-04-04T06:57:31.663 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:31.663+0000 7f912b400640 1 --2- 172.21.15.72:0/1914868003 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f912c0d0420 0x7f912c1408e0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f9118009870 tx=0x7f91180046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:31.664 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:31.663+0000 7f9123e00640 1 -- 172.21.15.72:0/1914868003 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9118032650 con 0x7f912c0d0420 2024-04-04T06:57:31.664 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:31.663+0000 7f9123e00640 1 -- 172.21.15.72:0/1914868003 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91180327f0 con 0x7f912c0d0420 2024-04-04T06:57:31.664 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:31.663+0000 7f9123e00640 1 -- 172.21.15.72:0/1914868003 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9118032be0 con 0x7f912c0d0420 2024-04-04T06:57:31.664 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:31.663+0000 7f9131600640 1 -- 172.21.15.72:0/1914868003 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f912c14ff30 con 0x7f912c0d0420 2024-04-04T06:57:31.664 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:31.664+0000 7f9131600640 1 -- 172.21.15.72:0/1914868003 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f912c1504f0 con 0x7f912c0d0420 2024-04-04T06:57:31.664 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:31.665+0000 7f9131600640 1 -- 172.21.15.72:0/1914868003 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f912c073000 con 0x7f912c0d0420 2024-04-04T06:57:31.664 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:31.665+0000 7f9123e00640 1 -- 172.21.15.72:0/1914868003 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f911804d3f0 con 0x7f912c0d0420 2024-04-04T06:57:31.665 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:31.666+0000 7f9123e00640 1 --2- 172.21.15.72:0/1914868003 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f910c06c920 0x7f910c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:31.665 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:31.666+0000 7f9123e00640 1 -- 172.21.15.72:0/1914868003 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f91180ad6b0 con 0x7f912c0d0420 2024-04-04T06:57:31.665 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:31.667+0000 7f912be00640 1 --2- 172.21.15.72:0/1914868003 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f910c06c920 0x7f910c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:31.666 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:31.667+0000 7f912be00640 1 --2- 172.21.15.72:0/1914868003 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f910c06c920 0x7f910c06ede0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f911c004ea0 tx=0x7f911c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:31.669 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:31.671+0000 7f9123e00640 1 -- 172.21.15.72:0/1914868003 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f912c073000 con 0x7f912c0d0420 2024-04-04T06:57:31.885 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:31.886+0000 7f9131600640 1 -- 172.21.15.72:0/1914868003 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f912c0756c0 con 0x7f912c0d0420 2024-04-04T06:57:31.885 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:31.887+0000 7f9123e00640 1 -- 172.21.15.72:0/1914868003 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) ==== 104+0+11 (secure 0 0 0) 0x7f9118040070 con 0x7f912c0d0420 2024-04-04T06:57:31.886 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2024-04-04T06:57:31.888 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:31.889+0000 7f9131600640 1 -- 172.21.15.72:0/1914868003 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f910c06c920 msgr2=0x7f910c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:31.888 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:31.889+0000 7f9131600640 1 --2- 172.21.15.72:0/1914868003 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f910c06c920 0x7f910c06ede0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f911c004ea0 tx=0x7f911c009040 comp rx=0 tx=0).stop 2024-04-04T06:57:31.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:31.889+0000 7f9131600640 1 -- 172.21.15.72:0/1914868003 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f912c0d0420 msgr2=0x7f912c1408e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:31.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:31.889+0000 7f9131600640 1 --2- 172.21.15.72:0/1914868003 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f912c0d0420 0x7f912c1408e0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f9118009870 tx=0x7f91180046c0 comp rx=0 tx=0).stop 2024-04-04T06:57:31.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:31.890+0000 7f9131600640 1 -- 172.21.15.72:0/1914868003 shutdown_connections 2024-04-04T06:57:31.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:31.890+0000 7f9131600640 1 --2- 172.21.15.72:0/1914868003 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f910c06c920 0x7f910c06ede0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:31.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:31.890+0000 7f9131600640 1 --2- 172.21.15.72:0/1914868003 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f912c0d0800 0x7f912c150cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:31.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:31.890+0000 7f9131600640 1 --2- 172.21.15.72:0/1914868003 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f912c0d0420 0x7f912c1408e0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:31.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:31.890+0000 7f9131600640 1 --2- 172.21.15.72:0/1914868003 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f912c0b4170 0x7f912c14f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:31.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:31.890+0000 7f9131600640 1 -- 172.21.15.72:0/1914868003 >> 172.21.15.72:0/1914868003 conn(0x7f912c06b890 msgr2=0x7f912c0b3310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:31.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:31.890+0000 7f9131600640 1 -- 172.21.15.72:0/1914868003 shutdown_connections 2024-04-04T06:57:31.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:31.890+0000 7f9131600640 1 -- 172.21.15.72:0/1914868003 wait complete. 2024-04-04T06:57:31.905 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-04T06:57:32.154 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:32.156+0000 7fa1f7200640 1 Processor -- start 2024-04-04T06:57:32.155 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:32.156+0000 7fa1f7200640 1 -- start start 2024-04-04T06:57:32.157 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:32.158+0000 7fa1f7200640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa1f00d1050 0x7fa1f00d14b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:32.157 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:32.158+0000 7fa1f7200640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fa1f00d2d10 0x7fa1f00d3180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:32.157 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:32.158+0000 7fa1f7200640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa1f00d2270 con 0x7fa1f015e1d0 2024-04-04T06:57:32.157 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:32.158+0000 7fa1f7200640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7fa1f00d19f0 con 0x7fa1f00d1050 2024-04-04T06:57:32.157 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:32.158+0000 7fa1f7200640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fa1f015e5b0 con 0x7fa1f00d2d10 2024-04-04T06:57:32.158 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:32.159+0000 7fa1f5e00640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fa1f015e1d0 0x7fa1f0162760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:52268/0 (socket says 172.21.15.72:52268) 2024-04-04T06:57:32.158 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:32.159+0000 7fa1f5e00640 1 -- 172.21.15.72:0/67218243 learned_addr learned my addr 172.21.15.72:0/67218243 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-04-04T06:57:32.158 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:32.159+0000 7fa1f5400640 1 --2- 172.21.15.72:0/67218243 >> v2:172.21.15.72:3300/0 conn(0x7fa1f00d1050 0x7fa1f00d14b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:32.158 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:32.159+0000 7fa1f6800640 1 --2- 172.21.15.72:0/67218243 >> v2:172.21.15.117:3300/0 conn(0x7fa1f00d2d10 0x7fa1f00d3180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:32.158 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:32.159+0000 7fa1f4a00640 1 -- 172.21.15.72:0/67218243 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3900196758 0 0) 0x7fa1f00d2270 con 0x7fa1f015e1d0 2024-04-04T06:57:32.158 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:32.159+0000 7fa1f4a00640 1 -- 172.21.15.72:0/67218243 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa1d8003520 con 0x7fa1f015e1d0 2024-04-04T06:57:32.159 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:32.159+0000 7fa1f5400640 1 -- 172.21.15.72:0/67218243 >> v2:172.21.15.117:3300/0 conn(0x7fa1f00d2d10 msgr2=0x7fa1f00d3180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:57:32.159 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:32.159+0000 7fa1f5400640 1 --2- 172.21.15.72:0/67218243 >> v2:172.21.15.117:3300/0 conn(0x7fa1f00d2d10 0x7fa1f00d3180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:32.159 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:32.159+0000 7fa1f5400640 1 -- 172.21.15.72:0/67218243 >> v1:172.21.15.72:6789/0 conn(0x7fa1f015e1d0 legacy=0x7fa1f0162760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:32.159 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:32.159+0000 7fa1f5400640 1 -- 172.21.15.72:0/67218243 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1f00cf4e0 con 0x7fa1f00d1050 2024-04-04T06:57:32.159 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:32.161+0000 7fa1f5400640 1 --2- 172.21.15.72:0/67218243 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa1f00d1050 0x7fa1f00d14b0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fa1f00ba210 tx=0x7fa1e002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6eaf529cb5f5b084 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:32.160 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:32.161+0000 7fa1f4a00640 1 -- 172.21.15.72:0/67218243 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1e00315a0 con 0x7fa1f00d1050 2024-04-04T06:57:32.160 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:32.161+0000 7fa1f4a00640 1 -- 172.21.15.72:0/67218243 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1e0037070 con 0x7fa1f00d1050 2024-04-04T06:57:32.160 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:32.161+0000 7fa1f4a00640 1 -- 172.21.15.72:0/67218243 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1e0031960 con 0x7fa1f00d1050 2024-04-04T06:57:32.160 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:32.161+0000 7fa1f7200640 1 -- 172.21.15.72:0/67218243 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa1f00d1050 msgr2=0x7fa1f00d14b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:32.161 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:32.161+0000 7fa1f7200640 1 --2- 172.21.15.72:0/67218243 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa1f00d1050 0x7fa1f00d14b0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fa1f00ba210 tx=0x7fa1e002b840 comp rx=0 tx=0).stop 2024-04-04T06:57:32.161 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:32.162+0000 7fa1f7200640 1 -- 172.21.15.72:0/67218243 shutdown_connections 2024-04-04T06:57:32.161 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:32.162+0000 7fa1f7200640 1 --2- 172.21.15.72:0/67218243 >> v2:172.21.15.117:3300/0 conn(0x7fa1f00d2d10 0x7fa1f00d3180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:32.161 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:32.162+0000 7fa1f7200640 1 --2- 172.21.15.72:0/67218243 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa1f00d1050 0x7fa1f00d14b0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:32.161 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:32.162+0000 7fa1f7200640 1 -- 172.21.15.72:0/67218243 >> 172.21.15.72:0/67218243 conn(0x7fa1f006b8c0 msgr2=0x7fa1f006bcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:32.161 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:32.162+0000 7fa1f7200640 1 -- 172.21.15.72:0/67218243 shutdown_connections 2024-04-04T06:57:32.161 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:32.162+0000 7fa1f7200640 1 -- 172.21.15.72:0/67218243 wait complete. 2024-04-04T06:57:32.162 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:32.163+0000 7fa1f7200640 1 Processor -- start 2024-04-04T06:57:32.162 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:32.164+0000 7fa1f7200640 1 -- start start 2024-04-04T06:57:32.163 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:32.164+0000 7fa1f7200640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa1f00d1050 0x7fa1f0152760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:32.163 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:32.164+0000 7fa1f7200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa1f00d2d10 0x7fa1f01606c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:32.164 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:32.164+0000 7fa1f7200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa1f015e1d0 0x7fa1f00b8790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:32.164 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:32.165+0000 7fa1f7200640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fa1f00cf7c0 con 0x7fa1f00d1050 2024-04-04T06:57:32.164 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:32.165+0000 7fa1f7200640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fa1f00b3430 con 0x7fa1f00d2d10 2024-04-04T06:57:32.164 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:32.165+0000 7fa1f7200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fa1f00cf940 con 0x7fa1f015e1d0 2024-04-04T06:57:32.164 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:32.165+0000 7fa1f5e00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa1f00d1050 0x7fa1f0152760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:32.164 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:32.165+0000 7fa1f5e00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa1f00d1050 0x7fa1f0152760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:38708/0 (socket says 172.21.15.72:38708) 2024-04-04T06:57:32.164 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:32.165+0000 7fa1f5e00640 1 -- 172.21.15.72:0/1295675276 learned_addr learned my addr 172.21.15.72:0/1295675276 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:57:32.165 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:32.165+0000 7fa1f5e00640 1 -- 172.21.15.72:0/1295675276 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa1f015e1d0 msgr2=0x7fa1f00b8790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:32.165 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:32.165+0000 7fa1f6800640 1 --2- 172.21.15.72:0/1295675276 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa1f015e1d0 0x7fa1f00b8790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:32.165 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:32.165+0000 7fa1f5e00640 1 --2- 172.21.15.72:0/1295675276 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa1f015e1d0 0x7fa1f00b8790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:32.166 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:32.165+0000 7fa1f5e00640 1 -- 172.21.15.72:0/1295675276 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa1f00d2d10 msgr2=0x7fa1f01606c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:32.166 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:32.165+0000 7fa1f5e00640 1 --2- 172.21.15.72:0/1295675276 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa1f00d2d10 0x7fa1f01606c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:32.166 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:32.165+0000 7fa1f5e00640 1 -- 172.21.15.72:0/1295675276 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1f0156690 con 0x7fa1f00d1050 2024-04-04T06:57:32.166 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:32.166+0000 7fa1f5e00640 1 --2- 172.21.15.72:0/1295675276 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa1f00d1050 0x7fa1f0152760 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fa1e400c390 tx=0x7fa1e400c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:32.166 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:32.166+0000 7fa1ea000640 1 -- 172.21.15.72:0/1295675276 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1e4017070 con 0x7fa1f00d1050 2024-04-04T06:57:32.166 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:32.166+0000 7fa1ea000640 1 -- 172.21.15.72:0/1295675276 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1e4005ce0 con 0x7fa1f00d1050 2024-04-04T06:57:32.166 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:32.166+0000 7fa1f7200640 1 -- 172.21.15.72:0/1295675276 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1f00cb330 con 0x7fa1f00d1050 2024-04-04T06:57:32.166 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:32.166+0000 7fa1ea000640 1 -- 172.21.15.72:0/1295675276 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1e40072f0 con 0x7fa1f00d1050 2024-04-04T06:57:32.166 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:32.166+0000 7fa1f7200640 1 -- 172.21.15.72:0/1295675276 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1f00cb8f0 con 0x7fa1f00d1050 2024-04-04T06:57:32.167 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:32.167+0000 7fa1f7200640 1 -- 172.21.15.72:0/1295675276 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa1f00756c0 con 0x7fa1f00d1050 2024-04-04T06:57:32.167 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:32.168+0000 7fa1ea000640 1 -- 172.21.15.72:0/1295675276 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa1e401a070 con 0x7fa1f00d1050 2024-04-04T06:57:32.167 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:32.169+0000 7fa1ea000640 1 --2- 172.21.15.72:0/1295675276 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fa1d406c920 0x7fa1d406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:32.168 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:32.169+0000 7fa1ea000640 1 -- 172.21.15.72:0/1295675276 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7fa1e408af80 con 0x7fa1f00d1050 2024-04-04T06:57:32.168 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:32.169+0000 7fa1f5400640 1 --2- 172.21.15.72:0/1295675276 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fa1d406c920 0x7fa1d406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:32.168 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:32.170+0000 7fa1f5400640 1 --2- 172.21.15.72:0/1295675276 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fa1d406c920 0x7fa1d406ede0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fa1e0036000 tx=0x7fa1e0030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:32.172 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:32.174+0000 7fa1ea000640 1 -- 172.21.15.72:0/1295675276 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fa1e4059320 con 0x7fa1f00d1050 2024-04-04T06:57:32.369 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:32.370+0000 7fa1f7200640 1 -- 172.21.15.72:0/1295675276 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fa1f00d1d80 con 0x7fa1f00d1050 2024-04-04T06:57:32.370 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:32.371+0000 7fa1ea000640 1 -- 172.21.15.72:0/1295675276 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) ==== 100+0+11 (secure 0 0 0) 0x7fa1e4058c20 con 0x7fa1f00d1050 2024-04-04T06:57:32.370 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 64 2024-04-04T06:57:32.372 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:32.373+0000 7fa1f7200640 1 -- 172.21.15.72:0/1295675276 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fa1d406c920 msgr2=0x7fa1d406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:32.373 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:32.373+0000 7fa1f7200640 1 --2- 172.21.15.72:0/1295675276 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fa1d406c920 0x7fa1d406ede0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fa1e0036000 tx=0x7fa1e0030000 comp rx=0 tx=0).stop 2024-04-04T06:57:32.373 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:32.373+0000 7fa1f7200640 1 -- 172.21.15.72:0/1295675276 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa1f00d1050 msgr2=0x7fa1f0152760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:32.373 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:32.373+0000 7fa1f7200640 1 --2- 172.21.15.72:0/1295675276 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa1f00d1050 0x7fa1f0152760 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fa1e400c390 tx=0x7fa1e400c850 comp rx=0 tx=0).stop 2024-04-04T06:57:32.373 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:32.373+0000 7fa1f7200640 1 -- 172.21.15.72:0/1295675276 shutdown_connections 2024-04-04T06:57:32.373 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:32.373+0000 7fa1f7200640 1 --2- 172.21.15.72:0/1295675276 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fa1d406c920 0x7fa1d406ede0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:32.373 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:32.373+0000 7fa1f7200640 1 --2- 172.21.15.72:0/1295675276 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa1f015e1d0 0x7fa1f00b8790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:32.373 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:32.373+0000 7fa1f7200640 1 --2- 172.21.15.72:0/1295675276 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa1f00d2d10 0x7fa1f01606c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:32.373 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:32.373+0000 7fa1f7200640 1 --2- 172.21.15.72:0/1295675276 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa1f00d1050 0x7fa1f0152760 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:32.373 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:32.373+0000 7fa1f7200640 1 -- 172.21.15.72:0/1295675276 >> 172.21.15.72:0/1295675276 conn(0x7fa1f006b8c0 msgr2=0x7fa1f00d4870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:32.373 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:32.374+0000 7fa1f7200640 1 -- 172.21.15.72:0/1295675276 shutdown_connections 2024-04-04T06:57:32.373 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:32.374+0000 7fa1f7200640 1 -- 172.21.15.72:0/1295675276 wait complete. 2024-04-04T06:57:32.392 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-04T06:57:32.589 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:32.590+0000 7f0235800640 1 Processor -- start 2024-04-04T06:57:32.589 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:32.591+0000 7f0235800640 1 -- start start 2024-04-04T06:57:32.592 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:32.593+0000 7f0235800640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f023006cc90 0x7f02300c7040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:32.592 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:32.593+0000 7f0235800640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02300b4930 con 0x7f02300d1510 2024-04-04T06:57:32.592 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:32.593+0000 7f0235800640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02300cff10 con 0x7f023015e6d0 2024-04-04T06:57:32.592 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:32.593+0000 7f0235800640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f02300cfcc0 con 0x7f023006cc90 2024-04-04T06:57:32.592 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:32.594+0000 7f022f400640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f02300d1510 0x7f02300c7580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:52278/0 (socket says 172.21.15.72:52278) 2024-04-04T06:57:32.592 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:32.594+0000 7f022f400640 1 -- 172.21.15.72:0/1913145157 learned_addr learned my addr 172.21.15.72:0/1913145157 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-04-04T06:57:32.594 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:32.594+0000 7f0227e00640 1 --2- 172.21.15.72:0/1913145157 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f023006cc90 0x7f02300c7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:32.594 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:32.594+0000 7f022e000640 1 -- 172.21.15.72:0/1913145157 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 176621293 0 0) 0x7f02300b4930 con 0x7f02300d1510 2024-04-04T06:57:32.594 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:32.594+0000 7f022e000640 1 -- 172.21.15.72:0/1913145157 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0214003520 con 0x7f02300d1510 2024-04-04T06:57:32.594 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:32.594+0000 7f022e000640 1 -- 172.21.15.72:0/1913145157 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1487848745 0 0) 0x7f0214003520 con 0x7f02300d1510 2024-04-04T06:57:32.595 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:32.594+0000 7f022e000640 1 -- 172.21.15.72:0/1913145157 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f023006cc90 msgr2=0x7f02300c7040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:57:32.595 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:32.594+0000 7f022e000640 1 --2- 172.21.15.72:0/1913145157 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f023006cc90 0x7f02300c7040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:32.595 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:32.594+0000 7f022e000640 1 -- 172.21.15.72:0/1913145157 >> v1:172.21.15.117:6789/0 conn(0x7f023015e6d0 legacy=0x7f023006c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:32.595 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:32.594+0000 7f022e000640 1 -- 172.21.15.72:0/1913145157 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02300d01f0 con 0x7f02300d1510 2024-04-04T06:57:32.595 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:32.595+0000 7f022e000640 1 -- 172.21.15.72:0/1913145157 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2465650867 0 0) 0x7f02280019f0 con 0x7f02300d1510 2024-04-04T06:57:32.595 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:32.595+0000 7f022e000640 1 -- 172.21.15.72:0/1913145157 >> v1:172.21.15.72:6789/0 conn(0x7f02300d1510 legacy=0x7f02300c7580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:32.595 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:32.595+0000 7f022e000640 1 --2- 172.21.15.72:0/1913145157 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f023006cc90 0x7f02140039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:32.595 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:32.595+0000 7f022e000640 1 --2- 172.21.15.72:0/1913145157 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0214004060 0x7f0214004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:32.595 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:32.595+0000 7f022e000640 1 --2- 172.21.15.72:0/1913145157 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0214004d40 0x7f02140051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:32.595 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:32.595+0000 7f022e000640 1 -- 172.21.15.72:0/1913145157 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f02300cfcc0 con 0x7f0214004060 2024-04-04T06:57:32.595 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:32.595+0000 7f022e000640 1 -- 172.21.15.72:0/1913145157 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f021400bca0 con 0x7f0214004d40 2024-04-04T06:57:32.595 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:32.595+0000 7f022e000640 1 -- 172.21.15.72:0/1913145157 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f021400bea0 con 0x7f023006cc90 2024-04-04T06:57:32.595 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:32.595+0000 7f0227e00640 1 --2- 172.21.15.72:0/1913145157 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0214004060 0x7f0214004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:32.595 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:32.595+0000 7f022ea00640 1 --2- 172.21.15.72:0/1913145157 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f023006cc90 0x7f02140039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:32.595 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:32.595+0000 7f022f400640 1 --2- 172.21.15.72:0/1913145157 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0214004d40 0x7f02140051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:32.596 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:32.595+0000 7f0227e00640 1 -- 172.21.15.72:0/1913145157 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f023006cc90 msgr2=0x7f02140039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:57:32.596 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:32.595+0000 7f0227e00640 1 --2- 172.21.15.72:0/1913145157 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f023006cc90 0x7f02140039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:32.596 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:32.595+0000 7f0227e00640 1 -- 172.21.15.72:0/1913145157 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0214004d40 msgr2=0x7f02140051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:57:32.596 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:32.595+0000 7f0227e00640 1 --2- 172.21.15.72:0/1913145157 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0214004d40 0x7f02140051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:32.596 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:32.596+0000 7f0227e00640 1 -- 172.21.15.72:0/1913145157 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0214003520 con 0x7f0214004060 2024-04-04T06:57:32.596 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:32.596+0000 7f022f400640 1 --2- 172.21.15.72:0/1913145157 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0214004d40 0x7f02140051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-04T06:57:32.597 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:32.597+0000 7f0227e00640 1 --2- 172.21.15.72:0/1913145157 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0214004060 0x7f0214004800 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f021800ba30 tx=0x7f0214005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc05b0c6631e0ea5 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:32.597 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:32.597+0000 7f022e000640 1 -- 172.21.15.72:0/1913145157 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0218036020 con 0x7f0214004060 2024-04-04T06:57:32.597 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:32.597+0000 7f022e000640 1 -- 172.21.15.72:0/1913145157 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0218032640 con 0x7f0214004060 2024-04-04T06:57:32.597 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:32.597+0000 7f022e000640 1 -- 172.21.15.72:0/1913145157 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f021800b600 con 0x7f0214004060 2024-04-04T06:57:32.597 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:32.598+0000 7f0235800640 1 -- 172.21.15.72:0/1913145157 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0214004060 msgr2=0x7f0214004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:32.597 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:32.598+0000 7f0235800640 1 --2- 172.21.15.72:0/1913145157 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0214004060 0x7f0214004800 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f021800ba30 tx=0x7f0214005830 comp rx=0 tx=0).stop 2024-04-04T06:57:32.597 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:32.598+0000 7f022f400640 1 -- 172.21.15.72:0/1913145157 reap_dead start 2024-04-04T06:57:32.597 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:32.598+0000 7f0235800640 1 -- 172.21.15.72:0/1913145157 shutdown_connections 2024-04-04T06:57:32.598 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:32.598+0000 7f0235800640 1 -- 172.21.15.72:0/1913145157 >> 172.21.15.72:0/1913145157 conn(0x7f02300d2180 msgr2=0x7f02300d2560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:32.598 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:32.598+0000 7f0235800640 1 -- 172.21.15.72:0/1913145157 shutdown_connections 2024-04-04T06:57:32.598 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:32.598+0000 7f0235800640 1 -- 172.21.15.72:0/1913145157 wait complete. 2024-04-04T06:57:32.598 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:32.599+0000 7f0235800640 1 Processor -- start 2024-04-04T06:57:32.598 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:32.600+0000 7f0235800640 1 -- start start 2024-04-04T06:57:32.600 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:32.600+0000 7f0235800640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f02301577b0 0x7f0230157b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:32.600 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:32.600+0000 7f0235800640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f02301557d0 0x7f0230155c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:32.600 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:32.600+0000 7f0235800640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0230148800 0x7f0230148c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:32.600 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:32.601+0000 7f0235800640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f02300d0a90 con 0x7f0230148800 2024-04-04T06:57:32.601 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:32.601+0000 7f0235800640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f02300d07b0 con 0x7f02301577b0 2024-04-04T06:57:32.601 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:32.601+0000 7f0235800640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f02300d0fb0 con 0x7f02301557d0 2024-04-04T06:57:32.601 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:32.601+0000 7f022f400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0230148800 0x7f0230148c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:32.601 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:32.601+0000 7f022f400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0230148800 0x7f0230148c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:38738/0 (socket says 172.21.15.72:38738) 2024-04-04T06:57:32.601 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:32.601+0000 7f022f400640 1 -- 172.21.15.72:0/2683585305 learned_addr learned my addr 172.21.15.72:0/2683585305 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:57:32.601 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:32.601+0000 7f0227e00640 1 --2- 172.21.15.72:0/2683585305 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f02301557d0 0x7f0230155c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:32.601 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:32.601+0000 7f022ea00640 1 --2- 172.21.15.72:0/2683585305 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f02301577b0 0x7f0230157b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:32.601 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:32.601+0000 7f022f400640 1 -- 172.21.15.72:0/2683585305 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f02301557d0 msgr2=0x7f0230155c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:32.601 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:32.601+0000 7f022f400640 1 --2- 172.21.15.72:0/2683585305 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f02301557d0 0x7f0230155c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:32.601 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:32.601+0000 7f022f400640 1 -- 172.21.15.72:0/2683585305 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f02301577b0 msgr2=0x7f0230157b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:32.601 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:32.601+0000 7f022f400640 1 --2- 172.21.15.72:0/2683585305 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f02301577b0 0x7f0230157b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:32.601 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:32.601+0000 7f022f400640 1 -- 172.21.15.72:0/2683585305 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0230158210 con 0x7f0230148800 2024-04-04T06:57:32.601 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:32.601+0000 7f022ea00640 1 --2- 172.21.15.72:0/2683585305 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f02301577b0 0x7f0230157b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-04T06:57:32.601 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:32.602+0000 7f022f400640 1 --2- 172.21.15.72:0/2683585305 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0230148800 0x7f0230148c80 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f0230067ba0 tx=0x7f022800b4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:32.602 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:32.602+0000 7f0226a00640 1 -- 172.21.15.72:0/2683585305 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0228019070 con 0x7f0230148800 2024-04-04T06:57:32.602 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:32.602+0000 7f0226a00640 1 -- 172.21.15.72:0/2683585305 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f022800de90 con 0x7f0230148800 2024-04-04T06:57:32.603 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:32.602+0000 7f0226a00640 1 -- 172.21.15.72:0/2683585305 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0228012610 con 0x7f0230148800 2024-04-04T06:57:32.603 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:32.602+0000 7f0235800640 1 -- 172.21.15.72:0/2683585305 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02301584f0 con 0x7f0230148800 2024-04-04T06:57:32.603 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:32.602+0000 7f0235800640 1 -- 172.21.15.72:0/2683585305 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0230158ab0 con 0x7f0230148800 2024-04-04T06:57:32.603 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:32.603+0000 7f0235800640 1 -- 172.21.15.72:0/2683585305 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0230075840 con 0x7f0230148800 2024-04-04T06:57:32.603 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:32.604+0000 7f0226a00640 1 -- 172.21.15.72:0/2683585305 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f022801c070 con 0x7f0230148800 2024-04-04T06:57:32.604 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:32.605+0000 7f0226a00640 1 --2- 172.21.15.72:0/2683585305 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f020c06c920 0x7f020c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:32.604 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:32.605+0000 7f0226a00640 1 -- 172.21.15.72:0/2683585305 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f022808bc20 con 0x7f0230148800 2024-04-04T06:57:32.604 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:32.606+0000 7f022ea00640 1 --2- 172.21.15.72:0/2683585305 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f020c06c920 0x7f020c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:32.605 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:32.606+0000 7f022ea00640 1 --2- 172.21.15.72:0/2683585305 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f020c06c920 0x7f020c06ede0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f0220001630 tx=0x7f0220009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:32.608 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:32.610+0000 7f0226a00640 1 -- 172.21.15.72:0/2683585305 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f0228059ea0 con 0x7f0230148800 2024-04-04T06:57:32.818 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:32.819+0000 7f0235800640 1 -- 172.21.15.72:0/2683585305 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f023015cb50 con 0x7f0230148800 2024-04-04T06:57:32.819 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:32.820+0000 7f0226a00640 1 -- 172.21.15.72:0/2683585305 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v22) ==== 80+0+0 (secure 0 0 0) 0x7f02280597a0 con 0x7f0230148800 2024-04-04T06:57:32.819 INFO:teuthology.orchestra.run.smithi072.stderr:listed 0 entries 2024-04-04T06:57:32.821 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:32.822+0000 7f0235800640 1 -- 172.21.15.72:0/2683585305 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f020c06c920 msgr2=0x7f020c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:32.821 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:32.822+0000 7f0235800640 1 --2- 172.21.15.72:0/2683585305 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f020c06c920 0x7f020c06ede0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f0220001630 tx=0x7f0220009040 comp rx=0 tx=0).stop 2024-04-04T06:57:32.821 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:32.822+0000 7f0235800640 1 -- 172.21.15.72:0/2683585305 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0230148800 msgr2=0x7f0230148c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:32.821 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:32.822+0000 7f0235800640 1 --2- 172.21.15.72:0/2683585305 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0230148800 0x7f0230148c80 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f0230067ba0 tx=0x7f022800b4a0 comp rx=0 tx=0).stop 2024-04-04T06:57:32.822 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:32.823+0000 7f0235800640 1 -- 172.21.15.72:0/2683585305 shutdown_connections 2024-04-04T06:57:32.822 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:32.823+0000 7f0235800640 1 --2- 172.21.15.72:0/2683585305 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f020c06c920 0x7f020c06ede0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:32.822 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:32.823+0000 7f0235800640 1 --2- 172.21.15.72:0/2683585305 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0230148800 0x7f0230148c80 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:32.822 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:32.823+0000 7f0235800640 1 --2- 172.21.15.72:0/2683585305 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f02301557d0 0x7f0230155c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:32.822 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:32.823+0000 7f0235800640 1 --2- 172.21.15.72:0/2683585305 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f02301577b0 0x7f0230157b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:32.822 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:32.823+0000 7f0235800640 1 -- 172.21.15.72:0/2683585305 >> 172.21.15.72:0/2683585305 conn(0x7f02300d2180 msgr2=0x7f02300717e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:32.822 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:32.823+0000 7f0235800640 1 -- 172.21.15.72:0/2683585305 shutdown_connections 2024-04-04T06:57:32.822 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:32.823+0000 7f0235800640 1 -- 172.21.15.72:0/2683585305 wait complete. 2024-04-04T06:57:32.840 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi117.front.sepia.ceph.com... 2024-04-04T06:57:32.841 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-04T06:57:32.841 DEBUG:teuthology.orchestra.run.smithi117:> sudo fusermount -u /home/ubuntu/cephtest/mnt.3 2024-04-04T06:57:32.945 INFO:teuthology.orchestra.run:waiting for 300 2024-04-04T06:57:32.945 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi117.front.sepia.ceph.com 2024-04-04T06:57:32.945 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-04T06:57:32.945 DEBUG:teuthology.orchestra.run.smithi117:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-04-04T06:57:32.999 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-04-04T06:57:32.999 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-04T06:57:33.205 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:33.206+0000 7f79ac600640 1 Processor -- start 2024-04-04T06:57:33.205 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:33.206+0000 7f79ac600640 1 -- start start 2024-04-04T06:57:33.208 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:33.209+0000 7f79ac600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f79a415e5e0 0x7f79a40b4380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:33.208 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:33.209+0000 7f79ac600640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f79a4162e40 con 0x7f79a40d1ba0 2024-04-04T06:57:33.208 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:33.209+0000 7f79ac600640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f79a4072600 con 0x7f79a40aff70 2024-04-04T06:57:33.208 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:33.209+0000 7f79ac600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f79a4072f30 con 0x7f79a415e5e0 2024-04-04T06:57:33.208 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:33.210+0000 7f79aa600640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f79a40d1ba0 0x7f79a4162730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:52284/0 (socket says 172.21.15.72:52284) 2024-04-04T06:57:33.208 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:33.210+0000 7f79aa600640 1 -- 172.21.15.72:0/1965835791 learned_addr learned my addr 172.21.15.72:0/1965835791 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-04-04T06:57:33.211 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:33.210+0000 7f79a9c00640 1 --2- 172.21.15.72:0/1965835791 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f79a415e5e0 0x7f79a40b4380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:33.211 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:33.210+0000 7f79a3e00640 1 -- 172.21.15.72:0/1965835791 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 298633564 0 0) 0x7f79a4162e40 con 0x7f79a40d1ba0 2024-04-04T06:57:33.211 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:33.210+0000 7f79a3e00640 1 -- 172.21.15.72:0/1965835791 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f798c003520 con 0x7f79a40d1ba0 2024-04-04T06:57:33.211 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:33.211+0000 7f79a3e00640 1 -- 172.21.15.72:0/1965835791 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 694772999 0 0) 0x7f798c003520 con 0x7f79a40d1ba0 2024-04-04T06:57:33.211 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:33.211+0000 7f79a3e00640 1 -- 172.21.15.72:0/1965835791 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f79a415e5e0 msgr2=0x7f79a40b4380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:57:33.211 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:33.211+0000 7f79a3e00640 1 --2- 172.21.15.72:0/1965835791 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f79a415e5e0 0x7f79a40b4380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:33.211 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:33.211+0000 7f79a3e00640 1 -- 172.21.15.72:0/1965835791 >> v1:172.21.15.117:6789/0 conn(0x7f79a40aff70 legacy=0x7f79a4162020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:33.211 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:33.211+0000 7f79a3e00640 1 -- 172.21.15.72:0/1965835791 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79a40728e0 con 0x7f79a40d1ba0 2024-04-04T06:57:33.211 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:33.211+0000 7f79a3e00640 1 -- 172.21.15.72:0/1965835791 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2465650867 0 0) 0x7f799c0019f0 con 0x7f79a40d1ba0 2024-04-04T06:57:33.211 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:33.211+0000 7f79a3e00640 1 -- 172.21.15.72:0/1965835791 >> v1:172.21.15.72:6789/0 conn(0x7f79a40d1ba0 legacy=0x7f79a4162730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:33.211 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:33.211+0000 7f79a3e00640 1 --2- 172.21.15.72:0/1965835791 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f798c0039e0 0x7f798c003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:33.211 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:33.211+0000 7f79a3e00640 1 --2- 172.21.15.72:0/1965835791 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f798c004800 0x7f798c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:33.212 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:33.211+0000 7f79a3e00640 1 --2- 172.21.15.72:0/1965835791 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f79a415e5e0 0x7f798c005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:33.212 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:33.211+0000 7f79a3e00640 1 -- 172.21.15.72:0/1965835791 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f79a4072f30 con 0x7f798c004800 2024-04-04T06:57:33.212 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:33.211+0000 7f79a3e00640 1 -- 172.21.15.72:0/1965835791 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f798c00baf0 con 0x7f798c0039e0 2024-04-04T06:57:33.212 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:33.211+0000 7f79a3e00640 1 -- 172.21.15.72:0/1965835791 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f798c00bcf0 con 0x7f79a415e5e0 2024-04-04T06:57:33.212 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:33.211+0000 7f79a9200640 1 --2- 172.21.15.72:0/1965835791 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f798c004800 0x7f798c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:33.212 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:33.211+0000 7f79a9c00640 1 --2- 172.21.15.72:0/1965835791 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f798c0039e0 0x7f798c003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:33.212 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:33.211+0000 7f79aa600640 1 --2- 172.21.15.72:0/1965835791 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f79a415e5e0 0x7f798c005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:33.212 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:33.212+0000 7f79a9200640 1 -- 172.21.15.72:0/1965835791 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f79a415e5e0 msgr2=0x7f798c005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:57:33.212 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:33.212+0000 7f79a9200640 1 --2- 172.21.15.72:0/1965835791 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f79a415e5e0 0x7f798c005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:33.212 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:33.212+0000 7f79a9200640 1 -- 172.21.15.72:0/1965835791 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f798c0039e0 msgr2=0x7f798c003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:57:33.212 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:33.212+0000 7f79a9200640 1 --2- 172.21.15.72:0/1965835791 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f798c0039e0 0x7f798c003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:33.212 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:33.212+0000 7f79a9200640 1 -- 172.21.15.72:0/1965835791 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f798c003520 con 0x7f798c004800 2024-04-04T06:57:33.212 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:33.212+0000 7f79a9c00640 1 --2- 172.21.15.72:0/1965835791 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f798c0039e0 0x7f798c003e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-04T06:57:33.213 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:33.212+0000 7f79aa600640 1 --2- 172.21.15.72:0/1965835791 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f79a415e5e0 0x7f798c005200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-04T06:57:33.214 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:33.213+0000 7f79a9200640 1 --2- 172.21.15.72:0/1965835791 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f798c004800 0x7f798c004c80 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f7990001750 tx=0x7f798c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4aeec3d7573d3641 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:33.214 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:33.213+0000 7f79a3e00640 1 -- 172.21.15.72:0/1965835791 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7990001370 con 0x7f798c004800 2024-04-04T06:57:33.214 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:33.213+0000 7f79a3e00640 1 -- 172.21.15.72:0/1965835791 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79900052d0 con 0x7f798c004800 2024-04-04T06:57:33.214 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:33.213+0000 7f79a3e00640 1 -- 172.21.15.72:0/1965835791 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7990003830 con 0x7f798c004800 2024-04-04T06:57:33.214 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:33.213+0000 7f79ac600640 1 -- 172.21.15.72:0/1965835791 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f798c004800 msgr2=0x7f798c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:33.215 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:33.213+0000 7f79ac600640 1 --2- 172.21.15.72:0/1965835791 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f798c004800 0x7f798c004c80 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f7990001750 tx=0x7f798c005830 comp rx=0 tx=0).stop 2024-04-04T06:57:33.215 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:33.213+0000 7f79aa600640 1 -- 172.21.15.72:0/1965835791 reap_dead start 2024-04-04T06:57:33.215 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:33.214+0000 7f79ac600640 1 -- 172.21.15.72:0/1965835791 shutdown_connections 2024-04-04T06:57:33.215 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:33.214+0000 7f79ac600640 1 -- 172.21.15.72:0/1965835791 >> 172.21.15.72:0/1965835791 conn(0x7f79a40d1080 msgr2=0x7f79a40d1490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:33.215 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:33.214+0000 7f79ac600640 1 -- 172.21.15.72:0/1965835791 shutdown_connections 2024-04-04T06:57:33.215 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:33.214+0000 7f79ac600640 1 -- 172.21.15.72:0/1965835791 wait complete. 2024-04-04T06:57:33.215 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:33.215+0000 7f79ac600640 1 Processor -- start 2024-04-04T06:57:33.215 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:33.216+0000 7f79ac600640 1 -- start start 2024-04-04T06:57:33.217 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:33.216+0000 7f79ac600640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f798c004800 0x7f79a4160700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:33.217 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:33.216+0000 7f79ac600640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f79a414eb10 0x7f79a406e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:33.217 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:33.216+0000 7f79ac600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f79a406ee20 0x7f79a415e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:33.217 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:33.216+0000 7f79ac600640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f79a40b04e0 con 0x7f798c004800 2024-04-04T06:57:33.218 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:33.216+0000 7f79ac600640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f79a40709a0 con 0x7f79a414eb10 2024-04-04T06:57:33.218 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:33.216+0000 7f79ac600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f79a40733c0 con 0x7f79a406ee20 2024-04-04T06:57:33.218 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:33.217+0000 7f79a9c00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f798c004800 0x7f79a4160700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:33.218 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:33.217+0000 7f79a9c00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f798c004800 0x7f79a4160700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:38756/0 (socket says 172.21.15.72:38756) 2024-04-04T06:57:33.218 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:33.217+0000 7f79a9c00640 1 -- 172.21.15.72:0/898107328 learned_addr learned my addr 172.21.15.72:0/898107328 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:57:33.218 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:33.217+0000 7f79aa600640 1 --2- 172.21.15.72:0/898107328 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f79a406ee20 0x7f79a415e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:33.218 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:33.217+0000 7f79a9200640 1 --2- 172.21.15.72:0/898107328 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f79a414eb10 0x7f79a406e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:33.218 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:33.217+0000 7f79a9c00640 1 -- 172.21.15.72:0/898107328 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f79a406ee20 msgr2=0x7f79a415e9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:33.218 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:33.217+0000 7f79a9c00640 1 --2- 172.21.15.72:0/898107328 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f79a406ee20 0x7f79a415e9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:33.218 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:33.217+0000 7f79a9c00640 1 -- 172.21.15.72:0/898107328 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f79a414eb10 msgr2=0x7f79a406e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:33.218 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:33.217+0000 7f79a9c00640 1 --2- 172.21.15.72:0/898107328 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f79a414eb10 0x7f79a406e8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:33.218 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:33.217+0000 7f79a9c00640 1 -- 172.21.15.72:0/898107328 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79a415f660 con 0x7f798c004800 2024-04-04T06:57:33.218 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:33.217+0000 7f79aa600640 1 --2- 172.21.15.72:0/898107328 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f79a406ee20 0x7f79a415e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-04T06:57:33.218 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:33.217+0000 7f79a9200640 1 --2- 172.21.15.72:0/898107328 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f79a414eb10 0x7f79a406e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-04T06:57:33.219 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:33.218+0000 7f79a9c00640 1 --2- 172.21.15.72:0/898107328 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f798c004800 0x7f79a4160700 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f79980108b0 tx=0x7f7998010d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:33.219 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:33.218+0000 7f79a1600640 1 -- 172.21.15.72:0/898107328 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f799800f040 con 0x7f798c004800 2024-04-04T06:57:33.219 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:33.218+0000 7f79a1600640 1 -- 172.21.15.72:0/898107328 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f799800eb00 con 0x7f798c004800 2024-04-04T06:57:33.219 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:33.218+0000 7f79ac600640 1 -- 172.21.15.72:0/898107328 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79a415f940 con 0x7f798c004800 2024-04-04T06:57:33.219 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:33.218+0000 7f79a1600640 1 -- 172.21.15.72:0/898107328 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f799801c400 con 0x7f798c004800 2024-04-04T06:57:33.219 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:33.218+0000 7f79ac600640 1 -- 172.21.15.72:0/898107328 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79a415ff00 con 0x7f798c004800 2024-04-04T06:57:33.219 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:33.219+0000 7f79ac600640 1 -- 172.21.15.72:0/898107328 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f79a4075840 con 0x7f798c004800 2024-04-04T06:57:33.219 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:33.221+0000 7f79a1600640 1 -- 172.21.15.72:0/898107328 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f799801c5a0 con 0x7f798c004800 2024-04-04T06:57:33.220 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:33.221+0000 7f79a1600640 1 --2- 172.21.15.72:0/898107328 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f798406c8f0 0x7f798406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:33.220 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:33.222+0000 7f79a1600640 1 -- 172.21.15.72:0/898107328 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f799808c210 con 0x7f798c004800 2024-04-04T06:57:33.220 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:33.222+0000 7f79a9200640 1 --2- 172.21.15.72:0/898107328 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f798406c8f0 0x7f798406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:33.221 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:33.222+0000 7f79a9200640 1 --2- 172.21.15.72:0/898107328 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f798406c8f0 0x7f798406edb0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f7990033000 tx=0x7f7990009030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:33.225 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:33.226+0000 7f79a1600640 1 -- 172.21.15.72:0/898107328 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f7998018030 con 0x7f798c004800 2024-04-04T06:57:33.518 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:33.519+0000 7f79ac600640 1 -- 172.21.15.72:0/898107328 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f79a406f200 con 0x7f798c004800 2024-04-04T06:57:33.519 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:33.520+0000 7f79a1600640 1 -- 172.21.15.72:0/898107328 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5181 (secure 0 0 0) 0x7f799805a5c0 con 0x7f798c004800 2024-04-04T06:57:33.519 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T06:57:33.519 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6834/3570831137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":3570831137},{"type":"v1","addr":"172.21.15.117:6834","nonce":3570831137}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4238,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/1683311500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6833","nonce":1683311500},{"type":"v1","addr":"172.21.15.117:6835","nonce":1683311500}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6835/4150347227","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":4150347227},{"type":"v1","addr":"172.21.15.72:6835","nonce":4150347227}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-04T06:56:28.435113+0000","modified":"2024-04-04T06:56:31.557618+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4263},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4263":{"gid":4263,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.72:6837/2958027127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6836","nonce":2958027127},{"type":"v1","addr":"172.21.15.72:6837","nonce":2958027127}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4263,"qdb_cluster":[4263]},"id":1}]} 2024-04-04T06:57:33.520 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 8 2024-04-04T06:57:33.522 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:33.523+0000 7f79ac600640 1 -- 172.21.15.72:0/898107328 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f798406c8f0 msgr2=0x7f798406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:33.522 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:33.523+0000 7f79ac600640 1 --2- 172.21.15.72:0/898107328 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f798406c8f0 0x7f798406edb0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f7990033000 tx=0x7f7990009030 comp rx=0 tx=0).stop 2024-04-04T06:57:33.522 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:33.523+0000 7f79ac600640 1 -- 172.21.15.72:0/898107328 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f798c004800 msgr2=0x7f79a4160700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:33.522 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:33.523+0000 7f79ac600640 1 --2- 172.21.15.72:0/898107328 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f798c004800 0x7f79a4160700 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f79980108b0 tx=0x7f7998010d70 comp rx=0 tx=0).stop 2024-04-04T06:57:33.522 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:33.523+0000 7f79ac600640 1 -- 172.21.15.72:0/898107328 shutdown_connections 2024-04-04T06:57:33.522 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:33.523+0000 7f79ac600640 1 --2- 172.21.15.72:0/898107328 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f798406c8f0 0x7f798406edb0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:33.522 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:33.523+0000 7f79ac600640 1 --2- 172.21.15.72:0/898107328 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f79a406ee20 0x7f79a415e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:33.522 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:33.523+0000 7f79ac600640 1 --2- 172.21.15.72:0/898107328 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f79a414eb10 0x7f79a406e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:33.522 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:33.523+0000 7f79ac600640 1 --2- 172.21.15.72:0/898107328 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f798c004800 0x7f79a4160700 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:33.523 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:33.523+0000 7f79ac600640 1 -- 172.21.15.72:0/898107328 >> 172.21.15.72:0/898107328 conn(0x7f79a40d1080 msgr2=0x7f79a40b1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:33.523 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:33.523+0000 7f79ac600640 1 -- 172.21.15.72:0/898107328 shutdown_connections 2024-04-04T06:57:33.523 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:33.523+0000 7f79ac600640 1 -- 172.21.15.72:0/898107328 wait complete. 2024-04-04T06:57:33.541 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-04T06:57:33.747 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:33.748+0000 7f5669e00640 1 Processor -- start 2024-04-04T06:57:33.747 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:33.748+0000 7f5669e00640 1 -- start start 2024-04-04T06:57:33.749 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:33.750+0000 7f5669e00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f566415c2d0 0x7f5664071610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:33.749 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:33.750+0000 7f5669e00640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f566415c6b0 0x7f56640c5e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:33.749 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:33.750+0000 7f5669e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f56640ccb20 0x7f56640ccfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:33.749 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:33.750+0000 7f5669e00640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f56640c6fb0 con 0x7f566415c6b0 2024-04-04T06:57:33.749 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:33.750+0000 7f5669e00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f56640c6710 con 0x7f566415c2d0 2024-04-04T06:57:33.749 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:33.750+0000 7f5669e00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f56640c69f0 con 0x7f56640ccb20 2024-04-04T06:57:33.749 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:33.750+0000 7f565be00640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f566415c6b0 0x7f56640c5e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:33.749 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:33.750+0000 7f565be00640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f566415c6b0 0x7f56640c5e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:38758/0 (socket says 172.21.15.72:38758) 2024-04-04T06:57:33.749 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:33.750+0000 7f565be00640 1 -- 172.21.15.72:0/2943851487 learned_addr learned my addr 172.21.15.72:0/2943851487 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:57:33.750 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:33.750+0000 7f565be00640 1 -- 172.21.15.72:0/2943851487 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f56640ccb20 msgr2=0x7f56640ccfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:57:33.750 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:33.750+0000 7f565be00640 1 --2- 172.21.15.72:0/2943851487 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f56640ccb20 0x7f56640ccfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:33.750 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:33.751+0000 7f565be00640 1 -- 172.21.15.72:0/2943851487 >> v2:172.21.15.117:3300/0 conn(0x7f566415c2d0 msgr2=0x7f5664071610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:57:33.750 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:33.751+0000 7f565be00640 1 --2- 172.21.15.72:0/2943851487 >> v2:172.21.15.117:3300/0 conn(0x7f566415c2d0 0x7f5664071610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:33.750 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:33.751+0000 7f565be00640 1 -- 172.21.15.72:0/2943851487 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56640c6cd0 con 0x7f566415c6b0 2024-04-04T06:57:33.750 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:33.752+0000 7f565be00640 1 --2- 172.21.15.72:0/2943851487 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f566415c6b0 0x7f56640c5e50 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f566406c210 tx=0x7f564c02b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f60cfe60c5f0f990 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:33.754 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:33.752+0000 7f5662000640 1 -- 172.21.15.72:0/2943851487 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f564c02e070 con 0x7f566415c6b0 2024-04-04T06:57:33.754 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:33.752+0000 7f5662000640 1 -- 172.21.15.72:0/2943851487 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f564c037070 con 0x7f566415c6b0 2024-04-04T06:57:33.754 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:33.752+0000 7f5662000640 1 -- 172.21.15.72:0/2943851487 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f564c031a00 con 0x7f566415c6b0 2024-04-04T06:57:33.754 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:33.752+0000 7f5669e00640 1 -- 172.21.15.72:0/2943851487 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f566415c6b0 msgr2=0x7f56640c5e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:33.754 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:33.752+0000 7f5669e00640 1 --2- 172.21.15.72:0/2943851487 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f566415c6b0 0x7f56640c5e50 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f566406c210 tx=0x7f564c02b880 comp rx=0 tx=0).stop 2024-04-04T06:57:33.754 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:33.753+0000 7f5669e00640 1 -- 172.21.15.72:0/2943851487 shutdown_connections 2024-04-04T06:57:33.754 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:33.753+0000 7f5669e00640 1 --2- 172.21.15.72:0/2943851487 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f56640ccb20 0x7f56640ccfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:33.755 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:33.753+0000 7f5669e00640 1 --2- 172.21.15.72:0/2943851487 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f566415c6b0 0x7f56640c5e50 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:33.755 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:33.753+0000 7f5669e00640 1 --2- 172.21.15.72:0/2943851487 >> v2:172.21.15.117:3300/0 conn(0x7f566415c2d0 0x7f5664071610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:33.755 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:33.753+0000 7f5669e00640 1 -- 172.21.15.72:0/2943851487 >> 172.21.15.72:0/2943851487 conn(0x7f566406b470 msgr2=0x7f566406b880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:33.755 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:33.753+0000 7f5669e00640 1 -- 172.21.15.72:0/2943851487 shutdown_connections 2024-04-04T06:57:33.755 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:33.753+0000 7f5669e00640 1 -- 172.21.15.72:0/2943851487 wait complete. 2024-04-04T06:57:33.755 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:33.755+0000 7f5669e00640 1 Processor -- start 2024-04-04T06:57:33.755 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:33.756+0000 7f5669e00640 1 -- start start 2024-04-04T06:57:33.757 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:33.757+0000 7f5669e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f56640ccb20 0x7f566415ad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:33.757 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:33.757+0000 7f5669e00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f566415c2d0 0x7f56640c7200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:33.757 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:33.757+0000 7f5669e00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f566415c6b0 0x7f5664072ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:33.757 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:33.757+0000 7f5669e00640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f56640b3ea0 con 0x7f566415c6b0 2024-04-04T06:57:33.757 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:33.757+0000 7f5669e00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f56640c6390 con 0x7f566415c2d0 2024-04-04T06:57:33.757 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:33.757+0000 7f5669e00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f56640b4020 con 0x7f56640ccb20 2024-04-04T06:57:33.757 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:33.757+0000 7f5663400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f566415c6b0 0x7f5664072ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:33.757 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:33.758+0000 7f5663400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f566415c6b0 0x7f5664072ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:38774/0 (socket says 172.21.15.72:38774) 2024-04-04T06:57:33.757 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:33.758+0000 7f5663400640 1 -- 172.21.15.72:0/191529414 learned_addr learned my addr 172.21.15.72:0/191529414 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:57:33.757 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:33.758+0000 7f5663400640 1 -- 172.21.15.72:0/191529414 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f56640ccb20 msgr2=0x7f566415ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:33.757 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:33.758+0000 7f5663400640 1 --2- 172.21.15.72:0/191529414 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f56640ccb20 0x7f566415ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:33.757 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:33.758+0000 7f5663400640 1 -- 172.21.15.72:0/191529414 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f566415c2d0 msgr2=0x7f56640c7200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:33.758 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:33.758+0000 7f5663400640 1 --2- 172.21.15.72:0/191529414 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f566415c2d0 0x7f56640c7200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:33.758 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:33.758+0000 7f5663400640 1 -- 172.21.15.72:0/191529414 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56640c7a30 con 0x7f566415c6b0 2024-04-04T06:57:33.758 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:33.758+0000 7f5663400640 1 --2- 172.21.15.72:0/191529414 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f566415c6b0 0x7f5664072ba0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f565c00b970 tx=0x7f565c00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:33.759 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:33.759+0000 7f565b400640 1 -- 172.21.15.72:0/191529414 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f565c019070 con 0x7f566415c6b0 2024-04-04T06:57:33.759 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:33.759+0000 7f565b400640 1 -- 172.21.15.72:0/191529414 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f565c00cb60 con 0x7f566415c6b0 2024-04-04T06:57:33.759 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:33.759+0000 7f5669e00640 1 -- 172.21.15.72:0/191529414 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56640c7d10 con 0x7f566415c6b0 2024-04-04T06:57:33.759 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:33.759+0000 7f565b400640 1 -- 172.21.15.72:0/191529414 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f565c014440 con 0x7f566415c6b0 2024-04-04T06:57:33.759 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:33.759+0000 7f5669e00640 1 -- 172.21.15.72:0/191529414 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56640c82d0 con 0x7f566415c6b0 2024-04-04T06:57:33.759 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:33.760+0000 7f5669e00640 1 -- 172.21.15.72:0/191529414 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5664075840 con 0x7f566415c6b0 2024-04-04T06:57:33.760 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:33.762+0000 7f565b400640 1 -- 172.21.15.72:0/191529414 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f565c01c070 con 0x7f566415c6b0 2024-04-04T06:57:33.761 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:33.763+0000 7f565b400640 1 --2- 172.21.15.72:0/191529414 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f564006c8f0 0x7f564006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:33.762 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:33.763+0000 7f565b400640 1 -- 172.21.15.72:0/191529414 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f565c08b9d0 con 0x7f566415c6b0 2024-04-04T06:57:33.762 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:33.763+0000 7f5662a00640 1 --2- 172.21.15.72:0/191529414 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f564006c8f0 0x7f564006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:33.762 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:33.764+0000 7f5662a00640 1 --2- 172.21.15.72:0/191529414 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f564006c8f0 0x7f564006edb0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f566415db50 tx=0x7f5654006c90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:33.766 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:33.768+0000 7f565b400640 1 -- 172.21.15.72:0/191529414 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f565c059ce0 con 0x7f566415c6b0 2024-04-04T06:57:34.010 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:34.012+0000 7f5669e00640 1 -- 172.21.15.72:0/191529414 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f56640c7740 con 0x7f566415c6b0 2024-04-04T06:57:34.011 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:34.013+0000 7f565b400640 1 -- 172.21.15.72:0/191529414 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16831 (secure 0 0 0) 0x7f565c0595e0 con 0x7f566415c6b0 2024-04-04T06:57:34.012 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T06:57:34.013 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":22,"fsid":"6708bac2-4f50-49b5-87a9-c390fd333eb3","created":"2024-04-04T06:56:04.282498+0000","modified":"2024-04-04T06:57:11.239134+0000","last_up_change":"2024-04-04T06:56:16.716089+0000","last_in_change":"2024-04-04T06:56:07.768593+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-04T06:56:17.421685+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-04T06:56:26.822661+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-04T06:56:27.429816+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7c345991-5af8-4dc6-a481-28610c40e128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":3889813953},{"type":"v1","addr":"172.21.15.72:6818","nonce":3889813953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":3889813953},{"type":"v1","addr":"172.21.15.72:6821","nonce":3889813953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":3889813953},{"type":"v1","addr":"172.21.15.72:6826","nonce":3889813953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":3889813953},{"type":"v1","addr":"172.21.15.72:6823","nonce":3889813953}]},"public_addr":"172.21.15.72:6818/3889813953","cluster_addr":"172.21.15.72:6821/3889813953","heartbeat_back_addr":"172.21.15.72:6826/3889813953","heartbeat_front_addr":"172.21.15.72:6823/3889813953","state":["exists","up"]},{"osd":1,"uuid":"1b3f7ab2-a56c-488d-a89a-1f3572361c95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":3101663154},{"type":"v1","addr":"172.21.15.72:6801","nonce":3101663154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":3101663154},{"type":"v1","addr":"172.21.15.72:6803","nonce":3101663154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":3101663154},{"type":"v1","addr":"172.21.15.72:6807","nonce":3101663154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":3101663154},{"type":"v1","addr":"172.21.15.72:6805","nonce":3101663154}]},"public_addr":"172.21.15.72:6801/3101663154","cluster_addr":"172.21.15.72:6803/3101663154","heartbeat_back_addr":"172.21.15.72:6807/3101663154","heartbeat_front_addr":"172.21.15.72:6805/3101663154","state":["exists","up"]},{"osd":2,"uuid":"fc9aa512-53df-40d7-ba04-3e6b7dcd1e34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":235374192},{"type":"v1","addr":"172.21.15.72:6809","nonce":235374192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":235374192},{"type":"v1","addr":"172.21.15.72:6811","nonce":235374192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":235374192},{"type":"v1","addr":"172.21.15.72:6815","nonce":235374192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":235374192},{"type":"v1","addr":"172.21.15.72:6813","nonce":235374192}]},"public_addr":"172.21.15.72:6809/235374192","cluster_addr":"172.21.15.72:6811/235374192","heartbeat_back_addr":"172.21.15.72:6815/235374192","heartbeat_front_addr":"172.21.15.72:6813/235374192","state":["exists","up"]},{"osd":3,"uuid":"b4f63eed-dc5b-4aba-bb50-de46eb41492b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6817","nonce":2806631742},{"type":"v1","addr":"172.21.15.72:6819","nonce":2806631742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":2806631742},{"type":"v1","addr":"172.21.15.72:6827","nonce":2806631742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":2806631742},{"type":"v1","addr":"172.21.15.72:6831","nonce":2806631742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":2806631742},{"type":"v1","addr":"172.21.15.72:6829","nonce":2806631742}]},"public_addr":"172.21.15.72:6819/2806631742","cluster_addr":"172.21.15.72:6827/2806631742","heartbeat_back_addr":"172.21.15.72:6831/2806631742","heartbeat_front_addr":"172.21.15.72:6829/2806631742","state":["exists","up"]},{"osd":4,"uuid":"9e985ef8-d711-4172-9286-c54e560895d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":4293536423},{"type":"v1","addr":"172.21.15.117:6825","nonce":4293536423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":4293536423},{"type":"v1","addr":"172.21.15.117:6827","nonce":4293536423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":4293536423},{"type":"v1","addr":"172.21.15.117:6831","nonce":4293536423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":4293536423},{"type":"v1","addr":"172.21.15.117:6829","nonce":4293536423}]},"public_addr":"172.21.15.117:6825/4293536423","cluster_addr":"172.21.15.117:6827/4293536423","heartbeat_back_addr":"172.21.15.117:6831/4293536423","heartbeat_front_addr":"172.21.15.117:6829/4293536423","state":["exists","up"]},{"osd":5,"uuid":"3e9f082b-8d7d-455f-8a96-66d0b4857125","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":684971679},{"type":"v1","addr":"172.21.15.117:6801","nonce":684971679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":684971679},{"type":"v1","addr":"172.21.15.117:6803","nonce":684971679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":684971679},{"type":"v1","addr":"172.21.15.117:6807","nonce":684971679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":684971679},{"type":"v1","addr":"172.21.15.117:6805","nonce":684971679}]},"public_addr":"172.21.15.117:6801/684971679","cluster_addr":"172.21.15.117:6803/684971679","heartbeat_back_addr":"172.21.15.117:6807/684971679","heartbeat_front_addr":"172.21.15.117:6805/684971679","state":["exists","up"]},{"osd":6,"uuid":"bcdafa9f-a870-4398-a38d-ab7697676473","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":2781186528},{"type":"v1","addr":"172.21.15.117:6809","nonce":2781186528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":2781186528},{"type":"v1","addr":"172.21.15.117:6811","nonce":2781186528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":2781186528},{"type":"v1","addr":"172.21.15.117:6815","nonce":2781186528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":2781186528},{"type":"v1","addr":"172.21.15.117:6813","nonce":2781186528}]},"public_addr":"172.21.15.117:6809/2781186528","cluster_addr":"172.21.15.117:6811/2781186528","heartbeat_back_addr":"172.21.15.117:6815/2781186528","heartbeat_front_addr":"172.21.15.117:6813/2781186528","state":["exists","up"]},{"osd":7,"uuid":"b68ec562-ff35-4d2d-a733-c896f8920cfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":617469882},{"type":"v1","addr":"172.21.15.117:6817","nonce":617469882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":617469882},{"type":"v1","addr":"172.21.15.117:6819","nonce":617469882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":617469882},{"type":"v1","addr":"172.21.15.117:6823","nonce":617469882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":617469882},{"type":"v1","addr":"172.21.15.117:6821","nonce":617469882}]},"public_addr":"172.21.15.117:6817/617469882","cluster_addr":"172.21.15.117:6819/617469882","heartbeat_back_addr":"172.21.15.117:6823/617469882","heartbeat_front_addr":"172.21.15.117:6821/617469882","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.347700+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.296619+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.361345+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.093323+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:12.857605+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:12.816090+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.083163+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.121639+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.13","mappings":[{"from":7,"to":1}]},{"pgid":"3.19","mappings":[{"from":3,"to":2}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.28","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-04T06:57:34.016 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:34.016+0000 7f5669e00640 1 -- 172.21.15.72:0/191529414 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f564006c8f0 msgr2=0x7f564006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:34.016 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:34.016+0000 7f5669e00640 1 --2- 172.21.15.72:0/191529414 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f564006c8f0 0x7f564006edb0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f566415db50 tx=0x7f5654006c90 comp rx=0 tx=0).stop 2024-04-04T06:57:34.016 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:34.017+0000 7f5669e00640 1 -- 172.21.15.72:0/191529414 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f566415c6b0 msgr2=0x7f5664072ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:34.016 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:34.017+0000 7f5669e00640 1 --2- 172.21.15.72:0/191529414 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f566415c6b0 0x7f5664072ba0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f565c00b970 tx=0x7f565c00be30 comp rx=0 tx=0).stop 2024-04-04T06:57:34.016 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:34.017+0000 7f5669e00640 1 -- 172.21.15.72:0/191529414 shutdown_connections 2024-04-04T06:57:34.016 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:34.017+0000 7f5669e00640 1 --2- 172.21.15.72:0/191529414 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f564006c8f0 0x7f564006edb0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:34.016 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:34.017+0000 7f5669e00640 1 --2- 172.21.15.72:0/191529414 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f566415c6b0 0x7f5664072ba0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:34.016 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:34.017+0000 7f5669e00640 1 --2- 172.21.15.72:0/191529414 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f566415c2d0 0x7f56640c7200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:34.016 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:34.017+0000 7f5669e00640 1 --2- 172.21.15.72:0/191529414 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f56640ccb20 0x7f566415ad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:34.016 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:34.017+0000 7f5669e00640 1 -- 172.21.15.72:0/191529414 >> 172.21.15.72:0/191529414 conn(0x7f566406b470 msgr2=0x7f566406edf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:34.016 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:34.017+0000 7f5669e00640 1 -- 172.21.15.72:0/191529414 shutdown_connections 2024-04-04T06:57:34.016 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:34.017+0000 7f5669e00640 1 -- 172.21.15.72:0/191529414 wait complete. 2024-04-04T06:57:34.038 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-04T06:56:17.421685+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-04T06:56:26.822661+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-04T06:56:27.429816+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-04T06:57:34.038 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-04T06:57:34.243 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:34.244+0000 7f880fa00640 1 Processor -- start 2024-04-04T06:57:34.243 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:34.244+0000 7f880fa00640 1 -- start start 2024-04-04T06:57:34.244 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:34.245+0000 7f880fa00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f88080d1db0 0x7f88080d2240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:34.244 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:34.245+0000 7f880fa00640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88080cce70 con 0x7f880815e540 2024-04-04T06:57:34.244 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:34.245+0000 7f880fa00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f880806b680 con 0x7f88080cfce0 2024-04-04T06:57:34.244 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:34.245+0000 7f880fa00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f88080d2930 con 0x7f88080d1db0 2024-04-04T06:57:34.244 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:34.246+0000 7f880d000640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f880815e540 0x7f88080cc760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:52286/0 (socket says 172.21.15.72:52286) 2024-04-04T06:57:34.244 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:34.246+0000 7f880d000640 1 -- 172.21.15.72:0/3612431816 learned_addr learned my addr 172.21.15.72:0/3612431816 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-04-04T06:57:34.246 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:34.246+0000 7f8807400640 1 -- 172.21.15.72:0/3612431816 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 234470964 0 0) 0x7f88080cce70 con 0x7f880815e540 2024-04-04T06:57:34.246 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:34.246+0000 7f8807400640 1 -- 172.21.15.72:0/3612431816 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f87f0003520 con 0x7f880815e540 2024-04-04T06:57:34.246 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:34.246+0000 7f8807e00640 1 --2- 172.21.15.72:0/3612431816 >> v2:172.21.15.117:3300/0 conn(0x7f88080d1db0 0x7f88080d2240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:34.246 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:34.246+0000 7f8807400640 1 -- 172.21.15.72:0/3612431816 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2432833392 0 0) 0x7f87f0003520 con 0x7f880815e540 2024-04-04T06:57:34.246 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:34.246+0000 7f8807400640 1 -- 172.21.15.72:0/3612431816 >> v2:172.21.15.117:3300/0 conn(0x7f88080d1db0 msgr2=0x7f88080d2240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:57:34.247 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:34.246+0000 7f8807400640 1 --2- 172.21.15.72:0/3612431816 >> v2:172.21.15.117:3300/0 conn(0x7f88080d1db0 0x7f88080d2240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:34.247 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:34.246+0000 7f8807400640 1 -- 172.21.15.72:0/3612431816 >> v1:172.21.15.117:6789/0 conn(0x7f88080cfce0 legacy=0x7f880806be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:34.247 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:34.246+0000 7f8807400640 1 -- 172.21.15.72:0/3612431816 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88080d2c10 con 0x7f880815e540 2024-04-04T06:57:34.247 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:34.246+0000 7f8807400640 1 -- 172.21.15.72:0/3612431816 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2465650867 0 0) 0x7f87fc001670 con 0x7f880815e540 2024-04-04T06:57:34.247 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:34.246+0000 7f8807400640 1 -- 172.21.15.72:0/3612431816 >> v1:172.21.15.72:6789/0 conn(0x7f880815e540 legacy=0x7f88080cc760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:34.247 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:34.247+0000 7f8807400640 1 --2- 172.21.15.72:0/3612431816 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f87f0003a00 0x7f87f0003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:34.247 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:34.247+0000 7f8807400640 1 --2- 172.21.15.72:0/3612431816 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f87f0004800 0x7f87f0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:34.247 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:34.247+0000 7f8807400640 1 --2- 172.21.15.72:0/3612431816 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f87f0005210 0x7f87f000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:34.247 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:34.247+0000 7f8807400640 1 -- 172.21.15.72:0/3612431816 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f88080d2930 con 0x7f87f0003a00 2024-04-04T06:57:34.247 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:34.247+0000 7f8807400640 1 -- 172.21.15.72:0/3612431816 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f87f000c160 con 0x7f87f0004800 2024-04-04T06:57:34.247 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:34.247+0000 7f8807400640 1 -- 172.21.15.72:0/3612431816 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f87f000c360 con 0x7f87f0005210 2024-04-04T06:57:34.247 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:34.247+0000 7f880d000640 1 --2- 172.21.15.72:0/3612431816 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f87f0003a00 0x7f87f0003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:34.247 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:34.247+0000 7f880d000640 1 -- 172.21.15.72:0/3612431816 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f87f0005210 msgr2=0x7f87f000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:57:34.247 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:34.247+0000 7f880d000640 1 --2- 172.21.15.72:0/3612431816 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f87f0005210 0x7f87f000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:34.248 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:34.247+0000 7f880d000640 1 -- 172.21.15.72:0/3612431816 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f87f0004800 msgr2=0x7f87f0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:57:34.248 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:34.247+0000 7f880d000640 1 --2- 172.21.15.72:0/3612431816 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f87f0004800 0x7f87f0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:34.248 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:34.247+0000 7f880da00640 1 -- 172.21.15.72:0/3612431816 reap_dead start 2024-04-04T06:57:34.248 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:34.247+0000 7f880d000640 1 -- 172.21.15.72:0/3612431816 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87f0003520 con 0x7f87f0003a00 2024-04-04T06:57:34.249 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:34.248+0000 7f880d000640 1 --2- 172.21.15.72:0/3612431816 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f87f0003a00 0x7f87f0003e20 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f87fc00c110 tx=0x7f87f0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24200ad356cdc258 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:34.249 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:34.249+0000 7f8807400640 1 -- 172.21.15.72:0/3612431816 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87fc007c40 con 0x7f87f0003a00 2024-04-04T06:57:34.249 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:34.249+0000 7f8807400640 1 -- 172.21.15.72:0/3612431816 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87fc030070 con 0x7f87f0003a00 2024-04-04T06:57:34.249 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:34.249+0000 7f8807400640 1 -- 172.21.15.72:0/3612431816 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87fc005d70 con 0x7f87f0003a00 2024-04-04T06:57:34.249 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:34.249+0000 7f880fa00640 1 -- 172.21.15.72:0/3612431816 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f87f0003a00 msgr2=0x7f87f0003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:34.249 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:34.249+0000 7f880fa00640 1 --2- 172.21.15.72:0/3612431816 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f87f0003a00 0x7f87f0003e20 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f87fc00c110 tx=0x7f87f0005830 comp rx=0 tx=0).stop 2024-04-04T06:57:34.249 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:34.250+0000 7f880fa00640 1 -- 172.21.15.72:0/3612431816 shutdown_connections 2024-04-04T06:57:34.249 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:34.250+0000 7f880fa00640 1 --2- 172.21.15.72:0/3612431816 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f87f0003a00 0x7f87f0003e20 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:34.249 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:34.250+0000 7f880fa00640 1 -- 172.21.15.72:0/3612431816 >> 172.21.15.72:0/3612431816 conn(0x7f88080b3c80 msgr2=0x7f88080b4090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:34.249 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:34.250+0000 7f880fa00640 1 -- 172.21.15.72:0/3612431816 shutdown_connections 2024-04-04T06:57:34.250 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:34.250+0000 7f880fa00640 1 -- 172.21.15.72:0/3612431816 wait complete. 2024-04-04T06:57:34.250 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:34.251+0000 7f880fa00640 1 Processor -- start 2024-04-04T06:57:34.250 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:34.252+0000 7f880fa00640 1 -- start start 2024-04-04T06:57:34.251 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:34.252+0000 7f880fa00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f87f0003a00 0x7f88081f8840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:34.251 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:34.253+0000 7f880fa00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f88081e7ff0 0x7f8808149380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:34.252 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:34.253+0000 7f880fa00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8808149cf0 0x7f880815c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:34.252 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:34.253+0000 7f880fa00640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f88081623d0 con 0x7f88081e7ff0 2024-04-04T06:57:34.252 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:34.253+0000 7f880fa00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f880806b920 con 0x7f87f0003a00 2024-04-04T06:57:34.252 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:34.253+0000 7f880fa00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f880815e920 con 0x7f8808149cf0 2024-04-04T06:57:34.252 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:34.253+0000 7f8807e00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f88081e7ff0 0x7f8808149380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:34.252 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:34.253+0000 7f8807e00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f88081e7ff0 0x7f8808149380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:38798/0 (socket says 172.21.15.72:38798) 2024-04-04T06:57:34.252 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:34.253+0000 7f8807e00640 1 -- 172.21.15.72:0/4229368167 learned_addr learned my addr 172.21.15.72:0/4229368167 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:57:34.253 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:34.253+0000 7f8807e00640 1 -- 172.21.15.72:0/4229368167 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8808149cf0 msgr2=0x7f880815c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:34.253 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:34.253+0000 7f8807e00640 1 --2- 172.21.15.72:0/4229368167 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8808149cf0 0x7f880815c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:34.253 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:34.253+0000 7f8807e00640 1 -- 172.21.15.72:0/4229368167 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f87f0003a00 msgr2=0x7f88081f8840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:34.253 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:34.253+0000 7f8807e00640 1 --2- 172.21.15.72:0/4229368167 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f87f0003a00 0x7f88081f8840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:34.253 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:34.253+0000 7f8807e00640 1 -- 172.21.15.72:0/4229368167 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f880814bd10 con 0x7f88081e7ff0 2024-04-04T06:57:34.254 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:34.254+0000 7f8807e00640 1 --2- 172.21.15.72:0/4229368167 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f88081e7ff0 0x7f8808149380 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f87f400d800 tx=0x7f87f400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:34.254 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:34.254+0000 7f8804c00640 1 -- 172.21.15.72:0/4229368167 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87f400b6c0 con 0x7f88081e7ff0 2024-04-04T06:57:34.254 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:34.254+0000 7f8804c00640 1 -- 172.21.15.72:0/4229368167 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87f4019070 con 0x7f88081e7ff0 2024-04-04T06:57:34.254 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:34.254+0000 7f8804c00640 1 -- 172.21.15.72:0/4229368167 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87f400baa0 con 0x7f88081e7ff0 2024-04-04T06:57:34.254 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:34.254+0000 7f880fa00640 1 -- 172.21.15.72:0/4229368167 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88080ca520 con 0x7f88081e7ff0 2024-04-04T06:57:34.254 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:34.254+0000 7f880fa00640 1 -- 172.21.15.72:0/4229368167 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88081e87b0 con 0x7f88081e7ff0 2024-04-04T06:57:34.254 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:34.255+0000 7f880fa00640 1 -- 172.21.15.72:0/4229368167 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8808075730 con 0x7f88081e7ff0 2024-04-04T06:57:34.255 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:34.256+0000 7f8804c00640 1 -- 172.21.15.72:0/4229368167 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f87f400bc40 con 0x7f88081e7ff0 2024-04-04T06:57:34.256 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:34.257+0000 7f8804c00640 1 --2- 172.21.15.72:0/4229368167 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f87e806c920 0x7f87e806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:34.256 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:34.257+0000 7f8804c00640 1 -- 172.21.15.72:0/4229368167 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f87f408bed0 con 0x7f88081e7ff0 2024-04-04T06:57:34.256 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:34.257+0000 7f880d000640 1 --2- 172.21.15.72:0/4229368167 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f87e806c920 0x7f87e806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:34.256 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:34.258+0000 7f880d000640 1 --2- 172.21.15.72:0/4229368167 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f87e806c920 0x7f87e806ede0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f87fc034000 tx=0x7f87fc007000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:34.261 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:34.262+0000 7f8804c00640 1 -- 172.21.15.72:0/4229368167 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f87f405a310 con 0x7f88081e7ff0 2024-04-04T06:57:34.534 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:34.535+0000 7f880fa00640 1 -- 172.21.15.72:0/4229368167 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f880806d370 con 0x7f88081e7ff0 2024-04-04T06:57:34.534 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:34.536+0000 7f8804c00640 1 -- 172.21.15.72:0/4229368167 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) ==== 93+0+10 (secure 0 0 0) 0x7f87f4059c10 con 0x7f88081e7ff0 2024-04-04T06:57:34.534 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 1 2024-04-04T06:57:34.537 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:34.538+0000 7f880fa00640 1 -- 172.21.15.72:0/4229368167 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f87e806c920 msgr2=0x7f87e806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:34.537 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:34.538+0000 7f880fa00640 1 --2- 172.21.15.72:0/4229368167 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f87e806c920 0x7f87e806ede0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f87fc034000 tx=0x7f87fc007000 comp rx=0 tx=0).stop 2024-04-04T06:57:34.537 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:34.538+0000 7f880fa00640 1 -- 172.21.15.72:0/4229368167 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f88081e7ff0 msgr2=0x7f8808149380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:34.537 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:34.538+0000 7f880fa00640 1 --2- 172.21.15.72:0/4229368167 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f88081e7ff0 0x7f8808149380 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f87f400d800 tx=0x7f87f400dcc0 comp rx=0 tx=0).stop 2024-04-04T06:57:34.537 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:34.538+0000 7f880fa00640 1 -- 172.21.15.72:0/4229368167 shutdown_connections 2024-04-04T06:57:34.537 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:34.538+0000 7f880fa00640 1 --2- 172.21.15.72:0/4229368167 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f87e806c920 0x7f87e806ede0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:34.537 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:34.538+0000 7f880fa00640 1 --2- 172.21.15.72:0/4229368167 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8808149cf0 0x7f880815c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:34.537 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:34.538+0000 7f880fa00640 1 --2- 172.21.15.72:0/4229368167 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f88081e7ff0 0x7f8808149380 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:34.538 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:34.538+0000 7f880fa00640 1 --2- 172.21.15.72:0/4229368167 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f87f0003a00 0x7f88081f8840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:34.538 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:34.538+0000 7f880fa00640 1 -- 172.21.15.72:0/4229368167 >> 172.21.15.72:0/4229368167 conn(0x7f88080b3c80 msgr2=0x7f88080cd990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:34.538 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:34.538+0000 7f880fa00640 1 -- 172.21.15.72:0/4229368167 shutdown_connections 2024-04-04T06:57:34.538 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:34.538+0000 7f880fa00640 1 -- 172.21.15.72:0/4229368167 wait complete. 2024-04-04T06:57:34.556 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-04T06:57:34.759 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:34.760+0000 7ffa81600640 1 Processor -- start 2024-04-04T06:57:34.759 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:34.760+0000 7ffa81600640 1 -- start start 2024-04-04T06:57:34.760 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:34.762+0000 7ffa81600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffa7c1418f0 0x7ffa7c0d0140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:34.761 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:34.762+0000 7ffa81600640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffa7c160b40 con 0x7ffa7c1423e0 2024-04-04T06:57:34.761 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:34.762+0000 7ffa81600640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffa7c15ffc0 con 0x7ffa7c0d0680 2024-04-04T06:57:34.761 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:34.762+0000 7ffa81600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7ffa7c0d0ae0 con 0x7ffa7c1418f0 2024-04-04T06:57:34.761 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:34.762+0000 7ffa80c00640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7ffa7c1423e0 0x7ffa7c15c9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:52290/0 (socket says 172.21.15.72:52290) 2024-04-04T06:57:34.761 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:34.762+0000 7ffa80c00640 1 -- 172.21.15.72:0/1009691630 learned_addr learned my addr 172.21.15.72:0/1009691630 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-04-04T06:57:34.763 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:34.763+0000 7ffa7be00640 1 --2- 172.21.15.72:0/1009691630 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffa7c1418f0 0x7ffa7c0d0140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:34.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:34.763+0000 7ffa7b400640 1 -- 172.21.15.72:0/1009691630 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1152453348 0 0) 0x7ffa7c160b40 con 0x7ffa7c1423e0 2024-04-04T06:57:34.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:34.763+0000 7ffa7b400640 1 -- 172.21.15.72:0/1009691630 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffa60003520 con 0x7ffa7c1423e0 2024-04-04T06:57:34.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:34.763+0000 7ffa7b400640 1 -- 172.21.15.72:0/1009691630 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2006074440 0 0) 0x7ffa60003520 con 0x7ffa7c1423e0 2024-04-04T06:57:34.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:34.763+0000 7ffa7b400640 1 -- 172.21.15.72:0/1009691630 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffa7c1418f0 msgr2=0x7ffa7c0d0140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:57:34.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:34.763+0000 7ffa7b400640 1 --2- 172.21.15.72:0/1009691630 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffa7c1418f0 0x7ffa7c0d0140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:34.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:34.763+0000 7ffa7b400640 1 -- 172.21.15.72:0/1009691630 >> v1:172.21.15.117:6789/0 conn(0x7ffa7c0d0680 legacy=0x7ffa7c141cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:34.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:34.763+0000 7ffa7b400640 1 -- 172.21.15.72:0/1009691630 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa7c1602a0 con 0x7ffa7c1423e0 2024-04-04T06:57:34.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:34.763+0000 7ffa7b400640 1 -- 172.21.15.72:0/1009691630 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2465650867 0 0) 0x7ffa740019f0 con 0x7ffa7c1423e0 2024-04-04T06:57:34.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:34.763+0000 7ffa7b400640 1 -- 172.21.15.72:0/1009691630 >> v1:172.21.15.72:6789/0 conn(0x7ffa7c1423e0 legacy=0x7ffa7c15c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:34.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:34.763+0000 7ffa7b400640 1 --2- 172.21.15.72:0/1009691630 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffa7c1418f0 0x7ffa600039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:34.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:34.763+0000 7ffa7b400640 1 --2- 172.21.15.72:0/1009691630 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffa60003f20 0x7ffa60004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:34.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:34.763+0000 7ffa7b400640 1 --2- 172.21.15.72:0/1009691630 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffa60004d40 0x7ffa600051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:34.765 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:34.763+0000 7ffa7b400640 1 -- 172.21.15.72:0/1009691630 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7ffa6000b9f0 con 0x7ffa60004d40 2024-04-04T06:57:34.765 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:34.763+0000 7ffa7b400640 1 -- 172.21.15.72:0/1009691630 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7ffa6000bba0 con 0x7ffa60003f20 2024-04-04T06:57:34.765 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:34.763+0000 7ffa7b400640 1 -- 172.21.15.72:0/1009691630 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7ffa6000bda0 con 0x7ffa7c1418f0 2024-04-04T06:57:34.765 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:34.764+0000 7ffa80c00640 1 --2- 172.21.15.72:0/1009691630 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffa60004d40 0x7ffa600051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:34.765 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:34.764+0000 7ffa73e00640 1 --2- 172.21.15.72:0/1009691630 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffa60003f20 0x7ffa60004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:34.765 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:34.764+0000 7ffa7be00640 1 --2- 172.21.15.72:0/1009691630 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffa7c1418f0 0x7ffa600039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:34.765 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:34.764+0000 7ffa80c00640 1 -- 172.21.15.72:0/1009691630 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffa7c1418f0 msgr2=0x7ffa600039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:57:34.765 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:34.764+0000 7ffa80c00640 1 --2- 172.21.15.72:0/1009691630 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffa7c1418f0 0x7ffa600039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:34.765 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:34.764+0000 7ffa80c00640 1 -- 172.21.15.72:0/1009691630 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffa60003f20 msgr2=0x7ffa60004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:57:34.765 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:34.764+0000 7ffa80c00640 1 --2- 172.21.15.72:0/1009691630 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffa60003f20 0x7ffa60004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:34.765 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:34.764+0000 7ffa80c00640 1 -- 172.21.15.72:0/1009691630 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa60003520 con 0x7ffa60004d40 2024-04-04T06:57:34.765 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:34.764+0000 7ffa7be00640 1 --2- 172.21.15.72:0/1009691630 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffa7c1418f0 0x7ffa600039e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-04T06:57:34.767 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:34.765+0000 7ffa80c00640 1 --2- 172.21.15.72:0/1009691630 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffa60004d40 0x7ffa600051c0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7ffa7400a860 tx=0x7ffa60005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac22acc2006ff3d6 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:34.767 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:34.766+0000 7ffa7b400640 1 -- 172.21.15.72:0/1009691630 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa7400a480 con 0x7ffa60004d40 2024-04-04T06:57:34.767 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:34.766+0000 7ffa7b400640 1 -- 172.21.15.72:0/1009691630 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa74034630 con 0x7ffa60004d40 2024-04-04T06:57:34.767 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:34.766+0000 7ffa7b400640 1 -- 172.21.15.72:0/1009691630 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa74034aa0 con 0x7ffa60004d40 2024-04-04T06:57:34.767 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:34.766+0000 7ffa81600640 1 -- 172.21.15.72:0/1009691630 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffa60004d40 msgr2=0x7ffa600051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:34.767 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:34.766+0000 7ffa81600640 1 --2- 172.21.15.72:0/1009691630 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffa60004d40 0x7ffa600051c0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7ffa7400a860 tx=0x7ffa60005830 comp rx=0 tx=0).stop 2024-04-04T06:57:34.767 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:34.766+0000 7ffa80c00640 1 -- 172.21.15.72:0/1009691630 reap_dead start 2024-04-04T06:57:34.767 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:34.766+0000 7ffa81600640 1 -- 172.21.15.72:0/1009691630 shutdown_connections 2024-04-04T06:57:34.767 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:34.766+0000 7ffa81600640 1 -- 172.21.15.72:0/1009691630 >> 172.21.15.72:0/1009691630 conn(0x7ffa7c06b890 msgr2=0x7ffa7c06bca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:34.767 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:34.766+0000 7ffa81600640 1 -- 172.21.15.72:0/1009691630 shutdown_connections 2024-04-04T06:57:34.767 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:34.766+0000 7ffa81600640 1 -- 172.21.15.72:0/1009691630 wait complete. 2024-04-04T06:57:34.768 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:34.768+0000 7ffa81600640 1 Processor -- start 2024-04-04T06:57:34.768 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:34.768+0000 7ffa81600640 1 -- start start 2024-04-04T06:57:34.769 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:34.769+0000 7ffa81600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffa7c15b350 0x7ffa7c0b0ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:34.769 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:34.769+0000 7ffa81600640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffa7c0b11e0 0x7ffa7c0b3520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:34.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:34.769+0000 7ffa81600640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffa7c15b730 0x7ffa7c0b3a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:34.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:34.769+0000 7ffa81600640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7ffa7c0cc9c0 con 0x7ffa7c15b730 2024-04-04T06:57:34.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:34.769+0000 7ffa81600640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7ffa7c160860 con 0x7ffa7c0b11e0 2024-04-04T06:57:34.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:34.769+0000 7ffa81600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7ffa7c15fc00 con 0x7ffa7c15b350 2024-04-04T06:57:34.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:34.769+0000 7ffa80c00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffa7c15b730 0x7ffa7c0b3a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:34.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:34.770+0000 7ffa80c00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffa7c15b730 0x7ffa7c0b3a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:38818/0 (socket says 172.21.15.72:38818) 2024-04-04T06:57:34.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:34.770+0000 7ffa80c00640 1 -- 172.21.15.72:0/3269886780 learned_addr learned my addr 172.21.15.72:0/3269886780 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:57:34.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:34.770+0000 7ffa7be00640 1 --2- 172.21.15.72:0/3269886780 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffa7c15b350 0x7ffa7c0b0ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:34.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:34.770+0000 7ffa73e00640 1 --2- 172.21.15.72:0/3269886780 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffa7c0b11e0 0x7ffa7c0b3520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:34.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:34.770+0000 7ffa80c00640 1 -- 172.21.15.72:0/3269886780 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffa7c15b350 msgr2=0x7ffa7c0b0ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:34.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:34.770+0000 7ffa80c00640 1 --2- 172.21.15.72:0/3269886780 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffa7c15b350 0x7ffa7c0b0ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:34.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:34.770+0000 7ffa80c00640 1 -- 172.21.15.72:0/3269886780 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffa7c0b11e0 msgr2=0x7ffa7c0b3520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:34.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:34.770+0000 7ffa80c00640 1 --2- 172.21.15.72:0/3269886780 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffa7c0b11e0 0x7ffa7c0b3520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:34.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:34.770+0000 7ffa80c00640 1 -- 172.21.15.72:0/3269886780 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa7c1f8360 con 0x7ffa7c15b730 2024-04-04T06:57:34.771 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:34.770+0000 7ffa80c00640 1 --2- 172.21.15.72:0/3269886780 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffa7c15b730 0x7ffa7c0b3a60 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7ffa7400a980 tx=0x7ffa7c160470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:34.771 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:34.771+0000 7ffa78c00640 1 -- 172.21.15.72:0/3269886780 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa7400a480 con 0x7ffa7c15b730 2024-04-04T06:57:34.771 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:34.771+0000 7ffa78c00640 1 -- 172.21.15.72:0/3269886780 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa74045070 con 0x7ffa7c15b730 2024-04-04T06:57:34.771 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:34.771+0000 7ffa78c00640 1 -- 172.21.15.72:0/3269886780 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa74001fd0 con 0x7ffa7c15b730 2024-04-04T06:57:34.771 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:34.771+0000 7ffa81600640 1 -- 172.21.15.72:0/3269886780 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa7c0afee0 con 0x7ffa7c15b730 2024-04-04T06:57:34.771 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:34.771+0000 7ffa81600640 1 -- 172.21.15.72:0/3269886780 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa7c0b04a0 con 0x7ffa7c15b730 2024-04-04T06:57:34.771 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:34.772+0000 7ffa81600640 1 -- 172.21.15.72:0/3269886780 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa7c0756c0 con 0x7ffa7c15b730 2024-04-04T06:57:34.771 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:34.773+0000 7ffa78c00640 1 -- 172.21.15.72:0/3269886780 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ffa74034bf0 con 0x7ffa7c15b730 2024-04-04T06:57:34.773 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:34.774+0000 7ffa78c00640 1 --2- 172.21.15.72:0/3269886780 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7ffa5806c8f0 0x7ffa5806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:34.773 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:34.774+0000 7ffa78c00640 1 -- 172.21.15.72:0/3269886780 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7ffa740ade60 con 0x7ffa7c15b730 2024-04-04T06:57:34.773 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:34.774+0000 7ffa7be00640 1 --2- 172.21.15.72:0/3269886780 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7ffa5806c8f0 0x7ffa5806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:34.773 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:34.775+0000 7ffa7be00640 1 --2- 172.21.15.72:0/3269886780 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7ffa5806c8f0 0x7ffa5806edb0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7ffa6c009aa0 tx=0x7ffa6c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:34.778 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:34.779+0000 7ffa78c00640 1 -- 172.21.15.72:0/3269886780 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7ffa7407c290 con 0x7ffa7c15b730 2024-04-04T06:57:34.976 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:34.977+0000 7ffa81600640 1 -- 172.21.15.72:0/3269886780 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7ffa7c06f250 con 0x7ffa7c15b730 2024-04-04T06:57:34.977 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:34.978+0000 7ffa78c00640 1 -- 172.21.15.72:0/3269886780 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) ==== 104+0+11 (secure 0 0 0) 0x7ffa7407bb90 con 0x7ffa7c15b730 2024-04-04T06:57:34.977 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2024-04-04T06:57:34.983 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:34.981+0000 7ffa81600640 1 -- 172.21.15.72:0/3269886780 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7ffa5806c8f0 msgr2=0x7ffa5806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:34.983 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:34.981+0000 7ffa81600640 1 --2- 172.21.15.72:0/3269886780 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7ffa5806c8f0 0x7ffa5806edb0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7ffa6c009aa0 tx=0x7ffa6c008040 comp rx=0 tx=0).stop 2024-04-04T06:57:34.983 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:34.981+0000 7ffa81600640 1 -- 172.21.15.72:0/3269886780 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffa7c15b730 msgr2=0x7ffa7c0b3a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:34.983 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:34.981+0000 7ffa81600640 1 --2- 172.21.15.72:0/3269886780 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffa7c15b730 0x7ffa7c0b3a60 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7ffa7400a980 tx=0x7ffa7c160470 comp rx=0 tx=0).stop 2024-04-04T06:57:34.983 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:34.981+0000 7ffa81600640 1 -- 172.21.15.72:0/3269886780 shutdown_connections 2024-04-04T06:57:34.983 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:34.981+0000 7ffa81600640 1 --2- 172.21.15.72:0/3269886780 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7ffa5806c8f0 0x7ffa5806edb0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:34.983 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:34.981+0000 7ffa81600640 1 --2- 172.21.15.72:0/3269886780 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffa7c15b730 0x7ffa7c0b3a60 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:34.983 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:34.981+0000 7ffa81600640 1 --2- 172.21.15.72:0/3269886780 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffa7c0b11e0 0x7ffa7c0b3520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:34.983 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:34.981+0000 7ffa81600640 1 --2- 172.21.15.72:0/3269886780 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffa7c15b350 0x7ffa7c0b0ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:34.984 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:34.981+0000 7ffa81600640 1 -- 172.21.15.72:0/3269886780 >> 172.21.15.72:0/3269886780 conn(0x7ffa7c06b890 msgr2=0x7ffa7c072330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:34.984 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:34.981+0000 7ffa81600640 1 -- 172.21.15.72:0/3269886780 shutdown_connections 2024-04-04T06:57:34.984 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:34.981+0000 7ffa81600640 1 -- 172.21.15.72:0/3269886780 wait complete. 2024-04-04T06:57:34.998 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-04T06:57:35.203 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:35.204+0000 7fafdc000640 1 Processor -- start 2024-04-04T06:57:35.203 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:35.204+0000 7fafdc000640 1 -- start start 2024-04-04T06:57:35.209 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:35.207+0000 7fafdc000640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fafd4145b10 0x7fafd406d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:35.209 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:35.207+0000 7fafdc000640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fafd406dac0 0x7fafd40cfa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:35.210 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:35.207+0000 7fafdc000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fafd40cff40 0x7fafd40d0340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:35.210 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:35.207+0000 7fafdc000640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7fafd40cea10 con 0x7fafd406dac0 2024-04-04T06:57:35.210 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:35.207+0000 7fafdc000640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fafd406e310 con 0x7fafd4145b10 2024-04-04T06:57:35.210 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:35.207+0000 7fafdc000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fafd4145ef0 con 0x7fafd40cff40 2024-04-04T06:57:35.210 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:35.207+0000 7fafd8c00640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fafd406dac0 0x7fafd40cfa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:35.211 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:35.207+0000 7fafd8c00640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fafd406dac0 0x7fafd40cfa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:38826/0 (socket says 172.21.15.72:38826) 2024-04-04T06:57:35.211 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:35.207+0000 7fafd8c00640 1 -- 172.21.15.72:0/772000283 learned_addr learned my addr 172.21.15.72:0/772000283 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:57:35.211 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:35.208+0000 7fafd9600640 1 --2- 172.21.15.72:0/772000283 >> v2:172.21.15.117:3300/0 conn(0x7fafd4145b10 0x7fafd406d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:35.211 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:35.208+0000 7fafda000640 1 --2- 172.21.15.72:0/772000283 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fafd40cff40 0x7fafd40d0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:35.211 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:35.208+0000 7fafd8c00640 1 -- 172.21.15.72:0/772000283 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fafd40cff40 msgr2=0x7fafd40d0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:57:35.211 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:35.208+0000 7fafd8c00640 1 --2- 172.21.15.72:0/772000283 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fafd40cff40 0x7fafd40d0340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:35.211 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:35.208+0000 7fafd8c00640 1 -- 172.21.15.72:0/772000283 >> v2:172.21.15.117:3300/0 conn(0x7fafd4145b10 msgr2=0x7fafd406d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:57:35.211 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:35.208+0000 7fafd8c00640 1 --2- 172.21.15.72:0/772000283 >> v2:172.21.15.117:3300/0 conn(0x7fafd4145b10 0x7fafd406d580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:35.212 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:35.208+0000 7fafd8c00640 1 -- 172.21.15.72:0/772000283 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafd40cec40 con 0x7fafd406dac0 2024-04-04T06:57:35.212 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:35.209+0000 7fafd8c00640 1 --2- 172.21.15.72:0/772000283 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fafd406dac0 0x7fafd40cfa00 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fafd406c350 tx=0x7fafc002b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2de5c8ea5a3cc5aa server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:35.212 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:35.209+0000 7fafd3e00640 1 -- 172.21.15.72:0/772000283 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafc002e070 con 0x7fafd406dac0 2024-04-04T06:57:35.212 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:35.209+0000 7fafd3e00640 1 -- 172.21.15.72:0/772000283 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fafc0037070 con 0x7fafd406dac0 2024-04-04T06:57:35.213 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:35.209+0000 7fafd3e00640 1 -- 172.21.15.72:0/772000283 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafc0031a00 con 0x7fafd406dac0 2024-04-04T06:57:35.213 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:35.210+0000 7fafdc000640 1 -- 172.21.15.72:0/772000283 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fafd406dac0 msgr2=0x7fafd40cfa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:35.213 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:35.210+0000 7fafdc000640 1 --2- 172.21.15.72:0/772000283 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fafd406dac0 0x7fafd40cfa00 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fafd406c350 tx=0x7fafc002b880 comp rx=0 tx=0).stop 2024-04-04T06:57:35.213 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:35.210+0000 7fafdc000640 1 -- 172.21.15.72:0/772000283 shutdown_connections 2024-04-04T06:57:35.213 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:35.210+0000 7fafdc000640 1 --2- 172.21.15.72:0/772000283 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fafd40cff40 0x7fafd40d0340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:35.214 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:35.210+0000 7fafdc000640 1 --2- 172.21.15.72:0/772000283 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fafd406dac0 0x7fafd40cfa00 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:35.214 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:35.210+0000 7fafdc000640 1 --2- 172.21.15.72:0/772000283 >> v2:172.21.15.117:3300/0 conn(0x7fafd4145b10 0x7fafd406d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:35.214 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:35.210+0000 7fafdc000640 1 -- 172.21.15.72:0/772000283 >> 172.21.15.72:0/772000283 conn(0x7fafd406b470 msgr2=0x7fafd406b850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:35.214 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:35.210+0000 7fafdc000640 1 -- 172.21.15.72:0/772000283 shutdown_connections 2024-04-04T06:57:35.214 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:35.210+0000 7fafdc000640 1 -- 172.21.15.72:0/772000283 wait complete. 2024-04-04T06:57:35.221 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:35.212+0000 7fafdc000640 1 Processor -- start 2024-04-04T06:57:35.221 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:35.212+0000 7fafdc000640 1 -- start start 2024-04-04T06:57:35.221 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:35.213+0000 7fafdc000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fafd406dac0 0x7fafd40c5890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:35.222 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:35.213+0000 7fafdc000640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fafd40cff40 0x7fafd415ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:35.222 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:35.213+0000 7fafdc000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fafd4145b10 0x7fafd41361b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:35.222 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:35.213+0000 7fafdc000640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fafd40cf4e0 con 0x7fafd40cff40 2024-04-04T06:57:35.222 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:35.213+0000 7fafdc000640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fafd40cf200 con 0x7fafd406dac0 2024-04-04T06:57:35.222 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:35.213+0000 7fafdc000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fafd406df70 con 0x7fafd4145b10 2024-04-04T06:57:35.223 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:35.213+0000 7fafd8c00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fafd40cff40 0x7fafd415ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:35.223 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:35.213+0000 7fafd8c00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fafd40cff40 0x7fafd415ba20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:38828/0 (socket says 172.21.15.72:38828) 2024-04-04T06:57:35.223 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:35.213+0000 7fafd8c00640 1 -- 172.21.15.72:0/2752289303 learned_addr learned my addr 172.21.15.72:0/2752289303 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:57:35.223 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:35.213+0000 7fafd8c00640 1 -- 172.21.15.72:0/2752289303 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fafd4145b10 msgr2=0x7fafd41361b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:35.223 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:35.213+0000 7fafd8c00640 1 --2- 172.21.15.72:0/2752289303 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fafd4145b10 0x7fafd41361b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:35.223 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:35.213+0000 7fafd8c00640 1 -- 172.21.15.72:0/2752289303 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fafd406dac0 msgr2=0x7fafd40c5890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:35.223 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:35.213+0000 7fafd9600640 1 --2- 172.21.15.72:0/2752289303 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fafd406dac0 0x7fafd40c5890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:35.224 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:35.213+0000 7fafd8c00640 1 --2- 172.21.15.72:0/2752289303 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fafd406dac0 0x7fafd40c5890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:35.224 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:35.213+0000 7fafd8c00640 1 -- 172.21.15.72:0/2752289303 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafd40b0b10 con 0x7fafd40cff40 2024-04-04T06:57:35.224 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:35.213+0000 7fafd9600640 1 --2- 172.21.15.72:0/2752289303 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fafd406dac0 0x7fafd40c5890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-04T06:57:35.224 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:35.214+0000 7fafd8c00640 1 --2- 172.21.15.72:0/2752289303 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fafd40cff40 0x7fafd415ba20 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fafc002b8c0 tx=0x7fafc00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:35.224 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:35.214+0000 7fafd1600640 1 -- 172.21.15.72:0/2752289303 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafc0032880 con 0x7fafd40cff40 2024-04-04T06:57:35.224 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:35.214+0000 7fafd1600640 1 -- 172.21.15.72:0/2752289303 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fafc0032a40 con 0x7fafd40cff40 2024-04-04T06:57:35.224 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:35.214+0000 7fafdc000640 1 -- 172.21.15.72:0/2752289303 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fafd40b0de0 con 0x7fafd40cff40 2024-04-04T06:57:35.224 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:35.214+0000 7fafd1600640 1 -- 172.21.15.72:0/2752289303 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafc0032e30 con 0x7fafd40cff40 2024-04-04T06:57:35.225 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:35.214+0000 7fafdc000640 1 -- 172.21.15.72:0/2752289303 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fafd40b13a0 con 0x7fafd40cff40 2024-04-04T06:57:35.225 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:35.216+0000 7fafdc000640 1 -- 172.21.15.72:0/2752289303 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fafd4075730 con 0x7fafd40cff40 2024-04-04T06:57:35.225 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:35.216+0000 7fafd1600640 1 -- 172.21.15.72:0/2752289303 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fafc004c060 con 0x7fafd40cff40 2024-04-04T06:57:35.225 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:35.217+0000 7fafd1600640 1 --2- 172.21.15.72:0/2752289303 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fafb406c8f0 0x7fafb406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:35.225 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:35.217+0000 7fafd1600640 1 -- 172.21.15.72:0/2752289303 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7fafc00ad870 con 0x7fafd40cff40 2024-04-04T06:57:35.225 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:35.217+0000 7fafd9600640 1 --2- 172.21.15.72:0/2752289303 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fafb406c8f0 0x7fafb406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:35.225 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:35.218+0000 7fafd9600640 1 --2- 172.21.15.72:0/2752289303 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fafb406c8f0 0x7fafb406edb0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fafc8006fd0 tx=0x7fafc8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:35.226 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:35.221+0000 7fafd1600640 1 -- 172.21.15.72:0/2752289303 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fafc0040070 con 0x7fafd40cff40 2024-04-04T06:57:35.422 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:35.424+0000 7fafdc000640 1 -- 172.21.15.72:0/2752289303 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fafd40d0c00 con 0x7fafd40cff40 2024-04-04T06:57:35.423 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:35.424+0000 7fafd1600640 1 -- 172.21.15.72:0/2752289303 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) ==== 100+0+11 (secure 0 0 0) 0x7fafc007bd30 con 0x7fafd40cff40 2024-04-04T06:57:35.423 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 64 2024-04-04T06:57:35.426 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:35.427+0000 7fafdc000640 1 -- 172.21.15.72:0/2752289303 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fafb406c8f0 msgr2=0x7fafb406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:35.426 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:35.427+0000 7fafdc000640 1 --2- 172.21.15.72:0/2752289303 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fafb406c8f0 0x7fafb406edb0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fafc8006fd0 tx=0x7fafc8008040 comp rx=0 tx=0).stop 2024-04-04T06:57:35.426 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:35.427+0000 7fafdc000640 1 -- 172.21.15.72:0/2752289303 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fafd40cff40 msgr2=0x7fafd415ba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:35.426 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:35.427+0000 7fafdc000640 1 --2- 172.21.15.72:0/2752289303 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fafd40cff40 0x7fafd415ba20 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fafc002b8c0 tx=0x7fafc00046c0 comp rx=0 tx=0).stop 2024-04-04T06:57:35.426 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:35.427+0000 7fafdc000640 1 -- 172.21.15.72:0/2752289303 shutdown_connections 2024-04-04T06:57:35.426 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:35.427+0000 7fafdc000640 1 --2- 172.21.15.72:0/2752289303 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fafb406c8f0 0x7fafb406edb0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:35.426 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:35.427+0000 7fafdc000640 1 --2- 172.21.15.72:0/2752289303 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fafd4145b10 0x7fafd41361b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:35.426 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:35.427+0000 7fafdc000640 1 --2- 172.21.15.72:0/2752289303 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fafd40cff40 0x7fafd415ba20 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:35.427 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:35.427+0000 7fafdc000640 1 --2- 172.21.15.72:0/2752289303 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fafd406dac0 0x7fafd40c5890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:35.427 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:35.427+0000 7fafdc000640 1 -- 172.21.15.72:0/2752289303 >> 172.21.15.72:0/2752289303 conn(0x7fafd406b470 msgr2=0x7fafd415e070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:35.427 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:35.427+0000 7fafdc000640 1 -- 172.21.15.72:0/2752289303 shutdown_connections 2024-04-04T06:57:35.427 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:35.427+0000 7fafdc000640 1 -- 172.21.15.72:0/2752289303 wait complete. 2024-04-04T06:57:35.447 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-04T06:57:35.655 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:35.656+0000 7f833d000640 1 Processor -- start 2024-04-04T06:57:35.655 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:35.656+0000 7f833d000640 1 -- start start 2024-04-04T06:57:35.656 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:35.657+0000 7f833d000640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f833815e5a0 0x7f83380b75c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:35.656 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:35.657+0000 7f833d000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f83380d3540 0x7f83380d08e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:35.656 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:35.657+0000 7f833d000640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83380cf7f0 con 0x7f83380b7b00 2024-04-04T06:57:35.656 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:35.657+0000 7f833d000640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f83380cfad0 con 0x7f833815e5a0 2024-04-04T06:57:35.656 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:35.657+0000 7f833d000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f83380d2350 con 0x7f83380d3540 2024-04-04T06:57:35.656 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:35.658+0000 7f8336a00640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f83380b7b00 0x7f83380d2e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:52300/0 (socket says 172.21.15.72:52300) 2024-04-04T06:57:35.656 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:35.658+0000 7f8336a00640 1 -- 172.21.15.72:0/4165427169 learned_addr learned my addr 172.21.15.72:0/4165427169 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-04-04T06:57:35.658 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:35.658+0000 7f8337e00640 1 --2- 172.21.15.72:0/4165427169 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f83380d3540 0x7f83380d08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:35.658 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:35.658+0000 7f8337400640 1 --2- 172.21.15.72:0/4165427169 >> v2:172.21.15.117:3300/0 conn(0x7f833815e5a0 0x7f83380b75c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:35.658 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:35.658+0000 7f8336000640 1 -- 172.21.15.72:0/4165427169 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 246884034 0 0) 0x7f83380cf7f0 con 0x7f83380b7b00 2024-04-04T06:57:35.658 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:35.658+0000 7f8336000640 1 -- 172.21.15.72:0/4165427169 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f831c003520 con 0x7f83380b7b00 2024-04-04T06:57:35.659 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:35.659+0000 7f8336000640 1 -- 172.21.15.72:0/4165427169 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 305162501 0 0) 0x7f831c003520 con 0x7f83380b7b00 2024-04-04T06:57:35.659 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:35.659+0000 7f8336000640 1 -- 172.21.15.72:0/4165427169 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f83380d3540 msgr2=0x7f83380d08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:57:35.659 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:35.659+0000 7f8336000640 1 --2- 172.21.15.72:0/4165427169 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f83380d3540 0x7f83380d08e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:35.659 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:35.659+0000 7f8336000640 1 -- 172.21.15.72:0/4165427169 >> v2:172.21.15.117:3300/0 conn(0x7f833815e5a0 msgr2=0x7f83380b75c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:57:35.659 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:35.659+0000 7f8336000640 1 --2- 172.21.15.72:0/4165427169 >> v2:172.21.15.117:3300/0 conn(0x7f833815e5a0 0x7f83380b75c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:35.659 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:35.659+0000 7f8336000640 1 -- 172.21.15.72:0/4165427169 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83380d2630 con 0x7f83380b7b00 2024-04-04T06:57:35.659 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:35.659+0000 7f8336000640 1 -- 172.21.15.72:0/4165427169 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2465650867 0 0) 0x7f8324001670 con 0x7f83380b7b00 2024-04-04T06:57:35.659 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:35.659+0000 7f8336000640 1 -- 172.21.15.72:0/4165427169 >> v1:172.21.15.72:6789/0 conn(0x7f83380b7b00 legacy=0x7f83380d2e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:35.659 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:35.659+0000 7f8336000640 1 --2- 172.21.15.72:0/4165427169 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f831c0039b0 0x7f831c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:35.659 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:35.659+0000 7f8336000640 1 --2- 172.21.15.72:0/4165427169 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f831c004800 0x7f831c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:35.659 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:35.659+0000 7f8336000640 1 --2- 172.21.15.72:0/4165427169 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f83380d3540 0x7f831c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:35.659 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:35.659+0000 7f8336000640 1 -- 172.21.15.72:0/4165427169 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f83380cfad0 con 0x7f831c004800 2024-04-04T06:57:35.659 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:35.659+0000 7f8336000640 1 -- 172.21.15.72:0/4165427169 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f83380d2350 con 0x7f831c0039b0 2024-04-04T06:57:35.660 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:35.659+0000 7f8336000640 1 -- 172.21.15.72:0/4165427169 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f831c00b9c0 con 0x7f83380d3540 2024-04-04T06:57:35.660 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:35.659+0000 7f8336a00640 1 --2- 172.21.15.72:0/4165427169 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f831c004800 0x7f831c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:35.660 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:35.659+0000 7f8337400640 1 --2- 172.21.15.72:0/4165427169 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f831c0039b0 0x7f831c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:35.660 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:35.659+0000 7f8337e00640 1 --2- 172.21.15.72:0/4165427169 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f83380d3540 0x7f831c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:35.660 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:35.660+0000 7f8336a00640 1 -- 172.21.15.72:0/4165427169 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f83380d3540 msgr2=0x7f831c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:57:35.660 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:35.660+0000 7f8336a00640 1 --2- 172.21.15.72:0/4165427169 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f83380d3540 0x7f831c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:35.660 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:35.660+0000 7f8336a00640 1 -- 172.21.15.72:0/4165427169 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f831c0039b0 msgr2=0x7f831c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:57:35.660 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:35.660+0000 7f8336a00640 1 --2- 172.21.15.72:0/4165427169 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f831c0039b0 0x7f831c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:35.660 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:35.660+0000 7f8336a00640 1 -- 172.21.15.72:0/4165427169 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f831c003520 con 0x7f831c004800 2024-04-04T06:57:35.661 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:35.661+0000 7f8336a00640 1 --2- 172.21.15.72:0/4165427169 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f831c004800 0x7f831c004c80 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f83380b7f20 tx=0x7f831c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd6146ae254cdb74 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:35.661 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:35.661+0000 7f8336000640 1 -- 172.21.15.72:0/4165427169 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8324007c80 con 0x7f831c004800 2024-04-04T06:57:35.661 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:35.661+0000 7f8336000640 1 -- 172.21.15.72:0/4165427169 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8324030070 con 0x7f831c004800 2024-04-04T06:57:35.661 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:35.661+0000 7f8336000640 1 -- 172.21.15.72:0/4165427169 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8324005cf0 con 0x7f831c004800 2024-04-04T06:57:35.662 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:35.662+0000 7f833d000640 1 -- 172.21.15.72:0/4165427169 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f831c004800 msgr2=0x7f831c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:35.662 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:35.662+0000 7f833d000640 1 --2- 172.21.15.72:0/4165427169 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f831c004800 0x7f831c004c80 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f83380b7f20 tx=0x7f831c005830 comp rx=0 tx=0).stop 2024-04-04T06:57:35.662 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:35.662+0000 7f8337e00640 1 -- 172.21.15.72:0/4165427169 reap_dead start 2024-04-04T06:57:35.662 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:35.662+0000 7f833d000640 1 -- 172.21.15.72:0/4165427169 shutdown_connections 2024-04-04T06:57:35.662 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:35.662+0000 7f833d000640 1 -- 172.21.15.72:0/4165427169 >> 172.21.15.72:0/4165427169 conn(0x7f833806b890 msgr2=0x7f833806bca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:35.662 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:35.662+0000 7f833d000640 1 -- 172.21.15.72:0/4165427169 shutdown_connections 2024-04-04T06:57:35.662 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:35.662+0000 7f833d000640 1 -- 172.21.15.72:0/4165427169 wait complete. 2024-04-04T06:57:35.664 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:35.664+0000 7f833d000640 1 Processor -- start 2024-04-04T06:57:35.664 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:35.664+0000 7f833d000640 1 -- start start 2024-04-04T06:57:35.665 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:35.665+0000 7f833d000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f831c004800 0x7f83381576f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:35.665 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:35.665+0000 7f833d000640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f83380b9260 0x7f83380b96e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:35.665 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:35.665+0000 7f833d000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f83381f4070 0x7f83381f4520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:35.665 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:35.665+0000 7f833d000640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f83380d08e0 con 0x7f83380b9260 2024-04-04T06:57:35.665 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:35.665+0000 7f833d000640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f833815e980 con 0x7f83381f4070 2024-04-04T06:57:35.665 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:35.665+0000 7f833d000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f83380d0a60 con 0x7f831c004800 2024-04-04T06:57:35.665 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:35.665+0000 7f8336a00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f83380b9260 0x7f83380b96e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:35.665 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:35.665+0000 7f8336a00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f83380b9260 0x7f83380b96e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:38834/0 (socket says 172.21.15.72:38834) 2024-04-04T06:57:35.665 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:35.665+0000 7f8336a00640 1 -- 172.21.15.72:0/1670979125 learned_addr learned my addr 172.21.15.72:0/1670979125 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:57:35.665 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:35.665+0000 7f8337400640 1 --2- 172.21.15.72:0/1670979125 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f831c004800 0x7f83381576f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:35.665 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:35.666+0000 7f8336a00640 1 -- 172.21.15.72:0/1670979125 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f831c004800 msgr2=0x7f83381576f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:35.665 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:35.666+0000 7f8336a00640 1 --2- 172.21.15.72:0/1670979125 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f831c004800 0x7f83381576f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:35.665 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:35.666+0000 7f8337e00640 1 --2- 172.21.15.72:0/1670979125 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f83381f4070 0x7f83381f4520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:35.665 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:35.666+0000 7f8336a00640 1 -- 172.21.15.72:0/1670979125 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f83381f4070 msgr2=0x7f83381f4520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:35.666 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:35.666+0000 7f8336a00640 1 --2- 172.21.15.72:0/1670979125 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f83381f4070 0x7f83381f4520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:35.666 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:35.666+0000 7f8336a00640 1 -- 172.21.15.72:0/1670979125 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8338157c30 con 0x7f83380b9260 2024-04-04T06:57:35.666 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:35.666+0000 7f8336a00640 1 --2- 172.21.15.72:0/1670979125 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f83380b9260 0x7f83380b96e0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f832402c480 tx=0x7f83380cf9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:35.667 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:35.666+0000 7f832f400640 1 -- 172.21.15.72:0/1670979125 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8324004bf0 con 0x7f83380b9260 2024-04-04T06:57:35.667 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:35.666+0000 7f832f400640 1 -- 172.21.15.72:0/1670979125 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8324004d90 con 0x7f83380b9260 2024-04-04T06:57:35.667 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:35.666+0000 7f833d000640 1 -- 172.21.15.72:0/1670979125 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83381f4df0 con 0x7f83380b9260 2024-04-04T06:57:35.667 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:35.666+0000 7f832f400640 1 -- 172.21.15.72:0/1670979125 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8324007270 con 0x7f83380b9260 2024-04-04T06:57:35.667 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:35.667+0000 7f833d000640 1 -- 172.21.15.72:0/1670979125 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f833815ac70 con 0x7f83380b9260 2024-04-04T06:57:35.667 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:35.668+0000 7f833d000640 1 -- 172.21.15.72:0/1670979125 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83380756c0 con 0x7f83380b9260 2024-04-04T06:57:35.667 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:35.668+0000 7f832f400640 1 -- 172.21.15.72:0/1670979125 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8324047020 con 0x7f83380b9260 2024-04-04T06:57:35.668 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:35.669+0000 7f832f400640 1 --2- 172.21.15.72:0/1670979125 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f831806c920 0x7f831806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:35.668 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:35.669+0000 7f832f400640 1 -- 172.21.15.72:0/1670979125 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f83240ace50 con 0x7f83380b9260 2024-04-04T06:57:35.668 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:35.670+0000 7f8337400640 1 --2- 172.21.15.72:0/1670979125 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f831806c920 0x7f831806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:35.669 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:35.670+0000 7f8337400640 1 --2- 172.21.15.72:0/1670979125 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f831806c920 0x7f831806ede0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f8328009a10 tx=0x7f8328008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:35.672 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:35.674+0000 7f832f400640 1 -- 172.21.15.72:0/1670979125 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f8338157c30 con 0x7f83380b9260 2024-04-04T06:57:35.910 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:35.911+0000 7f833d000640 1 -- 172.21.15.72:0/1670979125 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f83380d2090 con 0x7f83380b9260 2024-04-04T06:57:35.910 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:35.912+0000 7f832f400640 1 -- 172.21.15.72:0/1670979125 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5181 (secure 0 0 0) 0x7f832407b160 con 0x7f83380b9260 2024-04-04T06:57:35.911 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T06:57:35.911 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6834/3570831137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":3570831137},{"type":"v1","addr":"172.21.15.117:6834","nonce":3570831137}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4238,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/1683311500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6833","nonce":1683311500},{"type":"v1","addr":"172.21.15.117:6835","nonce":1683311500}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6835/4150347227","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":4150347227},{"type":"v1","addr":"172.21.15.72:6835","nonce":4150347227}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-04T06:56:28.435113+0000","modified":"2024-04-04T06:56:31.557618+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4263},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4263":{"gid":4263,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.72:6837/2958027127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6836","nonce":2958027127},{"type":"v1","addr":"172.21.15.72:6837","nonce":2958027127}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4263,"qdb_cluster":[4263]},"id":1}]} 2024-04-04T06:57:35.911 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 8 2024-04-04T06:57:35.913 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:35.914+0000 7f833d000640 1 -- 172.21.15.72:0/1670979125 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f831806c920 msgr2=0x7f831806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:35.913 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:35.914+0000 7f833d000640 1 --2- 172.21.15.72:0/1670979125 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f831806c920 0x7f831806ede0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f8328009a10 tx=0x7f8328008040 comp rx=0 tx=0).stop 2024-04-04T06:57:35.914 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:35.914+0000 7f833d000640 1 -- 172.21.15.72:0/1670979125 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f83380b9260 msgr2=0x7f83380b96e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:35.914 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:35.914+0000 7f833d000640 1 --2- 172.21.15.72:0/1670979125 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f83380b9260 0x7f83380b96e0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f832402c480 tx=0x7f83380cf9c0 comp rx=0 tx=0).stop 2024-04-04T06:57:35.914 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:35.914+0000 7f833d000640 1 -- 172.21.15.72:0/1670979125 shutdown_connections 2024-04-04T06:57:35.914 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:35.914+0000 7f833d000640 1 --2- 172.21.15.72:0/1670979125 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f831806c920 0x7f831806ede0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:35.914 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:35.914+0000 7f833d000640 1 --2- 172.21.15.72:0/1670979125 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f83381f4070 0x7f83381f4520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:35.914 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:35.914+0000 7f833d000640 1 --2- 172.21.15.72:0/1670979125 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f83380b9260 0x7f83380b96e0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:35.914 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:35.914+0000 7f833d000640 1 --2- 172.21.15.72:0/1670979125 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f831c004800 0x7f83381576f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:35.914 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:35.914+0000 7f833d000640 1 -- 172.21.15.72:0/1670979125 >> 172.21.15.72:0/1670979125 conn(0x7f833806b890 msgr2=0x7f83380b7ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:35.914 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:35.915+0000 7f833d000640 1 -- 172.21.15.72:0/1670979125 shutdown_connections 2024-04-04T06:57:35.914 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:35.915+0000 7f833d000640 1 -- 172.21.15.72:0/1670979125 wait complete. 2024-04-04T06:57:35.939 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-04T06:57:36.129 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:36.129+0000 7ff6a6a00640 1 Processor -- start 2024-04-04T06:57:36.129 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:36.129+0000 7ff6a6a00640 1 -- start start 2024-04-04T06:57:36.131 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:36.130+0000 7ff6a6a00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7ff6a015b230 0x7ff6a00d00c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:36.131 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:36.130+0000 7ff6a6a00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff6a00d0600 0x7ff6a00c4ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:36.131 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:36.130+0000 7ff6a6a00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff6a00c5c00 con 0x7ff6a00c5530 2024-04-04T06:57:36.131 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:36.130+0000 7ff6a6a00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7ff6a00c59c0 con 0x7ff6a015b230 2024-04-04T06:57:36.131 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:36.130+0000 7ff6a6a00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7ff6a015c2b0 con 0x7ff6a00d0600 2024-04-04T06:57:36.131 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:36.131+0000 7ff69f400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff6a00d0600 0x7ff6a00c4ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:36.131 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:36.131+0000 7ff69f400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff6a00d0600 0x7ff6a00c4ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.72:48446/0 (socket says 172.21.15.72:48446) 2024-04-04T06:57:36.131 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:36.131+0000 7ff69f400640 1 -- 172.21.15.72:0/2937654275 learned_addr learned my addr 172.21.15.72:0/2937654275 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:57:36.132 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:36.131+0000 7ff69fe00640 1 --2- 172.21.15.72:0/2937654275 >> v2:172.21.15.117:3300/0 conn(0x7ff6a015b230 0x7ff6a00d00c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:36.132 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:36.132+0000 7ff69f400640 1 -- 172.21.15.72:0/2937654275 >> v2:172.21.15.117:3300/0 conn(0x7ff6a015b230 msgr2=0x7ff6a00d00c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:57:36.132 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:36.132+0000 7ff69f400640 1 --2- 172.21.15.72:0/2937654275 >> v2:172.21.15.117:3300/0 conn(0x7ff6a015b230 0x7ff6a00d00c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:36.132 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:36.132+0000 7ff69f400640 1 -- 172.21.15.72:0/2937654275 >> v1:172.21.15.117:6789/0 conn(0x7ff6a00c5530 legacy=0x7ff6a015ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:36.132 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:36.132+0000 7ff69f400640 1 -- 172.21.15.72:0/2937654275 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6a015b980 con 0x7ff6a00d0600 2024-04-04T06:57:36.132 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:36.132+0000 7ff69ea00640 1 -- 172.21.15.72:0/2937654275 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3326396745 0 0) 0x7ff6a00c5c00 con 0x7ff6a00c5530 2024-04-04T06:57:36.133 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:36.133+0000 7ff69f400640 1 --2- 172.21.15.72:0/2937654275 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff6a00d0600 0x7ff6a00c4ff0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7ff68c00bb10 tx=0x7ff68c02e150 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a3e8b5aef63fc6e8 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:36.133 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:36.134+0000 7ff69ea00640 1 -- 172.21.15.72:0/2937654275 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff68c03b070 con 0x7ff6a00d0600 2024-04-04T06:57:36.133 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:36.134+0000 7ff69ea00640 1 -- 172.21.15.72:0/2937654275 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff68c036440 con 0x7ff6a00d0600 2024-04-04T06:57:36.134 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:36.134+0000 7ff69ea00640 1 -- 172.21.15.72:0/2937654275 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff68c036810 con 0x7ff6a00d0600 2024-04-04T06:57:36.134 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:36.134+0000 7ff6a6a00640 1 -- 172.21.15.72:0/2937654275 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff6a00d0600 msgr2=0x7ff6a00c4ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:36.135 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:36.134+0000 7ff6a6a00640 1 --2- 172.21.15.72:0/2937654275 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff6a00d0600 0x7ff6a00c4ff0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7ff68c00bb10 tx=0x7ff68c02e150 comp rx=0 tx=0).stop 2024-04-04T06:57:36.135 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:36.134+0000 7ff6a6a00640 1 -- 172.21.15.72:0/2937654275 shutdown_connections 2024-04-04T06:57:36.135 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:36.134+0000 7ff6a6a00640 1 --2- 172.21.15.72:0/2937654275 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff6a00d0600 0x7ff6a00c4ff0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:36.135 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:36.134+0000 7ff6a6a00640 1 --2- 172.21.15.72:0/2937654275 >> v2:172.21.15.117:3300/0 conn(0x7ff6a015b230 0x7ff6a00d00c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:36.135 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:36.134+0000 7ff6a6a00640 1 -- 172.21.15.72:0/2937654275 >> 172.21.15.72:0/2937654275 conn(0x7ff6a006b470 msgr2=0x7ff6a006b880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:36.135 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:36.135+0000 7ff6a6a00640 1 -- 172.21.15.72:0/2937654275 shutdown_connections 2024-04-04T06:57:36.135 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:36.135+0000 7ff6a6a00640 1 -- 172.21.15.72:0/2937654275 wait complete. 2024-04-04T06:57:36.136 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:36.136+0000 7ff6a6a00640 1 Processor -- start 2024-04-04T06:57:36.136 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:36.136+0000 7ff6a6a00640 1 -- start start 2024-04-04T06:57:36.138 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:36.137+0000 7ff6a6a00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff6a00c5530 0x7ff6a00af2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:36.138 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:36.137+0000 7ff6a6a00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff6a00d0600 0x7ff6a014c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:36.138 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:36.137+0000 7ff6a6a00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff6a015b230 0x7ff6a00b0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:36.138 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:36.137+0000 7ff6a6a00640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7ff6a015bf40 con 0x7ff6a015b230 2024-04-04T06:57:36.139 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:36.137+0000 7ff6a6a00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7ff6a00d0a40 con 0x7ff6a00d0600 2024-04-04T06:57:36.139 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:36.137+0000 7ff6a6a00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7ff6a015b610 con 0x7ff6a00c5530 2024-04-04T06:57:36.139 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:36.137+0000 7ff6a4a00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff6a015b230 0x7ff6a00b0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:36.139 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:36.138+0000 7ff6a4a00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff6a015b230 0x7ff6a00b0ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:38838/0 (socket says 172.21.15.72:38838) 2024-04-04T06:57:36.139 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:36.138+0000 7ff6a4a00640 1 -- 172.21.15.72:0/961602593 learned_addr learned my addr 172.21.15.72:0/961602593 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:57:36.139 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:36.138+0000 7ff69fe00640 1 --2- 172.21.15.72:0/961602593 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff6a00c5530 0x7ff6a00af2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:36.139 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:36.138+0000 7ff69f400640 1 --2- 172.21.15.72:0/961602593 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff6a00d0600 0x7ff6a014c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:36.139 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:36.138+0000 7ff6a4a00640 1 -- 172.21.15.72:0/961602593 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff6a00c5530 msgr2=0x7ff6a00af2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:36.139 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:36.138+0000 7ff6a4a00640 1 --2- 172.21.15.72:0/961602593 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff6a00c5530 0x7ff6a00af2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:36.139 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:36.138+0000 7ff6a4a00640 1 -- 172.21.15.72:0/961602593 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff6a00d0600 msgr2=0x7ff6a014c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:36.139 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:36.138+0000 7ff6a4a00640 1 --2- 172.21.15.72:0/961602593 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff6a00d0600 0x7ff6a014c3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:36.139 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:36.138+0000 7ff6a4a00640 1 -- 172.21.15.72:0/961602593 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6a00afb00 con 0x7ff6a015b230 2024-04-04T06:57:36.140 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:36.138+0000 7ff69fe00640 1 --2- 172.21.15.72:0/961602593 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff6a00c5530 0x7ff6a00af2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-04T06:57:36.140 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:36.138+0000 7ff69f400640 1 --2- 172.21.15.72:0/961602593 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff6a00d0600 0x7ff6a014c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-04T06:57:36.140 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:36.138+0000 7ff6a4a00640 1 --2- 172.21.15.72:0/961602593 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff6a015b230 0x7ff6a00b0ad0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7ff69800c790 tx=0x7ff69800cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:36.141 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:36.139+0000 7ff697e00640 1 -- 172.21.15.72:0/961602593 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff698003da0 con 0x7ff6a015b230 2024-04-04T06:57:36.141 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:36.139+0000 7ff697e00640 1 -- 172.21.15.72:0/961602593 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff698005070 con 0x7ff6a015b230 2024-04-04T06:57:36.141 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:36.139+0000 7ff697e00640 1 -- 172.21.15.72:0/961602593 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff698005460 con 0x7ff6a015b230 2024-04-04T06:57:36.141 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:36.139+0000 7ff6a6a00640 1 -- 172.21.15.72:0/961602593 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6a00afde0 con 0x7ff6a015b230 2024-04-04T06:57:36.141 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:36.139+0000 7ff6a6a00640 1 -- 172.21.15.72:0/961602593 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6a0071b40 con 0x7ff6a015b230 2024-04-04T06:57:36.142 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:36.140+0000 7ff6a6a00640 1 -- 172.21.15.72:0/961602593 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff6a0075840 con 0x7ff6a015b230 2024-04-04T06:57:36.142 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:36.141+0000 7ff697e00640 1 -- 172.21.15.72:0/961602593 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff698005600 con 0x7ff6a015b230 2024-04-04T06:57:36.142 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:36.142+0000 7ff697e00640 1 --2- 172.21.15.72:0/961602593 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7ff68006c8f0 0x7ff68006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:36.142 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:36.142+0000 7ff697e00640 1 -- 172.21.15.72:0/961602593 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7ff69808bbd0 con 0x7ff6a015b230 2024-04-04T06:57:36.142 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:36.142+0000 7ff69fe00640 1 --2- 172.21.15.72:0/961602593 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7ff68006c8f0 0x7ff68006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:36.142 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:36.143+0000 7ff69fe00640 1 --2- 172.21.15.72:0/961602593 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7ff68006c8f0 0x7ff68006edb0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7ff690009a20 tx=0x7ff690008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:36.146 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:36.146+0000 7ff697e00640 1 -- 172.21.15.72:0/961602593 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7ff698059ee0 con 0x7ff6a015b230 2024-04-04T06:57:36.356 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:36.357+0000 7ff6a6a00640 1 -- 172.21.15.72:0/961602593 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff6a00b4a70 con 0x7ff6a015b230 2024-04-04T06:57:36.358 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:36.358+0000 7ff697e00640 1 -- 172.21.15.72:0/961602593 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16831 (secure 0 0 0) 0x7ff6980597e0 con 0x7ff6a015b230 2024-04-04T06:57:36.359 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T06:57:36.359 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":22,"fsid":"6708bac2-4f50-49b5-87a9-c390fd333eb3","created":"2024-04-04T06:56:04.282498+0000","modified":"2024-04-04T06:57:11.239134+0000","last_up_change":"2024-04-04T06:56:16.716089+0000","last_in_change":"2024-04-04T06:56:07.768593+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-04T06:56:17.421685+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-04T06:56:26.822661+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-04T06:56:27.429816+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7c345991-5af8-4dc6-a481-28610c40e128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":3889813953},{"type":"v1","addr":"172.21.15.72:6818","nonce":3889813953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":3889813953},{"type":"v1","addr":"172.21.15.72:6821","nonce":3889813953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":3889813953},{"type":"v1","addr":"172.21.15.72:6826","nonce":3889813953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":3889813953},{"type":"v1","addr":"172.21.15.72:6823","nonce":3889813953}]},"public_addr":"172.21.15.72:6818/3889813953","cluster_addr":"172.21.15.72:6821/3889813953","heartbeat_back_addr":"172.21.15.72:6826/3889813953","heartbeat_front_addr":"172.21.15.72:6823/3889813953","state":["exists","up"]},{"osd":1,"uuid":"1b3f7ab2-a56c-488d-a89a-1f3572361c95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":3101663154},{"type":"v1","addr":"172.21.15.72:6801","nonce":3101663154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":3101663154},{"type":"v1","addr":"172.21.15.72:6803","nonce":3101663154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":3101663154},{"type":"v1","addr":"172.21.15.72:6807","nonce":3101663154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":3101663154},{"type":"v1","addr":"172.21.15.72:6805","nonce":3101663154}]},"public_addr":"172.21.15.72:6801/3101663154","cluster_addr":"172.21.15.72:6803/3101663154","heartbeat_back_addr":"172.21.15.72:6807/3101663154","heartbeat_front_addr":"172.21.15.72:6805/3101663154","state":["exists","up"]},{"osd":2,"uuid":"fc9aa512-53df-40d7-ba04-3e6b7dcd1e34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":235374192},{"type":"v1","addr":"172.21.15.72:6809","nonce":235374192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":235374192},{"type":"v1","addr":"172.21.15.72:6811","nonce":235374192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":235374192},{"type":"v1","addr":"172.21.15.72:6815","nonce":235374192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":235374192},{"type":"v1","addr":"172.21.15.72:6813","nonce":235374192}]},"public_addr":"172.21.15.72:6809/235374192","cluster_addr":"172.21.15.72:6811/235374192","heartbeat_back_addr":"172.21.15.72:6815/235374192","heartbeat_front_addr":"172.21.15.72:6813/235374192","state":["exists","up"]},{"osd":3,"uuid":"b4f63eed-dc5b-4aba-bb50-de46eb41492b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6817","nonce":2806631742},{"type":"v1","addr":"172.21.15.72:6819","nonce":2806631742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":2806631742},{"type":"v1","addr":"172.21.15.72:6827","nonce":2806631742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":2806631742},{"type":"v1","addr":"172.21.15.72:6831","nonce":2806631742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":2806631742},{"type":"v1","addr":"172.21.15.72:6829","nonce":2806631742}]},"public_addr":"172.21.15.72:6819/2806631742","cluster_addr":"172.21.15.72:6827/2806631742","heartbeat_back_addr":"172.21.15.72:6831/2806631742","heartbeat_front_addr":"172.21.15.72:6829/2806631742","state":["exists","up"]},{"osd":4,"uuid":"9e985ef8-d711-4172-9286-c54e560895d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":4293536423},{"type":"v1","addr":"172.21.15.117:6825","nonce":4293536423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":4293536423},{"type":"v1","addr":"172.21.15.117:6827","nonce":4293536423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":4293536423},{"type":"v1","addr":"172.21.15.117:6831","nonce":4293536423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":4293536423},{"type":"v1","addr":"172.21.15.117:6829","nonce":4293536423}]},"public_addr":"172.21.15.117:6825/4293536423","cluster_addr":"172.21.15.117:6827/4293536423","heartbeat_back_addr":"172.21.15.117:6831/4293536423","heartbeat_front_addr":"172.21.15.117:6829/4293536423","state":["exists","up"]},{"osd":5,"uuid":"3e9f082b-8d7d-455f-8a96-66d0b4857125","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":684971679},{"type":"v1","addr":"172.21.15.117:6801","nonce":684971679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":684971679},{"type":"v1","addr":"172.21.15.117:6803","nonce":684971679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":684971679},{"type":"v1","addr":"172.21.15.117:6807","nonce":684971679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":684971679},{"type":"v1","addr":"172.21.15.117:6805","nonce":684971679}]},"public_addr":"172.21.15.117:6801/684971679","cluster_addr":"172.21.15.117:6803/684971679","heartbeat_back_addr":"172.21.15.117:6807/684971679","heartbeat_front_addr":"172.21.15.117:6805/684971679","state":["exists","up"]},{"osd":6,"uuid":"bcdafa9f-a870-4398-a38d-ab7697676473","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":2781186528},{"type":"v1","addr":"172.21.15.117:6809","nonce":2781186528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":2781186528},{"type":"v1","addr":"172.21.15.117:6811","nonce":2781186528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":2781186528},{"type":"v1","addr":"172.21.15.117:6815","nonce":2781186528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":2781186528},{"type":"v1","addr":"172.21.15.117:6813","nonce":2781186528}]},"public_addr":"172.21.15.117:6809/2781186528","cluster_addr":"172.21.15.117:6811/2781186528","heartbeat_back_addr":"172.21.15.117:6815/2781186528","heartbeat_front_addr":"172.21.15.117:6813/2781186528","state":["exists","up"]},{"osd":7,"uuid":"b68ec562-ff35-4d2d-a733-c896f8920cfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":617469882},{"type":"v1","addr":"172.21.15.117:6817","nonce":617469882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":617469882},{"type":"v1","addr":"172.21.15.117:6819","nonce":617469882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":617469882},{"type":"v1","addr":"172.21.15.117:6823","nonce":617469882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":617469882},{"type":"v1","addr":"172.21.15.117:6821","nonce":617469882}]},"public_addr":"172.21.15.117:6817/617469882","cluster_addr":"172.21.15.117:6819/617469882","heartbeat_back_addr":"172.21.15.117:6823/617469882","heartbeat_front_addr":"172.21.15.117:6821/617469882","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.347700+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.296619+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.361345+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.093323+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:12.857605+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:12.816090+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.083163+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.121639+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.13","mappings":[{"from":7,"to":1}]},{"pgid":"3.19","mappings":[{"from":3,"to":2}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.28","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-04T06:57:36.361 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:36.361+0000 7ff6a6a00640 1 -- 172.21.15.72:0/961602593 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7ff68006c8f0 msgr2=0x7ff68006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:36.361 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:36.361+0000 7ff6a6a00640 1 --2- 172.21.15.72:0/961602593 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7ff68006c8f0 0x7ff68006edb0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7ff690009a20 tx=0x7ff690008040 comp rx=0 tx=0).stop 2024-04-04T06:57:36.362 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:36.361+0000 7ff6a6a00640 1 -- 172.21.15.72:0/961602593 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff6a015b230 msgr2=0x7ff6a00b0ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:36.362 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:36.361+0000 7ff6a6a00640 1 --2- 172.21.15.72:0/961602593 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff6a015b230 0x7ff6a00b0ad0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7ff69800c790 tx=0x7ff69800cc50 comp rx=0 tx=0).stop 2024-04-04T06:57:36.362 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:36.361+0000 7ff6a6a00640 1 -- 172.21.15.72:0/961602593 shutdown_connections 2024-04-04T06:57:36.362 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:36.361+0000 7ff6a6a00640 1 --2- 172.21.15.72:0/961602593 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7ff68006c8f0 0x7ff68006edb0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:36.362 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:36.361+0000 7ff6a6a00640 1 --2- 172.21.15.72:0/961602593 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff6a015b230 0x7ff6a00b0ad0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:36.362 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:36.361+0000 7ff6a6a00640 1 --2- 172.21.15.72:0/961602593 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff6a00d0600 0x7ff6a014c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:36.362 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:36.361+0000 7ff6a6a00640 1 --2- 172.21.15.72:0/961602593 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff6a00c5530 0x7ff6a00af2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:36.362 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:36.361+0000 7ff6a6a00640 1 -- 172.21.15.72:0/961602593 >> 172.21.15.72:0/961602593 conn(0x7ff6a006b470 msgr2=0x7ff6a006b850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:36.362 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:36.362+0000 7ff6a6a00640 1 -- 172.21.15.72:0/961602593 shutdown_connections 2024-04-04T06:57:36.362 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:36.362+0000 7ff6a6a00640 1 -- 172.21.15.72:0/961602593 wait complete. 2024-04-04T06:57:36.379 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-04T06:57:36.380 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-04T06:57:36.585 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:36.585+0000 7f589e200640 1 Processor -- start 2024-04-04T06:57:36.585 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:36.585+0000 7f589e200640 1 -- start start 2024-04-04T06:57:36.587 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:36.587+0000 7f589e200640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f5898144b60 0x7f58980b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:36.587 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:36.587+0000 7f589e200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5898074be0 0x7f589806fa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:36.587 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:36.587+0000 7f589e200640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5898070190 con 0x7f5898145310 2024-04-04T06:57:36.587 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:36.587+0000 7f589e200640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f5898070470 con 0x7f5898144b60 2024-04-04T06:57:36.587 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:36.587+0000 7f589e200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f5898070750 con 0x7f5898074be0 2024-04-04T06:57:36.588 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:36.588+0000 7f5897e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5898074be0 0x7f589806fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:36.588 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:36.588+0000 7f5897e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5898074be0 0x7f589806fa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.72:48474/0 (socket says 172.21.15.72:48474) 2024-04-04T06:57:36.588 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:36.588+0000 7f5897e00640 1 -- 172.21.15.72:0/589405942 learned_addr learned my addr 172.21.15.72:0/589405942 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:57:36.588 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:36.588+0000 7f5897400640 1 --2- 172.21.15.72:0/589405942 >> v2:172.21.15.117:3300/0 conn(0x7f5898144b60 0x7f58980b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:36.588 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:36.588+0000 7f5897e00640 1 -- 172.21.15.72:0/589405942 >> v2:172.21.15.117:3300/0 conn(0x7f5898144b60 msgr2=0x7f58980b4e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:57:36.588 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:36.588+0000 7f5897e00640 1 --2- 172.21.15.72:0/589405942 >> v2:172.21.15.117:3300/0 conn(0x7f5898144b60 0x7f58980b4e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:36.588 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:36.588+0000 7f5897e00640 1 -- 172.21.15.72:0/589405942 >> v1:172.21.15.117:6789/0 conn(0x7f5898145310 legacy=0x7f58980744d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:36.589 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:36.588+0000 7f5897e00640 1 -- 172.21.15.72:0/589405942 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f589806b510 con 0x7f5898074be0 2024-04-04T06:57:36.589 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:36.590+0000 7f5897e00640 1 --2- 172.21.15.72:0/589405942 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5898074be0 0x7f589806fa90 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f5890009870 tx=0x7f589002b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e4af0731ab4a2584 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:36.590 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:36.590+0000 7f5896a00640 1 -- 172.21.15.72:0/589405942 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5890034070 con 0x7f5898074be0 2024-04-04T06:57:36.590 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:36.590+0000 7f5896a00640 1 -- 172.21.15.72:0/589405942 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5890030840 con 0x7f5898074be0 2024-04-04T06:57:36.590 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:36.590+0000 7f5896a00640 1 -- 172.21.15.72:0/589405942 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5890030c10 con 0x7f5898074be0 2024-04-04T06:57:36.591 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:36.591+0000 7f589e200640 1 -- 172.21.15.72:0/589405942 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5898074be0 msgr2=0x7f589806fa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:36.591 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:36.591+0000 7f589e200640 1 --2- 172.21.15.72:0/589405942 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5898074be0 0x7f589806fa90 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f5890009870 tx=0x7f589002b980 comp rx=0 tx=0).stop 2024-04-04T06:57:36.591 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:36.591+0000 7f589e200640 1 -- 172.21.15.72:0/589405942 shutdown_connections 2024-04-04T06:57:36.591 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:36.591+0000 7f589e200640 1 --2- 172.21.15.72:0/589405942 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5898074be0 0x7f589806fa90 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:36.591 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:36.591+0000 7f589e200640 1 --2- 172.21.15.72:0/589405942 >> v2:172.21.15.117:3300/0 conn(0x7f5898144b60 0x7f58980b4e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:36.591 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:36.591+0000 7f589e200640 1 -- 172.21.15.72:0/589405942 >> 172.21.15.72:0/589405942 conn(0x7f589806e4c0 msgr2=0x7f589806e8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:36.591 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:36.591+0000 7f589e200640 1 -- 172.21.15.72:0/589405942 shutdown_connections 2024-04-04T06:57:36.591 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:36.591+0000 7f589e200640 1 -- 172.21.15.72:0/589405942 wait complete. 2024-04-04T06:57:36.592 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:36.593+0000 7f589e200640 1 Processor -- start 2024-04-04T06:57:36.592 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:36.593+0000 7f589e200640 1 -- start start 2024-04-04T06:57:36.593 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:36.594+0000 7f589e200640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5898074be0 0x7f58981418d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:36.594 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:36.594+0000 7f589e200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5898144b60 0x7f589815e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:36.594 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:36.594+0000 7f589e200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5898145310 0x7f58980af2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:36.594 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:36.594+0000 7f589e200640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f589806ba30 con 0x7f5898074be0 2024-04-04T06:57:36.594 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:36.594+0000 7f589e200640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f5898144f40 con 0x7f5898145310 2024-04-04T06:57:36.594 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:36.594+0000 7f589e200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f589806bbb0 con 0x7f5898144b60 2024-04-04T06:57:36.594 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:36.594+0000 7f5897400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5898074be0 0x7f58981418d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:36.594 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:36.594+0000 7f5897400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5898074be0 0x7f58981418d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:38846/0 (socket says 172.21.15.72:38846) 2024-04-04T06:57:36.594 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:36.594+0000 7f5897400640 1 -- 172.21.15.72:0/2475026125 learned_addr learned my addr 172.21.15.72:0/2475026125 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:57:36.595 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:36.594+0000 7f5897400640 1 -- 172.21.15.72:0/2475026125 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5898144b60 msgr2=0x7f589815e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:36.595 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:36.594+0000 7f5897400640 1 --2- 172.21.15.72:0/2475026125 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5898144b60 0x7f589815e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:36.595 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:36.594+0000 7f5897400640 1 -- 172.21.15.72:0/2475026125 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5898145310 msgr2=0x7f58980af2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:36.596 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:36.594+0000 7f5897e00640 1 --2- 172.21.15.72:0/2475026125 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5898145310 0x7f58980af2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:36.596 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:36.594+0000 7f5897400640 1 --2- 172.21.15.72:0/2475026125 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5898145310 0x7f58980af2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:36.596 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:36.594+0000 7f5897400640 1 -- 172.21.15.72:0/2475026125 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58980af810 con 0x7f5898074be0 2024-04-04T06:57:36.596 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:36.595+0000 7f5897400640 1 --2- 172.21.15.72:0/2475026125 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5898074be0 0x7f58981418d0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f588800efc0 tx=0x7f588800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:36.596 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:36.595+0000 7f588fe00640 1 -- 172.21.15.72:0/2475026125 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5888018020 con 0x7f5898074be0 2024-04-04T06:57:36.596 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:36.595+0000 7f588fe00640 1 -- 172.21.15.72:0/2475026125 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5888014480 con 0x7f5898074be0 2024-04-04T06:57:36.596 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:36.595+0000 7f588fe00640 1 -- 172.21.15.72:0/2475026125 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5888014850 con 0x7f5898074be0 2024-04-04T06:57:36.596 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:36.595+0000 7f589e200640 1 -- 172.21.15.72:0/2475026125 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58980c6e50 con 0x7f5898074be0 2024-04-04T06:57:36.596 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:36.595+0000 7f589e200640 1 -- 172.21.15.72:0/2475026125 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58980b1190 con 0x7f5898074be0 2024-04-04T06:57:36.597 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:36.596+0000 7f589e200640 1 -- 172.21.15.72:0/2475026125 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5898161170 con 0x7f5898074be0 2024-04-04T06:57:36.597 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:36.597+0000 7f588fe00640 1 -- 172.21.15.72:0/2475026125 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5888005d10 con 0x7f5898074be0 2024-04-04T06:57:36.598 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:36.598+0000 7f588fe00640 1 --2- 172.21.15.72:0/2475026125 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f587406c8f0 0x7f587406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:36.598 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:36.598+0000 7f588fe00640 1 -- 172.21.15.72:0/2475026125 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f588808c7a0 con 0x7f5898074be0 2024-04-04T06:57:36.598 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:36.598+0000 7f588ea00640 1 --2- 172.21.15.72:0/2475026125 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f587406c8f0 0x7f587406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:36.598 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:36.599+0000 7f588ea00640 1 --2- 172.21.15.72:0/2475026125 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f587406c8f0 0x7f587406edb0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f5880000f60 tx=0x7f58800079d0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:36.602 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:36.603+0000 7f588fe00640 1 -- 172.21.15.72:0/2475026125 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f5898161170 con 0x7f5898074be0 2024-04-04T06:57:36.839 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:36.839+0000 7f589e200640 1 -- 172.21.15.72:0/2475026125 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5898075840 con 0x7f5898074be0 2024-04-04T06:57:36.839 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:36.840+0000 7f588fe00640 1 -- 172.21.15.72:0/2475026125 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5181 (secure 0 0 0) 0x7f5888022070 con 0x7f5898074be0 2024-04-04T06:57:36.840 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T06:57:36.840 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6834/3570831137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":3570831137},{"type":"v1","addr":"172.21.15.117:6834","nonce":3570831137}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4238,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/1683311500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6833","nonce":1683311500},{"type":"v1","addr":"172.21.15.117:6835","nonce":1683311500}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6835/4150347227","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":4150347227},{"type":"v1","addr":"172.21.15.72:6835","nonce":4150347227}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-04T06:56:28.435113+0000","modified":"2024-04-04T06:56:31.557618+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4263},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4263":{"gid":4263,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.72:6837/2958027127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6836","nonce":2958027127},{"type":"v1","addr":"172.21.15.72:6837","nonce":2958027127}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4263,"qdb_cluster":[4263]},"id":1}]} 2024-04-04T06:57:36.840 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 8 2024-04-04T06:57:36.842 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:36.842+0000 7f589e200640 1 -- 172.21.15.72:0/2475026125 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f587406c8f0 msgr2=0x7f587406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:36.842 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:36.842+0000 7f589e200640 1 --2- 172.21.15.72:0/2475026125 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f587406c8f0 0x7f587406edb0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f5880000f60 tx=0x7f58800079d0 comp rx=0 tx=0).stop 2024-04-04T06:57:36.843 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:36.842+0000 7f589e200640 1 -- 172.21.15.72:0/2475026125 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5898074be0 msgr2=0x7f58981418d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:36.843 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:36.842+0000 7f589e200640 1 --2- 172.21.15.72:0/2475026125 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5898074be0 0x7f58981418d0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f588800efc0 tx=0x7f588800c490 comp rx=0 tx=0).stop 2024-04-04T06:57:36.843 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:36.842+0000 7f589e200640 1 -- 172.21.15.72:0/2475026125 shutdown_connections 2024-04-04T06:57:36.843 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:36.842+0000 7f589e200640 1 --2- 172.21.15.72:0/2475026125 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f587406c8f0 0x7f587406edb0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:36.843 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:36.842+0000 7f589e200640 1 --2- 172.21.15.72:0/2475026125 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5898145310 0x7f58980af2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:36.843 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:36.842+0000 7f589e200640 1 --2- 172.21.15.72:0/2475026125 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5898144b60 0x7f589815e1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:36.843 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:36.842+0000 7f589e200640 1 --2- 172.21.15.72:0/2475026125 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5898074be0 0x7f58981418d0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:36.843 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:36.842+0000 7f589e200640 1 -- 172.21.15.72:0/2475026125 >> 172.21.15.72:0/2475026125 conn(0x7f589806e4c0 msgr2=0x7f589815fa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:36.843 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:36.843+0000 7f589e200640 1 -- 172.21.15.72:0/2475026125 shutdown_connections 2024-04-04T06:57:36.843 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:36.843+0000 7f589e200640 1 -- 172.21.15.72:0/2475026125 wait complete. 2024-04-04T06:57:36.859 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-04T06:57:37.051 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:37.051+0000 7ffb2c800640 1 Processor -- start 2024-04-04T06:57:37.051 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:37.051+0000 7ffb2c800640 1 -- start start 2024-04-04T06:57:37.052 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:37.052+0000 7ffb2c800640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ffb240b3ba0 0x7ffb240d29a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:37.053 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:37.053+0000 7ffb2c800640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffb240cfc90 0x7ffb2406b470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:37.053 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:37.053+0000 7ffb2c800640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffb240d2ee0 con 0x7ffb2415f870 2024-04-04T06:57:37.053 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:37.053+0000 7ffb2c800640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7ffb241590f0 con 0x7ffb240b3ba0 2024-04-04T06:57:37.053 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:37.053+0000 7ffb2c800640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7ffb240d1f00 con 0x7ffb240cfc90 2024-04-04T06:57:37.053 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:37.053+0000 7ffb29e00640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ffb240b3ba0 0x7ffb240d29a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:37.053 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:37.053+0000 7ffb29400640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7ffb2415f870 0x7ffb240b3f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:52304/0 (socket says 172.21.15.72:52304) 2024-04-04T06:57:37.053 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:37.053+0000 7ffb29400640 1 -- 172.21.15.72:0/3970705599 learned_addr learned my addr 172.21.15.72:0/3970705599 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-04-04T06:57:37.054 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:37.053+0000 7ffb2a800640 1 --2- 172.21.15.72:0/3970705599 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffb240cfc90 0x7ffb2406b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:37.054 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:37.053+0000 7ffb29e00640 1 -- 172.21.15.72:0/3970705599 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffb240cfc90 msgr2=0x7ffb2406b470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:57:37.054 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:37.053+0000 7ffb29e00640 1 --2- 172.21.15.72:0/3970705599 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffb240cfc90 0x7ffb2406b470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:37.054 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:37.053+0000 7ffb29e00640 1 -- 172.21.15.72:0/3970705599 >> v1:172.21.15.72:6789/0 conn(0x7ffb2415f870 legacy=0x7ffb240b3f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:37.054 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:37.053+0000 7ffb28a00640 1 -- 172.21.15.72:0/3970705599 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3581329546 0 0) 0x7ffb240d2ee0 con 0x7ffb2415f870 2024-04-04T06:57:37.054 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:37.053+0000 7ffb29e00640 1 -- 172.21.15.72:0/3970705599 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb240d04e0 con 0x7ffb240b3ba0 2024-04-04T06:57:37.054 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:37.054+0000 7ffb2a800640 1 --2- 172.21.15.72:0/3970705599 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffb240cfc90 0x7ffb2406b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-04T06:57:37.055 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:37.055+0000 7ffb29e00640 1 --2- 172.21.15.72:0/3970705599 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffb240b3ba0 0x7ffb240d29a0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7ffb180097a0 tx=0x7ffb1802b7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37b5302652045b12 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:37.055 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:37.056+0000 7ffb28a00640 1 -- 172.21.15.72:0/3970705599 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb18038070 con 0x7ffb240b3ba0 2024-04-04T06:57:37.055 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:37.056+0000 7ffb28a00640 1 -- 172.21.15.72:0/3970705599 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb18031700 con 0x7ffb240b3ba0 2024-04-04T06:57:37.055 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:37.056+0000 7ffb28a00640 1 -- 172.21.15.72:0/3970705599 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb18031ad0 con 0x7ffb240b3ba0 2024-04-04T06:57:37.056 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:37.056+0000 7ffb2c800640 1 -- 172.21.15.72:0/3970705599 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffb240b3ba0 msgr2=0x7ffb240d29a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:37.056 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:37.056+0000 7ffb2c800640 1 --2- 172.21.15.72:0/3970705599 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffb240b3ba0 0x7ffb240d29a0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7ffb180097a0 tx=0x7ffb1802b7a0 comp rx=0 tx=0).stop 2024-04-04T06:57:37.056 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:37.056+0000 7ffb2c800640 1 -- 172.21.15.72:0/3970705599 shutdown_connections 2024-04-04T06:57:37.056 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:37.056+0000 7ffb2c800640 1 --2- 172.21.15.72:0/3970705599 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffb240cfc90 0x7ffb2406b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:37.056 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:37.056+0000 7ffb2c800640 1 --2- 172.21.15.72:0/3970705599 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffb240b3ba0 0x7ffb240d29a0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:37.056 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:37.056+0000 7ffb2c800640 1 -- 172.21.15.72:0/3970705599 >> 172.21.15.72:0/3970705599 conn(0x7ffb2406d680 msgr2=0x7ffb2406da60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:37.056 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:37.056+0000 7ffb2c800640 1 -- 172.21.15.72:0/3970705599 shutdown_connections 2024-04-04T06:57:37.057 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:37.056+0000 7ffb2c800640 1 -- 172.21.15.72:0/3970705599 wait complete. 2024-04-04T06:57:37.058 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:37.059+0000 7ffb2c800640 1 Processor -- start 2024-04-04T06:57:37.059 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:37.059+0000 7ffb2c800640 1 -- start start 2024-04-04T06:57:37.061 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:37.061+0000 7ffb2c800640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffb240b3ba0 0x7ffb241484c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:37.061 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:37.061+0000 7ffb2c800640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffb240cfc90 0x7ffb240b70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:37.061 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:37.061+0000 7ffb2c800640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffb2415f870 0x7ffb2415c810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:37.061 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:37.061+0000 7ffb2c800640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7ffb240d07c0 con 0x7ffb240cfc90 2024-04-04T06:57:37.061 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:37.061+0000 7ffb2c800640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7ffb240d2480 con 0x7ffb2415f870 2024-04-04T06:57:37.061 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:37.061+0000 7ffb2c800640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7ffb240d0940 con 0x7ffb240b3ba0 2024-04-04T06:57:37.061 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:37.061+0000 7ffb29400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffb240cfc90 0x7ffb240b70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:37.061 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:37.061+0000 7ffb29400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffb240cfc90 0x7ffb240b70c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:38870/0 (socket says 172.21.15.72:38870) 2024-04-04T06:57:37.061 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:37.061+0000 7ffb29400640 1 -- 172.21.15.72:0/3117278933 learned_addr learned my addr 172.21.15.72:0/3117278933 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:57:37.062 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:37.061+0000 7ffb29e00640 1 --2- 172.21.15.72:0/3117278933 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffb240b3ba0 0x7ffb241484c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:37.062 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:37.062+0000 7ffb2a800640 1 --2- 172.21.15.72:0/3117278933 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffb2415f870 0x7ffb2415c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:37.063 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:37.062+0000 7ffb29400640 1 -- 172.21.15.72:0/3117278933 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffb240b3ba0 msgr2=0x7ffb241484c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:37.063 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:37.062+0000 7ffb29400640 1 --2- 172.21.15.72:0/3117278933 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffb240b3ba0 0x7ffb241484c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:37.063 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:37.062+0000 7ffb29400640 1 -- 172.21.15.72:0/3117278933 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffb2415f870 msgr2=0x7ffb2415c810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:37.063 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:37.062+0000 7ffb29400640 1 --2- 172.21.15.72:0/3117278933 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffb2415f870 0x7ffb2415c810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:37.063 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:37.062+0000 7ffb29400640 1 -- 172.21.15.72:0/3117278933 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb24148a00 con 0x7ffb240cfc90 2024-04-04T06:57:37.063 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:37.062+0000 7ffb29400640 1 --2- 172.21.15.72:0/3117278933 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffb240cfc90 0x7ffb240b70c0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7ffb1400c4d0 tx=0x7ffb1400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:37.063 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:37.062+0000 7ffb1e000640 1 -- 172.21.15.72:0/3117278933 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb14018070 con 0x7ffb240cfc90 2024-04-04T06:57:37.063 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:37.062+0000 7ffb1e000640 1 -- 172.21.15.72:0/3117278933 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb14007500 con 0x7ffb240cfc90 2024-04-04T06:57:37.063 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:37.062+0000 7ffb2c800640 1 -- 172.21.15.72:0/3117278933 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb241595e0 con 0x7ffb240cfc90 2024-04-04T06:57:37.063 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:37.062+0000 7ffb1e000640 1 -- 172.21.15.72:0/3117278933 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb14004a20 con 0x7ffb240cfc90 2024-04-04T06:57:37.063 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:37.062+0000 7ffb2c800640 1 -- 172.21.15.72:0/3117278933 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb24159ba0 con 0x7ffb240cfc90 2024-04-04T06:57:37.064 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:37.063+0000 7ffb2c800640 1 -- 172.21.15.72:0/3117278933 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb24075840 con 0x7ffb240cfc90 2024-04-04T06:57:37.064 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:37.064+0000 7ffb1e000640 1 -- 172.21.15.72:0/3117278933 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ffb1401b070 con 0x7ffb240cfc90 2024-04-04T06:57:37.066 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:37.067+0000 7ffb1e000640 1 --2- 172.21.15.72:0/3117278933 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7ffb0806c920 0x7ffb0806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:37.066 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:37.067+0000 7ffb1e000640 1 -- 172.21.15.72:0/3117278933 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7ffb1408aec0 con 0x7ffb240cfc90 2024-04-04T06:57:37.066 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:37.067+0000 7ffb29e00640 1 --2- 172.21.15.72:0/3117278933 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7ffb0806c920 0x7ffb0806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:37.067 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:37.067+0000 7ffb29e00640 1 --2- 172.21.15.72:0/3117278933 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7ffb0806c920 0x7ffb0806ede0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7ffb18035000 tx=0x7ffb18008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:37.069 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:37.070+0000 7ffb1e000640 1 -- 172.21.15.72:0/3117278933 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7ffb24148a00 con 0x7ffb240cfc90 2024-04-04T06:57:37.303 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:37.303+0000 7ffb2c800640 1 -- 172.21.15.72:0/3117278933 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ffb240cf620 con 0x7ffb240cfc90 2024-04-04T06:57:37.303 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:37.304+0000 7ffb1e000640 1 -- 172.21.15.72:0/3117278933 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5181 (secure 0 0 0) 0x7ffb14059270 con 0x7ffb240cfc90 2024-04-04T06:57:37.304 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T06:57:37.304 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6834/3570831137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":3570831137},{"type":"v1","addr":"172.21.15.117:6834","nonce":3570831137}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4238,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/1683311500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6833","nonce":1683311500},{"type":"v1","addr":"172.21.15.117:6835","nonce":1683311500}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6835/4150347227","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":4150347227},{"type":"v1","addr":"172.21.15.72:6835","nonce":4150347227}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-04T06:56:28.435113+0000","modified":"2024-04-04T06:56:31.557618+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4263},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4263":{"gid":4263,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.72:6837/2958027127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6836","nonce":2958027127},{"type":"v1","addr":"172.21.15.72:6837","nonce":2958027127}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4263,"qdb_cluster":[4263]},"id":1}]} 2024-04-04T06:57:37.304 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 8 2024-04-04T06:57:37.306 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:37.306+0000 7ffb2c800640 1 -- 172.21.15.72:0/3117278933 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7ffb0806c920 msgr2=0x7ffb0806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:37.306 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:37.306+0000 7ffb2c800640 1 --2- 172.21.15.72:0/3117278933 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7ffb0806c920 0x7ffb0806ede0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7ffb18035000 tx=0x7ffb18008030 comp rx=0 tx=0).stop 2024-04-04T06:57:37.306 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:37.306+0000 7ffb2c800640 1 -- 172.21.15.72:0/3117278933 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffb240cfc90 msgr2=0x7ffb240b70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:37.306 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:37.306+0000 7ffb2c800640 1 --2- 172.21.15.72:0/3117278933 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffb240cfc90 0x7ffb240b70c0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7ffb1400c4d0 tx=0x7ffb1400c990 comp rx=0 tx=0).stop 2024-04-04T06:57:37.306 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:37.306+0000 7ffb2c800640 1 -- 172.21.15.72:0/3117278933 shutdown_connections 2024-04-04T06:57:37.306 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:37.306+0000 7ffb2c800640 1 --2- 172.21.15.72:0/3117278933 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7ffb0806c920 0x7ffb0806ede0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:37.306 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:37.306+0000 7ffb2c800640 1 --2- 172.21.15.72:0/3117278933 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffb2415f870 0x7ffb2415c810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:37.307 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:37.306+0000 7ffb2c800640 1 --2- 172.21.15.72:0/3117278933 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffb240cfc90 0x7ffb240b70c0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:37.307 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:37.306+0000 7ffb2c800640 1 --2- 172.21.15.72:0/3117278933 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffb240b3ba0 0x7ffb241484c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:37.307 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:37.306+0000 7ffb2c800640 1 -- 172.21.15.72:0/3117278933 >> 172.21.15.72:0/3117278933 conn(0x7ffb2406d680 msgr2=0x7ffb24160100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:37.307 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:37.306+0000 7ffb2c800640 1 -- 172.21.15.72:0/3117278933 shutdown_connections 2024-04-04T06:57:37.307 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:37.306+0000 7ffb2c800640 1 -- 172.21.15.72:0/3117278933 wait complete. 2024-04-04T06:57:37.323 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-04T06:57:37.517 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:37.517+0000 7f1efec00640 1 Processor -- start 2024-04-04T06:57:37.517 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:37.517+0000 7f1efec00640 1 -- start start 2024-04-04T06:57:37.519 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:37.518+0000 7f1efec00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1ef815e5a0 0x7f1ef80b75c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:37.519 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:37.518+0000 7f1efec00640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f1ef80b7b00 0x7f1ef80d2e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:37.519 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:37.519+0000 7f1efec00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1ef80d3820 con 0x7f1ef80d3370 2024-04-04T06:57:37.519 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:37.519+0000 7f1efec00640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f1ef80cf7f0 con 0x7f1ef80b7b00 2024-04-04T06:57:37.519 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:37.519+0000 7f1efec00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f1ef80cfad0 con 0x7f1ef815e5a0 2024-04-04T06:57:37.519 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:37.519+0000 7f1efce00640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f1ef80b7b00 0x7f1ef80d2e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:37.519 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:37.519+0000 7f1efce00640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f1ef80b7b00 0x7f1ef80d2e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:38872/0 (socket says 172.21.15.72:38872) 2024-04-04T06:57:37.519 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:37.519+0000 7f1efce00640 1 -- 172.21.15.72:0/4292357660 learned_addr learned my addr 172.21.15.72:0/4292357660 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:57:37.519 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:37.519+0000 7f1efd800640 1 --2- 172.21.15.72:0/4292357660 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1ef815e5a0 0x7f1ef80b75c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:37.520 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:37.519+0000 7f1efce00640 1 -- 172.21.15.72:0/4292357660 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1ef815e5a0 msgr2=0x7f1ef80b75c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:57:37.520 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:37.519+0000 7f1efce00640 1 --2- 172.21.15.72:0/4292357660 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1ef815e5a0 0x7f1ef80b75c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:37.520 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:37.520+0000 7f1efce00640 1 -- 172.21.15.72:0/4292357660 >> v1:172.21.15.117:6789/0 conn(0x7f1ef80d3370 legacy=0x7f1ef80d08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:37.520 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:37.520+0000 7f1efce00640 1 -- 172.21.15.72:0/4292357660 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ef80d2350 con 0x7f1ef80b7b00 2024-04-04T06:57:37.520 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:37.521+0000 7f1efce00640 1 --2- 172.21.15.72:0/4292357660 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1ef80b7b00 0x7f1ef80d2e30 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f1ee4009870 tx=0x7f1ee402b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23348b4f107a593f server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:37.521 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:37.521+0000 7f1ef7e00640 1 -- 172.21.15.72:0/4292357660 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ee4034070 con 0x7f1ef80b7b00 2024-04-04T06:57:37.521 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:37.521+0000 7f1ef7e00640 1 -- 172.21.15.72:0/4292357660 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ee4030840 con 0x7f1ef80b7b00 2024-04-04T06:57:37.522 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:37.521+0000 7f1ef7e00640 1 -- 172.21.15.72:0/4292357660 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ee4030c10 con 0x7f1ef80b7b00 2024-04-04T06:57:37.522 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:37.522+0000 7f1efec00640 1 -- 172.21.15.72:0/4292357660 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1ef80b7b00 msgr2=0x7f1ef80d2e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:37.522 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:37.522+0000 7f1efec00640 1 --2- 172.21.15.72:0/4292357660 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1ef80b7b00 0x7f1ef80d2e30 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f1ee4009870 tx=0x7f1ee402b980 comp rx=0 tx=0).stop 2024-04-04T06:57:37.522 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:37.522+0000 7f1efec00640 1 -- 172.21.15.72:0/4292357660 shutdown_connections 2024-04-04T06:57:37.522 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:37.522+0000 7f1efec00640 1 --2- 172.21.15.72:0/4292357660 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1ef80b7b00 0x7f1ef80d2e30 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:37.522 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:37.522+0000 7f1efec00640 1 --2- 172.21.15.72:0/4292357660 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1ef815e5a0 0x7f1ef80b75c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:37.522 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:37.522+0000 7f1efec00640 1 -- 172.21.15.72:0/4292357660 >> 172.21.15.72:0/4292357660 conn(0x7f1ef806b890 msgr2=0x7f1ef806bca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:37.522 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:37.522+0000 7f1efec00640 1 -- 172.21.15.72:0/4292357660 shutdown_connections 2024-04-04T06:57:37.522 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:37.522+0000 7f1efec00640 1 -- 172.21.15.72:0/4292357660 wait complete. 2024-04-04T06:57:37.523 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:37.524+0000 7f1efec00640 1 Processor -- start 2024-04-04T06:57:37.523 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:37.524+0000 7f1efec00640 1 -- start start 2024-04-04T06:57:37.525 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:37.525+0000 7f1efec00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1ef80b7b00 0x7f1ef8154290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:37.525 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:37.525+0000 7f1efec00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1ef80d3370 0x7f1ef80b93f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:37.525 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:37.525+0000 7f1efec00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1ef815e5a0 0x7f1ef80b9930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:37.525 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:37.525+0000 7f1efec00640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f1ef815e980 con 0x7f1ef80d3370 2024-04-04T06:57:37.525 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:37.525+0000 7f1efec00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f1ef80d2910 con 0x7f1ef80b7b00 2024-04-04T06:57:37.525 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:37.525+0000 7f1efec00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f1ef80d0ff0 con 0x7f1ef815e5a0 2024-04-04T06:57:37.525 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:37.525+0000 7f1efce00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1ef80d3370 0x7f1ef80b93f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:37.525 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:37.525+0000 7f1efce00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1ef80d3370 0x7f1ef80b93f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:38882/0 (socket says 172.21.15.72:38882) 2024-04-04T06:57:37.525 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:37.525+0000 7f1efce00640 1 -- 172.21.15.72:0/3527721907 learned_addr learned my addr 172.21.15.72:0/3527721907 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:57:37.525 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:37.525+0000 7f1efd800640 1 --2- 172.21.15.72:0/3527721907 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1ef80b7b00 0x7f1ef8154290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:37.525 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:37.525+0000 7f1efe200640 1 --2- 172.21.15.72:0/3527721907 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1ef815e5a0 0x7f1ef80b9930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:37.527 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:37.525+0000 7f1efce00640 1 -- 172.21.15.72:0/3527721907 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1ef815e5a0 msgr2=0x7f1ef80b9930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:37.527 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:37.526+0000 7f1efce00640 1 --2- 172.21.15.72:0/3527721907 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1ef815e5a0 0x7f1ef80b9930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:37.527 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:37.526+0000 7f1efce00640 1 -- 172.21.15.72:0/3527721907 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1ef80b7b00 msgr2=0x7f1ef8154290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:37.527 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:37.526+0000 7f1efce00640 1 --2- 172.21.15.72:0/3527721907 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1ef80b7b00 0x7f1ef8154290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:37.527 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:37.526+0000 7f1efce00640 1 -- 172.21.15.72:0/3527721907 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ef81f51d0 con 0x7f1ef80d3370 2024-04-04T06:57:37.527 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:37.526+0000 7f1efe200640 1 --2- 172.21.15.72:0/3527721907 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1ef815e5a0 0x7f1ef80b9930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-04T06:57:37.527 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:37.526+0000 7f1efce00640 1 --2- 172.21.15.72:0/3527721907 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1ef80d3370 0x7f1ef80b93f0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f1ee4000c00 tx=0x7f1ee4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:37.527 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:37.526+0000 7f1ef5600640 1 -- 172.21.15.72:0/3527721907 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ee4048070 con 0x7f1ef80d3370 2024-04-04T06:57:37.527 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:37.526+0000 7f1ef5600640 1 -- 172.21.15.72:0/3527721907 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ee4030640 con 0x7f1ef80d3370 2024-04-04T06:57:37.527 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:37.526+0000 7f1ef5600640 1 -- 172.21.15.72:0/3527721907 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ee4034040 con 0x7f1ef80d3370 2024-04-04T06:57:37.527 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:37.526+0000 7f1efec00640 1 -- 172.21.15.72:0/3527721907 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ef80cb420 con 0x7f1ef80d3370 2024-04-04T06:57:37.527 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:37.526+0000 7f1efec00640 1 -- 172.21.15.72:0/3527721907 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ef80cb9e0 con 0x7f1ef80d3370 2024-04-04T06:57:37.528 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:37.527+0000 7f1efec00640 1 -- 172.21.15.72:0/3527721907 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ef80756c0 con 0x7f1ef80d3370 2024-04-04T06:57:37.528 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:37.528+0000 7f1ef5600640 1 -- 172.21.15.72:0/3527721907 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1ee404b070 con 0x7f1ef80d3370 2024-04-04T06:57:37.529 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:37.530+0000 7f1ef5600640 1 --2- 172.21.15.72:0/3527721907 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f1ed806c8f0 0x7f1ed806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:37.529 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:37.530+0000 7f1ef5600640 1 -- 172.21.15.72:0/3527721907 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f1ee40adbf0 con 0x7f1ef80d3370 2024-04-04T06:57:37.529 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:37.530+0000 7f1efd800640 1 --2- 172.21.15.72:0/3527721907 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f1ed806c8f0 0x7f1ed806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:37.530 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:37.531+0000 7f1efd800640 1 --2- 172.21.15.72:0/3527721907 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f1ed806c8f0 0x7f1ed806edb0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f1eec006fd0 tx=0x7f1eec008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:37.534 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:37.534+0000 7f1ef5600640 1 -- 172.21.15.72:0/3527721907 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f1ee407bf00 con 0x7f1ef80d3370 2024-04-04T06:57:37.724 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:37.724+0000 7f1efec00640 1 -- 172.21.15.72:0/3527721907 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1ef80d2090 con 0x7f1ef80d3370 2024-04-04T06:57:37.725 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:37.726+0000 7f1ef5600640 1 -- 172.21.15.72:0/3527721907 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16831 (secure 0 0 0) 0x7f1ee407b800 con 0x7f1ef80d3370 2024-04-04T06:57:37.726 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T06:57:37.726 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":22,"fsid":"6708bac2-4f50-49b5-87a9-c390fd333eb3","created":"2024-04-04T06:56:04.282498+0000","modified":"2024-04-04T06:57:11.239134+0000","last_up_change":"2024-04-04T06:56:16.716089+0000","last_in_change":"2024-04-04T06:56:07.768593+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-04T06:56:17.421685+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-04T06:56:26.822661+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-04T06:56:27.429816+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7c345991-5af8-4dc6-a481-28610c40e128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":3889813953},{"type":"v1","addr":"172.21.15.72:6818","nonce":3889813953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":3889813953},{"type":"v1","addr":"172.21.15.72:6821","nonce":3889813953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":3889813953},{"type":"v1","addr":"172.21.15.72:6826","nonce":3889813953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":3889813953},{"type":"v1","addr":"172.21.15.72:6823","nonce":3889813953}]},"public_addr":"172.21.15.72:6818/3889813953","cluster_addr":"172.21.15.72:6821/3889813953","heartbeat_back_addr":"172.21.15.72:6826/3889813953","heartbeat_front_addr":"172.21.15.72:6823/3889813953","state":["exists","up"]},{"osd":1,"uuid":"1b3f7ab2-a56c-488d-a89a-1f3572361c95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":3101663154},{"type":"v1","addr":"172.21.15.72:6801","nonce":3101663154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":3101663154},{"type":"v1","addr":"172.21.15.72:6803","nonce":3101663154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":3101663154},{"type":"v1","addr":"172.21.15.72:6807","nonce":3101663154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":3101663154},{"type":"v1","addr":"172.21.15.72:6805","nonce":3101663154}]},"public_addr":"172.21.15.72:6801/3101663154","cluster_addr":"172.21.15.72:6803/3101663154","heartbeat_back_addr":"172.21.15.72:6807/3101663154","heartbeat_front_addr":"172.21.15.72:6805/3101663154","state":["exists","up"]},{"osd":2,"uuid":"fc9aa512-53df-40d7-ba04-3e6b7dcd1e34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":235374192},{"type":"v1","addr":"172.21.15.72:6809","nonce":235374192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":235374192},{"type":"v1","addr":"172.21.15.72:6811","nonce":235374192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":235374192},{"type":"v1","addr":"172.21.15.72:6815","nonce":235374192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":235374192},{"type":"v1","addr":"172.21.15.72:6813","nonce":235374192}]},"public_addr":"172.21.15.72:6809/235374192","cluster_addr":"172.21.15.72:6811/235374192","heartbeat_back_addr":"172.21.15.72:6815/235374192","heartbeat_front_addr":"172.21.15.72:6813/235374192","state":["exists","up"]},{"osd":3,"uuid":"b4f63eed-dc5b-4aba-bb50-de46eb41492b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6817","nonce":2806631742},{"type":"v1","addr":"172.21.15.72:6819","nonce":2806631742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":2806631742},{"type":"v1","addr":"172.21.15.72:6827","nonce":2806631742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":2806631742},{"type":"v1","addr":"172.21.15.72:6831","nonce":2806631742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":2806631742},{"type":"v1","addr":"172.21.15.72:6829","nonce":2806631742}]},"public_addr":"172.21.15.72:6819/2806631742","cluster_addr":"172.21.15.72:6827/2806631742","heartbeat_back_addr":"172.21.15.72:6831/2806631742","heartbeat_front_addr":"172.21.15.72:6829/2806631742","state":["exists","up"]},{"osd":4,"uuid":"9e985ef8-d711-4172-9286-c54e560895d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":4293536423},{"type":"v1","addr":"172.21.15.117:6825","nonce":4293536423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":4293536423},{"type":"v1","addr":"172.21.15.117:6827","nonce":4293536423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":4293536423},{"type":"v1","addr":"172.21.15.117:6831","nonce":4293536423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":4293536423},{"type":"v1","addr":"172.21.15.117:6829","nonce":4293536423}]},"public_addr":"172.21.15.117:6825/4293536423","cluster_addr":"172.21.15.117:6827/4293536423","heartbeat_back_addr":"172.21.15.117:6831/4293536423","heartbeat_front_addr":"172.21.15.117:6829/4293536423","state":["exists","up"]},{"osd":5,"uuid":"3e9f082b-8d7d-455f-8a96-66d0b4857125","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":684971679},{"type":"v1","addr":"172.21.15.117:6801","nonce":684971679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":684971679},{"type":"v1","addr":"172.21.15.117:6803","nonce":684971679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":684971679},{"type":"v1","addr":"172.21.15.117:6807","nonce":684971679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":684971679},{"type":"v1","addr":"172.21.15.117:6805","nonce":684971679}]},"public_addr":"172.21.15.117:6801/684971679","cluster_addr":"172.21.15.117:6803/684971679","heartbeat_back_addr":"172.21.15.117:6807/684971679","heartbeat_front_addr":"172.21.15.117:6805/684971679","state":["exists","up"]},{"osd":6,"uuid":"bcdafa9f-a870-4398-a38d-ab7697676473","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":2781186528},{"type":"v1","addr":"172.21.15.117:6809","nonce":2781186528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":2781186528},{"type":"v1","addr":"172.21.15.117:6811","nonce":2781186528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":2781186528},{"type":"v1","addr":"172.21.15.117:6815","nonce":2781186528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":2781186528},{"type":"v1","addr":"172.21.15.117:6813","nonce":2781186528}]},"public_addr":"172.21.15.117:6809/2781186528","cluster_addr":"172.21.15.117:6811/2781186528","heartbeat_back_addr":"172.21.15.117:6815/2781186528","heartbeat_front_addr":"172.21.15.117:6813/2781186528","state":["exists","up"]},{"osd":7,"uuid":"b68ec562-ff35-4d2d-a733-c896f8920cfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":617469882},{"type":"v1","addr":"172.21.15.117:6817","nonce":617469882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":617469882},{"type":"v1","addr":"172.21.15.117:6819","nonce":617469882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":617469882},{"type":"v1","addr":"172.21.15.117:6823","nonce":617469882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":617469882},{"type":"v1","addr":"172.21.15.117:6821","nonce":617469882}]},"public_addr":"172.21.15.117:6817/617469882","cluster_addr":"172.21.15.117:6819/617469882","heartbeat_back_addr":"172.21.15.117:6823/617469882","heartbeat_front_addr":"172.21.15.117:6821/617469882","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.347700+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.296619+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.361345+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.093323+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:12.857605+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:12.816090+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.083163+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.121639+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.13","mappings":[{"from":7,"to":1}]},{"pgid":"3.19","mappings":[{"from":3,"to":2}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.28","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-04T06:57:37.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:37.728+0000 7f1efec00640 1 -- 172.21.15.72:0/3527721907 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f1ed806c8f0 msgr2=0x7f1ed806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:37.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:37.728+0000 7f1efec00640 1 --2- 172.21.15.72:0/3527721907 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f1ed806c8f0 0x7f1ed806edb0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f1eec006fd0 tx=0x7f1eec008040 comp rx=0 tx=0).stop 2024-04-04T06:57:37.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:37.728+0000 7f1efec00640 1 -- 172.21.15.72:0/3527721907 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1ef80d3370 msgr2=0x7f1ef80b93f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:37.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:37.728+0000 7f1efec00640 1 --2- 172.21.15.72:0/3527721907 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1ef80d3370 0x7f1ef80b93f0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f1ee4000c00 tx=0x7f1ee4004730 comp rx=0 tx=0).stop 2024-04-04T06:57:37.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:37.728+0000 7f1efec00640 1 -- 172.21.15.72:0/3527721907 shutdown_connections 2024-04-04T06:57:37.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:37.728+0000 7f1efec00640 1 --2- 172.21.15.72:0/3527721907 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f1ed806c8f0 0x7f1ed806edb0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:37.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:37.728+0000 7f1efec00640 1 --2- 172.21.15.72:0/3527721907 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1ef815e5a0 0x7f1ef80b9930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:37.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:37.728+0000 7f1efec00640 1 --2- 172.21.15.72:0/3527721907 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1ef80d3370 0x7f1ef80b93f0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:37.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:37.728+0000 7f1efec00640 1 --2- 172.21.15.72:0/3527721907 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1ef80b7b00 0x7f1ef8154290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:37.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:37.728+0000 7f1efec00640 1 -- 172.21.15.72:0/3527721907 >> 172.21.15.72:0/3527721907 conn(0x7f1ef806b890 msgr2=0x7f1ef80b50b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:37.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:37.728+0000 7f1efec00640 1 -- 172.21.15.72:0/3527721907 shutdown_connections 2024-04-04T06:57:37.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:37.728+0000 7f1efec00640 1 -- 172.21.15.72:0/3527721907 wait complete. 2024-04-04T06:57:37.744 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-04T06:57:37.938 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:37.938+0000 7f3ef3200640 1 Processor -- start 2024-04-04T06:57:37.939 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:37.939+0000 7f3ef3200640 1 -- start start 2024-04-04T06:57:37.941 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:37.941+0000 7f3ef3200640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f3ef406cb90 0x7f3ef4166fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:37.941 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:37.941+0000 7f3ef3200640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ef4160580 con 0x7f3ef40cbd60 2024-04-04T06:57:37.941 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:37.941+0000 7f3ef3200640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ef4160860 con 0x7f3ef4145a30 2024-04-04T06:57:37.941 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:37.941+0000 7f3ef3200640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f3ef4160b40 con 0x7f3ef406cb90 2024-04-04T06:57:37.941 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:37.941+0000 7f3ef1e00640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f3ef40cbd60 0x7f3ef415fc80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:52310/0 (socket says 172.21.15.72:52310) 2024-04-04T06:57:37.941 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:37.941+0000 7f3ef1e00640 1 -- 172.21.15.72:0/3617963762 learned_addr learned my addr 172.21.15.72:0/3617963762 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-04-04T06:57:37.941 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:37.941+0000 7f3ef2800640 1 --2- 172.21.15.72:0/3617963762 >> v2:172.21.15.72:3300/0 conn(0x7f3ef406cb90 0x7f3ef4166fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:37.942 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:37.942+0000 7f3ef0a00640 1 -- 172.21.15.72:0/3617963762 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3350179727 0 0) 0x7f3ef4160580 con 0x7f3ef40cbd60 2024-04-04T06:57:37.942 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:37.942+0000 7f3ef0a00640 1 -- 172.21.15.72:0/3617963762 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3ed8003520 con 0x7f3ef40cbd60 2024-04-04T06:57:37.942 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:37.942+0000 7f3ef2800640 1 -- 172.21.15.72:0/3617963762 >> v1:172.21.15.117:6789/0 conn(0x7f3ef4145a30 legacy=0x7f3ef406c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:37.942 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:37.942+0000 7f3ef2800640 1 -- 172.21.15.72:0/3617963762 >> v1:172.21.15.72:6789/0 conn(0x7f3ef40cbd60 legacy=0x7f3ef415fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:37.942 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:37.942+0000 7f3ef2800640 1 -- 172.21.15.72:0/3617963762 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ef40cea30 con 0x7f3ef406cb90 2024-04-04T06:57:37.943 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:37.943+0000 7f3ef2800640 1 --2- 172.21.15.72:0/3617963762 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3ef406cb90 0x7f3ef4166fb0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f3eec009d90 tx=0x7f3eec02bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba41cb68821e11f3 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:37.943 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:37.943+0000 7f3ef0a00640 1 -- 172.21.15.72:0/3617963762 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3eec039070 con 0x7f3ef406cb90 2024-04-04T06:57:37.943 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:37.943+0000 7f3ef0a00640 1 -- 172.21.15.72:0/3617963762 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3eec02cd00 con 0x7f3ef406cb90 2024-04-04T06:57:37.943 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:37.943+0000 7f3ef0a00640 1 -- 172.21.15.72:0/3617963762 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3eec034640 con 0x7f3ef406cb90 2024-04-04T06:57:37.944 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:37.944+0000 7f3ef3200640 1 -- 172.21.15.72:0/3617963762 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3ef406cb90 msgr2=0x7f3ef4166fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:37.944 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:37.944+0000 7f3ef3200640 1 --2- 172.21.15.72:0/3617963762 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3ef406cb90 0x7f3ef4166fb0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f3eec009d90 tx=0x7f3eec02bf50 comp rx=0 tx=0).stop 2024-04-04T06:57:37.944 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:37.944+0000 7f3ef3200640 1 -- 172.21.15.72:0/3617963762 shutdown_connections 2024-04-04T06:57:37.944 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:37.944+0000 7f3ef3200640 1 --2- 172.21.15.72:0/3617963762 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3ef406cb90 0x7f3ef4166fb0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:37.944 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:37.944+0000 7f3ef3200640 1 -- 172.21.15.72:0/3617963762 >> 172.21.15.72:0/3617963762 conn(0x7f3ef4072360 msgr2=0x7f3ef4072770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:37.944 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:37.944+0000 7f3ef3200640 1 -- 172.21.15.72:0/3617963762 shutdown_connections 2024-04-04T06:57:37.944 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:37.944+0000 7f3ef3200640 1 -- 172.21.15.72:0/3617963762 wait complete. 2024-04-04T06:57:37.945 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:37.946+0000 7f3ef3200640 1 Processor -- start 2024-04-04T06:57:37.946 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:37.946+0000 7f3ef3200640 1 -- start start 2024-04-04T06:57:37.947 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:37.947+0000 7f3ef3200640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3ef406cb90 0x7f3ef40c7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:37.947 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:37.947+0000 7f3ef3200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3ef40cbd60 0x7f3ef41f47b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:37.947 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:37.947+0000 7f3ef3200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3ef4145a30 0x7f3ef415d800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:37.947 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:37.947+0000 7f3ef3200640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f3ef40cc140 con 0x7f3ef406cb90 2024-04-04T06:57:37.948 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:37.947+0000 7f3ef3200640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f3ef40d0240 con 0x7f3ef40cbd60 2024-04-04T06:57:37.948 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:37.947+0000 7f3ef3200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f3ef40c6780 con 0x7f3ef4145a30 2024-04-04T06:57:37.948 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:37.947+0000 7f3ef1e00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3ef406cb90 0x7f3ef40c7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:37.948 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:37.947+0000 7f3ef1e00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3ef406cb90 0x7f3ef40c7820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:38904/0 (socket says 172.21.15.72:38904) 2024-04-04T06:57:37.948 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:37.947+0000 7f3ef1e00640 1 -- 172.21.15.72:0/592578783 learned_addr learned my addr 172.21.15.72:0/592578783 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:57:37.948 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:37.948+0000 7f3ef1e00640 1 -- 172.21.15.72:0/592578783 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3ef4145a30 msgr2=0x7f3ef415d800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:37.948 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:37.948+0000 7f3ef1e00640 1 --2- 172.21.15.72:0/592578783 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3ef4145a30 0x7f3ef415d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:37.948 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:37.948+0000 7f3ef1e00640 1 -- 172.21.15.72:0/592578783 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3ef40cbd60 msgr2=0x7f3ef41f47b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:37.948 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:37.948+0000 7f3ef1e00640 1 --2- 172.21.15.72:0/592578783 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3ef40cbd60 0x7f3ef41f47b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:37.948 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:37.948+0000 7f3ef1e00640 1 -- 172.21.15.72:0/592578783 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ef40c6a60 con 0x7f3ef406cb90 2024-04-04T06:57:37.949 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:37.948+0000 7f3ef1e00640 1 --2- 172.21.15.72:0/592578783 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3ef406cb90 0x7f3ef40c7820 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f3edc00c500 tx=0x7f3edc00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:37.949 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:37.948+0000 7f3eea000640 1 -- 172.21.15.72:0/592578783 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3edc017070 con 0x7f3ef406cb90 2024-04-04T06:57:37.949 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:37.948+0000 7f3eea000640 1 -- 172.21.15.72:0/592578783 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3edc005ce0 con 0x7f3ef406cb90 2024-04-04T06:57:37.949 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:37.948+0000 7f3eea000640 1 -- 172.21.15.72:0/592578783 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3edc007330 con 0x7f3ef406cb90 2024-04-04T06:57:37.950 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:37.948+0000 7f3ef3200640 1 -- 172.21.15.72:0/592578783 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ef40c6d40 con 0x7f3ef406cb90 2024-04-04T06:57:37.950 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:37.949+0000 7f3ef3200640 1 -- 172.21.15.72:0/592578783 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ef40c7300 con 0x7f3ef406cb90 2024-04-04T06:57:37.950 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:37.950+0000 7f3ef3200640 1 -- 172.21.15.72:0/592578783 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ef40685a0 con 0x7f3ef406cb90 2024-04-04T06:57:37.951 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:37.952+0000 7f3eea000640 1 -- 172.21.15.72:0/592578783 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3edc01a070 con 0x7f3ef406cb90 2024-04-04T06:57:37.952 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:37.953+0000 7f3eea000640 1 --2- 172.21.15.72:0/592578783 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f3ed006c8f0 0x7f3ed006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:37.952 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:37.953+0000 7f3eea000640 1 -- 172.21.15.72:0/592578783 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f3edc08afe0 con 0x7f3ef406cb90 2024-04-04T06:57:37.952 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:37.953+0000 7f3ef1400640 1 --2- 172.21.15.72:0/592578783 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f3ed006c8f0 0x7f3ed006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:37.953 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:37.954+0000 7f3ef1400640 1 --2- 172.21.15.72:0/592578783 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f3ed006c8f0 0x7f3ed006edb0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f3ee4000f60 tx=0x7f3ee40079d0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:37.957 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:37.958+0000 7f3eea000640 1 -- 172.21.15.72:0/592578783 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f3edc0594e0 con 0x7f3ef406cb90 2024-04-04T06:57:38.195 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:38.195+0000 7f3ef3200640 1 -- 172.21.15.72:0/592578783 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f3ef4073500 con 0x7f3ef406cb90 2024-04-04T06:57:38.196 INFO:tasks.ceph.mon.a.smithi072.stderr:2024-04-04T06:57:38.196+0000 7fd332800640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-04T06:57:38.199 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:38.200+0000 7f3eea000640 1 -- 172.21.15.72:0/592578783 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) ==== 161+0+0 (secure 0 0 0) 0x7f3edc058de0 con 0x7f3ef406cb90 2024-04-04T06:57:38.199 INFO:teuthology.orchestra.run.smithi072.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-04T06:57:38.203 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:38.202+0000 7f3ef3200640 1 -- 172.21.15.72:0/592578783 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f3ed006c8f0 msgr2=0x7f3ed006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:38.203 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:38.202+0000 7f3ef3200640 1 --2- 172.21.15.72:0/592578783 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f3ed006c8f0 0x7f3ed006edb0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f3ee4000f60 tx=0x7f3ee40079d0 comp rx=0 tx=0).stop 2024-04-04T06:57:38.203 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:38.202+0000 7f3ef3200640 1 -- 172.21.15.72:0/592578783 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3ef406cb90 msgr2=0x7f3ef40c7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:38.203 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:38.202+0000 7f3ef3200640 1 --2- 172.21.15.72:0/592578783 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3ef406cb90 0x7f3ef40c7820 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f3edc00c500 tx=0x7f3edc00c9c0 comp rx=0 tx=0).stop 2024-04-04T06:57:38.203 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:38.203+0000 7f3ef3200640 1 -- 172.21.15.72:0/592578783 shutdown_connections 2024-04-04T06:57:38.203 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:38.203+0000 7f3ef3200640 1 --2- 172.21.15.72:0/592578783 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f3ed006c8f0 0x7f3ed006edb0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:38.203 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:38.203+0000 7f3ef3200640 1 --2- 172.21.15.72:0/592578783 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3ef4145a30 0x7f3ef415d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:38.203 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:38.203+0000 7f3ef3200640 1 --2- 172.21.15.72:0/592578783 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3ef40cbd60 0x7f3ef41f47b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:38.203 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:38.203+0000 7f3ef3200640 1 --2- 172.21.15.72:0/592578783 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3ef406cb90 0x7f3ef40c7820 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:38.203 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:38.203+0000 7f3ef3200640 1 -- 172.21.15.72:0/592578783 >> 172.21.15.72:0/592578783 conn(0x7f3ef4072360 msgr2=0x7f3ef40744d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:38.203 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:38.203+0000 7f3ef3200640 1 -- 172.21.15.72:0/592578783 shutdown_connections 2024-04-04T06:57:38.203 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:38.203+0000 7f3ef3200640 1 -- 172.21.15.72:0/592578783 wait complete. 2024-04-04T06:57:38.212 INFO:tasks.ceph.mds.c.smithi072.stderr: -4127> 2024-04-04T06:56:34.845+0000 7f8110a00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-04T06:57:38.220 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-04T06:57:38.276 INFO:tasks.ceph.mds.c.smithi072.stdout:starting mds.c at 2024-04-04T06:57:38.403 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:38.403+0000 7f999e400640 1 Processor -- start 2024-04-04T06:57:38.403 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:38.403+0000 7f999e400640 1 -- start start 2024-04-04T06:57:38.405 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:38.404+0000 7f999e400640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f9998145b10 0x7f999806d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:38.405 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:38.405+0000 7f999e400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f999806dac0 0x7f99980cfa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:38.405 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:38.405+0000 7f999e400640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9998145ef0 con 0x7f99980cff40 2024-04-04T06:57:38.405 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:38.405+0000 7f999e400640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f99980cea10 con 0x7f9998145b10 2024-04-04T06:57:38.405 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:38.405+0000 7f999e400640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f999806e310 con 0x7f999806dac0 2024-04-04T06:57:38.405 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:38.405+0000 7f9997e00640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f99980cff40 0x7f999815fe90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:52342/0 (socket says 172.21.15.72:52342) 2024-04-04T06:57:38.405 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:38.405+0000 7f9997e00640 1 -- 172.21.15.72:0/3813499369 learned_addr learned my addr 172.21.15.72:0/3813499369 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-04-04T06:57:38.405 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:38.405+0000 7f9997400640 1 --2- 172.21.15.72:0/3813499369 >> v2:172.21.15.72:3300/0 conn(0x7f9998145b10 0x7f999806d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:38.405 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:38.405+0000 7f9996a00640 1 --2- 172.21.15.72:0/3813499369 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f999806dac0 0x7f99980cfa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:38.406 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:38.405+0000 7f9996000640 1 -- 172.21.15.72:0/3813499369 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3756147950 0 0) 0x7f9998145ef0 con 0x7f99980cff40 2024-04-04T06:57:38.406 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:38.406+0000 7f9997400640 1 -- 172.21.15.72:0/3813499369 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f999806dac0 msgr2=0x7f99980cfa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:57:38.407 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:38.406+0000 7f9997400640 1 --2- 172.21.15.72:0/3813499369 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f999806dac0 0x7f99980cfa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:38.407 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:38.406+0000 7f9997400640 1 -- 172.21.15.72:0/3813499369 >> v1:172.21.15.72:6789/0 conn(0x7f99980cff40 legacy=0x7f999815fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:38.407 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:38.406+0000 7f9997400640 1 -- 172.21.15.72:0/3813499369 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99980cec40 con 0x7f9998145b10 2024-04-04T06:57:38.407 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:38.407+0000 7f9997400640 1 --2- 172.21.15.72:0/3813499369 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9998145b10 0x7f999806d580 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f99880097a0 tx=0x7f998802b820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aab294ab39b536b6 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:38.407 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:38.407+0000 7f9996000640 1 -- 172.21.15.72:0/3813499369 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9988031780 con 0x7f9998145b10 2024-04-04T06:57:38.407 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:38.407+0000 7f9996000640 1 -- 172.21.15.72:0/3813499369 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9988037070 con 0x7f9998145b10 2024-04-04T06:57:38.407 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:38.407+0000 7f9996000640 1 -- 172.21.15.72:0/3813499369 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9988031b40 con 0x7f9998145b10 2024-04-04T06:57:38.408 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:38.407+0000 7f999e400640 1 -- 172.21.15.72:0/3813499369 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9998145b10 msgr2=0x7f999806d580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:38.408 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:38.407+0000 7f999e400640 1 --2- 172.21.15.72:0/3813499369 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9998145b10 0x7f999806d580 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f99880097a0 tx=0x7f998802b820 comp rx=0 tx=0).stop 2024-04-04T06:57:38.408 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:38.408+0000 7f999e400640 1 -- 172.21.15.72:0/3813499369 shutdown_connections 2024-04-04T06:57:38.408 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:38.408+0000 7f999e400640 1 --2- 172.21.15.72:0/3813499369 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f999806dac0 0x7f99980cfa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:38.408 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:38.408+0000 7f999e400640 1 --2- 172.21.15.72:0/3813499369 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9998145b10 0x7f999806d580 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:38.408 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:38.408+0000 7f999e400640 1 -- 172.21.15.72:0/3813499369 >> 172.21.15.72:0/3813499369 conn(0x7f999806b470 msgr2=0x7f999806b850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:38.408 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:38.408+0000 7f999e400640 1 -- 172.21.15.72:0/3813499369 shutdown_connections 2024-04-04T06:57:38.408 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:38.408+0000 7f999e400640 1 -- 172.21.15.72:0/3813499369 wait complete. 2024-04-04T06:57:38.409 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:38.409+0000 7f999e400640 1 Processor -- start 2024-04-04T06:57:38.409 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:38.409+0000 7f999e400640 1 -- start start 2024-04-04T06:57:38.412 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:38.410+0000 7f999e400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f999806dac0 0x7f9998159d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:38.412 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:38.410+0000 7f999e400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f99980cff40 0x7f99980afb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:38.412 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:38.410+0000 7f999e400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9998145b10 0x7f99981f53d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:38.412 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:38.410+0000 7f999e400640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f99980cf4e0 con 0x7f9998145b10 2024-04-04T06:57:38.412 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:38.410+0000 7f999e400640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f99980cf200 con 0x7f999806dac0 2024-04-04T06:57:38.412 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:38.410+0000 7f999e400640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f999806df40 con 0x7f99980cff40 2024-04-04T06:57:38.412 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:38.411+0000 7f9997e00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9998145b10 0x7f99981f53d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:38.412 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:38.411+0000 7f9997e00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9998145b10 0x7f99981f53d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:38936/0 (socket says 172.21.15.72:38936) 2024-04-04T06:57:38.412 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:38.411+0000 7f9997e00640 1 -- 172.21.15.72:0/246023582 learned_addr learned my addr 172.21.15.72:0/246023582 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:57:38.412 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:38.411+0000 7f9997400640 1 --2- 172.21.15.72:0/246023582 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f999806dac0 0x7f9998159d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:38.412 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:38.411+0000 7f9997e00640 1 -- 172.21.15.72:0/246023582 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f99980cff40 msgr2=0x7f99980afb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:38.412 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:38.411+0000 7f9997e00640 1 --2- 172.21.15.72:0/246023582 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f99980cff40 0x7f99980afb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:38.412 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:38.411+0000 7f9997e00640 1 -- 172.21.15.72:0/246023582 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f999806dac0 msgr2=0x7f9998159d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:38.413 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:38.411+0000 7f9997e00640 1 --2- 172.21.15.72:0/246023582 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f999806dac0 0x7f9998159d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:38.413 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:38.411+0000 7f9997e00640 1 -- 172.21.15.72:0/246023582 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99980b0390 con 0x7f9998145b10 2024-04-04T06:57:38.413 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:38.411+0000 7f9997400640 1 --2- 172.21.15.72:0/246023582 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f999806dac0 0x7f9998159d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-04T06:57:38.413 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:38.412+0000 7f9997e00640 1 --2- 172.21.15.72:0/246023582 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9998145b10 0x7f99981f53d0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f999000c390 tx=0x7f999000c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:38.413 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:38.412+0000 7f998f400640 1 -- 172.21.15.72:0/246023582 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9990017070 con 0x7f9998145b10 2024-04-04T06:57:38.413 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:38.412+0000 7f998f400640 1 -- 172.21.15.72:0/246023582 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9990005ce0 con 0x7f9998145b10 2024-04-04T06:57:38.413 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:38.412+0000 7f998f400640 1 -- 172.21.15.72:0/246023582 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9990007310 con 0x7f9998145b10 2024-04-04T06:57:38.413 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:38.412+0000 7f999e400640 1 -- 172.21.15.72:0/246023582 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99980b0670 con 0x7f9998145b10 2024-04-04T06:57:38.413 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:38.412+0000 7f999e400640 1 -- 172.21.15.72:0/246023582 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99981f4230 con 0x7f9998145b10 2024-04-04T06:57:38.414 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:38.413+0000 7f999e400640 1 -- 172.21.15.72:0/246023582 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9998075730 con 0x7f9998145b10 2024-04-04T06:57:38.414 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:38.414+0000 7f998f400640 1 -- 172.21.15.72:0/246023582 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f999001a070 con 0x7f9998145b10 2024-04-04T06:57:38.415 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:38.416+0000 7f998f400640 1 --2- 172.21.15.72:0/246023582 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f997406c920 0x7f997406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:38.415 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:38.416+0000 7f998f400640 1 -- 172.21.15.72:0/246023582 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5911+0+0 (secure 0 0 0) 0x7f999008aec0 con 0x7f9998145b10 2024-04-04T06:57:38.415 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:38.416+0000 7f9997400640 1 --2- 172.21.15.72:0/246023582 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f997406c920 0x7f997406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:38.415 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:38.416+0000 7f9997400640 1 --2- 172.21.15.72:0/246023582 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f997406c920 0x7f997406ede0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f9988036000 tx=0x7f9988008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:38.419 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:38.420+0000 7f998f400640 1 -- 172.21.15.72:0/246023582 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f99900592b0 con 0x7f9998145b10 2024-04-04T06:57:38.658 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:38.658+0000 7f999e400640 1 -- 172.21.15.72:0/246023582 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f99980d0c00 con 0x7f9998145b10 2024-04-04T06:57:39.203 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:39.204+0000 7f998f400640 1 -- 172.21.15.72:0/246023582 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) ==== 104+0+0 (secure 0 0 0) 0x7f9990058bb0 con 0x7f9998145b10 2024-04-04T06:57:39.207 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:39.207+0000 7f999e400640 1 -- 172.21.15.72:0/246023582 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f997406c920 msgr2=0x7f997406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:39.207 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:39.207+0000 7f999e400640 1 --2- 172.21.15.72:0/246023582 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f997406c920 0x7f997406ede0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f9988036000 tx=0x7f9988008030 comp rx=0 tx=0).stop 2024-04-04T06:57:39.207 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:39.208+0000 7f999e400640 1 -- 172.21.15.72:0/246023582 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9998145b10 msgr2=0x7f99981f53d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:39.207 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:39.208+0000 7f999e400640 1 --2- 172.21.15.72:0/246023582 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9998145b10 0x7f99981f53d0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f999000c390 tx=0x7f999000c850 comp rx=0 tx=0).stop 2024-04-04T06:57:39.207 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:39.208+0000 7f999e400640 1 -- 172.21.15.72:0/246023582 shutdown_connections 2024-04-04T06:57:39.207 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:39.208+0000 7f999e400640 1 --2- 172.21.15.72:0/246023582 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f997406c920 0x7f997406ede0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:39.207 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:39.208+0000 7f999e400640 1 --2- 172.21.15.72:0/246023582 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9998145b10 0x7f99981f53d0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:39.207 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:39.208+0000 7f999e400640 1 --2- 172.21.15.72:0/246023582 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f99980cff40 0x7f99980afb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:39.207 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:39.208+0000 7f999e400640 1 --2- 172.21.15.72:0/246023582 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f999806dac0 0x7f9998159d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:39.207 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:39.208+0000 7f999e400640 1 -- 172.21.15.72:0/246023582 >> 172.21.15.72:0/246023582 conn(0x7f999806b470 msgr2=0x7f99980b43a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:39.208 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:39.208+0000 7f999e400640 1 -- 172.21.15.72:0/246023582 shutdown_connections 2024-04-04T06:57:39.208 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:39.208+0000 7f999e400640 1 -- 172.21.15.72:0/246023582 wait complete. 2024-04-04T06:57:39.231 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-04T06:57:39.449 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:39.450+0000 7f6615800640 1 Processor -- start 2024-04-04T06:57:39.449 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:39.450+0000 7f6615800640 1 -- start start 2024-04-04T06:57:39.450 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:39.452+0000 7f6615800640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f66100af060 0x7f66100cad00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:39.451 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:39.452+0000 7f6615800640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6610161dc0 0x7f6610162230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:39.451 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:39.452+0000 7f6615800640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6610072df0 con 0x7f661015e320 2024-04-04T06:57:39.451 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:39.452+0000 7f6615800640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f661015e700 con 0x7f66100af060 2024-04-04T06:57:39.451 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:39.452+0000 7f6615800640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f66100cb240 con 0x7f6610161dc0 2024-04-04T06:57:39.451 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:39.452+0000 7f660fe00640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f661015e320 0x7f66100cf3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:39638/0 (socket says 172.21.15.72:39638) 2024-04-04T06:57:39.451 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:39.452+0000 7f660fe00640 1 -- 172.21.15.72:0/1895757158 learned_addr learned my addr 172.21.15.72:0/1895757158 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-04-04T06:57:39.453 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:39.452+0000 7f6607e00640 1 --2- 172.21.15.72:0/1895757158 >> v2:172.21.15.117:3300/0 conn(0x7f66100af060 0x7f66100cad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:39.453 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:39.452+0000 7f660f400640 1 -- 172.21.15.72:0/1895757158 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2303955997 0 0) 0x7f6610072df0 con 0x7f661015e320 2024-04-04T06:57:39.453 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:39.452+0000 7f6614e00640 1 --2- 172.21.15.72:0/1895757158 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6610161dc0 0x7f6610162230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:39.453 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:39.453+0000 7f660f400640 1 -- 172.21.15.72:0/1895757158 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f65f4003520 con 0x7f661015e320 2024-04-04T06:57:39.453 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:39.453+0000 7f660f400640 1 -- 172.21.15.72:0/1895757158 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2977536423 0 0) 0x7f65f4003520 con 0x7f661015e320 2024-04-04T06:57:39.453 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:39.453+0000 7f660f400640 1 -- 172.21.15.72:0/1895757158 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6610161dc0 msgr2=0x7f6610162230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:57:39.453 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:39.453+0000 7f660f400640 1 --2- 172.21.15.72:0/1895757158 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6610161dc0 0x7f6610162230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:39.454 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:39.453+0000 7f660f400640 1 -- 172.21.15.72:0/1895757158 >> v2:172.21.15.117:3300/0 conn(0x7f66100af060 msgr2=0x7f66100cad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:57:39.454 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:39.453+0000 7f660f400640 1 --2- 172.21.15.72:0/1895757158 >> v2:172.21.15.117:3300/0 conn(0x7f66100af060 0x7f66100cad00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:39.454 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:39.453+0000 7f660f400640 1 -- 172.21.15.72:0/1895757158 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6610073090 con 0x7f661015e320 2024-04-04T06:57:39.454 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:39.453+0000 7f660f400640 1 -- 172.21.15.72:0/1895757158 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2465650867 0 0) 0x7f6600001670 con 0x7f661015e320 2024-04-04T06:57:39.454 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:39.453+0000 7f660f400640 1 -- 172.21.15.72:0/1895757158 >> v1:172.21.15.72:6789/0 conn(0x7f661015e320 legacy=0x7f66100cf3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:39.454 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:39.453+0000 7f660f400640 1 --2- 172.21.15.72:0/1895757158 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f65f40039b0 0x7f65f4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:39.454 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:39.453+0000 7f660f400640 1 --2- 172.21.15.72:0/1895757158 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f65f4004800 0x7f65f4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:39.454 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:39.453+0000 7f660f400640 1 --2- 172.21.15.72:0/1895757158 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6610161dc0 0x7f65f40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:39.454 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:39.453+0000 7f660f400640 1 -- 172.21.15.72:0/1895757158 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f661015e700 con 0x7f65f4004800 2024-04-04T06:57:39.454 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:39.453+0000 7f660f400640 1 -- 172.21.15.72:0/1895757158 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f66100cb240 con 0x7f65f40039b0 2024-04-04T06:57:39.454 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:39.453+0000 7f660f400640 1 -- 172.21.15.72:0/1895757158 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f65f400b9c0 con 0x7f6610161dc0 2024-04-04T06:57:39.454 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:39.453+0000 7f6607e00640 1 --2- 172.21.15.72:0/1895757158 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f65f4004800 0x7f65f4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:39.454 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:39.454+0000 7f660fe00640 1 --2- 172.21.15.72:0/1895757158 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f65f40039b0 0x7f65f4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:39.454 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:39.454+0000 7f6614e00640 1 --2- 172.21.15.72:0/1895757158 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6610161dc0 0x7f65f40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:39.454 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:39.454+0000 7f6607e00640 1 -- 172.21.15.72:0/1895757158 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6610161dc0 msgr2=0x7f65f40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:57:39.455 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:39.454+0000 7f6607e00640 1 --2- 172.21.15.72:0/1895757158 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6610161dc0 0x7f65f40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:39.455 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:39.454+0000 7f6607e00640 1 -- 172.21.15.72:0/1895757158 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f65f40039b0 msgr2=0x7f65f4003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:57:39.455 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:39.454+0000 7f6607e00640 1 --2- 172.21.15.72:0/1895757158 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f65f40039b0 0x7f65f4003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:39.455 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:39.454+0000 7f6607e00640 1 -- 172.21.15.72:0/1895757158 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65f4003520 con 0x7f65f4004800 2024-04-04T06:57:39.455 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:39.454+0000 7f6614e00640 1 --2- 172.21.15.72:0/1895757158 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6610161dc0 0x7f65f40051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-04T06:57:39.456 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:39.455+0000 7f6607e00640 1 --2- 172.21.15.72:0/1895757158 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f65f4004800 0x7f65f4004c80 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f65f8009ac0 tx=0x7f65f4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b17544dbce253ed0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:39.456 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:39.455+0000 7f660f400640 1 -- 172.21.15.72:0/1895757158 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65f8039070 con 0x7f65f4004800 2024-04-04T06:57:39.456 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:39.455+0000 7f660f400640 1 -- 172.21.15.72:0/1895757158 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65f802c6d0 con 0x7f65f4004800 2024-04-04T06:57:39.456 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:39.455+0000 7f660f400640 1 -- 172.21.15.72:0/1895757158 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65f8009690 con 0x7f65f4004800 2024-04-04T06:57:39.456 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:39.456+0000 7f6615800640 1 -- 172.21.15.72:0/1895757158 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f65f4004800 msgr2=0x7f65f4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:39.456 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:39.456+0000 7f6615800640 1 --2- 172.21.15.72:0/1895757158 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f65f4004800 0x7f65f4004c80 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f65f8009ac0 tx=0x7f65f4005830 comp rx=0 tx=0).stop 2024-04-04T06:57:39.456 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:39.456+0000 7f6614e00640 1 -- 172.21.15.72:0/1895757158 reap_dead start 2024-04-04T06:57:39.456 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:39.456+0000 7f6615800640 1 -- 172.21.15.72:0/1895757158 shutdown_connections 2024-04-04T06:57:39.456 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:39.456+0000 7f6615800640 1 -- 172.21.15.72:0/1895757158 >> 172.21.15.72:0/1895757158 conn(0x7f66100b1870 msgr2=0x7f66100b1c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:39.457 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:39.456+0000 7f6615800640 1 -- 172.21.15.72:0/1895757158 shutdown_connections 2024-04-04T06:57:39.457 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:39.456+0000 7f6615800640 1 -- 172.21.15.72:0/1895757158 wait complete. 2024-04-04T06:57:39.458 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:39.458+0000 7f6615800640 1 Processor -- start 2024-04-04T06:57:39.459 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:39.458+0000 7f6615800640 1 -- start start 2024-04-04T06:57:39.459 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:39.459+0000 7f6615800640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f65f4004800 0x7f661009aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:39.459 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:39.459+0000 7f6615800640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f66100c4560 0x7f661015b260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:39.459 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:39.459+0000 7f6615800640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f661009cd00 0x7f661009d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:39.459 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:39.459+0000 7f6615800640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f66100714d0 con 0x7f661009cd00 2024-04-04T06:57:39.459 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:39.459+0000 7f6615800640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f66100711f0 con 0x7f65f4004800 2024-04-04T06:57:39.459 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:39.459+0000 7f6615800640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f66100cfac0 con 0x7f66100c4560 2024-04-04T06:57:39.459 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:39.459+0000 7f6614e00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f661009cd00 0x7f661009d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:39.459 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:39.459+0000 7f6614e00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f661009cd00 0x7f661009d1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:37724/0 (socket says 172.21.15.72:37724) 2024-04-04T06:57:39.459 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:39.459+0000 7f6614e00640 1 -- 172.21.15.72:0/1852144459 learned_addr learned my addr 172.21.15.72:0/1852144459 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:57:39.459 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:39.460+0000 7f660fe00640 1 --2- 172.21.15.72:0/1852144459 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f65f4004800 0x7f661009aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:39.459 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:39.460+0000 7f6607e00640 1 --2- 172.21.15.72:0/1852144459 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f66100c4560 0x7f661015b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:39.459 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:39.460+0000 7f6614e00640 1 -- 172.21.15.72:0/1852144459 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f66100c4560 msgr2=0x7f661015b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:39.459 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:39.460+0000 7f6614e00640 1 --2- 172.21.15.72:0/1852144459 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f66100c4560 0x7f661015b260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:39.460 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:39.460+0000 7f6614e00640 1 -- 172.21.15.72:0/1852144459 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f65f4004800 msgr2=0x7f661009aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:39.460 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:39.460+0000 7f6614e00640 1 --2- 172.21.15.72:0/1852144459 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f65f4004800 0x7f661009aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:39.460 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:39.460+0000 7f6614e00640 1 -- 172.21.15.72:0/1852144459 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f661009b2a0 con 0x7f661009cd00 2024-04-04T06:57:39.460 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:39.460+0000 7f660fe00640 1 --2- 172.21.15.72:0/1852144459 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f65f4004800 0x7f661009aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-04T06:57:39.460 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:39.460+0000 7f6614e00640 1 --2- 172.21.15.72:0/1852144459 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f661009cd00 0x7f661009d1b0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f66100b28b0 tx=0x7f660800f4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:39.461 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:39.460+0000 7f660cc00640 1 -- 172.21.15.72:0/1852144459 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f660801c070 con 0x7f661009cd00 2024-04-04T06:57:39.461 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:39.460+0000 7f660cc00640 1 -- 172.21.15.72:0/1852144459 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6608017400 con 0x7f661009cd00 2024-04-04T06:57:39.461 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:39.460+0000 7f6615800640 1 -- 172.21.15.72:0/1852144459 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66100c6d70 con 0x7f661009cd00 2024-04-04T06:57:39.461 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:39.460+0000 7f660cc00640 1 -- 172.21.15.72:0/1852144459 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66080177d0 con 0x7f661009cd00 2024-04-04T06:57:39.461 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:39.461+0000 7f6615800640 1 -- 172.21.15.72:0/1852144459 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66100af7e0 con 0x7f661009cd00 2024-04-04T06:57:39.461 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:39.462+0000 7f6615800640 1 -- 172.21.15.72:0/1852144459 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66100756c0 con 0x7f661009cd00 2024-04-04T06:57:39.461 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:39.463+0000 7f660cc00640 1 -- 172.21.15.72:0/1852144459 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6608005d10 con 0x7f661009cd00 2024-04-04T06:57:39.462 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:39.463+0000 7f660cc00640 1 --2- 172.21.15.72:0/1852144459 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f65ec06c8f0 0x7f65ec06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:39.462 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:39.464+0000 7f660cc00640 1 -- 172.21.15.72:0/1852144459 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5911+0+0 (secure 0 0 0) 0x7f660808bea0 con 0x7f661009cd00 2024-04-04T06:57:39.462 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:39.464+0000 7f660fe00640 1 --2- 172.21.15.72:0/1852144459 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f65ec06c8f0 0x7f65ec06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:39.463 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:39.465+0000 7f660fe00640 1 --2- 172.21.15.72:0/1852144459 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f65ec06c8f0 0x7f65ec06edb0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f6600001eb0 tx=0x7f6600000f70 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:39.467 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:39.468+0000 7f660cc00640 1 -- 172.21.15.72:0/1852144459 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f6608012070 con 0x7f661009cd00 2024-04-04T06:57:39.670 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:39.671+0000 7f6615800640 1 -- 172.21.15.72:0/1852144459 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f66100c6770 con 0x7f661009cd00 2024-04-04T06:57:40.448 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:40.448+0000 7f660cc00640 1 -- 172.21.15.72:0/1852144459 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v24) ==== 181+0+0 (secure 0 0 0) 0x7f660805a1f0 con 0x7f661009cd00 2024-04-04T06:57:40.448 INFO:teuthology.orchestra.run.smithi072.stderr:pool 'cephfs_metadata' removed 2024-04-04T06:57:40.451 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:40.452+0000 7f6615800640 1 -- 172.21.15.72:0/1852144459 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f65ec06c8f0 msgr2=0x7f65ec06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:40.451 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:40.452+0000 7f6615800640 1 --2- 172.21.15.72:0/1852144459 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f65ec06c8f0 0x7f65ec06edb0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f6600001eb0 tx=0x7f6600000f70 comp rx=0 tx=0).stop 2024-04-04T06:57:40.451 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:40.452+0000 7f6615800640 1 -- 172.21.15.72:0/1852144459 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f661009cd00 msgr2=0x7f661009d1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:40.451 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:40.452+0000 7f6615800640 1 --2- 172.21.15.72:0/1852144459 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f661009cd00 0x7f661009d1b0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f66100b28b0 tx=0x7f660800f4a0 comp rx=0 tx=0).stop 2024-04-04T06:57:40.451 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:40.452+0000 7f6615800640 1 -- 172.21.15.72:0/1852144459 shutdown_connections 2024-04-04T06:57:40.451 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:40.452+0000 7f6615800640 1 --2- 172.21.15.72:0/1852144459 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f65ec06c8f0 0x7f65ec06edb0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:40.452 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:40.452+0000 7f6615800640 1 --2- 172.21.15.72:0/1852144459 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f661009cd00 0x7f661009d1b0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:40.452 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:40.452+0000 7f6615800640 1 --2- 172.21.15.72:0/1852144459 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f66100c4560 0x7f661015b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:40.452 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:40.452+0000 7f6615800640 1 --2- 172.21.15.72:0/1852144459 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f65f4004800 0x7f661009aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:40.452 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:40.452+0000 7f6615800640 1 -- 172.21.15.72:0/1852144459 >> 172.21.15.72:0/1852144459 conn(0x7f66100b1870 msgr2=0x7f66100cdda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:40.452 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:40.453+0000 7f6615800640 1 -- 172.21.15.72:0/1852144459 shutdown_connections 2024-04-04T06:57:40.452 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:40.453+0000 7f6615800640 1 -- 172.21.15.72:0/1852144459 wait complete. 2024-04-04T06:57:40.472 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-04T06:57:40.673 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:40.674+0000 7f641d400640 1 Processor -- start 2024-04-04T06:57:40.673 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:40.674+0000 7f641d400640 1 -- start start 2024-04-04T06:57:40.674 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:40.675+0000 7f641d400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f641815c2d0 0x7f6418071610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:40.675 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:40.675+0000 7f641d400640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f641815c6b0 0x7f64180c5e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:40.675 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:40.676+0000 7f641d400640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f64180c6710 con 0x7f64180ccb20 2024-04-04T06:57:40.675 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:40.676+0000 7f641d400640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f64180c6fb0 con 0x7f641815c6b0 2024-04-04T06:57:40.675 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:40.676+0000 7f641d400640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f64180c69f0 con 0x7f641815c2d0 2024-04-04T06:57:40.675 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:40.676+0000 7f6417200640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f64180ccb20 0x7f64180b3ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:39650/0 (socket says 172.21.15.72:39650) 2024-04-04T06:57:40.675 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:40.676+0000 7f6417200640 1 -- 172.21.15.72:0/987238249 learned_addr learned my addr 172.21.15.72:0/987238249 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-04-04T06:57:40.675 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:40.676+0000 7f6415e00640 1 --2- 172.21.15.72:0/987238249 >> v2:172.21.15.72:3300/0 conn(0x7f641815c6b0 0x7f64180c5e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:40.676 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:40.676+0000 7f6416800640 1 --2- 172.21.15.72:0/987238249 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f641815c2d0 0x7f6418071610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:40.676 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:40.676+0000 7f6415e00640 1 -- 172.21.15.72:0/987238249 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f641815c2d0 msgr2=0x7f6418071610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:57:40.676 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:40.677+0000 7f6415e00640 1 --2- 172.21.15.72:0/987238249 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f641815c2d0 0x7f6418071610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:40.676 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:40.677+0000 7f6415e00640 1 -- 172.21.15.72:0/987238249 >> v1:172.21.15.72:6789/0 conn(0x7f64180ccb20 legacy=0x7f64180b3ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:40.676 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:40.677+0000 7f6415e00640 1 -- 172.21.15.72:0/987238249 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64180c6cd0 con 0x7f641815c6b0 2024-04-04T06:57:40.676 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:40.677+0000 7f6415400640 1 -- 172.21.15.72:0/987238249 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1280783777 0 0) 0x7f64180c6710 con 0x7f64180ccb20 2024-04-04T06:57:40.677 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:40.678+0000 7f6415e00640 1 --2- 172.21.15.72:0/987238249 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f641815c6b0 0x7f64180c5e50 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f64040097a0 tx=0x7f640402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee72b5c6a030e59a server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:40.677 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:40.678+0000 7f6415400640 1 -- 172.21.15.72:0/987238249 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64040315a0 con 0x7f641815c6b0 2024-04-04T06:57:40.677 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:40.678+0000 7f6415400640 1 -- 172.21.15.72:0/987238249 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6404037070 con 0x7f641815c6b0 2024-04-04T06:57:40.678 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:40.678+0000 7f6415400640 1 -- 172.21.15.72:0/987238249 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6404031960 con 0x7f641815c6b0 2024-04-04T06:57:40.678 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:40.678+0000 7f641d400640 1 -- 172.21.15.72:0/987238249 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f641815c6b0 msgr2=0x7f64180c5e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:40.678 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:40.678+0000 7f641d400640 1 --2- 172.21.15.72:0/987238249 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f641815c6b0 0x7f64180c5e50 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f64040097a0 tx=0x7f640402b840 comp rx=0 tx=0).stop 2024-04-04T06:57:40.678 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:40.679+0000 7f641d400640 1 -- 172.21.15.72:0/987238249 shutdown_connections 2024-04-04T06:57:40.678 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:40.679+0000 7f641d400640 1 --2- 172.21.15.72:0/987238249 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f641815c6b0 0x7f64180c5e50 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:40.678 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:40.679+0000 7f641d400640 1 --2- 172.21.15.72:0/987238249 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f641815c2d0 0x7f6418071610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:40.678 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:40.679+0000 7f641d400640 1 -- 172.21.15.72:0/987238249 >> 172.21.15.72:0/987238249 conn(0x7f641806b470 msgr2=0x7f641806b880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:40.678 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:40.679+0000 7f641d400640 1 -- 172.21.15.72:0/987238249 shutdown_connections 2024-04-04T06:57:40.678 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:40.679+0000 7f641d400640 1 -- 172.21.15.72:0/987238249 wait complete. 2024-04-04T06:57:40.679 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:40.680+0000 7f641d400640 1 Processor -- start 2024-04-04T06:57:40.679 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:40.681+0000 7f641d400640 1 -- start start 2024-04-04T06:57:40.682 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:40.681+0000 7f641d400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f64180ccb20 0x7f64181f4750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:40.682 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:40.681+0000 7f641d400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f641815c2d0 0x7f64180cc2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:40.682 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:40.682+0000 7f641d400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f641815c6b0 0x7f64180aee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:40.682 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:40.682+0000 7f641d400640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f64180ccfb0 con 0x7f641815c6b0 2024-04-04T06:57:40.682 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:40.682+0000 7f641d400640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f64180c6390 con 0x7f641815c2d0 2024-04-04T06:57:40.682 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:40.682+0000 7f641d400640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f64180cd130 con 0x7f64180ccb20 2024-04-04T06:57:40.682 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:40.682+0000 7f6417200640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f641815c6b0 0x7f64180aee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:40.682 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:40.682+0000 7f6417200640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f641815c6b0 0x7f64180aee60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:37744/0 (socket says 172.21.15.72:37744) 2024-04-04T06:57:40.682 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:40.682+0000 7f6417200640 1 -- 172.21.15.72:0/3570947961 learned_addr learned my addr 172.21.15.72:0/3570947961 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:57:40.682 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:40.682+0000 7f6417200640 1 -- 172.21.15.72:0/3570947961 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f64180ccb20 msgr2=0x7f64181f4750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:40.683 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:40.682+0000 7f6417200640 1 --2- 172.21.15.72:0/3570947961 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f64180ccb20 0x7f64181f4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:40.683 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:40.682+0000 7f6417200640 1 -- 172.21.15.72:0/3570947961 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f641815c2d0 msgr2=0x7f64180cc2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:40.683 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:40.682+0000 7f6417200640 1 --2- 172.21.15.72:0/3570947961 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f641815c2d0 0x7f64180cc2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:40.683 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:40.682+0000 7f6417200640 1 -- 172.21.15.72:0/3570947961 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64180af3a0 con 0x7f641815c6b0 2024-04-04T06:57:40.683 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:40.683+0000 7f6417200640 1 --2- 172.21.15.72:0/3570947961 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f641815c6b0 0x7f64180aee60 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f641000c7a0 tx=0x7f641000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:40.683 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:40.683+0000 7f640ea00640 1 -- 172.21.15.72:0/3570947961 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6410018070 con 0x7f641815c6b0 2024-04-04T06:57:40.683 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:40.683+0000 7f640ea00640 1 -- 172.21.15.72:0/3570947961 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f641000a640 con 0x7f641815c6b0 2024-04-04T06:57:40.683 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:40.683+0000 7f641d400640 1 -- 172.21.15.72:0/3570947961 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64180af660 con 0x7f641815c6b0 2024-04-04T06:57:40.683 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:40.683+0000 7f640ea00640 1 -- 172.21.15.72:0/3570947961 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f641000aab0 con 0x7f641815c6b0 2024-04-04T06:57:40.683 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:40.683+0000 7f641d400640 1 -- 172.21.15.72:0/3570947961 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64181f3f50 con 0x7f641815c6b0 2024-04-04T06:57:40.684 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:40.684+0000 7f641d400640 1 -- 172.21.15.72:0/3570947961 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6418075840 con 0x7f641815c6b0 2024-04-04T06:57:40.684 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:40.685+0000 7f640ea00640 1 -- 172.21.15.72:0/3570947961 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f641001b070 con 0x7f641815c6b0 2024-04-04T06:57:40.684 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:40.686+0000 7f640ea00640 1 --2- 172.21.15.72:0/3570947961 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f63f806c8f0 0x7f63f806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:40.685 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:40.686+0000 7f640ea00640 1 -- 172.21.15.72:0/3570947961 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5473+0+0 (secure 0 0 0) 0x7f641008b100 con 0x7f641815c6b0 2024-04-04T06:57:40.685 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:40.686+0000 7f6416800640 1 --2- 172.21.15.72:0/3570947961 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f63f806c8f0 0x7f63f806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:40.685 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:40.687+0000 7f6416800640 1 --2- 172.21.15.72:0/3570947961 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f63f806c8f0 0x7f63f806edb0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f64180cbf80 tx=0x7f6408008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:40.689 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:40.691+0000 7f640ea00640 1 -- 172.21.15.72:0/3570947961 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f6410059570 con 0x7f641815c6b0 2024-04-04T06:57:40.892 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:40.893+0000 7f641d400640 1 -- 172.21.15.72:0/3570947961 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f641806c610 con 0x7f641815c6b0 2024-04-04T06:57:41.451 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:41.452+0000 7f640ea00640 1 -- 172.21.15.72:0/3570947961 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v25) ==== 169+0+0 (secure 0 0 0) 0x7f6410058e70 con 0x7f641815c6b0 2024-04-04T06:57:41.452 INFO:teuthology.orchestra.run.smithi072.stderr:pool 'cephfs_data' removed 2024-04-04T06:57:41.454 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:41.456+0000 7f641d400640 1 -- 172.21.15.72:0/3570947961 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f63f806c8f0 msgr2=0x7f63f806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:41.454 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:41.456+0000 7f641d400640 1 --2- 172.21.15.72:0/3570947961 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f63f806c8f0 0x7f63f806edb0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f64180cbf80 tx=0x7f6408008040 comp rx=0 tx=0).stop 2024-04-04T06:57:41.454 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:41.456+0000 7f641d400640 1 -- 172.21.15.72:0/3570947961 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f641815c6b0 msgr2=0x7f64180aee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:41.455 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:41.456+0000 7f641d400640 1 --2- 172.21.15.72:0/3570947961 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f641815c6b0 0x7f64180aee60 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f641000c7a0 tx=0x7f641000cc60 comp rx=0 tx=0).stop 2024-04-04T06:57:41.455 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:41.456+0000 7f641d400640 1 -- 172.21.15.72:0/3570947961 shutdown_connections 2024-04-04T06:57:41.455 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:41.456+0000 7f641d400640 1 --2- 172.21.15.72:0/3570947961 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f63f806c8f0 0x7f63f806edb0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:41.455 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:41.456+0000 7f641d400640 1 --2- 172.21.15.72:0/3570947961 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f641815c6b0 0x7f64180aee60 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:41.456 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:41.456+0000 7f641d400640 1 --2- 172.21.15.72:0/3570947961 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f641815c2d0 0x7f64180cc2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:41.456 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:41.456+0000 7f641d400640 1 --2- 172.21.15.72:0/3570947961 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f64180ccb20 0x7f64181f4750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:41.456 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:41.456+0000 7f641d400640 1 -- 172.21.15.72:0/3570947961 >> 172.21.15.72:0/3570947961 conn(0x7f641806b470 msgr2=0x7f64180b3ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:41.456 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:41.456+0000 7f641d400640 1 -- 172.21.15.72:0/3570947961 shutdown_connections 2024-04-04T06:57:41.456 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:41.456+0000 7f641d400640 1 -- 172.21.15.72:0/3570947961 wait complete. 2024-04-04T06:57:41.481 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-04T06:57:41.481 INFO:tasks.ceph.mds.a:Stopping old one... 2024-04-04T06:57:41.481 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-04T06:57:41.481 INFO:teuthology.orchestra.run:waiting for 300 2024-04-04T06:57:41.481 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-04T06:57:41.481 INFO:tasks.ceph.mds.c:Stopping old one... 2024-04-04T06:57:41.482 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-04T06:57:41.482 INFO:teuthology.orchestra.run:waiting for 300 2024-04-04T06:57:41.482 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-04T06:57:41.482 INFO:tasks.ceph.mds.b:Stopping old one... 2024-04-04T06:57:41.482 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-04T06:57:41.482 INFO:teuthology.orchestra.run:waiting for 300 2024-04-04T06:57:41.482 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-04T06:57:41.482 INFO:tasks.ceph.mds.d:Stopping old one... 2024-04-04T06:57:41.483 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-04T06:57:41.483 INFO:teuthology.orchestra.run:waiting for 300 2024-04-04T06:57:41.501 INFO:tasks.ceph.mds.a:Stopped 2024-04-04T06:57:41.502 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-04T06:57:41.502 INFO:tasks.ceph.mds.c:Stopped 2024-04-04T06:57:41.502 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-04T06:57:41.503 INFO:tasks.ceph.mds.d:Stopped 2024-04-04T06:57:41.504 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-04T06:57:41.504 INFO:tasks.ceph.mds.b:Stopped 2024-04-04T06:57:41.505 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-04T06:57:41.549 INFO:tasks.ceph.mds.a:Started 2024-04-04T06:57:41.549 DEBUG:teuthology.parallel:result is None 2024-04-04T06:57:41.551 INFO:tasks.ceph.mds.d:Started 2024-04-04T06:57:41.551 DEBUG:teuthology.parallel:result is None 2024-04-04T06:57:41.554 INFO:tasks.ceph.mds.c:Started 2024-04-04T06:57:41.555 DEBUG:teuthology.parallel:result is None 2024-04-04T06:57:41.556 INFO:tasks.ceph.mds.b:Started 2024-04-04T06:57:41.556 DEBUG:teuthology.parallel:result is None 2024-04-04T06:57:41.556 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-04-04T06:57:41.705 INFO:tasks.ceph.mds.b.smithi117.stdout:starting mds.b at 2024-04-04T06:57:41.705 INFO:tasks.ceph.mds.d.smithi117.stdout:starting mds.d at 2024-04-04T06:57:41.706 INFO:tasks.ceph.mds.a.smithi072.stdout:starting mds.a at 2024-04-04T06:57:41.707 INFO:tasks.ceph.mds.c.smithi072.stdout:starting mds.c at 2024-04-04T06:57:41.745 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:41.746+0000 7fa762200640 1 Processor -- start 2024-04-04T06:57:41.745 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:41.746+0000 7fa762200640 1 -- start start 2024-04-04T06:57:41.746 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:41.747+0000 7fa762200640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fa75c162850 0x7fa75c0cea40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:41.746 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:41.747+0000 7fa762200640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa75c0ccad0 0x7fa75c0ccf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:41.746 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:41.747+0000 7fa762200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa75c166460 0x7fa75c1668d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:41.746 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:41.747+0000 7fa762200640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7fa75c0b3080 con 0x7fa75c0ccad0 2024-04-04T06:57:41.746 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:41.747+0000 7fa762200640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fa75c0cf5a0 con 0x7fa75c162850 2024-04-04T06:57:41.746 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:41.747+0000 7fa762200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fa75c0b38e0 con 0x7fa75c166460 2024-04-04T06:57:41.747 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:41.748+0000 7fa75aa00640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa75c0ccad0 0x7fa75c0ccf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:41.747 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:41.748+0000 7fa75aa00640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa75c0ccad0 0x7fa75c0ccf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:37776/0 (socket says 172.21.15.72:37776) 2024-04-04T06:57:41.747 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:41.748+0000 7fa75aa00640 1 -- 172.21.15.72:0/3204057628 learned_addr learned my addr 172.21.15.72:0/3204057628 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:57:41.747 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:41.748+0000 7fa75b400640 1 --2- 172.21.15.72:0/3204057628 >> v2:172.21.15.117:3300/0 conn(0x7fa75c162850 0x7fa75c0cea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:41.747 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:41.748+0000 7fa75aa00640 1 -- 172.21.15.72:0/3204057628 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa75c166460 msgr2=0x7fa75c1668d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:57:41.747 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:41.748+0000 7fa75be00640 1 --2- 172.21.15.72:0/3204057628 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa75c166460 0x7fa75c1668d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:41.747 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:41.748+0000 7fa75aa00640 1 --2- 172.21.15.72:0/3204057628 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa75c166460 0x7fa75c1668d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:41.748 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:41.748+0000 7fa75aa00640 1 -- 172.21.15.72:0/3204057628 >> v2:172.21.15.117:3300/0 conn(0x7fa75c162850 msgr2=0x7fa75c0cea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:57:41.748 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:41.748+0000 7fa75aa00640 1 --2- 172.21.15.72:0/3204057628 >> v2:172.21.15.117:3300/0 conn(0x7fa75c162850 0x7fa75c0cea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:41.748 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:41.748+0000 7fa75aa00640 1 -- 172.21.15.72:0/3204057628 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa75c0b3320 con 0x7fa75c0ccad0 2024-04-04T06:57:41.748 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:41.748+0000 7fa75b400640 1 --2- 172.21.15.72:0/3204057628 >> v2:172.21.15.117:3300/0 conn(0x7fa75c162850 0x7fa75c0cea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-04T06:57:41.748 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:41.748+0000 7fa75be00640 1 --2- 172.21.15.72:0/3204057628 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa75c166460 0x7fa75c1668d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-04T06:57:41.749 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:41.749+0000 7fa75aa00640 1 --2- 172.21.15.72:0/3204057628 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa75c0ccad0 0x7fa75c0ccf60 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fa75c0b62c0 tx=0x7fa74802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16d7c572846903ae server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:41.749 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:41.749+0000 7fa75a000640 1 -- 172.21.15.72:0/3204057628 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa748035020 con 0x7fa75c0ccad0 2024-04-04T06:57:41.749 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:41.749+0000 7fa75a000640 1 -- 172.21.15.72:0/3204057628 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa748031870 con 0x7fa75c0ccad0 2024-04-04T06:57:41.749 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:41.750+0000 7fa75a000640 1 -- 172.21.15.72:0/3204057628 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa748031c40 con 0x7fa75c0ccad0 2024-04-04T06:57:41.749 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:41.750+0000 7fa762200640 1 -- 172.21.15.72:0/3204057628 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa75c0ccad0 msgr2=0x7fa75c0ccf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:41.749 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:41.750+0000 7fa762200640 1 --2- 172.21.15.72:0/3204057628 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa75c0ccad0 0x7fa75c0ccf60 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fa75c0b62c0 tx=0x7fa74802b910 comp rx=0 tx=0).stop 2024-04-04T06:57:41.750 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:41.750+0000 7fa762200640 1 -- 172.21.15.72:0/3204057628 shutdown_connections 2024-04-04T06:57:41.750 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:41.750+0000 7fa762200640 1 --2- 172.21.15.72:0/3204057628 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa75c166460 0x7fa75c1668d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:41.750 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:41.750+0000 7fa762200640 1 --2- 172.21.15.72:0/3204057628 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa75c0ccad0 0x7fa75c0ccf60 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:41.750 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:41.750+0000 7fa762200640 1 --2- 172.21.15.72:0/3204057628 >> v2:172.21.15.117:3300/0 conn(0x7fa75c162850 0x7fa75c0cea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:41.750 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:41.750+0000 7fa762200640 1 -- 172.21.15.72:0/3204057628 >> 172.21.15.72:0/3204057628 conn(0x7fa75c06b470 msgr2=0x7fa75c06b880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:41.750 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:41.750+0000 7fa762200640 1 -- 172.21.15.72:0/3204057628 shutdown_connections 2024-04-04T06:57:41.750 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:41.750+0000 7fa762200640 1 -- 172.21.15.72:0/3204057628 wait complete. 2024-04-04T06:57:41.750 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:41.752+0000 7fa762200640 1 Processor -- start 2024-04-04T06:57:41.751 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:41.752+0000 7fa762200640 1 -- start start 2024-04-04T06:57:41.752 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:41.753+0000 7fa762200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa75c0ccad0 0x7fa75c159a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:41.752 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:41.753+0000 7fa762200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa75c162850 0x7fa75c158300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:41.752 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:41.753+0000 7fa762200640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa75c166460 0x7fa75c15e220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:41.752 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:41.753+0000 7fa762200640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fa75c0cef80 con 0x7fa75c166460 2024-04-04T06:57:41.752 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:41.753+0000 7fa762200640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fa75c0cf840 con 0x7fa75c0ccad0 2024-04-04T06:57:41.752 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:41.753+0000 7fa762200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fa75c162c30 con 0x7fa75c162850 2024-04-04T06:57:41.752 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:41.753+0000 7fa75be00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa75c166460 0x7fa75c15e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:41.752 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:41.753+0000 7fa75b400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa75c0ccad0 0x7fa75c159a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:41.752 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:41.753+0000 7fa75b400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa75c0ccad0 0x7fa75c159a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.72:48472/0 (socket says 172.21.15.72:48472) 2024-04-04T06:57:41.752 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:41.753+0000 7fa75b400640 1 -- 172.21.15.72:0/2296901156 learned_addr learned my addr 172.21.15.72:0/2296901156 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:57:41.753 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:41.753+0000 7fa75aa00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa75c162850 0x7fa75c158300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:41.754 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:41.754+0000 7fa75aa00640 1 -- 172.21.15.72:0/2296901156 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa75c0ccad0 msgr2=0x7fa75c159a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:41.754 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:41.754+0000 7fa75aa00640 1 --2- 172.21.15.72:0/2296901156 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa75c0ccad0 0x7fa75c159a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:41.754 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:41.754+0000 7fa75aa00640 1 -- 172.21.15.72:0/2296901156 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa75c166460 msgr2=0x7fa75c15e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:41.754 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:41.754+0000 7fa75aa00640 1 --2- 172.21.15.72:0/2296901156 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa75c166460 0x7fa75c15e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:41.754 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:41.754+0000 7fa75aa00640 1 -- 172.21.15.72:0/2296901156 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa75c158e50 con 0x7fa75c162850 2024-04-04T06:57:41.754 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:41.754+0000 7fa75aa00640 1 --2- 172.21.15.72:0/2296901156 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa75c162850 0x7fa75c158300 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fa748033000 tx=0x7fa7480046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:41.754 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:41.755+0000 7fa753400640 1 -- 172.21.15.72:0/2296901156 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa748040070 con 0x7fa75c162850 2024-04-04T06:57:41.754 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:41.755+0000 7fa753400640 1 -- 172.21.15.72:0/2296901156 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa74803a420 con 0x7fa75c162850 2024-04-04T06:57:41.755 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:41.755+0000 7fa762200640 1 -- 172.21.15.72:0/2296901156 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa75c06dc10 con 0x7fa75c162850 2024-04-04T06:57:41.755 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:41.755+0000 7fa753400640 1 -- 172.21.15.72:0/2296901156 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa748035040 con 0x7fa75c162850 2024-04-04T06:57:41.755 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:41.755+0000 7fa762200640 1 -- 172.21.15.72:0/2296901156 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fa75c06e1d0 con 0x7fa75c162850 2024-04-04T06:57:41.755 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:41.756+0000 7fa762200640 1 -- 172.21.15.72:0/2296901156 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa75c075840 con 0x7fa75c162850 2024-04-04T06:57:41.756 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:41.757+0000 7fa753400640 1 -- 172.21.15.72:0/2296901156 <== mon.2 v2:172.21.15.117:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa74804b060 con 0x7fa75c162850 2024-04-04T06:57:41.757 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:41.758+0000 7fa753400640 1 --2- 172.21.15.72:0/2296901156 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fa73c06c920 0x7fa73c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:41.757 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:41.758+0000 7fa753400640 1 -- 172.21.15.72:0/2296901156 <== mon.2 v2:172.21.15.117:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 4943+0+0 (secure 0 0 0) 0x7fa7480ad9b0 con 0x7fa75c162850 2024-04-04T06:57:41.757 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:41.759+0000 7fa75b400640 1 --2- 172.21.15.72:0/2296901156 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fa73c06c920 0x7fa73c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:41.758 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:41.759+0000 7fa75b400640 1 --2- 172.21.15.72:0/2296901156 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fa73c06c920 0x7fa73c06ede0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fa74c00ac20 tx=0x7fa74c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:41.761 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:41.763+0000 7fa753400640 1 -- 172.21.15.72:0/2296901156 <== mon.2 v2:172.21.15.117:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fa75c158e50 con 0x7fa75c162850 2024-04-04T06:57:41.977 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:41.978+0000 7fa762200640 1 -- 172.21.15.72:0/2296901156 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7fa75c0cc6a0 con 0x7fa75c162850 2024-04-04T06:57:42.499 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:42.499+0000 7fa753400640 1 -- 172.21.15.72:0/2296901156 <== mon.2 v2:172.21.15.117:3301/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v27) ==== 97+0+0 (secure 0 0 0) 0x7fa74807bc00 con 0x7fa75c162850 2024-04-04T06:57:42.499 INFO:teuthology.orchestra.run.smithi072.stderr: removed all blocklist entries 2024-04-04T06:57:42.502 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:42.503+0000 7fa762200640 1 -- 172.21.15.72:0/2296901156 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fa73c06c920 msgr2=0x7fa73c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:42.502 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:42.503+0000 7fa762200640 1 --2- 172.21.15.72:0/2296901156 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fa73c06c920 0x7fa73c06ede0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fa74c00ac20 tx=0x7fa74c008040 comp rx=0 tx=0).stop 2024-04-04T06:57:42.502 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:42.503+0000 7fa762200640 1 -- 172.21.15.72:0/2296901156 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa75c162850 msgr2=0x7fa75c158300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:42.502 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:42.503+0000 7fa762200640 1 --2- 172.21.15.72:0/2296901156 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa75c162850 0x7fa75c158300 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fa748033000 tx=0x7fa7480046c0 comp rx=0 tx=0).stop 2024-04-04T06:57:42.503 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:42.503+0000 7fa762200640 1 -- 172.21.15.72:0/2296901156 shutdown_connections 2024-04-04T06:57:42.503 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:42.503+0000 7fa762200640 1 --2- 172.21.15.72:0/2296901156 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fa73c06c920 0x7fa73c06ede0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:42.503 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:42.503+0000 7fa762200640 1 --2- 172.21.15.72:0/2296901156 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa75c166460 0x7fa75c15e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:42.503 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:42.503+0000 7fa762200640 1 --2- 172.21.15.72:0/2296901156 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa75c162850 0x7fa75c158300 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:42.503 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:42.503+0000 7fa762200640 1 --2- 172.21.15.72:0/2296901156 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa75c0ccad0 0x7fa75c159a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:42.503 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:42.503+0000 7fa762200640 1 -- 172.21.15.72:0/2296901156 >> 172.21.15.72:0/2296901156 conn(0x7fa75c06b470 msgr2=0x7fa75c1606d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:42.503 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:42.503+0000 7fa762200640 1 -- 172.21.15.72:0/2296901156 shutdown_connections 2024-04-04T06:57:42.503 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:42.503+0000 7fa762200640 1 -- 172.21.15.72:0/2296901156 wait complete. 2024-04-04T06:57:42.524 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-04-04T06:57:42.720 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:42.721+0000 7f95da600640 1 Processor -- start 2024-04-04T06:57:42.720 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:42.721+0000 7f95da600640 1 -- start start 2024-04-04T06:57:42.722 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:42.723+0000 7f95da600640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f95d4073570 0x7f95d4071610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:42.722 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:42.723+0000 7f95da600640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f95d406eee0 0x7f95d40b3700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:42.722 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:42.723+0000 7f95da600640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95d40b3f50 con 0x7f95d40ccad0 2024-04-04T06:57:42.722 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:42.723+0000 7f95da600640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f95d4073950 con 0x7f95d4073570 2024-04-04T06:57:42.722 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:42.723+0000 7f95da600640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f95d40cb520 con 0x7f95d406eee0 2024-04-04T06:57:42.722 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:42.723+0000 7f95d3400640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f95d4073570 0x7f95d4071610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:42.722 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:42.723+0000 7f95d3e00640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f95d40ccad0 0x7f95d40ccee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:39678/0 (socket says 172.21.15.72:39678) 2024-04-04T06:57:42.722 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:42.723+0000 7f95d3e00640 1 -- 172.21.15.72:0/3479243687 learned_addr learned my addr 172.21.15.72:0/3479243687 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-04-04T06:57:42.723 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:42.723+0000 7f95d2a00640 1 --2- 172.21.15.72:0/3479243687 >> v2:172.21.15.117:3300/0 conn(0x7f95d406eee0 0x7f95d40b3700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:42.723 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:42.724+0000 7f95d2000640 1 -- 172.21.15.72:0/3479243687 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2131875277 0 0) 0x7f95d40b3f50 con 0x7f95d40ccad0 2024-04-04T06:57:42.723 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:42.724+0000 7f95d3400640 1 -- 172.21.15.72:0/3479243687 >> v2:172.21.15.117:3300/0 conn(0x7f95d406eee0 msgr2=0x7f95d40b3700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:57:42.723 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:42.724+0000 7f95d3400640 1 --2- 172.21.15.72:0/3479243687 >> v2:172.21.15.117:3300/0 conn(0x7f95d406eee0 0x7f95d40b3700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:42.723 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:42.724+0000 7f95d3400640 1 -- 172.21.15.72:0/3479243687 >> v1:172.21.15.72:6789/0 conn(0x7f95d40ccad0 legacy=0x7f95d40ccee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:42.723 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:42.724+0000 7f95d3400640 1 -- 172.21.15.72:0/3479243687 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95d40b4230 con 0x7f95d4073570 2024-04-04T06:57:42.724 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:42.725+0000 7f95d3400640 1 --2- 172.21.15.72:0/3479243687 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f95d4073570 0x7f95d4071610 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f95d40b30c0 tx=0x7f95c402b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c4652f448c88dd6 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:42.724 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:42.725+0000 7f95d2000640 1 -- 172.21.15.72:0/3479243687 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95c4034070 con 0x7f95d4073570 2024-04-04T06:57:42.724 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:42.725+0000 7f95d2000640 1 -- 172.21.15.72:0/3479243687 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95c4030610 con 0x7f95d4073570 2024-04-04T06:57:42.724 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:42.725+0000 7f95d2000640 1 -- 172.21.15.72:0/3479243687 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95c40309e0 con 0x7f95d4073570 2024-04-04T06:57:42.725 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:42.726+0000 7f95da600640 1 -- 172.21.15.72:0/3479243687 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f95d4073570 msgr2=0x7f95d4071610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:42.725 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:42.726+0000 7f95da600640 1 --2- 172.21.15.72:0/3479243687 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f95d4073570 0x7f95d4071610 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f95d40b30c0 tx=0x7f95c402b960 comp rx=0 tx=0).stop 2024-04-04T06:57:42.725 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:42.726+0000 7f95da600640 1 -- 172.21.15.72:0/3479243687 shutdown_connections 2024-04-04T06:57:42.725 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:42.726+0000 7f95da600640 1 --2- 172.21.15.72:0/3479243687 >> v2:172.21.15.117:3300/0 conn(0x7f95d406eee0 0x7f95d40b3700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:42.725 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:42.726+0000 7f95da600640 1 --2- 172.21.15.72:0/3479243687 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f95d4073570 0x7f95d4071610 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:42.725 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:42.726+0000 7f95da600640 1 -- 172.21.15.72:0/3479243687 >> 172.21.15.72:0/3479243687 conn(0x7f95d406b470 msgr2=0x7f95d406b880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:42.725 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:42.726+0000 7f95da600640 1 -- 172.21.15.72:0/3479243687 shutdown_connections 2024-04-04T06:57:42.726 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:42.726+0000 7f95da600640 1 -- 172.21.15.72:0/3479243687 wait complete. 2024-04-04T06:57:42.726 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:42.728+0000 7f95da600640 1 Processor -- start 2024-04-04T06:57:42.727 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:42.728+0000 7f95da600640 1 -- start start 2024-04-04T06:57:42.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:42.729+0000 7f95da600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f95d406eee0 0x7f95d415e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:42.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:42.729+0000 7f95da600640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f95d4073570 0x7f95d40c5ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:42.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:42.729+0000 7f95da600640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f95d40ccad0 0x7f95d409dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:42.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:42.729+0000 7f95da600640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f95d40b47f0 con 0x7f95d40ccad0 2024-04-04T06:57:42.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:42.729+0000 7f95da600640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f95d40b3c40 con 0x7f95d4073570 2024-04-04T06:57:42.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:42.729+0000 7f95da600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f95d40b4970 con 0x7f95d406eee0 2024-04-04T06:57:42.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:42.729+0000 7f95d3e00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f95d40ccad0 0x7f95d409dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:42.730 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:42.729+0000 7f95d3e00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f95d40ccad0 0x7f95d409dbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:37804/0 (socket says 172.21.15.72:37804) 2024-04-04T06:57:42.730 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:42.729+0000 7f95d3e00640 1 -- 172.21.15.72:0/1239180549 learned_addr learned my addr 172.21.15.72:0/1239180549 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:57:42.730 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:42.730+0000 7f95d2a00640 1 --2- 172.21.15.72:0/1239180549 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f95d4073570 0x7f95d40c5ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:42.730 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:42.730+0000 7f95d3e00640 1 -- 172.21.15.72:0/1239180549 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f95d406eee0 msgr2=0x7f95d415e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:42.730 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:42.730+0000 7f95d3400640 1 --2- 172.21.15.72:0/1239180549 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f95d406eee0 0x7f95d415e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:42.730 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:42.730+0000 7f95d3e00640 1 --2- 172.21.15.72:0/1239180549 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f95d406eee0 0x7f95d415e8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:42.730 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:42.730+0000 7f95d3e00640 1 -- 172.21.15.72:0/1239180549 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f95d4073570 msgr2=0x7f95d40c5ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:42.730 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:42.730+0000 7f95d3e00640 1 --2- 172.21.15.72:0/1239180549 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f95d4073570 0x7f95d40c5ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:42.730 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:42.730+0000 7f95d3e00640 1 -- 172.21.15.72:0/1239180549 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95d40c4a10 con 0x7f95d40ccad0 2024-04-04T06:57:42.730 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:42.730+0000 7f95d3e00640 1 --2- 172.21.15.72:0/1239180549 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f95d40ccad0 0x7f95d409dbb0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f95cc00c780 tx=0x7f95cc00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:42.730 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:42.730+0000 7f95cb400640 1 -- 172.21.15.72:0/1239180549 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95cc018070 con 0x7f95d40ccad0 2024-04-04T06:57:42.730 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:42.730+0000 7f95cb400640 1 -- 172.21.15.72:0/1239180549 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95cc00a640 con 0x7f95d40ccad0 2024-04-04T06:57:42.730 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:42.730+0000 7f95cb400640 1 -- 172.21.15.72:0/1239180549 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95cc00aa30 con 0x7f95d40ccad0 2024-04-04T06:57:42.731 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:42.730+0000 7f95da600640 1 -- 172.21.15.72:0/1239180549 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95d40c61a0 con 0x7f95d40ccad0 2024-04-04T06:57:42.731 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:42.731+0000 7f95da600640 1 -- 172.21.15.72:0/1239180549 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95d40c3f30 con 0x7f95d40ccad0 2024-04-04T06:57:42.731 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:42.732+0000 7f95da600640 1 -- 172.21.15.72:0/1239180549 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95d4075840 con 0x7f95d40ccad0 2024-04-04T06:57:42.731 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:42.733+0000 7f95cb400640 1 -- 172.21.15.72:0/1239180549 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f95cc00abd0 con 0x7f95d40ccad0 2024-04-04T06:57:42.732 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:42.733+0000 7f95cb400640 1 --2- 172.21.15.72:0/1239180549 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f95b006c8f0 0x7f95b006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:42.732 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:42.733+0000 7f95cb400640 1 -- 172.21.15.72:0/1239180549 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 4857+0+0 (secure 0 0 0) 0x7f95cc08ad00 con 0x7f95d40ccad0 2024-04-04T06:57:42.732 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:42.734+0000 7f95d3400640 1 --2- 172.21.15.72:0/1239180549 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f95b006c8f0 0x7f95b006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:42.733 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:42.734+0000 7f95d3400640 1 --2- 172.21.15.72:0/1239180549 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f95b006c8f0 0x7f95b006edb0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f95c4036000 tx=0x7f95c403b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:42.736 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:42.738+0000 7f95cb400640 1 -- 172.21.15.72:0/1239180549 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f95cc059470 con 0x7f95d40ccad0 2024-04-04T06:57:43.005 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:43.006+0000 7f95da600640 1 -- 172.21.15.72:0/1239180549 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f95d40af7e0 con 0x7f95d40ccad0 2024-04-04T06:57:43.005 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:43.007+0000 7f95cb400640 1 -- 172.21.15.72:0/1239180549 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v4) ==== 80+0+6645 (secure 0 0 0) 0x7f95cc058d70 con 0x7f95d40ccad0 2024-04-04T06:57:43.006 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T06:57:43.006 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-04T06:57:43.006 INFO:teuthology.orchestra.run.smithi072.stdout: "auth_dump": [ 2024-04-04T06:57:43.006 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-04T06:57:43.006 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "mds.a", 2024-04-04T06:57:43.006 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQDWTg5mbG7JCBAAKz9JsETvc6Baa0PlUPpirw==", 2024-04-04T06:57:43.006 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2024-04-04T06:57:43.006 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": "allow", 2024-04-04T06:57:43.007 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow *", 2024-04-04T06:57:43.007 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow *", 2024-04-04T06:57:43.007 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2024-04-04T06:57:43.007 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-04T06:57:43.007 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-04T06:57:43.007 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-04T06:57:43.007 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "mds.b", 2024-04-04T06:57:43.007 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQDWTg5mfhrkKBAAPtjPJrv0eeKXkIaALC/fjg==", 2024-04-04T06:57:43.007 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2024-04-04T06:57:43.007 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": "allow", 2024-04-04T06:57:43.007 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow *", 2024-04-04T06:57:43.007 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow *", 2024-04-04T06:57:43.007 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2024-04-04T06:57:43.007 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-04T06:57:43.008 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-04T06:57:43.008 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-04T06:57:43.008 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "mds.c", 2024-04-04T06:57:43.008 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQDWTg5mS7LjFxAAmVDMhZMWarW6yI/MUaSpfw==", 2024-04-04T06:57:43.008 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2024-04-04T06:57:43.008 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": "allow", 2024-04-04T06:57:43.008 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow *", 2024-04-04T06:57:43.008 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow *", 2024-04-04T06:57:43.008 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2024-04-04T06:57:43.008 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-04T06:57:43.008 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-04T06:57:43.008 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-04T06:57:43.008 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "mds.d", 2024-04-04T06:57:43.009 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQDWTg5mdU4vORAAFE04AtIguVlsGytmUcD9rA==", 2024-04-04T06:57:43.009 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2024-04-04T06:57:43.009 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": "allow", 2024-04-04T06:57:43.009 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow *", 2024-04-04T06:57:43.009 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow *", 2024-04-04T06:57:43.009 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2024-04-04T06:57:43.009 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-04T06:57:43.009 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-04T06:57:43.009 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-04T06:57:43.009 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "osd.0", 2024-04-04T06:57:43.009 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQDbTg5mEfaILBAA6lk1NZHPLGJFcWt1l7nXhA==", 2024-04-04T06:57:43.009 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2024-04-04T06:57:43.009 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow profile osd", 2024-04-04T06:57:43.009 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile osd", 2024-04-04T06:57:43.010 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2024-04-04T06:57:43.010 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-04T06:57:43.010 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-04T06:57:43.010 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-04T06:57:43.010 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "osd.1", 2024-04-04T06:57:43.010 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQDeTg5mT4lHNxAA1Vl42CqiPiu4imhU++h7JQ==", 2024-04-04T06:57:43.010 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2024-04-04T06:57:43.010 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow profile osd", 2024-04-04T06:57:43.010 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile osd", 2024-04-04T06:57:43.010 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2024-04-04T06:57:43.010 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-04T06:57:43.010 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-04T06:57:43.010 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-04T06:57:43.011 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "osd.2", 2024-04-04T06:57:43.011 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQDiTg5mYPGrExAA9hkjzTpeXU7zbi6+/TQdeQ==", 2024-04-04T06:57:43.011 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2024-04-04T06:57:43.011 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow profile osd", 2024-04-04T06:57:43.011 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile osd", 2024-04-04T06:57:43.011 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2024-04-04T06:57:43.011 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-04T06:57:43.011 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-04T06:57:43.011 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-04T06:57:43.011 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "osd.3", 2024-04-04T06:57:43.011 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQDlTg5mnsRkHBAAyx5Gr6Wd3zxT+OHQdrWArw==", 2024-04-04T06:57:43.011 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2024-04-04T06:57:43.011 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow profile osd", 2024-04-04T06:57:43.012 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile osd", 2024-04-04T06:57:43.012 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2024-04-04T06:57:43.012 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-04T06:57:43.012 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-04T06:57:43.012 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-04T06:57:43.012 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "osd.4", 2024-04-04T06:57:43.012 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQDsTg5mp8jJJRAAnn8Sr4jnelNVHlo1bDGUrw==", 2024-04-04T06:57:43.012 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2024-04-04T06:57:43.012 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow profile osd", 2024-04-04T06:57:43.012 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile osd", 2024-04-04T06:57:43.012 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2024-04-04T06:57:43.012 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-04T06:57:43.012 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-04T06:57:43.012 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-04T06:57:43.013 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "osd.5", 2024-04-04T06:57:43.013 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQDvTg5mTuLbLhAAKRgSpIUa4KRF1sonWacj3g==", 2024-04-04T06:57:43.013 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2024-04-04T06:57:43.013 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow profile osd", 2024-04-04T06:57:43.013 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile osd", 2024-04-04T06:57:43.013 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2024-04-04T06:57:43.013 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-04T06:57:43.013 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-04T06:57:43.013 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-04T06:57:43.013 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "osd.6", 2024-04-04T06:57:43.013 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQDzTg5m0k9SCxAA0IJtySvK7sR+FiJbVWYjPA==", 2024-04-04T06:57:43.013 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2024-04-04T06:57:43.013 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow profile osd", 2024-04-04T06:57:43.013 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile osd", 2024-04-04T06:57:43.014 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2024-04-04T06:57:43.014 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-04T06:57:43.014 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-04T06:57:43.014 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-04T06:57:43.014 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "osd.7", 2024-04-04T06:57:43.014 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQD2Tg5m4PRnFBAAYUoiTxqshpXqsWnDCKLsjQ==", 2024-04-04T06:57:43.014 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2024-04-04T06:57:43.014 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow profile osd", 2024-04-04T06:57:43.014 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile osd", 2024-04-04T06:57:43.014 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2024-04-04T06:57:43.014 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-04T06:57:43.014 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-04T06:57:43.014 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-04T06:57:43.015 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "client.0", 2024-04-04T06:57:43.015 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQDXTg5mRJVYCxAA4YRQHdGOPQqDB4fp2kieUw==", 2024-04-04T06:57:43.015 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2024-04-04T06:57:43.015 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": "allow", 2024-04-04T06:57:43.015 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow r", 2024-04-04T06:57:43.015 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow rw", 2024-04-04T06:57:43.015 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow rwx" 2024-04-04T06:57:43.015 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-04T06:57:43.015 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-04T06:57:43.015 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-04T06:57:43.015 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "client.1", 2024-04-04T06:57:43.015 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQDXTg5mZHMkIRAALRQ8KXH7kiVqbY2ksTWAMg==", 2024-04-04T06:57:43.015 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2024-04-04T06:57:43.016 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": "allow", 2024-04-04T06:57:43.016 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow r", 2024-04-04T06:57:43.016 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow rw", 2024-04-04T06:57:43.016 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow rwx" 2024-04-04T06:57:43.016 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-04T06:57:43.016 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-04T06:57:43.016 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-04T06:57:43.016 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "client.2", 2024-04-04T06:57:43.016 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQDXTg5m2MwpFhAA+TAowiuln4S4BvSJOcYAXg==", 2024-04-04T06:57:43.016 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2024-04-04T06:57:43.016 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": "allow", 2024-04-04T06:57:43.016 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow r", 2024-04-04T06:57:43.016 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow rw", 2024-04-04T06:57:43.016 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow rwx" 2024-04-04T06:57:43.017 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-04T06:57:43.017 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-04T06:57:43.017 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-04T06:57:43.017 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "client.3", 2024-04-04T06:57:43.017 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQDXTg5m1Uv7KxAAdTgSlAt2V2fXX5tCRwy/Yw==", 2024-04-04T06:57:43.017 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2024-04-04T06:57:43.017 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": "allow", 2024-04-04T06:57:43.017 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow r", 2024-04-04T06:57:43.017 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow rw", 2024-04-04T06:57:43.017 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow rwx" 2024-04-04T06:57:43.017 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-04T06:57:43.017 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-04T06:57:43.017 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-04T06:57:43.017 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "client.admin", 2024-04-04T06:57:43.018 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQDUTg5mK1AXORAAlC1pVAaGvWlKo7AeRDsVXg==", 2024-04-04T06:57:43.018 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2024-04-04T06:57:43.018 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": "allow *", 2024-04-04T06:57:43.018 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow *", 2024-04-04T06:57:43.018 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow *", 2024-04-04T06:57:43.018 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2024-04-04T06:57:43.018 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-04T06:57:43.018 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-04T06:57:43.018 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-04T06:57:43.018 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "client.bootstrap-mds", 2024-04-04T06:57:43.018 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQAETw5mpVzzEBAA/5Xec41rUlo1MG+zSWcDpA==", 2024-04-04T06:57:43.018 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2024-04-04T06:57:43.018 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile bootstrap-mds" 2024-04-04T06:57:43.018 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-04T06:57:43.019 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-04T06:57:43.019 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-04T06:57:43.019 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "client.bootstrap-mgr", 2024-04-04T06:57:43.019 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQAETw5muHnzEBAAiufMct1rJEIgQ7I/4oeDHg==", 2024-04-04T06:57:43.019 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2024-04-04T06:57:43.019 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile bootstrap-mgr" 2024-04-04T06:57:43.019 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-04T06:57:43.019 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-04T06:57:43.019 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-04T06:57:43.019 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "client.bootstrap-osd", 2024-04-04T06:57:43.019 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQAETw5mVZPzEBAAdYiG5bnBsHnkhGUtyVYF8A==", 2024-04-04T06:57:43.019 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2024-04-04T06:57:43.019 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile bootstrap-osd" 2024-04-04T06:57:43.019 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-04T06:57:43.019 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-04T06:57:43.020 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-04T06:57:43.020 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "client.bootstrap-rbd", 2024-04-04T06:57:43.020 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQAETw5mHa3zEBAAmb6JWod5aEpX2Ryvg6u5Dg==", 2024-04-04T06:57:43.020 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2024-04-04T06:57:43.020 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile bootstrap-rbd" 2024-04-04T06:57:43.020 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-04T06:57:43.020 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-04T06:57:43.020 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-04T06:57:43.020 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-04-04T06:57:43.020 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQAETw5mCcfzEBAAH5CliOURuinhLT4oyppijg==", 2024-04-04T06:57:43.020 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2024-04-04T06:57:43.020 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-04-04T06:57:43.020 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-04T06:57:43.021 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-04T06:57:43.021 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-04T06:57:43.021 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "client.bootstrap-rgw", 2024-04-04T06:57:43.021 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQAETw5mK+HzEBAA9t6fXzlt2rEx7GH55NYnQg==", 2024-04-04T06:57:43.021 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2024-04-04T06:57:43.021 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile bootstrap-rgw" 2024-04-04T06:57:43.021 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-04T06:57:43.021 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-04T06:57:43.021 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-04T06:57:43.021 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "mgr.x", 2024-04-04T06:57:43.021 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQDVTg5mtSXaOBAAZJpJzPhQazxoTD6q4qxdog==", 2024-04-04T06:57:43.022 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2024-04-04T06:57:43.022 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": "allow *", 2024-04-04T06:57:43.022 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile mgr", 2024-04-04T06:57:43.022 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2024-04-04T06:57:43.022 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-04T06:57:43.022 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-04T06:57:43.022 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-04T06:57:43.022 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "mgr.y", 2024-04-04T06:57:43.022 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQDVTg5my1hdLRAAH9HxUr+diI1AKFLWTO1tNw==", 2024-04-04T06:57:43.022 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2024-04-04T06:57:43.022 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": "allow *", 2024-04-04T06:57:43.022 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile mgr", 2024-04-04T06:57:43.022 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2024-04-04T06:57:43.023 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-04T06:57:43.023 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-04T06:57:43.023 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-04T06:57:43.023 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-04T06:57:43.024 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:43.009+0000 7f95da600640 1 -- 172.21.15.72:0/1239180549 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f95b006c8f0 msgr2=0x7f95b006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:43.024 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:43.009+0000 7f95da600640 1 --2- 172.21.15.72:0/1239180549 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f95b006c8f0 0x7f95b006edb0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f95c4036000 tx=0x7f95c403b040 comp rx=0 tx=0).stop 2024-04-04T06:57:43.024 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:43.009+0000 7f95da600640 1 -- 172.21.15.72:0/1239180549 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f95d40ccad0 msgr2=0x7f95d409dbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:43.024 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:43.009+0000 7f95da600640 1 --2- 172.21.15.72:0/1239180549 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f95d40ccad0 0x7f95d409dbb0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f95cc00c780 tx=0x7f95cc00cc40 comp rx=0 tx=0).stop 2024-04-04T06:57:43.024 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:43.010+0000 7f95da600640 1 -- 172.21.15.72:0/1239180549 shutdown_connections 2024-04-04T06:57:43.024 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:43.010+0000 7f95da600640 1 --2- 172.21.15.72:0/1239180549 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f95b006c8f0 0x7f95b006edb0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:43.024 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:43.010+0000 7f95da600640 1 --2- 172.21.15.72:0/1239180549 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f95d40ccad0 0x7f95d409dbb0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:43.025 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:43.010+0000 7f95da600640 1 --2- 172.21.15.72:0/1239180549 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f95d4073570 0x7f95d40c5ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:43.025 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:43.010+0000 7f95da600640 1 --2- 172.21.15.72:0/1239180549 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f95d406eee0 0x7f95d415e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:43.025 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:43.010+0000 7f95da600640 1 -- 172.21.15.72:0/1239180549 >> 172.21.15.72:0/1239180549 conn(0x7f95d406b470 msgr2=0x7f95d406b850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:43.025 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:43.010+0000 7f95da600640 1 -- 172.21.15.72:0/1239180549 shutdown_connections 2024-04-04T06:57:43.025 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:43.010+0000 7f95da600640 1 -- 172.21.15.72:0/1239180549 wait complete. 2024-04-04T06:57:43.026 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-04-04T06:57:43.229 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:43.230+0000 7f3035000640 1 Processor -- start 2024-04-04T06:57:43.229 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:43.230+0000 7f3035000640 1 -- start start 2024-04-04T06:57:43.230 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:43.231+0000 7f3035000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f30300b2220 0x7f30300b3b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:43.230 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:43.231+0000 7f3035000640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3030072180 con 0x7f3030071410 2024-04-04T06:57:43.230 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:43.231+0000 7f3035000640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30300b3060 con 0x7f30301448c0 2024-04-04T06:57:43.230 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:43.231+0000 7f3035000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f30300b3340 con 0x7f30300b2220 2024-04-04T06:57:43.230 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:43.231+0000 7f302e800640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f3030071410 0x7f3030071880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:39688/0 (socket says 172.21.15.72:39688) 2024-04-04T06:57:43.230 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:43.231+0000 7f302e800640 1 -- 172.21.15.72:0/3053668815 learned_addr learned my addr 172.21.15.72:0/3053668815 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-04-04T06:57:43.232 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:43.232+0000 7f3025400640 1 --2- 172.21.15.72:0/3053668815 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f30300b2220 0x7f30300b3b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:43.232 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:43.232+0000 7f302d400640 1 -- 172.21.15.72:0/3053668815 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3263790184 0 0) 0x7f3030072180 con 0x7f3030071410 2024-04-04T06:57:43.232 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:43.232+0000 7f302d400640 1 -- 172.21.15.72:0/3053668815 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3014003520 con 0x7f3030071410 2024-04-04T06:57:43.232 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:43.232+0000 7f302d400640 1 -- 172.21.15.72:0/3053668815 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1311249616 0 0) 0x7f3014003520 con 0x7f3030071410 2024-04-04T06:57:43.233 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:43.232+0000 7f302d400640 1 -- 172.21.15.72:0/3053668815 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f30300b2220 msgr2=0x7f30300b3b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:57:43.233 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:43.232+0000 7f302d400640 1 --2- 172.21.15.72:0/3053668815 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f30300b2220 0x7f30300b3b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:43.233 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:43.232+0000 7f302d400640 1 -- 172.21.15.72:0/3053668815 >> v1:172.21.15.117:6789/0 conn(0x7f30301448c0 legacy=0x7f30300b1b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:43.233 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:43.232+0000 7f302d400640 1 -- 172.21.15.72:0/3053668815 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30300b3620 con 0x7f3030071410 2024-04-04T06:57:43.233 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:43.232+0000 7f302d400640 1 -- 172.21.15.72:0/3053668815 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2465650867 0 0) 0x7f30280019f0 con 0x7f3030071410 2024-04-04T06:57:43.233 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:43.232+0000 7f302d400640 1 -- 172.21.15.72:0/3053668815 >> v1:172.21.15.72:6789/0 conn(0x7f3030071410 legacy=0x7f3030071880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:43.233 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:43.232+0000 7f302d400640 1 --2- 172.21.15.72:0/3053668815 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f30140039e0 0x7f3014003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:43.233 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:43.232+0000 7f302d400640 1 --2- 172.21.15.72:0/3053668815 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3014004800 0x7f3014004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:43.233 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:43.232+0000 7f302d400640 1 --2- 172.21.15.72:0/3053668815 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f30300b2220 0x7f3014005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:43.233 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:43.232+0000 7f302d400640 1 -- 172.21.15.72:0/3053668815 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f30300b3340 con 0x7f30140039e0 2024-04-04T06:57:43.233 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:43.232+0000 7f302d400640 1 -- 172.21.15.72:0/3053668815 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f301400bb50 con 0x7f3014004800 2024-04-04T06:57:43.233 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:43.233+0000 7f302d400640 1 -- 172.21.15.72:0/3053668815 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f301400df30 con 0x7f30300b2220 2024-04-04T06:57:43.233 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:43.233+0000 7f302de00640 1 --2- 172.21.15.72:0/3053668815 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f30140039e0 0x7f3014003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:43.234 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:43.233+0000 7f3025400640 1 --2- 172.21.15.72:0/3053668815 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3014004800 0x7f3014004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:43.234 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:43.233+0000 7f302e800640 1 --2- 172.21.15.72:0/3053668815 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f30300b2220 0x7f3014005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:43.234 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:43.233+0000 7f302de00640 1 -- 172.21.15.72:0/3053668815 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f30300b2220 msgr2=0x7f3014005220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:57:43.234 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:43.233+0000 7f302de00640 1 --2- 172.21.15.72:0/3053668815 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f30300b2220 0x7f3014005220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:43.234 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:43.233+0000 7f302de00640 1 -- 172.21.15.72:0/3053668815 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3014004800 msgr2=0x7f3014004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:57:43.234 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:43.233+0000 7f302de00640 1 --2- 172.21.15.72:0/3053668815 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3014004800 0x7f3014004c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:43.234 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:43.233+0000 7f302de00640 1 -- 172.21.15.72:0/3053668815 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3014003520 con 0x7f30140039e0 2024-04-04T06:57:43.235 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:43.234+0000 7f302de00640 1 --2- 172.21.15.72:0/3053668815 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f30140039e0 0x7f3014003e00 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f3020001780 tx=0x7f3014005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a1ec359eadd3b1d server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:43.235 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:43.234+0000 7f302d400640 1 -- 172.21.15.72:0/3053668815 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3020001370 con 0x7f30140039e0 2024-04-04T06:57:43.236 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:43.235+0000 7f302d400640 1 -- 172.21.15.72:0/3053668815 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30200052d0 con 0x7f30140039e0 2024-04-04T06:57:43.236 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:43.235+0000 7f302d400640 1 -- 172.21.15.72:0/3053668815 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3020003830 con 0x7f30140039e0 2024-04-04T06:57:43.236 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:43.235+0000 7f3035000640 1 -- 172.21.15.72:0/3053668815 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f30140039e0 msgr2=0x7f3014003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:43.236 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:43.235+0000 7f3035000640 1 --2- 172.21.15.72:0/3053668815 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f30140039e0 0x7f3014003e00 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f3020001780 tx=0x7f3014005830 comp rx=0 tx=0).stop 2024-04-04T06:57:43.236 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:43.235+0000 7f302e800640 1 -- 172.21.15.72:0/3053668815 reap_dead start 2024-04-04T06:57:43.236 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:43.235+0000 7f3035000640 1 -- 172.21.15.72:0/3053668815 shutdown_connections 2024-04-04T06:57:43.236 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:43.235+0000 7f3035000640 1 -- 172.21.15.72:0/3053668815 >> 172.21.15.72:0/3053668815 conn(0x7f303006b470 msgr2=0x7f303006b850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:43.236 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:43.235+0000 7f3035000640 1 -- 172.21.15.72:0/3053668815 shutdown_connections 2024-04-04T06:57:43.236 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:43.235+0000 7f3035000640 1 -- 172.21.15.72:0/3053668815 wait complete. 2024-04-04T06:57:43.236 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:43.237+0000 7f3035000640 1 Processor -- start 2024-04-04T06:57:43.236 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:43.237+0000 7f3035000640 1 -- start start 2024-04-04T06:57:43.238 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:43.238+0000 7f3035000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f30140039e0 0x7f30301eae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:43.238 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:43.238+0000 7f3035000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f30300c9d10 0x7f30300cb800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:43.238 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:43.238+0000 7f3035000640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f303013b0d0 0x7f3030142db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:43.238 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:43.238+0000 7f3035000640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f30300b3cc0 con 0x7f303013b0d0 2024-04-04T06:57:43.238 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:43.238+0000 7f3035000640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f30300b3b40 con 0x7f30300c9d10 2024-04-04T06:57:43.238 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:43.238+0000 7f3035000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f30300b3e40 con 0x7f30140039e0 2024-04-04T06:57:43.239 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:43.238+0000 7f302e800640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f303013b0d0 0x7f3030142db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:43.239 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:43.238+0000 7f302e800640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f303013b0d0 0x7f3030142db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:37812/0 (socket says 172.21.15.72:37812) 2024-04-04T06:57:43.239 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:43.238+0000 7f302e800640 1 -- 172.21.15.72:0/3271351547 learned_addr learned my addr 172.21.15.72:0/3271351547 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:57:43.239 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:43.239+0000 7f302de00640 1 --2- 172.21.15.72:0/3271351547 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f30140039e0 0x7f30301eae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:43.239 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:43.239+0000 7f3025400640 1 --2- 172.21.15.72:0/3271351547 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f30300c9d10 0x7f30300cb800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:43.239 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:43.239+0000 7f302e800640 1 -- 172.21.15.72:0/3271351547 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f30140039e0 msgr2=0x7f30301eae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:43.239 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:43.239+0000 7f302e800640 1 --2- 172.21.15.72:0/3271351547 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f30140039e0 0x7f30301eae60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:43.239 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:43.239+0000 7f302e800640 1 -- 172.21.15.72:0/3271351547 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f30300c9d10 msgr2=0x7f30300cb800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:43.239 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:43.239+0000 7f302e800640 1 --2- 172.21.15.72:0/3271351547 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f30300c9d10 0x7f30300cb800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:43.239 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:43.239+0000 7f302e800640 1 -- 172.21.15.72:0/3271351547 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30300c92a0 con 0x7f303013b0d0 2024-04-04T06:57:43.239 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:43.239+0000 7f302e800640 1 --2- 172.21.15.72:0/3271351547 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f303013b0d0 0x7f3030142db0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f3030075320 tx=0x7f302800b4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:43.239 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:43.239+0000 7f3026a00640 1 -- 172.21.15.72:0/3271351547 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f302800de90 con 0x7f303013b0d0 2024-04-04T06:57:43.239 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:43.239+0000 7f3026a00640 1 -- 172.21.15.72:0/3271351547 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f302800bb80 con 0x7f303013b0d0 2024-04-04T06:57:43.239 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:43.239+0000 7f3026a00640 1 -- 172.21.15.72:0/3271351547 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3028007070 con 0x7f303013b0d0 2024-04-04T06:57:43.240 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:43.239+0000 7f3035000640 1 -- 172.21.15.72:0/3271351547 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f303013b840 con 0x7f303013b0d0 2024-04-04T06:57:43.240 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:43.239+0000 7f3035000640 1 -- 172.21.15.72:0/3271351547 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f303013b550 con 0x7f303013b0d0 2024-04-04T06:57:43.240 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:43.241+0000 7f3035000640 1 -- 172.21.15.72:0/3271351547 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30300757a0 con 0x7f303013b0d0 2024-04-04T06:57:43.240 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:43.242+0000 7f3026a00640 1 -- 172.21.15.72:0/3271351547 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f302801b020 con 0x7f303013b0d0 2024-04-04T06:57:43.242 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:43.243+0000 7f3026a00640 1 --2- 172.21.15.72:0/3271351547 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f300c06cac0 0x7f300c06ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:43.242 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:43.243+0000 7f3026a00640 1 -- 172.21.15.72:0/3271351547 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 4857+0+0 (secure 0 0 0) 0x7f302808b9f0 con 0x7f303013b0d0 2024-04-04T06:57:43.242 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:43.243+0000 7f302de00640 1 --2- 172.21.15.72:0/3271351547 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f300c06cac0 0x7f300c06ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:43.242 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:43.244+0000 7f302de00640 1 --2- 172.21.15.72:0/3271351547 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f300c06cac0 0x7f300c06ef80 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f3020033000 tx=0x7f3020009030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:43.246 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:43.248+0000 7f3026a00640 1 -- 172.21.15.72:0/3271351547 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f302805a0d0 con 0x7f303013b0d0 2024-04-04T06:57:43.527 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:43.529+0000 7f3035000640 1 -- 172.21.15.72:0/3271351547 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) -- 0x7f30300cb450 con 0x7f303013b0d0 2024-04-04T06:57:43.531 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:43.533+0000 7f3026a00640 1 -- 172.21.15.72:0/3271351547 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v5) ==== 90+0+0 (secure 0 0 0) 0x7f30280599d0 con 0x7f303013b0d0 2024-04-04T06:57:43.535 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:43.535+0000 7f3035000640 1 -- 172.21.15.72:0/3271351547 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f300c06cac0 msgr2=0x7f300c06ef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:43.535 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:43.535+0000 7f3035000640 1 --2- 172.21.15.72:0/3271351547 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f300c06cac0 0x7f300c06ef80 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f3020033000 tx=0x7f3020009030 comp rx=0 tx=0).stop 2024-04-04T06:57:43.535 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:43.536+0000 7f3035000640 1 -- 172.21.15.72:0/3271351547 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f303013b0d0 msgr2=0x7f3030142db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:43.535 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:43.536+0000 7f3035000640 1 --2- 172.21.15.72:0/3271351547 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f303013b0d0 0x7f3030142db0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f3030075320 tx=0x7f302800b4a0 comp rx=0 tx=0).stop 2024-04-04T06:57:43.535 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:43.536+0000 7f3035000640 1 -- 172.21.15.72:0/3271351547 shutdown_connections 2024-04-04T06:57:43.535 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:43.536+0000 7f3035000640 1 --2- 172.21.15.72:0/3271351547 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f300c06cac0 0x7f300c06ef80 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:43.535 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:43.536+0000 7f3035000640 1 --2- 172.21.15.72:0/3271351547 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f303013b0d0 0x7f3030142db0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:43.535 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:43.536+0000 7f3035000640 1 --2- 172.21.15.72:0/3271351547 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f30300c9d10 0x7f30300cb800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:43.535 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:43.536+0000 7f3035000640 1 --2- 172.21.15.72:0/3271351547 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f30140039e0 0x7f30301eae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:43.535 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:43.536+0000 7f3035000640 1 -- 172.21.15.72:0/3271351547 >> 172.21.15.72:0/3271351547 conn(0x7f303006b470 msgr2=0x7f30300cf5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:43.535 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:43.536+0000 7f3035000640 1 -- 172.21.15.72:0/3271351547 shutdown_connections 2024-04-04T06:57:43.536 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:43.536+0000 7f3035000640 1 -- 172.21.15.72:0/3271351547 wait complete. 2024-04-04T06:57:43.554 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-04-04T06:57:43.752 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:43.753+0000 7fbafea00640 1 Processor -- start 2024-04-04T06:57:43.752 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:43.753+0000 7fbafea00640 1 -- start start 2024-04-04T06:57:43.754 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:43.755+0000 7fbafea00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fbaf81448c0 0x7fbaf80b3b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:43.754 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:43.755+0000 7fbafea00640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fbaf8071b20 0x7fbaf80b1fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:43.754 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:43.755+0000 7fbafea00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbaf8072180 con 0x7fbaf80b1b10 2024-04-04T06:57:43.754 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:43.755+0000 7fbafea00640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7fbaf8071f60 con 0x7fbaf8071b20 2024-04-04T06:57:43.754 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:43.755+0000 7fbafea00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fbaf80b3060 con 0x7fbaf81448c0 2024-04-04T06:57:43.754 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:43.755+0000 7fbafca00640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fbaf8071b20 0x7fbaf80b1fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:43.754 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:43.755+0000 7fbafca00640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fbaf8071b20 0x7fbaf80b1fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:37828/0 (socket says 172.21.15.72:37828) 2024-04-04T06:57:43.754 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:43.755+0000 7fbafca00640 1 -- 172.21.15.72:0/1297314575 learned_addr learned my addr 172.21.15.72:0/1297314575 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:57:43.755 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:43.755+0000 7fbafca00640 1 -- 172.21.15.72:0/1297314575 >> v2:172.21.15.117:3300/0 conn(0x7fbaf81448c0 msgr2=0x7fbaf80b3b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:57:43.755 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:43.755+0000 7fbafca00640 1 --2- 172.21.15.72:0/1297314575 >> v2:172.21.15.117:3300/0 conn(0x7fbaf81448c0 0x7fbaf80b3b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:43.755 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:43.755+0000 7fbafca00640 1 -- 172.21.15.72:0/1297314575 >> v1:172.21.15.117:6789/0 conn(0x7fbaf80b1b10 legacy=0x7fbaf8071410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:57:43.755 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:43.755+0000 7fbafca00640 1 -- 172.21.15.72:0/1297314575 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbaf80b3340 con 0x7fbaf8071b20 2024-04-04T06:57:43.755 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:43.757+0000 7fbafca00640 1 --2- 172.21.15.72:0/1297314575 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbaf8071b20 0x7fbaf80b1fa0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fbaf80754b0 tx=0x7fbaf002dfd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=513d3eaa52c6b6b7 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:43.756 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:43.757+0000 7fbaf6a00640 1 -- 172.21.15.72:0/1297314575 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaf002eb70 con 0x7fbaf8071b20 2024-04-04T06:57:43.756 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:43.757+0000 7fbaf6a00640 1 -- 172.21.15.72:0/1297314575 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbaf002ed10 con 0x7fbaf8071b20 2024-04-04T06:57:43.756 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:43.757+0000 7fbaf6a00640 1 -- 172.21.15.72:0/1297314575 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaf0036610 con 0x7fbaf8071b20 2024-04-04T06:57:43.756 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:43.758+0000 7fbafea00640 1 -- 172.21.15.72:0/1297314575 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbaf8071b20 msgr2=0x7fbaf80b1fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:43.757 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:43.758+0000 7fbafea00640 1 --2- 172.21.15.72:0/1297314575 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbaf8071b20 0x7fbaf80b1fa0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fbaf80754b0 tx=0x7fbaf002dfd0 comp rx=0 tx=0).stop 2024-04-04T06:57:43.757 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:43.758+0000 7fbafea00640 1 -- 172.21.15.72:0/1297314575 shutdown_connections 2024-04-04T06:57:43.757 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:43.758+0000 7fbafea00640 1 --2- 172.21.15.72:0/1297314575 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbaf8071b20 0x7fbaf80b1fa0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:43.757 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:43.758+0000 7fbafea00640 1 --2- 172.21.15.72:0/1297314575 >> v2:172.21.15.117:3300/0 conn(0x7fbaf81448c0 0x7fbaf80b3b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:43.757 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:43.758+0000 7fbafea00640 1 -- 172.21.15.72:0/1297314575 >> 172.21.15.72:0/1297314575 conn(0x7fbaf806b470 msgr2=0x7fbaf806b850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:43.757 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:43.758+0000 7fbafea00640 1 -- 172.21.15.72:0/1297314575 shutdown_connections 2024-04-04T06:57:43.757 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:43.758+0000 7fbafea00640 1 -- 172.21.15.72:0/1297314575 wait complete. 2024-04-04T06:57:43.758 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:43.759+0000 7fbafea00640 1 Processor -- start 2024-04-04T06:57:43.758 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:43.760+0000 7fbafea00640 1 -- start start 2024-04-04T06:57:43.760 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:43.760+0000 7fbafea00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbaf8071b20 0x7fbaf8138900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:43.761 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:43.760+0000 7fbafea00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbaf80b1b10 0x7fbaf815d130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:43.761 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:43.760+0000 7fbafea00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbaf81448c0 0x7fbaf815d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:43.761 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:43.760+0000 7fbafea00640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fbaf80cd730 con 0x7fbaf80b1b10 2024-04-04T06:57:43.761 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:43.761+0000 7fbafea00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fbaf8144ca0 con 0x7fbaf81448c0 2024-04-04T06:57:43.761 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:43.761+0000 7fbafea00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fbaf80cd8b0 con 0x7fbaf8071b20 2024-04-04T06:57:43.761 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:43.761+0000 7fbaf7400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbaf80b1b10 0x7fbaf815d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:43.761 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:43.761+0000 7fbaf7400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbaf80b1b10 0x7fbaf815d130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:37840/0 (socket says 172.21.15.72:37840) 2024-04-04T06:57:43.761 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:43.761+0000 7fbaf7400640 1 -- 172.21.15.72:0/1450801893 learned_addr learned my addr 172.21.15.72:0/1450801893 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:57:43.761 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:43.761+0000 7fbaf7400640 1 -- 172.21.15.72:0/1450801893 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbaf8071b20 msgr2=0x7fbaf8138900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:43.761 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:43.761+0000 7fbaf7e00640 1 --2- 172.21.15.72:0/1450801893 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbaf8071b20 0x7fbaf8138900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:43.761 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:43.761+0000 7fbafca00640 1 --2- 172.21.15.72:0/1450801893 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbaf81448c0 0x7fbaf815d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:43.761 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:43.761+0000 7fbaf7400640 1 --2- 172.21.15.72:0/1450801893 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbaf8071b20 0x7fbaf8138900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:43.761 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:43.761+0000 7fbaf7400640 1 -- 172.21.15.72:0/1450801893 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbaf81448c0 msgr2=0x7fbaf815d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:43.761 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:43.761+0000 7fbaf7400640 1 --2- 172.21.15.72:0/1450801893 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbaf81448c0 0x7fbaf815d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:43.762 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:43.761+0000 7fbaf7400640 1 -- 172.21.15.72:0/1450801893 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbaf80ca210 con 0x7fbaf80b1b10 2024-04-04T06:57:43.762 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:43.761+0000 7fbaf7e00640 1 --2- 172.21.15.72:0/1450801893 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbaf8071b20 0x7fbaf8138900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-04T06:57:43.762 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:43.761+0000 7fbafca00640 1 --2- 172.21.15.72:0/1450801893 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbaf81448c0 0x7fbaf815d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-04T06:57:43.762 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:43.762+0000 7fbaf7400640 1 --2- 172.21.15.72:0/1450801893 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbaf80b1b10 0x7fbaf815d130 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fbae400c410 tx=0x7fbae400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:43.762 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:43.762+0000 7fbaefe00640 1 -- 172.21.15.72:0/1450801893 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbae4017070 con 0x7fbaf80b1b10 2024-04-04T06:57:43.762 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:43.762+0000 7fbaefe00640 1 -- 172.21.15.72:0/1450801893 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbae40035f0 con 0x7fbaf80b1b10 2024-04-04T06:57:43.762 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:43.762+0000 7fbaefe00640 1 -- 172.21.15.72:0/1450801893 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbae4003a20 con 0x7fbaf80b1b10 2024-04-04T06:57:43.762 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:43.762+0000 7fbafea00640 1 -- 172.21.15.72:0/1450801893 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbaf80ca4f0 con 0x7fbaf80b1b10 2024-04-04T06:57:43.762 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:43.762+0000 7fbafea00640 1 -- 172.21.15.72:0/1450801893 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbaf80caab0 con 0x7fbaf80b1b10 2024-04-04T06:57:43.763 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:43.763+0000 7fbafea00640 1 -- 172.21.15.72:0/1450801893 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbaf8144420 con 0x7fbaf80b1b10 2024-04-04T06:57:43.763 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:43.764+0000 7fbaefe00640 1 -- 172.21.15.72:0/1450801893 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fbae4003bc0 con 0x7fbaf80b1b10 2024-04-04T06:57:43.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:43.765+0000 7fbaefe00640 1 --2- 172.21.15.72:0/1450801893 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fbad806c8f0 0x7fbad806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:43.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:43.765+0000 7fbaefe00640 1 -- 172.21.15.72:0/1450801893 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 4857+0+0 (secure 0 0 0) 0x7fbae408aa90 con 0x7fbaf80b1b10 2024-04-04T06:57:43.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:43.765+0000 7fbaf7e00640 1 --2- 172.21.15.72:0/1450801893 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fbad806c8f0 0x7fbad806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:43.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:43.766+0000 7fbaf7e00640 1 --2- 172.21.15.72:0/1450801893 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fbad806c8f0 0x7fbad806edb0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fbaf80b4030 tx=0x7fbae8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:43.768 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:43.770+0000 7fbaefe00640 1 -- 172.21.15.72:0/1450801893 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fbaf8144420 con 0x7fbaf80b1b10 2024-04-04T06:57:44.042 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:44.043+0000 7fbafea00640 1 -- 172.21.15.72:0/1450801893 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) -- 0x7fbaf815bbc0 con 0x7fbaf80b1b10 2024-04-04T06:57:44.046 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:44.047+0000 7fbaefe00640 1 -- 172.21.15.72:0/1450801893 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v6) ==== 90+0+0 (secure 0 0 0) 0x7fbae40592a0 con 0x7fbaf80b1b10 2024-04-04T06:57:44.049 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:44.050+0000 7fbafea00640 1 -- 172.21.15.72:0/1450801893 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fbad806c8f0 msgr2=0x7fbad806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:44.050 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:44.050+0000 7fbafea00640 1 --2- 172.21.15.72:0/1450801893 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fbad806c8f0 0x7fbad806edb0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fbaf80b4030 tx=0x7fbae8008040 comp rx=0 tx=0).stop 2024-04-04T06:57:44.050 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:44.050+0000 7fbafea00640 1 -- 172.21.15.72:0/1450801893 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbaf80b1b10 msgr2=0x7fbaf815d130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:44.050 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:44.050+0000 7fbafea00640 1 --2- 172.21.15.72:0/1450801893 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbaf80b1b10 0x7fbaf815d130 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fbae400c410 tx=0x7fbae400c8d0 comp rx=0 tx=0).stop 2024-04-04T06:57:44.050 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:44.050+0000 7fbafea00640 1 -- 172.21.15.72:0/1450801893 shutdown_connections 2024-04-04T06:57:44.050 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:44.051+0000 7fbafea00640 1 --2- 172.21.15.72:0/1450801893 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fbad806c8f0 0x7fbad806edb0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:44.050 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:44.051+0000 7fbafea00640 1 --2- 172.21.15.72:0/1450801893 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbaf81448c0 0x7fbaf815d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:44.050 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:44.051+0000 7fbafea00640 1 --2- 172.21.15.72:0/1450801893 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbaf80b1b10 0x7fbaf815d130 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:44.050 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:44.051+0000 7fbafea00640 1 --2- 172.21.15.72:0/1450801893 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbaf8071b20 0x7fbaf8138900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:44.050 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:44.051+0000 7fbafea00640 1 -- 172.21.15.72:0/1450801893 >> 172.21.15.72:0/1450801893 conn(0x7fbaf806b470 msgr2=0x7fbaf80cfe50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:44.050 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:44.051+0000 7fbafea00640 1 -- 172.21.15.72:0/1450801893 shutdown_connections 2024-04-04T06:57:44.050 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:44.051+0000 7fbafea00640 1 -- 172.21.15.72:0/1450801893 wait complete. 2024-04-04T06:57:44.069 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-04-04T06:57:44.270 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:44.271+0000 7f6d7da00640 1 Processor -- start 2024-04-04T06:57:44.270 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:44.272+0000 7f6d7da00640 1 -- start start 2024-04-04T06:57:44.272 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:44.273+0000 7f6d7da00640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f6d780b2220 0x7f6d7815ec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:44.272 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:44.273+0000 7f6d7da00640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6d780d0bc0 con 0x7f6d7815e7c0 2024-04-04T06:57:44.272 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:44.273+0000 7f6d7da00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6d7815f350 con 0x7f6d7815e3e0 2024-04-04T06:57:44.272 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:44.273+0000 7f6d7da00640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f6d780d0020 con 0x7f6d780b2220 2024-04-04T06:57:44.272 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:44.273+0000 7f6d77400640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f6d780b2220 0x7f6d7815ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:44.272 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:44.273+0000 7f6d6e000640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f6d7815e7c0 0x7f6d780b1b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:39694/0 (socket says 172.21.15.72:39694) 2024-04-04T06:57:44.272 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:44.273+0000 7f6d6e000640 1 -- 172.21.15.72:0/3655335625 learned_addr learned my addr 172.21.15.72:0/3655335625 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-04-04T06:57:44.273 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:44.274+0000 7f6d77400640 1 -- 172.21.15.72:0/3655335625 >> v1:172.21.15.117:6789/0 conn(0x7f6d7815e3e0 legacy=0x7f6d780d04b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:57:44.273 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:44.274+0000 7f6d77400640 1 -- 172.21.15.72:0/3655335625 >> v1:172.21.15.72:6789/0 conn(0x7f6d7815e7c0 legacy=0x7f6d780b1b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:44.273 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:44.274+0000 7f6d77400640 1 -- 172.21.15.72:0/3655335625 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d7815f630 con 0x7f6d780b2220 2024-04-04T06:57:44.273 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:44.274+0000 7f6d76000640 1 -- 172.21.15.72:0/3655335625 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1077743125 0 0) 0x7f6d780d0bc0 con 0x7f6d7815e7c0 2024-04-04T06:57:44.274 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:44.275+0000 7f6d77400640 1 --2- 172.21.15.72:0/3655335625 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6d780b2220 0x7f6d7815ec50 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f6d70009d90 tx=0x7f6d7002beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6403aca0cc30c server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:44.274 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:44.275+0000 7f6d76000640 1 -- 172.21.15.72:0/3655335625 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d70039070 con 0x7f6d780b2220 2024-04-04T06:57:44.274 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:44.275+0000 7f6d76000640 1 -- 172.21.15.72:0/3655335625 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d7002cc60 con 0x7f6d780b2220 2024-04-04T06:57:44.274 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:44.275+0000 7f6d76000640 1 -- 172.21.15.72:0/3655335625 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d70034660 con 0x7f6d780b2220 2024-04-04T06:57:44.275 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:44.276+0000 7f6d7da00640 1 -- 172.21.15.72:0/3655335625 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6d780b2220 msgr2=0x7f6d7815ec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:44.275 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:44.276+0000 7f6d7da00640 1 --2- 172.21.15.72:0/3655335625 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6d780b2220 0x7f6d7815ec50 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f6d70009d90 tx=0x7f6d7002beb0 comp rx=0 tx=0).stop 2024-04-04T06:57:44.275 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:44.276+0000 7f6d7da00640 1 -- 172.21.15.72:0/3655335625 shutdown_connections 2024-04-04T06:57:44.275 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:44.276+0000 7f6d7da00640 1 --2- 172.21.15.72:0/3655335625 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6d780b2220 0x7f6d7815ec50 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:44.275 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:44.276+0000 7f6d7da00640 1 -- 172.21.15.72:0/3655335625 >> 172.21.15.72:0/3655335625 conn(0x7f6d7806b470 msgr2=0x7f6d7806b850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:44.275 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:44.276+0000 7f6d7da00640 1 -- 172.21.15.72:0/3655335625 shutdown_connections 2024-04-04T06:57:44.275 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:44.276+0000 7f6d7da00640 1 -- 172.21.15.72:0/3655335625 wait complete. 2024-04-04T06:57:44.276 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:44.278+0000 7f6d7da00640 1 Processor -- start 2024-04-04T06:57:44.277 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:44.278+0000 7f6d7da00640 1 -- start start 2024-04-04T06:57:44.279 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:44.279+0000 7f6d7da00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6d780b2220 0x7f6d78147860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:44.279 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:44.279+0000 7f6d7da00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6d7815e3e0 0x7f6d78155670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:44.279 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:44.279+0000 7f6d7da00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6d7815e7c0 0x7f6d7806b850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:44.280 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:44.279+0000 7f6d7da00640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f6d78073560 con 0x7f6d780b2220 2024-04-04T06:57:44.280 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:44.279+0000 7f6d7da00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f6d780733e0 con 0x7f6d7815e7c0 2024-04-04T06:57:44.280 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:44.279+0000 7f6d7da00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f6d78071580 con 0x7f6d7815e3e0 2024-04-04T06:57:44.280 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:44.279+0000 7f6d76a00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6d780b2220 0x7f6d78147860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:44.280 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:44.279+0000 7f6d76a00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6d780b2220 0x7f6d78147860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:37850/0 (socket says 172.21.15.72:37850) 2024-04-04T06:57:44.280 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:44.279+0000 7f6d76a00640 1 -- 172.21.15.72:0/317607495 learned_addr learned my addr 172.21.15.72:0/317607495 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:57:44.280 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:44.280+0000 7f6d6e000640 1 --2- 172.21.15.72:0/317607495 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6d7815e3e0 0x7f6d78155670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:44.280 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:44.280+0000 7f6d77400640 1 --2- 172.21.15.72:0/317607495 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6d7815e7c0 0x7f6d7806b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:44.280 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:44.280+0000 7f6d76a00640 1 -- 172.21.15.72:0/317607495 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6d7815e3e0 msgr2=0x7f6d78155670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:44.280 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:44.280+0000 7f6d76a00640 1 --2- 172.21.15.72:0/317607495 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6d7815e3e0 0x7f6d78155670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:44.280 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:44.280+0000 7f6d76a00640 1 -- 172.21.15.72:0/317607495 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6d7815e7c0 msgr2=0x7f6d7806b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:44.280 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:44.280+0000 7f6d76a00640 1 --2- 172.21.15.72:0/317607495 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6d7815e7c0 0x7f6d7806b850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:44.280 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:44.280+0000 7f6d76a00640 1 -- 172.21.15.72:0/317607495 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d78155f70 con 0x7f6d780b2220 2024-04-04T06:57:44.281 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:44.280+0000 7f6d77400640 1 --2- 172.21.15.72:0/317607495 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6d7815e7c0 0x7f6d7806b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-04T06:57:44.281 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:44.280+0000 7f6d76a00640 1 --2- 172.21.15.72:0/317607495 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6d780b2220 0x7f6d78147860 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f6d6800c430 tx=0x7f6d6800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:44.281 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:44.280+0000 7f6d6f400640 1 -- 172.21.15.72:0/317607495 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d68011790 con 0x7f6d780b2220 2024-04-04T06:57:44.281 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:44.280+0000 7f6d6f400640 1 -- 172.21.15.72:0/317607495 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d68017070 con 0x7f6d780b2220 2024-04-04T06:57:44.281 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:44.280+0000 7f6d6f400640 1 -- 172.21.15.72:0/317607495 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d68011bb0 con 0x7f6d780b2220 2024-04-04T06:57:44.281 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:44.280+0000 7f6d7da00640 1 -- 172.21.15.72:0/317607495 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d78156250 con 0x7f6d780b2220 2024-04-04T06:57:44.281 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:44.280+0000 7f6d7da00640 1 -- 172.21.15.72:0/317607495 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d78156810 con 0x7f6d780b2220 2024-04-04T06:57:44.281 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:44.282+0000 7f6d7da00640 1 -- 172.21.15.72:0/317607495 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d78156c50 con 0x7f6d780b2220 2024-04-04T06:57:44.281 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:44.283+0000 7f6d6f400640 1 -- 172.21.15.72:0/317607495 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6d6801c460 con 0x7f6d780b2220 2024-04-04T06:57:44.282 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:44.284+0000 7f6d6f400640 1 --2- 172.21.15.72:0/317607495 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f6d5406c8f0 0x7f6d5406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:44.283 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:44.284+0000 7f6d6f400640 1 -- 172.21.15.72:0/317607495 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 4857+0+0 (secure 0 0 0) 0x7f6d6808b720 con 0x7f6d780b2220 2024-04-04T06:57:44.283 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:44.284+0000 7f6d6e000640 1 --2- 172.21.15.72:0/317607495 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f6d5406c8f0 0x7f6d5406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:44.283 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:44.285+0000 7f6d6e000640 1 --2- 172.21.15.72:0/317607495 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f6d5406c8f0 0x7f6d5406edb0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f6d78153c90 tx=0x7f6d60007c00 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:44.287 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:44.289+0000 7f6d6f400640 1 -- 172.21.15.72:0/317607495 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f6d68059ea0 con 0x7f6d780b2220 2024-04-04T06:57:44.554 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:44.555+0000 7f6d7da00640 1 -- 172.21.15.72:0/317607495 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) -- 0x7f6d780757a0 con 0x7f6d780b2220 2024-04-04T06:57:44.559 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:44.560+0000 7f6d6f400640 1 -- 172.21.15.72:0/317607495 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v7) ==== 90+0+0 (secure 0 0 0) 0x7f6d680597a0 con 0x7f6d780b2220 2024-04-04T06:57:44.561 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:44.562+0000 7f6d7da00640 1 -- 172.21.15.72:0/317607495 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f6d5406c8f0 msgr2=0x7f6d5406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:44.561 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:44.562+0000 7f6d7da00640 1 --2- 172.21.15.72:0/317607495 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f6d5406c8f0 0x7f6d5406edb0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f6d78153c90 tx=0x7f6d60007c00 comp rx=0 tx=0).stop 2024-04-04T06:57:44.561 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:44.562+0000 7f6d7da00640 1 -- 172.21.15.72:0/317607495 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6d780b2220 msgr2=0x7f6d78147860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:44.561 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:44.562+0000 7f6d7da00640 1 --2- 172.21.15.72:0/317607495 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6d780b2220 0x7f6d78147860 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f6d6800c430 tx=0x7f6d6800c8f0 comp rx=0 tx=0).stop 2024-04-04T06:57:44.562 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:44.562+0000 7f6d7da00640 1 -- 172.21.15.72:0/317607495 shutdown_connections 2024-04-04T06:57:44.562 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:44.562+0000 7f6d7da00640 1 --2- 172.21.15.72:0/317607495 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f6d5406c8f0 0x7f6d5406edb0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:44.562 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:44.562+0000 7f6d7da00640 1 --2- 172.21.15.72:0/317607495 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6d7815e7c0 0x7f6d7806b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:44.562 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:44.562+0000 7f6d7da00640 1 --2- 172.21.15.72:0/317607495 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6d7815e3e0 0x7f6d78155670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:44.562 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:44.562+0000 7f6d7da00640 1 --2- 172.21.15.72:0/317607495 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6d780b2220 0x7f6d78147860 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:44.562 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:44.562+0000 7f6d7da00640 1 -- 172.21.15.72:0/317607495 >> 172.21.15.72:0/317607495 conn(0x7f6d7806b470 msgr2=0x7f6d780b1a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:44.562 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:44.563+0000 7f6d7da00640 1 -- 172.21.15.72:0/317607495 shutdown_connections 2024-04-04T06:57:44.562 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:44.563+0000 7f6d7da00640 1 -- 172.21.15.72:0/317607495 wait complete. 2024-04-04T06:57:44.579 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-04-04T06:57:44.580 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T06:57:44.587 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T06:57:44.758 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:44.760+0000 7f3228400640 1 Processor -- start 2024-04-04T06:57:44.759 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:44.760+0000 7f3228400640 1 -- start start 2024-04-04T06:57:44.760 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:44.761+0000 7f3228400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f322013f1f0 0x7f32200b1b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:44.760 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:44.761+0000 7f3228400640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f32201607c0 0x7f32200ce8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:44.760 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:44.761+0000 7f3228400640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f322013f5d0 con 0x7f32200b2050 2024-04-04T06:57:44.760 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:44.761+0000 7f3228400640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f3220160c50 con 0x7f32201607c0 2024-04-04T06:57:44.760 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:44.761+0000 7f3228400640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f322015c800 con 0x7f322013f1f0 2024-04-04T06:57:44.760 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:44.761+0000 7f3225000640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f32200b2050 0x7f32201600b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:39708/0 (socket says 172.21.15.72:39708) 2024-04-04T06:57:44.760 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:44.761+0000 7f3225000640 1 -- 172.21.15.72:0/2860897447 learned_addr learned my addr 172.21.15.72:0/2860897447 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-04-04T06:57:44.762 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:44.762+0000 7f321fe00640 1 -- 172.21.15.72:0/2860897447 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3675428940 0 0) 0x7f320c001110 con 0x7f32200b2050 2024-04-04T06:57:44.762 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:44.762+0000 7f321fe00640 1 -- 172.21.15.72:0/2860897447 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3208003520 con 0x7f32200b2050 2024-04-04T06:57:44.763 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:44.762+0000 7f3226400640 1 --2- 172.21.15.72:0/2860897447 >> v2:172.21.15.117:3300/0 conn(0x7f32201607c0 0x7f32200ce8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:44.763 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:44.762+0000 7f3225a00640 1 --2- 172.21.15.72:0/2860897447 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f322013f1f0 0x7f32200b1b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:44.763 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:44.762+0000 7f321fe00640 1 -- 172.21.15.72:0/2860897447 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1703419936 0 0) 0x7f3208003520 con 0x7f32200b2050 2024-04-04T06:57:44.763 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:44.762+0000 7f321fe00640 1 -- 172.21.15.72:0/2860897447 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f322013f1f0 msgr2=0x7f32200b1b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:57:44.763 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:44.762+0000 7f321fe00640 1 --2- 172.21.15.72:0/2860897447 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f322013f1f0 0x7f32200b1b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:44.763 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:44.762+0000 7f321fe00640 1 -- 172.21.15.72:0/2860897447 >> v2:172.21.15.117:3300/0 conn(0x7f32201607c0 msgr2=0x7f32200ce8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:57:44.763 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:44.762+0000 7f321fe00640 1 --2- 172.21.15.72:0/2860897447 >> v2:172.21.15.117:3300/0 conn(0x7f32201607c0 0x7f32200ce8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:44.763 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:44.762+0000 7f321fe00640 1 -- 172.21.15.72:0/2860897447 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f322015ca80 con 0x7f32200b2050 2024-04-04T06:57:44.763 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:44.762+0000 7f321fe00640 1 -- 172.21.15.72:0/2860897447 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2465650867 0 0) 0x7f320c001840 con 0x7f32200b2050 2024-04-04T06:57:44.763 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:44.762+0000 7f321fe00640 1 -- 172.21.15.72:0/2860897447 >> v1:172.21.15.72:6789/0 conn(0x7f32200b2050 legacy=0x7f32201600b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:44.763 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:44.762+0000 7f321fe00640 1 --2- 172.21.15.72:0/2860897447 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f322013f1f0 0x7f32080039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:44.763 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:44.762+0000 7f321fe00640 1 --2- 172.21.15.72:0/2860897447 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3208003fe0 0x7f3208004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:44.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:44.762+0000 7f321fe00640 1 --2- 172.21.15.72:0/2860897447 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3208004d40 0x7f32080051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:44.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:44.762+0000 7f321fe00640 1 -- 172.21.15.72:0/2860897447 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f3220160c50 con 0x7f3208003fe0 2024-04-04T06:57:44.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:44.762+0000 7f321fe00640 1 -- 172.21.15.72:0/2860897447 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f322015c800 con 0x7f3208004d40 2024-04-04T06:57:44.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:44.762+0000 7f321fe00640 1 -- 172.21.15.72:0/2860897447 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f320800bac0 con 0x7f322013f1f0 2024-04-04T06:57:44.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:44.763+0000 7f3225000640 1 --2- 172.21.15.72:0/2860897447 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3208003fe0 0x7f3208004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:44.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:44.763+0000 7f3226400640 1 --2- 172.21.15.72:0/2860897447 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3208004d40 0x7f32080051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:44.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:44.763+0000 7f3225a00640 1 --2- 172.21.15.72:0/2860897447 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f322013f1f0 0x7f32080039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:44.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:44.763+0000 7f3225000640 1 -- 172.21.15.72:0/2860897447 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f322013f1f0 msgr2=0x7f32080039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:57:44.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:44.763+0000 7f3225000640 1 --2- 172.21.15.72:0/2860897447 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f322013f1f0 0x7f32080039b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:44.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:44.763+0000 7f3225000640 1 -- 172.21.15.72:0/2860897447 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3208004d40 msgr2=0x7f32080051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:57:44.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:44.763+0000 7f3225000640 1 --2- 172.21.15.72:0/2860897447 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3208004d40 0x7f32080051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:44.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:44.763+0000 7f3225000640 1 -- 172.21.15.72:0/2860897447 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3208003520 con 0x7f3208003fe0 2024-04-04T06:57:44.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:44.763+0000 7f3226400640 1 --2- 172.21.15.72:0/2860897447 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3208004d40 0x7f32080051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-04T06:57:44.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:44.764+0000 7f3225000640 1 --2- 172.21.15.72:0/2860897447 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3208003fe0 0x7f3208004800 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f320c00c3b0 tx=0x7f3208005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae8cd80c874757c server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:44.766 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:44.764+0000 7f321fe00640 1 -- 172.21.15.72:0/2860897447 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f320c00c0e0 con 0x7f3208003fe0 2024-04-04T06:57:44.766 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:44.764+0000 7f321fe00640 1 -- 172.21.15.72:0/2860897447 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f320c030070 con 0x7f3208003fe0 2024-04-04T06:57:44.766 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:44.764+0000 7f321fe00640 1 -- 172.21.15.72:0/2860897447 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f320c0058d0 con 0x7f3208003fe0 2024-04-04T06:57:44.766 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:44.765+0000 7f3228400640 1 -- 172.21.15.72:0/2860897447 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3208003fe0 msgr2=0x7f3208004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:44.766 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:44.765+0000 7f3228400640 1 --2- 172.21.15.72:0/2860897447 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3208003fe0 0x7f3208004800 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f320c00c3b0 tx=0x7f3208005830 comp rx=0 tx=0).stop 2024-04-04T06:57:44.766 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:44.765+0000 7f3226400640 1 -- 172.21.15.72:0/2860897447 reap_dead start 2024-04-04T06:57:44.766 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:44.765+0000 7f3228400640 1 -- 172.21.15.72:0/2860897447 shutdown_connections 2024-04-04T06:57:44.766 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:44.765+0000 7f3228400640 1 -- 172.21.15.72:0/2860897447 >> 172.21.15.72:0/2860897447 conn(0x7f322006b470 msgr2=0x7f322006b850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:44.766 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:44.765+0000 7f3228400640 1 -- 172.21.15.72:0/2860897447 shutdown_connections 2024-04-04T06:57:44.766 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:44.765+0000 7f3228400640 1 -- 172.21.15.72:0/2860897447 wait complete. 2024-04-04T06:57:44.766 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:44.767+0000 7f3228400640 1 Processor -- start 2024-04-04T06:57:44.766 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:44.767+0000 7f3228400640 1 -- start start 2024-04-04T06:57:44.768 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:44.768+0000 7f3228400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3208003fe0 0x7f322013a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:44.769 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:44.768+0000 7f3228400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f32200b0f10 0x7f32200b1390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:44.769 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:44.768+0000 7f3228400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f322013f9a0 0x7f322013fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:44.769 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:44.768+0000 7f3228400640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f322015d320 con 0x7f32200b0f10 2024-04-04T06:57:44.769 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:44.768+0000 7f3228400640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f322015d040 con 0x7f322013f9a0 2024-04-04T06:57:44.769 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:44.768+0000 7f3228400640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f32200b1b10 con 0x7f3208003fe0 2024-04-04T06:57:44.769 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:44.768+0000 7f3225000640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f32200b0f10 0x7f32200b1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:44.769 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:44.768+0000 7f3225000640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f32200b0f10 0x7f32200b1390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:37868/0 (socket says 172.21.15.72:37868) 2024-04-04T06:57:44.769 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:44.768+0000 7f3225000640 1 -- 172.21.15.72:0/4078020953 learned_addr learned my addr 172.21.15.72:0/4078020953 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:57:44.769 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:44.768+0000 7f3226400640 1 --2- 172.21.15.72:0/4078020953 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f322013f9a0 0x7f322013fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:44.769 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:44.768+0000 7f3225a00640 1 --2- 172.21.15.72:0/4078020953 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3208003fe0 0x7f322013a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:44.769 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:44.768+0000 7f3225000640 1 -- 172.21.15.72:0/4078020953 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3208003fe0 msgr2=0x7f322013a820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:44.769 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:44.768+0000 7f3225000640 1 --2- 172.21.15.72:0/4078020953 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3208003fe0 0x7f322013a820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:44.769 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:44.768+0000 7f3225000640 1 -- 172.21.15.72:0/4078020953 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f322013f9a0 msgr2=0x7f322013fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:44.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:44.768+0000 7f3225000640 1 --2- 172.21.15.72:0/4078020953 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f322013f9a0 0x7f322013fe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:44.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:44.768+0000 7f3225000640 1 -- 172.21.15.72:0/4078020953 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f322013ad60 con 0x7f32200b0f10 2024-04-04T06:57:44.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:44.769+0000 7f3225000640 1 --2- 172.21.15.72:0/4078020953 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f32200b0f10 0x7f32200b1390 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f320c001b40 tx=0x7f3220156e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:44.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:44.769+0000 7f321d600640 1 -- 172.21.15.72:0/4078020953 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f320c004bf0 con 0x7f32200b0f10 2024-04-04T06:57:44.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:44.769+0000 7f321d600640 1 -- 172.21.15.72:0/4078020953 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f320c004d90 con 0x7f32200b0f10 2024-04-04T06:57:44.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:44.769+0000 7f3228400640 1 -- 172.21.15.72:0/4078020953 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32201406b0 con 0x7f32200b0f10 2024-04-04T06:57:44.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:44.769+0000 7f321d600640 1 -- 172.21.15.72:0/4078020953 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f320c007270 con 0x7f32200b0f10 2024-04-04T06:57:44.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:44.769+0000 7f3228400640 1 -- 172.21.15.72:0/4078020953 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3220140c70 con 0x7f32200b0f10 2024-04-04T06:57:44.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:44.770+0000 7f3228400640 1 -- 172.21.15.72:0/4078020953 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32200b18d0 con 0x7f32200b0f10 2024-04-04T06:57:44.771 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:44.771+0000 7f321d600640 1 -- 172.21.15.72:0/4078020953 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f320c007410 con 0x7f32200b0f10 2024-04-04T06:57:44.771 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:44.772+0000 7f321d600640 1 --2- 172.21.15.72:0/4078020953 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f320006c920 0x7f320006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:44.771 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:44.772+0000 7f321d600640 1 -- 172.21.15.72:0/4078020953 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 4857+0+0 (secure 0 0 0) 0x7f320c0acfd0 con 0x7f32200b0f10 2024-04-04T06:57:44.771 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:44.772+0000 7f3225a00640 1 --2- 172.21.15.72:0/4078020953 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f320006c920 0x7f320006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:44.772 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:44.773+0000 7f3225a00640 1 --2- 172.21.15.72:0/4078020953 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f320006c920 0x7f320006ede0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f3214006fd0 tx=0x7f3214008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:44.775 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:44.776+0000 7f321d600640 1 -- 172.21.15.72:0/4078020953 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f322013ad60 con 0x7f32200b0f10 2024-04-04T06:57:45.043 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:45.044+0000 7f3228400640 1 -- 172.21.15.72:0/4078020953 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) -- 0x7f32200757a0 con 0x7f32200b0f10 2024-04-04T06:57:45.046 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:45.048+0000 7f321d600640 1 -- 172.21.15.72:0/4078020953 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v8) ==== 90+0+0 (secure 0 0 0) 0x7f322013f5d0 con 0x7f32200b0f10 2024-04-04T06:57:45.049 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:45.050+0000 7f3228400640 1 -- 172.21.15.72:0/4078020953 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f320006c920 msgr2=0x7f320006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:45.049 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:45.050+0000 7f3228400640 1 --2- 172.21.15.72:0/4078020953 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f320006c920 0x7f320006ede0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f3214006fd0 tx=0x7f3214008040 comp rx=0 tx=0).stop 2024-04-04T06:57:45.049 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:45.050+0000 7f3228400640 1 -- 172.21.15.72:0/4078020953 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f32200b0f10 msgr2=0x7f32200b1390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:45.049 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:45.050+0000 7f3228400640 1 --2- 172.21.15.72:0/4078020953 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f32200b0f10 0x7f32200b1390 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f320c001b40 tx=0x7f3220156e50 comp rx=0 tx=0).stop 2024-04-04T06:57:45.049 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:45.050+0000 7f3228400640 1 -- 172.21.15.72:0/4078020953 shutdown_connections 2024-04-04T06:57:45.049 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:45.050+0000 7f3228400640 1 --2- 172.21.15.72:0/4078020953 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f320006c920 0x7f320006ede0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:45.049 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:45.050+0000 7f3228400640 1 --2- 172.21.15.72:0/4078020953 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f322013f9a0 0x7f322013fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:45.049 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:45.050+0000 7f3228400640 1 --2- 172.21.15.72:0/4078020953 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f32200b0f10 0x7f32200b1390 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:45.049 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:45.050+0000 7f3228400640 1 --2- 172.21.15.72:0/4078020953 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3208003fe0 0x7f322013a820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:45.049 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:45.050+0000 7f3228400640 1 -- 172.21.15.72:0/4078020953 >> 172.21.15.72:0/4078020953 conn(0x7f322006b470 msgr2=0x7f322013ddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:45.050 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:45.050+0000 7f3228400640 1 -- 172.21.15.72:0/4078020953 shutdown_connections 2024-04-04T06:57:45.050 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:45.050+0000 7f3228400640 1 -- 172.21.15.72:0/4078020953 wait complete. 2024-04-04T06:57:45.066 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-04-04T06:57:45.272 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:45.273+0000 7f3b6c800640 1 Processor -- start 2024-04-04T06:57:45.272 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:45.273+0000 7f3b6c800640 1 -- start start 2024-04-04T06:57:45.274 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:45.275+0000 7f3b6c800640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f3b640b2220 0x7f3b641600b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:45.274 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:45.275+0000 7f3b6c800640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b6413f5d0 con 0x7f3b6413f1f0 2024-04-04T06:57:45.274 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:45.275+0000 7f3b6c800640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b6415c800 con 0x7f3b641605f0 2024-04-04T06:57:45.274 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:45.275+0000 7f3b6c800640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f3b6415ca80 con 0x7f3b640b2220 2024-04-04T06:57:45.276 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:45.275+0000 7f3b69e00640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f3b6413f1f0 0x7f3b640b1b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:39710/0 (socket says 172.21.15.72:39710) 2024-04-04T06:57:45.276 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:45.275+0000 7f3b69e00640 1 -- 172.21.15.72:0/2326840219 learned_addr learned my addr 172.21.15.72:0/2326840219 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-04-04T06:57:45.276 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:45.276+0000 7f3b69400640 1 --2- 172.21.15.72:0/2326840219 >> v2:172.21.15.117:3300/0 conn(0x7f3b640b2220 0x7f3b641600b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:45.276 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:45.276+0000 7f3b68a00640 1 -- 172.21.15.72:0/2326840219 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3787657932 0 0) 0x7f3b58001110 con 0x7f3b6413f1f0 2024-04-04T06:57:45.276 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:45.276+0000 7f3b68a00640 1 -- 172.21.15.72:0/2326840219 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3b4c003520 con 0x7f3b6413f1f0 2024-04-04T06:57:45.276 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:45.276+0000 7f3b68a00640 1 -- 172.21.15.72:0/2326840219 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 383240645 0 0) 0x7f3b4c003520 con 0x7f3b6413f1f0 2024-04-04T06:57:45.277 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:45.276+0000 7f3b68a00640 1 -- 172.21.15.72:0/2326840219 >> v2:172.21.15.117:3300/0 conn(0x7f3b640b2220 msgr2=0x7f3b641600b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:57:45.277 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:45.276+0000 7f3b68a00640 1 --2- 172.21.15.72:0/2326840219 >> v2:172.21.15.117:3300/0 conn(0x7f3b640b2220 0x7f3b641600b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:45.277 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:45.276+0000 7f3b68a00640 1 -- 172.21.15.72:0/2326840219 >> v1:172.21.15.117:6789/0 conn(0x7f3b641605f0 legacy=0x7f3b640ce8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:45.277 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:45.276+0000 7f3b68a00640 1 -- 172.21.15.72:0/2326840219 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b6415cd60 con 0x7f3b6413f1f0 2024-04-04T06:57:45.277 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:45.276+0000 7f3b68a00640 1 -- 172.21.15.72:0/2326840219 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2465650867 0 0) 0x7f3b58001840 con 0x7f3b6413f1f0 2024-04-04T06:57:45.277 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:45.277+0000 7f3b68a00640 1 -- 172.21.15.72:0/2326840219 >> v1:172.21.15.72:6789/0 conn(0x7f3b6413f1f0 legacy=0x7f3b640b1b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:45.277 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:45.277+0000 7f3b68a00640 1 --2- 172.21.15.72:0/2326840219 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3b4c003a00 0x7f3b4c003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:45.277 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:45.277+0000 7f3b68a00640 1 --2- 172.21.15.72:0/2326840219 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3b4c004800 0x7f3b4c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:45.277 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:45.277+0000 7f3b68a00640 1 --2- 172.21.15.72:0/2326840219 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3b4c0051c0 0x7f3b4c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:45.277 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:45.277+0000 7f3b68a00640 1 -- 172.21.15.72:0/2326840219 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f3b6415ca80 con 0x7f3b4c0051c0 2024-04-04T06:57:45.277 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:45.277+0000 7f3b68a00640 1 -- 172.21.15.72:0/2326840219 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f3b4c00c0c0 con 0x7f3b4c003a00 2024-04-04T06:57:45.277 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:45.277+0000 7f3b68a00640 1 -- 172.21.15.72:0/2326840219 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f3b4c00c2c0 con 0x7f3b4c004800 2024-04-04T06:57:45.277 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:45.277+0000 7f3b6a800640 1 --2- 172.21.15.72:0/2326840219 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3b4c0051c0 0x7f3b4c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:45.277 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:45.277+0000 7f3b69e00640 1 --2- 172.21.15.72:0/2326840219 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3b4c003a00 0x7f3b4c003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:45.278 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:45.277+0000 7f3b69400640 1 --2- 172.21.15.72:0/2326840219 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3b4c004800 0x7f3b4c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:45.278 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:45.277+0000 7f3b6a800640 1 -- 172.21.15.72:0/2326840219 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3b4c004800 msgr2=0x7f3b4c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:57:45.278 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:45.277+0000 7f3b6a800640 1 --2- 172.21.15.72:0/2326840219 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3b4c004800 0x7f3b4c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:45.278 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:45.277+0000 7f3b6a800640 1 -- 172.21.15.72:0/2326840219 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3b4c003a00 msgr2=0x7f3b4c003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:57:45.278 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:45.277+0000 7f3b6a800640 1 --2- 172.21.15.72:0/2326840219 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3b4c003a00 0x7f3b4c003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:45.278 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:45.277+0000 7f3b6a800640 1 -- 172.21.15.72:0/2326840219 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b4c003520 con 0x7f3b4c0051c0 2024-04-04T06:57:45.279 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:45.278+0000 7f3b6a800640 1 -- 172.21.15.72:0/2326840219 reap_dead start 2024-04-04T06:57:45.279 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:45.279+0000 7f3b6a800640 1 --2- 172.21.15.72:0/2326840219 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3b4c0051c0 0x7f3b4c00b9c0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f3b60001e50 tx=0x7f3b4c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f03f0263b08e929 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:45.279 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:45.279+0000 7f3b68a00640 1 -- 172.21.15.72:0/2326840219 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b60001a70 con 0x7f3b4c0051c0 2024-04-04T06:57:45.279 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:45.279+0000 7f3b68a00640 1 -- 172.21.15.72:0/2326840219 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b60003b90 con 0x7f3b4c0051c0 2024-04-04T06:57:45.279 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:45.279+0000 7f3b68a00640 1 -- 172.21.15.72:0/2326840219 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b600050d0 con 0x7f3b4c0051c0 2024-04-04T06:57:45.279 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:45.279+0000 7f3b6c800640 1 -- 172.21.15.72:0/2326840219 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3b4c0051c0 msgr2=0x7f3b4c00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:45.280 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:45.279+0000 7f3b6c800640 1 --2- 172.21.15.72:0/2326840219 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3b4c0051c0 0x7f3b4c00b9c0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f3b60001e50 tx=0x7f3b4c005830 comp rx=0 tx=0).stop 2024-04-04T06:57:45.280 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:45.279+0000 7f3b6c800640 1 -- 172.21.15.72:0/2326840219 shutdown_connections 2024-04-04T06:57:45.280 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:45.279+0000 7f3b6c800640 1 --2- 172.21.15.72:0/2326840219 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3b4c0051c0 0x7f3b4c00b9c0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:45.280 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:45.279+0000 7f3b6c800640 1 -- 172.21.15.72:0/2326840219 >> 172.21.15.72:0/2326840219 conn(0x7f3b6406b470 msgr2=0x7f3b6406b850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:45.280 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:45.279+0000 7f3b6c800640 1 -- 172.21.15.72:0/2326840219 shutdown_connections 2024-04-04T06:57:45.280 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:45.279+0000 7f3b6c800640 1 -- 172.21.15.72:0/2326840219 wait complete. 2024-04-04T06:57:45.282 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:45.281+0000 7f3b6c800640 1 Processor -- start 2024-04-04T06:57:45.282 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:45.281+0000 7f3b6c800640 1 -- start start 2024-04-04T06:57:45.282 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:45.282+0000 7f3b6c800640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3b4c0051c0 0x7f3b640b2c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:45.282 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:45.282+0000 7f3b6c800640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3b6414e660 0x7f3b641349c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:45.282 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:45.282+0000 7f3b6c800640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3b641f4160 0x7f3b6413bf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:45.283 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:45.282+0000 7f3b6c800640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f3b64160a20 con 0x7f3b6414e660 2024-04-04T06:57:45.283 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:45.282+0000 7f3b6c800640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f3b6415d320 con 0x7f3b4c0051c0 2024-04-04T06:57:45.283 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:45.282+0000 7f3b6c800640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f3b64160ba0 con 0x7f3b641f4160 2024-04-04T06:57:45.283 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:45.282+0000 7f3b69400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3b6414e660 0x7f3b641349c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:45.283 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:45.282+0000 7f3b69400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3b6414e660 0x7f3b641349c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:37884/0 (socket says 172.21.15.72:37884) 2024-04-04T06:57:45.283 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:45.282+0000 7f3b69400640 1 -- 172.21.15.72:0/1341833019 learned_addr learned my addr 172.21.15.72:0/1341833019 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:57:45.283 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:45.283+0000 7f3b69e00640 1 --2- 172.21.15.72:0/1341833019 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3b4c0051c0 0x7f3b640b2c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:45.283 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:45.283+0000 7f3b6a800640 1 --2- 172.21.15.72:0/1341833019 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3b641f4160 0x7f3b6413bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:45.283 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:45.283+0000 7f3b69400640 1 -- 172.21.15.72:0/1341833019 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3b641f4160 msgr2=0x7f3b6413bf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:45.283 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:45.283+0000 7f3b69400640 1 --2- 172.21.15.72:0/1341833019 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3b641f4160 0x7f3b6413bf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:45.283 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:45.283+0000 7f3b69400640 1 -- 172.21.15.72:0/1341833019 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3b4c0051c0 msgr2=0x7f3b640b2c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:45.283 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:45.283+0000 7f3b69400640 1 --2- 172.21.15.72:0/1341833019 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3b4c0051c0 0x7f3b640b2c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:45.283 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:45.283+0000 7f3b69400640 1 -- 172.21.15.72:0/1341833019 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b640b3140 con 0x7f3b6414e660 2024-04-04T06:57:45.283 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:45.283+0000 7f3b69400640 1 --2- 172.21.15.72:0/1341833019 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3b6414e660 0x7f3b641349c0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f3b54011570 tx=0x7f3b54011a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:45.284 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:45.283+0000 7f3b5e000640 1 -- 172.21.15.72:0/1341833019 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b54015930 con 0x7f3b6414e660 2024-04-04T06:57:45.284 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:45.283+0000 7f3b5e000640 1 -- 172.21.15.72:0/1341833019 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b54015ad0 con 0x7f3b6414e660 2024-04-04T06:57:45.284 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:45.283+0000 7f3b5e000640 1 -- 172.21.15.72:0/1341833019 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b5401d400 con 0x7f3b6414e660 2024-04-04T06:57:45.284 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:45.283+0000 7f3b6c800640 1 -- 172.21.15.72:0/1341833019 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b640b33c0 con 0x7f3b6414e660 2024-04-04T06:57:45.284 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:45.283+0000 7f3b6c800640 1 -- 172.21.15.72:0/1341833019 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b640b3980 con 0x7f3b6414e660 2024-04-04T06:57:45.284 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:45.285+0000 7f3b6c800640 1 -- 172.21.15.72:0/1341833019 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b640757a0 con 0x7f3b6414e660 2024-04-04T06:57:45.284 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:45.286+0000 7f3b5e000640 1 -- 172.21.15.72:0/1341833019 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3b5401d5a0 con 0x7f3b6414e660 2024-04-04T06:57:45.285 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:45.286+0000 7f3b5e000640 1 --2- 172.21.15.72:0/1341833019 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f3b4806c8f0 0x7f3b4806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:45.285 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:45.287+0000 7f3b5e000640 1 -- 172.21.15.72:0/1341833019 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 4857+0+0 (secure 0 0 0) 0x7f3b5408c010 con 0x7f3b6414e660 2024-04-04T06:57:45.285 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:45.287+0000 7f3b69e00640 1 --2- 172.21.15.72:0/1341833019 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f3b4806c8f0 0x7f3b4806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:45.286 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:45.287+0000 7f3b69e00640 1 --2- 172.21.15.72:0/1341833019 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f3b4806c8f0 0x7f3b4806edb0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f3b580012b0 tx=0x7f3b58009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:45.289 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:45.291+0000 7f3b5e000640 1 -- 172.21.15.72:0/1341833019 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f3b640b3140 con 0x7f3b6414e660 2024-04-04T06:57:45.565 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:45.566+0000 7f3b6c800640 1 -- 172.21.15.72:0/1341833019 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) -- 0x7f3b6415c240 con 0x7f3b6414e660 2024-04-04T06:57:45.569 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:45.570+0000 7f3b5e000640 1 -- 172.21.15.72:0/1341833019 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v9) ==== 97+0+0 (secure 0 0 0) 0x7f3b54019030 con 0x7f3b6414e660 2024-04-04T06:57:45.572 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:45.573+0000 7f3b6c800640 1 -- 172.21.15.72:0/1341833019 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f3b4806c8f0 msgr2=0x7f3b4806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:45.572 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:45.573+0000 7f3b6c800640 1 --2- 172.21.15.72:0/1341833019 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f3b4806c8f0 0x7f3b4806edb0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f3b580012b0 tx=0x7f3b58009040 comp rx=0 tx=0).stop 2024-04-04T06:57:45.572 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:45.573+0000 7f3b6c800640 1 -- 172.21.15.72:0/1341833019 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3b6414e660 msgr2=0x7f3b641349c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:45.572 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:45.573+0000 7f3b6c800640 1 --2- 172.21.15.72:0/1341833019 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3b6414e660 0x7f3b641349c0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f3b54011570 tx=0x7f3b54011a30 comp rx=0 tx=0).stop 2024-04-04T06:57:45.572 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:45.573+0000 7f3b6c800640 1 -- 172.21.15.72:0/1341833019 shutdown_connections 2024-04-04T06:57:45.573 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:45.573+0000 7f3b6c800640 1 --2- 172.21.15.72:0/1341833019 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f3b4806c8f0 0x7f3b4806edb0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:45.573 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:45.573+0000 7f3b6c800640 1 --2- 172.21.15.72:0/1341833019 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3b641f4160 0x7f3b6413bf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:45.573 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:45.573+0000 7f3b6c800640 1 --2- 172.21.15.72:0/1341833019 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3b6414e660 0x7f3b641349c0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:45.573 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:45.573+0000 7f3b6c800640 1 --2- 172.21.15.72:0/1341833019 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3b4c0051c0 0x7f3b640b2c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:45.573 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:45.573+0000 7f3b6c800640 1 -- 172.21.15.72:0/1341833019 >> 172.21.15.72:0/1341833019 conn(0x7f3b6406b470 msgr2=0x7f3b64141440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:45.573 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:45.573+0000 7f3b6c800640 1 -- 172.21.15.72:0/1341833019 shutdown_connections 2024-04-04T06:57:45.573 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:45.573+0000 7f3b6c800640 1 -- 172.21.15.72:0/1341833019 wait complete. 2024-04-04T06:57:45.590 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-04-04T06:57:45.800 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:45.801+0000 7f472fe00640 1 Processor -- start 2024-04-04T06:57:45.800 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:45.801+0000 7f472fe00640 1 -- start start 2024-04-04T06:57:45.801 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:45.802+0000 7f472fe00640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f473015e630 0x7f47300d22c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:45.801 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:45.803+0000 7f472fe00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f47300b9f40 0x7f47300cf010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:45.802 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:45.803+0000 7f472fe00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f47300d3cd0 0x7f47300cf550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:45.802 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:45.803+0000 7f472fe00640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f47300d2c30 con 0x7f473015e630 2024-04-04T06:57:45.802 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:45.803+0000 7f472fe00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f47300d2f10 con 0x7f47300b9f40 2024-04-04T06:57:45.802 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:45.803+0000 7f472fe00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f47300d31f0 con 0x7f47300d3cd0 2024-04-04T06:57:45.802 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:45.803+0000 7f472ea00640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f473015e630 0x7f47300d22c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:45.802 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:45.803+0000 7f472ea00640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f473015e630 0x7f47300d22c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:37894/0 (socket says 172.21.15.72:37894) 2024-04-04T06:57:45.802 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:45.803+0000 7f472ea00640 1 -- 172.21.15.72:0/2432350459 learned_addr learned my addr 172.21.15.72:0/2432350459 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:57:45.803 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:45.803+0000 7f472f400640 1 --2- 172.21.15.72:0/2432350459 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f47300d3cd0 0x7f47300cf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:45.803 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:45.803+0000 7f472e000640 1 --2- 172.21.15.72:0/2432350459 >> v2:172.21.15.117:3300/0 conn(0x7f47300b9f40 0x7f47300cf010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:45.803 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:45.803+0000 7f472ea00640 1 -- 172.21.15.72:0/2432350459 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f47300d3cd0 msgr2=0x7f47300cf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:57:45.803 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:45.803+0000 7f472ea00640 1 --2- 172.21.15.72:0/2432350459 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f47300d3cd0 0x7f47300cf550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:45.803 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:45.803+0000 7f472ea00640 1 -- 172.21.15.72:0/2432350459 >> v2:172.21.15.117:3300/0 conn(0x7f47300b9f40 msgr2=0x7f47300cf010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:57:45.803 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:45.803+0000 7f472ea00640 1 --2- 172.21.15.72:0/2432350459 >> v2:172.21.15.117:3300/0 conn(0x7f47300b9f40 0x7f47300cf010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:45.803 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:45.803+0000 7f472ea00640 1 -- 172.21.15.72:0/2432350459 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47300d34d0 con 0x7f473015e630 2024-04-04T06:57:45.804 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:45.805+0000 7f472ea00640 1 --2- 172.21.15.72:0/2432350459 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f473015e630 0x7f47300d22c0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f47300b7140 tx=0x7f472002b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16178a2f6e84988b server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:45.804 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:45.805+0000 7f472d600640 1 -- 172.21.15.72:0/2432350459 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f472002e070 con 0x7f473015e630 2024-04-04T06:57:45.804 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:45.805+0000 7f472d600640 1 -- 172.21.15.72:0/2432350459 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4720037070 con 0x7f473015e630 2024-04-04T06:57:45.804 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:45.805+0000 7f472d600640 1 -- 172.21.15.72:0/2432350459 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4720031a00 con 0x7f473015e630 2024-04-04T06:57:45.805 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:45.806+0000 7f472fe00640 1 -- 172.21.15.72:0/2432350459 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f473015e630 msgr2=0x7f47300d22c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:45.805 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:45.806+0000 7f472fe00640 1 --2- 172.21.15.72:0/2432350459 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f473015e630 0x7f47300d22c0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f47300b7140 tx=0x7f472002b880 comp rx=0 tx=0).stop 2024-04-04T06:57:45.805 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:45.806+0000 7f472fe00640 1 -- 172.21.15.72:0/2432350459 shutdown_connections 2024-04-04T06:57:45.805 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:45.806+0000 7f472fe00640 1 --2- 172.21.15.72:0/2432350459 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f47300d3cd0 0x7f47300cf550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:45.805 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:45.806+0000 7f472fe00640 1 --2- 172.21.15.72:0/2432350459 >> v2:172.21.15.117:3300/0 conn(0x7f47300b9f40 0x7f47300cf010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:45.805 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:45.806+0000 7f472fe00640 1 --2- 172.21.15.72:0/2432350459 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f473015e630 0x7f47300d22c0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:45.805 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:45.806+0000 7f472fe00640 1 -- 172.21.15.72:0/2432350459 >> 172.21.15.72:0/2432350459 conn(0x7f473006b860 msgr2=0x7f473006bc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:45.805 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:45.806+0000 7f472fe00640 1 -- 172.21.15.72:0/2432350459 shutdown_connections 2024-04-04T06:57:45.805 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:45.806+0000 7f472fe00640 1 -- 172.21.15.72:0/2432350459 wait complete. 2024-04-04T06:57:45.807 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:45.808+0000 7f472fe00640 1 Processor -- start 2024-04-04T06:57:45.807 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:45.808+0000 7f472fe00640 1 -- start start 2024-04-04T06:57:45.807 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:45.809+0000 7f472fe00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f47300b9f40 0x7f473015d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:45.808 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:45.809+0000 7f472fe00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f47300d3cd0 0x7f4730151d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:45.808 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:45.809+0000 7f472fe00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f473015e630 0x7f47300c99e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:45.808 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:45.809+0000 7f472fe00640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f47300d2980 con 0x7f47300d3cd0 2024-04-04T06:57:45.808 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:45.809+0000 7f472fe00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f47300d2800 con 0x7f473015e630 2024-04-04T06:57:45.808 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:45.809+0000 7f472fe00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f4730071a90 con 0x7f47300b9f40 2024-04-04T06:57:45.808 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:45.809+0000 7f472e000640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f47300d3cd0 0x7f4730151d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:45.808 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:45.809+0000 7f472e000640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f47300d3cd0 0x7f4730151d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:37898/0 (socket says 172.21.15.72:37898) 2024-04-04T06:57:45.808 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:45.809+0000 7f472e000640 1 -- 172.21.15.72:0/2044991586 learned_addr learned my addr 172.21.15.72:0/2044991586 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:57:45.810 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:45.809+0000 7f472e000640 1 -- 172.21.15.72:0/2044991586 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f47300b9f40 msgr2=0x7f473015d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:45.810 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:45.809+0000 7f472ea00640 1 --2- 172.21.15.72:0/2044991586 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f47300b9f40 0x7f473015d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:45.810 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:45.809+0000 7f472f400640 1 --2- 172.21.15.72:0/2044991586 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f473015e630 0x7f47300c99e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:45.810 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:45.809+0000 7f472e000640 1 --2- 172.21.15.72:0/2044991586 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f47300b9f40 0x7f473015d390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:45.810 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:45.810+0000 7f472e000640 1 -- 172.21.15.72:0/2044991586 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f473015e630 msgr2=0x7f47300c99e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:45.811 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:45.810+0000 7f472e000640 1 --2- 172.21.15.72:0/2044991586 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f473015e630 0x7f47300c99e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:45.811 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:45.810+0000 7f472e000640 1 -- 172.21.15.72:0/2044991586 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4730152260 con 0x7f47300d3cd0 2024-04-04T06:57:45.811 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:45.810+0000 7f472e000640 1 --2- 172.21.15.72:0/2044991586 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f47300d3cd0 0x7f4730151d20 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f471c00cda0 tx=0x7f471c00a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:45.811 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:45.810+0000 7f4726a00640 1 -- 172.21.15.72:0/2044991586 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f471c003b90 con 0x7f47300d3cd0 2024-04-04T06:57:45.811 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:45.810+0000 7f4726a00640 1 -- 172.21.15.72:0/2044991586 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f471c003d30 con 0x7f47300d3cd0 2024-04-04T06:57:45.811 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:45.810+0000 7f4726a00640 1 -- 172.21.15.72:0/2044991586 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f471c004260 con 0x7f47300d3cd0 2024-04-04T06:57:45.811 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:45.810+0000 7f472fe00640 1 -- 172.21.15.72:0/2044991586 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f473015ee80 con 0x7f47300d3cd0 2024-04-04T06:57:45.811 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:45.810+0000 7f472fe00640 1 -- 172.21.15.72:0/2044991586 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f473015f440 con 0x7f47300d3cd0 2024-04-04T06:57:45.811 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:45.811+0000 7f472fe00640 1 -- 172.21.15.72:0/2044991586 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47300756c0 con 0x7f47300d3cd0 2024-04-04T06:57:45.812 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:45.812+0000 7f4726a00640 1 -- 172.21.15.72:0/2044991586 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f471c004400 con 0x7f47300d3cd0 2024-04-04T06:57:45.812 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:45.813+0000 7f4726a00640 1 --2- 172.21.15.72:0/2044991586 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f471006c8f0 0x7f471006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:45.812 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:45.813+0000 7f4726a00640 1 -- 172.21.15.72:0/2044991586 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 4857+0+0 (secure 0 0 0) 0x7f471c08c300 con 0x7f47300d3cd0 2024-04-04T06:57:45.812 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:45.813+0000 7f472ea00640 1 --2- 172.21.15.72:0/2044991586 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f471006c8f0 0x7f471006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:45.813 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:45.814+0000 7f472ea00640 1 --2- 172.21.15.72:0/2044991586 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f471006c8f0 0x7f471006edb0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f4720036000 tx=0x7f4720008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:45.816 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:45.818+0000 7f4726a00640 1 -- 172.21.15.72:0/2044991586 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f471c01d340 con 0x7f47300d3cd0 2024-04-04T06:57:46.087 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:46.088+0000 7f472fe00640 1 -- 172.21.15.72:0/2044991586 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) -- 0x7f47300d5120 con 0x7f47300d3cd0 2024-04-04T06:57:46.090 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:46.092+0000 7f4726a00640 1 -- 172.21.15.72:0/2044991586 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v10) ==== 90+0+0 (secure 0 0 0) 0x7f471c05a9f0 con 0x7f47300d3cd0 2024-04-04T06:57:46.094 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:46.094+0000 7f472fe00640 1 -- 172.21.15.72:0/2044991586 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f471006c8f0 msgr2=0x7f471006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:46.094 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:46.094+0000 7f472fe00640 1 --2- 172.21.15.72:0/2044991586 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f471006c8f0 0x7f471006edb0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f4720036000 tx=0x7f4720008030 comp rx=0 tx=0).stop 2024-04-04T06:57:46.094 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:46.094+0000 7f472fe00640 1 -- 172.21.15.72:0/2044991586 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f47300d3cd0 msgr2=0x7f4730151d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:46.094 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:46.094+0000 7f472fe00640 1 --2- 172.21.15.72:0/2044991586 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f47300d3cd0 0x7f4730151d20 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f471c00cda0 tx=0x7f471c00a660 comp rx=0 tx=0).stop 2024-04-04T06:57:46.094 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:46.095+0000 7f472fe00640 1 -- 172.21.15.72:0/2044991586 shutdown_connections 2024-04-04T06:57:46.094 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:46.095+0000 7f472fe00640 1 --2- 172.21.15.72:0/2044991586 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f471006c8f0 0x7f471006edb0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:46.094 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:46.095+0000 7f472fe00640 1 --2- 172.21.15.72:0/2044991586 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f473015e630 0x7f47300c99e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:46.094 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:46.095+0000 7f472fe00640 1 --2- 172.21.15.72:0/2044991586 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f47300d3cd0 0x7f4730151d20 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:46.094 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:46.095+0000 7f472fe00640 1 --2- 172.21.15.72:0/2044991586 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f47300b9f40 0x7f473015d390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:46.094 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:46.095+0000 7f472fe00640 1 -- 172.21.15.72:0/2044991586 >> 172.21.15.72:0/2044991586 conn(0x7f473006b860 msgr2=0x7f4730071de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:46.094 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:46.095+0000 7f472fe00640 1 -- 172.21.15.72:0/2044991586 shutdown_connections 2024-04-04T06:57:46.095 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:46.095+0000 7f472fe00640 1 -- 172.21.15.72:0/2044991586 wait complete. 2024-04-04T06:57:46.113 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-04T06:57:46.321 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:46.322+0000 7f59dd000640 1 Processor -- start 2024-04-04T06:57:46.321 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:46.322+0000 7f59dd000640 1 -- start start 2024-04-04T06:57:46.322 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:46.323+0000 7f59dd000640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f59d815b230 0x7f59d80d00c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:46.322 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:46.323+0000 7f59dd000640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f59d80d0600 0x7f59d80c4ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:46.323 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:46.323+0000 7f59dd000640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59d80c5980 con 0x7f59d80c5530 2024-04-04T06:57:46.323 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:46.323+0000 7f59dd000640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f59d815c2b0 con 0x7f59d80d0600 2024-04-04T06:57:46.323 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:46.323+0000 7f59dd000640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f59d80d0a40 con 0x7f59d815b230 2024-04-04T06:57:46.323 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:46.324+0000 7f59cfe00640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f59d80d0600 0x7f59d80c4ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:46.323 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:46.324+0000 7f59d6800640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f59d80c5530 0x7f59d815ed60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:39722/0 (socket says 172.21.15.72:39722) 2024-04-04T06:57:46.323 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:46.324+0000 7f59d6800640 1 -- 172.21.15.72:0/583102397 learned_addr learned my addr 172.21.15.72:0/583102397 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-04-04T06:57:46.323 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:46.324+0000 7f59d5e00640 1 --2- 172.21.15.72:0/583102397 >> v2:172.21.15.117:3300/0 conn(0x7f59d815b230 0x7f59d80d00c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:46.324 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:46.324+0000 7f59cfe00640 1 -- 172.21.15.72:0/583102397 >> v2:172.21.15.117:3300/0 conn(0x7f59d815b230 msgr2=0x7f59d80d00c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:57:46.324 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:46.324+0000 7f59cfe00640 1 --2- 172.21.15.72:0/583102397 >> v2:172.21.15.117:3300/0 conn(0x7f59d815b230 0x7f59d80d00c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:46.324 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:46.324+0000 7f59cfe00640 1 -- 172.21.15.72:0/583102397 >> v1:172.21.15.72:6789/0 conn(0x7f59d80c5530 legacy=0x7f59d815ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:46.324 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:46.324+0000 7f59cfe00640 1 -- 172.21.15.72:0/583102397 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59d80c5c00 con 0x7f59d80d0600 2024-04-04T06:57:46.324 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:46.324+0000 7f59d5400640 1 -- 172.21.15.72:0/583102397 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1448646422 0 0) 0x7f59d0001490 con 0x7f59d80c5530 2024-04-04T06:57:46.324 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:46.325+0000 7f59cfe00640 1 --2- 172.21.15.72:0/583102397 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f59d80d0600 0x7f59d80c4ff0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f59d80d0c80 tx=0x7f59c002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46f8d5bfd9501740 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:46.325 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:46.326+0000 7f59d5400640 1 -- 172.21.15.72:0/583102397 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59c0035020 con 0x7f59d80d0600 2024-04-04T06:57:46.325 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:46.326+0000 7f59d5400640 1 -- 172.21.15.72:0/583102397 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59c0031830 con 0x7f59d80d0600 2024-04-04T06:57:46.325 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:46.326+0000 7f59d5400640 1 -- 172.21.15.72:0/583102397 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59c0031c00 con 0x7f59d80d0600 2024-04-04T06:57:46.325 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:46.326+0000 7f59dd000640 1 -- 172.21.15.72:0/583102397 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f59d80d0600 msgr2=0x7f59d80c4ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:46.326 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:46.326+0000 7f59dd000640 1 --2- 172.21.15.72:0/583102397 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f59d80d0600 0x7f59d80c4ff0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f59d80d0c80 tx=0x7f59c002b8d0 comp rx=0 tx=0).stop 2024-04-04T06:57:46.326 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:46.326+0000 7f59dd000640 1 -- 172.21.15.72:0/583102397 shutdown_connections 2024-04-04T06:57:46.326 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:46.326+0000 7f59dd000640 1 --2- 172.21.15.72:0/583102397 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f59d80d0600 0x7f59d80c4ff0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:46.326 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:46.326+0000 7f59dd000640 1 --2- 172.21.15.72:0/583102397 >> v2:172.21.15.117:3300/0 conn(0x7f59d815b230 0x7f59d80d00c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:46.326 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:46.326+0000 7f59dd000640 1 -- 172.21.15.72:0/583102397 >> 172.21.15.72:0/583102397 conn(0x7f59d806b470 msgr2=0x7f59d806b880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:46.326 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:46.326+0000 7f59dd000640 1 -- 172.21.15.72:0/583102397 shutdown_connections 2024-04-04T06:57:46.326 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:46.326+0000 7f59dd000640 1 -- 172.21.15.72:0/583102397 wait complete. 2024-04-04T06:57:46.327 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:46.328+0000 7f59dd000640 1 Processor -- start 2024-04-04T06:57:46.327 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:46.328+0000 7f59dd000640 1 -- start start 2024-04-04T06:57:46.329 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:46.329+0000 7f59dd000640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f59d80c5530 0x7f59d8157d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:46.330 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:46.329+0000 7f59dd000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f59d80d0600 0x7f59d80c9e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:46.330 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:46.329+0000 7f59dd000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f59d815b230 0x7f59d80b3e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:46.330 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:46.329+0000 7f59dd000640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f59d815bf40 con 0x7f59d80c5530 2024-04-04T06:57:46.330 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:46.329+0000 7f59dd000640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f59d815bc60 con 0x7f59d80d0600 2024-04-04T06:57:46.330 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:46.329+0000 7f59dd000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f59d815b610 con 0x7f59d815b230 2024-04-04T06:57:46.330 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:46.329+0000 7f59d5e00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f59d80c5530 0x7f59d8157d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:46.330 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:46.330+0000 7f59d5e00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f59d80c5530 0x7f59d8157d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:37914/0 (socket says 172.21.15.72:37914) 2024-04-04T06:57:46.330 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:46.330+0000 7f59d5e00640 1 -- 172.21.15.72:0/4250743449 learned_addr learned my addr 172.21.15.72:0/4250743449 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:57:46.330 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:46.330+0000 7f59cfe00640 1 --2- 172.21.15.72:0/4250743449 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f59d80d0600 0x7f59d80c9e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:46.330 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:46.330+0000 7f59d5e00640 1 -- 172.21.15.72:0/4250743449 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f59d815b230 msgr2=0x7f59d80b3e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:46.330 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:46.330+0000 7f59d6800640 1 --2- 172.21.15.72:0/4250743449 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f59d815b230 0x7f59d80b3e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:46.331 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:46.330+0000 7f59d5e00640 1 --2- 172.21.15.72:0/4250743449 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f59d815b230 0x7f59d80b3e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:46.331 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:46.330+0000 7f59d5e00640 1 -- 172.21.15.72:0/4250743449 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f59d80d0600 msgr2=0x7f59d80c9e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:46.331 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:46.330+0000 7f59d5e00640 1 --2- 172.21.15.72:0/4250743449 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f59d80d0600 0x7f59d80c9e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:46.331 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:46.330+0000 7f59d5e00640 1 -- 172.21.15.72:0/4250743449 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59d80ae8a0 con 0x7f59d80c5530 2024-04-04T06:57:46.331 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:46.330+0000 7f59d5e00640 1 --2- 172.21.15.72:0/4250743449 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f59d80c5530 0x7f59d8157d60 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f59c800d800 tx=0x7f59c800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:46.331 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:46.330+0000 7f59ce000640 1 -- 172.21.15.72:0/4250743449 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59c800b6c0 con 0x7f59d80c5530 2024-04-04T06:57:46.331 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:46.330+0000 7f59ce000640 1 -- 172.21.15.72:0/4250743449 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59c8019070 con 0x7f59d80c5530 2024-04-04T06:57:46.331 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:46.330+0000 7f59ce000640 1 -- 172.21.15.72:0/4250743449 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59c800ba80 con 0x7f59d80c5530 2024-04-04T06:57:46.331 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:46.330+0000 7f59dd000640 1 -- 172.21.15.72:0/4250743449 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59d80aeb80 con 0x7f59d80c5530 2024-04-04T06:57:46.331 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:46.331+0000 7f59dd000640 1 -- 172.21.15.72:0/4250743449 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59d81582a0 con 0x7f59d80c5530 2024-04-04T06:57:46.332 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:46.332+0000 7f59dd000640 1 -- 172.21.15.72:0/4250743449 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59d806d670 con 0x7f59d80c5530 2024-04-04T06:57:46.332 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:46.333+0000 7f59ce000640 1 -- 172.21.15.72:0/4250743449 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f59c800bc20 con 0x7f59d80c5530 2024-04-04T06:57:46.332 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:46.333+0000 7f59ce000640 1 --2- 172.21.15.72:0/4250743449 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f59b406c920 0x7f59b406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:46.332 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:46.334+0000 7f59ce000640 1 -- 172.21.15.72:0/4250743449 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 4857+0+0 (secure 0 0 0) 0x7f59c808bca0 con 0x7f59d80c5530 2024-04-04T06:57:46.333 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:46.334+0000 7f59cfe00640 1 --2- 172.21.15.72:0/4250743449 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f59b406c920 0x7f59b406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:46.333 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:46.334+0000 7f59cfe00640 1 --2- 172.21.15.72:0/4250743449 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f59b406c920 0x7f59b406ede0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f59c0036000 tx=0x7f59c0008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:46.336 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:46.338+0000 7f59ce000640 1 -- 172.21.15.72:0/4250743449 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f59c801c360 con 0x7f59d80c5530 2024-04-04T06:57:46.538 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:46.539+0000 7f59dd000640 1 -- 172.21.15.72:0/4250743449 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f59d8075840 con 0x7f59d80c5530 2024-04-04T06:57:46.540 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:46.542+0000 7f59ce000640 1 -- 172.21.15.72:0/4250743449 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) ==== 74+0+12867 (secure 0 0 0) 0x7f59c805a410 con 0x7f59d80c5530 2024-04-04T06:57:46.541 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T06:57:46.541 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":29,"fsid":"6708bac2-4f50-49b5-87a9-c390fd333eb3","created":"2024-04-04T06:56:04.282498+0000","modified":"2024-04-04T06:57:42.505544+0000","last_up_change":"2024-04-04T06:56:16.716089+0000","last_in_change":"2024-04-04T06:56:07.768593+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-04T06:56:17.421685+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7c345991-5af8-4dc6-a481-28610c40e128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":3889813953},{"type":"v1","addr":"172.21.15.72:6818","nonce":3889813953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":3889813953},{"type":"v1","addr":"172.21.15.72:6821","nonce":3889813953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":3889813953},{"type":"v1","addr":"172.21.15.72:6826","nonce":3889813953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":3889813953},{"type":"v1","addr":"172.21.15.72:6823","nonce":3889813953}]},"public_addr":"172.21.15.72:6818/3889813953","cluster_addr":"172.21.15.72:6821/3889813953","heartbeat_back_addr":"172.21.15.72:6826/3889813953","heartbeat_front_addr":"172.21.15.72:6823/3889813953","state":["exists","up"]},{"osd":1,"uuid":"1b3f7ab2-a56c-488d-a89a-1f3572361c95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":3101663154},{"type":"v1","addr":"172.21.15.72:6801","nonce":3101663154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":3101663154},{"type":"v1","addr":"172.21.15.72:6803","nonce":3101663154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":3101663154},{"type":"v1","addr":"172.21.15.72:6807","nonce":3101663154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":3101663154},{"type":"v1","addr":"172.21.15.72:6805","nonce":3101663154}]},"public_addr":"172.21.15.72:6801/3101663154","cluster_addr":"172.21.15.72:6803/3101663154","heartbeat_back_addr":"172.21.15.72:6807/3101663154","heartbeat_front_addr":"172.21.15.72:6805/3101663154","state":["exists","up"]},{"osd":2,"uuid":"fc9aa512-53df-40d7-ba04-3e6b7dcd1e34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":235374192},{"type":"v1","addr":"172.21.15.72:6809","nonce":235374192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":235374192},{"type":"v1","addr":"172.21.15.72:6811","nonce":235374192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":235374192},{"type":"v1","addr":"172.21.15.72:6815","nonce":235374192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":235374192},{"type":"v1","addr":"172.21.15.72:6813","nonce":235374192}]},"public_addr":"172.21.15.72:6809/235374192","cluster_addr":"172.21.15.72:6811/235374192","heartbeat_back_addr":"172.21.15.72:6815/235374192","heartbeat_front_addr":"172.21.15.72:6813/235374192","state":["exists","up"]},{"osd":3,"uuid":"b4f63eed-dc5b-4aba-bb50-de46eb41492b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6817","nonce":2806631742},{"type":"v1","addr":"172.21.15.72:6819","nonce":2806631742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":2806631742},{"type":"v1","addr":"172.21.15.72:6827","nonce":2806631742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":2806631742},{"type":"v1","addr":"172.21.15.72:6831","nonce":2806631742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":2806631742},{"type":"v1","addr":"172.21.15.72:6829","nonce":2806631742}]},"public_addr":"172.21.15.72:6819/2806631742","cluster_addr":"172.21.15.72:6827/2806631742","heartbeat_back_addr":"172.21.15.72:6831/2806631742","heartbeat_front_addr":"172.21.15.72:6829/2806631742","state":["exists","up"]},{"osd":4,"uuid":"9e985ef8-d711-4172-9286-c54e560895d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":4293536423},{"type":"v1","addr":"172.21.15.117:6825","nonce":4293536423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":4293536423},{"type":"v1","addr":"172.21.15.117:6827","nonce":4293536423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":4293536423},{"type":"v1","addr":"172.21.15.117:6831","nonce":4293536423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":4293536423},{"type":"v1","addr":"172.21.15.117:6829","nonce":4293536423}]},"public_addr":"172.21.15.117:6825/4293536423","cluster_addr":"172.21.15.117:6827/4293536423","heartbeat_back_addr":"172.21.15.117:6831/4293536423","heartbeat_front_addr":"172.21.15.117:6829/4293536423","state":["exists","up"]},{"osd":5,"uuid":"3e9f082b-8d7d-455f-8a96-66d0b4857125","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":684971679},{"type":"v1","addr":"172.21.15.117:6801","nonce":684971679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":684971679},{"type":"v1","addr":"172.21.15.117:6803","nonce":684971679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":684971679},{"type":"v1","addr":"172.21.15.117:6807","nonce":684971679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":684971679},{"type":"v1","addr":"172.21.15.117:6805","nonce":684971679}]},"public_addr":"172.21.15.117:6801/684971679","cluster_addr":"172.21.15.117:6803/684971679","heartbeat_back_addr":"172.21.15.117:6807/684971679","heartbeat_front_addr":"172.21.15.117:6805/684971679","state":["exists","up"]},{"osd":6,"uuid":"bcdafa9f-a870-4398-a38d-ab7697676473","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":2781186528},{"type":"v1","addr":"172.21.15.117:6809","nonce":2781186528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":2781186528},{"type":"v1","addr":"172.21.15.117:6811","nonce":2781186528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":2781186528},{"type":"v1","addr":"172.21.15.117:6815","nonce":2781186528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":2781186528},{"type":"v1","addr":"172.21.15.117:6813","nonce":2781186528}]},"public_addr":"172.21.15.117:6809/2781186528","cluster_addr":"172.21.15.117:6811/2781186528","heartbeat_back_addr":"172.21.15.117:6815/2781186528","heartbeat_front_addr":"172.21.15.117:6813/2781186528","state":["exists","up"]},{"osd":7,"uuid":"b68ec562-ff35-4d2d-a733-c896f8920cfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":617469882},{"type":"v1","addr":"172.21.15.117:6817","nonce":617469882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":617469882},{"type":"v1","addr":"172.21.15.117:6819","nonce":617469882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":617469882},{"type":"v1","addr":"172.21.15.117:6823","nonce":617469882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":617469882},{"type":"v1","addr":"172.21.15.117:6821","nonce":617469882}]},"public_addr":"172.21.15.117:6817/617469882","cluster_addr":"172.21.15.117:6819/617469882","heartbeat_back_addr":"172.21.15.117:6823/617469882","heartbeat_front_addr":"172.21.15.117:6821/617469882","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.347700+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.296619+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.361345+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.093323+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:12.857605+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:12.816090+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.083163+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.121639+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-04T06:57:46.543 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:46.544+0000 7f59dd000640 1 -- 172.21.15.72:0/4250743449 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f59b406c920 msgr2=0x7f59b406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:46.543 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:46.544+0000 7f59dd000640 1 --2- 172.21.15.72:0/4250743449 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f59b406c920 0x7f59b406ede0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f59c0036000 tx=0x7f59c0008030 comp rx=0 tx=0).stop 2024-04-04T06:57:46.543 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:46.544+0000 7f59dd000640 1 -- 172.21.15.72:0/4250743449 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f59d80c5530 msgr2=0x7f59d8157d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:46.543 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:46.544+0000 7f59dd000640 1 --2- 172.21.15.72:0/4250743449 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f59d80c5530 0x7f59d8157d60 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f59c800d800 tx=0x7f59c800dcc0 comp rx=0 tx=0).stop 2024-04-04T06:57:46.544 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:46.544+0000 7f59dd000640 1 -- 172.21.15.72:0/4250743449 shutdown_connections 2024-04-04T06:57:46.544 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:46.544+0000 7f59dd000640 1 --2- 172.21.15.72:0/4250743449 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f59b406c920 0x7f59b406ede0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:46.544 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:46.544+0000 7f59dd000640 1 --2- 172.21.15.72:0/4250743449 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f59d815b230 0x7f59d80b3e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:46.544 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:46.544+0000 7f59dd000640 1 --2- 172.21.15.72:0/4250743449 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f59d80d0600 0x7f59d80c9e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:46.544 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:46.544+0000 7f59dd000640 1 --2- 172.21.15.72:0/4250743449 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f59d80c5530 0x7f59d8157d60 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:46.544 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:46.544+0000 7f59dd000640 1 -- 172.21.15.72:0/4250743449 >> 172.21.15.72:0/4250743449 conn(0x7f59d806b470 msgr2=0x7f59d80ce030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:46.544 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:46.544+0000 7f59dd000640 1 -- 172.21.15.72:0/4250743449 shutdown_connections 2024-04-04T06:57:46.544 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:46.544+0000 7f59dd000640 1 -- 172.21.15.72:0/4250743449 wait complete. 2024-04-04T06:57:46.561 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-04T06:56:17.421685+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-04T06:57:46.562 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-04T06:57:46.762 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:46.763+0000 7f63de600640 1 Processor -- start 2024-04-04T06:57:46.762 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:46.763+0000 7f63de600640 1 -- start start 2024-04-04T06:57:46.763 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:46.764+0000 7f63de600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f63d8145b10 0x7f63d806d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:46.763 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:46.765+0000 7f63de600640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63d8145ef0 con 0x7f63d80d0110 2024-04-04T06:57:46.763 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:46.765+0000 7f63de600640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63d80cec40 con 0x7f63d806dac0 2024-04-04T06:57:46.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:46.765+0000 7f63de600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f63d80cea10 con 0x7f63d8145b10 2024-04-04T06:57:46.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:46.765+0000 7f63d7e00640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f63d80d0110 0x7f63d8071430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:39730/0 (socket says 172.21.15.72:39730) 2024-04-04T06:57:46.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:46.765+0000 7f63d7e00640 1 -- 172.21.15.72:0/1960944019 learned_addr learned my addr 172.21.15.72:0/1960944019 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-04-04T06:57:46.766 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:46.765+0000 7f63d7400640 1 --2- 172.21.15.72:0/1960944019 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f63d8145b10 0x7f63d806d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:46.766 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:46.765+0000 7f63d6a00640 1 -- 172.21.15.72:0/1960944019 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1023346197 0 0) 0x7f63d8145ef0 con 0x7f63d80d0110 2024-04-04T06:57:46.766 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:46.765+0000 7f63d6a00640 1 -- 172.21.15.72:0/1960944019 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f63bc003520 con 0x7f63d80d0110 2024-04-04T06:57:46.766 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:46.766+0000 7f63d6a00640 1 -- 172.21.15.72:0/1960944019 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 8619056 0 0) 0x7f63bc003520 con 0x7f63d80d0110 2024-04-04T06:57:46.766 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:46.766+0000 7f63d6a00640 1 -- 172.21.15.72:0/1960944019 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f63d8145b10 msgr2=0x7f63d806d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:57:46.766 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:46.766+0000 7f63d6a00640 1 --2- 172.21.15.72:0/1960944019 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f63d8145b10 0x7f63d806d580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:46.766 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:46.766+0000 7f63d6a00640 1 -- 172.21.15.72:0/1960944019 >> v1:172.21.15.117:6789/0 conn(0x7f63d806dac0 legacy=0x7f63d80cfa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:46.766 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:46.766+0000 7f63d6a00640 1 -- 172.21.15.72:0/1960944019 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63d80cef20 con 0x7f63d80d0110 2024-04-04T06:57:46.766 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:46.766+0000 7f63d6a00640 1 -- 172.21.15.72:0/1960944019 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2465650867 0 0) 0x7f63d0001670 con 0x7f63d80d0110 2024-04-04T06:57:46.766 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:46.766+0000 7f63d6a00640 1 -- 172.21.15.72:0/1960944019 >> v1:172.21.15.72:6789/0 conn(0x7f63d80d0110 legacy=0x7f63d8071430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:46.767 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:46.766+0000 7f63d6a00640 1 --2- 172.21.15.72:0/1960944019 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f63bc0039e0 0x7f63bc003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:46.767 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:46.766+0000 7f63d6a00640 1 --2- 172.21.15.72:0/1960944019 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f63d8145b10 0x7f63bc004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:46.767 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:46.766+0000 7f63d6a00640 1 --2- 172.21.15.72:0/1960944019 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f63bc004d40 0x7f63bc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:46.767 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:46.766+0000 7f63d6a00640 1 -- 172.21.15.72:0/1960944019 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f63bc00bb70 con 0x7f63bc0039e0 2024-04-04T06:57:46.767 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:46.766+0000 7f63d6a00640 1 -- 172.21.15.72:0/1960944019 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f63bc00bd20 con 0x7f63bc004d40 2024-04-04T06:57:46.767 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:46.766+0000 7f63d6a00640 1 -- 172.21.15.72:0/1960944019 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f63bc00bf20 con 0x7f63d8145b10 2024-04-04T06:57:46.767 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:46.766+0000 7f63d7400640 1 --2- 172.21.15.72:0/1960944019 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f63bc0039e0 0x7f63bc003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:46.767 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:46.766+0000 7f63d7e00640 1 --2- 172.21.15.72:0/1960944019 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f63bc004d40 0x7f63bc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:46.767 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:46.766+0000 7f63cea00640 1 --2- 172.21.15.72:0/1960944019 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f63d8145b10 0x7f63bc004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:46.767 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:46.767+0000 7f63d7400640 1 -- 172.21.15.72:0/1960944019 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f63d8145b10 msgr2=0x7f63bc004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:57:46.767 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:46.767+0000 7f63d7400640 1 --2- 172.21.15.72:0/1960944019 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f63d8145b10 0x7f63bc004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:46.767 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:46.767+0000 7f63d7400640 1 -- 172.21.15.72:0/1960944019 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f63bc004d40 msgr2=0x7f63bc0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:57:46.767 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:46.767+0000 7f63d7400640 1 --2- 172.21.15.72:0/1960944019 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f63bc004d40 0x7f63bc0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:46.767 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:46.767+0000 7f63d7400640 1 -- 172.21.15.72:0/1960944019 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63bc003520 con 0x7f63bc0039e0 2024-04-04T06:57:46.767 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:46.767+0000 7f63cea00640 1 --2- 172.21.15.72:0/1960944019 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f63d8145b10 0x7f63bc004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-04T06:57:46.769 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:46.768+0000 7f63d7400640 1 --2- 172.21.15.72:0/1960944019 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f63bc0039e0 0x7f63bc003e00 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f63c8007360 tx=0x7f63bc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d16945b5671d6e42 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:46.769 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:46.768+0000 7f63d6a00640 1 -- 172.21.15.72:0/1960944019 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63c8039070 con 0x7f63bc0039e0 2024-04-04T06:57:46.769 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:46.768+0000 7f63d6a00640 1 -- 172.21.15.72:0/1960944019 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63c802ccd0 con 0x7f63bc0039e0 2024-04-04T06:57:46.769 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:46.768+0000 7f63d6a00640 1 -- 172.21.15.72:0/1960944019 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63c8009be0 con 0x7f63bc0039e0 2024-04-04T06:57:46.769 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:46.768+0000 7f63de600640 1 -- 172.21.15.72:0/1960944019 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f63bc0039e0 msgr2=0x7f63bc003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:46.769 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:46.768+0000 7f63de600640 1 --2- 172.21.15.72:0/1960944019 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f63bc0039e0 0x7f63bc003e00 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f63c8007360 tx=0x7f63bc005830 comp rx=0 tx=0).stop 2024-04-04T06:57:46.769 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:46.768+0000 7f63d7e00640 1 -- 172.21.15.72:0/1960944019 reap_dead start 2024-04-04T06:57:46.769 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:46.769+0000 7f63de600640 1 -- 172.21.15.72:0/1960944019 shutdown_connections 2024-04-04T06:57:46.769 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:46.769+0000 7f63de600640 1 -- 172.21.15.72:0/1960944019 >> 172.21.15.72:0/1960944019 conn(0x7f63d806b470 msgr2=0x7f63d806b850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:46.769 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:46.769+0000 7f63de600640 1 -- 172.21.15.72:0/1960944019 shutdown_connections 2024-04-04T06:57:46.769 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:46.769+0000 7f63de600640 1 -- 172.21.15.72:0/1960944019 wait complete. 2024-04-04T06:57:46.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:46.770+0000 7f63de600640 1 Processor -- start 2024-04-04T06:57:46.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:46.770+0000 7f63de600640 1 -- start start 2024-04-04T06:57:46.771 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:46.771+0000 7f63de600640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f63bc0039e0 0x7f63d81f0480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:46.772 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:46.771+0000 7f63de600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f63d813aed0 0x7f63d8144120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:46.772 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:46.771+0000 7f63de600640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f63d813b350 0x7f63d8144660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:46.772 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:46.771+0000 7f63de600640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f63d80cf4e0 con 0x7f63bc0039e0 2024-04-04T06:57:46.772 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:46.771+0000 7f63de600640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f63d806e310 con 0x7f63d813b350 2024-04-04T06:57:46.772 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:46.771+0000 7f63de600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f63d806df40 con 0x7f63d813aed0 2024-04-04T06:57:46.772 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:46.772+0000 7f63d7400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f63bc0039e0 0x7f63d81f0480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:46.772 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:46.772+0000 7f63d7400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f63bc0039e0 0x7f63d81f0480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:37936/0 (socket says 172.21.15.72:37936) 2024-04-04T06:57:46.772 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:46.772+0000 7f63d7400640 1 -- 172.21.15.72:0/566516815 learned_addr learned my addr 172.21.15.72:0/566516815 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:57:46.772 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:46.772+0000 7f63d7e00640 1 --2- 172.21.15.72:0/566516815 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f63d813b350 0x7f63d8144660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:46.772 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:46.772+0000 7f63d7400640 1 -- 172.21.15.72:0/566516815 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f63d813aed0 msgr2=0x7f63d8144120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:46.772 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:46.772+0000 7f63d7400640 1 --2- 172.21.15.72:0/566516815 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f63d813aed0 0x7f63d8144120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:46.772 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:46.772+0000 7f63d7400640 1 -- 172.21.15.72:0/566516815 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f63d813b350 msgr2=0x7f63d8144660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:46.772 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:46.772+0000 7f63d7400640 1 --2- 172.21.15.72:0/566516815 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f63d813b350 0x7f63d8144660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:46.772 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:46.772+0000 7f63d7400640 1 -- 172.21.15.72:0/566516815 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63d80affb0 con 0x7f63bc0039e0 2024-04-04T06:57:46.773 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:46.772+0000 7f63d7400640 1 --2- 172.21.15.72:0/566516815 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f63bc0039e0 0x7f63d81f0480 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f63c8000f80 tx=0x7f63c8004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:46.773 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:46.773+0000 7f63cfe00640 1 -- 172.21.15.72:0/566516815 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63c8042030 con 0x7f63bc0039e0 2024-04-04T06:57:46.773 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:46.773+0000 7f63cfe00640 1 -- 172.21.15.72:0/566516815 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63c803a040 con 0x7f63bc0039e0 2024-04-04T06:57:46.773 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:46.773+0000 7f63cfe00640 1 -- 172.21.15.72:0/566516815 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63c8039070 con 0x7f63bc0039e0 2024-04-04T06:57:46.773 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:46.773+0000 7f63de600640 1 -- 172.21.15.72:0/566516815 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63d81f2ff0 con 0x7f63bc0039e0 2024-04-04T06:57:46.773 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:46.773+0000 7f63de600640 1 -- 172.21.15.72:0/566516815 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63d81f35b0 con 0x7f63bc0039e0 2024-04-04T06:57:46.773 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:46.774+0000 7f63de600640 1 -- 172.21.15.72:0/566516815 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63d8075730 con 0x7f63bc0039e0 2024-04-04T06:57:46.773 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:46.775+0000 7f63cfe00640 1 -- 172.21.15.72:0/566516815 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f63c8045070 con 0x7f63bc0039e0 2024-04-04T06:57:46.775 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:46.776+0000 7f63cfe00640 1 --2- 172.21.15.72:0/566516815 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f63b406c8f0 0x7f63b406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:46.775 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:46.776+0000 7f63cfe00640 1 -- 172.21.15.72:0/566516815 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 4857+0+0 (secure 0 0 0) 0x7f63c80acc60 con 0x7f63bc0039e0 2024-04-04T06:57:46.775 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:46.776+0000 7f63cea00640 1 --2- 172.21.15.72:0/566516815 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f63b406c8f0 0x7f63b406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:46.775 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:46.777+0000 7f63cea00640 1 --2- 172.21.15.72:0/566516815 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f63b406c8f0 0x7f63b406edb0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f63d8142730 tx=0x7f63c0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:46.779 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:46.781+0000 7f63cfe00640 1 -- 172.21.15.72:0/566516815 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f63c807b3e0 con 0x7f63bc0039e0 2024-04-04T06:57:46.962 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:46.963+0000 7f63de600640 1 -- 172.21.15.72:0/566516815 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f63d80d0c00 con 0x7f63bc0039e0 2024-04-04T06:57:46.963 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:46.964+0000 7f63cfe00640 1 -- 172.21.15.72:0/566516815 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) ==== 93+0+10 (secure 0 0 0) 0x7f63c807ace0 con 0x7f63bc0039e0 2024-04-04T06:57:46.963 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 1 2024-04-04T06:57:46.966 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:46.966+0000 7f63de600640 1 -- 172.21.15.72:0/566516815 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f63b406c8f0 msgr2=0x7f63b406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:46.966 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:46.966+0000 7f63de600640 1 --2- 172.21.15.72:0/566516815 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f63b406c8f0 0x7f63b406edb0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f63d8142730 tx=0x7f63c0009040 comp rx=0 tx=0).stop 2024-04-04T06:57:46.966 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:46.966+0000 7f63de600640 1 -- 172.21.15.72:0/566516815 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f63bc0039e0 msgr2=0x7f63d81f0480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:46.966 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:46.966+0000 7f63de600640 1 --2- 172.21.15.72:0/566516815 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f63bc0039e0 0x7f63d81f0480 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f63c8000f80 tx=0x7f63c8004ab0 comp rx=0 tx=0).stop 2024-04-04T06:57:46.966 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:46.967+0000 7f63de600640 1 -- 172.21.15.72:0/566516815 shutdown_connections 2024-04-04T06:57:46.966 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:46.967+0000 7f63de600640 1 --2- 172.21.15.72:0/566516815 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f63b406c8f0 0x7f63b406edb0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:46.966 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:46.967+0000 7f63de600640 1 --2- 172.21.15.72:0/566516815 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f63d813b350 0x7f63d8144660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:46.966 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:46.967+0000 7f63de600640 1 --2- 172.21.15.72:0/566516815 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f63d813aed0 0x7f63d8144120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:46.966 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:46.967+0000 7f63de600640 1 --2- 172.21.15.72:0/566516815 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f63bc0039e0 0x7f63d81f0480 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:46.966 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:46.967+0000 7f63de600640 1 -- 172.21.15.72:0/566516815 >> 172.21.15.72:0/566516815 conn(0x7f63d806b470 msgr2=0x7f63d815ee50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:46.966 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:46.967+0000 7f63de600640 1 -- 172.21.15.72:0/566516815 shutdown_connections 2024-04-04T06:57:46.966 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:46.967+0000 7f63de600640 1 -- 172.21.15.72:0/566516815 wait complete. 2024-04-04T06:57:46.983 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-04T06:57:47.184 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:47.185+0000 7f052c000640 1 Processor -- start 2024-04-04T06:57:47.184 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:47.185+0000 7f052c000640 1 -- start start 2024-04-04T06:57:47.185 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:47.186+0000 7f052c000640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0524073570 0x7f0524071610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:47.185 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:47.186+0000 7f052c000640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f052406eee0 0x7f05240b3700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:47.185 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:47.186+0000 7f052c000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f05240ccad0 0x7f05240ccf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:47.185 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:47.186+0000 7f052c000640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f0524073950 con 0x7f0524073570 2024-04-04T06:57:47.185 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:47.186+0000 7f052c000640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f05240cb520 con 0x7f052406eee0 2024-04-04T06:57:47.185 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:47.186+0000 7f052c000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f05240cd440 con 0x7f05240ccad0 2024-04-04T06:57:47.186 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:47.187+0000 7f0529600640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0524073570 0x7f0524071610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:47.186 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:47.187+0000 7f0529600640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0524073570 0x7f0524071610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:37950/0 (socket says 172.21.15.72:37950) 2024-04-04T06:57:47.187 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:47.187+0000 7f0529600640 1 -- 172.21.15.72:0/1643504057 learned_addr learned my addr 172.21.15.72:0/1643504057 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:57:47.187 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:47.187+0000 7f0528c00640 1 --2- 172.21.15.72:0/1643504057 >> v2:172.21.15.117:3300/0 conn(0x7f052406eee0 0x7f05240b3700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:47.187 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:47.187+0000 7f052a000640 1 --2- 172.21.15.72:0/1643504057 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f05240ccad0 0x7f05240ccf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:47.187 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:47.188+0000 7f0529600640 1 -- 172.21.15.72:0/1643504057 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f05240ccad0 msgr2=0x7f05240ccf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:57:47.187 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:47.188+0000 7f0529600640 1 --2- 172.21.15.72:0/1643504057 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f05240ccad0 0x7f05240ccf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:47.187 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:47.188+0000 7f0529600640 1 -- 172.21.15.72:0/1643504057 >> v2:172.21.15.117:3300/0 conn(0x7f052406eee0 msgr2=0x7f05240b3700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:57:47.187 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:47.188+0000 7f0529600640 1 --2- 172.21.15.72:0/1643504057 >> v2:172.21.15.117:3300/0 conn(0x7f052406eee0 0x7f05240b3700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:47.187 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:47.188+0000 7f0529600640 1 -- 172.21.15.72:0/1643504057 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05240b3f50 con 0x7f0524073570 2024-04-04T06:57:47.187 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:47.189+0000 7f0529600640 1 --2- 172.21.15.72:0/1643504057 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0524073570 0x7f0524071610 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f05240b30c0 tx=0x7f051802b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20348d66338cb5d1 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:47.188 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:47.189+0000 7f0523e00640 1 -- 172.21.15.72:0/1643504057 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0518034070 con 0x7f0524073570 2024-04-04T06:57:47.188 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:47.189+0000 7f0523e00640 1 -- 172.21.15.72:0/1643504057 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0518030840 con 0x7f0524073570 2024-04-04T06:57:47.188 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:47.190+0000 7f0523e00640 1 -- 172.21.15.72:0/1643504057 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0518030c10 con 0x7f0524073570 2024-04-04T06:57:47.189 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:47.190+0000 7f052c000640 1 -- 172.21.15.72:0/1643504057 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0524073570 msgr2=0x7f0524071610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:47.189 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:47.190+0000 7f052c000640 1 --2- 172.21.15.72:0/1643504057 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0524073570 0x7f0524071610 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f05240b30c0 tx=0x7f051802b980 comp rx=0 tx=0).stop 2024-04-04T06:57:47.189 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:47.190+0000 7f052c000640 1 -- 172.21.15.72:0/1643504057 shutdown_connections 2024-04-04T06:57:47.189 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:47.190+0000 7f052c000640 1 --2- 172.21.15.72:0/1643504057 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f05240ccad0 0x7f05240ccf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:47.189 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:47.190+0000 7f052c000640 1 --2- 172.21.15.72:0/1643504057 >> v2:172.21.15.117:3300/0 conn(0x7f052406eee0 0x7f05240b3700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:47.189 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:47.190+0000 7f052c000640 1 --2- 172.21.15.72:0/1643504057 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0524073570 0x7f0524071610 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:47.189 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:47.190+0000 7f052c000640 1 -- 172.21.15.72:0/1643504057 >> 172.21.15.72:0/1643504057 conn(0x7f052406b470 msgr2=0x7f052406b880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:47.189 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:47.190+0000 7f052c000640 1 -- 172.21.15.72:0/1643504057 shutdown_connections 2024-04-04T06:57:47.190 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:47.190+0000 7f052c000640 1 -- 172.21.15.72:0/1643504057 wait complete. 2024-04-04T06:57:47.191 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:47.192+0000 7f052c000640 1 Processor -- start 2024-04-04T06:57:47.191 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:47.193+0000 7f052c000640 1 -- start start 2024-04-04T06:57:47.193 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:47.194+0000 7f052c000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f052406eee0 0x7f05240cdf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:47.193 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:47.194+0000 7f052c000640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0524073570 0x7f0524157fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:47.194 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:47.194+0000 7f052c000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f05240ccad0 0x7f0524158520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:47.194 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:47.194+0000 7f052c000640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f05240b3c40 con 0x7f0524073570 2024-04-04T06:57:47.194 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:47.194+0000 7f052c000640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f05240b4510 con 0x7f05240ccad0 2024-04-04T06:57:47.194 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:47.194+0000 7f052c000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f05240b47f0 con 0x7f052406eee0 2024-04-04T06:57:47.194 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:47.194+0000 7f0528c00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0524073570 0x7f0524157fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:47.194 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:47.194+0000 7f0528c00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0524073570 0x7f0524157fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:37964/0 (socket says 172.21.15.72:37964) 2024-04-04T06:57:47.194 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:47.194+0000 7f0528c00640 1 -- 172.21.15.72:0/443821971 learned_addr learned my addr 172.21.15.72:0/443821971 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:57:47.194 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:47.194+0000 7f052a000640 1 --2- 172.21.15.72:0/443821971 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f05240ccad0 0x7f0524158520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:47.194 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:47.194+0000 7f0529600640 1 --2- 172.21.15.72:0/443821971 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f052406eee0 0x7f05240cdf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:47.194 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:47.195+0000 7f0528c00640 1 -- 172.21.15.72:0/443821971 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f052406eee0 msgr2=0x7f05240cdf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:47.194 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:47.195+0000 7f0528c00640 1 --2- 172.21.15.72:0/443821971 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f052406eee0 0x7f05240cdf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:47.194 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:47.195+0000 7f0528c00640 1 -- 172.21.15.72:0/443821971 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f05240ccad0 msgr2=0x7f0524158520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:47.195 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:47.195+0000 7f0528c00640 1 --2- 172.21.15.72:0/443821971 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f05240ccad0 0x7f0524158520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:47.195 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:47.195+0000 7f0528c00640 1 -- 172.21.15.72:0/443821971 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05240cd940 con 0x7f0524073570 2024-04-04T06:57:47.195 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:47.195+0000 7f0528c00640 1 --2- 172.21.15.72:0/443821971 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0524073570 0x7f0524157fe0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f051000e890 tx=0x7f051000ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:47.195 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:47.195+0000 7f0521600640 1 -- 172.21.15.72:0/443821971 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0510017070 con 0x7f0524073570 2024-04-04T06:57:47.196 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:47.195+0000 7f0521600640 1 -- 172.21.15.72:0/443821971 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f051000c940 con 0x7f0524073570 2024-04-04T06:57:47.196 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:47.195+0000 7f0521600640 1 -- 172.21.15.72:0/443821971 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f051000cd10 con 0x7f0524073570 2024-04-04T06:57:47.196 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:47.195+0000 7f052c000640 1 -- 172.21.15.72:0/443821971 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05240ca060 con 0x7f0524073570 2024-04-04T06:57:47.196 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:47.195+0000 7f052c000640 1 -- 172.21.15.72:0/443821971 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05240cd660 con 0x7f0524073570 2024-04-04T06:57:47.196 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:47.196+0000 7f052c000640 1 -- 172.21.15.72:0/443821971 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0524075840 con 0x7f0524073570 2024-04-04T06:57:47.196 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:47.198+0000 7f0521600640 1 -- 172.21.15.72:0/443821971 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f051001a070 con 0x7f0524073570 2024-04-04T06:57:47.197 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:47.199+0000 7f0521600640 1 --2- 172.21.15.72:0/443821971 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f050406c920 0x7f050406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:47.197 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:47.199+0000 7f0521600640 1 -- 172.21.15.72:0/443821971 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 4857+0+0 (secure 0 0 0) 0x7f051008b7a0 con 0x7f0524073570 2024-04-04T06:57:47.198 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:47.199+0000 7f0529600640 1 --2- 172.21.15.72:0/443821971 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f050406c920 0x7f050406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:47.198 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:47.200+0000 7f0529600640 1 --2- 172.21.15.72:0/443821971 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f050406c920 0x7f050406ede0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f0518036000 tx=0x7f051803b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:47.202 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:47.203+0000 7f0521600640 1 -- 172.21.15.72:0/443821971 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f0510059f10 con 0x7f0524073570 2024-04-04T06:57:47.398 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:47.399+0000 7f052c000640 1 -- 172.21.15.72:0/443821971 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f05240b0ef0 con 0x7f0524073570 2024-04-04T06:57:47.398 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:47.399+0000 7f0521600640 1 -- 172.21.15.72:0/443821971 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v29) ==== 84+0+65 (secure 0 0 0) 0x7f05100600e0 con 0x7f0524073570 2024-04-04T06:57:47.399 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T06:57:47.399 INFO:teuthology.orchestra.run.smithi072.stdout:[ 2024-04-04T06:57:47.399 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-04T06:57:47.399 INFO:teuthology.orchestra.run.smithi072.stdout: "poolnum": 1, 2024-04-04T06:57:47.399 INFO:teuthology.orchestra.run.smithi072.stdout: "poolname": ".mgr" 2024-04-04T06:57:47.399 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-04T06:57:47.399 INFO:teuthology.orchestra.run.smithi072.stdout:] 2024-04-04T06:57:47.401 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:47.402+0000 7f052c000640 1 -- 172.21.15.72:0/443821971 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f050406c920 msgr2=0x7f050406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:47.401 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:47.402+0000 7f052c000640 1 --2- 172.21.15.72:0/443821971 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f050406c920 0x7f050406ede0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f0518036000 tx=0x7f051803b040 comp rx=0 tx=0).stop 2024-04-04T06:57:47.401 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:47.402+0000 7f052c000640 1 -- 172.21.15.72:0/443821971 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0524073570 msgr2=0x7f0524157fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:47.401 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:47.402+0000 7f052c000640 1 --2- 172.21.15.72:0/443821971 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0524073570 0x7f0524157fe0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f051000e890 tx=0x7f051000ed50 comp rx=0 tx=0).stop 2024-04-04T06:57:47.401 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:47.402+0000 7f052c000640 1 -- 172.21.15.72:0/443821971 shutdown_connections 2024-04-04T06:57:47.401 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:47.402+0000 7f052c000640 1 --2- 172.21.15.72:0/443821971 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f050406c920 0x7f050406ede0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:47.401 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:47.402+0000 7f052c000640 1 --2- 172.21.15.72:0/443821971 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f05240ccad0 0x7f0524158520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:47.402 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:47.402+0000 7f052c000640 1 --2- 172.21.15.72:0/443821971 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0524073570 0x7f0524157fe0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:47.402 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:47.402+0000 7f052c000640 1 --2- 172.21.15.72:0/443821971 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f052406eee0 0x7f05240cdf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:47.402 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:47.402+0000 7f052c000640 1 -- 172.21.15.72:0/443821971 >> 172.21.15.72:0/443821971 conn(0x7f052406b470 msgr2=0x7f052406e210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:47.402 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:47.402+0000 7f052c000640 1 -- 172.21.15.72:0/443821971 shutdown_connections 2024-04-04T06:57:47.402 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:47.402+0000 7f052c000640 1 -- 172.21.15.72:0/443821971 wait complete. 2024-04-04T06:57:47.420 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-04T06:57:47.420 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-04T06:57:47.627 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:47.628+0000 7f667e200640 1 Processor -- start 2024-04-04T06:57:47.627 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:47.629+0000 7f667e200640 1 -- start start 2024-04-04T06:57:47.629 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:47.630+0000 7f667e200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f667815e860 0x7f66780cec30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:47.629 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:47.630+0000 7f667e200640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f66780cf660 0x7f66780b7a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:47.629 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:47.630+0000 7f667e200640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f66780d2d10 con 0x7f66780cf280 2024-04-04T06:57:47.629 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:47.630+0000 7f667e200640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f66780d3920 con 0x7f66780cf660 2024-04-04T06:57:47.629 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:47.630+0000 7f667e200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f66780d2ff0 con 0x7f667815e860 2024-04-04T06:57:47.629 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:47.631+0000 7f667d800640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f66780cf660 0x7f66780b7a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:47.630 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:47.631+0000 7f6677e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f667815e860 0x7f66780cec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:47.630 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:47.631+0000 7f667d800640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f66780cf660 0x7f66780b7a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.72:48668/0 (socket says 172.21.15.72:48668) 2024-04-04T06:57:47.630 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:47.631+0000 7f667d800640 1 -- 172.21.15.72:0/818992222 learned_addr learned my addr 172.21.15.72:0/818992222 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:57:47.630 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:47.631+0000 7f667d800640 1 -- 172.21.15.72:0/818992222 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f667815e860 msgr2=0x7f66780cec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:57:47.630 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:47.631+0000 7f667d800640 1 --2- 172.21.15.72:0/818992222 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f667815e860 0x7f66780cec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:47.630 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:47.631+0000 7f667d800640 1 -- 172.21.15.72:0/818992222 >> v1:172.21.15.117:6789/0 conn(0x7f66780cf280 legacy=0x7f66780d2550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:47.630 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:47.631+0000 7f667d800640 1 -- 172.21.15.72:0/818992222 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66780d32d0 con 0x7f66780cf660 2024-04-04T06:57:47.631 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:47.633+0000 7f667d800640 1 --2- 172.21.15.72:0/818992222 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f66780cf660 0x7f66780b7a80 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f6670009e50 tx=0x7f667002bf60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5cc9db0d9d72e1d3 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:47.632 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:47.633+0000 7f6677400640 1 -- 172.21.15.72:0/818992222 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f667002cb00 con 0x7f66780cf660 2024-04-04T06:57:47.632 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:47.633+0000 7f6677400640 1 -- 172.21.15.72:0/818992222 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f667002cca0 con 0x7f66780cf660 2024-04-04T06:57:47.632 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:47.633+0000 7f6677400640 1 -- 172.21.15.72:0/818992222 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6670034610 con 0x7f66780cf660 2024-04-04T06:57:47.633 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:47.634+0000 7f667e200640 1 -- 172.21.15.72:0/818992222 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f66780cf660 msgr2=0x7f66780b7a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:47.633 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:47.634+0000 7f667e200640 1 --2- 172.21.15.72:0/818992222 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f66780cf660 0x7f66780b7a80 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f6670009e50 tx=0x7f667002bf60 comp rx=0 tx=0).stop 2024-04-04T06:57:47.633 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:47.634+0000 7f667e200640 1 -- 172.21.15.72:0/818992222 shutdown_connections 2024-04-04T06:57:47.633 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:47.634+0000 7f667e200640 1 --2- 172.21.15.72:0/818992222 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f66780cf660 0x7f66780b7a80 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:47.633 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:47.634+0000 7f667e200640 1 --2- 172.21.15.72:0/818992222 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f667815e860 0x7f66780cec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:47.633 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:47.634+0000 7f667e200640 1 -- 172.21.15.72:0/818992222 >> 172.21.15.72:0/818992222 conn(0x7f667806b860 msgr2=0x7f667806bc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:47.634 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:47.634+0000 7f667e200640 1 -- 172.21.15.72:0/818992222 shutdown_connections 2024-04-04T06:57:47.634 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:47.634+0000 7f667e200640 1 -- 172.21.15.72:0/818992222 wait complete. 2024-04-04T06:57:47.634 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:47.636+0000 7f667e200640 1 Processor -- start 2024-04-04T06:57:47.634 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:47.636+0000 7f667e200640 1 -- start start 2024-04-04T06:57:47.636 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:47.637+0000 7f667e200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f66780cf280 0x7f66780b8e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:47.636 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:47.637+0000 7f667e200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f66780cf660 0x7f66780b9380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:47.636 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:47.637+0000 7f667e200640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f667815e860 0x7f66780cc340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:47.637 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:47.637+0000 7f667e200640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f66780b7fc0 con 0x7f667815e860 2024-04-04T06:57:47.637 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:47.637+0000 7f667e200640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f66780cfb10 con 0x7f66780cf660 2024-04-04T06:57:47.637 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:47.637+0000 7f667e200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f66780b8140 con 0x7f66780cf280 2024-04-04T06:57:47.637 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:47.637+0000 7f667d800640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f667815e860 0x7f66780cc340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:47.637 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:47.637+0000 7f667d800640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f667815e860 0x7f66780cc340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:37978/0 (socket says 172.21.15.72:37978) 2024-04-04T06:57:47.637 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:47.637+0000 7f667d800640 1 -- 172.21.15.72:0/3241788 learned_addr learned my addr 172.21.15.72:0/3241788 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:57:47.637 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:47.637+0000 7f667ce00640 1 --2- 172.21.15.72:0/3241788 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f66780cf280 0x7f66780b8e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:47.637 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:47.637+0000 7f6677e00640 1 --2- 172.21.15.72:0/3241788 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f66780cf660 0x7f66780b9380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:47.637 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:47.638+0000 7f667d800640 1 -- 172.21.15.72:0/3241788 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f66780cf280 msgr2=0x7f66780b8e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:47.637 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:47.638+0000 7f667d800640 1 --2- 172.21.15.72:0/3241788 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f66780cf280 0x7f66780b8e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:47.637 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:47.638+0000 7f667d800640 1 -- 172.21.15.72:0/3241788 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f66780cf660 msgr2=0x7f66780b9380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:47.637 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:47.638+0000 7f667d800640 1 --2- 172.21.15.72:0/3241788 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f66780cf660 0x7f66780b9380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:47.637 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:47.638+0000 7f667d800640 1 -- 172.21.15.72:0/3241788 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f667814f840 con 0x7f667815e860 2024-04-04T06:57:47.637 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:47.638+0000 7f667d800640 1 --2- 172.21.15.72:0/3241788 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f667815e860 0x7f66780cc340 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f6670036040 tx=0x7f6670004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:47.638 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:47.638+0000 7f6674c00640 1 -- 172.21.15.72:0/3241788 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6670043020 con 0x7f667815e860 2024-04-04T06:57:47.638 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:47.638+0000 7f6674c00640 1 -- 172.21.15.72:0/3241788 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f667002ce50 con 0x7f667815e860 2024-04-04T06:57:47.639 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:47.638+0000 7f667e200640 1 -- 172.21.15.72:0/3241788 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f667814fb20 con 0x7f667815e860 2024-04-04T06:57:47.639 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:47.638+0000 7f6674c00640 1 -- 172.21.15.72:0/3241788 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6670009510 con 0x7f667815e860 2024-04-04T06:57:47.639 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:47.639+0000 7f667e200640 1 -- 172.21.15.72:0/3241788 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66780ab030 con 0x7f667815e860 2024-04-04T06:57:47.639 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:47.640+0000 7f667e200640 1 -- 172.21.15.72:0/3241788 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66780756c0 con 0x7f667815e860 2024-04-04T06:57:47.639 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:47.641+0000 7f6674c00640 1 -- 172.21.15.72:0/3241788 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6670046020 con 0x7f667815e860 2024-04-04T06:57:47.640 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:47.642+0000 7f6674c00640 1 --2- 172.21.15.72:0/3241788 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f665406c8f0 0x7f665406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:47.640 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:47.642+0000 7f6674c00640 1 -- 172.21.15.72:0/3241788 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 4857+0+0 (secure 0 0 0) 0x7f66700adec0 con 0x7f667815e860 2024-04-04T06:57:47.640 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:47.642+0000 7f667ce00640 1 --2- 172.21.15.72:0/3241788 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f665406c8f0 0x7f665406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:47.641 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:47.643+0000 7f667ce00640 1 --2- 172.21.15.72:0/3241788 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f665406c8f0 0x7f665406edb0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f6668000f60 tx=0x7f6668009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:47.644 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:47.646+0000 7f6674c00640 1 -- 172.21.15.72:0/3241788 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f667004d030 con 0x7f667815e860 2024-04-04T06:57:47.847 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:47.848+0000 7f667e200640 1 -- 172.21.15.72:0/3241788 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f667814fcf0 con 0x7f667815e860 2024-04-04T06:57:48.519 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:48.520+0000 7f6674c00640 1 -- 172.21.15.72:0/3241788 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v30) ==== 138+0+0 (secure 0 0 0) 0x7f667007c5b0 con 0x7f667815e860 2024-04-04T06:57:48.519 INFO:teuthology.orchestra.run.smithi072.stderr:pool 'cephfs_metadata' created 2024-04-04T06:57:48.523 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:48.524+0000 7f667e200640 1 -- 172.21.15.72:0/3241788 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f665406c8f0 msgr2=0x7f665406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:48.523 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:48.524+0000 7f667e200640 1 --2- 172.21.15.72:0/3241788 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f665406c8f0 0x7f665406edb0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f6668000f60 tx=0x7f6668009040 comp rx=0 tx=0).stop 2024-04-04T06:57:48.523 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:48.524+0000 7f667e200640 1 -- 172.21.15.72:0/3241788 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f667815e860 msgr2=0x7f66780cc340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:48.523 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:48.524+0000 7f667e200640 1 --2- 172.21.15.72:0/3241788 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f667815e860 0x7f66780cc340 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f6670036040 tx=0x7f6670004a40 comp rx=0 tx=0).stop 2024-04-04T06:57:48.523 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:48.524+0000 7f667e200640 1 -- 172.21.15.72:0/3241788 shutdown_connections 2024-04-04T06:57:48.523 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:48.524+0000 7f667e200640 1 --2- 172.21.15.72:0/3241788 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f665406c8f0 0x7f665406edb0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:48.523 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:48.524+0000 7f667e200640 1 --2- 172.21.15.72:0/3241788 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f667815e860 0x7f66780cc340 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:48.523 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:48.524+0000 7f667e200640 1 --2- 172.21.15.72:0/3241788 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f66780cf660 0x7f66780b9380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:48.523 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:48.524+0000 7f667e200640 1 --2- 172.21.15.72:0/3241788 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f66780cf280 0x7f66780b8e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:48.523 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:48.524+0000 7f667e200640 1 -- 172.21.15.72:0/3241788 >> 172.21.15.72:0/3241788 conn(0x7f667806b860 msgr2=0x7f66780ceb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:48.524 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:48.524+0000 7f667e200640 1 -- 172.21.15.72:0/3241788 shutdown_connections 2024-04-04T06:57:48.524 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:48.524+0000 7f667e200640 1 -- 172.21.15.72:0/3241788 wait complete. 2024-04-04T06:57:48.551 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-04T06:57:48.747 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:48.749+0000 7fe165a00640 1 Processor -- start 2024-04-04T06:57:48.748 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:48.749+0000 7fe165a00640 1 -- start start 2024-04-04T06:57:48.749 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:48.750+0000 7fe165a00640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe1600d0890 0x7fe16006d340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:48.749 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:48.750+0000 7fe165a00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fe160151af0 0x7fe16006d880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:48.749 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:48.750+0000 7fe165a00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe160072100 con 0x7fe160151710 2024-04-04T06:57:48.749 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:48.750+0000 7fe165a00640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7fe160071ee0 con 0x7fe1600d0890 2024-04-04T06:57:48.749 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:48.750+0000 7fe165a00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fe1600723e0 con 0x7fe160151af0 2024-04-04T06:57:48.750 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:48.751+0000 7fe15e000640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe1600d0890 0x7fe16006d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:48.750 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:48.751+0000 7fe15e000640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe1600d0890 0x7fe16006d340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:37986/0 (socket says 172.21.15.72:37986) 2024-04-04T06:57:48.751 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:48.751+0000 7fe15e000640 1 -- 172.21.15.72:0/442923822 learned_addr learned my addr 172.21.15.72:0/442923822 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:57:48.751 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:48.751+0000 7fe15f400640 1 --2- 172.21.15.72:0/442923822 >> v2:172.21.15.117:3300/0 conn(0x7fe160151af0 0x7fe16006d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:48.751 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:48.751+0000 7fe15e000640 1 -- 172.21.15.72:0/442923822 >> v2:172.21.15.117:3300/0 conn(0x7fe160151af0 msgr2=0x7fe16006d880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:57:48.751 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:48.751+0000 7fe15e000640 1 --2- 172.21.15.72:0/442923822 >> v2:172.21.15.117:3300/0 conn(0x7fe160151af0 0x7fe16006d880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:48.751 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:48.751+0000 7fe15e000640 1 -- 172.21.15.72:0/442923822 >> v1:172.21.15.117:6789/0 conn(0x7fe160151710 legacy=0x7fe1600717d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:57:48.751 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:48.752+0000 7fe15e000640 1 -- 172.21.15.72:0/442923822 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1600726c0 con 0x7fe1600d0890 2024-04-04T06:57:48.751 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:48.753+0000 7fe15e000640 1 --2- 172.21.15.72:0/442923822 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe1600d0890 0x7fe16006d340 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fe14c009870 tx=0x7fe14c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b35d87db35915d20 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:48.752 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:48.753+0000 7fe15d600640 1 -- 172.21.15.72:0/442923822 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe14c035020 con 0x7fe1600d0890 2024-04-04T06:57:48.752 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:48.753+0000 7fe15d600640 1 -- 172.21.15.72:0/442923822 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe14c031870 con 0x7fe1600d0890 2024-04-04T06:57:48.752 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:48.753+0000 7fe15d600640 1 -- 172.21.15.72:0/442923822 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe14c031c40 con 0x7fe1600d0890 2024-04-04T06:57:48.753 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:48.754+0000 7fe165a00640 1 -- 172.21.15.72:0/442923822 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe1600d0890 msgr2=0x7fe16006d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:48.753 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:48.754+0000 7fe165a00640 1 --2- 172.21.15.72:0/442923822 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe1600d0890 0x7fe16006d340 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fe14c009870 tx=0x7fe14c02b910 comp rx=0 tx=0).stop 2024-04-04T06:57:48.753 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:48.754+0000 7fe165a00640 1 -- 172.21.15.72:0/442923822 shutdown_connections 2024-04-04T06:57:48.753 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:48.754+0000 7fe165a00640 1 --2- 172.21.15.72:0/442923822 >> v2:172.21.15.117:3300/0 conn(0x7fe160151af0 0x7fe16006d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:48.753 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:48.754+0000 7fe165a00640 1 --2- 172.21.15.72:0/442923822 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe1600d0890 0x7fe16006d340 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:48.753 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:48.754+0000 7fe165a00640 1 -- 172.21.15.72:0/442923822 >> 172.21.15.72:0/442923822 conn(0x7fe16006b470 msgr2=0x7fe16006b850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:48.754 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:48.754+0000 7fe165a00640 1 -- 172.21.15.72:0/442923822 shutdown_connections 2024-04-04T06:57:48.754 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:48.754+0000 7fe165a00640 1 -- 172.21.15.72:0/442923822 wait complete. 2024-04-04T06:57:48.755 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:48.756+0000 7fe165a00640 1 Processor -- start 2024-04-04T06:57:48.755 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:48.756+0000 7fe165a00640 1 -- start start 2024-04-04T06:57:48.756 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:48.757+0000 7fe165a00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe1600d0890 0x7fe16014a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:48.756 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:48.757+0000 7fe165a00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe160151710 0x7fe160153f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:48.756 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:48.757+0000 7fe165a00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe160151af0 0x7fe16014f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:48.756 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:48.757+0000 7fe165a00640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fe1600d00a0 con 0x7fe160151af0 2024-04-04T06:57:48.757 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:48.757+0000 7fe165a00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fe1600cff20 con 0x7fe1600d0890 2024-04-04T06:57:48.757 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:48.757+0000 7fe165a00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fe1600d0220 con 0x7fe160151710 2024-04-04T06:57:48.757 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:48.757+0000 7fe15f400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe160151af0 0x7fe16014f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:48.757 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:48.757+0000 7fe15f400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe160151af0 0x7fe16014f010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:37994/0 (socket says 172.21.15.72:37994) 2024-04-04T06:57:48.757 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:48.757+0000 7fe15f400640 1 -- 172.21.15.72:0/1924329430 learned_addr learned my addr 172.21.15.72:0/1924329430 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:57:48.757 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:48.757+0000 7fe15ea00640 1 --2- 172.21.15.72:0/1924329430 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe1600d0890 0x7fe16014a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:48.757 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:48.758+0000 7fe15e000640 1 --2- 172.21.15.72:0/1924329430 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe160151710 0x7fe160153f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:48.757 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:48.758+0000 7fe15f400640 1 -- 172.21.15.72:0/1924329430 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe160151710 msgr2=0x7fe160153f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:48.757 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:48.758+0000 7fe15f400640 1 --2- 172.21.15.72:0/1924329430 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe160151710 0x7fe160153f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:48.757 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:48.758+0000 7fe15f400640 1 -- 172.21.15.72:0/1924329430 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe1600d0890 msgr2=0x7fe16014a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:48.757 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:48.758+0000 7fe15f400640 1 --2- 172.21.15.72:0/1924329430 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe1600d0890 0x7fe16014a6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:48.757 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:48.758+0000 7fe15f400640 1 -- 172.21.15.72:0/1924329430 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe160154890 con 0x7fe160151af0 2024-04-04T06:57:48.757 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:48.758+0000 7fe15f400640 1 --2- 172.21.15.72:0/1924329430 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe160151af0 0x7fe16014f010 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fe158007ca0 tx=0x7fe15800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:48.759 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:48.758+0000 7fe156a00640 1 -- 172.21.15.72:0/1924329430 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe158014420 con 0x7fe160151af0 2024-04-04T06:57:48.759 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:48.758+0000 7fe156a00640 1 -- 172.21.15.72:0/1924329430 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe158019070 con 0x7fe160151af0 2024-04-04T06:57:48.759 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:48.758+0000 7fe165a00640 1 -- 172.21.15.72:0/1924329430 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe160154b70 con 0x7fe160151af0 2024-04-04T06:57:48.759 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:48.758+0000 7fe156a00640 1 -- 172.21.15.72:0/1924329430 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe158014800 con 0x7fe160151af0 2024-04-04T06:57:48.759 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:48.758+0000 7fe165a00640 1 -- 172.21.15.72:0/1924329430 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1601337f0 con 0x7fe160151af0 2024-04-04T06:57:48.759 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:48.759+0000 7fe165a00640 1 -- 172.21.15.72:0/1924329430 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe160075730 con 0x7fe160151af0 2024-04-04T06:57:48.760 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:48.761+0000 7fe156a00640 1 -- 172.21.15.72:0/1924329430 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe1580149a0 con 0x7fe160151af0 2024-04-04T06:57:48.760 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:48.761+0000 7fe156a00640 1 --2- 172.21.15.72:0/1924329430 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fe14006c8f0 0x7fe14006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:48.760 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:48.762+0000 7fe156a00640 1 -- 172.21.15.72:0/1924329430 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5227+0+0 (secure 0 0 0) 0x7fe15808c120 con 0x7fe160151af0 2024-04-04T06:57:48.760 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:48.762+0000 7fe15ea00640 1 --2- 172.21.15.72:0/1924329430 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fe14006c8f0 0x7fe14006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:48.761 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:48.762+0000 7fe15ea00640 1 --2- 172.21.15.72:0/1924329430 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fe14006c8f0 0x7fe14006edb0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fe150004ea0 tx=0x7fe150009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:48.765 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:48.767+0000 7fe156a00640 1 -- 172.21.15.72:0/1924329430 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fe15805a720 con 0x7fe160151af0 2024-04-04T06:57:48.966 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:48.967+0000 7fe165a00640 1 -- 172.21.15.72:0/1924329430 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fe16014bef0 con 0x7fe160151af0 2024-04-04T06:57:49.534 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:49.535+0000 7fe156a00640 1 -- 172.21.15.72:0/1924329430 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v31) ==== 170+0+0 (secure 0 0 0) 0x7fe15805a020 con 0x7fe160151af0 2024-04-04T06:57:49.535 INFO:teuthology.orchestra.run.smithi072.stderr:pool 'cephfs_data' created 2024-04-04T06:57:49.538 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:49.539+0000 7fe165a00640 1 -- 172.21.15.72:0/1924329430 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fe14006c8f0 msgr2=0x7fe14006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:49.538 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:49.539+0000 7fe165a00640 1 --2- 172.21.15.72:0/1924329430 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fe14006c8f0 0x7fe14006edb0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fe150004ea0 tx=0x7fe150009040 comp rx=0 tx=0).stop 2024-04-04T06:57:49.538 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:49.539+0000 7fe165a00640 1 -- 172.21.15.72:0/1924329430 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe160151af0 msgr2=0x7fe16014f010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:49.539 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:49.539+0000 7fe165a00640 1 --2- 172.21.15.72:0/1924329430 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe160151af0 0x7fe16014f010 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fe158007ca0 tx=0x7fe15800e4b0 comp rx=0 tx=0).stop 2024-04-04T06:57:49.539 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:49.540+0000 7fe165a00640 1 -- 172.21.15.72:0/1924329430 shutdown_connections 2024-04-04T06:57:49.539 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:49.540+0000 7fe165a00640 1 --2- 172.21.15.72:0/1924329430 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fe14006c8f0 0x7fe14006edb0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:49.539 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:49.540+0000 7fe165a00640 1 --2- 172.21.15.72:0/1924329430 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe160151af0 0x7fe16014f010 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:49.539 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:49.540+0000 7fe165a00640 1 --2- 172.21.15.72:0/1924329430 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe160151710 0x7fe160153f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:49.539 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:49.540+0000 7fe165a00640 1 --2- 172.21.15.72:0/1924329430 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe1600d0890 0x7fe16014a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:49.539 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:49.540+0000 7fe165a00640 1 -- 172.21.15.72:0/1924329430 >> 172.21.15.72:0/1924329430 conn(0x7fe16006b470 msgr2=0x7fe16015e3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:49.539 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:49.540+0000 7fe165a00640 1 -- 172.21.15.72:0/1924329430 shutdown_connections 2024-04-04T06:57:49.540 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:49.540+0000 7fe165a00640 1 -- 172.21.15.72:0/1924329430 wait complete. 2024-04-04T06:57:49.573 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-04T06:57:49.755 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:49.756+0000 7fe43ce00640 1 Processor -- start 2024-04-04T06:57:49.755 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:49.756+0000 7fe43ce00640 1 -- start start 2024-04-04T06:57:49.756 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:49.758+0000 7fe43ce00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe438145b10 0x7fe43806d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:49.756 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:49.758+0000 7fe43ce00640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe4380d0110 0x7fe438071430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:49.757 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:49.758+0000 7fe43ce00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe438145ef0 con 0x7fe43806dac0 2024-04-04T06:57:49.757 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:49.758+0000 7fe43ce00640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7fe4380cea10 con 0x7fe4380d0110 2024-04-04T06:57:49.757 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:49.758+0000 7fe43ce00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fe43806e310 con 0x7fe438145b10 2024-04-04T06:57:49.758 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:49.758+0000 7fe436800640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe4380d0110 0x7fe438071430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:49.758 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:49.758+0000 7fe436800640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe4380d0110 0x7fe438071430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:38724/0 (socket says 172.21.15.72:38724) 2024-04-04T06:57:49.758 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:49.758+0000 7fe436800640 1 -- 172.21.15.72:0/1419368190 learned_addr learned my addr 172.21.15.72:0/1419368190 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:57:49.758 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:49.758+0000 7fe435e00640 1 --2- 172.21.15.72:0/1419368190 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe438145b10 0x7fe43806d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:49.758 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:49.759+0000 7fe436800640 1 -- 172.21.15.72:0/1419368190 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe438145b10 msgr2=0x7fe43806d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:57:49.758 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:49.759+0000 7fe436800640 1 --2- 172.21.15.72:0/1419368190 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe438145b10 0x7fe43806d580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:49.758 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:49.759+0000 7fe436800640 1 -- 172.21.15.72:0/1419368190 >> v1:172.21.15.117:6789/0 conn(0x7fe43806dac0 legacy=0x7fe4380cfa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:57:49.758 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:49.759+0000 7fe436800640 1 -- 172.21.15.72:0/1419368190 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4380cec40 con 0x7fe4380d0110 2024-04-04T06:57:49.759 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:49.760+0000 7fe436800640 1 --2- 172.21.15.72:0/1419368190 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe4380d0110 0x7fe438071430 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fe43806e490 tx=0x7fe43002be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1c6de2dc730d8e8 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:49.759 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:49.760+0000 7fe435400640 1 -- 172.21.15.72:0/1419368190 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe43002c9c0 con 0x7fe4380d0110 2024-04-04T06:57:49.759 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:49.760+0000 7fe435400640 1 -- 172.21.15.72:0/1419368190 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe43002cb60 con 0x7fe4380d0110 2024-04-04T06:57:49.759 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:49.760+0000 7fe435400640 1 -- 172.21.15.72:0/1419368190 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4300343f0 con 0x7fe4380d0110 2024-04-04T06:57:49.760 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:49.761+0000 7fe43ce00640 1 -- 172.21.15.72:0/1419368190 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe4380d0110 msgr2=0x7fe438071430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:49.760 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:49.761+0000 7fe43ce00640 1 --2- 172.21.15.72:0/1419368190 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe4380d0110 0x7fe438071430 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fe43806e490 tx=0x7fe43002be20 comp rx=0 tx=0).stop 2024-04-04T06:57:49.760 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:49.761+0000 7fe43ce00640 1 -- 172.21.15.72:0/1419368190 shutdown_connections 2024-04-04T06:57:49.760 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:49.761+0000 7fe43ce00640 1 --2- 172.21.15.72:0/1419368190 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe4380d0110 0x7fe438071430 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:49.760 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:49.761+0000 7fe43ce00640 1 --2- 172.21.15.72:0/1419368190 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe438145b10 0x7fe43806d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:49.760 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:49.761+0000 7fe43ce00640 1 -- 172.21.15.72:0/1419368190 >> 172.21.15.72:0/1419368190 conn(0x7fe43806b470 msgr2=0x7fe43806b850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:49.760 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:49.761+0000 7fe43ce00640 1 -- 172.21.15.72:0/1419368190 shutdown_connections 2024-04-04T06:57:49.760 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:49.761+0000 7fe43ce00640 1 -- 172.21.15.72:0/1419368190 wait complete. 2024-04-04T06:57:49.761 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:49.763+0000 7fe43ce00640 1 Processor -- start 2024-04-04T06:57:49.761 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:49.763+0000 7fe43ce00640 1 -- start start 2024-04-04T06:57:49.762 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:49.764+0000 7fe43ce00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe43806dac0 0x7fe4380b27a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:49.763 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:49.764+0000 7fe43ce00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe4380d0110 0x7fe43813edd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:49.763 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:49.764+0000 7fe43ce00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe438145b10 0x7fe4381436d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:49.763 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:49.764+0000 7fe43ce00640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fe4380cf4e0 con 0x7fe4380d0110 2024-04-04T06:57:49.763 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:49.764+0000 7fe43ce00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fe4380cf200 con 0x7fe438145b10 2024-04-04T06:57:49.763 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:49.764+0000 7fe43ce00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fe43806df40 con 0x7fe43806dac0 2024-04-04T06:57:49.763 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:49.764+0000 7fe42d400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe4380d0110 0x7fe43813edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:49.763 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:49.764+0000 7fe42d400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe4380d0110 0x7fe43813edd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:38730/0 (socket says 172.21.15.72:38730) 2024-04-04T06:57:49.763 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:49.764+0000 7fe42d400640 1 -- 172.21.15.72:0/3785424868 learned_addr learned my addr 172.21.15.72:0/3785424868 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:57:49.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:49.764+0000 7fe436800640 1 --2- 172.21.15.72:0/3785424868 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe438145b10 0x7fe4381436d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:49.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:49.764+0000 7fe435e00640 1 --2- 172.21.15.72:0/3785424868 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe43806dac0 0x7fe4380b27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:49.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:49.764+0000 7fe42d400640 1 -- 172.21.15.72:0/3785424868 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe43806dac0 msgr2=0x7fe4380b27a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:49.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:49.764+0000 7fe42d400640 1 --2- 172.21.15.72:0/3785424868 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe43806dac0 0x7fe4380b27a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:49.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:49.764+0000 7fe42d400640 1 -- 172.21.15.72:0/3785424868 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe438145b10 msgr2=0x7fe4381436d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:49.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:49.764+0000 7fe42d400640 1 --2- 172.21.15.72:0/3785424868 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe438145b10 0x7fe4381436d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:49.765 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:49.764+0000 7fe42d400640 1 -- 172.21.15.72:0/3785424868 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4380b10e0 con 0x7fe4380d0110 2024-04-04T06:57:49.765 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:49.765+0000 7fe42d400640 1 --2- 172.21.15.72:0/3785424868 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe4380d0110 0x7fe43813edd0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fe42000c430 tx=0x7fe42000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:49.765 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:49.765+0000 7fe42ea00640 1 -- 172.21.15.72:0/3785424868 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe420011790 con 0x7fe4380d0110 2024-04-04T06:57:49.765 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:49.765+0000 7fe42ea00640 1 -- 172.21.15.72:0/3785424868 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe420017070 con 0x7fe4380d0110 2024-04-04T06:57:49.765 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:49.765+0000 7fe43ce00640 1 -- 172.21.15.72:0/3785424868 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4380b13c0 con 0x7fe4380d0110 2024-04-04T06:57:49.765 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:49.765+0000 7fe42ea00640 1 -- 172.21.15.72:0/3785424868 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe420011bb0 con 0x7fe4380d0110 2024-04-04T06:57:49.765 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:49.765+0000 7fe43ce00640 1 -- 172.21.15.72:0/3785424868 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4380b1980 con 0x7fe4380d0110 2024-04-04T06:57:49.765 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:49.766+0000 7fe43ce00640 1 -- 172.21.15.72:0/3785424868 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe438075730 con 0x7fe4380d0110 2024-04-04T06:57:49.766 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:49.768+0000 7fe42ea00640 1 -- 172.21.15.72:0/3785424868 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe42001c460 con 0x7fe4380d0110 2024-04-04T06:57:49.768 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:49.769+0000 7fe42ea00640 1 --2- 172.21.15.72:0/3785424868 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fe41406c8f0 0x7fe41406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:49.768 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:49.769+0000 7fe42ea00640 1 -- 172.21.15.72:0/3785424868 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5609+0+0 (secure 0 0 0) 0x7fe42008ba30 con 0x7fe4380d0110 2024-04-04T06:57:49.768 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:49.769+0000 7fe435e00640 1 --2- 172.21.15.72:0/3785424868 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fe41406c8f0 0x7fe41406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:49.768 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:49.770+0000 7fe435e00640 1 --2- 172.21.15.72:0/3785424868 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fe41406c8f0 0x7fe41406edb0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fe42800b7c0 tx=0x7fe428008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:49.773 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:49.774+0000 7fe42ea00640 1 -- 172.21.15.72:0/3785424868 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fe420059e20 con 0x7fe4380d0110 2024-04-04T06:57:50.016 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:50.017+0000 7fe43ce00640 1 -- 172.21.15.72:0/3785424868 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fe4380733a0 con 0x7fe4380d0110 2024-04-04T06:57:50.551 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:50.551+0000 7fe42ea00640 1 -- 172.21.15.72:0/3785424868 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v13) ==== 172+0+0 (secure 0 0 0) 0x7fe420059720 con 0x7fe4380d0110 2024-04-04T06:57:50.554 INFO:teuthology.orchestra.run.smithi072.stderr:new fs with metadata pool 4 and data pool 5 2024-04-04T06:57:50.560 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:50.561+0000 7fe43ce00640 1 -- 172.21.15.72:0/3785424868 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fe41406c8f0 msgr2=0x7fe41406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:50.560 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:50.561+0000 7fe43ce00640 1 --2- 172.21.15.72:0/3785424868 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fe41406c8f0 0x7fe41406edb0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fe42800b7c0 tx=0x7fe428008040 comp rx=0 tx=0).stop 2024-04-04T06:57:50.560 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:50.561+0000 7fe43ce00640 1 -- 172.21.15.72:0/3785424868 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe4380d0110 msgr2=0x7fe43813edd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:50.561 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:50.561+0000 7fe43ce00640 1 --2- 172.21.15.72:0/3785424868 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe4380d0110 0x7fe43813edd0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fe42000c430 tx=0x7fe42000c8f0 comp rx=0 tx=0).stop 2024-04-04T06:57:50.561 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:50.562+0000 7fe43ce00640 1 -- 172.21.15.72:0/3785424868 shutdown_connections 2024-04-04T06:57:50.561 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:50.562+0000 7fe43ce00640 1 --2- 172.21.15.72:0/3785424868 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fe41406c8f0 0x7fe41406edb0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:50.561 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:50.562+0000 7fe43ce00640 1 --2- 172.21.15.72:0/3785424868 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe438145b10 0x7fe4381436d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:50.561 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:50.562+0000 7fe43ce00640 1 --2- 172.21.15.72:0/3785424868 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe4380d0110 0x7fe43813edd0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:50.561 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:50.562+0000 7fe43ce00640 1 --2- 172.21.15.72:0/3785424868 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe43806dac0 0x7fe4380b27a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:50.561 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:50.562+0000 7fe43ce00640 1 -- 172.21.15.72:0/3785424868 >> 172.21.15.72:0/3785424868 conn(0x7fe43806b470 msgr2=0x7fe43815eb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:50.563 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:50.564+0000 7fe43ce00640 1 -- 172.21.15.72:0/3785424868 shutdown_connections 2024-04-04T06:57:50.563 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:50.564+0000 7fe43ce00640 1 -- 172.21.15.72:0/3785424868 wait complete. 2024-04-04T06:57:50.595 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-04T06:57:50.771 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:50.772+0000 7f4a07e00640 1 Processor -- start 2024-04-04T06:57:50.771 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:50.772+0000 7f4a07e00640 1 -- start start 2024-04-04T06:57:50.772 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:50.773+0000 7f4a07e00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f4a00145c00 0x7f4a00070710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:50.772 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:50.773+0000 7f4a07e00640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a0006c360 con 0x7f4a00074be0 2024-04-04T06:57:50.772 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:50.773+0000 7f4a07e00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a0006fc30 con 0x7f4a00070c50 2024-04-04T06:57:50.772 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:50.773+0000 7f4a07e00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f4a00145fe0 con 0x7f4a00145c00 2024-04-04T06:57:50.773 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:50.774+0000 7f4a05e00640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f4a00074be0 0x7f4a0015c910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:37764/0 (socket says 172.21.15.72:37764) 2024-04-04T06:57:50.773 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:50.774+0000 7f4a05e00640 1 -- 172.21.15.72:0/1799121255 learned_addr learned my addr 172.21.15.72:0/1799121255 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-04-04T06:57:50.775 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:50.774+0000 7f4a05400640 1 --2- 172.21.15.72:0/1799121255 >> v2:172.21.15.117:3300/0 conn(0x7f4a00145c00 0x7f4a00070710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:50.775 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:50.774+0000 7f49ffe00640 1 -- 172.21.15.72:0/1799121255 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2365993055 0 0) 0x7f4a0006c360 con 0x7f4a00074be0 2024-04-04T06:57:50.775 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:50.774+0000 7f49ffe00640 1 -- 172.21.15.72:0/1799121255 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f49e8003520 con 0x7f4a00074be0 2024-04-04T06:57:50.775 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:50.775+0000 7f49ffe00640 1 -- 172.21.15.72:0/1799121255 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3638041691 0 0) 0x7f49e8003520 con 0x7f4a00074be0 2024-04-04T06:57:50.775 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:50.775+0000 7f49ffe00640 1 -- 172.21.15.72:0/1799121255 >> v2:172.21.15.117:3300/0 conn(0x7f4a00145c00 msgr2=0x7f4a00070710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:57:50.775 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:50.775+0000 7f49ffe00640 1 --2- 172.21.15.72:0/1799121255 >> v2:172.21.15.117:3300/0 conn(0x7f4a00145c00 0x7f4a00070710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:50.775 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:50.775+0000 7f49ffe00640 1 -- 172.21.15.72:0/1799121255 >> v1:172.21.15.117:6789/0 conn(0x7f4a00070c50 legacy=0x7f4a000744d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:50.775 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:50.775+0000 7f49ffe00640 1 -- 172.21.15.72:0/1799121255 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a0006ff10 con 0x7f4a00074be0 2024-04-04T06:57:50.775 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:50.775+0000 7f49ffe00640 1 -- 172.21.15.72:0/1799121255 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2465650867 0 0) 0x7f49f80019f0 con 0x7f4a00074be0 2024-04-04T06:57:50.775 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:50.775+0000 7f49ffe00640 1 -- 172.21.15.72:0/1799121255 >> v1:172.21.15.72:6789/0 conn(0x7f4a00074be0 legacy=0x7f4a0015c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:50.775 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:50.775+0000 7f49ffe00640 1 --2- 172.21.15.72:0/1799121255 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f49e80039b0 0x7f49e8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:50.775 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:50.775+0000 7f49ffe00640 1 --2- 172.21.15.72:0/1799121255 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f49e8004800 0x7f49e8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:50.775 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:50.775+0000 7f49ffe00640 1 --2- 172.21.15.72:0/1799121255 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f49e80051c0 0x7f49e800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:50.775 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:50.775+0000 7f49ffe00640 1 -- 172.21.15.72:0/1799121255 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f4a00145fe0 con 0x7f49e80039b0 2024-04-04T06:57:50.776 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:50.775+0000 7f49ffe00640 1 -- 172.21.15.72:0/1799121255 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f49e800c060 con 0x7f49e8004800 2024-04-04T06:57:50.776 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:50.775+0000 7f49ffe00640 1 -- 172.21.15.72:0/1799121255 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f49e800c260 con 0x7f49e80051c0 2024-04-04T06:57:50.776 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:50.775+0000 7f4a05400640 1 --2- 172.21.15.72:0/1799121255 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f49e80039b0 0x7f49e8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:50.776 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:50.775+0000 7f4a05400640 1 -- 172.21.15.72:0/1799121255 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f49e80051c0 msgr2=0x7f49e800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:57:50.776 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:50.775+0000 7f4a05400640 1 --2- 172.21.15.72:0/1799121255 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f49e80051c0 0x7f49e800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:50.776 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:50.775+0000 7f4a05400640 1 -- 172.21.15.72:0/1799121255 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f49e8004800 msgr2=0x7f49e8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:57:50.776 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:50.775+0000 7f4a05400640 1 --2- 172.21.15.72:0/1799121255 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f49e8004800 0x7f49e8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:50.776 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:50.775+0000 7f4a05400640 1 -- 172.21.15.72:0/1799121255 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49e8003520 con 0x7f49e80039b0 2024-04-04T06:57:50.776 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:50.775+0000 7f4a05e00640 1 -- 172.21.15.72:0/1799121255 reap_dead start 2024-04-04T06:57:50.777 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:50.776+0000 7f4a05400640 1 --2- 172.21.15.72:0/1799121255 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f49e80039b0 0x7f49e8003dd0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f49f4009ac0 tx=0x7f49e8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=264dcb746199d61e server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:50.777 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:50.777+0000 7f49ffe00640 1 -- 172.21.15.72:0/1799121255 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49f4039070 con 0x7f49e80039b0 2024-04-04T06:57:50.777 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:50.777+0000 7f49ffe00640 1 -- 172.21.15.72:0/1799121255 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49f402c6b0 con 0x7f49e80039b0 2024-04-04T06:57:50.777 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:50.777+0000 7f49ffe00640 1 -- 172.21.15.72:0/1799121255 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49f4009690 con 0x7f49e80039b0 2024-04-04T06:57:50.777 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:50.777+0000 7f4a07e00640 1 -- 172.21.15.72:0/1799121255 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f49e80039b0 msgr2=0x7f49e8003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:50.778 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:50.777+0000 7f4a07e00640 1 --2- 172.21.15.72:0/1799121255 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f49e80039b0 0x7f49e8003dd0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f49f4009ac0 tx=0x7f49e8005830 comp rx=0 tx=0).stop 2024-04-04T06:57:50.778 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:50.777+0000 7f4a07e00640 1 -- 172.21.15.72:0/1799121255 shutdown_connections 2024-04-04T06:57:50.778 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:50.777+0000 7f4a07e00640 1 --2- 172.21.15.72:0/1799121255 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f49e80039b0 0x7f49e8003dd0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:50.778 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:50.777+0000 7f4a07e00640 1 -- 172.21.15.72:0/1799121255 >> 172.21.15.72:0/1799121255 conn(0x7f4a0006e4c0 msgr2=0x7f4a0006e8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:50.778 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:50.777+0000 7f4a07e00640 1 -- 172.21.15.72:0/1799121255 shutdown_connections 2024-04-04T06:57:50.778 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:50.777+0000 7f4a07e00640 1 -- 172.21.15.72:0/1799121255 wait complete. 2024-04-04T06:57:50.779 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:50.779+0000 7f4a07e00640 1 Processor -- start 2024-04-04T06:57:50.779 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:50.779+0000 7f4a07e00640 1 -- start start 2024-04-04T06:57:50.779 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:50.780+0000 7f4a07e00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f49e80039b0 0x7f4a001360a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:50.779 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:50.780+0000 7f4a07e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4a001e3930 0x7f4a001e3db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:50.779 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:50.780+0000 7f4a07e00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4a000adec0 0x7f4a000ae340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:50.779 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:50.780+0000 7f4a07e00640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f4a00070aa0 con 0x7f4a000adec0 2024-04-04T06:57:50.779 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:50.780+0000 7f4a07e00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f4a00070920 con 0x7f49e80039b0 2024-04-04T06:57:50.779 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:50.780+0000 7f4a07e00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f4a00070280 con 0x7f4a001e3930 2024-04-04T06:57:50.780 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:50.780+0000 7f4a05e00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4a000adec0 0x7f4a000ae340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:50.780 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:50.781+0000 7f4a05e00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4a000adec0 0x7f4a000ae340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:38750/0 (socket says 172.21.15.72:38750) 2024-04-04T06:57:50.780 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:50.781+0000 7f4a05e00640 1 -- 172.21.15.72:0/2760357387 learned_addr learned my addr 172.21.15.72:0/2760357387 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:57:50.781 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:50.781+0000 7f4a05400640 1 --2- 172.21.15.72:0/2760357387 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f49e80039b0 0x7f4a001360a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:50.781 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:50.781+0000 7f4a04a00640 1 --2- 172.21.15.72:0/2760357387 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4a001e3930 0x7f4a001e3db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:50.781 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:50.781+0000 7f4a05e00640 1 -- 172.21.15.72:0/2760357387 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4a001e3930 msgr2=0x7f4a001e3db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:50.781 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:50.781+0000 7f4a05e00640 1 --2- 172.21.15.72:0/2760357387 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4a001e3930 0x7f4a001e3db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:50.782 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:50.781+0000 7f4a05e00640 1 -- 172.21.15.72:0/2760357387 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f49e80039b0 msgr2=0x7f4a001360a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:50.782 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:50.781+0000 7f4a05e00640 1 --2- 172.21.15.72:0/2760357387 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f49e80039b0 0x7f4a001360a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:50.782 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:50.781+0000 7f4a05e00640 1 -- 172.21.15.72:0/2760357387 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a000aec60 con 0x7f4a000adec0 2024-04-04T06:57:50.782 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:50.781+0000 7f4a04a00640 1 --2- 172.21.15.72:0/2760357387 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4a001e3930 0x7f4a001e3db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-04T06:57:50.782 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:50.781+0000 7f4a05e00640 1 --2- 172.21.15.72:0/2760357387 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4a000adec0 0x7f4a000ae340 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f4a000724d0 tx=0x7f49f800cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:50.782 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:50.782+0000 7f49fd600640 1 -- 172.21.15.72:0/2760357387 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49f800ce70 con 0x7f4a000adec0 2024-04-04T06:57:50.782 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:50.782+0000 7f49fd600640 1 -- 172.21.15.72:0/2760357387 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49f800a610 con 0x7f4a000adec0 2024-04-04T06:57:50.782 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:50.782+0000 7f49fd600640 1 -- 172.21.15.72:0/2760357387 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49f800aa20 con 0x7f4a000adec0 2024-04-04T06:57:50.782 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:50.782+0000 7f4a07e00640 1 -- 172.21.15.72:0/2760357387 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a001e1620 con 0x7f4a000adec0 2024-04-04T06:57:50.782 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:50.782+0000 7f4a07e00640 1 -- 172.21.15.72:0/2760357387 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a001e1be0 con 0x7f4a000adec0 2024-04-04T06:57:50.782 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:50.783+0000 7f4a07e00640 1 -- 172.21.15.72:0/2760357387 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a0006cf30 con 0x7f4a000adec0 2024-04-04T06:57:50.783 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:50.784+0000 7f49fd600640 1 -- 172.21.15.72:0/2760357387 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f49f8011070 con 0x7f4a000adec0 2024-04-04T06:57:50.783 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:50.785+0000 7f49fd600640 1 --2- 172.21.15.72:0/2760357387 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f49e006c8f0 0x7f49e006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:50.784 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:50.785+0000 7f49fd600640 1 -- 172.21.15.72:0/2760357387 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f49f808b260 con 0x7f4a000adec0 2024-04-04T06:57:50.784 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:50.785+0000 7f4a05400640 1 --2- 172.21.15.72:0/2760357387 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f49e006c8f0 0x7f49e006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:50.784 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:50.786+0000 7f4a05400640 1 --2- 172.21.15.72:0/2760357387 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f49e006c8f0 0x7f49e006edb0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f49f4036000 tx=0x7f49f4030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:50.788 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:50.789+0000 7f49fd600640 1 -- 172.21.15.72:0/2760357387 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f49f80595f0 con 0x7f4a000adec0 2024-04-04T06:57:50.974 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:50.975+0000 7f4a07e00640 1 -- 172.21.15.72:0/2760357387 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4a0006d5e0 con 0x7f4a000adec0 2024-04-04T06:57:50.976 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:50.977+0000 7f49fd600640 1 -- 172.21.15.72:0/2760357387 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) ==== 74+0+16658 (secure 0 0 0) 0x7f49f8058ef0 con 0x7f4a000adec0 2024-04-04T06:57:50.976 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T06:57:50.976 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":32,"fsid":"6708bac2-4f50-49b5-87a9-c390fd333eb3","created":"2024-04-04T06:56:04.282498+0000","modified":"2024-04-04T06:57:50.019252+0000","last_up_change":"2024-04-04T06:56:16.716089+0000","last_in_change":"2024-04-04T06:56:07.768593+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-04T06:56:17.421685+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-04-04T06:57:47.865021+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-04-04T06:57:48.981181+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7c345991-5af8-4dc6-a481-28610c40e128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":3889813953},{"type":"v1","addr":"172.21.15.72:6818","nonce":3889813953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":3889813953},{"type":"v1","addr":"172.21.15.72:6821","nonce":3889813953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":3889813953},{"type":"v1","addr":"172.21.15.72:6826","nonce":3889813953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":3889813953},{"type":"v1","addr":"172.21.15.72:6823","nonce":3889813953}]},"public_addr":"172.21.15.72:6818/3889813953","cluster_addr":"172.21.15.72:6821/3889813953","heartbeat_back_addr":"172.21.15.72:6826/3889813953","heartbeat_front_addr":"172.21.15.72:6823/3889813953","state":["exists","up"]},{"osd":1,"uuid":"1b3f7ab2-a56c-488d-a89a-1f3572361c95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":3101663154},{"type":"v1","addr":"172.21.15.72:6801","nonce":3101663154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":3101663154},{"type":"v1","addr":"172.21.15.72:6803","nonce":3101663154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":3101663154},{"type":"v1","addr":"172.21.15.72:6807","nonce":3101663154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":3101663154},{"type":"v1","addr":"172.21.15.72:6805","nonce":3101663154}]},"public_addr":"172.21.15.72:6801/3101663154","cluster_addr":"172.21.15.72:6803/3101663154","heartbeat_back_addr":"172.21.15.72:6807/3101663154","heartbeat_front_addr":"172.21.15.72:6805/3101663154","state":["exists","up"]},{"osd":2,"uuid":"fc9aa512-53df-40d7-ba04-3e6b7dcd1e34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":235374192},{"type":"v1","addr":"172.21.15.72:6809","nonce":235374192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":235374192},{"type":"v1","addr":"172.21.15.72:6811","nonce":235374192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":235374192},{"type":"v1","addr":"172.21.15.72:6815","nonce":235374192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":235374192},{"type":"v1","addr":"172.21.15.72:6813","nonce":235374192}]},"public_addr":"172.21.15.72:6809/235374192","cluster_addr":"172.21.15.72:6811/235374192","heartbeat_back_addr":"172.21.15.72:6815/235374192","heartbeat_front_addr":"172.21.15.72:6813/235374192","state":["exists","up"]},{"osd":3,"uuid":"b4f63eed-dc5b-4aba-bb50-de46eb41492b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6817","nonce":2806631742},{"type":"v1","addr":"172.21.15.72:6819","nonce":2806631742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":2806631742},{"type":"v1","addr":"172.21.15.72:6827","nonce":2806631742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":2806631742},{"type":"v1","addr":"172.21.15.72:6831","nonce":2806631742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":2806631742},{"type":"v1","addr":"172.21.15.72:6829","nonce":2806631742}]},"public_addr":"172.21.15.72:6819/2806631742","cluster_addr":"172.21.15.72:6827/2806631742","heartbeat_back_addr":"172.21.15.72:6831/2806631742","heartbeat_front_addr":"172.21.15.72:6829/2806631742","state":["exists","up"]},{"osd":4,"uuid":"9e985ef8-d711-4172-9286-c54e560895d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":4293536423},{"type":"v1","addr":"172.21.15.117:6825","nonce":4293536423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":4293536423},{"type":"v1","addr":"172.21.15.117:6827","nonce":4293536423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":4293536423},{"type":"v1","addr":"172.21.15.117:6831","nonce":4293536423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":4293536423},{"type":"v1","addr":"172.21.15.117:6829","nonce":4293536423}]},"public_addr":"172.21.15.117:6825/4293536423","cluster_addr":"172.21.15.117:6827/4293536423","heartbeat_back_addr":"172.21.15.117:6831/4293536423","heartbeat_front_addr":"172.21.15.117:6829/4293536423","state":["exists","up"]},{"osd":5,"uuid":"3e9f082b-8d7d-455f-8a96-66d0b4857125","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":684971679},{"type":"v1","addr":"172.21.15.117:6801","nonce":684971679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":684971679},{"type":"v1","addr":"172.21.15.117:6803","nonce":684971679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":684971679},{"type":"v1","addr":"172.21.15.117:6807","nonce":684971679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":684971679},{"type":"v1","addr":"172.21.15.117:6805","nonce":684971679}]},"public_addr":"172.21.15.117:6801/684971679","cluster_addr":"172.21.15.117:6803/684971679","heartbeat_back_addr":"172.21.15.117:6807/684971679","heartbeat_front_addr":"172.21.15.117:6805/684971679","state":["exists","up"]},{"osd":6,"uuid":"bcdafa9f-a870-4398-a38d-ab7697676473","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":2781186528},{"type":"v1","addr":"172.21.15.117:6809","nonce":2781186528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":2781186528},{"type":"v1","addr":"172.21.15.117:6811","nonce":2781186528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":2781186528},{"type":"v1","addr":"172.21.15.117:6815","nonce":2781186528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":2781186528},{"type":"v1","addr":"172.21.15.117:6813","nonce":2781186528}]},"public_addr":"172.21.15.117:6809/2781186528","cluster_addr":"172.21.15.117:6811/2781186528","heartbeat_back_addr":"172.21.15.117:6815/2781186528","heartbeat_front_addr":"172.21.15.117:6813/2781186528","state":["exists","up"]},{"osd":7,"uuid":"b68ec562-ff35-4d2d-a733-c896f8920cfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":617469882},{"type":"v1","addr":"172.21.15.117:6817","nonce":617469882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":617469882},{"type":"v1","addr":"172.21.15.117:6819","nonce":617469882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":617469882},{"type":"v1","addr":"172.21.15.117:6823","nonce":617469882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":617469882},{"type":"v1","addr":"172.21.15.117:6821","nonce":617469882}]},"public_addr":"172.21.15.117:6817/617469882","cluster_addr":"172.21.15.117:6819/617469882","heartbeat_back_addr":"172.21.15.117:6823/617469882","heartbeat_front_addr":"172.21.15.117:6821/617469882","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.347700+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.296619+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.361345+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.093323+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:12.857605+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:12.816090+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.083163+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.121639+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-04T06:57:50.979 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:50.979+0000 7f4a07e00640 1 -- 172.21.15.72:0/2760357387 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f49e006c8f0 msgr2=0x7f49e006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:50.979 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:50.979+0000 7f4a07e00640 1 --2- 172.21.15.72:0/2760357387 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f49e006c8f0 0x7f49e006edb0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f49f4036000 tx=0x7f49f4030000 comp rx=0 tx=0).stop 2024-04-04T06:57:50.979 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:50.979+0000 7f4a07e00640 1 -- 172.21.15.72:0/2760357387 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4a000adec0 msgr2=0x7f4a000ae340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:50.979 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:50.979+0000 7f4a07e00640 1 --2- 172.21.15.72:0/2760357387 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4a000adec0 0x7f4a000ae340 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f4a000724d0 tx=0x7f49f800cc20 comp rx=0 tx=0).stop 2024-04-04T06:57:50.979 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:50.979+0000 7f4a07e00640 1 -- 172.21.15.72:0/2760357387 shutdown_connections 2024-04-04T06:57:50.979 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:50.979+0000 7f4a07e00640 1 --2- 172.21.15.72:0/2760357387 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f49e006c8f0 0x7f49e006edb0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:50.979 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:50.979+0000 7f4a07e00640 1 --2- 172.21.15.72:0/2760357387 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4a000adec0 0x7f4a000ae340 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:50.979 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:50.979+0000 7f4a07e00640 1 --2- 172.21.15.72:0/2760357387 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4a001e3930 0x7f4a001e3db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:50.979 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:50.979+0000 7f4a07e00640 1 --2- 172.21.15.72:0/2760357387 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f49e80039b0 0x7f4a001360a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:50.979 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:50.979+0000 7f4a07e00640 1 -- 172.21.15.72:0/2760357387 >> 172.21.15.72:0/2760357387 conn(0x7f4a0006e4c0 msgr2=0x7f4a000d0290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:50.980 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:50.980+0000 7f4a07e00640 1 -- 172.21.15.72:0/2760357387 shutdown_connections 2024-04-04T06:57:50.980 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:50.980+0000 7f4a07e00640 1 -- 172.21.15.72:0/2760357387 wait complete. 2024-04-04T06:57:50.996 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-04T06:57:51.203 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:51.204+0000 7f25f6600640 1 Processor -- start 2024-04-04T06:57:51.203 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:51.204+0000 7f25f6600640 1 -- start start 2024-04-04T06:57:51.205 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:51.206+0000 7f25f6600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f25f01566a0 0x7f25f0142370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:51.206 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:51.206+0000 7f25f6600640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f25f0156a80 0x7f25f006c480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:51.206 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:51.206+0000 7f25f6600640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f25f01428b0 con 0x7f25f015fdb0 2024-04-04T06:57:51.206 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:51.206+0000 7f25f6600640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f25f00cb8c0 con 0x7f25f0156a80 2024-04-04T06:57:51.206 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:51.206+0000 7f25f6600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f25f015c7c0 con 0x7f25f01566a0 2024-04-04T06:57:51.206 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:51.207+0000 7f25ef400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f25f01566a0 0x7f25f0142370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:51.206 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:51.207+0000 7f25e6a00640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f25f0156a80 0x7f25f006c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:51.206 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:51.207+0000 7f25efe00640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f25f015fdb0 0x7f25f015cc80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.72:35082/0 (socket says 172.21.15.72:35082) 2024-04-04T06:57:51.206 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:51.207+0000 7f25efe00640 1 -- 172.21.15.72:0/3745666146 learned_addr learned my addr 172.21.15.72:0/3745666146 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-04-04T06:57:51.207 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:51.207+0000 7f25eea00640 1 -- 172.21.15.72:0/3745666146 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3828706155 0 0) 0x7f25f01428b0 con 0x7f25f015fdb0 2024-04-04T06:57:51.207 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:51.207+0000 7f25eea00640 1 -- 172.21.15.72:0/3745666146 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f25d4003520 con 0x7f25f015fdb0 2024-04-04T06:57:51.207 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:51.208+0000 7f25e6a00640 1 -- 172.21.15.72:0/3745666146 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f25f01566a0 msgr2=0x7f25f0142370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:57:51.207 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:51.208+0000 7f25e6a00640 1 --2- 172.21.15.72:0/3745666146 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f25f01566a0 0x7f25f0142370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:51.207 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:51.208+0000 7f25e6a00640 1 -- 172.21.15.72:0/3745666146 >> v1:172.21.15.117:6789/0 conn(0x7f25f015fdb0 legacy=0x7f25f015cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:51.207 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:51.208+0000 7f25e6a00640 1 -- 172.21.15.72:0/3745666146 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25f013ff00 con 0x7f25f0156a80 2024-04-04T06:57:51.207 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:51.208+0000 7f25ef400640 1 --2- 172.21.15.72:0/3745666146 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f25f01566a0 0x7f25f0142370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-04T06:57:51.208 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:51.209+0000 7f25e6a00640 1 --2- 172.21.15.72:0/3745666146 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f25f0156a80 0x7f25f006c480 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f25e00097a0 tx=0x7f25e002b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=843303afd1a43260 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:51.208 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:51.209+0000 7f25eea00640 1 -- 172.21.15.72:0/3745666146 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25e0035020 con 0x7f25f0156a80 2024-04-04T06:57:51.208 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:51.209+0000 7f25eea00640 1 -- 172.21.15.72:0/3745666146 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25e0031810 con 0x7f25f0156a80 2024-04-04T06:57:51.208 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:51.209+0000 7f25eea00640 1 -- 172.21.15.72:0/3745666146 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25e0031bc0 con 0x7f25f0156a80 2024-04-04T06:57:51.208 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:51.210+0000 7f25f6600640 1 -- 172.21.15.72:0/3745666146 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f25f0156a80 msgr2=0x7f25f006c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:51.209 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:51.210+0000 7f25f6600640 1 --2- 172.21.15.72:0/3745666146 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f25f0156a80 0x7f25f006c480 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f25e00097a0 tx=0x7f25e002b8b0 comp rx=0 tx=0).stop 2024-04-04T06:57:51.209 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:51.210+0000 7f25f6600640 1 -- 172.21.15.72:0/3745666146 shutdown_connections 2024-04-04T06:57:51.209 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:51.210+0000 7f25f6600640 1 --2- 172.21.15.72:0/3745666146 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f25f0156a80 0x7f25f006c480 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:51.209 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:51.210+0000 7f25f6600640 1 --2- 172.21.15.72:0/3745666146 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f25f01566a0 0x7f25f0142370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:51.209 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:51.210+0000 7f25f6600640 1 -- 172.21.15.72:0/3745666146 >> 172.21.15.72:0/3745666146 conn(0x7f25f0072470 msgr2=0x7f25f0072880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:51.210 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:51.210+0000 7f25f6600640 1 -- 172.21.15.72:0/3745666146 shutdown_connections 2024-04-04T06:57:51.210 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:51.210+0000 7f25f6600640 1 -- 172.21.15.72:0/3745666146 wait complete. 2024-04-04T06:57:51.210 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:51.212+0000 7f25f6600640 1 Processor -- start 2024-04-04T06:57:51.210 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:51.212+0000 7f25f6600640 1 -- start start 2024-04-04T06:57:51.211 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:51.213+0000 7f25f6600640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f25f01566a0 0x7f25f0153a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:51.212 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:51.213+0000 7f25f6600640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f25f0156a80 0x7f25f015cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:51.212 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:51.213+0000 7f25f6600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f25f015fdb0 0x7f25f00ceaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:51.212 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:51.213+0000 7f25f6600640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f25f0160870 con 0x7f25f01566a0 2024-04-04T06:57:51.212 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:51.213+0000 7f25f6600640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f25f0160590 con 0x7f25f0156a80 2024-04-04T06:57:51.212 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:51.213+0000 7f25f6600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f25f0160b50 con 0x7f25f015fdb0 2024-04-04T06:57:51.213 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:51.213+0000 7f25ef400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f25f01566a0 0x7f25f0153a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:51.213 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:51.213+0000 7f25e6a00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f25f0156a80 0x7f25f015cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:51.213 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:51.214+0000 7f25e6a00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f25f0156a80 0x7f25f015cc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.72:49430/0 (socket says 172.21.15.72:49430) 2024-04-04T06:57:51.213 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:51.214+0000 7f25e6a00640 1 -- 172.21.15.72:0/1451921160 learned_addr learned my addr 172.21.15.72:0/1451921160 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:57:51.213 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:51.214+0000 7f25efe00640 1 --2- 172.21.15.72:0/1451921160 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f25f015fdb0 0x7f25f00ceaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:51.213 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:51.214+0000 7f25e6a00640 1 -- 172.21.15.72:0/1451921160 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f25f015fdb0 msgr2=0x7f25f00ceaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:51.213 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:51.214+0000 7f25e6a00640 1 --2- 172.21.15.72:0/1451921160 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f25f015fdb0 0x7f25f00ceaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:51.213 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:51.214+0000 7f25e6a00640 1 -- 172.21.15.72:0/1451921160 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f25f01566a0 msgr2=0x7f25f0153a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:51.213 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:51.214+0000 7f25e6a00640 1 --2- 172.21.15.72:0/1451921160 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f25f01566a0 0x7f25f0153a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:51.213 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:51.214+0000 7f25e6a00640 1 -- 172.21.15.72:0/1451921160 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25f00c7ff0 con 0x7f25f0156a80 2024-04-04T06:57:51.214 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:51.215+0000 7f25e6a00640 1 --2- 172.21.15.72:0/1451921160 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f25f0156a80 0x7f25f015cc80 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f25e002b8f0 tx=0x7f25e00046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:51.214 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:51.215+0000 7f25e7e00640 1 -- 172.21.15.72:0/1451921160 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25e0035040 con 0x7f25f0156a80 2024-04-04T06:57:51.214 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:51.215+0000 7f25f6600640 1 -- 172.21.15.72:0/1451921160 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25f015f910 con 0x7f25f0156a80 2024-04-04T06:57:51.214 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:51.215+0000 7f25e7e00640 1 -- 172.21.15.72:0/1451921160 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25e0003820 con 0x7f25f0156a80 2024-04-04T06:57:51.215 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:51.215+0000 7f25e7e00640 1 -- 172.21.15.72:0/1451921160 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25e0003bd0 con 0x7f25f0156a80 2024-04-04T06:57:51.215 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:51.215+0000 7f25f6600640 1 -- 172.21.15.72:0/1451921160 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25f00add60 con 0x7f25f0156a80 2024-04-04T06:57:51.215 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:51.216+0000 7f25f6600640 1 -- 172.21.15.72:0/1451921160 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f25f0075840 con 0x7f25f0156a80 2024-04-04T06:57:51.217 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:51.219+0000 7f25e7e00640 1 -- 172.21.15.72:0/1451921160 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f25e0038020 con 0x7f25f0156a80 2024-04-04T06:57:51.218 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:51.219+0000 7f25e7e00640 1 --2- 172.21.15.72:0/1451921160 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f25cc06c920 0x7f25cc06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:51.218 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:51.219+0000 7f25e7e00640 1 -- 172.21.15.72:0/1451921160 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f25e00ade60 con 0x7f25f0156a80 2024-04-04T06:57:51.218 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:51.220+0000 7f25ef400640 1 --2- 172.21.15.72:0/1451921160 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f25cc06c920 0x7f25cc06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:51.219 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:51.220+0000 7f25ef400640 1 --2- 172.21.15.72:0/1451921160 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f25cc06c920 0x7f25cc06ede0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f25d8009560 tx=0x7f25d8009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:51.234 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:51.235+0000 7f25e7e00640 1 -- 172.21.15.72:0/1451921160 <== mon.1 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f25e007bc50 con 0x7f25f0156a80 2024-04-04T06:57:51.433 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:51.434+0000 7f25f6600640 1 -- 172.21.15.72:0/1451921160 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f25f0154490 con 0x7f25f0156a80 2024-04-04T06:57:51.436 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:51.438+0000 7f25e7e00640 1 -- 172.21.15.72:0/1451921160 <== mon.1 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) ==== 74+0+16658 (secure 0 0 0) 0x7f25e007ff50 con 0x7f25f0156a80 2024-04-04T06:57:51.437 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T06:57:51.437 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":32,"fsid":"6708bac2-4f50-49b5-87a9-c390fd333eb3","created":"2024-04-04T06:56:04.282498+0000","modified":"2024-04-04T06:57:50.019252+0000","last_up_change":"2024-04-04T06:56:16.716089+0000","last_in_change":"2024-04-04T06:56:07.768593+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-04T06:56:17.421685+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-04-04T06:57:47.865021+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-04-04T06:57:48.981181+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7c345991-5af8-4dc6-a481-28610c40e128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":3889813953},{"type":"v1","addr":"172.21.15.72:6818","nonce":3889813953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":3889813953},{"type":"v1","addr":"172.21.15.72:6821","nonce":3889813953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":3889813953},{"type":"v1","addr":"172.21.15.72:6826","nonce":3889813953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":3889813953},{"type":"v1","addr":"172.21.15.72:6823","nonce":3889813953}]},"public_addr":"172.21.15.72:6818/3889813953","cluster_addr":"172.21.15.72:6821/3889813953","heartbeat_back_addr":"172.21.15.72:6826/3889813953","heartbeat_front_addr":"172.21.15.72:6823/3889813953","state":["exists","up"]},{"osd":1,"uuid":"1b3f7ab2-a56c-488d-a89a-1f3572361c95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":3101663154},{"type":"v1","addr":"172.21.15.72:6801","nonce":3101663154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":3101663154},{"type":"v1","addr":"172.21.15.72:6803","nonce":3101663154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":3101663154},{"type":"v1","addr":"172.21.15.72:6807","nonce":3101663154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":3101663154},{"type":"v1","addr":"172.21.15.72:6805","nonce":3101663154}]},"public_addr":"172.21.15.72:6801/3101663154","cluster_addr":"172.21.15.72:6803/3101663154","heartbeat_back_addr":"172.21.15.72:6807/3101663154","heartbeat_front_addr":"172.21.15.72:6805/3101663154","state":["exists","up"]},{"osd":2,"uuid":"fc9aa512-53df-40d7-ba04-3e6b7dcd1e34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":235374192},{"type":"v1","addr":"172.21.15.72:6809","nonce":235374192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":235374192},{"type":"v1","addr":"172.21.15.72:6811","nonce":235374192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":235374192},{"type":"v1","addr":"172.21.15.72:6815","nonce":235374192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":235374192},{"type":"v1","addr":"172.21.15.72:6813","nonce":235374192}]},"public_addr":"172.21.15.72:6809/235374192","cluster_addr":"172.21.15.72:6811/235374192","heartbeat_back_addr":"172.21.15.72:6815/235374192","heartbeat_front_addr":"172.21.15.72:6813/235374192","state":["exists","up"]},{"osd":3,"uuid":"b4f63eed-dc5b-4aba-bb50-de46eb41492b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6817","nonce":2806631742},{"type":"v1","addr":"172.21.15.72:6819","nonce":2806631742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":2806631742},{"type":"v1","addr":"172.21.15.72:6827","nonce":2806631742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":2806631742},{"type":"v1","addr":"172.21.15.72:6831","nonce":2806631742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":2806631742},{"type":"v1","addr":"172.21.15.72:6829","nonce":2806631742}]},"public_addr":"172.21.15.72:6819/2806631742","cluster_addr":"172.21.15.72:6827/2806631742","heartbeat_back_addr":"172.21.15.72:6831/2806631742","heartbeat_front_addr":"172.21.15.72:6829/2806631742","state":["exists","up"]},{"osd":4,"uuid":"9e985ef8-d711-4172-9286-c54e560895d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":4293536423},{"type":"v1","addr":"172.21.15.117:6825","nonce":4293536423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":4293536423},{"type":"v1","addr":"172.21.15.117:6827","nonce":4293536423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":4293536423},{"type":"v1","addr":"172.21.15.117:6831","nonce":4293536423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":4293536423},{"type":"v1","addr":"172.21.15.117:6829","nonce":4293536423}]},"public_addr":"172.21.15.117:6825/4293536423","cluster_addr":"172.21.15.117:6827/4293536423","heartbeat_back_addr":"172.21.15.117:6831/4293536423","heartbeat_front_addr":"172.21.15.117:6829/4293536423","state":["exists","up"]},{"osd":5,"uuid":"3e9f082b-8d7d-455f-8a96-66d0b4857125","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":684971679},{"type":"v1","addr":"172.21.15.117:6801","nonce":684971679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":684971679},{"type":"v1","addr":"172.21.15.117:6803","nonce":684971679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":684971679},{"type":"v1","addr":"172.21.15.117:6807","nonce":684971679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":684971679},{"type":"v1","addr":"172.21.15.117:6805","nonce":684971679}]},"public_addr":"172.21.15.117:6801/684971679","cluster_addr":"172.21.15.117:6803/684971679","heartbeat_back_addr":"172.21.15.117:6807/684971679","heartbeat_front_addr":"172.21.15.117:6805/684971679","state":["exists","up"]},{"osd":6,"uuid":"bcdafa9f-a870-4398-a38d-ab7697676473","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":2781186528},{"type":"v1","addr":"172.21.15.117:6809","nonce":2781186528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":2781186528},{"type":"v1","addr":"172.21.15.117:6811","nonce":2781186528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":2781186528},{"type":"v1","addr":"172.21.15.117:6815","nonce":2781186528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":2781186528},{"type":"v1","addr":"172.21.15.117:6813","nonce":2781186528}]},"public_addr":"172.21.15.117:6809/2781186528","cluster_addr":"172.21.15.117:6811/2781186528","heartbeat_back_addr":"172.21.15.117:6815/2781186528","heartbeat_front_addr":"172.21.15.117:6813/2781186528","state":["exists","up"]},{"osd":7,"uuid":"b68ec562-ff35-4d2d-a733-c896f8920cfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":617469882},{"type":"v1","addr":"172.21.15.117:6817","nonce":617469882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":617469882},{"type":"v1","addr":"172.21.15.117:6819","nonce":617469882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":617469882},{"type":"v1","addr":"172.21.15.117:6823","nonce":617469882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":617469882},{"type":"v1","addr":"172.21.15.117:6821","nonce":617469882}]},"public_addr":"172.21.15.117:6817/617469882","cluster_addr":"172.21.15.117:6819/617469882","heartbeat_back_addr":"172.21.15.117:6823/617469882","heartbeat_front_addr":"172.21.15.117:6821/617469882","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.347700+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.296619+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.361345+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.093323+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:12.857605+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:12.816090+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.083163+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.121639+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-04T06:57:51.439 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:51.440+0000 7f25f6600640 1 -- 172.21.15.72:0/1451921160 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f25cc06c920 msgr2=0x7f25cc06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:51.439 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:51.440+0000 7f25f6600640 1 --2- 172.21.15.72:0/1451921160 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f25cc06c920 0x7f25cc06ede0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f25d8009560 tx=0x7f25d8009190 comp rx=0 tx=0).stop 2024-04-04T06:57:51.439 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:51.440+0000 7f25f6600640 1 -- 172.21.15.72:0/1451921160 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f25f0156a80 msgr2=0x7f25f015cc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:51.440 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:51.440+0000 7f25f6600640 1 --2- 172.21.15.72:0/1451921160 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f25f0156a80 0x7f25f015cc80 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f25e002b8f0 tx=0x7f25e00046c0 comp rx=0 tx=0).stop 2024-04-04T06:57:51.440 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:51.440+0000 7f25f6600640 1 -- 172.21.15.72:0/1451921160 shutdown_connections 2024-04-04T06:57:51.440 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:51.440+0000 7f25f6600640 1 --2- 172.21.15.72:0/1451921160 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f25cc06c920 0x7f25cc06ede0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:51.440 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:51.440+0000 7f25f6600640 1 --2- 172.21.15.72:0/1451921160 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f25f015fdb0 0x7f25f00ceaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:51.440 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:51.440+0000 7f25f6600640 1 --2- 172.21.15.72:0/1451921160 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f25f0156a80 0x7f25f015cc80 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:51.440 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:51.440+0000 7f25f6600640 1 --2- 172.21.15.72:0/1451921160 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f25f01566a0 0x7f25f0153a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:51.440 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:51.440+0000 7f25f6600640 1 -- 172.21.15.72:0/1451921160 >> 172.21.15.72:0/1451921160 conn(0x7f25f0072470 msgr2=0x7f25f00c6700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:51.440 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:51.440+0000 7f25f6600640 1 -- 172.21.15.72:0/1451921160 shutdown_connections 2024-04-04T06:57:51.441 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:51.441+0000 7f25f6600640 1 -- 172.21.15.72:0/1451921160 wait complete. 2024-04-04T06:57:51.459 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-04T06:57:51.667 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:51.668+0000 7f880e800640 1 Processor -- start 2024-04-04T06:57:51.667 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:51.668+0000 7f880e800640 1 -- start start 2024-04-04T06:57:51.670 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:51.670+0000 7f880e800640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f880815e650 0x7f88080b9e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:51.670 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:51.670+0000 7f880e800640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f88080d0b80 0x7f88080d4260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:51.670 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:51.670+0000 7f880e800640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88080d13f0 con 0x7f88080d47a0 2024-04-04T06:57:51.670 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:51.670+0000 7f880e800640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f88080d4c10 con 0x7f88080d0b80 2024-04-04T06:57:51.670 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:51.670+0000 7f880e800640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f88080d29b0 con 0x7f880815e650 2024-04-04T06:57:51.671 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:51.670+0000 7f8807e00640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f88080d47a0 0x7f8808162060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:37772/0 (socket says 172.21.15.72:37772) 2024-04-04T06:57:51.671 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:51.670+0000 7f8806a00640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f88080d0b80 0x7f88080d4260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:51.671 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:51.670+0000 7f8807e00640 1 -- 172.21.15.72:0/798953207 learned_addr learned my addr 172.21.15.72:0/798953207 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-04-04T06:57:51.671 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:51.670+0000 7f8807400640 1 --2- 172.21.15.72:0/798953207 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f880815e650 0x7f88080b9e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:51.671 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:51.671+0000 7f8806a00640 1 -- 172.21.15.72:0/798953207 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f880815e650 msgr2=0x7f88080b9e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:57:51.671 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:51.671+0000 7f8806a00640 1 --2- 172.21.15.72:0/798953207 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f880815e650 0x7f88080b9e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:51.671 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:51.671+0000 7f8806a00640 1 -- 172.21.15.72:0/798953207 >> v1:172.21.15.72:6789/0 conn(0x7f88080d47a0 legacy=0x7f8808162060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:51.671 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:51.671+0000 7f8806a00640 1 -- 172.21.15.72:0/798953207 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88080d16d0 con 0x7f88080d0b80 2024-04-04T06:57:51.674 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:51.672+0000 7f8806a00640 1 --2- 172.21.15.72:0/798953207 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f88080d0b80 0x7f88080d4260 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f87f4009d90 tx=0x7f87f402bc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb7cddd817a1be2f server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:51.675 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:51.672+0000 7f8806000640 1 -- 172.21.15.72:0/798953207 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87f4039070 con 0x7f88080d0b80 2024-04-04T06:57:51.675 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:51.672+0000 7f8806000640 1 -- 172.21.15.72:0/798953207 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87f402c980 con 0x7f88080d0b80 2024-04-04T06:57:51.675 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:51.672+0000 7f8806000640 1 -- 172.21.15.72:0/798953207 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87f402cd50 con 0x7f88080d0b80 2024-04-04T06:57:51.675 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:51.673+0000 7f880e800640 1 -- 172.21.15.72:0/798953207 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f88080d0b80 msgr2=0x7f88080d4260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:51.675 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:51.673+0000 7f880e800640 1 --2- 172.21.15.72:0/798953207 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f88080d0b80 0x7f88080d4260 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f87f4009d90 tx=0x7f87f402bc50 comp rx=0 tx=0).stop 2024-04-04T06:57:51.675 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:51.673+0000 7f880e800640 1 -- 172.21.15.72:0/798953207 shutdown_connections 2024-04-04T06:57:51.675 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:51.673+0000 7f880e800640 1 --2- 172.21.15.72:0/798953207 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f88080d0b80 0x7f88080d4260 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:51.676 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:51.673+0000 7f880e800640 1 --2- 172.21.15.72:0/798953207 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f880815e650 0x7f88080b9e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:51.676 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:51.673+0000 7f880e800640 1 -- 172.21.15.72:0/798953207 >> 172.21.15.72:0/798953207 conn(0x7f880806b470 msgr2=0x7f880806b880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:51.676 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:51.673+0000 7f880e800640 1 -- 172.21.15.72:0/798953207 shutdown_connections 2024-04-04T06:57:51.676 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:51.673+0000 7f880e800640 1 -- 172.21.15.72:0/798953207 wait complete. 2024-04-04T06:57:51.676 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:51.675+0000 7f880e800640 1 Processor -- start 2024-04-04T06:57:51.676 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:51.675+0000 7f880e800640 1 -- start start 2024-04-04T06:57:51.680 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:51.676+0000 7f880e800640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f88080d0b80 0x7f880815cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:51.680 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:51.676+0000 7f880e800640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f88080d47a0 0x7f8808150220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:51.680 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:51.676+0000 7f880e800640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f880815e650 0x7f8808160ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:51.680 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:51.676+0000 7f880e800640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f88080d1000 con 0x7f88080d0b80 2024-04-04T06:57:51.680 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:51.676+0000 7f880e800640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f88080b7470 con 0x7f880815e650 2024-04-04T06:57:51.680 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:51.676+0000 7f880e800640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f88080d1180 con 0x7f88080d47a0 2024-04-04T06:57:51.681 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:51.676+0000 7f8807400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f88080d0b80 0x7f880815cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:51.681 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:51.677+0000 7f8807400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f88080d0b80 0x7f880815cdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:38800/0 (socket says 172.21.15.72:38800) 2024-04-04T06:57:51.681 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:51.677+0000 7f8807400640 1 -- 172.21.15.72:0/1895754409 learned_addr learned my addr 172.21.15.72:0/1895754409 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:57:51.681 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:51.677+0000 7f8806a00640 1 --2- 172.21.15.72:0/1895754409 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f88080d47a0 0x7f8808150220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:51.681 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:51.677+0000 7f8807400640 1 -- 172.21.15.72:0/1895754409 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f88080d47a0 msgr2=0x7f8808150220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:51.681 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:51.677+0000 7f8807400640 1 --2- 172.21.15.72:0/1895754409 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f88080d47a0 0x7f8808150220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:51.681 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:51.677+0000 7f8807400640 1 -- 172.21.15.72:0/1895754409 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f880815e650 msgr2=0x7f8808160ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:51.681 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:51.677+0000 7f8807400640 1 --2- 172.21.15.72:0/1895754409 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f880815e650 0x7f8808160ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:51.681 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:51.677+0000 7f8807400640 1 -- 172.21.15.72:0/1895754409 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8808150b20 con 0x7f88080d0b80 2024-04-04T06:57:51.681 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:51.677+0000 7f8807400640 1 --2- 172.21.15.72:0/1895754409 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f88080d0b80 0x7f880815cdb0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f87f800d800 tx=0x7f87f800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:51.681 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:51.677+0000 7f87ff400640 1 -- 172.21.15.72:0/1895754409 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87f800b6c0 con 0x7f88080d0b80 2024-04-04T06:57:51.681 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:51.678+0000 7f87ff400640 1 -- 172.21.15.72:0/1895754409 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87f8019070 con 0x7f88080d0b80 2024-04-04T06:57:51.681 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:51.678+0000 7f87ff400640 1 -- 172.21.15.72:0/1895754409 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87f800ba80 con 0x7f88080d0b80 2024-04-04T06:57:51.682 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:51.678+0000 7f880e800640 1 -- 172.21.15.72:0/1895754409 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8808152560 con 0x7f88080d0b80 2024-04-04T06:57:51.682 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:51.678+0000 7f880e800640 1 -- 172.21.15.72:0/1895754409 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8808152b20 con 0x7f88080d0b80 2024-04-04T06:57:51.682 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:51.679+0000 7f880e800640 1 -- 172.21.15.72:0/1895754409 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8808075730 con 0x7f88080d0b80 2024-04-04T06:57:51.682 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:51.680+0000 7f87ff400640 1 -- 172.21.15.72:0/1895754409 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f87f800bc20 con 0x7f88080d0b80 2024-04-04T06:57:51.682 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:51.680+0000 7f87ff400640 1 --2- 172.21.15.72:0/1895754409 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f87e806c8f0 0x7f87e806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:51.682 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:51.681+0000 7f87ff400640 1 -- 172.21.15.72:0/1895754409 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f87f808bff0 con 0x7f88080d0b80 2024-04-04T06:57:51.682 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:51.681+0000 7f8806a00640 1 --2- 172.21.15.72:0/1895754409 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f87e806c8f0 0x7f87e806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:51.682 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:51.681+0000 7f8806a00640 1 --2- 172.21.15.72:0/1895754409 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f87e806c8f0 0x7f87e806edb0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f87f4036000 tx=0x7f87f4030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:51.684 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:51.685+0000 7f87ff400640 1 -- 172.21.15.72:0/1895754409 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f87f801c360 con 0x7f88080d0b80 2024-04-04T06:57:51.923 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:51.924+0000 7f880e800640 1 -- 172.21.15.72:0/1895754409 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f88080d1fe0 con 0x7f88080d0b80 2024-04-04T06:57:52.563 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:52.564+0000 7f87ff400640 1 -- 172.21.15.72:0/1895754409 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v16) ==== 118+0+0 (secure 0 0 0) 0x7f87f805a470 con 0x7f88080d0b80 2024-04-04T06:57:52.567 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:52.568+0000 7f880e800640 1 -- 172.21.15.72:0/1895754409 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f87e806c8f0 msgr2=0x7f87e806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:52.567 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:52.568+0000 7f880e800640 1 --2- 172.21.15.72:0/1895754409 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f87e806c8f0 0x7f87e806edb0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f87f4036000 tx=0x7f87f4030000 comp rx=0 tx=0).stop 2024-04-04T06:57:52.567 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:52.568+0000 7f880e800640 1 -- 172.21.15.72:0/1895754409 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f88080d0b80 msgr2=0x7f880815cdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:52.567 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:52.568+0000 7f880e800640 1 --2- 172.21.15.72:0/1895754409 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f88080d0b80 0x7f880815cdb0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f87f800d800 tx=0x7f87f800dcc0 comp rx=0 tx=0).stop 2024-04-04T06:57:52.567 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:52.568+0000 7f880e800640 1 -- 172.21.15.72:0/1895754409 shutdown_connections 2024-04-04T06:57:52.567 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:52.568+0000 7f880e800640 1 --2- 172.21.15.72:0/1895754409 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f87e806c8f0 0x7f87e806edb0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:52.567 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:52.568+0000 7f880e800640 1 --2- 172.21.15.72:0/1895754409 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f880815e650 0x7f8808160ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:52.567 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:52.568+0000 7f880e800640 1 --2- 172.21.15.72:0/1895754409 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f88080d47a0 0x7f8808150220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:52.567 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:52.568+0000 7f880e800640 1 --2- 172.21.15.72:0/1895754409 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f88080d0b80 0x7f880815cdb0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:52.568 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:52.568+0000 7f880e800640 1 -- 172.21.15.72:0/1895754409 >> 172.21.15.72:0/1895754409 conn(0x7f880806b470 msgr2=0x7f88080c9290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:52.568 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:52.569+0000 7f880e800640 1 -- 172.21.15.72:0/1895754409 shutdown_connections 2024-04-04T06:57:52.568 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:52.569+0000 7f880e800640 1 -- 172.21.15.72:0/1895754409 wait complete. 2024-04-04T06:57:52.589 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-04-04T06:57:52.589 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-04T06:57:52.788 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:52.789+0000 7f25d5e00640 1 Processor -- start 2024-04-04T06:57:52.788 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:52.789+0000 7f25d5e00640 1 -- start start 2024-04-04T06:57:52.790 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:52.791+0000 7f25d5e00640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f25d015e1d0 0x7f25d0162760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:52.790 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:52.791+0000 7f25d5e00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f25d00d1050 0x7f25d00d14b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:52.790 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:52.791+0000 7f25d5e00640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f25d00d2270 con 0x7f25d00d4070 2024-04-04T06:57:52.790 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:52.791+0000 7f25d5e00640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f25d00d19f0 con 0x7f25d015e1d0 2024-04-04T06:57:52.790 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:52.791+0000 7f25d5e00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f25d0162ca0 con 0x7f25d00d1050 2024-04-04T06:57:52.790 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:52.791+0000 7f25d4a00640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f25d015e1d0 0x7f25d0162760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:52.790 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:52.791+0000 7f25d5400640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f25d00d4070 0x7f25d00d44e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:37786/0 (socket says 172.21.15.72:37786) 2024-04-04T06:57:52.790 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:52.791+0000 7f25d5400640 1 -- 172.21.15.72:0/4214288161 learned_addr learned my addr 172.21.15.72:0/4214288161 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-04-04T06:57:52.791 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:52.792+0000 7f25c7e00640 1 --2- 172.21.15.72:0/4214288161 >> v2:172.21.15.117:3300/0 conn(0x7f25d00d1050 0x7f25d00d14b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:52.791 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:52.792+0000 7f25d4a00640 1 -- 172.21.15.72:0/4214288161 >> v2:172.21.15.117:3300/0 conn(0x7f25d00d1050 msgr2=0x7f25d00d14b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:57:52.791 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:52.792+0000 7f25d4a00640 1 --2- 172.21.15.72:0/4214288161 >> v2:172.21.15.117:3300/0 conn(0x7f25d00d1050 0x7f25d00d14b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:52.791 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:52.792+0000 7f25d4a00640 1 -- 172.21.15.72:0/4214288161 >> v1:172.21.15.72:6789/0 conn(0x7f25d00d4070 legacy=0x7f25d00d44e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:52.791 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:52.792+0000 7f25d4a00640 1 -- 172.21.15.72:0/4214288161 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25d015e5b0 con 0x7f25d015e1d0 2024-04-04T06:57:52.792 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:52.792+0000 7f25c7e00640 1 --2- 172.21.15.72:0/4214288161 >> v2:172.21.15.117:3300/0 conn(0x7f25d00d1050 0x7f25d00d14b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-04T06:57:52.792 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:52.792+0000 7f25cfe00640 1 -- 172.21.15.72:0/4214288161 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2317592074 0 0) 0x7f25d00d2270 con 0x7f25d00d4070 2024-04-04T06:57:52.792 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:52.793+0000 7f25d4a00640 1 --2- 172.21.15.72:0/4214288161 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f25d015e1d0 0x7f25d0162760 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f25d0071b50 tx=0x7f25c002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67f80cd3fc45e42c server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:52.792 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:52.794+0000 7f25cfe00640 1 -- 172.21.15.72:0/4214288161 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25c00315a0 con 0x7f25d015e1d0 2024-04-04T06:57:52.792 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:52.794+0000 7f25cfe00640 1 -- 172.21.15.72:0/4214288161 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25c0037070 con 0x7f25d015e1d0 2024-04-04T06:57:52.792 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:52.794+0000 7f25cfe00640 1 -- 172.21.15.72:0/4214288161 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25c0031960 con 0x7f25d015e1d0 2024-04-04T06:57:52.793 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:52.794+0000 7f25d5e00640 1 -- 172.21.15.72:0/4214288161 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f25d015e1d0 msgr2=0x7f25d0162760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:52.793 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:52.794+0000 7f25d5e00640 1 --2- 172.21.15.72:0/4214288161 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f25d015e1d0 0x7f25d0162760 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f25d0071b50 tx=0x7f25c002b840 comp rx=0 tx=0).stop 2024-04-04T06:57:52.794 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:52.794+0000 7f25d5e00640 1 -- 172.21.15.72:0/4214288161 shutdown_connections 2024-04-04T06:57:52.794 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:52.794+0000 7f25d5e00640 1 --2- 172.21.15.72:0/4214288161 >> v2:172.21.15.117:3300/0 conn(0x7f25d00d1050 0x7f25d00d14b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:52.794 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:52.794+0000 7f25d5e00640 1 --2- 172.21.15.72:0/4214288161 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f25d015e1d0 0x7f25d0162760 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:52.794 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:52.794+0000 7f25d5e00640 1 -- 172.21.15.72:0/4214288161 >> 172.21.15.72:0/4214288161 conn(0x7f25d006b8c0 msgr2=0x7f25d006bcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:52.794 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:52.794+0000 7f25d5e00640 1 -- 172.21.15.72:0/4214288161 shutdown_connections 2024-04-04T06:57:52.794 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:52.794+0000 7f25d5e00640 1 -- 172.21.15.72:0/4214288161 wait complete. 2024-04-04T06:57:52.797 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:52.796+0000 7f25d5e00640 1 Processor -- start 2024-04-04T06:57:52.798 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:52.796+0000 7f25d5e00640 1 -- start start 2024-04-04T06:57:52.800 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:52.797+0000 7f25d5e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f25d00d1050 0x7f25d0153650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:52.800 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:52.797+0000 7f25d5e00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f25d00d4070 0x7f25d015f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:52.800 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:52.797+0000 7f25d5e00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f25d015e1d0 0x7f25d015f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:52.800 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:52.797+0000 7f25d5e00640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f25d00d3d20 con 0x7f25d00d4070 2024-04-04T06:57:52.800 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:52.797+0000 7f25d5e00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f25d00d2510 con 0x7f25d015e1d0 2024-04-04T06:57:52.800 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:52.797+0000 7f25d5e00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f25d00b3430 con 0x7f25d00d1050 2024-04-04T06:57:52.801 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:52.797+0000 7f25c7e00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f25d00d4070 0x7f25d015f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:52.801 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:52.797+0000 7f25c7e00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f25d00d4070 0x7f25d015f190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:38824/0 (socket says 172.21.15.72:38824) 2024-04-04T06:57:52.801 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:52.797+0000 7f25c7e00640 1 -- 172.21.15.72:0/1487557147 learned_addr learned my addr 172.21.15.72:0/1487557147 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:57:52.801 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:52.797+0000 7f25d5400640 1 --2- 172.21.15.72:0/1487557147 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f25d015e1d0 0x7f25d015f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:52.801 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:52.797+0000 7f25d4a00640 1 --2- 172.21.15.72:0/1487557147 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f25d00d1050 0x7f25d0153650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:52.801 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:52.798+0000 7f25c7e00640 1 -- 172.21.15.72:0/1487557147 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f25d00d1050 msgr2=0x7f25d0153650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:52.801 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:52.798+0000 7f25c7e00640 1 --2- 172.21.15.72:0/1487557147 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f25d00d1050 0x7f25d0153650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:52.801 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:52.798+0000 7f25c7e00640 1 -- 172.21.15.72:0/1487557147 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f25d015e1d0 msgr2=0x7f25d015f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:52.801 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:52.798+0000 7f25c7e00640 1 --2- 172.21.15.72:0/1487557147 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f25d015e1d0 0x7f25d015f6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:52.801 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:52.798+0000 7f25c7e00640 1 -- 172.21.15.72:0/1487557147 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25d01608f0 con 0x7f25d00d4070 2024-04-04T06:57:52.801 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:52.798+0000 7f25d5400640 1 --2- 172.21.15.72:0/1487557147 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f25d015e1d0 0x7f25d015f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-04T06:57:52.801 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:52.798+0000 7f25d4a00640 1 --2- 172.21.15.72:0/1487557147 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f25d00d1050 0x7f25d0153650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-04T06:57:52.801 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:52.798+0000 7f25c7e00640 1 --2- 172.21.15.72:0/1487557147 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f25d00d4070 0x7f25d015f190 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f25b800c820 tx=0x7f25b800cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:52.801 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:52.798+0000 7f25cd600640 1 -- 172.21.15.72:0/1487557147 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25b8015070 con 0x7f25d00d4070 2024-04-04T06:57:52.802 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:52.798+0000 7f25cd600640 1 -- 172.21.15.72:0/1487557147 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25b80079d0 con 0x7f25d00d4070 2024-04-04T06:57:52.802 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:52.798+0000 7f25cd600640 1 -- 172.21.15.72:0/1487557147 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25b8007da0 con 0x7f25d00d4070 2024-04-04T06:57:52.802 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:52.798+0000 7f25d5e00640 1 -- 172.21.15.72:0/1487557147 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25d00b8e70 con 0x7f25d00d4070 2024-04-04T06:57:52.802 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:52.798+0000 7f25d5e00640 1 -- 172.21.15.72:0/1487557147 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25d015ffc0 con 0x7f25d00d4070 2024-04-04T06:57:52.802 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:52.799+0000 7f25d5e00640 1 -- 172.21.15.72:0/1487557147 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f25d00756c0 con 0x7f25d00d4070 2024-04-04T06:57:52.803 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:52.800+0000 7f25cd600640 1 -- 172.21.15.72:0/1487557147 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f25b8018070 con 0x7f25d00d4070 2024-04-04T06:57:52.803 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:52.802+0000 7f25cd600640 1 --2- 172.21.15.72:0/1487557147 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f25ac06c8f0 0x7f25ac06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:52.803 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:52.802+0000 7f25cd600640 1 -- 172.21.15.72:0/1487557147 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f25b808bb10 con 0x7f25d00d4070 2024-04-04T06:57:52.803 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:52.802+0000 7f25d4a00640 1 --2- 172.21.15.72:0/1487557147 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f25ac06c8f0 0x7f25ac06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:52.803 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:52.803+0000 7f25d4a00640 1 --2- 172.21.15.72:0/1487557147 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f25ac06c8f0 0x7f25ac06edb0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f25c0036000 tx=0x7f25c0008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:52.804 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:52.806+0000 7f25cd600640 1 -- 172.21.15.72:0/1487557147 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f25b8059ea0 con 0x7f25d00d4070 2024-04-04T06:57:53.162 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:53.164+0000 7f25d5e00640 1 -- 172.21.15.72:0/1487557147 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f25d00cb800 con 0x7f25d00d4070 2024-04-04T06:57:53.499 INFO:tasks.ceph.mds.a.smithi072.stderr:2024-04-04T06:57:53.500+0000 7fa390800640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-04T06:57:53.566 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:53.567+0000 7f25cd600640 1 -- 172.21.15.72:0/1487557147 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v17) ==== 122+0+0 (secure 0 0 0) 0x7f25b80597a0 con 0x7f25d00d4070 2024-04-04T06:57:53.570 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:53.571+0000 7f25d5e00640 1 -- 172.21.15.72:0/1487557147 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f25ac06c8f0 msgr2=0x7f25ac06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:53.570 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:53.571+0000 7f25d5e00640 1 --2- 172.21.15.72:0/1487557147 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f25ac06c8f0 0x7f25ac06edb0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f25c0036000 tx=0x7f25c0008030 comp rx=0 tx=0).stop 2024-04-04T06:57:53.570 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:53.571+0000 7f25d5e00640 1 -- 172.21.15.72:0/1487557147 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f25d00d4070 msgr2=0x7f25d015f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:53.570 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:53.571+0000 7f25d5e00640 1 --2- 172.21.15.72:0/1487557147 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f25d00d4070 0x7f25d015f190 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f25b800c820 tx=0x7f25b800cc20 comp rx=0 tx=0).stop 2024-04-04T06:57:53.570 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:53.571+0000 7f25d5e00640 1 -- 172.21.15.72:0/1487557147 shutdown_connections 2024-04-04T06:57:53.570 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:53.571+0000 7f25d5e00640 1 --2- 172.21.15.72:0/1487557147 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f25ac06c8f0 0x7f25ac06edb0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:53.570 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:53.571+0000 7f25d5e00640 1 --2- 172.21.15.72:0/1487557147 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f25d015e1d0 0x7f25d015f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:53.570 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:53.571+0000 7f25d5e00640 1 --2- 172.21.15.72:0/1487557147 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f25d00d4070 0x7f25d015f190 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:53.571 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:53.571+0000 7f25d5e00640 1 --2- 172.21.15.72:0/1487557147 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f25d00d1050 0x7f25d0153650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:53.571 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:53.571+0000 7f25d5e00640 1 -- 172.21.15.72:0/1487557147 >> 172.21.15.72:0/1487557147 conn(0x7f25d006b8c0 msgr2=0x7f25d006bca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:53.571 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:53.572+0000 7f25d5e00640 1 -- 172.21.15.72:0/1487557147 shutdown_connections 2024-04-04T06:57:53.571 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:53.572+0000 7f25d5e00640 1 -- 172.21.15.72:0/1487557147 wait complete. 2024-04-04T06:57:53.592 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-04T06:57:53.593 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-04T06:57:53.796 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:53.797+0000 7fa253e00640 1 Processor -- start 2024-04-04T06:57:53.796 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:53.797+0000 7fa253e00640 1 -- start start 2024-04-04T06:57:53.798 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:53.799+0000 7fa253e00640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa24c0cfc90 0x7fa24c06b470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:53.798 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:53.799+0000 7fa253e00640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa24c0d1f00 con 0x7fa24c0b3ba0 2024-04-04T06:57:53.798 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:53.799+0000 7fa253e00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa24c0d04e0 con 0x7fa24c15f870 2024-04-04T06:57:53.798 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:53.799+0000 7fa253e00640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7fa24c1590f0 con 0x7fa24c0cfc90 2024-04-04T06:57:53.798 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:53.799+0000 7fa251400640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fa24c0b3ba0 0x7fa24c0d29a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:37798/0 (socket says 172.21.15.72:37798) 2024-04-04T06:57:53.799 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:53.799+0000 7fa251400640 1 -- 172.21.15.72:0/3752531289 learned_addr learned my addr 172.21.15.72:0/3752531289 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-04-04T06:57:53.799 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:53.799+0000 7fa251e00640 1 --2- 172.21.15.72:0/3752531289 >> v2:172.21.15.72:3300/0 conn(0x7fa24c0cfc90 0x7fa24c06b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:53.801 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:53.800+0000 7fa24be00640 1 -- 172.21.15.72:0/3752531289 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 338718687 0 0) 0x7fa24c0d1f00 con 0x7fa24c0b3ba0 2024-04-04T06:57:53.802 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:53.800+0000 7fa251e00640 1 -- 172.21.15.72:0/3752531289 >> v1:172.21.15.117:6789/0 conn(0x7fa24c15f870 legacy=0x7fa24c0b3f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:57:53.802 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:53.800+0000 7fa251e00640 1 -- 172.21.15.72:0/3752531289 >> v1:172.21.15.72:6789/0 conn(0x7fa24c0b3ba0 legacy=0x7fa24c0d29a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:53.802 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:53.800+0000 7fa251e00640 1 -- 172.21.15.72:0/3752531289 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa24c0d21a0 con 0x7fa24c0cfc90 2024-04-04T06:57:53.802 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:53.801+0000 7fa251e00640 1 --2- 172.21.15.72:0/3752531289 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa24c0cfc90 0x7fa24c06b470 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fa244009d90 tx=0x7fa24402bd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84f93788f7777c8b server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:53.802 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:53.801+0000 7fa24be00640 1 -- 172.21.15.72:0/3752531289 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa244039070 con 0x7fa24c0cfc90 2024-04-04T06:57:53.803 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:53.801+0000 7fa24be00640 1 -- 172.21.15.72:0/3752531289 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa24402cb40 con 0x7fa24c0cfc90 2024-04-04T06:57:53.803 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:53.801+0000 7fa24be00640 1 -- 172.21.15.72:0/3752531289 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa244034440 con 0x7fa24c0cfc90 2024-04-04T06:57:53.803 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:53.802+0000 7fa253e00640 1 -- 172.21.15.72:0/3752531289 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa24c0cfc90 msgr2=0x7fa24c06b470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:53.803 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:53.802+0000 7fa253e00640 1 --2- 172.21.15.72:0/3752531289 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa24c0cfc90 0x7fa24c06b470 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fa244009d90 tx=0x7fa24402bd90 comp rx=0 tx=0).stop 2024-04-04T06:57:53.803 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:53.802+0000 7fa253e00640 1 -- 172.21.15.72:0/3752531289 shutdown_connections 2024-04-04T06:57:53.803 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:53.802+0000 7fa253e00640 1 --2- 172.21.15.72:0/3752531289 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa24c0cfc90 0x7fa24c06b470 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:53.804 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:53.802+0000 7fa253e00640 1 -- 172.21.15.72:0/3752531289 >> 172.21.15.72:0/3752531289 conn(0x7fa24c06d680 msgr2=0x7fa24c06da60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:53.804 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:53.802+0000 7fa253e00640 1 -- 172.21.15.72:0/3752531289 shutdown_connections 2024-04-04T06:57:53.804 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:53.802+0000 7fa253e00640 1 -- 172.21.15.72:0/3752531289 wait complete. 2024-04-04T06:57:53.805 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:53.805+0000 7fa253e00640 1 Processor -- start 2024-04-04T06:57:53.805 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:53.805+0000 7fa253e00640 1 -- start start 2024-04-04T06:57:53.807 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:53.807+0000 7fa253e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa24c0b3ba0 0x7fa24c15a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:53.808 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:53.807+0000 7fa253e00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa24c0cfc90 0x7fa24c1494d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:53.808 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:53.807+0000 7fa253e00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa24c15f870 0x7fa24c15bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:53.808 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:53.807+0000 7fa253e00640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fa24c0d0940 con 0x7fa24c0cfc90 2024-04-04T06:57:53.808 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:53.807+0000 7fa253e00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fa24c0d07c0 con 0x7fa24c15f870 2024-04-04T06:57:53.808 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:53.807+0000 7fa253e00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fa24c0d00c0 con 0x7fa24c0b3ba0 2024-04-04T06:57:53.808 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:53.807+0000 7fa250a00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa24c0cfc90 0x7fa24c1494d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:53.809 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:53.807+0000 7fa250a00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa24c0cfc90 0x7fa24c1494d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:38836/0 (socket says 172.21.15.72:38836) 2024-04-04T06:57:53.809 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:53.807+0000 7fa250a00640 1 -- 172.21.15.72:0/1298206444 learned_addr learned my addr 172.21.15.72:0/1298206444 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:57:53.809 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:53.807+0000 7fa251400640 1 --2- 172.21.15.72:0/1298206444 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa24c0b3ba0 0x7fa24c15a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:53.809 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:53.807+0000 7fa251e00640 1 --2- 172.21.15.72:0/1298206444 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa24c15f870 0x7fa24c15bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:53.809 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:53.808+0000 7fa250a00640 1 -- 172.21.15.72:0/1298206444 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa24c0b3ba0 msgr2=0x7fa24c15a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:53.809 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:53.808+0000 7fa250a00640 1 --2- 172.21.15.72:0/1298206444 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa24c0b3ba0 0x7fa24c15a720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:53.809 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:53.808+0000 7fa250a00640 1 -- 172.21.15.72:0/1298206444 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa24c15f870 msgr2=0x7fa24c15bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:53.809 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:53.808+0000 7fa250a00640 1 --2- 172.21.15.72:0/1298206444 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa24c15f870 0x7fa24c15bf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:53.809 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:53.808+0000 7fa250a00640 1 -- 172.21.15.72:0/1298206444 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa24c1544f0 con 0x7fa24c0cfc90 2024-04-04T06:57:53.809 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:53.808+0000 7fa251e00640 1 --2- 172.21.15.72:0/1298206444 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa24c15f870 0x7fa24c15bf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-04T06:57:53.809 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:53.808+0000 7fa250a00640 1 --2- 172.21.15.72:0/1298206444 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa24c0cfc90 0x7fa24c1494d0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fa23800c460 tx=0x7fa23800c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:53.809 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:53.808+0000 7fa249600640 1 -- 172.21.15.72:0/1298206444 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa238011790 con 0x7fa24c0cfc90 2024-04-04T06:57:53.810 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:53.808+0000 7fa249600640 1 -- 172.21.15.72:0/1298206444 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa238017070 con 0x7fa24c0cfc90 2024-04-04T06:57:53.810 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:53.808+0000 7fa249600640 1 -- 172.21.15.72:0/1298206444 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa238011bb0 con 0x7fa24c0cfc90 2024-04-04T06:57:53.810 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:53.808+0000 7fa253e00640 1 -- 172.21.15.72:0/1298206444 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa24c1547d0 con 0x7fa24c0cfc90 2024-04-04T06:57:53.810 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:53.808+0000 7fa253e00640 1 -- 172.21.15.72:0/1298206444 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa24c155200 con 0x7fa24c0cfc90 2024-04-04T06:57:53.811 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:53.810+0000 7fa253e00640 1 -- 172.21.15.72:0/1298206444 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa24c075840 con 0x7fa24c0cfc90 2024-04-04T06:57:53.811 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:53.810+0000 7fa249600640 1 -- 172.21.15.72:0/1298206444 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa23801c460 con 0x7fa24c0cfc90 2024-04-04T06:57:53.811 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:53.811+0000 7fa249600640 1 --2- 172.21.15.72:0/1298206444 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fa22c06c8f0 0x7fa22c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:53.811 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:53.811+0000 7fa249600640 1 -- 172.21.15.72:0/1298206444 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7fa23808bae0 con 0x7fa24c0cfc90 2024-04-04T06:57:53.811 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:53.812+0000 7fa251400640 1 --2- 172.21.15.72:0/1298206444 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fa22c06c8f0 0x7fa22c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:53.811 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:53.812+0000 7fa251400640 1 --2- 172.21.15.72:0/1298206444 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fa22c06c8f0 0x7fa22c06edb0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fa240000f60 tx=0x7fa240007c00 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:53.815 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:53.816+0000 7fa249600640 1 -- 172.21.15.72:0/1298206444 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fa238059de0 con 0x7fa24c0cfc90 2024-04-04T06:57:54.103 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:54.104+0000 7fa253e00640 1 -- 172.21.15.72:0/1298206444 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa24c0b8040 con 0x7fa24c0cfc90 2024-04-04T06:57:54.104 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:54.105+0000 7fa249600640 1 -- 172.21.15.72:0/1298206444 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+5184 (secure 0 0 0) 0x7fa2380596e0 con 0x7fa24c0cfc90 2024-04-04T06:57:54.104 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T06:57:54.104 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4619,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/2380537280","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6833","nonce":2380537280},{"type":"v1","addr":"172.21.15.117:6835","nonce":2380537280}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4840,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6834/108808341","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":108808341},{"type":"v1","addr":"172.21.15.117:6834","nonce":108808341}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":5253,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6836/3494332623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":3494332623},{"type":"v1","addr":"172.21.15.72:6836","nonce":3494332623}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-04T06:57:50.020152+0000","modified":"2024-04-04T06:57:53.165429+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5256},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5256":{"gid":5256,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.72:6837/2509618069","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6835","nonce":2509618069},{"type":"v1","addr":"172.21.15.72:6837","nonce":2509618069}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5256,"qdb_cluster":[5256]},"id":2}]} 2024-04-04T06:57:54.105 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 17 2024-04-04T06:57:54.107 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:54.107+0000 7fa253e00640 1 -- 172.21.15.72:0/1298206444 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fa22c06c8f0 msgr2=0x7fa22c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:54.107 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:54.107+0000 7fa253e00640 1 --2- 172.21.15.72:0/1298206444 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fa22c06c8f0 0x7fa22c06edb0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fa240000f60 tx=0x7fa240007c00 comp rx=0 tx=0).stop 2024-04-04T06:57:54.107 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:54.107+0000 7fa253e00640 1 -- 172.21.15.72:0/1298206444 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa24c0cfc90 msgr2=0x7fa24c1494d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:54.107 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:54.107+0000 7fa253e00640 1 --2- 172.21.15.72:0/1298206444 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa24c0cfc90 0x7fa24c1494d0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fa23800c460 tx=0x7fa23800c920 comp rx=0 tx=0).stop 2024-04-04T06:57:54.107 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:54.107+0000 7fa253e00640 1 -- 172.21.15.72:0/1298206444 shutdown_connections 2024-04-04T06:57:54.108 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:54.107+0000 7fa253e00640 1 --2- 172.21.15.72:0/1298206444 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fa22c06c8f0 0x7fa22c06edb0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:54.108 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:54.107+0000 7fa253e00640 1 --2- 172.21.15.72:0/1298206444 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa24c15f870 0x7fa24c15bf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:54.108 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:54.107+0000 7fa253e00640 1 --2- 172.21.15.72:0/1298206444 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa24c0cfc90 0x7fa24c1494d0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:54.108 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:54.107+0000 7fa253e00640 1 --2- 172.21.15.72:0/1298206444 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa24c0b3ba0 0x7fa24c15a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:54.108 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:54.107+0000 7fa253e00640 1 -- 172.21.15.72:0/1298206444 >> 172.21.15.72:0/1298206444 conn(0x7fa24c06d680 msgr2=0x7fa24c1618f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:54.108 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:54.107+0000 7fa253e00640 1 -- 172.21.15.72:0/1298206444 shutdown_connections 2024-04-04T06:57:54.108 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:54.108+0000 7fa253e00640 1 -- 172.21.15.72:0/1298206444 wait complete. 2024-04-04T06:57:54.124 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-04T06:57:54.329 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:54.330+0000 7f0075800640 1 Processor -- start 2024-04-04T06:57:54.329 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:54.330+0000 7f0075800640 1 -- start start 2024-04-04T06:57:54.330 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:54.331+0000 7f0075800640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0070071610 0x7f00700c5e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:54.330 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:54.331+0000 7f0075800640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f00700ccb20 0x7f00700ccf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:54.331 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:54.331+0000 7f0075800640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f00700c6710 con 0x7f007015c2d0 2024-04-04T06:57:54.331 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:54.331+0000 7f0075800640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f00700cd4d0 con 0x7f0070071610 2024-04-04T06:57:54.331 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:54.331+0000 7f0075800640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f00700c6fb0 con 0x7f00700ccb20 2024-04-04T06:57:54.331 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:54.332+0000 7f0067e00640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0070071610 0x7f00700c5e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:54.331 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:54.332+0000 7f006ea00640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f007015c2d0 0x7f007015c6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:37800/0 (socket says 172.21.15.72:37800) 2024-04-04T06:57:54.331 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:54.332+0000 7f006ea00640 1 -- 172.21.15.72:0/3533216491 learned_addr learned my addr 172.21.15.72:0/3533216491 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-04-04T06:57:54.332 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:54.332+0000 7f006e000640 1 -- 172.21.15.72:0/3533216491 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2165284851 0 0) 0x7f00700c6710 con 0x7f007015c2d0 2024-04-04T06:57:54.332 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:54.332+0000 7f006e000640 1 -- 172.21.15.72:0/3533216491 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0054003520 con 0x7f007015c2d0 2024-04-04T06:57:54.332 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:54.332+0000 7f0067e00640 1 -- 172.21.15.72:0/3533216491 >> v2:172.21.15.117:3300/0 conn(0x7f00700ccb20 msgr2=0x7f00700ccf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:57:54.332 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:54.332+0000 7f0067e00640 1 --2- 172.21.15.72:0/3533216491 >> v2:172.21.15.117:3300/0 conn(0x7f00700ccb20 0x7f00700ccf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:54.332 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:54.332+0000 7f0067e00640 1 -- 172.21.15.72:0/3533216491 >> v1:172.21.15.72:6789/0 conn(0x7f007015c2d0 legacy=0x7f007015c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:54.332 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:54.332+0000 7f0067e00640 1 -- 172.21.15.72:0/3533216491 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00700c69f0 con 0x7f0070071610 2024-04-04T06:57:54.333 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:54.335+0000 7f0067e00640 1 --2- 172.21.15.72:0/3533216491 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0070071610 0x7f00700c5e50 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f00700afca0 tx=0x7f005802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55f129ffc03582c1 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:54.335 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:54.335+0000 7f006e000640 1 -- 172.21.15.72:0/3533216491 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00580315a0 con 0x7f0070071610 2024-04-04T06:57:54.335 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:54.335+0000 7f006e000640 1 -- 172.21.15.72:0/3533216491 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0058037070 con 0x7f0070071610 2024-04-04T06:57:54.335 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:54.335+0000 7f006e000640 1 -- 172.21.15.72:0/3533216491 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0058031960 con 0x7f0070071610 2024-04-04T06:57:54.335 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:54.336+0000 7f0075800640 1 -- 172.21.15.72:0/3533216491 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0070071610 msgr2=0x7f00700c5e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:54.335 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:54.336+0000 7f0075800640 1 --2- 172.21.15.72:0/3533216491 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0070071610 0x7f00700c5e50 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f00700afca0 tx=0x7f005802b840 comp rx=0 tx=0).stop 2024-04-04T06:57:54.335 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:54.336+0000 7f0075800640 1 -- 172.21.15.72:0/3533216491 shutdown_connections 2024-04-04T06:57:54.335 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:54.336+0000 7f0075800640 1 --2- 172.21.15.72:0/3533216491 >> v2:172.21.15.117:3300/0 conn(0x7f00700ccb20 0x7f00700ccf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:54.335 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:54.336+0000 7f0075800640 1 --2- 172.21.15.72:0/3533216491 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0070071610 0x7f00700c5e50 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:54.335 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:54.336+0000 7f0075800640 1 -- 172.21.15.72:0/3533216491 >> 172.21.15.72:0/3533216491 conn(0x7f007006b470 msgr2=0x7f007006b880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:54.335 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:54.336+0000 7f0075800640 1 -- 172.21.15.72:0/3533216491 shutdown_connections 2024-04-04T06:57:54.336 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:54.336+0000 7f0075800640 1 -- 172.21.15.72:0/3533216491 wait complete. 2024-04-04T06:57:54.337 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:54.339+0000 7f0075800640 1 Processor -- start 2024-04-04T06:57:54.337 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:54.339+0000 7f0075800640 1 -- start start 2024-04-04T06:57:54.341 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:54.340+0000 7f0075800640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0070071610 0x7f00701ef060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:54.341 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:54.340+0000 7f0075800640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f00700ccb20 0x7f007015a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:54.341 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:54.340+0000 7f0075800640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f007015c2d0 0x7f00701f2be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:54.341 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:54.340+0000 7f0075800640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f00700b3ea0 con 0x7f007015c2d0 2024-04-04T06:57:54.341 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:54.340+0000 7f0075800640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f00700c6390 con 0x7f00700ccb20 2024-04-04T06:57:54.341 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:54.340+0000 7f0075800640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f00700b4020 con 0x7f0070071610 2024-04-04T06:57:54.341 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:54.341+0000 7f006f400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f007015c2d0 0x7f00701f2be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:54.341 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:54.341+0000 7f006f400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f007015c2d0 0x7f00701f2be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:38852/0 (socket says 172.21.15.72:38852) 2024-04-04T06:57:54.341 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:54.341+0000 7f006f400640 1 -- 172.21.15.72:0/1621782182 learned_addr learned my addr 172.21.15.72:0/1621782182 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:57:54.341 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:54.341+0000 7f006ea00640 1 --2- 172.21.15.72:0/1621782182 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0070071610 0x7f00701ef060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:54.341 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:54.341+0000 7f0067e00640 1 --2- 172.21.15.72:0/1621782182 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f00700ccb20 0x7f007015a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:54.341 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:54.341+0000 7f006f400640 1 -- 172.21.15.72:0/1621782182 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0070071610 msgr2=0x7f00701ef060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:54.341 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:54.341+0000 7f006f400640 1 --2- 172.21.15.72:0/1621782182 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0070071610 0x7f00701ef060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:54.342 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:54.341+0000 7f006f400640 1 -- 172.21.15.72:0/1621782182 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f00700ccb20 msgr2=0x7f007015a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:54.342 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:54.341+0000 7f006f400640 1 --2- 172.21.15.72:0/1621782182 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f00700ccb20 0x7f007015a800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:54.342 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:54.341+0000 7f006f400640 1 -- 172.21.15.72:0/1621782182 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00700ad620 con 0x7f007015c2d0 2024-04-04T06:57:54.342 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:54.341+0000 7f0067e00640 1 --2- 172.21.15.72:0/1621782182 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f00700ccb20 0x7f007015a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-04T06:57:54.342 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:54.342+0000 7f006f400640 1 --2- 172.21.15.72:0/1621782182 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f007015c2d0 0x7f00701f2be0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f006800b970 tx=0x7f006800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:54.342 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:54.342+0000 7f0066a00640 1 -- 172.21.15.72:0/1621782182 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0068019070 con 0x7f007015c2d0 2024-04-04T06:57:54.342 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:54.342+0000 7f0066a00640 1 -- 172.21.15.72:0/1621782182 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f006800cb60 con 0x7f007015c2d0 2024-04-04T06:57:54.342 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:54.342+0000 7f0075800640 1 -- 172.21.15.72:0/1621782182 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00700ad900 con 0x7f007015c2d0 2024-04-04T06:57:54.342 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:54.342+0000 7f0066a00640 1 -- 172.21.15.72:0/1621782182 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0068014440 con 0x7f007015c2d0 2024-04-04T06:57:54.342 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:54.342+0000 7f0075800640 1 -- 172.21.15.72:0/1621782182 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00700adec0 con 0x7f007015c2d0 2024-04-04T06:57:54.343 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:54.343+0000 7f0075800640 1 -- 172.21.15.72:0/1621782182 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0070075840 con 0x7f007015c2d0 2024-04-04T06:57:54.343 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:54.344+0000 7f0066a00640 1 -- 172.21.15.72:0/1621782182 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f006801c070 con 0x7f007015c2d0 2024-04-04T06:57:54.344 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:54.345+0000 7f0066a00640 1 --2- 172.21.15.72:0/1621782182 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f004c06c920 0x7f004c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:54.344 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:54.345+0000 7f0066a00640 1 -- 172.21.15.72:0/1621782182 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f006808b7f0 con 0x7f007015c2d0 2024-04-04T06:57:54.344 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:54.345+0000 7f006ea00640 1 --2- 172.21.15.72:0/1621782182 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f004c06c920 0x7f004c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:54.345 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:54.346+0000 7f006ea00640 1 --2- 172.21.15.72:0/1621782182 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f004c06c920 0x7f004c06ede0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f0060007fd0 tx=0x7f0060009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:54.349 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:54.350+0000 7f0066a00640 1 -- 172.21.15.72:0/1621782182 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f0068059cb0 con 0x7f007015c2d0 2024-04-04T06:57:54.547 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:54.548+0000 7f0075800640 1 -- 172.21.15.72:0/1621782182 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f00700ce760 con 0x7f007015c2d0 2024-04-04T06:57:54.548 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:54.550+0000 7f0066a00640 1 -- 172.21.15.72:0/1621782182 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) ==== 74+0+16645 (secure 0 0 0) 0x7f00680595b0 con 0x7f007015c2d0 2024-04-04T06:57:54.549 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T06:57:54.550 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":33,"fsid":"6708bac2-4f50-49b5-87a9-c390fd333eb3","created":"2024-04-04T06:56:04.282498+0000","modified":"2024-04-04T06:57:51.552734+0000","last_up_change":"2024-04-04T06:56:16.716089+0000","last_in_change":"2024-04-04T06:56:07.768593+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-04T06:56:17.421685+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-04-04T06:57:47.865021+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-04-04T06:57:48.981181+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7c345991-5af8-4dc6-a481-28610c40e128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":3889813953},{"type":"v1","addr":"172.21.15.72:6818","nonce":3889813953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":3889813953},{"type":"v1","addr":"172.21.15.72:6821","nonce":3889813953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":3889813953},{"type":"v1","addr":"172.21.15.72:6826","nonce":3889813953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":3889813953},{"type":"v1","addr":"172.21.15.72:6823","nonce":3889813953}]},"public_addr":"172.21.15.72:6818/3889813953","cluster_addr":"172.21.15.72:6821/3889813953","heartbeat_back_addr":"172.21.15.72:6826/3889813953","heartbeat_front_addr":"172.21.15.72:6823/3889813953","state":["exists","up"]},{"osd":1,"uuid":"1b3f7ab2-a56c-488d-a89a-1f3572361c95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":3101663154},{"type":"v1","addr":"172.21.15.72:6801","nonce":3101663154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":3101663154},{"type":"v1","addr":"172.21.15.72:6803","nonce":3101663154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":3101663154},{"type":"v1","addr":"172.21.15.72:6807","nonce":3101663154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":3101663154},{"type":"v1","addr":"172.21.15.72:6805","nonce":3101663154}]},"public_addr":"172.21.15.72:6801/3101663154","cluster_addr":"172.21.15.72:6803/3101663154","heartbeat_back_addr":"172.21.15.72:6807/3101663154","heartbeat_front_addr":"172.21.15.72:6805/3101663154","state":["exists","up"]},{"osd":2,"uuid":"fc9aa512-53df-40d7-ba04-3e6b7dcd1e34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":235374192},{"type":"v1","addr":"172.21.15.72:6809","nonce":235374192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":235374192},{"type":"v1","addr":"172.21.15.72:6811","nonce":235374192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":235374192},{"type":"v1","addr":"172.21.15.72:6815","nonce":235374192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":235374192},{"type":"v1","addr":"172.21.15.72:6813","nonce":235374192}]},"public_addr":"172.21.15.72:6809/235374192","cluster_addr":"172.21.15.72:6811/235374192","heartbeat_back_addr":"172.21.15.72:6815/235374192","heartbeat_front_addr":"172.21.15.72:6813/235374192","state":["exists","up"]},{"osd":3,"uuid":"b4f63eed-dc5b-4aba-bb50-de46eb41492b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6817","nonce":2806631742},{"type":"v1","addr":"172.21.15.72:6819","nonce":2806631742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":2806631742},{"type":"v1","addr":"172.21.15.72:6827","nonce":2806631742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":2806631742},{"type":"v1","addr":"172.21.15.72:6831","nonce":2806631742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":2806631742},{"type":"v1","addr":"172.21.15.72:6829","nonce":2806631742}]},"public_addr":"172.21.15.72:6819/2806631742","cluster_addr":"172.21.15.72:6827/2806631742","heartbeat_back_addr":"172.21.15.72:6831/2806631742","heartbeat_front_addr":"172.21.15.72:6829/2806631742","state":["exists","up"]},{"osd":4,"uuid":"9e985ef8-d711-4172-9286-c54e560895d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":4293536423},{"type":"v1","addr":"172.21.15.117:6825","nonce":4293536423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":4293536423},{"type":"v1","addr":"172.21.15.117:6827","nonce":4293536423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":4293536423},{"type":"v1","addr":"172.21.15.117:6831","nonce":4293536423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":4293536423},{"type":"v1","addr":"172.21.15.117:6829","nonce":4293536423}]},"public_addr":"172.21.15.117:6825/4293536423","cluster_addr":"172.21.15.117:6827/4293536423","heartbeat_back_addr":"172.21.15.117:6831/4293536423","heartbeat_front_addr":"172.21.15.117:6829/4293536423","state":["exists","up"]},{"osd":5,"uuid":"3e9f082b-8d7d-455f-8a96-66d0b4857125","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":684971679},{"type":"v1","addr":"172.21.15.117:6801","nonce":684971679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":684971679},{"type":"v1","addr":"172.21.15.117:6803","nonce":684971679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":684971679},{"type":"v1","addr":"172.21.15.117:6807","nonce":684971679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":684971679},{"type":"v1","addr":"172.21.15.117:6805","nonce":684971679}]},"public_addr":"172.21.15.117:6801/684971679","cluster_addr":"172.21.15.117:6803/684971679","heartbeat_back_addr":"172.21.15.117:6807/684971679","heartbeat_front_addr":"172.21.15.117:6805/684971679","state":["exists","up"]},{"osd":6,"uuid":"bcdafa9f-a870-4398-a38d-ab7697676473","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":2781186528},{"type":"v1","addr":"172.21.15.117:6809","nonce":2781186528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":2781186528},{"type":"v1","addr":"172.21.15.117:6811","nonce":2781186528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":2781186528},{"type":"v1","addr":"172.21.15.117:6815","nonce":2781186528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":2781186528},{"type":"v1","addr":"172.21.15.117:6813","nonce":2781186528}]},"public_addr":"172.21.15.117:6809/2781186528","cluster_addr":"172.21.15.117:6811/2781186528","heartbeat_back_addr":"172.21.15.117:6815/2781186528","heartbeat_front_addr":"172.21.15.117:6813/2781186528","state":["exists","up"]},{"osd":7,"uuid":"b68ec562-ff35-4d2d-a733-c896f8920cfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":617469882},{"type":"v1","addr":"172.21.15.117:6817","nonce":617469882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":617469882},{"type":"v1","addr":"172.21.15.117:6819","nonce":617469882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":617469882},{"type":"v1","addr":"172.21.15.117:6823","nonce":617469882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":617469882},{"type":"v1","addr":"172.21.15.117:6821","nonce":617469882}]},"public_addr":"172.21.15.117:6817/617469882","cluster_addr":"172.21.15.117:6819/617469882","heartbeat_back_addr":"172.21.15.117:6823/617469882","heartbeat_front_addr":"172.21.15.117:6821/617469882","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.347700+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.296619+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.361345+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.093323+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:12.857605+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:12.816090+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.083163+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.121639+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-04T06:57:54.551 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:54.552+0000 7f0075800640 1 -- 172.21.15.72:0/1621782182 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f004c06c920 msgr2=0x7f004c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:54.551 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:54.552+0000 7f0075800640 1 --2- 172.21.15.72:0/1621782182 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f004c06c920 0x7f004c06ede0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f0060007fd0 tx=0x7f0060009040 comp rx=0 tx=0).stop 2024-04-04T06:57:54.551 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:54.552+0000 7f0075800640 1 -- 172.21.15.72:0/1621782182 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f007015c2d0 msgr2=0x7f00701f2be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:54.551 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:54.552+0000 7f0075800640 1 --2- 172.21.15.72:0/1621782182 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f007015c2d0 0x7f00701f2be0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f006800b970 tx=0x7f006800be30 comp rx=0 tx=0).stop 2024-04-04T06:57:54.551 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:54.552+0000 7f0075800640 1 -- 172.21.15.72:0/1621782182 shutdown_connections 2024-04-04T06:57:54.552 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:54.552+0000 7f0075800640 1 --2- 172.21.15.72:0/1621782182 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f004c06c920 0x7f004c06ede0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:54.552 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:54.552+0000 7f0075800640 1 --2- 172.21.15.72:0/1621782182 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f007015c2d0 0x7f00701f2be0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:54.552 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:54.552+0000 7f0075800640 1 --2- 172.21.15.72:0/1621782182 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f00700ccb20 0x7f007015a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:54.552 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:54.552+0000 7f0075800640 1 --2- 172.21.15.72:0/1621782182 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0070071610 0x7f00701ef060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:54.552 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:54.552+0000 7f0075800640 1 -- 172.21.15.72:0/1621782182 >> 172.21.15.72:0/1621782182 conn(0x7f007006b470 msgr2=0x7f0070071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:54.552 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:54.553+0000 7f0075800640 1 -- 172.21.15.72:0/1621782182 shutdown_connections 2024-04-04T06:57:54.552 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:54.553+0000 7f0075800640 1 -- 172.21.15.72:0/1621782182 wait complete. 2024-04-04T06:57:54.570 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-04T06:57:54.570 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-04T06:57:54.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:54.765+0000 7f243da00640 1 Processor -- start 2024-04-04T06:57:54.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:54.765+0000 7f243da00640 1 -- start start 2024-04-04T06:57:54.766 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:54.766+0000 7f243da00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f243815e6d0 0x7f243806c580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:54.766 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:54.767+0000 7f243da00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f24380d1510 0x7f243806cac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:54.766 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:54.767+0000 7f243da00640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f24380d1bf0 0x7f2438070f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:54.766 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:54.767+0000 7f243da00640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f24380cfcc0 con 0x7f24380d1bf0 2024-04-04T06:57:54.766 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:54.767+0000 7f243da00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f24380b4930 con 0x7f24380d1510 2024-04-04T06:57:54.766 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:54.767+0000 7f243da00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f24380cff10 con 0x7f243815e6d0 2024-04-04T06:57:54.766 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:54.767+0000 7f2437400640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f24380d1bf0 0x7f2438070f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:54.766 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:54.767+0000 7f2437400640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f24380d1bf0 0x7f2438070f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:38868/0 (socket says 172.21.15.72:38868) 2024-04-04T06:57:54.766 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:54.767+0000 7f2437400640 1 -- 172.21.15.72:0/3695323062 learned_addr learned my addr 172.21.15.72:0/3695323062 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:57:54.767 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:54.767+0000 7f2437400640 1 -- 172.21.15.72:0/3695323062 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f243815e6d0 msgr2=0x7f243806c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:57:54.767 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:54.767+0000 7f2437400640 1 --2- 172.21.15.72:0/3695323062 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f243815e6d0 0x7f243806c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:54.768 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:54.767+0000 7f2437400640 1 -- 172.21.15.72:0/3695323062 >> v2:172.21.15.117:3300/0 conn(0x7f24380d1510 msgr2=0x7f243806cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:57:54.768 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:54.767+0000 7f2437400640 1 --2- 172.21.15.72:0/3695323062 >> v2:172.21.15.117:3300/0 conn(0x7f24380d1510 0x7f243806cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:54.768 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:54.767+0000 7f2437400640 1 -- 172.21.15.72:0/3695323062 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24380d01f0 con 0x7f24380d1bf0 2024-04-04T06:57:54.768 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:54.768+0000 7f2437400640 1 --2- 172.21.15.72:0/3695323062 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f24380d1bf0 0x7f2438070f50 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f243806f030 tx=0x7f243002bdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5abeb35fd0eb5d6e server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:54.768 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:54.769+0000 7f2436000640 1 -- 172.21.15.72:0/3695323062 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f243002c950 con 0x7f24380d1bf0 2024-04-04T06:57:54.769 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:54.769+0000 7f2436000640 1 -- 172.21.15.72:0/3695323062 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f243002caf0 con 0x7f24380d1bf0 2024-04-04T06:57:54.769 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:54.769+0000 7f2436000640 1 -- 172.21.15.72:0/3695323062 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24300343f0 con 0x7f24380d1bf0 2024-04-04T06:57:54.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:54.769+0000 7f243da00640 1 -- 172.21.15.72:0/3695323062 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f24380d1bf0 msgr2=0x7f2438070f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:54.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:54.769+0000 7f243da00640 1 --2- 172.21.15.72:0/3695323062 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f24380d1bf0 0x7f2438070f50 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f243806f030 tx=0x7f243002bdb0 comp rx=0 tx=0).stop 2024-04-04T06:57:54.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:54.769+0000 7f243da00640 1 -- 172.21.15.72:0/3695323062 shutdown_connections 2024-04-04T06:57:54.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:54.769+0000 7f243da00640 1 --2- 172.21.15.72:0/3695323062 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f24380d1bf0 0x7f2438070f50 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:54.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:54.769+0000 7f243da00640 1 --2- 172.21.15.72:0/3695323062 >> v2:172.21.15.117:3300/0 conn(0x7f24380d1510 0x7f243806cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:54.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:54.769+0000 7f243da00640 1 --2- 172.21.15.72:0/3695323062 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f243815e6d0 0x7f243806c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:54.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:54.769+0000 7f243da00640 1 -- 172.21.15.72:0/3695323062 >> 172.21.15.72:0/3695323062 conn(0x7f24380d2180 msgr2=0x7f24380d2560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:54.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:54.769+0000 7f243da00640 1 -- 172.21.15.72:0/3695323062 shutdown_connections 2024-04-04T06:57:54.771 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:54.769+0000 7f243da00640 1 -- 172.21.15.72:0/3695323062 wait complete. 2024-04-04T06:57:54.771 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:54.771+0000 7f243da00640 1 Processor -- start 2024-04-04T06:57:54.771 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:54.771+0000 7f243da00640 1 -- start start 2024-04-04T06:57:54.773 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:54.772+0000 7f243da00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f24380d1510 0x7f2438144d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:54.773 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:54.772+0000 7f243da00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f24380d1bf0 0x7f2438161000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:54.773 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:54.772+0000 7f243da00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f243815e6d0 0x7f2438161540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:54.773 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:54.772+0000 7f243da00640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f24380d0a90 con 0x7f24380d1510 2024-04-04T06:57:54.773 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:54.772+0000 7f243da00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f24380d07b0 con 0x7f243815e6d0 2024-04-04T06:57:54.773 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:54.772+0000 7f243da00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f24380d0fb0 con 0x7f24380d1bf0 2024-04-04T06:57:54.773 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:54.772+0000 7f2436a00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f24380d1510 0x7f2438144d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:54.773 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:54.772+0000 7f2436a00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f24380d1510 0x7f2438144d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:38876/0 (socket says 172.21.15.72:38876) 2024-04-04T06:57:54.773 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:54.772+0000 7f2436a00640 1 -- 172.21.15.72:0/1214591428 learned_addr learned my addr 172.21.15.72:0/1214591428 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:57:54.773 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:54.773+0000 7f2436a00640 1 -- 172.21.15.72:0/1214591428 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f24380d1bf0 msgr2=0x7f2438161000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:54.773 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:54.773+0000 7f242e000640 1 --2- 172.21.15.72:0/1214591428 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f24380d1bf0 0x7f2438161000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:54.774 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:54.773+0000 7f2437400640 1 --2- 172.21.15.72:0/1214591428 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f243815e6d0 0x7f2438161540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:54.774 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:54.773+0000 7f2436a00640 1 --2- 172.21.15.72:0/1214591428 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f24380d1bf0 0x7f2438161000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:54.774 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:54.773+0000 7f2436a00640 1 -- 172.21.15.72:0/1214591428 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f243815e6d0 msgr2=0x7f2438161540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:54.774 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:54.773+0000 7f2436a00640 1 --2- 172.21.15.72:0/1214591428 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f243815e6d0 0x7f2438161540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:54.774 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:54.773+0000 7f2436a00640 1 -- 172.21.15.72:0/1214591428 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f243815b960 con 0x7f24380d1510 2024-04-04T06:57:54.774 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:54.773+0000 7f2436a00640 1 --2- 172.21.15.72:0/1214591428 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f24380d1510 0x7f2438144d60 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f242800b4a0 tx=0x7f242800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:54.774 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:54.774+0000 7f242f400640 1 -- 172.21.15.72:0/1214591428 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2428014070 con 0x7f24380d1510 2024-04-04T06:57:54.774 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:54.774+0000 7f242f400640 1 -- 172.21.15.72:0/1214591428 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2428010610 con 0x7f24380d1510 2024-04-04T06:57:54.774 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:54.774+0000 7f242f400640 1 -- 172.21.15.72:0/1214591428 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2428010a00 con 0x7f24380d1510 2024-04-04T06:57:54.774 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:54.774+0000 7f243da00640 1 -- 172.21.15.72:0/1214591428 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f243815bc40 con 0x7f24380d1510 2024-04-04T06:57:54.774 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:54.774+0000 7f243da00640 1 -- 172.21.15.72:0/1214591428 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f243815c200 con 0x7f24380d1510 2024-04-04T06:57:54.775 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:54.775+0000 7f243da00640 1 -- 172.21.15.72:0/1214591428 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2438075840 con 0x7f24380d1510 2024-04-04T06:57:54.775 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:54.776+0000 7f242f400640 1 -- 172.21.15.72:0/1214591428 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2428017070 con 0x7f24380d1510 2024-04-04T06:57:54.776 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:54.777+0000 7f242f400640 1 --2- 172.21.15.72:0/1214591428 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f241406c8f0 0x7f241406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:54.776 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:54.777+0000 7f242f400640 1 -- 172.21.15.72:0/1214591428 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f242808b530 con 0x7f24380d1510 2024-04-04T06:57:54.776 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:54.777+0000 7f242e000640 1 --2- 172.21.15.72:0/1214591428 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f241406c8f0 0x7f241406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:54.777 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:54.778+0000 7f242e000640 1 --2- 172.21.15.72:0/1214591428 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f241406c8f0 0x7f241406edb0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f243806d600 tx=0x7f2420008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:54.781 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:54.782+0000 7f242f400640 1 -- 172.21.15.72:0/1214591428 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f24280599f0 con 0x7f24380d1510 2024-04-04T06:57:54.974 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:54.975+0000 7f243da00640 1 -- 172.21.15.72:0/1214591428 --> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f243806d350 con 0x7f241406c8f0 2024-04-04T06:57:54.989 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:54.990+0000 7f242f400640 1 -- 172.21.15.72:0/1214591428 <== mgr.4101 v2:172.21.15.72:6832/2205173820 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251948 (secure 0 0 0) 0x7f243806d350 con 0x7f241406c8f0 2024-04-04T06:57:54.994 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T06:57:54.996 INFO:teuthology.orchestra.run.smithi072.stderr:dumped all 2024-04-04T06:57:54.997 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:54.994+0000 7f243da00640 1 -- 172.21.15.72:0/1214591428 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f241406c8f0 msgr2=0x7f241406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:54.998 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:54.994+0000 7f243da00640 1 --2- 172.21.15.72:0/1214591428 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f241406c8f0 0x7f241406edb0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f243806d600 tx=0x7f2420008040 comp rx=0 tx=0).stop 2024-04-04T06:57:54.998 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:54.994+0000 7f243da00640 1 -- 172.21.15.72:0/1214591428 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f24380d1510 msgr2=0x7f2438144d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:54.998 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:54.994+0000 7f243da00640 1 --2- 172.21.15.72:0/1214591428 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f24380d1510 0x7f2438144d60 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f242800b4a0 tx=0x7f242800b960 comp rx=0 tx=0).stop 2024-04-04T06:57:54.998 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:54.994+0000 7f243da00640 1 -- 172.21.15.72:0/1214591428 shutdown_connections 2024-04-04T06:57:54.998 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:54.994+0000 7f243da00640 1 --2- 172.21.15.72:0/1214591428 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f241406c8f0 0x7f241406edb0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:54.998 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:54.994+0000 7f243da00640 1 --2- 172.21.15.72:0/1214591428 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f243815e6d0 0x7f2438161540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:54.998 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:54.994+0000 7f243da00640 1 --2- 172.21.15.72:0/1214591428 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f24380d1bf0 0x7f2438161000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:54.998 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:54.994+0000 7f243da00640 1 --2- 172.21.15.72:0/1214591428 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f24380d1510 0x7f2438144d60 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:54.998 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:54.994+0000 7f243da00640 1 -- 172.21.15.72:0/1214591428 >> 172.21.15.72:0/1214591428 conn(0x7f24380d2180 msgr2=0x7f24381567e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:54.998 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:54.995+0000 7f243da00640 1 -- 172.21.15.72:0/1214591428 shutdown_connections 2024-04-04T06:57:54.998 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:54.995+0000 7f243da00640 1 -- 172.21.15.72:0/1214591428 wait complete. 2024-04-04T06:57:55.011 INFO:teuthology.orchestra.run.smithi072.stdout:{"pg_ready":true,"pg_map":{"version":74,"stamp":"2024-04-04T06:57:53.412276+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":116,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220324,"kb_used_data":4136,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754396,"statfs":{"total":773094113280,"available":772868501504,"internally_reserved":0,"allocated":4235264,"data_stored":2358420,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":38,"apply_latency_ms":38,"commit_latency_ns":38000000,"apply_latency_ns":38000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.889460"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-04T06:57:51.583247+0000","last_change":"2024-04-04T06:57:50.579876+0000","last_active":"2024-04-04T06:57:51.583247+0000","last_peered":"2024-04-04T06:57:51.583247+0000","last_clean":"2024-04-04T06:57:51.583247+0000","last_became_active":"2024-04-04T06:57:50.579368+0000","last_became_peered":"2024-04-04T06:57:50.579368+0000","last_unstale":"2024-04-04T06:57:51.583247+0000","last_undegraded":"2024-04-04T06:57:51.583247+0000","last_fullsized":"2024-04-04T06:57:51.583247+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_clean_scrub_stamp":"2024-04-04T06:57:49.521429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T07:00:47.771739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-04T06:57:51.579648+0000","last_change":"2024-04-04T06:57:50.562180+0000","last_active":"2024-04-04T06:57:51.579648+0000","last_peered":"2024-04-04T06:57:51.579648+0000","last_clean":"2024-04-04T06:57:51.579648+0000","last_became_active":"2024-04-04T06:57:50.561858+0000","last_became_peered":"2024-04-04T06:57:50.561858+0000","last_unstale":"2024-04-04T06:57:51.579648+0000","last_undegraded":"2024-04-04T06:57:51.579648+0000","last_fullsized":"2024-04-04T06:57:51.579648+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_clean_scrub_stamp":"2024-04-04T06:57:49.521429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T08:06:49.659344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-04T06:57:51.581492+0000","last_change":"2024-04-04T06:57:50.572064+0000","last_active":"2024-04-04T06:57:51.581492+0000","last_peered":"2024-04-04T06:57:51.581492+0000","last_clean":"2024-04-04T06:57:51.581492+0000","last_became_active":"2024-04-04T06:57:50.571674+0000","last_became_peered":"2024-04-04T06:57:50.571674+0000","last_unstale":"2024-04-04T06:57:51.581492+0000","last_undegraded":"2024-04-04T06:57:51.581492+0000","last_fullsized":"2024-04-04T06:57:51.581492+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_clean_scrub_stamp":"2024-04-04T06:57:49.521429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T17:30:40.936288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-04T06:57:51.573674+0000","last_change":"2024-04-04T06:57:50.564353+0000","last_active":"2024-04-04T06:57:51.573674+0000","last_peered":"2024-04-04T06:57:51.573674+0000","last_clean":"2024-04-04T06:57:51.573674+0000","last_became_active":"2024-04-04T06:57:50.563733+0000","last_became_peered":"2024-04-04T06:57:50.563733+0000","last_unstale":"2024-04-04T06:57:51.573674+0000","last_undegraded":"2024-04-04T06:57:51.573674+0000","last_fullsized":"2024-04-04T06:57:51.573674+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_clean_scrub_stamp":"2024-04-04T06:57:49.521429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T12:46:28.589425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-04T06:57:51.580324+0000","last_change":"2024-04-04T06:57:50.581481+0000","last_active":"2024-04-04T06:57:51.580324+0000","last_peered":"2024-04-04T06:57:51.580324+0000","last_clean":"2024-04-04T06:57:51.580324+0000","last_became_active":"2024-04-04T06:57:50.579177+0000","last_became_peered":"2024-04-04T06:57:50.579177+0000","last_unstale":"2024-04-04T06:57:51.580324+0000","last_undegraded":"2024-04-04T06:57:51.580324+0000","last_fullsized":"2024-04-04T06:57:51.580324+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_clean_scrub_stamp":"2024-04-04T06:57:49.521429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T14:53:46.101613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-04T06:57:51.578782+0000","last_change":"2024-04-04T06:57:50.561066+0000","last_active":"2024-04-04T06:57:51.578782+0000","last_peered":"2024-04-04T06:57:51.578782+0000","last_clean":"2024-04-04T06:57:51.578782+0000","last_became_active":"2024-04-04T06:57:50.559042+0000","last_became_peered":"2024-04-04T06:57:50.559042+0000","last_unstale":"2024-04-04T06:57:51.578782+0000","last_undegraded":"2024-04-04T06:57:51.578782+0000","last_fullsized":"2024-04-04T06:57:51.578782+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_clean_scrub_stamp":"2024-04-04T06:57:49.521429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T07:52:03.846365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-04T06:57:51.571398+0000","last_change":"2024-04-04T06:57:50.567989+0000","last_active":"2024-04-04T06:57:51.571398+0000","last_peered":"2024-04-04T06:57:51.571398+0000","last_clean":"2024-04-04T06:57:51.571398+0000","last_became_active":"2024-04-04T06:57:50.567720+0000","last_became_peered":"2024-04-04T06:57:50.567720+0000","last_unstale":"2024-04-04T06:57:51.571398+0000","last_undegraded":"2024-04-04T06:57:51.571398+0000","last_fullsized":"2024-04-04T06:57:51.571398+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_clean_scrub_stamp":"2024-04-04T06:57:49.521429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T07:14:49.491716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-04T06:57:51.569534+0000","last_change":"2024-04-04T06:57:50.562327+0000","last_active":"2024-04-04T06:57:51.569534+0000","last_peered":"2024-04-04T06:57:51.569534+0000","last_clean":"2024-04-04T06:57:51.569534+0000","last_became_active":"2024-04-04T06:57:50.562019+0000","last_became_peered":"2024-04-04T06:57:50.562019+0000","last_unstale":"2024-04-04T06:57:51.569534+0000","last_undegraded":"2024-04-04T06:57:51.569534+0000","last_fullsized":"2024-04-04T06:57:51.569534+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_clean_scrub_stamp":"2024-04-04T06:57:49.521429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T15:03:45.455031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-04T06:57:51.572613+0000","last_change":"2024-04-04T06:57:50.565899+0000","last_active":"2024-04-04T06:57:51.572613+0000","last_peered":"2024-04-04T06:57:51.572613+0000","last_clean":"2024-04-04T06:57:51.572613+0000","last_became_active":"2024-04-04T06:57:50.565638+0000","last_became_peered":"2024-04-04T06:57:50.565638+0000","last_unstale":"2024-04-04T06:57:51.572613+0000","last_undegraded":"2024-04-04T06:57:51.572613+0000","last_fullsized":"2024-04-04T06:57:51.572613+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_clean_scrub_stamp":"2024-04-04T06:57:49.521429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T15:13:01.548675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-04T06:57:51.574275+0000","last_change":"2024-04-04T06:57:50.567444+0000","last_active":"2024-04-04T06:57:51.574275+0000","last_peered":"2024-04-04T06:57:51.574275+0000","last_clean":"2024-04-04T06:57:51.574275+0000","last_became_active":"2024-04-04T06:57:50.566135+0000","last_became_peered":"2024-04-04T06:57:50.566135+0000","last_unstale":"2024-04-04T06:57:51.574275+0000","last_undegraded":"2024-04-04T06:57:51.574275+0000","last_fullsized":"2024-04-04T06:57:51.574275+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_clean_scrub_stamp":"2024-04-04T06:57:49.521429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T12:23:30.739887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-04T06:57:51.572795+0000","last_change":"2024-04-04T06:57:50.567307+0000","last_active":"2024-04-04T06:57:51.572795+0000","last_peered":"2024-04-04T06:57:51.572795+0000","last_clean":"2024-04-04T06:57:51.572795+0000","last_became_active":"2024-04-04T06:57:50.566662+0000","last_became_peered":"2024-04-04T06:57:50.566662+0000","last_unstale":"2024-04-04T06:57:51.572795+0000","last_undegraded":"2024-04-04T06:57:51.572795+0000","last_fullsized":"2024-04-04T06:57:51.572795+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_clean_scrub_stamp":"2024-04-04T06:57:49.521429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T15:08:05.883633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-04T06:57:51.581182+0000","last_change":"2024-04-04T06:57:50.570736+0000","last_active":"2024-04-04T06:57:51.581182+0000","last_peered":"2024-04-04T06:57:51.581182+0000","last_clean":"2024-04-04T06:57:51.581182+0000","last_became_active":"2024-04-04T06:57:50.570227+0000","last_became_peered":"2024-04-04T06:57:50.570227+0000","last_unstale":"2024-04-04T06:57:51.581182+0000","last_undegraded":"2024-04-04T06:57:51.581182+0000","last_fullsized":"2024-04-04T06:57:51.581182+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_clean_scrub_stamp":"2024-04-04T06:57:49.521429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T11:10:45.270383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-04T06:57:51.580580+0000","last_change":"2024-04-04T06:57:50.564989+0000","last_active":"2024-04-04T06:57:51.580580+0000","last_peered":"2024-04-04T06:57:51.580580+0000","last_clean":"2024-04-04T06:57:51.580580+0000","last_became_active":"2024-04-04T06:57:50.564665+0000","last_became_peered":"2024-04-04T06:57:50.564665+0000","last_unstale":"2024-04-04T06:57:51.580580+0000","last_undegraded":"2024-04-04T06:57:51.580580+0000","last_fullsized":"2024-04-04T06:57:51.580580+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_clean_scrub_stamp":"2024-04-04T06:57:49.521429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T12:41:57.470638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-04T06:57:51.578895+0000","last_change":"2024-04-04T06:57:50.561538+0000","last_active":"2024-04-04T06:57:51.578895+0000","last_peered":"2024-04-04T06:57:51.578895+0000","last_clean":"2024-04-04T06:57:51.578895+0000","last_became_active":"2024-04-04T06:57:50.561215+0000","last_became_peered":"2024-04-04T06:57:50.561215+0000","last_unstale":"2024-04-04T06:57:51.578895+0000","last_undegraded":"2024-04-04T06:57:51.578895+0000","last_fullsized":"2024-04-04T06:57:51.578895+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_clean_scrub_stamp":"2024-04-04T06:57:49.521429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T12:32:44.007516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-04T06:57:51.580462+0000","last_change":"2024-04-04T06:57:50.572605+0000","last_active":"2024-04-04T06:57:51.580462+0000","last_peered":"2024-04-04T06:57:51.580462+0000","last_clean":"2024-04-04T06:57:51.580462+0000","last_became_active":"2024-04-04T06:57:50.571313+0000","last_became_peered":"2024-04-04T06:57:50.571313+0000","last_unstale":"2024-04-04T06:57:51.580462+0000","last_undegraded":"2024-04-04T06:57:51.580462+0000","last_fullsized":"2024-04-04T06:57:51.580462+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_clean_scrub_stamp":"2024-04-04T06:57:49.521429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T09:30:01.998412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-04T06:57:51.570508+0000","last_change":"2024-04-04T06:57:50.562101+0000","last_active":"2024-04-04T06:57:51.570508+0000","last_peered":"2024-04-04T06:57:51.570508+0000","last_clean":"2024-04-04T06:57:51.570508+0000","last_became_active":"2024-04-04T06:57:50.561785+0000","last_became_peered":"2024-04-04T06:57:50.561785+0000","last_unstale":"2024-04-04T06:57:51.570508+0000","last_undegraded":"2024-04-04T06:57:51.570508+0000","last_fullsized":"2024-04-04T06:57:51.570508+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_clean_scrub_stamp":"2024-04-04T06:57:49.521429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T11:10:45.270383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-04T06:57:51.573054+0000","last_change":"2024-04-04T06:57:50.571143+0000","last_active":"2024-04-04T06:57:51.573054+0000","last_peered":"2024-04-04T06:57:51.573054+0000","last_clean":"2024-04-04T06:57:51.573054+0000","last_became_active":"2024-04-04T06:57:50.570877+0000","last_became_peered":"2024-04-04T06:57:50.570877+0000","last_unstale":"2024-04-04T06:57:51.573054+0000","last_undegraded":"2024-04-04T06:57:51.573054+0000","last_fullsized":"2024-04-04T06:57:51.573054+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_clean_scrub_stamp":"2024-04-04T06:57:49.521429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T18:36:51.123426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-04T06:57:51.579519+0000","last_change":"2024-04-04T06:57:50.567450+0000","last_active":"2024-04-04T06:57:51.579519+0000","last_peered":"2024-04-04T06:57:51.579519+0000","last_clean":"2024-04-04T06:57:51.579519+0000","last_became_active":"2024-04-04T06:57:50.566627+0000","last_became_peered":"2024-04-04T06:57:50.566627+0000","last_unstale":"2024-04-04T06:57:51.579519+0000","last_undegraded":"2024-04-04T06:57:51.579519+0000","last_fullsized":"2024-04-04T06:57:51.579519+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_clean_scrub_stamp":"2024-04-04T06:57:49.521429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T18:36:51.123426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-04T06:57:51.578933+0000","last_change":"2024-04-04T06:57:50.567126+0000","last_active":"2024-04-04T06:57:51.578933+0000","last_peered":"2024-04-04T06:57:51.578933+0000","last_clean":"2024-04-04T06:57:51.578933+0000","last_became_active":"2024-04-04T06:57:50.566782+0000","last_became_peered":"2024-04-04T06:57:50.566782+0000","last_unstale":"2024-04-04T06:57:51.578933+0000","last_undegraded":"2024-04-04T06:57:51.578933+0000","last_fullsized":"2024-04-04T06:57:51.578933+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_clean_scrub_stamp":"2024-04-04T06:57:49.521429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T17:30:40.936288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-04T06:57:51.580236+0000","last_change":"2024-04-04T06:57:50.580454+0000","last_active":"2024-04-04T06:57:51.580236+0000","last_peered":"2024-04-04T06:57:51.580236+0000","last_clean":"2024-04-04T06:57:51.580236+0000","last_became_active":"2024-04-04T06:57:50.580053+0000","last_became_peered":"2024-04-04T06:57:50.580053+0000","last_unstale":"2024-04-04T06:57:51.580236+0000","last_undegraded":"2024-04-04T06:57:51.580236+0000","last_fullsized":"2024-04-04T06:57:51.580236+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_clean_scrub_stamp":"2024-04-04T06:57:49.521429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T16:04:20.779973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-04T06:57:51.570453+0000","last_change":"2024-04-04T06:57:50.562140+0000","last_active":"2024-04-04T06:57:51.570453+0000","last_peered":"2024-04-04T06:57:51.570453+0000","last_clean":"2024-04-04T06:57:51.570453+0000","last_became_active":"2024-04-04T06:57:50.561727+0000","last_became_peered":"2024-04-04T06:57:50.561727+0000","last_unstale":"2024-04-04T06:57:51.570453+0000","last_undegraded":"2024-04-04T06:57:51.570453+0000","last_fullsized":"2024-04-04T06:57:51.570453+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_clean_scrub_stamp":"2024-04-04T06:57:49.521429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T17:08:37.586414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-04T06:57:51.571948+0000","last_change":"2024-04-04T06:57:50.551779+0000","last_active":"2024-04-04T06:57:51.571948+0000","last_peered":"2024-04-04T06:57:51.571948+0000","last_clean":"2024-04-04T06:57:51.571948+0000","last_became_active":"2024-04-04T06:57:50.547478+0000","last_became_peered":"2024-04-04T06:57:50.547478+0000","last_unstale":"2024-04-04T06:57:51.571948+0000","last_undegraded":"2024-04-04T06:57:51.571948+0000","last_fullsized":"2024-04-04T06:57:51.571948+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_clean_scrub_stamp":"2024-04-04T06:57:49.521429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T07:00:47.771739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-04T06:57:51.566202+0000","last_change":"2024-04-04T06:57:50.564506+0000","last_active":"2024-04-04T06:57:51.566202+0000","last_peered":"2024-04-04T06:57:51.566202+0000","last_clean":"2024-04-04T06:57:51.566202+0000","last_became_active":"2024-04-04T06:57:50.564220+0000","last_became_peered":"2024-04-04T06:57:50.564220+0000","last_unstale":"2024-04-04T06:57:51.566202+0000","last_undegraded":"2024-04-04T06:57:51.566202+0000","last_fullsized":"2024-04-04T06:57:51.566202+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_clean_scrub_stamp":"2024-04-04T06:57:49.521429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T15:58:35.455393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-04T06:57:51.580422+0000","last_change":"2024-04-04T06:57:50.565263+0000","last_active":"2024-04-04T06:57:51.580422+0000","last_peered":"2024-04-04T06:57:51.580422+0000","last_clean":"2024-04-04T06:57:51.580422+0000","last_became_active":"2024-04-04T06:57:50.564791+0000","last_became_peered":"2024-04-04T06:57:50.564791+0000","last_unstale":"2024-04-04T06:57:51.580422+0000","last_undegraded":"2024-04-04T06:57:51.580422+0000","last_fullsized":"2024-04-04T06:57:51.580422+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_clean_scrub_stamp":"2024-04-04T06:57:49.521429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T15:03:45.455031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-04T06:57:51.574750+0000","last_change":"2024-04-04T06:57:50.567205+0000","last_active":"2024-04-04T06:57:51.574750+0000","last_peered":"2024-04-04T06:57:51.574750+0000","last_clean":"2024-04-04T06:57:51.574750+0000","last_became_active":"2024-04-04T06:57:50.565816+0000","last_became_peered":"2024-04-04T06:57:50.565816+0000","last_unstale":"2024-04-04T06:57:51.574750+0000","last_undegraded":"2024-04-04T06:57:51.574750+0000","last_fullsized":"2024-04-04T06:57:51.574750+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_clean_scrub_stamp":"2024-04-04T06:57:49.521429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T09:30:01.998412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-04T06:57:51.579840+0000","last_change":"2024-04-04T06:57:50.576403+0000","last_active":"2024-04-04T06:57:51.579840+0000","last_peered":"2024-04-04T06:57:51.579840+0000","last_clean":"2024-04-04T06:57:51.579840+0000","last_became_active":"2024-04-04T06:57:50.574383+0000","last_became_peered":"2024-04-04T06:57:50.574383+0000","last_unstale":"2024-04-04T06:57:51.579840+0000","last_undegraded":"2024-04-04T06:57:51.579840+0000","last_fullsized":"2024-04-04T06:57:51.579840+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_clean_scrub_stamp":"2024-04-04T06:57:49.521429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T17:25:49.648650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-04T06:57:51.574319+0000","last_change":"2024-04-04T06:57:50.573431+0000","last_active":"2024-04-04T06:57:51.574319+0000","last_peered":"2024-04-04T06:57:51.574319+0000","last_clean":"2024-04-04T06:57:51.574319+0000","last_became_active":"2024-04-04T06:57:50.570888+0000","last_became_peered":"2024-04-04T06:57:50.570888+0000","last_unstale":"2024-04-04T06:57:51.574319+0000","last_undegraded":"2024-04-04T06:57:51.574319+0000","last_fullsized":"2024-04-04T06:57:51.574319+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_clean_scrub_stamp":"2024-04-04T06:57:49.521429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T17:34:44.962343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-04T06:57:51.581342+0000","last_change":"2024-04-04T06:57:50.566628+0000","last_active":"2024-04-04T06:57:51.581342+0000","last_peered":"2024-04-04T06:57:51.581342+0000","last_clean":"2024-04-04T06:57:51.581342+0000","last_became_active":"2024-04-04T06:57:50.563112+0000","last_became_peered":"2024-04-04T06:57:50.563112+0000","last_unstale":"2024-04-04T06:57:51.581342+0000","last_undegraded":"2024-04-04T06:57:51.581342+0000","last_fullsized":"2024-04-04T06:57:51.581342+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_clean_scrub_stamp":"2024-04-04T06:57:49.521429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T07:14:49.491716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-04T06:57:51.570835+0000","last_change":"2024-04-04T06:57:50.550575+0000","last_active":"2024-04-04T06:57:51.570835+0000","last_peered":"2024-04-04T06:57:51.570835+0000","last_clean":"2024-04-04T06:57:51.570835+0000","last_became_active":"2024-04-04T06:57:50.546749+0000","last_became_peered":"2024-04-04T06:57:50.546749+0000","last_unstale":"2024-04-04T06:57:51.570835+0000","last_undegraded":"2024-04-04T06:57:51.570835+0000","last_fullsized":"2024-04-04T06:57:51.570835+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_clean_scrub_stamp":"2024-04-04T06:57:49.521429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T11:22:05.401737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-04T06:57:51.571725+0000","last_change":"2024-04-04T06:57:50.570556+0000","last_active":"2024-04-04T06:57:51.571725+0000","last_peered":"2024-04-04T06:57:51.571725+0000","last_clean":"2024-04-04T06:57:51.571725+0000","last_became_active":"2024-04-04T06:57:50.570307+0000","last_became_peered":"2024-04-04T06:57:50.570307+0000","last_unstale":"2024-04-04T06:57:51.571725+0000","last_undegraded":"2024-04-04T06:57:51.571725+0000","last_fullsized":"2024-04-04T06:57:51.571725+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_clean_scrub_stamp":"2024-04-04T06:57:49.521429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T12:32:44.007516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-04T06:57:51.582497+0000","last_change":"2024-04-04T06:57:50.575684+0000","last_active":"2024-04-04T06:57:51.582497+0000","last_peered":"2024-04-04T06:57:51.582497+0000","last_clean":"2024-04-04T06:57:51.582497+0000","last_became_active":"2024-04-04T06:57:50.575246+0000","last_became_peered":"2024-04-04T06:57:50.575246+0000","last_unstale":"2024-04-04T06:57:51.582497+0000","last_undegraded":"2024-04-04T06:57:51.582497+0000","last_fullsized":"2024-04-04T06:57:51.582497+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_clean_scrub_stamp":"2024-04-04T06:57:49.521429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T17:08:37.586414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-04T06:57:51.569618+0000","last_change":"2024-04-04T06:57:50.565238+0000","last_active":"2024-04-04T06:57:51.569618+0000","last_peered":"2024-04-04T06:57:51.569618+0000","last_clean":"2024-04-04T06:57:51.569618+0000","last_became_active":"2024-04-04T06:57:50.564960+0000","last_became_peered":"2024-04-04T06:57:50.564960+0000","last_unstale":"2024-04-04T06:57:51.569618+0000","last_undegraded":"2024-04-04T06:57:51.569618+0000","last_fullsized":"2024-04-04T06:57:51.569618+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_clean_scrub_stamp":"2024-04-04T06:57:49.521429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T09:30:01.998412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-04T06:57:51.566287+0000","last_change":"2024-04-04T06:57:50.569958+0000","last_active":"2024-04-04T06:57:51.566287+0000","last_peered":"2024-04-04T06:57:51.566287+0000","last_clean":"2024-04-04T06:57:51.566287+0000","last_became_active":"2024-04-04T06:57:50.569640+0000","last_became_peered":"2024-04-04T06:57:50.569640+0000","last_unstale":"2024-04-04T06:57:51.566287+0000","last_undegraded":"2024-04-04T06:57:51.566287+0000","last_fullsized":"2024-04-04T06:57:51.566287+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_clean_scrub_stamp":"2024-04-04T06:57:49.521429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T16:44:52.700218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"32'4","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-04T06:57:51.583576+0000","last_change":"2024-04-04T06:57:49.574011+0000","last_active":"2024-04-04T06:57:51.583576+0000","last_peered":"2024-04-04T06:57:51.583576+0000","last_clean":"2024-04-04T06:57:51.583576+0000","last_became_active":"2024-04-04T06:57:49.573737+0000","last_became_peered":"2024-04-04T06:57:49.573737+0000","last_unstale":"2024-04-04T06:57:51.583576+0000","last_undegraded":"2024-04-04T06:57:51.583576+0000","last_fullsized":"2024-04-04T06:57:51.583576+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:57:48.507843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:57:48.507843+0000","last_clean_scrub_stamp":"2024-04-04T06:57:48.507843+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T08:19:47.244976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-04T06:57:51.583235+0000","last_change":"2024-04-04T06:57:50.574673+0000","last_active":"2024-04-04T06:57:51.583235+0000","last_peered":"2024-04-04T06:57:51.583235+0000","last_clean":"2024-04-04T06:57:51.583235+0000","last_became_active":"2024-04-04T06:57:50.574345+0000","last_became_peered":"2024-04-04T06:57:50.574345+0000","last_unstale":"2024-04-04T06:57:51.583235+0000","last_undegraded":"2024-04-04T06:57:51.583235+0000","last_fullsized":"2024-04-04T06:57:51.583235+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_clean_scrub_stamp":"2024-04-04T06:57:49.521429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T09:04:40.102864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"32'1","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-04T06:57:51.566220+0000","last_change":"2024-04-04T06:57:49.560801+0000","last_active":"2024-04-04T06:57:51.566220+0000","last_peered":"2024-04-04T06:57:51.566220+0000","last_clean":"2024-04-04T06:57:51.566220+0000","last_became_active":"2024-04-04T06:57:49.560491+0000","last_became_peered":"2024-04-04T06:57:49.560491+0000","last_unstale":"2024-04-04T06:57:51.566220+0000","last_undegraded":"2024-04-04T06:57:51.566220+0000","last_fullsized":"2024-04-04T06:57:51.566220+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:57:48.507843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:57:48.507843+0000","last_clean_scrub_stamp":"2024-04-04T06:57:48.507843+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T08:03:58.694981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-04T06:57:51.570666+0000","last_change":"2024-04-04T06:57:50.550573+0000","last_active":"2024-04-04T06:57:51.570666+0000","last_peered":"2024-04-04T06:57:51.570666+0000","last_clean":"2024-04-04T06:57:51.570666+0000","last_became_active":"2024-04-04T06:57:50.549971+0000","last_became_peered":"2024-04-04T06:57:50.549971+0000","last_unstale":"2024-04-04T06:57:51.570666+0000","last_undegraded":"2024-04-04T06:57:51.570666+0000","last_fullsized":"2024-04-04T06:57:51.570666+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_clean_scrub_stamp":"2024-04-04T06:57:49.521429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T14:10:38.953987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"32'2","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-04T06:57:51.578985+0000","last_change":"2024-04-04T06:57:49.576214+0000","last_active":"2024-04-04T06:57:51.578985+0000","last_peered":"2024-04-04T06:57:51.578985+0000","last_clean":"2024-04-04T06:57:51.578985+0000","last_became_active":"2024-04-04T06:57:49.575920+0000","last_became_peered":"2024-04-04T06:57:49.575920+0000","last_unstale":"2024-04-04T06:57:51.578985+0000","last_undegraded":"2024-04-04T06:57:51.578985+0000","last_fullsized":"2024-04-04T06:57:51.578985+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:57:48.507843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:57:48.507843+0000","last_clean_scrub_stamp":"2024-04-04T06:57:48.507843+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T16:44:51.686632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-04T06:57:51.574407+0000","last_change":"2024-04-04T06:57:50.573138+0000","last_active":"2024-04-04T06:57:51.574407+0000","last_peered":"2024-04-04T06:57:51.574407+0000","last_clean":"2024-04-04T06:57:51.574407+0000","last_became_active":"2024-04-04T06:57:50.570518+0000","last_became_peered":"2024-04-04T06:57:50.570518+0000","last_unstale":"2024-04-04T06:57:51.574407+0000","last_undegraded":"2024-04-04T06:57:51.574407+0000","last_fullsized":"2024-04-04T06:57:51.574407+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_clean_scrub_stamp":"2024-04-04T06:57:49.521429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T15:03:45.455031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"32'2","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-04T06:57:51.580399+0000","last_change":"2024-04-04T06:57:49.569871+0000","last_active":"2024-04-04T06:57:51.580399+0000","last_peered":"2024-04-04T06:57:51.580399+0000","last_clean":"2024-04-04T06:57:51.580399+0000","last_became_active":"2024-04-04T06:57:49.568180+0000","last_became_peered":"2024-04-04T06:57:49.568180+0000","last_unstale":"2024-04-04T06:57:51.580399+0000","last_undegraded":"2024-04-04T06:57:51.580399+0000","last_fullsized":"2024-04-04T06:57:51.580399+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:57:48.507843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:57:48.507843+0000","last_clean_scrub_stamp":"2024-04-04T06:57:48.507843+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T12:57:21.127133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-04T06:57:51.571950+0000","last_change":"2024-04-04T06:57:50.568226+0000","last_active":"2024-04-04T06:57:51.571950+0000","last_peered":"2024-04-04T06:57:51.571950+0000","last_clean":"2024-04-04T06:57:51.571950+0000","last_became_active":"2024-04-04T06:57:50.567342+0000","last_became_peered":"2024-04-04T06:57:50.567342+0000","last_unstale":"2024-04-04T06:57:51.571950+0000","last_undegraded":"2024-04-04T06:57:51.571950+0000","last_fullsized":"2024-04-04T06:57:51.571950+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_clean_scrub_stamp":"2024-04-04T06:57:49.521429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T17:30:40.936288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"32'1","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-04T06:57:51.571043+0000","last_change":"2024-04-04T06:57:49.566562+0000","last_active":"2024-04-04T06:57:51.571043+0000","last_peered":"2024-04-04T06:57:51.571043+0000","last_clean":"2024-04-04T06:57:51.571043+0000","last_became_active":"2024-04-04T06:57:49.566240+0000","last_became_peered":"2024-04-04T06:57:49.566240+0000","last_unstale":"2024-04-04T06:57:51.571043+0000","last_undegraded":"2024-04-04T06:57:51.571043+0000","last_fullsized":"2024-04-04T06:57:51.571043+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:57:48.507843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:57:48.507843+0000","last_clean_scrub_stamp":"2024-04-04T06:57:48.507843+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T16:04:19.766388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-04T06:57:51.580870+0000","last_change":"2024-04-04T06:57:50.565149+0000","last_active":"2024-04-04T06:57:51.580870+0000","last_peered":"2024-04-04T06:57:51.580870+0000","last_clean":"2024-04-04T06:57:51.580870+0000","last_became_active":"2024-04-04T06:57:50.564715+0000","last_became_peered":"2024-04-04T06:57:50.564715+0000","last_unstale":"2024-04-04T06:57:51.580870+0000","last_undegraded":"2024-04-04T06:57:51.580870+0000","last_fullsized":"2024-04-04T06:57:51.580870+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_clean_scrub_stamp":"2024-04-04T06:57:49.521429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T13:30:41.542528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"32'1","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-04T06:57:51.571750+0000","last_change":"2024-04-04T06:57:49.567912+0000","last_active":"2024-04-04T06:57:51.571750+0000","last_peered":"2024-04-04T06:57:51.571750+0000","last_clean":"2024-04-04T06:57:51.571750+0000","last_became_active":"2024-04-04T06:57:49.563803+0000","last_became_peered":"2024-04-04T06:57:49.563803+0000","last_unstale":"2024-04-04T06:57:51.571750+0000","last_undegraded":"2024-04-04T06:57:51.571750+0000","last_fullsized":"2024-04-04T06:57:51.571750+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:57:48.507843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:57:48.507843+0000","last_clean_scrub_stamp":"2024-04-04T06:57:48.507843+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T08:57:00.178088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-04T06:57:51.572175+0000","last_change":"2024-04-04T06:57:50.570830+0000","last_active":"2024-04-04T06:57:51.572175+0000","last_peered":"2024-04-04T06:57:51.572175+0000","last_clean":"2024-04-04T06:57:51.572175+0000","last_became_active":"2024-04-04T06:57:50.570013+0000","last_became_peered":"2024-04-04T06:57:50.570013+0000","last_unstale":"2024-04-04T06:57:51.572175+0000","last_undegraded":"2024-04-04T06:57:51.572175+0000","last_fullsized":"2024-04-04T06:57:51.572175+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_clean_scrub_stamp":"2024-04-04T06:57:49.521429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T10:45:20.080928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-04T06:57:51.579508+0000","last_change":"2024-04-04T06:57:49.564789+0000","last_active":"2024-04-04T06:57:51.579508+0000","last_peered":"2024-04-04T06:57:51.579508+0000","last_clean":"2024-04-04T06:57:51.579508+0000","last_became_active":"2024-04-04T06:57:49.564461+0000","last_became_peered":"2024-04-04T06:57:49.564461+0000","last_unstale":"2024-04-04T06:57:51.579508+0000","last_undegraded":"2024-04-04T06:57:51.579508+0000","last_fullsized":"2024-04-04T06:57:51.579508+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:57:48.507843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:57:48.507843+0000","last_clean_scrub_stamp":"2024-04-04T06:57:48.507843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T15:58:34.441807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-04T06:57:51.573528+0000","last_change":"2024-04-04T06:57:50.584408+0000","last_active":"2024-04-04T06:57:51.573528+0000","last_peered":"2024-04-04T06:57:51.573528+0000","last_clean":"2024-04-04T06:57:51.573528+0000","last_became_active":"2024-04-04T06:57:50.584228+0000","last_became_peered":"2024-04-04T06:57:50.584228+0000","last_unstale":"2024-04-04T06:57:51.573528+0000","last_undegraded":"2024-04-04T06:57:51.573528+0000","last_fullsized":"2024-04-04T06:57:51.573528+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_clean_scrub_stamp":"2024-04-04T06:57:49.521429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T14:49:30.811386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-04T06:57:51.570205+0000","last_change":"2024-04-04T06:57:49.573346+0000","last_active":"2024-04-04T06:57:51.570205+0000","last_peered":"2024-04-04T06:57:51.570205+0000","last_clean":"2024-04-04T06:57:51.570205+0000","last_became_active":"2024-04-04T06:57:49.573042+0000","last_became_peered":"2024-04-04T06:57:49.573042+0000","last_unstale":"2024-04-04T06:57:51.570205+0000","last_undegraded":"2024-04-04T06:57:51.570205+0000","last_fullsized":"2024-04-04T06:57:51.570205+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:57:48.507843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:57:48.507843+0000","last_clean_scrub_stamp":"2024-04-04T06:57:48.507843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T12:40:55.080177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-04T06:57:51.581493+0000","last_change":"2024-04-04T06:57:50.563549+0000","last_active":"2024-04-04T06:57:51.581493+0000","last_peered":"2024-04-04T06:57:51.581493+0000","last_clean":"2024-04-04T06:57:51.581493+0000","last_became_active":"2024-04-04T06:57:50.562095+0000","last_became_peered":"2024-04-04T06:57:50.562095+0000","last_unstale":"2024-04-04T06:57:51.581493+0000","last_undegraded":"2024-04-04T06:57:51.581493+0000","last_fullsized":"2024-04-04T06:57:51.581493+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_clean_scrub_stamp":"2024-04-04T06:57:49.521429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T12:32:44.007516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-04T06:57:51.579280+0000","last_change":"2024-04-04T06:57:49.572232+0000","last_active":"2024-04-04T06:57:51.579280+0000","last_peered":"2024-04-04T06:57:51.579280+0000","last_clean":"2024-04-04T06:57:51.579280+0000","last_became_active":"2024-04-04T06:57:49.571906+0000","last_became_peered":"2024-04-04T06:57:49.571906+0000","last_unstale":"2024-04-04T06:57:51.579280+0000","last_undegraded":"2024-04-04T06:57:51.579280+0000","last_fullsized":"2024-04-04T06:57:51.579280+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:57:48.507843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:57:48.507843+0000","last_clean_scrub_stamp":"2024-04-04T06:57:48.507843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T09:22:53.336351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-04T06:57:51.579431+0000","last_change":"2024-04-04T06:57:50.573771+0000","last_active":"2024-04-04T06:57:51.579431+0000","last_peered":"2024-04-04T06:57:51.579431+0000","last_clean":"2024-04-04T06:57:51.579431+0000","last_became_active":"2024-04-04T06:57:50.573499+0000","last_became_peered":"2024-04-04T06:57:50.573499+0000","last_unstale":"2024-04-04T06:57:51.579431+0000","last_undegraded":"2024-04-04T06:57:51.579431+0000","last_fullsized":"2024-04-04T06:57:51.579431+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_clean_scrub_stamp":"2024-04-04T06:57:49.521429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T15:08:05.883633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-04T06:57:51.566314+0000","last_change":"2024-04-04T06:57:49.569792+0000","last_active":"2024-04-04T06:57:51.566314+0000","last_peered":"2024-04-04T06:57:51.566314+0000","last_clean":"2024-04-04T06:57:51.566314+0000","last_became_active":"2024-04-04T06:57:49.567091+0000","last_became_peered":"2024-04-04T06:57:49.567091+0000","last_unstale":"2024-04-04T06:57:51.566314+0000","last_undegraded":"2024-04-04T06:57:51.566314+0000","last_fullsized":"2024-04-04T06:57:51.566314+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:57:48.507843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:57:48.507843+0000","last_clean_scrub_stamp":"2024-04-04T06:57:48.507843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T15:57:11.006633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-04T06:57:51.579025+0000","last_change":"2024-04-04T06:57:50.557167+0000","last_active":"2024-04-04T06:57:51.579025+0000","last_peered":"2024-04-04T06:57:51.579025+0000","last_clean":"2024-04-04T06:57:51.579025+0000","last_became_active":"2024-04-04T06:57:50.556733+0000","last_became_peered":"2024-04-04T06:57:50.556733+0000","last_unstale":"2024-04-04T06:57:51.579025+0000","last_undegraded":"2024-04-04T06:57:51.579025+0000","last_fullsized":"2024-04-04T06:57:51.579025+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_clean_scrub_stamp":"2024-04-04T06:57:49.521429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T11:07:27.160554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"32'3","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-04T06:57:51.581543+0000","last_change":"2024-04-04T06:57:49.570446+0000","last_active":"2024-04-04T06:57:51.581543+0000","last_peered":"2024-04-04T06:57:51.581543+0000","last_clean":"2024-04-04T06:57:51.581543+0000","last_became_active":"2024-04-04T06:57:49.570088+0000","last_became_peered":"2024-04-04T06:57:49.570088+0000","last_unstale":"2024-04-04T06:57:51.581543+0000","last_undegraded":"2024-04-04T06:57:51.581543+0000","last_fullsized":"2024-04-04T06:57:51.581543+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:57:48.507843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:57:48.507843+0000","last_clean_scrub_stamp":"2024-04-04T06:57:48.507843+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T15:58:34.441807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-04T06:57:51.581211+0000","last_change":"2024-04-04T06:57:50.572998+0000","last_active":"2024-04-04T06:57:51.581211+0000","last_peered":"2024-04-04T06:57:51.581211+0000","last_clean":"2024-04-04T06:57:51.581211+0000","last_became_active":"2024-04-04T06:57:50.571747+0000","last_became_peered":"2024-04-04T06:57:50.571747+0000","last_unstale":"2024-04-04T06:57:51.581211+0000","last_undegraded":"2024-04-04T06:57:51.581211+0000","last_fullsized":"2024-04-04T06:57:51.581211+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_clean_scrub_stamp":"2024-04-04T06:57:49.521429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T07:52:03.846365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"32'6","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-04T06:57:51.578684+0000","last_change":"2024-04-04T06:57:49.577328+0000","last_active":"2024-04-04T06:57:51.578684+0000","last_peered":"2024-04-04T06:57:51.578684+0000","last_clean":"2024-04-04T06:57:51.578684+0000","last_became_active":"2024-04-04T06:57:49.576912+0000","last_became_peered":"2024-04-04T06:57:49.576912+0000","last_unstale":"2024-04-04T06:57:51.578684+0000","last_undegraded":"2024-04-04T06:57:51.578684+0000","last_fullsized":"2024-04-04T06:57:51.578684+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:57:48.507843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:57:48.507843+0000","last_clean_scrub_stamp":"2024-04-04T06:57:48.507843+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T12:34:35.572600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-04T06:57:51.573549+0000","last_change":"2024-04-04T06:57:50.583855+0000","last_active":"2024-04-04T06:57:51.573549+0000","last_peered":"2024-04-04T06:57:51.573549+0000","last_clean":"2024-04-04T06:57:51.573549+0000","last_became_active":"2024-04-04T06:57:50.583541+0000","last_became_peered":"2024-04-04T06:57:50.583541+0000","last_unstale":"2024-04-04T06:57:51.573549+0000","last_undegraded":"2024-04-04T06:57:51.573549+0000","last_fullsized":"2024-04-04T06:57:51.573549+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_clean_scrub_stamp":"2024-04-04T06:57:49.521429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T11:45:50.008012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"32'2","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-04T06:57:51.571185+0000","last_change":"2024-04-04T06:57:49.570742+0000","last_active":"2024-04-04T06:57:51.571185+0000","last_peered":"2024-04-04T06:57:51.571185+0000","last_clean":"2024-04-04T06:57:51.571185+0000","last_became_active":"2024-04-04T06:57:49.570454+0000","last_became_peered":"2024-04-04T06:57:49.570454+0000","last_unstale":"2024-04-04T06:57:51.571185+0000","last_undegraded":"2024-04-04T06:57:51.571185+0000","last_fullsized":"2024-04-04T06:57:51.571185+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:57:48.507843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:57:48.507843+0000","last_clean_scrub_stamp":"2024-04-04T06:57:48.507843+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T14:53:45.088027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-04T06:57:51.578644+0000","last_change":"2024-04-04T06:57:50.561735+0000","last_active":"2024-04-04T06:57:51.578644+0000","last_peered":"2024-04-04T06:57:51.578644+0000","last_clean":"2024-04-04T06:57:51.578644+0000","last_became_active":"2024-04-04T06:57:50.561486+0000","last_became_peered":"2024-04-04T06:57:50.561486+0000","last_unstale":"2024-04-04T06:57:51.578644+0000","last_undegraded":"2024-04-04T06:57:51.578644+0000","last_fullsized":"2024-04-04T06:57:51.578644+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_clean_scrub_stamp":"2024-04-04T06:57:49.521429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T11:10:45.270383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-04T06:57:51.573488+0000","last_change":"2024-04-04T06:57:49.573509+0000","last_active":"2024-04-04T06:57:51.573488+0000","last_peered":"2024-04-04T06:57:51.573488+0000","last_clean":"2024-04-04T06:57:51.573488+0000","last_became_active":"2024-04-04T06:57:49.573221+0000","last_became_peered":"2024-04-04T06:57:49.573221+0000","last_unstale":"2024-04-04T06:57:51.573488+0000","last_undegraded":"2024-04-04T06:57:51.573488+0000","last_fullsized":"2024-04-04T06:57:51.573488+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:57:48.507843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:57:48.507843+0000","last_clean_scrub_stamp":"2024-04-04T06:57:48.507843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T09:15:32.272861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-04T06:57:51.570445+0000","last_change":"2024-04-04T06:57:50.568882+0000","last_active":"2024-04-04T06:57:51.570445+0000","last_peered":"2024-04-04T06:57:51.570445+0000","last_clean":"2024-04-04T06:57:51.570445+0000","last_became_active":"2024-04-04T06:57:50.568621+0000","last_became_peered":"2024-04-04T06:57:50.568621+0000","last_unstale":"2024-04-04T06:57:51.570445+0000","last_undegraded":"2024-04-04T06:57:51.570445+0000","last_fullsized":"2024-04-04T06:57:51.570445+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_clean_scrub_stamp":"2024-04-04T06:57:49.521429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T13:30:41.542528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-04T06:57:51.578857+0000","last_change":"2024-04-04T06:57:49.571082+0000","last_active":"2024-04-04T06:57:51.578857+0000","last_peered":"2024-04-04T06:57:51.578857+0000","last_clean":"2024-04-04T06:57:51.578857+0000","last_became_active":"2024-04-04T06:57:49.570811+0000","last_became_peered":"2024-04-04T06:57:49.570811+0000","last_unstale":"2024-04-04T06:57:51.578857+0000","last_undegraded":"2024-04-04T06:57:51.578857+0000","last_fullsized":"2024-04-04T06:57:51.578857+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:57:48.507843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:57:48.507843+0000","last_clean_scrub_stamp":"2024-04-04T06:57:48.507843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T10:45:19.067343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-04T06:57:51.582903+0000","last_change":"2024-04-04T06:57:50.567723+0000","last_active":"2024-04-04T06:57:51.582903+0000","last_peered":"2024-04-04T06:57:51.582903+0000","last_clean":"2024-04-04T06:57:51.582903+0000","last_became_active":"2024-04-04T06:57:50.567452+0000","last_became_peered":"2024-04-04T06:57:50.567452+0000","last_unstale":"2024-04-04T06:57:51.582903+0000","last_undegraded":"2024-04-04T06:57:51.582903+0000","last_fullsized":"2024-04-04T06:57:51.582903+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_clean_scrub_stamp":"2024-04-04T06:57:49.521429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T11:22:05.401737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"32'8","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-04T06:57:51.578475+0000","last_change":"2024-04-04T06:57:49.576152+0000","last_active":"2024-04-04T06:57:51.578475+0000","last_peered":"2024-04-04T06:57:51.578475+0000","last_clean":"2024-04-04T06:57:51.578475+0000","last_became_active":"2024-04-04T06:57:49.575859+0000","last_became_peered":"2024-04-04T06:57:49.575859+0000","last_unstale":"2024-04-04T06:57:51.578475+0000","last_undegraded":"2024-04-04T06:57:51.578475+0000","last_fullsized":"2024-04-04T06:57:51.578475+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:57:48.507843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:57:48.507843+0000","last_clean_scrub_stamp":"2024-04-04T06:57:48.507843+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T07:00:46.758154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-04T06:57:51.572216+0000","last_change":"2024-04-04T06:57:50.559019+0000","last_active":"2024-04-04T06:57:51.572216+0000","last_peered":"2024-04-04T06:57:51.572216+0000","last_clean":"2024-04-04T06:57:51.572216+0000","last_became_active":"2024-04-04T06:57:50.558709+0000","last_became_peered":"2024-04-04T06:57:50.558709+0000","last_unstale":"2024-04-04T06:57:51.572216+0000","last_undegraded":"2024-04-04T06:57:51.572216+0000","last_fullsized":"2024-04-04T06:57:51.572216+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_clean_scrub_stamp":"2024-04-04T06:57:49.521429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T15:58:35.455393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"32'1","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-04T06:57:51.575045+0000","last_change":"2024-04-04T06:57:49.571351+0000","last_active":"2024-04-04T06:57:51.575045+0000","last_peered":"2024-04-04T06:57:51.575045+0000","last_clean":"2024-04-04T06:57:51.575045+0000","last_became_active":"2024-04-04T06:57:49.571012+0000","last_became_peered":"2024-04-04T06:57:49.571012+0000","last_unstale":"2024-04-04T06:57:51.575045+0000","last_undegraded":"2024-04-04T06:57:51.575045+0000","last_fullsized":"2024-04-04T06:57:51.575045+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:57:48.507843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:57:48.507843+0000","last_clean_scrub_stamp":"2024-04-04T06:57:48.507843+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T11:22:04.388152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-04T06:57:51.581544+0000","last_change":"2024-04-04T06:57:50.569780+0000","last_active":"2024-04-04T06:57:51.581544+0000","last_peered":"2024-04-04T06:57:51.581544+0000","last_clean":"2024-04-04T06:57:51.581544+0000","last_became_active":"2024-04-04T06:57:50.568621+0000","last_became_peered":"2024-04-04T06:57:50.568621+0000","last_unstale":"2024-04-04T06:57:51.581544+0000","last_undegraded":"2024-04-04T06:57:51.581544+0000","last_fullsized":"2024-04-04T06:57:51.581544+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_clean_scrub_stamp":"2024-04-04T06:57:49.521429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T11:07:27.160554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"32'2","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-04T06:57:51.572151+0000","last_change":"2024-04-04T06:57:49.573669+0000","last_active":"2024-04-04T06:57:51.572151+0000","last_peered":"2024-04-04T06:57:51.572151+0000","last_clean":"2024-04-04T06:57:51.572151+0000","last_became_active":"2024-04-04T06:57:49.573056+0000","last_became_peered":"2024-04-04T06:57:49.573056+0000","last_unstale":"2024-04-04T06:57:51.572151+0000","last_undegraded":"2024-04-04T06:57:51.572151+0000","last_fullsized":"2024-04-04T06:57:51.572151+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:57:48.507843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:57:48.507843+0000","last_clean_scrub_stamp":"2024-04-04T06:57:48.507843+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T07:35:29.239698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-04T06:57:51.573922+0000","last_change":"2024-04-04T06:57:50.573733+0000","last_active":"2024-04-04T06:57:51.573922+0000","last_peered":"2024-04-04T06:57:51.573922+0000","last_clean":"2024-04-04T06:57:51.573922+0000","last_became_active":"2024-04-04T06:57:50.573444+0000","last_became_peered":"2024-04-04T06:57:50.573444+0000","last_unstale":"2024-04-04T06:57:51.573922+0000","last_undegraded":"2024-04-04T06:57:51.573922+0000","last_fullsized":"2024-04-04T06:57:51.573922+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_clean_scrub_stamp":"2024-04-04T06:57:49.521429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T13:04:33.784786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"32'1","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-04T06:57:51.571730+0000","last_change":"2024-04-04T06:57:49.563266+0000","last_active":"2024-04-04T06:57:51.571730+0000","last_peered":"2024-04-04T06:57:51.571730+0000","last_clean":"2024-04-04T06:57:51.571730+0000","last_became_active":"2024-04-04T06:57:49.562916+0000","last_became_peered":"2024-04-04T06:57:49.562916+0000","last_unstale":"2024-04-04T06:57:51.571730+0000","last_undegraded":"2024-04-04T06:57:51.571730+0000","last_fullsized":"2024-04-04T06:57:51.571730+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:57:48.507843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:57:48.507843+0000","last_clean_scrub_stamp":"2024-04-04T06:57:48.507843+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T17:19:50.355797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-04T06:57:51.580539+0000","last_change":"2024-04-04T06:57:50.574786+0000","last_active":"2024-04-04T06:57:51.580539+0000","last_peered":"2024-04-04T06:57:51.580539+0000","last_clean":"2024-04-04T06:57:51.580539+0000","last_became_active":"2024-04-04T06:57:50.568214+0000","last_became_peered":"2024-04-04T06:57:50.568214+0000","last_unstale":"2024-04-04T06:57:51.580539+0000","last_undegraded":"2024-04-04T06:57:51.580539+0000","last_fullsized":"2024-04-04T06:57:51.580539+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_clean_scrub_stamp":"2024-04-04T06:57:49.521429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T17:19:51.369382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-04T06:57:51.570905+0000","last_change":"2024-04-04T06:57:49.569151+0000","last_active":"2024-04-04T06:57:51.570905+0000","last_peered":"2024-04-04T06:57:51.570905+0000","last_clean":"2024-04-04T06:57:51.570905+0000","last_became_active":"2024-04-04T06:57:49.567915+0000","last_became_peered":"2024-04-04T06:57:49.567915+0000","last_unstale":"2024-04-04T06:57:51.570905+0000","last_undegraded":"2024-04-04T06:57:51.570905+0000","last_fullsized":"2024-04-04T06:57:51.570905+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:57:48.507843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:57:48.507843+0000","last_clean_scrub_stamp":"2024-04-04T06:57:48.507843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T15:04:48.323215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-04T06:57:51.579999+0000","last_change":"2024-04-04T06:57:50.569342+0000","last_active":"2024-04-04T06:57:51.579999+0000","last_peered":"2024-04-04T06:57:51.579999+0000","last_clean":"2024-04-04T06:57:51.579999+0000","last_became_active":"2024-04-04T06:57:50.569086+0000","last_became_peered":"2024-04-04T06:57:50.569086+0000","last_unstale":"2024-04-04T06:57:51.579999+0000","last_undegraded":"2024-04-04T06:57:51.579999+0000","last_fullsized":"2024-04-04T06:57:51.579999+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_clean_scrub_stamp":"2024-04-04T06:57:49.521429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T08:57:01.191673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"32'2","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-04T06:57:51.566174+0000","last_change":"2024-04-04T06:57:49.565317+0000","last_active":"2024-04-04T06:57:51.566174+0000","last_peered":"2024-04-04T06:57:51.566174+0000","last_clean":"2024-04-04T06:57:51.566174+0000","last_became_active":"2024-04-04T06:57:49.565036+0000","last_became_peered":"2024-04-04T06:57:49.565036+0000","last_unstale":"2024-04-04T06:57:51.566174+0000","last_undegraded":"2024-04-04T06:57:51.566174+0000","last_fullsized":"2024-04-04T06:57:51.566174+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:57:48.507843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:57:48.507843+0000","last_clean_scrub_stamp":"2024-04-04T06:57:48.507843+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T17:08:36.572829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-04T06:57:51.580745+0000","last_change":"2024-04-04T06:57:50.578519+0000","last_active":"2024-04-04T06:57:51.580745+0000","last_peered":"2024-04-04T06:57:51.580745+0000","last_clean":"2024-04-04T06:57:51.580745+0000","last_became_active":"2024-04-04T06:57:50.578108+0000","last_became_peered":"2024-04-04T06:57:50.578108+0000","last_unstale":"2024-04-04T06:57:51.580745+0000","last_undegraded":"2024-04-04T06:57:51.580745+0000","last_fullsized":"2024-04-04T06:57:51.580745+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_clean_scrub_stamp":"2024-04-04T06:57:49.521429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T08:19:48.258561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-04T06:57:51.582798+0000","last_change":"2024-04-04T06:57:49.577306+0000","last_active":"2024-04-04T06:57:51.582798+0000","last_peered":"2024-04-04T06:57:51.582798+0000","last_clean":"2024-04-04T06:57:51.582798+0000","last_became_active":"2024-04-04T06:57:49.577059+0000","last_became_peered":"2024-04-04T06:57:49.577059+0000","last_unstale":"2024-04-04T06:57:51.582798+0000","last_undegraded":"2024-04-04T06:57:51.582798+0000","last_fullsized":"2024-04-04T06:57:51.582798+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:57:48.507843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:57:48.507843+0000","last_clean_scrub_stamp":"2024-04-04T06:57:48.507843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T16:36:25.597766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-04T06:57:51.579803+0000","last_change":"2024-04-04T06:57:50.579823+0000","last_active":"2024-04-04T06:57:51.579803+0000","last_peered":"2024-04-04T06:57:51.579803+0000","last_clean":"2024-04-04T06:57:51.579803+0000","last_became_active":"2024-04-04T06:57:50.575590+0000","last_became_peered":"2024-04-04T06:57:50.575590+0000","last_unstale":"2024-04-04T06:57:51.579803+0000","last_undegraded":"2024-04-04T06:57:51.579803+0000","last_fullsized":"2024-04-04T06:57:51.579803+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_clean_scrub_stamp":"2024-04-04T06:57:49.521429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T11:46:05.894347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-04T06:57:51.571248+0000","last_change":"2024-04-04T06:57:49.567451+0000","last_active":"2024-04-04T06:57:51.571248+0000","last_peered":"2024-04-04T06:57:51.571248+0000","last_clean":"2024-04-04T06:57:51.571248+0000","last_became_active":"2024-04-04T06:57:49.567101+0000","last_became_peered":"2024-04-04T06:57:49.567101+0000","last_unstale":"2024-04-04T06:57:51.571248+0000","last_undegraded":"2024-04-04T06:57:51.571248+0000","last_fullsized":"2024-04-04T06:57:51.571248+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:57:48.507843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:57:48.507843+0000","last_clean_scrub_stamp":"2024-04-04T06:57:48.507843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T17:12:51.481243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-04T06:57:51.571049+0000","last_change":"2024-04-04T06:57:50.577113+0000","last_active":"2024-04-04T06:57:51.571049+0000","last_peered":"2024-04-04T06:57:51.571049+0000","last_clean":"2024-04-04T06:57:51.571049+0000","last_became_active":"2024-04-04T06:57:50.576515+0000","last_became_peered":"2024-04-04T06:57:50.576515+0000","last_unstale":"2024-04-04T06:57:51.571049+0000","last_undegraded":"2024-04-04T06:57:51.571049+0000","last_fullsized":"2024-04-04T06:57:51.571049+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_clean_scrub_stamp":"2024-04-04T06:57:49.521429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T07:52:03.846365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-04T06:57:51.580308+0000","last_change":"2024-04-04T06:57:49.564823+0000","last_active":"2024-04-04T06:57:51.580308+0000","last_peered":"2024-04-04T06:57:51.580308+0000","last_clean":"2024-04-04T06:57:51.580308+0000","last_became_active":"2024-04-04T06:57:49.564469+0000","last_became_peered":"2024-04-04T06:57:49.564469+0000","last_unstale":"2024-04-04T06:57:51.580308+0000","last_undegraded":"2024-04-04T06:57:51.580308+0000","last_fullsized":"2024-04-04T06:57:51.580308+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:57:48.507843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:57:48.507843+0000","last_clean_scrub_stamp":"2024-04-04T06:57:48.507843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T15:13:00.535090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-04T06:57:51.580453+0000","last_change":"2024-04-04T06:57:50.570747+0000","last_active":"2024-04-04T06:57:51.580453+0000","last_peered":"2024-04-04T06:57:51.580453+0000","last_clean":"2024-04-04T06:57:51.580453+0000","last_became_active":"2024-04-04T06:57:50.570478+0000","last_became_peered":"2024-04-04T06:57:50.570478+0000","last_unstale":"2024-04-04T06:57:51.580453+0000","last_undegraded":"2024-04-04T06:57:51.580453+0000","last_fullsized":"2024-04-04T06:57:51.580453+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_clean_scrub_stamp":"2024-04-04T06:57:49.521429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T15:04:49.336801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"32'2","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-04T06:57:51.575124+0000","last_change":"2024-04-04T06:57:49.562221+0000","last_active":"2024-04-04T06:57:51.575124+0000","last_peered":"2024-04-04T06:57:51.575124+0000","last_clean":"2024-04-04T06:57:51.575124+0000","last_became_active":"2024-04-04T06:57:49.561874+0000","last_became_peered":"2024-04-04T06:57:49.561874+0000","last_unstale":"2024-04-04T06:57:51.575124+0000","last_undegraded":"2024-04-04T06:57:51.575124+0000","last_fullsized":"2024-04-04T06:57:51.575124+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:57:48.507843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:57:48.507843+0000","last_clean_scrub_stamp":"2024-04-04T06:57:48.507843+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T09:04:39.089278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-04T06:57:51.581665+0000","last_change":"2024-04-04T06:57:50.575310+0000","last_active":"2024-04-04T06:57:51.581665+0000","last_peered":"2024-04-04T06:57:51.581665+0000","last_clean":"2024-04-04T06:57:51.581665+0000","last_became_active":"2024-04-04T06:57:50.574426+0000","last_became_peered":"2024-04-04T06:57:50.574426+0000","last_unstale":"2024-04-04T06:57:51.581665+0000","last_undegraded":"2024-04-04T06:57:51.581665+0000","last_fullsized":"2024-04-04T06:57:51.581665+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_clean_scrub_stamp":"2024-04-04T06:57:49.521429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T15:08:05.883633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"33'1","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-04T06:57:51.571598+0000","last_change":"2024-04-04T06:57:49.554627+0000","last_active":"2024-04-04T06:57:51.571598+0000","last_peered":"2024-04-04T06:57:51.571598+0000","last_clean":"2024-04-04T06:57:51.571598+0000","last_became_active":"2024-04-04T06:57:49.554182+0000","last_became_peered":"2024-04-04T06:57:49.554182+0000","last_unstale":"2024-04-04T06:57:51.571598+0000","last_undegraded":"2024-04-04T06:57:51.571598+0000","last_fullsized":"2024-04-04T06:57:51.571598+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:57:48.507843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:57:48.507843+0000","last_clean_scrub_stamp":"2024-04-04T06:57:48.507843+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T09:15:32.272861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-04T06:57:51.566586+0000","last_change":"2024-04-04T06:57:50.569862+0000","last_active":"2024-04-04T06:57:51.566586+0000","last_peered":"2024-04-04T06:57:51.566586+0000","last_clean":"2024-04-04T06:57:51.566586+0000","last_became_active":"2024-04-04T06:57:50.569543+0000","last_became_peered":"2024-04-04T06:57:50.569543+0000","last_unstale":"2024-04-04T06:57:51.566586+0000","last_undegraded":"2024-04-04T06:57:51.566586+0000","last_fullsized":"2024-04-04T06:57:51.566586+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_clean_scrub_stamp":"2024-04-04T06:57:49.521429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T12:34:36.586185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-04T06:57:51.574018+0000","last_change":"2024-04-04T06:57:49.563548+0000","last_active":"2024-04-04T06:57:51.574018+0000","last_peered":"2024-04-04T06:57:51.574018+0000","last_clean":"2024-04-04T06:57:51.574018+0000","last_became_active":"2024-04-04T06:57:49.563173+0000","last_became_peered":"2024-04-04T06:57:49.563173+0000","last_unstale":"2024-04-04T06:57:51.574018+0000","last_undegraded":"2024-04-04T06:57:51.574018+0000","last_fullsized":"2024-04-04T06:57:51.574018+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:57:48.507843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:57:48.507843+0000","last_clean_scrub_stamp":"2024-04-04T06:57:48.507843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T14:10:37.940401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-04T06:57:51.582617+0000","last_change":"2024-04-04T06:57:50.572149+0000","last_active":"2024-04-04T06:57:51.582617+0000","last_peered":"2024-04-04T06:57:51.582617+0000","last_clean":"2024-04-04T06:57:51.582617+0000","last_became_active":"2024-04-04T06:57:50.571832+0000","last_became_peered":"2024-04-04T06:57:50.571832+0000","last_unstale":"2024-04-04T06:57:51.582617+0000","last_undegraded":"2024-04-04T06:57:51.582617+0000","last_fullsized":"2024-04-04T06:57:51.582617+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_clean_scrub_stamp":"2024-04-04T06:57:49.521429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T14:10:38.953987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-04T06:57:51.566364+0000","last_change":"2024-04-04T06:57:49.565359+0000","last_active":"2024-04-04T06:57:51.566364+0000","last_peered":"2024-04-04T06:57:51.566364+0000","last_clean":"2024-04-04T06:57:51.566364+0000","last_became_active":"2024-04-04T06:57:49.565098+0000","last_became_peered":"2024-04-04T06:57:49.565098+0000","last_unstale":"2024-04-04T06:57:51.566364+0000","last_undegraded":"2024-04-04T06:57:51.566364+0000","last_fullsized":"2024-04-04T06:57:51.566364+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:57:48.507843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:57:48.507843+0000","last_clean_scrub_stamp":"2024-04-04T06:57:48.507843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T14:10:37.940401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-04T06:57:51.566206+0000","last_change":"2024-04-04T06:57:50.574284+0000","last_active":"2024-04-04T06:57:51.566206+0000","last_peered":"2024-04-04T06:57:51.566206+0000","last_clean":"2024-04-04T06:57:51.566206+0000","last_became_active":"2024-04-04T06:57:50.573914+0000","last_became_peered":"2024-04-04T06:57:50.573914+0000","last_unstale":"2024-04-04T06:57:51.566206+0000","last_undegraded":"2024-04-04T06:57:51.566206+0000","last_fullsized":"2024-04-04T06:57:51.566206+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_clean_scrub_stamp":"2024-04-04T06:57:49.521429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T15:13:01.548675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-04T06:57:51.573614+0000","last_change":"2024-04-04T06:57:49.563737+0000","last_active":"2024-04-04T06:57:51.573614+0000","last_peered":"2024-04-04T06:57:51.573614+0000","last_clean":"2024-04-04T06:57:51.573614+0000","last_became_active":"2024-04-04T06:57:49.563408+0000","last_became_peered":"2024-04-04T06:57:49.563408+0000","last_unstale":"2024-04-04T06:57:51.573614+0000","last_undegraded":"2024-04-04T06:57:51.573614+0000","last_fullsized":"2024-04-04T06:57:51.573614+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:57:48.507843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:57:48.507843+0000","last_clean_scrub_stamp":"2024-04-04T06:57:48.507843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T17:08:36.572829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-04T06:57:51.578841+0000","last_change":"2024-04-04T06:57:50.559325+0000","last_active":"2024-04-04T06:57:51.578841+0000","last_peered":"2024-04-04T06:57:51.578841+0000","last_clean":"2024-04-04T06:57:51.578841+0000","last_became_active":"2024-04-04T06:57:50.558998+0000","last_became_peered":"2024-04-04T06:57:50.558998+0000","last_unstale":"2024-04-04T06:57:51.578841+0000","last_undegraded":"2024-04-04T06:57:51.578841+0000","last_fullsized":"2024-04-04T06:57:51.578841+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_clean_scrub_stamp":"2024-04-04T06:57:49.521429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T07:14:49.491716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-04T06:57:51.571456+0000","last_change":"2024-04-04T06:57:49.565175+0000","last_active":"2024-04-04T06:57:51.571456+0000","last_peered":"2024-04-04T06:57:51.571456+0000","last_clean":"2024-04-04T06:57:51.571456+0000","last_became_active":"2024-04-04T06:57:49.564886+0000","last_became_peered":"2024-04-04T06:57:49.564886+0000","last_unstale":"2024-04-04T06:57:51.571456+0000","last_undegraded":"2024-04-04T06:57:51.571456+0000","last_fullsized":"2024-04-04T06:57:51.571456+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:57:48.507843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:57:48.507843+0000","last_clean_scrub_stamp":"2024-04-04T06:57:48.507843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T11:46:04.880762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-04T06:57:51.571000+0000","last_change":"2024-04-04T06:57:50.552529+0000","last_active":"2024-04-04T06:57:51.571000+0000","last_peered":"2024-04-04T06:57:51.571000+0000","last_clean":"2024-04-04T06:57:51.571000+0000","last_became_active":"2024-04-04T06:57:50.551948+0000","last_became_peered":"2024-04-04T06:57:50.551948+0000","last_unstale":"2024-04-04T06:57:51.571000+0000","last_undegraded":"2024-04-04T06:57:51.571000+0000","last_fullsized":"2024-04-04T06:57:51.571000+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_clean_scrub_stamp":"2024-04-04T06:57:49.521429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T09:04:40.102864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-04T06:57:51.578619+0000","last_change":"2024-04-04T06:57:49.569040+0000","last_active":"2024-04-04T06:57:51.578619+0000","last_peered":"2024-04-04T06:57:51.578619+0000","last_clean":"2024-04-04T06:57:51.578619+0000","last_became_active":"2024-04-04T06:57:49.568607+0000","last_became_peered":"2024-04-04T06:57:49.568607+0000","last_unstale":"2024-04-04T06:57:51.578619+0000","last_undegraded":"2024-04-04T06:57:51.578619+0000","last_fullsized":"2024-04-04T06:57:51.578619+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:57:48.507843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:57:48.507843+0000","last_clean_scrub_stamp":"2024-04-04T06:57:48.507843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T15:13:00.535090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-04T06:57:51.572450+0000","last_change":"2024-04-04T06:57:50.563498+0000","last_active":"2024-04-04T06:57:51.572450+0000","last_peered":"2024-04-04T06:57:51.572450+0000","last_clean":"2024-04-04T06:57:51.572450+0000","last_became_active":"2024-04-04T06:57:50.558916+0000","last_became_peered":"2024-04-04T06:57:50.558916+0000","last_unstale":"2024-04-04T06:57:51.572450+0000","last_undegraded":"2024-04-04T06:57:51.572450+0000","last_fullsized":"2024-04-04T06:57:51.572450+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_clean_scrub_stamp":"2024-04-04T06:57:49.521429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T11:07:27.160554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-04T06:57:51.582631+0000","last_change":"2024-04-04T06:57:49.569984+0000","last_active":"2024-04-04T06:57:51.582631+0000","last_peered":"2024-04-04T06:57:51.582631+0000","last_clean":"2024-04-04T06:57:51.582631+0000","last_became_active":"2024-04-04T06:57:49.569431+0000","last_became_peered":"2024-04-04T06:57:49.569431+0000","last_unstale":"2024-04-04T06:57:51.582631+0000","last_undegraded":"2024-04-04T06:57:51.582631+0000","last_fullsized":"2024-04-04T06:57:51.582631+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:57:48.507843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:57:48.507843+0000","last_clean_scrub_stamp":"2024-04-04T06:57:48.507843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T12:41:56.457052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":196,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-04T06:57:51.570599+0000","last_change":"2024-04-04T06:56:19.364611+0000","last_active":"2024-04-04T06:57:51.570599+0000","last_peered":"2024-04-04T06:57:51.570599+0000","last_clean":"2024-04-04T06:57:51.570599+0000","last_became_active":"2024-04-04T06:56:19.362232+0000","last_became_peered":"2024-04-04T06:56:19.362232+0000","last_unstale":"2024-04-04T06:57:51.570599+0000","last_undegraded":"2024-04-04T06:57:51.570599+0000","last_fullsized":"2024-04-04T06:57:51.570599+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:17.744258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:17.744258+0000","last_clean_scrub_stamp":"2024-04-04T06:56:17.744258+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T17:25:16.494215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574871,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27976,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343864,"statfs":{"total":96636764160,"available":96608116736,"internally_reserved":0,"allocated":970752,"data_stored":737066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574870,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":380928,"data_stored":147224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574870,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":380928,"data_stored":147280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574869,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":380928,"data_stored":146712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574871,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27404,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":389120,"data_stored":148242,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574871,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27388,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":376832,"data_stored":146678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574869,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27404,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":389120,"data_stored":148242,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574870,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27968,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343872,"statfs":{"total":96636764160,"available":96608124928,"internally_reserved":0,"allocated":966656,"data_stored":736976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-04T06:57:55.018 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-04T06:57:55.246 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:55.247+0000 7f86f6a00640 1 Processor -- start 2024-04-04T06:57:55.246 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:55.247+0000 7f86f6a00640 1 -- start start 2024-04-04T06:57:55.248 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:55.249+0000 7f86f6a00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f86f00b3cf0 0x7f86f006b470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:55.248 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:55.249+0000 7f86f6a00640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f86f00b4c70 con 0x7f86f015e9c0 2024-04-04T06:57:55.248 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:55.249+0000 7f86f6a00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f86f00b4120 con 0x7f86f0147e40 2024-04-04T06:57:55.248 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:55.249+0000 7f86f6a00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f86f00b43d0 con 0x7f86f00b3cf0 2024-04-04T06:57:55.248 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:55.249+0000 7f86e7400640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f86f015e9c0 0x7f86f00714c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:37814/0 (socket says 172.21.15.72:37814) 2024-04-04T06:57:55.248 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:55.249+0000 7f86e7400640 1 -- 172.21.15.72:0/3812813709 learned_addr learned my addr 172.21.15.72:0/3812813709 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-04-04T06:57:55.250 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:55.250+0000 7f86f4a00640 1 --2- 172.21.15.72:0/3812813709 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f86f00b3cf0 0x7f86f006b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:55.250 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:55.250+0000 7f86ef400640 1 -- 172.21.15.72:0/3812813709 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1480033319 0 0) 0x7f86d8001110 con 0x7f86f015e9c0 2024-04-04T06:57:55.250 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:55.250+0000 7f86ef400640 1 -- 172.21.15.72:0/3812813709 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f86d4003520 con 0x7f86f015e9c0 2024-04-04T06:57:55.250 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:55.250+0000 7f86ef400640 1 -- 172.21.15.72:0/3812813709 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2822498061 0 0) 0x7f86d4003520 con 0x7f86f015e9c0 2024-04-04T06:57:55.250 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:55.250+0000 7f86ef400640 1 -- 172.21.15.72:0/3812813709 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f86f00b3cf0 msgr2=0x7f86f006b470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:57:55.250 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:55.250+0000 7f86ef400640 1 --2- 172.21.15.72:0/3812813709 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f86f00b3cf0 0x7f86f006b470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:55.250 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:55.250+0000 7f86ef400640 1 -- 172.21.15.72:0/3812813709 >> v1:172.21.15.117:6789/0 conn(0x7f86f0147e40 legacy=0x7f86f00c74e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:55.251 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:55.250+0000 7f86ef400640 1 -- 172.21.15.72:0/3812813709 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86f00b46b0 con 0x7f86f015e9c0 2024-04-04T06:57:55.251 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:55.250+0000 7f86ef400640 1 -- 172.21.15.72:0/3812813709 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2465650867 0 0) 0x7f86d8001840 con 0x7f86f015e9c0 2024-04-04T06:57:55.251 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:55.250+0000 7f86ef400640 1 -- 172.21.15.72:0/3812813709 >> v1:172.21.15.72:6789/0 conn(0x7f86f015e9c0 legacy=0x7f86f00714c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:55.251 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:55.250+0000 7f86ef400640 1 --2- 172.21.15.72:0/3812813709 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f86f00b3cf0 0x7f86d40039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:55.251 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:55.250+0000 7f86ef400640 1 --2- 172.21.15.72:0/3812813709 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f86d4003f60 0x7f86d4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:55.251 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:55.250+0000 7f86ef400640 1 --2- 172.21.15.72:0/3812813709 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f86d4004d40 0x7f86d40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:55.251 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:55.250+0000 7f86ef400640 1 -- 172.21.15.72:0/3812813709 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f86f00b43d0 con 0x7f86d4004d40 2024-04-04T06:57:55.251 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:55.251+0000 7f86ef400640 1 -- 172.21.15.72:0/3812813709 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f86d400bc00 con 0x7f86d4003f60 2024-04-04T06:57:55.251 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:55.251+0000 7f86ef400640 1 -- 172.21.15.72:0/3812813709 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f86d400be00 con 0x7f86f00b3cf0 2024-04-04T06:57:55.251 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:55.251+0000 7f86f4a00640 1 --2- 172.21.15.72:0/3812813709 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f86d4004d40 0x7f86d40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:55.251 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:55.251+0000 7f86efe00640 1 --2- 172.21.15.72:0/3812813709 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f86f00b3cf0 0x7f86d40039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:55.251 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:55.251+0000 7f86e7400640 1 --2- 172.21.15.72:0/3812813709 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f86d4003f60 0x7f86d4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:55.251 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:55.251+0000 7f86f4a00640 1 -- 172.21.15.72:0/3812813709 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f86f00b3cf0 msgr2=0x7f86d40039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:57:55.251 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:55.251+0000 7f86f4a00640 1 --2- 172.21.15.72:0/3812813709 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f86f00b3cf0 0x7f86d40039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:55.252 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:55.251+0000 7f86f4a00640 1 -- 172.21.15.72:0/3812813709 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f86d4003f60 msgr2=0x7f86d4004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:57:55.252 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:55.251+0000 7f86f4a00640 1 --2- 172.21.15.72:0/3812813709 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f86d4003f60 0x7f86d4004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:55.252 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:55.251+0000 7f86f4a00640 1 -- 172.21.15.72:0/3812813709 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86d4003520 con 0x7f86d4004d40 2024-04-04T06:57:55.252 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:55.251+0000 7f86efe00640 1 --2- 172.21.15.72:0/3812813709 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f86f00b3cf0 0x7f86d40039e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-04T06:57:55.252 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:55.251+0000 7f86e7400640 1 --2- 172.21.15.72:0/3812813709 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f86d4003f60 0x7f86d4004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-04T06:57:55.253 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:55.252+0000 7f86f4a00640 1 --2- 172.21.15.72:0/3812813709 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f86d4004d40 0x7f86d40051c0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f86e8009ac0 tx=0x7f86d4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=963fde2e1d2d7e7 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:55.253 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:55.253+0000 7f86ef400640 1 -- 172.21.15.72:0/3812813709 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86e8039070 con 0x7f86d4004d40 2024-04-04T06:57:55.253 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:55.253+0000 7f86ef400640 1 -- 172.21.15.72:0/3812813709 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86e802c6b0 con 0x7f86d4004d40 2024-04-04T06:57:55.253 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:55.253+0000 7f86ef400640 1 -- 172.21.15.72:0/3812813709 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86e8009690 con 0x7f86d4004d40 2024-04-04T06:57:55.253 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:55.253+0000 7f86f6a00640 1 -- 172.21.15.72:0/3812813709 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f86d4004d40 msgr2=0x7f86d40051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:55.253 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:55.253+0000 7f86f6a00640 1 --2- 172.21.15.72:0/3812813709 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f86d4004d40 0x7f86d40051c0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f86e8009ac0 tx=0x7f86d4005830 comp rx=0 tx=0).stop 2024-04-04T06:57:55.254 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:55.253+0000 7f86f4a00640 1 -- 172.21.15.72:0/3812813709 reap_dead start 2024-04-04T06:57:55.254 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:55.253+0000 7f86f6a00640 1 -- 172.21.15.72:0/3812813709 shutdown_connections 2024-04-04T06:57:55.254 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:55.253+0000 7f86f6a00640 1 -- 172.21.15.72:0/3812813709 >> 172.21.15.72:0/3812813709 conn(0x7f86f00d2110 msgr2=0x7f86f00d24f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:55.254 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:55.253+0000 7f86f6a00640 1 -- 172.21.15.72:0/3812813709 shutdown_connections 2024-04-04T06:57:55.254 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:55.253+0000 7f86f6a00640 1 -- 172.21.15.72:0/3812813709 wait complete. 2024-04-04T06:57:55.255 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:55.255+0000 7f86f6a00640 1 Processor -- start 2024-04-04T06:57:55.255 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:55.255+0000 7f86f6a00640 1 -- start start 2024-04-04T06:57:55.255 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:55.256+0000 7f86f6a00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f86d4004d40 0x7f86f00b7b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:55.255 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:55.256+0000 7f86f6a00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f86f00c9b60 0x7f86f00c9fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:55.255 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:55.256+0000 7f86f6a00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f86f0142440 0x7f86f01428c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:55.255 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:55.256+0000 7f86f6a00640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f86f00c71e0 con 0x7f86f00c9b60 2024-04-04T06:57:55.255 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:55.256+0000 7f86f6a00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f86f0070fa0 con 0x7f86f0142440 2024-04-04T06:57:55.255 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:55.256+0000 7f86f6a00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f86f00c7bf0 con 0x7f86d4004d40 2024-04-04T06:57:55.255 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:55.256+0000 7f86e7400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f86f00c9b60 0x7f86f00c9fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:55.255 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:55.256+0000 7f86e7400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f86f00c9b60 0x7f86f00c9fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:38898/0 (socket says 172.21.15.72:38898) 2024-04-04T06:57:55.256 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:55.256+0000 7f86e7400640 1 -- 172.21.15.72:0/2225143911 learned_addr learned my addr 172.21.15.72:0/2225143911 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:57:55.257 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:55.257+0000 7f86f4a00640 1 --2- 172.21.15.72:0/2225143911 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f86f0142440 0x7f86f01428c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:55.257 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:55.257+0000 7f86efe00640 1 --2- 172.21.15.72:0/2225143911 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f86d4004d40 0x7f86f00b7b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:55.257 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:55.257+0000 7f86e7400640 1 -- 172.21.15.72:0/2225143911 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f86d4004d40 msgr2=0x7f86f00b7b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:55.257 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:55.257+0000 7f86e7400640 1 --2- 172.21.15.72:0/2225143911 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f86d4004d40 0x7f86f00b7b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:55.257 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:55.257+0000 7f86e7400640 1 -- 172.21.15.72:0/2225143911 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f86f0142440 msgr2=0x7f86f01428c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:55.257 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:55.257+0000 7f86e7400640 1 --2- 172.21.15.72:0/2225143911 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f86f0142440 0x7f86f01428c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:55.257 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:55.257+0000 7f86e7400640 1 -- 172.21.15.72:0/2225143911 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86f00c9480 con 0x7f86f00c9b60 2024-04-04T06:57:55.257 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:55.257+0000 7f86e7400640 1 --2- 172.21.15.72:0/2225143911 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f86f00c9b60 0x7f86f00c9fe0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f86d8001eb0 tx=0x7f86d800dd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:55.257 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:55.258+0000 7f86ecc00640 1 -- 172.21.15.72:0/2225143911 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86d8019070 con 0x7f86f00c9b60 2024-04-04T06:57:55.258 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:55.258+0000 7f86ecc00640 1 -- 172.21.15.72:0/2225143911 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86d80075a0 con 0x7f86f00c9b60 2024-04-04T06:57:55.258 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:55.258+0000 7f86f6a00640 1 -- 172.21.15.72:0/2225143911 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86f01f5790 con 0x7f86f00c9b60 2024-04-04T06:57:55.258 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:55.258+0000 7f86ecc00640 1 -- 172.21.15.72:0/2225143911 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86d8004a20 con 0x7f86f00c9b60 2024-04-04T06:57:55.258 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:55.258+0000 7f86f6a00640 1 -- 172.21.15.72:0/2225143911 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86f01f5d50 con 0x7f86f00c9b60 2024-04-04T06:57:55.259 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:55.259+0000 7f86f6a00640 1 -- 172.21.15.72:0/2225143911 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86f0068760 con 0x7f86f00c9b60 2024-04-04T06:57:55.259 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:55.260+0000 7f86ecc00640 1 -- 172.21.15.72:0/2225143911 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f86d801c070 con 0x7f86f00c9b60 2024-04-04T06:57:55.263 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:55.261+0000 7f86ecc00640 1 --2- 172.21.15.72:0/2225143911 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f86cc06c8f0 0x7f86cc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:55.263 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:55.261+0000 7f86ecc00640 1 -- 172.21.15.72:0/2225143911 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f86d808b7d0 con 0x7f86f00c9b60 2024-04-04T06:57:55.263 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:55.262+0000 7f86efe00640 1 --2- 172.21.15.72:0/2225143911 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f86cc06c8f0 0x7f86cc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:55.264 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:55.262+0000 7f86efe00640 1 --2- 172.21.15.72:0/2225143911 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f86cc06c8f0 0x7f86cc06edb0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f86f015e4e0 tx=0x7f86e0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:55.264 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:55.265+0000 7f86ecc00640 1 -- 172.21.15.72:0/2225143911 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f86f0068760 con 0x7f86f00c9b60 2024-04-04T06:57:55.462 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:55.463+0000 7f86f6a00640 1 -- 172.21.15.72:0/2225143911 --> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f86f0075840 con 0x7f86cc06c8f0 2024-04-04T06:57:55.484 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:55.485+0000 7f86ecc00640 1 -- 172.21.15.72:0/2225143911 <== mgr.4101 v2:172.21.15.72:6832/2205173820 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251948 (secure 0 0 0) 0x7f86f0075840 con 0x7f86cc06c8f0 2024-04-04T06:57:55.487 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T06:57:55.489 INFO:teuthology.orchestra.run.smithi072.stderr:dumped all 2024-04-04T06:57:55.490 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:55.490+0000 7f86f6a00640 1 -- 172.21.15.72:0/2225143911 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f86cc06c8f0 msgr2=0x7f86cc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:55.491 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:55.490+0000 7f86f6a00640 1 --2- 172.21.15.72:0/2225143911 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f86cc06c8f0 0x7f86cc06edb0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f86f015e4e0 tx=0x7f86e0009040 comp rx=0 tx=0).stop 2024-04-04T06:57:55.491 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:55.490+0000 7f86f6a00640 1 -- 172.21.15.72:0/2225143911 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f86f00c9b60 msgr2=0x7f86f00c9fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:55.491 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:55.490+0000 7f86f6a00640 1 --2- 172.21.15.72:0/2225143911 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f86f00c9b60 0x7f86f00c9fe0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f86d8001eb0 tx=0x7f86d800dd60 comp rx=0 tx=0).stop 2024-04-04T06:57:55.491 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:55.490+0000 7f86f6a00640 1 -- 172.21.15.72:0/2225143911 shutdown_connections 2024-04-04T06:57:55.491 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:55.490+0000 7f86f6a00640 1 --2- 172.21.15.72:0/2225143911 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f86cc06c8f0 0x7f86cc06edb0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:55.491 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:55.490+0000 7f86f6a00640 1 --2- 172.21.15.72:0/2225143911 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f86f0142440 0x7f86f01428c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:55.491 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:55.490+0000 7f86f6a00640 1 --2- 172.21.15.72:0/2225143911 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f86f00c9b60 0x7f86f00c9fe0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:55.491 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:55.490+0000 7f86f6a00640 1 --2- 172.21.15.72:0/2225143911 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f86d4004d40 0x7f86f00b7b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:55.491 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:55.490+0000 7f86f6a00640 1 -- 172.21.15.72:0/2225143911 >> 172.21.15.72:0/2225143911 conn(0x7f86f00d2110 msgr2=0x7f86f00ceb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:55.491 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:55.490+0000 7f86f6a00640 1 -- 172.21.15.72:0/2225143911 shutdown_connections 2024-04-04T06:57:55.491 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:55.490+0000 7f86f6a00640 1 -- 172.21.15.72:0/2225143911 wait complete. 2024-04-04T06:57:55.508 INFO:teuthology.orchestra.run.smithi072.stdout:{"pg_ready":true,"pg_map":{"version":75,"stamp":"2024-04-04T06:57:55.413131+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":116,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220324,"kb_used_data":4136,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754396,"statfs":{"total":773094113280,"available":772868501504,"internally_reserved":0,"allocated":4235264,"data_stored":2358420,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":38,"apply_latency_ms":38,"commit_latency_ns":38000000,"apply_latency_ns":38000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001954"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-04T06:57:51.583247+0000","last_change":"2024-04-04T06:57:50.579876+0000","last_active":"2024-04-04T06:57:51.583247+0000","last_peered":"2024-04-04T06:57:51.583247+0000","last_clean":"2024-04-04T06:57:51.583247+0000","last_became_active":"2024-04-04T06:57:50.579368+0000","last_became_peered":"2024-04-04T06:57:50.579368+0000","last_unstale":"2024-04-04T06:57:51.583247+0000","last_undegraded":"2024-04-04T06:57:51.583247+0000","last_fullsized":"2024-04-04T06:57:51.583247+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_clean_scrub_stamp":"2024-04-04T06:57:49.521429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T07:00:47.771739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-04T06:57:51.579648+0000","last_change":"2024-04-04T06:57:50.562180+0000","last_active":"2024-04-04T06:57:51.579648+0000","last_peered":"2024-04-04T06:57:51.579648+0000","last_clean":"2024-04-04T06:57:51.579648+0000","last_became_active":"2024-04-04T06:57:50.561858+0000","last_became_peered":"2024-04-04T06:57:50.561858+0000","last_unstale":"2024-04-04T06:57:51.579648+0000","last_undegraded":"2024-04-04T06:57:51.579648+0000","last_fullsized":"2024-04-04T06:57:51.579648+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_clean_scrub_stamp":"2024-04-04T06:57:49.521429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T08:06:49.659344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-04T06:57:51.581492+0000","last_change":"2024-04-04T06:57:50.572064+0000","last_active":"2024-04-04T06:57:51.581492+0000","last_peered":"2024-04-04T06:57:51.581492+0000","last_clean":"2024-04-04T06:57:51.581492+0000","last_became_active":"2024-04-04T06:57:50.571674+0000","last_became_peered":"2024-04-04T06:57:50.571674+0000","last_unstale":"2024-04-04T06:57:51.581492+0000","last_undegraded":"2024-04-04T06:57:51.581492+0000","last_fullsized":"2024-04-04T06:57:51.581492+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_clean_scrub_stamp":"2024-04-04T06:57:49.521429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T17:30:40.936288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-04T06:57:51.573674+0000","last_change":"2024-04-04T06:57:50.564353+0000","last_active":"2024-04-04T06:57:51.573674+0000","last_peered":"2024-04-04T06:57:51.573674+0000","last_clean":"2024-04-04T06:57:51.573674+0000","last_became_active":"2024-04-04T06:57:50.563733+0000","last_became_peered":"2024-04-04T06:57:50.563733+0000","last_unstale":"2024-04-04T06:57:51.573674+0000","last_undegraded":"2024-04-04T06:57:51.573674+0000","last_fullsized":"2024-04-04T06:57:51.573674+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_clean_scrub_stamp":"2024-04-04T06:57:49.521429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T12:46:28.589425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-04T06:57:51.580324+0000","last_change":"2024-04-04T06:57:50.581481+0000","last_active":"2024-04-04T06:57:51.580324+0000","last_peered":"2024-04-04T06:57:51.580324+0000","last_clean":"2024-04-04T06:57:51.580324+0000","last_became_active":"2024-04-04T06:57:50.579177+0000","last_became_peered":"2024-04-04T06:57:50.579177+0000","last_unstale":"2024-04-04T06:57:51.580324+0000","last_undegraded":"2024-04-04T06:57:51.580324+0000","last_fullsized":"2024-04-04T06:57:51.580324+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_clean_scrub_stamp":"2024-04-04T06:57:49.521429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T14:53:46.101613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-04T06:57:51.578782+0000","last_change":"2024-04-04T06:57:50.561066+0000","last_active":"2024-04-04T06:57:51.578782+0000","last_peered":"2024-04-04T06:57:51.578782+0000","last_clean":"2024-04-04T06:57:51.578782+0000","last_became_active":"2024-04-04T06:57:50.559042+0000","last_became_peered":"2024-04-04T06:57:50.559042+0000","last_unstale":"2024-04-04T06:57:51.578782+0000","last_undegraded":"2024-04-04T06:57:51.578782+0000","last_fullsized":"2024-04-04T06:57:51.578782+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_clean_scrub_stamp":"2024-04-04T06:57:49.521429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T07:52:03.846365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-04T06:57:51.571398+0000","last_change":"2024-04-04T06:57:50.567989+0000","last_active":"2024-04-04T06:57:51.571398+0000","last_peered":"2024-04-04T06:57:51.571398+0000","last_clean":"2024-04-04T06:57:51.571398+0000","last_became_active":"2024-04-04T06:57:50.567720+0000","last_became_peered":"2024-04-04T06:57:50.567720+0000","last_unstale":"2024-04-04T06:57:51.571398+0000","last_undegraded":"2024-04-04T06:57:51.571398+0000","last_fullsized":"2024-04-04T06:57:51.571398+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_clean_scrub_stamp":"2024-04-04T06:57:49.521429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T07:14:49.491716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-04T06:57:51.569534+0000","last_change":"2024-04-04T06:57:50.562327+0000","last_active":"2024-04-04T06:57:51.569534+0000","last_peered":"2024-04-04T06:57:51.569534+0000","last_clean":"2024-04-04T06:57:51.569534+0000","last_became_active":"2024-04-04T06:57:50.562019+0000","last_became_peered":"2024-04-04T06:57:50.562019+0000","last_unstale":"2024-04-04T06:57:51.569534+0000","last_undegraded":"2024-04-04T06:57:51.569534+0000","last_fullsized":"2024-04-04T06:57:51.569534+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_clean_scrub_stamp":"2024-04-04T06:57:49.521429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T15:03:45.455031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-04T06:57:51.572613+0000","last_change":"2024-04-04T06:57:50.565899+0000","last_active":"2024-04-04T06:57:51.572613+0000","last_peered":"2024-04-04T06:57:51.572613+0000","last_clean":"2024-04-04T06:57:51.572613+0000","last_became_active":"2024-04-04T06:57:50.565638+0000","last_became_peered":"2024-04-04T06:57:50.565638+0000","last_unstale":"2024-04-04T06:57:51.572613+0000","last_undegraded":"2024-04-04T06:57:51.572613+0000","last_fullsized":"2024-04-04T06:57:51.572613+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_clean_scrub_stamp":"2024-04-04T06:57:49.521429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T15:13:01.548675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-04T06:57:51.574275+0000","last_change":"2024-04-04T06:57:50.567444+0000","last_active":"2024-04-04T06:57:51.574275+0000","last_peered":"2024-04-04T06:57:51.574275+0000","last_clean":"2024-04-04T06:57:51.574275+0000","last_became_active":"2024-04-04T06:57:50.566135+0000","last_became_peered":"2024-04-04T06:57:50.566135+0000","last_unstale":"2024-04-04T06:57:51.574275+0000","last_undegraded":"2024-04-04T06:57:51.574275+0000","last_fullsized":"2024-04-04T06:57:51.574275+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_clean_scrub_stamp":"2024-04-04T06:57:49.521429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T12:23:30.739887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-04T06:57:51.572795+0000","last_change":"2024-04-04T06:57:50.567307+0000","last_active":"2024-04-04T06:57:51.572795+0000","last_peered":"2024-04-04T06:57:51.572795+0000","last_clean":"2024-04-04T06:57:51.572795+0000","last_became_active":"2024-04-04T06:57:50.566662+0000","last_became_peered":"2024-04-04T06:57:50.566662+0000","last_unstale":"2024-04-04T06:57:51.572795+0000","last_undegraded":"2024-04-04T06:57:51.572795+0000","last_fullsized":"2024-04-04T06:57:51.572795+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_clean_scrub_stamp":"2024-04-04T06:57:49.521429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T15:08:05.883633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-04T06:57:51.581182+0000","last_change":"2024-04-04T06:57:50.570736+0000","last_active":"2024-04-04T06:57:51.581182+0000","last_peered":"2024-04-04T06:57:51.581182+0000","last_clean":"2024-04-04T06:57:51.581182+0000","last_became_active":"2024-04-04T06:57:50.570227+0000","last_became_peered":"2024-04-04T06:57:50.570227+0000","last_unstale":"2024-04-04T06:57:51.581182+0000","last_undegraded":"2024-04-04T06:57:51.581182+0000","last_fullsized":"2024-04-04T06:57:51.581182+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_clean_scrub_stamp":"2024-04-04T06:57:49.521429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T11:10:45.270383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-04T06:57:51.580580+0000","last_change":"2024-04-04T06:57:50.564989+0000","last_active":"2024-04-04T06:57:51.580580+0000","last_peered":"2024-04-04T06:57:51.580580+0000","last_clean":"2024-04-04T06:57:51.580580+0000","last_became_active":"2024-04-04T06:57:50.564665+0000","last_became_peered":"2024-04-04T06:57:50.564665+0000","last_unstale":"2024-04-04T06:57:51.580580+0000","last_undegraded":"2024-04-04T06:57:51.580580+0000","last_fullsized":"2024-04-04T06:57:51.580580+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_clean_scrub_stamp":"2024-04-04T06:57:49.521429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T12:41:57.470638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-04T06:57:51.578895+0000","last_change":"2024-04-04T06:57:50.561538+0000","last_active":"2024-04-04T06:57:51.578895+0000","last_peered":"2024-04-04T06:57:51.578895+0000","last_clean":"2024-04-04T06:57:51.578895+0000","last_became_active":"2024-04-04T06:57:50.561215+0000","last_became_peered":"2024-04-04T06:57:50.561215+0000","last_unstale":"2024-04-04T06:57:51.578895+0000","last_undegraded":"2024-04-04T06:57:51.578895+0000","last_fullsized":"2024-04-04T06:57:51.578895+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_clean_scrub_stamp":"2024-04-04T06:57:49.521429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T12:32:44.007516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-04T06:57:51.580462+0000","last_change":"2024-04-04T06:57:50.572605+0000","last_active":"2024-04-04T06:57:51.580462+0000","last_peered":"2024-04-04T06:57:51.580462+0000","last_clean":"2024-04-04T06:57:51.580462+0000","last_became_active":"2024-04-04T06:57:50.571313+0000","last_became_peered":"2024-04-04T06:57:50.571313+0000","last_unstale":"2024-04-04T06:57:51.580462+0000","last_undegraded":"2024-04-04T06:57:51.580462+0000","last_fullsized":"2024-04-04T06:57:51.580462+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_clean_scrub_stamp":"2024-04-04T06:57:49.521429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T09:30:01.998412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-04T06:57:51.570508+0000","last_change":"2024-04-04T06:57:50.562101+0000","last_active":"2024-04-04T06:57:51.570508+0000","last_peered":"2024-04-04T06:57:51.570508+0000","last_clean":"2024-04-04T06:57:51.570508+0000","last_became_active":"2024-04-04T06:57:50.561785+0000","last_became_peered":"2024-04-04T06:57:50.561785+0000","last_unstale":"2024-04-04T06:57:51.570508+0000","last_undegraded":"2024-04-04T06:57:51.570508+0000","last_fullsized":"2024-04-04T06:57:51.570508+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_clean_scrub_stamp":"2024-04-04T06:57:49.521429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T11:10:45.270383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-04T06:57:51.573054+0000","last_change":"2024-04-04T06:57:50.571143+0000","last_active":"2024-04-04T06:57:51.573054+0000","last_peered":"2024-04-04T06:57:51.573054+0000","last_clean":"2024-04-04T06:57:51.573054+0000","last_became_active":"2024-04-04T06:57:50.570877+0000","last_became_peered":"2024-04-04T06:57:50.570877+0000","last_unstale":"2024-04-04T06:57:51.573054+0000","last_undegraded":"2024-04-04T06:57:51.573054+0000","last_fullsized":"2024-04-04T06:57:51.573054+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_clean_scrub_stamp":"2024-04-04T06:57:49.521429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T18:36:51.123426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-04T06:57:51.579519+0000","last_change":"2024-04-04T06:57:50.567450+0000","last_active":"2024-04-04T06:57:51.579519+0000","last_peered":"2024-04-04T06:57:51.579519+0000","last_clean":"2024-04-04T06:57:51.579519+0000","last_became_active":"2024-04-04T06:57:50.566627+0000","last_became_peered":"2024-04-04T06:57:50.566627+0000","last_unstale":"2024-04-04T06:57:51.579519+0000","last_undegraded":"2024-04-04T06:57:51.579519+0000","last_fullsized":"2024-04-04T06:57:51.579519+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_clean_scrub_stamp":"2024-04-04T06:57:49.521429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T18:36:51.123426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-04T06:57:51.578933+0000","last_change":"2024-04-04T06:57:50.567126+0000","last_active":"2024-04-04T06:57:51.578933+0000","last_peered":"2024-04-04T06:57:51.578933+0000","last_clean":"2024-04-04T06:57:51.578933+0000","last_became_active":"2024-04-04T06:57:50.566782+0000","last_became_peered":"2024-04-04T06:57:50.566782+0000","last_unstale":"2024-04-04T06:57:51.578933+0000","last_undegraded":"2024-04-04T06:57:51.578933+0000","last_fullsized":"2024-04-04T06:57:51.578933+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_clean_scrub_stamp":"2024-04-04T06:57:49.521429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T17:30:40.936288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-04T06:57:51.580236+0000","last_change":"2024-04-04T06:57:50.580454+0000","last_active":"2024-04-04T06:57:51.580236+0000","last_peered":"2024-04-04T06:57:51.580236+0000","last_clean":"2024-04-04T06:57:51.580236+0000","last_became_active":"2024-04-04T06:57:50.580053+0000","last_became_peered":"2024-04-04T06:57:50.580053+0000","last_unstale":"2024-04-04T06:57:51.580236+0000","last_undegraded":"2024-04-04T06:57:51.580236+0000","last_fullsized":"2024-04-04T06:57:51.580236+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_clean_scrub_stamp":"2024-04-04T06:57:49.521429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T16:04:20.779973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-04T06:57:51.570453+0000","last_change":"2024-04-04T06:57:50.562140+0000","last_active":"2024-04-04T06:57:51.570453+0000","last_peered":"2024-04-04T06:57:51.570453+0000","last_clean":"2024-04-04T06:57:51.570453+0000","last_became_active":"2024-04-04T06:57:50.561727+0000","last_became_peered":"2024-04-04T06:57:50.561727+0000","last_unstale":"2024-04-04T06:57:51.570453+0000","last_undegraded":"2024-04-04T06:57:51.570453+0000","last_fullsized":"2024-04-04T06:57:51.570453+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_clean_scrub_stamp":"2024-04-04T06:57:49.521429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T17:08:37.586414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-04T06:57:51.571948+0000","last_change":"2024-04-04T06:57:50.551779+0000","last_active":"2024-04-04T06:57:51.571948+0000","last_peered":"2024-04-04T06:57:51.571948+0000","last_clean":"2024-04-04T06:57:51.571948+0000","last_became_active":"2024-04-04T06:57:50.547478+0000","last_became_peered":"2024-04-04T06:57:50.547478+0000","last_unstale":"2024-04-04T06:57:51.571948+0000","last_undegraded":"2024-04-04T06:57:51.571948+0000","last_fullsized":"2024-04-04T06:57:51.571948+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_clean_scrub_stamp":"2024-04-04T06:57:49.521429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T07:00:47.771739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-04T06:57:51.566202+0000","last_change":"2024-04-04T06:57:50.564506+0000","last_active":"2024-04-04T06:57:51.566202+0000","last_peered":"2024-04-04T06:57:51.566202+0000","last_clean":"2024-04-04T06:57:51.566202+0000","last_became_active":"2024-04-04T06:57:50.564220+0000","last_became_peered":"2024-04-04T06:57:50.564220+0000","last_unstale":"2024-04-04T06:57:51.566202+0000","last_undegraded":"2024-04-04T06:57:51.566202+0000","last_fullsized":"2024-04-04T06:57:51.566202+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_clean_scrub_stamp":"2024-04-04T06:57:49.521429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T15:58:35.455393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-04T06:57:51.580422+0000","last_change":"2024-04-04T06:57:50.565263+0000","last_active":"2024-04-04T06:57:51.580422+0000","last_peered":"2024-04-04T06:57:51.580422+0000","last_clean":"2024-04-04T06:57:51.580422+0000","last_became_active":"2024-04-04T06:57:50.564791+0000","last_became_peered":"2024-04-04T06:57:50.564791+0000","last_unstale":"2024-04-04T06:57:51.580422+0000","last_undegraded":"2024-04-04T06:57:51.580422+0000","last_fullsized":"2024-04-04T06:57:51.580422+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_clean_scrub_stamp":"2024-04-04T06:57:49.521429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T15:03:45.455031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-04T06:57:51.574750+0000","last_change":"2024-04-04T06:57:50.567205+0000","last_active":"2024-04-04T06:57:51.574750+0000","last_peered":"2024-04-04T06:57:51.574750+0000","last_clean":"2024-04-04T06:57:51.574750+0000","last_became_active":"2024-04-04T06:57:50.565816+0000","last_became_peered":"2024-04-04T06:57:50.565816+0000","last_unstale":"2024-04-04T06:57:51.574750+0000","last_undegraded":"2024-04-04T06:57:51.574750+0000","last_fullsized":"2024-04-04T06:57:51.574750+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_clean_scrub_stamp":"2024-04-04T06:57:49.521429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T09:30:01.998412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-04T06:57:51.579840+0000","last_change":"2024-04-04T06:57:50.576403+0000","last_active":"2024-04-04T06:57:51.579840+0000","last_peered":"2024-04-04T06:57:51.579840+0000","last_clean":"2024-04-04T06:57:51.579840+0000","last_became_active":"2024-04-04T06:57:50.574383+0000","last_became_peered":"2024-04-04T06:57:50.574383+0000","last_unstale":"2024-04-04T06:57:51.579840+0000","last_undegraded":"2024-04-04T06:57:51.579840+0000","last_fullsized":"2024-04-04T06:57:51.579840+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_clean_scrub_stamp":"2024-04-04T06:57:49.521429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T17:25:49.648650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-04T06:57:51.574319+0000","last_change":"2024-04-04T06:57:50.573431+0000","last_active":"2024-04-04T06:57:51.574319+0000","last_peered":"2024-04-04T06:57:51.574319+0000","last_clean":"2024-04-04T06:57:51.574319+0000","last_became_active":"2024-04-04T06:57:50.570888+0000","last_became_peered":"2024-04-04T06:57:50.570888+0000","last_unstale":"2024-04-04T06:57:51.574319+0000","last_undegraded":"2024-04-04T06:57:51.574319+0000","last_fullsized":"2024-04-04T06:57:51.574319+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_clean_scrub_stamp":"2024-04-04T06:57:49.521429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T17:34:44.962343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-04T06:57:51.581342+0000","last_change":"2024-04-04T06:57:50.566628+0000","last_active":"2024-04-04T06:57:51.581342+0000","last_peered":"2024-04-04T06:57:51.581342+0000","last_clean":"2024-04-04T06:57:51.581342+0000","last_became_active":"2024-04-04T06:57:50.563112+0000","last_became_peered":"2024-04-04T06:57:50.563112+0000","last_unstale":"2024-04-04T06:57:51.581342+0000","last_undegraded":"2024-04-04T06:57:51.581342+0000","last_fullsized":"2024-04-04T06:57:51.581342+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_clean_scrub_stamp":"2024-04-04T06:57:49.521429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T07:14:49.491716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-04T06:57:51.570835+0000","last_change":"2024-04-04T06:57:50.550575+0000","last_active":"2024-04-04T06:57:51.570835+0000","last_peered":"2024-04-04T06:57:51.570835+0000","last_clean":"2024-04-04T06:57:51.570835+0000","last_became_active":"2024-04-04T06:57:50.546749+0000","last_became_peered":"2024-04-04T06:57:50.546749+0000","last_unstale":"2024-04-04T06:57:51.570835+0000","last_undegraded":"2024-04-04T06:57:51.570835+0000","last_fullsized":"2024-04-04T06:57:51.570835+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_clean_scrub_stamp":"2024-04-04T06:57:49.521429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T11:22:05.401737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-04T06:57:51.571725+0000","last_change":"2024-04-04T06:57:50.570556+0000","last_active":"2024-04-04T06:57:51.571725+0000","last_peered":"2024-04-04T06:57:51.571725+0000","last_clean":"2024-04-04T06:57:51.571725+0000","last_became_active":"2024-04-04T06:57:50.570307+0000","last_became_peered":"2024-04-04T06:57:50.570307+0000","last_unstale":"2024-04-04T06:57:51.571725+0000","last_undegraded":"2024-04-04T06:57:51.571725+0000","last_fullsized":"2024-04-04T06:57:51.571725+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_clean_scrub_stamp":"2024-04-04T06:57:49.521429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T12:32:44.007516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-04T06:57:51.582497+0000","last_change":"2024-04-04T06:57:50.575684+0000","last_active":"2024-04-04T06:57:51.582497+0000","last_peered":"2024-04-04T06:57:51.582497+0000","last_clean":"2024-04-04T06:57:51.582497+0000","last_became_active":"2024-04-04T06:57:50.575246+0000","last_became_peered":"2024-04-04T06:57:50.575246+0000","last_unstale":"2024-04-04T06:57:51.582497+0000","last_undegraded":"2024-04-04T06:57:51.582497+0000","last_fullsized":"2024-04-04T06:57:51.582497+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_clean_scrub_stamp":"2024-04-04T06:57:49.521429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T17:08:37.586414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-04T06:57:51.569618+0000","last_change":"2024-04-04T06:57:50.565238+0000","last_active":"2024-04-04T06:57:51.569618+0000","last_peered":"2024-04-04T06:57:51.569618+0000","last_clean":"2024-04-04T06:57:51.569618+0000","last_became_active":"2024-04-04T06:57:50.564960+0000","last_became_peered":"2024-04-04T06:57:50.564960+0000","last_unstale":"2024-04-04T06:57:51.569618+0000","last_undegraded":"2024-04-04T06:57:51.569618+0000","last_fullsized":"2024-04-04T06:57:51.569618+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_clean_scrub_stamp":"2024-04-04T06:57:49.521429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T09:30:01.998412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-04T06:57:51.566287+0000","last_change":"2024-04-04T06:57:50.569958+0000","last_active":"2024-04-04T06:57:51.566287+0000","last_peered":"2024-04-04T06:57:51.566287+0000","last_clean":"2024-04-04T06:57:51.566287+0000","last_became_active":"2024-04-04T06:57:50.569640+0000","last_became_peered":"2024-04-04T06:57:50.569640+0000","last_unstale":"2024-04-04T06:57:51.566287+0000","last_undegraded":"2024-04-04T06:57:51.566287+0000","last_fullsized":"2024-04-04T06:57:51.566287+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_clean_scrub_stamp":"2024-04-04T06:57:49.521429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T16:44:52.700218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"32'4","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-04T06:57:51.583576+0000","last_change":"2024-04-04T06:57:49.574011+0000","last_active":"2024-04-04T06:57:51.583576+0000","last_peered":"2024-04-04T06:57:51.583576+0000","last_clean":"2024-04-04T06:57:51.583576+0000","last_became_active":"2024-04-04T06:57:49.573737+0000","last_became_peered":"2024-04-04T06:57:49.573737+0000","last_unstale":"2024-04-04T06:57:51.583576+0000","last_undegraded":"2024-04-04T06:57:51.583576+0000","last_fullsized":"2024-04-04T06:57:51.583576+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:57:48.507843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:57:48.507843+0000","last_clean_scrub_stamp":"2024-04-04T06:57:48.507843+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T08:19:47.244976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-04T06:57:51.583235+0000","last_change":"2024-04-04T06:57:50.574673+0000","last_active":"2024-04-04T06:57:51.583235+0000","last_peered":"2024-04-04T06:57:51.583235+0000","last_clean":"2024-04-04T06:57:51.583235+0000","last_became_active":"2024-04-04T06:57:50.574345+0000","last_became_peered":"2024-04-04T06:57:50.574345+0000","last_unstale":"2024-04-04T06:57:51.583235+0000","last_undegraded":"2024-04-04T06:57:51.583235+0000","last_fullsized":"2024-04-04T06:57:51.583235+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_clean_scrub_stamp":"2024-04-04T06:57:49.521429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T09:04:40.102864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"32'1","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-04T06:57:51.566220+0000","last_change":"2024-04-04T06:57:49.560801+0000","last_active":"2024-04-04T06:57:51.566220+0000","last_peered":"2024-04-04T06:57:51.566220+0000","last_clean":"2024-04-04T06:57:51.566220+0000","last_became_active":"2024-04-04T06:57:49.560491+0000","last_became_peered":"2024-04-04T06:57:49.560491+0000","last_unstale":"2024-04-04T06:57:51.566220+0000","last_undegraded":"2024-04-04T06:57:51.566220+0000","last_fullsized":"2024-04-04T06:57:51.566220+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:57:48.507843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:57:48.507843+0000","last_clean_scrub_stamp":"2024-04-04T06:57:48.507843+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T08:03:58.694981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-04T06:57:51.570666+0000","last_change":"2024-04-04T06:57:50.550573+0000","last_active":"2024-04-04T06:57:51.570666+0000","last_peered":"2024-04-04T06:57:51.570666+0000","last_clean":"2024-04-04T06:57:51.570666+0000","last_became_active":"2024-04-04T06:57:50.549971+0000","last_became_peered":"2024-04-04T06:57:50.549971+0000","last_unstale":"2024-04-04T06:57:51.570666+0000","last_undegraded":"2024-04-04T06:57:51.570666+0000","last_fullsized":"2024-04-04T06:57:51.570666+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_clean_scrub_stamp":"2024-04-04T06:57:49.521429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T14:10:38.953987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"32'2","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-04T06:57:51.578985+0000","last_change":"2024-04-04T06:57:49.576214+0000","last_active":"2024-04-04T06:57:51.578985+0000","last_peered":"2024-04-04T06:57:51.578985+0000","last_clean":"2024-04-04T06:57:51.578985+0000","last_became_active":"2024-04-04T06:57:49.575920+0000","last_became_peered":"2024-04-04T06:57:49.575920+0000","last_unstale":"2024-04-04T06:57:51.578985+0000","last_undegraded":"2024-04-04T06:57:51.578985+0000","last_fullsized":"2024-04-04T06:57:51.578985+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:57:48.507843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:57:48.507843+0000","last_clean_scrub_stamp":"2024-04-04T06:57:48.507843+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T16:44:51.686632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-04T06:57:51.574407+0000","last_change":"2024-04-04T06:57:50.573138+0000","last_active":"2024-04-04T06:57:51.574407+0000","last_peered":"2024-04-04T06:57:51.574407+0000","last_clean":"2024-04-04T06:57:51.574407+0000","last_became_active":"2024-04-04T06:57:50.570518+0000","last_became_peered":"2024-04-04T06:57:50.570518+0000","last_unstale":"2024-04-04T06:57:51.574407+0000","last_undegraded":"2024-04-04T06:57:51.574407+0000","last_fullsized":"2024-04-04T06:57:51.574407+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_clean_scrub_stamp":"2024-04-04T06:57:49.521429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T15:03:45.455031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"32'2","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-04T06:57:51.580399+0000","last_change":"2024-04-04T06:57:49.569871+0000","last_active":"2024-04-04T06:57:51.580399+0000","last_peered":"2024-04-04T06:57:51.580399+0000","last_clean":"2024-04-04T06:57:51.580399+0000","last_became_active":"2024-04-04T06:57:49.568180+0000","last_became_peered":"2024-04-04T06:57:49.568180+0000","last_unstale":"2024-04-04T06:57:51.580399+0000","last_undegraded":"2024-04-04T06:57:51.580399+0000","last_fullsized":"2024-04-04T06:57:51.580399+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:57:48.507843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:57:48.507843+0000","last_clean_scrub_stamp":"2024-04-04T06:57:48.507843+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T12:57:21.127133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-04T06:57:51.571950+0000","last_change":"2024-04-04T06:57:50.568226+0000","last_active":"2024-04-04T06:57:51.571950+0000","last_peered":"2024-04-04T06:57:51.571950+0000","last_clean":"2024-04-04T06:57:51.571950+0000","last_became_active":"2024-04-04T06:57:50.567342+0000","last_became_peered":"2024-04-04T06:57:50.567342+0000","last_unstale":"2024-04-04T06:57:51.571950+0000","last_undegraded":"2024-04-04T06:57:51.571950+0000","last_fullsized":"2024-04-04T06:57:51.571950+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_clean_scrub_stamp":"2024-04-04T06:57:49.521429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T17:30:40.936288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"32'1","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-04T06:57:51.571043+0000","last_change":"2024-04-04T06:57:49.566562+0000","last_active":"2024-04-04T06:57:51.571043+0000","last_peered":"2024-04-04T06:57:51.571043+0000","last_clean":"2024-04-04T06:57:51.571043+0000","last_became_active":"2024-04-04T06:57:49.566240+0000","last_became_peered":"2024-04-04T06:57:49.566240+0000","last_unstale":"2024-04-04T06:57:51.571043+0000","last_undegraded":"2024-04-04T06:57:51.571043+0000","last_fullsized":"2024-04-04T06:57:51.571043+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:57:48.507843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:57:48.507843+0000","last_clean_scrub_stamp":"2024-04-04T06:57:48.507843+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T16:04:19.766388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-04T06:57:51.580870+0000","last_change":"2024-04-04T06:57:50.565149+0000","last_active":"2024-04-04T06:57:51.580870+0000","last_peered":"2024-04-04T06:57:51.580870+0000","last_clean":"2024-04-04T06:57:51.580870+0000","last_became_active":"2024-04-04T06:57:50.564715+0000","last_became_peered":"2024-04-04T06:57:50.564715+0000","last_unstale":"2024-04-04T06:57:51.580870+0000","last_undegraded":"2024-04-04T06:57:51.580870+0000","last_fullsized":"2024-04-04T06:57:51.580870+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_clean_scrub_stamp":"2024-04-04T06:57:49.521429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T13:30:41.542528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"32'1","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-04T06:57:51.571750+0000","last_change":"2024-04-04T06:57:49.567912+0000","last_active":"2024-04-04T06:57:51.571750+0000","last_peered":"2024-04-04T06:57:51.571750+0000","last_clean":"2024-04-04T06:57:51.571750+0000","last_became_active":"2024-04-04T06:57:49.563803+0000","last_became_peered":"2024-04-04T06:57:49.563803+0000","last_unstale":"2024-04-04T06:57:51.571750+0000","last_undegraded":"2024-04-04T06:57:51.571750+0000","last_fullsized":"2024-04-04T06:57:51.571750+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:57:48.507843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:57:48.507843+0000","last_clean_scrub_stamp":"2024-04-04T06:57:48.507843+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T08:57:00.178088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-04T06:57:51.572175+0000","last_change":"2024-04-04T06:57:50.570830+0000","last_active":"2024-04-04T06:57:51.572175+0000","last_peered":"2024-04-04T06:57:51.572175+0000","last_clean":"2024-04-04T06:57:51.572175+0000","last_became_active":"2024-04-04T06:57:50.570013+0000","last_became_peered":"2024-04-04T06:57:50.570013+0000","last_unstale":"2024-04-04T06:57:51.572175+0000","last_undegraded":"2024-04-04T06:57:51.572175+0000","last_fullsized":"2024-04-04T06:57:51.572175+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_clean_scrub_stamp":"2024-04-04T06:57:49.521429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T10:45:20.080928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-04T06:57:51.579508+0000","last_change":"2024-04-04T06:57:49.564789+0000","last_active":"2024-04-04T06:57:51.579508+0000","last_peered":"2024-04-04T06:57:51.579508+0000","last_clean":"2024-04-04T06:57:51.579508+0000","last_became_active":"2024-04-04T06:57:49.564461+0000","last_became_peered":"2024-04-04T06:57:49.564461+0000","last_unstale":"2024-04-04T06:57:51.579508+0000","last_undegraded":"2024-04-04T06:57:51.579508+0000","last_fullsized":"2024-04-04T06:57:51.579508+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:57:48.507843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:57:48.507843+0000","last_clean_scrub_stamp":"2024-04-04T06:57:48.507843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T15:58:34.441807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-04T06:57:51.573528+0000","last_change":"2024-04-04T06:57:50.584408+0000","last_active":"2024-04-04T06:57:51.573528+0000","last_peered":"2024-04-04T06:57:51.573528+0000","last_clean":"2024-04-04T06:57:51.573528+0000","last_became_active":"2024-04-04T06:57:50.584228+0000","last_became_peered":"2024-04-04T06:57:50.584228+0000","last_unstale":"2024-04-04T06:57:51.573528+0000","last_undegraded":"2024-04-04T06:57:51.573528+0000","last_fullsized":"2024-04-04T06:57:51.573528+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_clean_scrub_stamp":"2024-04-04T06:57:49.521429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T14:49:30.811386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-04T06:57:51.570205+0000","last_change":"2024-04-04T06:57:49.573346+0000","last_active":"2024-04-04T06:57:51.570205+0000","last_peered":"2024-04-04T06:57:51.570205+0000","last_clean":"2024-04-04T06:57:51.570205+0000","last_became_active":"2024-04-04T06:57:49.573042+0000","last_became_peered":"2024-04-04T06:57:49.573042+0000","last_unstale":"2024-04-04T06:57:51.570205+0000","last_undegraded":"2024-04-04T06:57:51.570205+0000","last_fullsized":"2024-04-04T06:57:51.570205+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:57:48.507843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:57:48.507843+0000","last_clean_scrub_stamp":"2024-04-04T06:57:48.507843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T12:40:55.080177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-04T06:57:51.581493+0000","last_change":"2024-04-04T06:57:50.563549+0000","last_active":"2024-04-04T06:57:51.581493+0000","last_peered":"2024-04-04T06:57:51.581493+0000","last_clean":"2024-04-04T06:57:51.581493+0000","last_became_active":"2024-04-04T06:57:50.562095+0000","last_became_peered":"2024-04-04T06:57:50.562095+0000","last_unstale":"2024-04-04T06:57:51.581493+0000","last_undegraded":"2024-04-04T06:57:51.581493+0000","last_fullsized":"2024-04-04T06:57:51.581493+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_clean_scrub_stamp":"2024-04-04T06:57:49.521429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T12:32:44.007516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-04T06:57:51.579280+0000","last_change":"2024-04-04T06:57:49.572232+0000","last_active":"2024-04-04T06:57:51.579280+0000","last_peered":"2024-04-04T06:57:51.579280+0000","last_clean":"2024-04-04T06:57:51.579280+0000","last_became_active":"2024-04-04T06:57:49.571906+0000","last_became_peered":"2024-04-04T06:57:49.571906+0000","last_unstale":"2024-04-04T06:57:51.579280+0000","last_undegraded":"2024-04-04T06:57:51.579280+0000","last_fullsized":"2024-04-04T06:57:51.579280+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:57:48.507843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:57:48.507843+0000","last_clean_scrub_stamp":"2024-04-04T06:57:48.507843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T09:22:53.336351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-04T06:57:51.579431+0000","last_change":"2024-04-04T06:57:50.573771+0000","last_active":"2024-04-04T06:57:51.579431+0000","last_peered":"2024-04-04T06:57:51.579431+0000","last_clean":"2024-04-04T06:57:51.579431+0000","last_became_active":"2024-04-04T06:57:50.573499+0000","last_became_peered":"2024-04-04T06:57:50.573499+0000","last_unstale":"2024-04-04T06:57:51.579431+0000","last_undegraded":"2024-04-04T06:57:51.579431+0000","last_fullsized":"2024-04-04T06:57:51.579431+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_clean_scrub_stamp":"2024-04-04T06:57:49.521429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T15:08:05.883633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-04T06:57:51.566314+0000","last_change":"2024-04-04T06:57:49.569792+0000","last_active":"2024-04-04T06:57:51.566314+0000","last_peered":"2024-04-04T06:57:51.566314+0000","last_clean":"2024-04-04T06:57:51.566314+0000","last_became_active":"2024-04-04T06:57:49.567091+0000","last_became_peered":"2024-04-04T06:57:49.567091+0000","last_unstale":"2024-04-04T06:57:51.566314+0000","last_undegraded":"2024-04-04T06:57:51.566314+0000","last_fullsized":"2024-04-04T06:57:51.566314+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:57:48.507843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:57:48.507843+0000","last_clean_scrub_stamp":"2024-04-04T06:57:48.507843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T15:57:11.006633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-04T06:57:51.579025+0000","last_change":"2024-04-04T06:57:50.557167+0000","last_active":"2024-04-04T06:57:51.579025+0000","last_peered":"2024-04-04T06:57:51.579025+0000","last_clean":"2024-04-04T06:57:51.579025+0000","last_became_active":"2024-04-04T06:57:50.556733+0000","last_became_peered":"2024-04-04T06:57:50.556733+0000","last_unstale":"2024-04-04T06:57:51.579025+0000","last_undegraded":"2024-04-04T06:57:51.579025+0000","last_fullsized":"2024-04-04T06:57:51.579025+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_clean_scrub_stamp":"2024-04-04T06:57:49.521429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T11:07:27.160554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"32'3","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-04T06:57:51.581543+0000","last_change":"2024-04-04T06:57:49.570446+0000","last_active":"2024-04-04T06:57:51.581543+0000","last_peered":"2024-04-04T06:57:51.581543+0000","last_clean":"2024-04-04T06:57:51.581543+0000","last_became_active":"2024-04-04T06:57:49.570088+0000","last_became_peered":"2024-04-04T06:57:49.570088+0000","last_unstale":"2024-04-04T06:57:51.581543+0000","last_undegraded":"2024-04-04T06:57:51.581543+0000","last_fullsized":"2024-04-04T06:57:51.581543+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:57:48.507843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:57:48.507843+0000","last_clean_scrub_stamp":"2024-04-04T06:57:48.507843+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T15:58:34.441807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-04T06:57:51.581211+0000","last_change":"2024-04-04T06:57:50.572998+0000","last_active":"2024-04-04T06:57:51.581211+0000","last_peered":"2024-04-04T06:57:51.581211+0000","last_clean":"2024-04-04T06:57:51.581211+0000","last_became_active":"2024-04-04T06:57:50.571747+0000","last_became_peered":"2024-04-04T06:57:50.571747+0000","last_unstale":"2024-04-04T06:57:51.581211+0000","last_undegraded":"2024-04-04T06:57:51.581211+0000","last_fullsized":"2024-04-04T06:57:51.581211+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_clean_scrub_stamp":"2024-04-04T06:57:49.521429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T07:52:03.846365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"32'6","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-04T06:57:51.578684+0000","last_change":"2024-04-04T06:57:49.577328+0000","last_active":"2024-04-04T06:57:51.578684+0000","last_peered":"2024-04-04T06:57:51.578684+0000","last_clean":"2024-04-04T06:57:51.578684+0000","last_became_active":"2024-04-04T06:57:49.576912+0000","last_became_peered":"2024-04-04T06:57:49.576912+0000","last_unstale":"2024-04-04T06:57:51.578684+0000","last_undegraded":"2024-04-04T06:57:51.578684+0000","last_fullsized":"2024-04-04T06:57:51.578684+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:57:48.507843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:57:48.507843+0000","last_clean_scrub_stamp":"2024-04-04T06:57:48.507843+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T12:34:35.572600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-04T06:57:51.573549+0000","last_change":"2024-04-04T06:57:50.583855+0000","last_active":"2024-04-04T06:57:51.573549+0000","last_peered":"2024-04-04T06:57:51.573549+0000","last_clean":"2024-04-04T06:57:51.573549+0000","last_became_active":"2024-04-04T06:57:50.583541+0000","last_became_peered":"2024-04-04T06:57:50.583541+0000","last_unstale":"2024-04-04T06:57:51.573549+0000","last_undegraded":"2024-04-04T06:57:51.573549+0000","last_fullsized":"2024-04-04T06:57:51.573549+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_clean_scrub_stamp":"2024-04-04T06:57:49.521429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T11:45:50.008012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"32'2","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-04T06:57:51.571185+0000","last_change":"2024-04-04T06:57:49.570742+0000","last_active":"2024-04-04T06:57:51.571185+0000","last_peered":"2024-04-04T06:57:51.571185+0000","last_clean":"2024-04-04T06:57:51.571185+0000","last_became_active":"2024-04-04T06:57:49.570454+0000","last_became_peered":"2024-04-04T06:57:49.570454+0000","last_unstale":"2024-04-04T06:57:51.571185+0000","last_undegraded":"2024-04-04T06:57:51.571185+0000","last_fullsized":"2024-04-04T06:57:51.571185+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:57:48.507843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:57:48.507843+0000","last_clean_scrub_stamp":"2024-04-04T06:57:48.507843+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T14:53:45.088027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-04T06:57:51.578644+0000","last_change":"2024-04-04T06:57:50.561735+0000","last_active":"2024-04-04T06:57:51.578644+0000","last_peered":"2024-04-04T06:57:51.578644+0000","last_clean":"2024-04-04T06:57:51.578644+0000","last_became_active":"2024-04-04T06:57:50.561486+0000","last_became_peered":"2024-04-04T06:57:50.561486+0000","last_unstale":"2024-04-04T06:57:51.578644+0000","last_undegraded":"2024-04-04T06:57:51.578644+0000","last_fullsized":"2024-04-04T06:57:51.578644+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_clean_scrub_stamp":"2024-04-04T06:57:49.521429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T11:10:45.270383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-04T06:57:51.573488+0000","last_change":"2024-04-04T06:57:49.573509+0000","last_active":"2024-04-04T06:57:51.573488+0000","last_peered":"2024-04-04T06:57:51.573488+0000","last_clean":"2024-04-04T06:57:51.573488+0000","last_became_active":"2024-04-04T06:57:49.573221+0000","last_became_peered":"2024-04-04T06:57:49.573221+0000","last_unstale":"2024-04-04T06:57:51.573488+0000","last_undegraded":"2024-04-04T06:57:51.573488+0000","last_fullsized":"2024-04-04T06:57:51.573488+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:57:48.507843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:57:48.507843+0000","last_clean_scrub_stamp":"2024-04-04T06:57:48.507843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T09:15:32.272861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-04T06:57:51.570445+0000","last_change":"2024-04-04T06:57:50.568882+0000","last_active":"2024-04-04T06:57:51.570445+0000","last_peered":"2024-04-04T06:57:51.570445+0000","last_clean":"2024-04-04T06:57:51.570445+0000","last_became_active":"2024-04-04T06:57:50.568621+0000","last_became_peered":"2024-04-04T06:57:50.568621+0000","last_unstale":"2024-04-04T06:57:51.570445+0000","last_undegraded":"2024-04-04T06:57:51.570445+0000","last_fullsized":"2024-04-04T06:57:51.570445+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_clean_scrub_stamp":"2024-04-04T06:57:49.521429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T13:30:41.542528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-04T06:57:51.578857+0000","last_change":"2024-04-04T06:57:49.571082+0000","last_active":"2024-04-04T06:57:51.578857+0000","last_peered":"2024-04-04T06:57:51.578857+0000","last_clean":"2024-04-04T06:57:51.578857+0000","last_became_active":"2024-04-04T06:57:49.570811+0000","last_became_peered":"2024-04-04T06:57:49.570811+0000","last_unstale":"2024-04-04T06:57:51.578857+0000","last_undegraded":"2024-04-04T06:57:51.578857+0000","last_fullsized":"2024-04-04T06:57:51.578857+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:57:48.507843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:57:48.507843+0000","last_clean_scrub_stamp":"2024-04-04T06:57:48.507843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T10:45:19.067343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-04T06:57:51.582903+0000","last_change":"2024-04-04T06:57:50.567723+0000","last_active":"2024-04-04T06:57:51.582903+0000","last_peered":"2024-04-04T06:57:51.582903+0000","last_clean":"2024-04-04T06:57:51.582903+0000","last_became_active":"2024-04-04T06:57:50.567452+0000","last_became_peered":"2024-04-04T06:57:50.567452+0000","last_unstale":"2024-04-04T06:57:51.582903+0000","last_undegraded":"2024-04-04T06:57:51.582903+0000","last_fullsized":"2024-04-04T06:57:51.582903+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_clean_scrub_stamp":"2024-04-04T06:57:49.521429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T11:22:05.401737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"32'8","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-04T06:57:51.578475+0000","last_change":"2024-04-04T06:57:49.576152+0000","last_active":"2024-04-04T06:57:51.578475+0000","last_peered":"2024-04-04T06:57:51.578475+0000","last_clean":"2024-04-04T06:57:51.578475+0000","last_became_active":"2024-04-04T06:57:49.575859+0000","last_became_peered":"2024-04-04T06:57:49.575859+0000","last_unstale":"2024-04-04T06:57:51.578475+0000","last_undegraded":"2024-04-04T06:57:51.578475+0000","last_fullsized":"2024-04-04T06:57:51.578475+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:57:48.507843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:57:48.507843+0000","last_clean_scrub_stamp":"2024-04-04T06:57:48.507843+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T07:00:46.758154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-04T06:57:51.572216+0000","last_change":"2024-04-04T06:57:50.559019+0000","last_active":"2024-04-04T06:57:51.572216+0000","last_peered":"2024-04-04T06:57:51.572216+0000","last_clean":"2024-04-04T06:57:51.572216+0000","last_became_active":"2024-04-04T06:57:50.558709+0000","last_became_peered":"2024-04-04T06:57:50.558709+0000","last_unstale":"2024-04-04T06:57:51.572216+0000","last_undegraded":"2024-04-04T06:57:51.572216+0000","last_fullsized":"2024-04-04T06:57:51.572216+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_clean_scrub_stamp":"2024-04-04T06:57:49.521429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T15:58:35.455393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"32'1","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-04T06:57:51.575045+0000","last_change":"2024-04-04T06:57:49.571351+0000","last_active":"2024-04-04T06:57:51.575045+0000","last_peered":"2024-04-04T06:57:51.575045+0000","last_clean":"2024-04-04T06:57:51.575045+0000","last_became_active":"2024-04-04T06:57:49.571012+0000","last_became_peered":"2024-04-04T06:57:49.571012+0000","last_unstale":"2024-04-04T06:57:51.575045+0000","last_undegraded":"2024-04-04T06:57:51.575045+0000","last_fullsized":"2024-04-04T06:57:51.575045+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:57:48.507843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:57:48.507843+0000","last_clean_scrub_stamp":"2024-04-04T06:57:48.507843+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T11:22:04.388152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-04T06:57:51.581544+0000","last_change":"2024-04-04T06:57:50.569780+0000","last_active":"2024-04-04T06:57:51.581544+0000","last_peered":"2024-04-04T06:57:51.581544+0000","last_clean":"2024-04-04T06:57:51.581544+0000","last_became_active":"2024-04-04T06:57:50.568621+0000","last_became_peered":"2024-04-04T06:57:50.568621+0000","last_unstale":"2024-04-04T06:57:51.581544+0000","last_undegraded":"2024-04-04T06:57:51.581544+0000","last_fullsized":"2024-04-04T06:57:51.581544+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_clean_scrub_stamp":"2024-04-04T06:57:49.521429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T11:07:27.160554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"32'2","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-04T06:57:51.572151+0000","last_change":"2024-04-04T06:57:49.573669+0000","last_active":"2024-04-04T06:57:51.572151+0000","last_peered":"2024-04-04T06:57:51.572151+0000","last_clean":"2024-04-04T06:57:51.572151+0000","last_became_active":"2024-04-04T06:57:49.573056+0000","last_became_peered":"2024-04-04T06:57:49.573056+0000","last_unstale":"2024-04-04T06:57:51.572151+0000","last_undegraded":"2024-04-04T06:57:51.572151+0000","last_fullsized":"2024-04-04T06:57:51.572151+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:57:48.507843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:57:48.507843+0000","last_clean_scrub_stamp":"2024-04-04T06:57:48.507843+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T07:35:29.239698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-04T06:57:51.573922+0000","last_change":"2024-04-04T06:57:50.573733+0000","last_active":"2024-04-04T06:57:51.573922+0000","last_peered":"2024-04-04T06:57:51.573922+0000","last_clean":"2024-04-04T06:57:51.573922+0000","last_became_active":"2024-04-04T06:57:50.573444+0000","last_became_peered":"2024-04-04T06:57:50.573444+0000","last_unstale":"2024-04-04T06:57:51.573922+0000","last_undegraded":"2024-04-04T06:57:51.573922+0000","last_fullsized":"2024-04-04T06:57:51.573922+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_clean_scrub_stamp":"2024-04-04T06:57:49.521429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T13:04:33.784786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"32'1","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-04T06:57:51.571730+0000","last_change":"2024-04-04T06:57:49.563266+0000","last_active":"2024-04-04T06:57:51.571730+0000","last_peered":"2024-04-04T06:57:51.571730+0000","last_clean":"2024-04-04T06:57:51.571730+0000","last_became_active":"2024-04-04T06:57:49.562916+0000","last_became_peered":"2024-04-04T06:57:49.562916+0000","last_unstale":"2024-04-04T06:57:51.571730+0000","last_undegraded":"2024-04-04T06:57:51.571730+0000","last_fullsized":"2024-04-04T06:57:51.571730+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:57:48.507843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:57:48.507843+0000","last_clean_scrub_stamp":"2024-04-04T06:57:48.507843+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T17:19:50.355797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-04T06:57:51.580539+0000","last_change":"2024-04-04T06:57:50.574786+0000","last_active":"2024-04-04T06:57:51.580539+0000","last_peered":"2024-04-04T06:57:51.580539+0000","last_clean":"2024-04-04T06:57:51.580539+0000","last_became_active":"2024-04-04T06:57:50.568214+0000","last_became_peered":"2024-04-04T06:57:50.568214+0000","last_unstale":"2024-04-04T06:57:51.580539+0000","last_undegraded":"2024-04-04T06:57:51.580539+0000","last_fullsized":"2024-04-04T06:57:51.580539+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_clean_scrub_stamp":"2024-04-04T06:57:49.521429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T17:19:51.369382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-04T06:57:51.570905+0000","last_change":"2024-04-04T06:57:49.569151+0000","last_active":"2024-04-04T06:57:51.570905+0000","last_peered":"2024-04-04T06:57:51.570905+0000","last_clean":"2024-04-04T06:57:51.570905+0000","last_became_active":"2024-04-04T06:57:49.567915+0000","last_became_peered":"2024-04-04T06:57:49.567915+0000","last_unstale":"2024-04-04T06:57:51.570905+0000","last_undegraded":"2024-04-04T06:57:51.570905+0000","last_fullsized":"2024-04-04T06:57:51.570905+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:57:48.507843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:57:48.507843+0000","last_clean_scrub_stamp":"2024-04-04T06:57:48.507843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T15:04:48.323215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-04T06:57:51.579999+0000","last_change":"2024-04-04T06:57:50.569342+0000","last_active":"2024-04-04T06:57:51.579999+0000","last_peered":"2024-04-04T06:57:51.579999+0000","last_clean":"2024-04-04T06:57:51.579999+0000","last_became_active":"2024-04-04T06:57:50.569086+0000","last_became_peered":"2024-04-04T06:57:50.569086+0000","last_unstale":"2024-04-04T06:57:51.579999+0000","last_undegraded":"2024-04-04T06:57:51.579999+0000","last_fullsized":"2024-04-04T06:57:51.579999+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_clean_scrub_stamp":"2024-04-04T06:57:49.521429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T08:57:01.191673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"32'2","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-04T06:57:51.566174+0000","last_change":"2024-04-04T06:57:49.565317+0000","last_active":"2024-04-04T06:57:51.566174+0000","last_peered":"2024-04-04T06:57:51.566174+0000","last_clean":"2024-04-04T06:57:51.566174+0000","last_became_active":"2024-04-04T06:57:49.565036+0000","last_became_peered":"2024-04-04T06:57:49.565036+0000","last_unstale":"2024-04-04T06:57:51.566174+0000","last_undegraded":"2024-04-04T06:57:51.566174+0000","last_fullsized":"2024-04-04T06:57:51.566174+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:57:48.507843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:57:48.507843+0000","last_clean_scrub_stamp":"2024-04-04T06:57:48.507843+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T17:08:36.572829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-04T06:57:51.580745+0000","last_change":"2024-04-04T06:57:50.578519+0000","last_active":"2024-04-04T06:57:51.580745+0000","last_peered":"2024-04-04T06:57:51.580745+0000","last_clean":"2024-04-04T06:57:51.580745+0000","last_became_active":"2024-04-04T06:57:50.578108+0000","last_became_peered":"2024-04-04T06:57:50.578108+0000","last_unstale":"2024-04-04T06:57:51.580745+0000","last_undegraded":"2024-04-04T06:57:51.580745+0000","last_fullsized":"2024-04-04T06:57:51.580745+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_clean_scrub_stamp":"2024-04-04T06:57:49.521429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T08:19:48.258561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-04T06:57:51.582798+0000","last_change":"2024-04-04T06:57:49.577306+0000","last_active":"2024-04-04T06:57:51.582798+0000","last_peered":"2024-04-04T06:57:51.582798+0000","last_clean":"2024-04-04T06:57:51.582798+0000","last_became_active":"2024-04-04T06:57:49.577059+0000","last_became_peered":"2024-04-04T06:57:49.577059+0000","last_unstale":"2024-04-04T06:57:51.582798+0000","last_undegraded":"2024-04-04T06:57:51.582798+0000","last_fullsized":"2024-04-04T06:57:51.582798+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:57:48.507843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:57:48.507843+0000","last_clean_scrub_stamp":"2024-04-04T06:57:48.507843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T16:36:25.597766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-04T06:57:51.579803+0000","last_change":"2024-04-04T06:57:50.579823+0000","last_active":"2024-04-04T06:57:51.579803+0000","last_peered":"2024-04-04T06:57:51.579803+0000","last_clean":"2024-04-04T06:57:51.579803+0000","last_became_active":"2024-04-04T06:57:50.575590+0000","last_became_peered":"2024-04-04T06:57:50.575590+0000","last_unstale":"2024-04-04T06:57:51.579803+0000","last_undegraded":"2024-04-04T06:57:51.579803+0000","last_fullsized":"2024-04-04T06:57:51.579803+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_clean_scrub_stamp":"2024-04-04T06:57:49.521429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T11:46:05.894347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-04T06:57:51.571248+0000","last_change":"2024-04-04T06:57:49.567451+0000","last_active":"2024-04-04T06:57:51.571248+0000","last_peered":"2024-04-04T06:57:51.571248+0000","last_clean":"2024-04-04T06:57:51.571248+0000","last_became_active":"2024-04-04T06:57:49.567101+0000","last_became_peered":"2024-04-04T06:57:49.567101+0000","last_unstale":"2024-04-04T06:57:51.571248+0000","last_undegraded":"2024-04-04T06:57:51.571248+0000","last_fullsized":"2024-04-04T06:57:51.571248+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:57:48.507843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:57:48.507843+0000","last_clean_scrub_stamp":"2024-04-04T06:57:48.507843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T17:12:51.481243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-04T06:57:51.571049+0000","last_change":"2024-04-04T06:57:50.577113+0000","last_active":"2024-04-04T06:57:51.571049+0000","last_peered":"2024-04-04T06:57:51.571049+0000","last_clean":"2024-04-04T06:57:51.571049+0000","last_became_active":"2024-04-04T06:57:50.576515+0000","last_became_peered":"2024-04-04T06:57:50.576515+0000","last_unstale":"2024-04-04T06:57:51.571049+0000","last_undegraded":"2024-04-04T06:57:51.571049+0000","last_fullsized":"2024-04-04T06:57:51.571049+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_clean_scrub_stamp":"2024-04-04T06:57:49.521429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T07:52:03.846365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-04T06:57:51.580308+0000","last_change":"2024-04-04T06:57:49.564823+0000","last_active":"2024-04-04T06:57:51.580308+0000","last_peered":"2024-04-04T06:57:51.580308+0000","last_clean":"2024-04-04T06:57:51.580308+0000","last_became_active":"2024-04-04T06:57:49.564469+0000","last_became_peered":"2024-04-04T06:57:49.564469+0000","last_unstale":"2024-04-04T06:57:51.580308+0000","last_undegraded":"2024-04-04T06:57:51.580308+0000","last_fullsized":"2024-04-04T06:57:51.580308+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:57:48.507843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:57:48.507843+0000","last_clean_scrub_stamp":"2024-04-04T06:57:48.507843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T15:13:00.535090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-04T06:57:51.580453+0000","last_change":"2024-04-04T06:57:50.570747+0000","last_active":"2024-04-04T06:57:51.580453+0000","last_peered":"2024-04-04T06:57:51.580453+0000","last_clean":"2024-04-04T06:57:51.580453+0000","last_became_active":"2024-04-04T06:57:50.570478+0000","last_became_peered":"2024-04-04T06:57:50.570478+0000","last_unstale":"2024-04-04T06:57:51.580453+0000","last_undegraded":"2024-04-04T06:57:51.580453+0000","last_fullsized":"2024-04-04T06:57:51.580453+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_clean_scrub_stamp":"2024-04-04T06:57:49.521429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T15:04:49.336801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"32'2","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-04T06:57:51.575124+0000","last_change":"2024-04-04T06:57:49.562221+0000","last_active":"2024-04-04T06:57:51.575124+0000","last_peered":"2024-04-04T06:57:51.575124+0000","last_clean":"2024-04-04T06:57:51.575124+0000","last_became_active":"2024-04-04T06:57:49.561874+0000","last_became_peered":"2024-04-04T06:57:49.561874+0000","last_unstale":"2024-04-04T06:57:51.575124+0000","last_undegraded":"2024-04-04T06:57:51.575124+0000","last_fullsized":"2024-04-04T06:57:51.575124+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:57:48.507843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:57:48.507843+0000","last_clean_scrub_stamp":"2024-04-04T06:57:48.507843+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T09:04:39.089278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-04T06:57:51.581665+0000","last_change":"2024-04-04T06:57:50.575310+0000","last_active":"2024-04-04T06:57:51.581665+0000","last_peered":"2024-04-04T06:57:51.581665+0000","last_clean":"2024-04-04T06:57:51.581665+0000","last_became_active":"2024-04-04T06:57:50.574426+0000","last_became_peered":"2024-04-04T06:57:50.574426+0000","last_unstale":"2024-04-04T06:57:51.581665+0000","last_undegraded":"2024-04-04T06:57:51.581665+0000","last_fullsized":"2024-04-04T06:57:51.581665+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_clean_scrub_stamp":"2024-04-04T06:57:49.521429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T15:08:05.883633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"33'1","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-04T06:57:51.571598+0000","last_change":"2024-04-04T06:57:49.554627+0000","last_active":"2024-04-04T06:57:51.571598+0000","last_peered":"2024-04-04T06:57:51.571598+0000","last_clean":"2024-04-04T06:57:51.571598+0000","last_became_active":"2024-04-04T06:57:49.554182+0000","last_became_peered":"2024-04-04T06:57:49.554182+0000","last_unstale":"2024-04-04T06:57:51.571598+0000","last_undegraded":"2024-04-04T06:57:51.571598+0000","last_fullsized":"2024-04-04T06:57:51.571598+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:57:48.507843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:57:48.507843+0000","last_clean_scrub_stamp":"2024-04-04T06:57:48.507843+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T09:15:32.272861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-04T06:57:51.566586+0000","last_change":"2024-04-04T06:57:50.569862+0000","last_active":"2024-04-04T06:57:51.566586+0000","last_peered":"2024-04-04T06:57:51.566586+0000","last_clean":"2024-04-04T06:57:51.566586+0000","last_became_active":"2024-04-04T06:57:50.569543+0000","last_became_peered":"2024-04-04T06:57:50.569543+0000","last_unstale":"2024-04-04T06:57:51.566586+0000","last_undegraded":"2024-04-04T06:57:51.566586+0000","last_fullsized":"2024-04-04T06:57:51.566586+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_clean_scrub_stamp":"2024-04-04T06:57:49.521429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T12:34:36.586185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-04T06:57:51.574018+0000","last_change":"2024-04-04T06:57:49.563548+0000","last_active":"2024-04-04T06:57:51.574018+0000","last_peered":"2024-04-04T06:57:51.574018+0000","last_clean":"2024-04-04T06:57:51.574018+0000","last_became_active":"2024-04-04T06:57:49.563173+0000","last_became_peered":"2024-04-04T06:57:49.563173+0000","last_unstale":"2024-04-04T06:57:51.574018+0000","last_undegraded":"2024-04-04T06:57:51.574018+0000","last_fullsized":"2024-04-04T06:57:51.574018+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:57:48.507843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:57:48.507843+0000","last_clean_scrub_stamp":"2024-04-04T06:57:48.507843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T14:10:37.940401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-04T06:57:51.582617+0000","last_change":"2024-04-04T06:57:50.572149+0000","last_active":"2024-04-04T06:57:51.582617+0000","last_peered":"2024-04-04T06:57:51.582617+0000","last_clean":"2024-04-04T06:57:51.582617+0000","last_became_active":"2024-04-04T06:57:50.571832+0000","last_became_peered":"2024-04-04T06:57:50.571832+0000","last_unstale":"2024-04-04T06:57:51.582617+0000","last_undegraded":"2024-04-04T06:57:51.582617+0000","last_fullsized":"2024-04-04T06:57:51.582617+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_clean_scrub_stamp":"2024-04-04T06:57:49.521429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T14:10:38.953987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-04T06:57:51.566364+0000","last_change":"2024-04-04T06:57:49.565359+0000","last_active":"2024-04-04T06:57:51.566364+0000","last_peered":"2024-04-04T06:57:51.566364+0000","last_clean":"2024-04-04T06:57:51.566364+0000","last_became_active":"2024-04-04T06:57:49.565098+0000","last_became_peered":"2024-04-04T06:57:49.565098+0000","last_unstale":"2024-04-04T06:57:51.566364+0000","last_undegraded":"2024-04-04T06:57:51.566364+0000","last_fullsized":"2024-04-04T06:57:51.566364+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:57:48.507843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:57:48.507843+0000","last_clean_scrub_stamp":"2024-04-04T06:57:48.507843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T14:10:37.940401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-04T06:57:51.566206+0000","last_change":"2024-04-04T06:57:50.574284+0000","last_active":"2024-04-04T06:57:51.566206+0000","last_peered":"2024-04-04T06:57:51.566206+0000","last_clean":"2024-04-04T06:57:51.566206+0000","last_became_active":"2024-04-04T06:57:50.573914+0000","last_became_peered":"2024-04-04T06:57:50.573914+0000","last_unstale":"2024-04-04T06:57:51.566206+0000","last_undegraded":"2024-04-04T06:57:51.566206+0000","last_fullsized":"2024-04-04T06:57:51.566206+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_clean_scrub_stamp":"2024-04-04T06:57:49.521429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T15:13:01.548675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-04T06:57:51.573614+0000","last_change":"2024-04-04T06:57:49.563737+0000","last_active":"2024-04-04T06:57:51.573614+0000","last_peered":"2024-04-04T06:57:51.573614+0000","last_clean":"2024-04-04T06:57:51.573614+0000","last_became_active":"2024-04-04T06:57:49.563408+0000","last_became_peered":"2024-04-04T06:57:49.563408+0000","last_unstale":"2024-04-04T06:57:51.573614+0000","last_undegraded":"2024-04-04T06:57:51.573614+0000","last_fullsized":"2024-04-04T06:57:51.573614+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:57:48.507843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:57:48.507843+0000","last_clean_scrub_stamp":"2024-04-04T06:57:48.507843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T17:08:36.572829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-04T06:57:51.578841+0000","last_change":"2024-04-04T06:57:50.559325+0000","last_active":"2024-04-04T06:57:51.578841+0000","last_peered":"2024-04-04T06:57:51.578841+0000","last_clean":"2024-04-04T06:57:51.578841+0000","last_became_active":"2024-04-04T06:57:50.558998+0000","last_became_peered":"2024-04-04T06:57:50.558998+0000","last_unstale":"2024-04-04T06:57:51.578841+0000","last_undegraded":"2024-04-04T06:57:51.578841+0000","last_fullsized":"2024-04-04T06:57:51.578841+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_clean_scrub_stamp":"2024-04-04T06:57:49.521429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T07:14:49.491716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-04T06:57:51.571456+0000","last_change":"2024-04-04T06:57:49.565175+0000","last_active":"2024-04-04T06:57:51.571456+0000","last_peered":"2024-04-04T06:57:51.571456+0000","last_clean":"2024-04-04T06:57:51.571456+0000","last_became_active":"2024-04-04T06:57:49.564886+0000","last_became_peered":"2024-04-04T06:57:49.564886+0000","last_unstale":"2024-04-04T06:57:51.571456+0000","last_undegraded":"2024-04-04T06:57:51.571456+0000","last_fullsized":"2024-04-04T06:57:51.571456+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:57:48.507843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:57:48.507843+0000","last_clean_scrub_stamp":"2024-04-04T06:57:48.507843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T11:46:04.880762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-04T06:57:51.571000+0000","last_change":"2024-04-04T06:57:50.552529+0000","last_active":"2024-04-04T06:57:51.571000+0000","last_peered":"2024-04-04T06:57:51.571000+0000","last_clean":"2024-04-04T06:57:51.571000+0000","last_became_active":"2024-04-04T06:57:50.551948+0000","last_became_peered":"2024-04-04T06:57:50.551948+0000","last_unstale":"2024-04-04T06:57:51.571000+0000","last_undegraded":"2024-04-04T06:57:51.571000+0000","last_fullsized":"2024-04-04T06:57:51.571000+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_clean_scrub_stamp":"2024-04-04T06:57:49.521429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T09:04:40.102864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-04T06:57:51.578619+0000","last_change":"2024-04-04T06:57:49.569040+0000","last_active":"2024-04-04T06:57:51.578619+0000","last_peered":"2024-04-04T06:57:51.578619+0000","last_clean":"2024-04-04T06:57:51.578619+0000","last_became_active":"2024-04-04T06:57:49.568607+0000","last_became_peered":"2024-04-04T06:57:49.568607+0000","last_unstale":"2024-04-04T06:57:51.578619+0000","last_undegraded":"2024-04-04T06:57:51.578619+0000","last_fullsized":"2024-04-04T06:57:51.578619+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:57:48.507843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:57:48.507843+0000","last_clean_scrub_stamp":"2024-04-04T06:57:48.507843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T15:13:00.535090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-04T06:57:51.572450+0000","last_change":"2024-04-04T06:57:50.563498+0000","last_active":"2024-04-04T06:57:51.572450+0000","last_peered":"2024-04-04T06:57:51.572450+0000","last_clean":"2024-04-04T06:57:51.572450+0000","last_became_active":"2024-04-04T06:57:50.558916+0000","last_became_peered":"2024-04-04T06:57:50.558916+0000","last_unstale":"2024-04-04T06:57:51.572450+0000","last_undegraded":"2024-04-04T06:57:51.572450+0000","last_fullsized":"2024-04-04T06:57:51.572450+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:57:49.521429+0000","last_clean_scrub_stamp":"2024-04-04T06:57:49.521429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T11:07:27.160554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-04T06:57:51.582631+0000","last_change":"2024-04-04T06:57:49.569984+0000","last_active":"2024-04-04T06:57:51.582631+0000","last_peered":"2024-04-04T06:57:51.582631+0000","last_clean":"2024-04-04T06:57:51.582631+0000","last_became_active":"2024-04-04T06:57:49.569431+0000","last_became_peered":"2024-04-04T06:57:49.569431+0000","last_unstale":"2024-04-04T06:57:51.582631+0000","last_undegraded":"2024-04-04T06:57:51.582631+0000","last_fullsized":"2024-04-04T06:57:51.582631+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:57:48.507843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:57:48.507843+0000","last_clean_scrub_stamp":"2024-04-04T06:57:48.507843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T12:41:56.457052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":196,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-04T06:57:51.570599+0000","last_change":"2024-04-04T06:56:19.364611+0000","last_active":"2024-04-04T06:57:51.570599+0000","last_peered":"2024-04-04T06:57:51.570599+0000","last_clean":"2024-04-04T06:57:51.570599+0000","last_became_active":"2024-04-04T06:56:19.362232+0000","last_became_peered":"2024-04-04T06:56:19.362232+0000","last_unstale":"2024-04-04T06:57:51.570599+0000","last_undegraded":"2024-04-04T06:57:51.570599+0000","last_fullsized":"2024-04-04T06:57:51.570599+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:17.744258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:17.744258+0000","last_clean_scrub_stamp":"2024-04-04T06:56:17.744258+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T17:25:16.494215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574871,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27976,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343864,"statfs":{"total":96636764160,"available":96608116736,"internally_reserved":0,"allocated":970752,"data_stored":737066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574870,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":380928,"data_stored":147224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574870,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":380928,"data_stored":147280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574869,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":380928,"data_stored":146712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574871,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27404,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":389120,"data_stored":148242,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574871,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27388,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":376832,"data_stored":146678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574869,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27404,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":389120,"data_stored":148242,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574870,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27968,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343872,"statfs":{"total":96636764160,"available":96608124928,"internally_reserved":0,"allocated":966656,"data_stored":736976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-04T06:57:55.867 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-04T06:57:55.868 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-04-04T06:57:56.089 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:56.090+0000 7f492a400640 1 Processor -- start 2024-04-04T06:57:56.089 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:56.090+0000 7f492a400640 1 -- start start 2024-04-04T06:57:56.090 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:56.091+0000 7f492a400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f49240cb7d0 0x7f49240adb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:56.090 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:56.091+0000 7f492a400640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f49240ae080 0x7f49241621c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:56.090 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:56.091+0000 7f492a400640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f49240cbc60 con 0x7f492415e670 2024-04-04T06:57:56.090 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:56.091+0000 7f492a400640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f49240cbf40 con 0x7f49240ae080 2024-04-04T06:57:56.091 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:56.091+0000 7f492a400640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f49240cee80 con 0x7f49240cb7d0 2024-04-04T06:57:56.091 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:56.092+0000 7f4923e00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f49240ae080 0x7f49241621c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:56.091 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:56.092+0000 7f4922a00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f49240cb7d0 0x7f49240adb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:56.091 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:56.092+0000 7f4923e00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f49240ae080 0x7f49241621c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.72:49506/0 (socket says 172.21.15.72:49506) 2024-04-04T06:57:56.092 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:56.092+0000 7f4923e00640 1 -- 172.21.15.72:0/484642756 learned_addr learned my addr 172.21.15.72:0/484642756 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:57:56.092 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:56.092+0000 7f4923400640 1 --1- 172.21.15.72:0/484642756 >> v1:172.21.15.117:6789/0 conn(0x7f492415e670 0x7f49240cff60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.72:35110/0 (socket says 172.21.15.72:35110) 2024-04-04T06:57:56.092 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:56.093+0000 7f4922a00640 1 -- 172.21.15.72:0/484642756 >> v2:172.21.15.117:3300/0 conn(0x7f49240ae080 msgr2=0x7f49241621c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:57:56.092 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:56.093+0000 7f4922a00640 1 --2- 172.21.15.72:0/484642756 >> v2:172.21.15.117:3300/0 conn(0x7f49240ae080 0x7f49241621c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:56.092 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:56.093+0000 7f4922a00640 1 -- 172.21.15.72:0/484642756 >> v1:172.21.15.117:6789/0 conn(0x7f492415e670 legacy=0x7f49240cff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:56.092 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:56.093+0000 7f4922a00640 1 -- 172.21.15.72:0/484642756 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49240cf160 con 0x7f49240cb7d0 2024-04-04T06:57:56.093 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:56.094+0000 7f4922a00640 1 --2- 172.21.15.72:0/484642756 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f49240cb7d0 0x7f49240adb40 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f49100097a0 tx=0x7f491002b820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5283bcab43a1a750 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:56.093 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:56.095+0000 7f4922000640 1 -- 172.21.15.72:0/484642756 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4910031780 con 0x7f49240cb7d0 2024-04-04T06:57:56.094 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:56.095+0000 7f4922000640 1 -- 172.21.15.72:0/484642756 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4910037070 con 0x7f49240cb7d0 2024-04-04T06:57:56.094 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:56.095+0000 7f4922000640 1 -- 172.21.15.72:0/484642756 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4910031b40 con 0x7f49240cb7d0 2024-04-04T06:57:56.094 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:56.095+0000 7f492a400640 1 -- 172.21.15.72:0/484642756 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f49240cb7d0 msgr2=0x7f49240adb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:56.094 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:56.095+0000 7f492a400640 1 --2- 172.21.15.72:0/484642756 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f49240cb7d0 0x7f49240adb40 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f49100097a0 tx=0x7f491002b820 comp rx=0 tx=0).stop 2024-04-04T06:57:56.095 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:56.096+0000 7f492a400640 1 -- 172.21.15.72:0/484642756 shutdown_connections 2024-04-04T06:57:56.095 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:56.096+0000 7f492a400640 1 --2- 172.21.15.72:0/484642756 >> v2:172.21.15.117:3300/0 conn(0x7f49240ae080 0x7f49241621c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:56.095 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:56.096+0000 7f492a400640 1 --2- 172.21.15.72:0/484642756 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f49240cb7d0 0x7f49240adb40 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:56.095 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:56.096+0000 7f492a400640 1 -- 172.21.15.72:0/484642756 >> 172.21.15.72:0/484642756 conn(0x7f49240d0770 msgr2=0x7f49240d0b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:56.095 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:56.096+0000 7f492a400640 1 -- 172.21.15.72:0/484642756 shutdown_connections 2024-04-04T06:57:56.095 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:56.096+0000 7f492a400640 1 -- 172.21.15.72:0/484642756 wait complete. 2024-04-04T06:57:56.096 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:56.097+0000 7f492a400640 1 Processor -- start 2024-04-04T06:57:56.096 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:56.098+0000 7f492a400640 1 -- start start 2024-04-04T06:57:56.099 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:56.099+0000 7f492a400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f49240ae080 0x7f492414bca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:56.099 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:56.099+0000 7f492a400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f492415e670 0x7f4924160e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:56.099 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:56.099+0000 7f492a400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f49241613d0 0x7f49240c98d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:56.099 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:56.099+0000 7f492a400640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f49240cf910 con 0x7f49240ae080 2024-04-04T06:57:56.099 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:56.099+0000 7f492a400640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f49240cf440 con 0x7f49241613d0 2024-04-04T06:57:56.099 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:56.099+0000 7f492a400640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f49240cfa90 con 0x7f492415e670 2024-04-04T06:57:56.099 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:56.099+0000 7f4923400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f49240ae080 0x7f492414bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:56.099 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:56.099+0000 7f4923400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f49240ae080 0x7f492414bca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:38906/0 (socket says 172.21.15.72:38906) 2024-04-04T06:57:56.099 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:56.099+0000 7f4923400640 1 -- 172.21.15.72:0/2616481983 learned_addr learned my addr 172.21.15.72:0/2616481983 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:57:56.099 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:56.099+0000 7f4922a00640 1 --2- 172.21.15.72:0/2616481983 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f492415e670 0x7f4924160e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:56.100 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:56.099+0000 7f4923e00640 1 --2- 172.21.15.72:0/2616481983 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f49241613d0 0x7f49240c98d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:56.100 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:56.099+0000 7f4923400640 1 -- 172.21.15.72:0/2616481983 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f492415e670 msgr2=0x7f4924160e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:56.100 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:56.099+0000 7f4923400640 1 --2- 172.21.15.72:0/2616481983 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f492415e670 0x7f4924160e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:56.100 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:56.099+0000 7f4923400640 1 -- 172.21.15.72:0/2616481983 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f49241613d0 msgr2=0x7f49240c98d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:56.100 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:56.099+0000 7f4923400640 1 --2- 172.21.15.72:0/2616481983 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f49241613d0 0x7f49240c98d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:56.100 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:56.099+0000 7f4923400640 1 -- 172.21.15.72:0/2616481983 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f492414c1e0 con 0x7f49240ae080 2024-04-04T06:57:56.100 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:56.100+0000 7f4923400640 1 --2- 172.21.15.72:0/2616481983 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f49240ae080 0x7f492414bca0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f491400c430 tx=0x7f491400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:56.100 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:56.100+0000 7f491b400640 1 -- 172.21.15.72:0/2616481983 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49140074e0 con 0x7f49240ae080 2024-04-04T06:57:56.100 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:56.100+0000 7f491b400640 1 -- 172.21.15.72:0/2616481983 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4914007680 con 0x7f49240ae080 2024-04-04T06:57:56.100 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:56.100+0000 7f491b400640 1 -- 172.21.15.72:0/2616481983 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4914004a00 con 0x7f49240ae080 2024-04-04T06:57:56.100 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:56.100+0000 7f492a400640 1 -- 172.21.15.72:0/2616481983 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49240ca630 con 0x7f49240ae080 2024-04-04T06:57:56.100 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:56.100+0000 7f492a400640 1 -- 172.21.15.72:0/2616481983 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49240b3920 con 0x7f49240ae080 2024-04-04T06:57:56.101 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:56.101+0000 7f492a400640 1 -- 172.21.15.72:0/2616481983 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f49240b2010 con 0x7f49240ae080 2024-04-04T06:57:56.101 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:56.102+0000 7f491b400640 1 -- 172.21.15.72:0/2616481983 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f491401a020 con 0x7f49240ae080 2024-04-04T06:57:56.102 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:56.103+0000 7f491b400640 1 --2- 172.21.15.72:0/2616481983 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f490406c920 0x7f490406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:56.102 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:56.103+0000 7f491b400640 1 -- 172.21.15.72:0/2616481983 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f491408b370 con 0x7f49240ae080 2024-04-04T06:57:56.102 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:56.103+0000 7f4922a00640 1 --2- 172.21.15.72:0/2616481983 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f490406c920 0x7f490406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:56.103 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:56.104+0000 7f4922a00640 1 --2- 172.21.15.72:0/2616481983 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f490406c920 0x7f490406ede0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f4910036000 tx=0x7f491003d040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:56.106 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:56.108+0000 7f491b400640 1 -- 172.21.15.72:0/2616481983 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f49240b2010 con 0x7f49240ae080 2024-04-04T06:57:56.380 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:56.382+0000 7f492a400640 1 -- 172.21.15.72:0/2616481983 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f49240b3430 con 0x7f49240ae080 2024-04-04T06:57:56.384 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:56.385+0000 7f491b400640 1 -- 172.21.15.72:0/2616481983 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v11) ==== 190+0+147 (secure 0 0 0) 0x7f4914059790 con 0x7f49240ae080 2024-04-04T06:57:56.384 INFO:teuthology.orchestra.run.smithi072.stdout:[client.0] 2024-04-04T06:57:56.384 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQDXTg5mRJVYCxAA4YRQHdGOPQqDB4fp2kieUw== 2024-04-04T06:57:56.384 INFO:teuthology.orchestra.run.smithi072.stdout: caps mds = "allow" 2024-04-04T06:57:56.384 INFO:teuthology.orchestra.run.smithi072.stdout: caps mon = "allow r" 2024-04-04T06:57:56.384 INFO:teuthology.orchestra.run.smithi072.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-04-04T06:57:56.384 INFO:teuthology.orchestra.run.smithi072.stderr:updated caps for client.0 2024-04-04T06:57:56.386 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:56.388+0000 7f492a400640 1 -- 172.21.15.72:0/2616481983 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f490406c920 msgr2=0x7f490406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:56.386 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:56.388+0000 7f492a400640 1 --2- 172.21.15.72:0/2616481983 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f490406c920 0x7f490406ede0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f4910036000 tx=0x7f491003d040 comp rx=0 tx=0).stop 2024-04-04T06:57:56.387 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:56.388+0000 7f492a400640 1 -- 172.21.15.72:0/2616481983 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f49240ae080 msgr2=0x7f492414bca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:56.387 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:56.388+0000 7f492a400640 1 --2- 172.21.15.72:0/2616481983 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f49240ae080 0x7f492414bca0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f491400c430 tx=0x7f491400c8f0 comp rx=0 tx=0).stop 2024-04-04T06:57:56.387 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:56.388+0000 7f492a400640 1 -- 172.21.15.72:0/2616481983 shutdown_connections 2024-04-04T06:57:56.387 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:56.388+0000 7f492a400640 1 --2- 172.21.15.72:0/2616481983 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f490406c920 0x7f490406ede0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:56.387 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:56.388+0000 7f492a400640 1 --2- 172.21.15.72:0/2616481983 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f49241613d0 0x7f49240c98d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:56.387 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:56.388+0000 7f492a400640 1 --2- 172.21.15.72:0/2616481983 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f492415e670 0x7f4924160e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:56.387 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:56.388+0000 7f492a400640 1 --2- 172.21.15.72:0/2616481983 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f49240ae080 0x7f492414bca0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:56.387 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:56.388+0000 7f492a400640 1 -- 172.21.15.72:0/2616481983 >> 172.21.15.72:0/2616481983 conn(0x7f49240d0770 msgr2=0x7f49240b1480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:56.387 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:56.388+0000 7f492a400640 1 -- 172.21.15.72:0/2616481983 shutdown_connections 2024-04-04T06:57:56.388 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:56.388+0000 7f492a400640 1 -- 172.21.15.72:0/2616481983 wait complete. 2024-04-04T06:57:56.408 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-04T06:57:56.616 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:56.617+0000 7f9393200640 1 Processor -- start 2024-04-04T06:57:56.616 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:56.618+0000 7f9393200640 1 -- start start 2024-04-04T06:57:56.618 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:56.619+0000 7f9393200640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f93940cf0e0 0x7f93940c7390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:56.618 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:56.619+0000 7f9393200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f939406cb90 0x7f93940c78d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:56.618 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:56.619+0000 7f9393200640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9394070d50 con 0x7f9394161db0 2024-04-04T06:57:56.618 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:56.619+0000 7f9393200640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f93940c6df0 con 0x7f93940cf0e0 2024-04-04T06:57:56.618 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:56.619+0000 7f9393200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f93940c61e0 con 0x7f939406cb90 2024-04-04T06:57:56.619 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:56.620+0000 7f9389400640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f9394161db0 0x7f939406c480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:37822/0 (socket says 172.21.15.72:37822) 2024-04-04T06:57:56.619 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:56.620+0000 7f9389400640 1 -- 172.21.15.72:0/608124958 learned_addr learned my addr 172.21.15.72:0/608124958 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-04-04T06:57:56.620 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:56.620+0000 7f9392800640 1 --2- 172.21.15.72:0/608124958 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f939406cb90 0x7f93940c78d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:56.621 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:56.620+0000 7f9391e00640 1 --2- 172.21.15.72:0/608124958 >> v2:172.21.15.117:3300/0 conn(0x7f93940cf0e0 0x7f93940c7390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:56.621 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:56.620+0000 7f9391400640 1 -- 172.21.15.72:0/608124958 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 678341705 0 0) 0x7f9394070d50 con 0x7f9394161db0 2024-04-04T06:57:56.621 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:56.620+0000 7f9391400640 1 -- 172.21.15.72:0/608124958 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9378003520 con 0x7f9394161db0 2024-04-04T06:57:56.621 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:56.621+0000 7f9391400640 1 -- 172.21.15.72:0/608124958 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 527059368 0 0) 0x7f9378003520 con 0x7f9394161db0 2024-04-04T06:57:56.621 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:56.621+0000 7f9391400640 1 -- 172.21.15.72:0/608124958 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f939406cb90 msgr2=0x7f93940c78d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:57:56.621 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:56.621+0000 7f9391400640 1 --2- 172.21.15.72:0/608124958 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f939406cb90 0x7f93940c78d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:56.621 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:56.621+0000 7f9391400640 1 -- 172.21.15.72:0/608124958 >> v2:172.21.15.117:3300/0 conn(0x7f93940cf0e0 msgr2=0x7f93940c7390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:57:56.621 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:56.621+0000 7f9391400640 1 --2- 172.21.15.72:0/608124958 >> v2:172.21.15.117:3300/0 conn(0x7f93940cf0e0 0x7f93940c7390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:56.621 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:56.621+0000 7f9391400640 1 -- 172.21.15.72:0/608124958 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93940c64c0 con 0x7f9394161db0 2024-04-04T06:57:56.621 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:56.621+0000 7f9391400640 1 -- 172.21.15.72:0/608124958 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2465650867 0 0) 0x7f937c001670 con 0x7f9394161db0 2024-04-04T06:57:56.621 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:56.621+0000 7f9391400640 1 -- 172.21.15.72:0/608124958 >> v1:172.21.15.72:6789/0 conn(0x7f9394161db0 legacy=0x7f939406c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:56.621 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:56.621+0000 7f9391400640 1 --2- 172.21.15.72:0/608124958 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f93780039b0 0x7f9378003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:56.621 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:56.621+0000 7f9391400640 1 --2- 172.21.15.72:0/608124958 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9378004800 0x7f9378004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:56.622 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:56.621+0000 7f9391400640 1 --2- 172.21.15.72:0/608124958 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f939406cb90 0x7f93780051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:56.622 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:56.621+0000 7f9391400640 1 -- 172.21.15.72:0/608124958 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f93940c6df0 con 0x7f93780039b0 2024-04-04T06:57:56.622 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:56.621+0000 7f9391400640 1 -- 172.21.15.72:0/608124958 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f93940c61e0 con 0x7f9378004800 2024-04-04T06:57:56.622 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:56.621+0000 7f9391400640 1 -- 172.21.15.72:0/608124958 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f937800b9f0 con 0x7f939406cb90 2024-04-04T06:57:56.622 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:56.621+0000 7f9391e00640 1 --2- 172.21.15.72:0/608124958 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f93780039b0 0x7f9378003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:56.622 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:56.622+0000 7f9389400640 1 --2- 172.21.15.72:0/608124958 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9378004800 0x7f9378004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:56.622 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:56.622+0000 7f9391e00640 1 -- 172.21.15.72:0/608124958 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f939406cb90 msgr2=0x7f93780051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:57:56.622 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:56.622+0000 7f9391e00640 1 --2- 172.21.15.72:0/608124958 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f939406cb90 0x7f93780051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:56.622 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:56.622+0000 7f9391e00640 1 -- 172.21.15.72:0/608124958 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9378004800 msgr2=0x7f9378004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:57:56.622 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:56.622+0000 7f9391e00640 1 --2- 172.21.15.72:0/608124958 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9378004800 0x7f9378004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:56.622 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:56.622+0000 7f9391e00640 1 -- 172.21.15.72:0/608124958 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9378003520 con 0x7f93780039b0 2024-04-04T06:57:56.622 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:56.622+0000 7f9389400640 1 --2- 172.21.15.72:0/608124958 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9378004800 0x7f9378004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-04T06:57:56.623 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:56.623+0000 7f9391e00640 1 --2- 172.21.15.72:0/608124958 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f93780039b0 0x7f9378003dd0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f9384009fc0 tx=0x7f9378005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b781e7a285345ce server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:56.624 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:56.624+0000 7f9391400640 1 -- 172.21.15.72:0/608124958 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9384039070 con 0x7f93780039b0 2024-04-04T06:57:56.624 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:56.624+0000 7f9391400640 1 -- 172.21.15.72:0/608124958 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f938402cc40 con 0x7f93780039b0 2024-04-04T06:57:56.624 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:56.624+0000 7f9391400640 1 -- 172.21.15.72:0/608124958 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9384009c10 con 0x7f93780039b0 2024-04-04T06:57:56.624 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:56.624+0000 7f9393200640 1 -- 172.21.15.72:0/608124958 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f93780039b0 msgr2=0x7f9378003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:56.624 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:56.624+0000 7f9393200640 1 --2- 172.21.15.72:0/608124958 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f93780039b0 0x7f9378003dd0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f9384009fc0 tx=0x7f9378005830 comp rx=0 tx=0).stop 2024-04-04T06:57:56.624 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:56.624+0000 7f9392800640 1 -- 172.21.15.72:0/608124958 reap_dead start 2024-04-04T06:57:56.624 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:56.624+0000 7f9393200640 1 -- 172.21.15.72:0/608124958 shutdown_connections 2024-04-04T06:57:56.624 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:56.624+0000 7f9393200640 1 -- 172.21.15.72:0/608124958 >> 172.21.15.72:0/608124958 conn(0x7f9394072360 msgr2=0x7f9394072770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:56.624 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:56.624+0000 7f9393200640 1 -- 172.21.15.72:0/608124958 shutdown_connections 2024-04-04T06:57:56.624 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:56.624+0000 7f9393200640 1 -- 172.21.15.72:0/608124958 wait complete. 2024-04-04T06:57:56.625 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:56.627+0000 7f9393200640 1 Processor -- start 2024-04-04T06:57:56.626 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:56.627+0000 7f9393200640 1 -- start start 2024-04-04T06:57:56.628 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:56.628+0000 7f9393200640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f93780039b0 0x7f93941537d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:56.628 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:56.628+0000 7f9393200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9394160760 0x7f939415c130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:56.628 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:56.628+0000 7f9393200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f939415c670 0x7f939415e930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:56.628 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:56.628+0000 7f9393200640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f93940cf4c0 con 0x7f93780039b0 2024-04-04T06:57:56.628 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:56.628+0000 7f9393200640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f93940c6a80 con 0x7f9394160760 2024-04-04T06:57:56.628 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:56.628+0000 7f9393200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f93940cf640 con 0x7f939415c670 2024-04-04T06:57:56.628 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:56.629+0000 7f9391e00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f93780039b0 0x7f93941537d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:56.628 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:56.629+0000 7f9391e00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f93780039b0 0x7f93941537d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:38916/0 (socket says 172.21.15.72:38916) 2024-04-04T06:57:56.628 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:56.629+0000 7f9391e00640 1 -- 172.21.15.72:0/2723820653 learned_addr learned my addr 172.21.15.72:0/2723820653 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:57:56.628 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:56.629+0000 7f9391e00640 1 -- 172.21.15.72:0/2723820653 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f939415c670 msgr2=0x7f939415e930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:56.629 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:56.629+0000 7f9391e00640 1 --2- 172.21.15.72:0/2723820653 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f939415c670 0x7f939415e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:56.629 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:56.629+0000 7f9391e00640 1 -- 172.21.15.72:0/2723820653 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9394160760 msgr2=0x7f939415c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:56.629 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:56.629+0000 7f9391e00640 1 --2- 172.21.15.72:0/2723820653 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9394160760 0x7f939415c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:56.629 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:56.629+0000 7f9391e00640 1 -- 172.21.15.72:0/2723820653 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f939415f6c0 con 0x7f93780039b0 2024-04-04T06:57:56.629 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:56.629+0000 7f9391e00640 1 --2- 172.21.15.72:0/2723820653 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f93780039b0 0x7f93941537d0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f9384037040 tx=0x7f9384009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:56.630 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:56.630+0000 7f938aa00640 1 -- 172.21.15.72:0/2723820653 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9384039050 con 0x7f93780039b0 2024-04-04T06:57:56.630 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:56.630+0000 7f938aa00640 1 -- 172.21.15.72:0/2723820653 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f938403a040 con 0x7f93780039b0 2024-04-04T06:57:56.630 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:56.630+0000 7f938aa00640 1 -- 172.21.15.72:0/2723820653 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9384034de0 con 0x7f93780039b0 2024-04-04T06:57:56.630 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:56.630+0000 7f9393200640 1 -- 172.21.15.72:0/2723820653 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f939415f9a0 con 0x7f93780039b0 2024-04-04T06:57:56.630 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:56.630+0000 7f9393200640 1 -- 172.21.15.72:0/2723820653 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f939415ff60 con 0x7f93780039b0 2024-04-04T06:57:56.630 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:56.631+0000 7f9393200640 1 -- 172.21.15.72:0/2723820653 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f93940685a0 con 0x7f93780039b0 2024-04-04T06:57:56.631 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:56.633+0000 7f938aa00640 1 -- 172.21.15.72:0/2723820653 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9384047030 con 0x7f93780039b0 2024-04-04T06:57:56.632 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:56.634+0000 7f938aa00640 1 --2- 172.21.15.72:0/2723820653 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f937006c8f0 0x7f937006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:56.633 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:56.634+0000 7f938aa00640 1 -- 172.21.15.72:0/2723820653 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f93840add60 con 0x7f93780039b0 2024-04-04T06:57:56.633 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:56.634+0000 7f9389400640 1 --2- 172.21.15.72:0/2723820653 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f937006c8f0 0x7f937006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:56.633 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:56.635+0000 7f9389400640 1 --2- 172.21.15.72:0/2723820653 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f937006c8f0 0x7f937006edb0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f937c001920 tx=0x7f937c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:56.641 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:56.642+0000 7f938aa00640 1 -- 172.21.15.72:0/2723820653 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f938404e060 con 0x7f93780039b0 2024-04-04T06:57:56.969 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:56.970+0000 7f9393200640 1 -- 172.21.15.72:0/2723820653 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f939415caa0 con 0x7f93780039b0 2024-04-04T06:57:56.970 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:56.971+0000 7f938aa00640 1 -- 172.21.15.72:0/2723820653 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+5184 (secure 0 0 0) 0x7f938407c100 con 0x7f93780039b0 2024-04-04T06:57:56.970 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T06:57:56.970 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4619,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/2380537280","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6833","nonce":2380537280},{"type":"v1","addr":"172.21.15.117:6835","nonce":2380537280}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4840,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6834/108808341","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":108808341},{"type":"v1","addr":"172.21.15.117:6834","nonce":108808341}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":5253,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6836/3494332623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":3494332623},{"type":"v1","addr":"172.21.15.72:6836","nonce":3494332623}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-04T06:57:50.020152+0000","modified":"2024-04-04T06:57:53.165429+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5256},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5256":{"gid":5256,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.72:6837/2509618069","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6835","nonce":2509618069},{"type":"v1","addr":"172.21.15.72:6837","nonce":2509618069}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5256,"qdb_cluster":[5256]},"id":2}]} 2024-04-04T06:57:56.970 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 17 2024-04-04T06:57:56.973 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:56.973+0000 7f9393200640 1 -- 172.21.15.72:0/2723820653 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f937006c8f0 msgr2=0x7f937006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:56.973 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:56.973+0000 7f9393200640 1 --2- 172.21.15.72:0/2723820653 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f937006c8f0 0x7f937006edb0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f937c001920 tx=0x7f937c009040 comp rx=0 tx=0).stop 2024-04-04T06:57:56.973 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:56.973+0000 7f9393200640 1 -- 172.21.15.72:0/2723820653 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f93780039b0 msgr2=0x7f93941537d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:56.973 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:56.973+0000 7f9393200640 1 --2- 172.21.15.72:0/2723820653 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f93780039b0 0x7f93941537d0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f9384037040 tx=0x7f9384009750 comp rx=0 tx=0).stop 2024-04-04T06:57:56.973 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:56.973+0000 7f9393200640 1 -- 172.21.15.72:0/2723820653 shutdown_connections 2024-04-04T06:57:56.973 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:56.973+0000 7f9393200640 1 --2- 172.21.15.72:0/2723820653 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f937006c8f0 0x7f937006edb0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:56.973 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:56.973+0000 7f9393200640 1 --2- 172.21.15.72:0/2723820653 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f939415c670 0x7f939415e930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:56.973 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:56.973+0000 7f9393200640 1 --2- 172.21.15.72:0/2723820653 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9394160760 0x7f939415c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:56.973 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:56.973+0000 7f9393200640 1 --2- 172.21.15.72:0/2723820653 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f93780039b0 0x7f93941537d0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:56.973 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:56.974+0000 7f9393200640 1 -- 172.21.15.72:0/2723820653 >> 172.21.15.72:0/2723820653 conn(0x7f9394072360 msgr2=0x7f939415d730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:56.973 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:56.974+0000 7f9393200640 1 -- 172.21.15.72:0/2723820653 shutdown_connections 2024-04-04T06:57:56.973 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:56.974+0000 7f9393200640 1 -- 172.21.15.72:0/2723820653 wait complete. 2024-04-04T06:57:57.396 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-04T06:57:50.020152+0000', 'modified': '2024-04-04T06:57:53.165429+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5256}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5256': {'gid': 5256, 'name': 'a', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.72:6837/2509618069', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.72:6835', 'nonce': 2509618069}, {'type': 'v1', 'addr': '172.21.15.72:6837', 'nonce': 2509618069}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 5256, 'qdb_cluster': [5256]} 2024-04-04T06:57:57.396 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-04T06:57:57.397 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-04-04T06:57:57.614 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.615+0000 7f6502200640 1 Processor -- start 2024-04-04T06:57:57.614 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.616+0000 7f6502200640 1 -- start start 2024-04-04T06:57:57.616 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.617+0000 7f6502200640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f64fc15be80 0x7f64fc06c480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:57.616 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.617+0000 7f6502200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f64fc15f530 0x7f64fc06c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:57.616 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.617+0000 7f6502200640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f64fc161e70 0x7f64fc162300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:57.616 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.617+0000 7f6502200640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f64fc15ea70 con 0x7f64fc161e70 2024-04-04T06:57:57.616 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.617+0000 7f6502200640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f64fc15c260 con 0x7f64fc15be80 2024-04-04T06:57:57.616 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.617+0000 7f6502200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f64fc162ba0 con 0x7f64fc15f530 2024-04-04T06:57:57.616 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.617+0000 7f6501800640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f64fc161e70 0x7f64fc162300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:57.616 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.617+0000 7f6501800640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f64fc161e70 0x7f64fc162300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:38924/0 (socket says 172.21.15.72:38924) 2024-04-04T06:57:57.616 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.617+0000 7f6501800640 1 -- 172.21.15.72:0/2617331216 learned_addr learned my addr 172.21.15.72:0/2617331216 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:57:57.617 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.618+0000 7f6501800640 1 -- 172.21.15.72:0/2617331216 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f64fc15f530 msgr2=0x7f64fc06c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:57:57.617 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.618+0000 7f64fbe00640 1 --2- 172.21.15.72:0/2617331216 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f64fc15f530 0x7f64fc06c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:57.617 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.618+0000 7f6500e00640 1 --2- 172.21.15.72:0/2617331216 >> v2:172.21.15.117:3300/0 conn(0x7f64fc15be80 0x7f64fc06c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:57.617 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.618+0000 7f6501800640 1 --2- 172.21.15.72:0/2617331216 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f64fc15f530 0x7f64fc06c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:57.617 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.618+0000 7f6501800640 1 -- 172.21.15.72:0/2617331216 >> v2:172.21.15.117:3300/0 conn(0x7f64fc15be80 msgr2=0x7f64fc06c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:57:57.617 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.618+0000 7f6501800640 1 --2- 172.21.15.72:0/2617331216 >> v2:172.21.15.117:3300/0 conn(0x7f64fc15be80 0x7f64fc06c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:57.618 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.618+0000 7f6501800640 1 -- 172.21.15.72:0/2617331216 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64fc15ed30 con 0x7f64fc161e70 2024-04-04T06:57:57.618 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.618+0000 7f6500e00640 1 --2- 172.21.15.72:0/2617331216 >> v2:172.21.15.117:3300/0 conn(0x7f64fc15be80 0x7f64fc06c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-04T06:57:57.618 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.618+0000 7f64fbe00640 1 --2- 172.21.15.72:0/2617331216 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f64fc15f530 0x7f64fc06c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-04T06:57:57.619 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.619+0000 7f6501800640 1 --2- 172.21.15.72:0/2617331216 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f64fc161e70 0x7f64fc162300 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f64fc073720 tx=0x7f64f402bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac944159c04fb6e server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:57.619 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.619+0000 7f64fb400640 1 -- 172.21.15.72:0/2617331216 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64f402ca80 con 0x7f64fc161e70 2024-04-04T06:57:57.619 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.619+0000 7f64fb400640 1 -- 172.21.15.72:0/2617331216 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64f402cc20 con 0x7f64fc161e70 2024-04-04T06:57:57.619 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.619+0000 7f64fb400640 1 -- 172.21.15.72:0/2617331216 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64f40343f0 con 0x7f64fc161e70 2024-04-04T06:57:57.619 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.620+0000 7f6502200640 1 -- 172.21.15.72:0/2617331216 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f64fc161e70 msgr2=0x7f64fc162300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:57.619 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.620+0000 7f6502200640 1 --2- 172.21.15.72:0/2617331216 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f64fc161e70 0x7f64fc162300 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f64fc073720 tx=0x7f64f402bee0 comp rx=0 tx=0).stop 2024-04-04T06:57:57.619 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.620+0000 7f6502200640 1 -- 172.21.15.72:0/2617331216 shutdown_connections 2024-04-04T06:57:57.620 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.620+0000 7f6502200640 1 --2- 172.21.15.72:0/2617331216 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f64fc161e70 0x7f64fc162300 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:57.620 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.620+0000 7f6502200640 1 --2- 172.21.15.72:0/2617331216 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f64fc15f530 0x7f64fc06c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:57.620 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.620+0000 7f6502200640 1 --2- 172.21.15.72:0/2617331216 >> v2:172.21.15.117:3300/0 conn(0x7f64fc15be80 0x7f64fc06c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:57.620 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.620+0000 7f6502200640 1 -- 172.21.15.72:0/2617331216 >> 172.21.15.72:0/2617331216 conn(0x7f64fc072280 msgr2=0x7f64fc072690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:57.620 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.620+0000 7f6502200640 1 -- 172.21.15.72:0/2617331216 shutdown_connections 2024-04-04T06:57:57.620 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.620+0000 7f6502200640 1 -- 172.21.15.72:0/2617331216 wait complete. 2024-04-04T06:57:57.620 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.622+0000 7f6502200640 1 Processor -- start 2024-04-04T06:57:57.620 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.622+0000 7f6502200640 1 -- start start 2024-04-04T06:57:57.623 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.623+0000 7f6502200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f64fc15be80 0x7f64fc0cffa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:57.623 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.623+0000 7f6502200640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f64fc15f530 0x7f64fc070440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:57.623 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.623+0000 7f6502200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f64fc161e70 0x7f64fc1f7760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:57.623 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.623+0000 7f6502200640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f64fc0add40 con 0x7f64fc15f530 2024-04-04T06:57:57.623 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.623+0000 7f6502200640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f64fc162840 con 0x7f64fc161e70 2024-04-04T06:57:57.623 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.623+0000 7f6502200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f64fc0adec0 con 0x7f64fc15be80 2024-04-04T06:57:57.624 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.623+0000 7f64fbe00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f64fc15f530 0x7f64fc070440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:57.624 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.623+0000 7f64fbe00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f64fc15f530 0x7f64fc070440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:38934/0 (socket says 172.21.15.72:38934) 2024-04-04T06:57:57.624 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.623+0000 7f64fbe00640 1 -- 172.21.15.72:0/2674878718 learned_addr learned my addr 172.21.15.72:0/2674878718 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:57:57.624 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.623+0000 7f6501800640 1 --2- 172.21.15.72:0/2674878718 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f64fc161e70 0x7f64fc1f7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:57.624 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.623+0000 7f6500e00640 1 --2- 172.21.15.72:0/2674878718 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f64fc15be80 0x7f64fc0cffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:57.624 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.623+0000 7f64fbe00640 1 -- 172.21.15.72:0/2674878718 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f64fc15be80 msgr2=0x7f64fc0cffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:57.624 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.623+0000 7f64fbe00640 1 --2- 172.21.15.72:0/2674878718 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f64fc15be80 0x7f64fc0cffa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:57.624 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.623+0000 7f64fbe00640 1 -- 172.21.15.72:0/2674878718 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f64fc161e70 msgr2=0x7f64fc1f7760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:57.624 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.624+0000 7f64fbe00640 1 --2- 172.21.15.72:0/2674878718 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f64fc161e70 0x7f64fc1f7760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:57.624 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.624+0000 7f64fbe00640 1 -- 172.21.15.72:0/2674878718 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64fc1435f0 con 0x7f64fc15f530 2024-04-04T06:57:57.624 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.624+0000 7f6500e00640 1 --2- 172.21.15.72:0/2674878718 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f64fc15be80 0x7f64fc0cffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-04T06:57:57.624 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.624+0000 7f6501800640 1 --2- 172.21.15.72:0/2674878718 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f64fc161e70 0x7f64fc1f7760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-04T06:57:57.624 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.624+0000 7f64fbe00640 1 --2- 172.21.15.72:0/2674878718 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f64fc15f530 0x7f64fc070440 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f64e800c820 tx=0x7f64e800cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:57.624 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.624+0000 7f64f8c00640 1 -- 172.21.15.72:0/2674878718 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64e8015070 con 0x7f64fc15f530 2024-04-04T06:57:57.625 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.624+0000 7f64f8c00640 1 -- 172.21.15.72:0/2674878718 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64e8007a30 con 0x7f64fc15f530 2024-04-04T06:57:57.625 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.624+0000 7f64f8c00640 1 -- 172.21.15.72:0/2674878718 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64e8007e00 con 0x7f64fc15f530 2024-04-04T06:57:57.625 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.624+0000 7f6502200640 1 -- 172.21.15.72:0/2674878718 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64fc0cda40 con 0x7f64fc15f530 2024-04-04T06:57:57.625 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.624+0000 7f6502200640 1 -- 172.21.15.72:0/2674878718 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64fc154300 con 0x7f64fc15f530 2024-04-04T06:57:57.626 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.627+0000 7f64f8c00640 1 -- 172.21.15.72:0/2674878718 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f64e8018070 con 0x7f64fc15f530 2024-04-04T06:57:57.627 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.627+0000 7f64f8c00640 1 --2- 172.21.15.72:0/2674878718 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f64dc06c8f0 0x7f64dc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:57.627 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.628+0000 7f64f8c00640 1 -- 172.21.15.72:0/2674878718 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f64e808bab0 con 0x7f64fc15f530 2024-04-04T06:57:57.627 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.628+0000 7f6500e00640 1 --2- 172.21.15.72:0/2674878718 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f64dc06c8f0 0x7f64dc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:57.627 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.628+0000 7f65061fd740 1 Processor -- start 2024-04-04T06:57:57.627 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.628+0000 7f6500e00640 1 --2- 172.21.15.72:0/2674878718 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f64dc06c8f0 0x7f64dc06edb0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f64f0006fd0 tx=0x7f64f0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:57.627 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.628+0000 7f65061fd740 1 -- start start 2024-04-04T06:57:57.629 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.629+0000 7f65061fd740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x559b9c079300 0x559b9c04c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:57.629 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.629+0000 7f65061fd740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559b9c0796e0 0x559b9c07c090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:57.629 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.629+0000 7f65061fd740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x559b9c04c7e0 0x559b9c07c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:57.629 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.629+0000 7f65061fd740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x559b9c013ab0 con 0x559b9c04c7e0 2024-04-04T06:57:57.629 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.629+0000 7f65061fd740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x559b9bfb5fa0 con 0x559b9c0796e0 2024-04-04T06:57:57.629 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.629+0000 7f65061fd740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x559b9bf5e560 con 0x559b9c079300 2024-04-04T06:57:57.629 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.629+0000 7f6501800640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x559b9c04c7e0 0x559b9c07c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:57.629 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.630+0000 7f6501800640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x559b9c04c7e0 0x559b9c07c5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:38948/0 (socket says 172.21.15.72:38948) 2024-04-04T06:57:57.629 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.630+0000 7f6501800640 1 -- 172.21.15.72:0/1969323751 learned_addr learned my addr 172.21.15.72:0/1969323751 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:57:57.629 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.630+0000 7f64fbe00640 1 --2- 172.21.15.72:0/1969323751 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559b9c0796e0 0x559b9c07c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:57.629 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.630+0000 7f6500e00640 1 --2- 172.21.15.72:0/1969323751 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x559b9c079300 0x559b9c04c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:57.629 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.630+0000 7f6501800640 1 -- 172.21.15.72:0/1969323751 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x559b9c079300 msgr2=0x559b9c04c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:57:57.629 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.630+0000 7f6501800640 1 --2- 172.21.15.72:0/1969323751 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x559b9c079300 0x559b9c04c2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:57.630 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.630+0000 7f6501800640 1 -- 172.21.15.72:0/1969323751 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559b9c0796e0 msgr2=0x559b9c07c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:57:57.630 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.630+0000 7f6501800640 1 --2- 172.21.15.72:0/1969323751 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559b9c0796e0 0x559b9c07c090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:57.630 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.630+0000 7f6501800640 1 -- 172.21.15.72:0/1969323751 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559b9bcca2d0 con 0x559b9c04c7e0 2024-04-04T06:57:57.631 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.631+0000 7f6501800640 1 --2- 172.21.15.72:0/1969323751 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x559b9c04c7e0 0x559b9c07c5d0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f64f402bf20 tx=0x7f64f402e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a16da7b3c69bd35 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:57.631 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.631+0000 7f64ed600640 1 -- 172.21.15.72:0/1969323751 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64f402cc00 con 0x559b9c04c7e0 2024-04-04T06:57:57.631 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.631+0000 7f64ed600640 1 -- 172.21.15.72:0/1969323751 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64f403e430 con 0x559b9c04c7e0 2024-04-04T06:57:57.631 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.631+0000 7f64ed600640 1 -- 172.21.15.72:0/1969323751 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64f403e7e0 con 0x559b9c04c7e0 2024-04-04T06:57:57.631 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.632+0000 7f65061fd740 1 -- 172.21.15.72:0/1969323751 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x559b9c04c7e0 msgr2=0x559b9c07c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:57.631 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.632+0000 7f65061fd740 1 --2- 172.21.15.72:0/1969323751 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x559b9c04c7e0 0x559b9c07c5d0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f64f402bf20 tx=0x7f64f402e000 comp rx=0 tx=0).stop 2024-04-04T06:57:57.631 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.632+0000 7f65061fd740 1 -- 172.21.15.72:0/1969323751 shutdown_connections 2024-04-04T06:57:57.631 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.632+0000 7f65061fd740 1 --2- 172.21.15.72:0/1969323751 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x559b9c04c7e0 0x559b9c07c5d0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:57.632 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.632+0000 7f65061fd740 1 --2- 172.21.15.72:0/1969323751 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559b9c0796e0 0x559b9c07c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:57.632 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.632+0000 7f65061fd740 1 --2- 172.21.15.72:0/1969323751 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x559b9c079300 0x559b9c04c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:57.632 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.632+0000 7f65061fd740 1 -- 172.21.15.72:0/1969323751 >> 172.21.15.72:0/1969323751 conn(0x559b9c04e510 msgr2=0x559b9c097090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:57.632 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.632+0000 7f65061fd740 1 -- 172.21.15.72:0/1969323751 shutdown_connections 2024-04-04T06:57:57.632 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.632+0000 7f65061fd740 1 -- 172.21.15.72:0/1969323751 wait complete. 2024-04-04T06:57:57.632 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.633+0000 7f65061fd740 1 -- start start 2024-04-04T06:57:57.634 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.633+0000 7f65061fd740 1 Processor -- start 2024-04-04T06:57:57.635 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.634+0000 7f65061fd740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559b9c079300 0x559b9c07f080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:57.635 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.634+0000 7f65061fd740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x559b9c0796e0 0x559b9c08e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:57.635 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.634+0000 7f65061fd740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x559b9c06a730 0x559b9c08ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:57.635 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.634+0000 7f65061fd740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x559b9bf71920 con 0x559b9c06a730 2024-04-04T06:57:57.635 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.634+0000 7f65061fd740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x559b9bfb1f50 con 0x559b9c079300 2024-04-04T06:57:57.635 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.634+0000 7f65061fd740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x559b9c050ab0 con 0x559b9c0796e0 2024-04-04T06:57:57.635 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.634+0000 7f65061fd740 10 client.0 _ll_register_callbacks cb 0x559b9bf71310 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-04T06:57:57.635 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.634+0000 7f6501800640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x559b9c06a730 0x559b9c08ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:57.635 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.634+0000 7f6501800640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x559b9c06a730 0x559b9c08ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:38952/0 (socket says 172.21.15.72:38952) 2024-04-04T06:57:57.635 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.634+0000 7f6501800640 1 -- 172.21.15.72:0/100086818 learned_addr learned my addr 172.21.15.72:0/100086818 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:57:57.635 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.634+0000 7f6500e00640 1 --2- 172.21.15.72:0/100086818 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559b9c079300 0x559b9c07f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:57.635 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.635+0000 7f64fbe00640 1 --2- 172.21.15.72:0/100086818 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x559b9c0796e0 0x559b9c08e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:57.635 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.635+0000 7f6501800640 1 -- 172.21.15.72:0/100086818 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x559b9c0796e0 msgr2=0x559b9c08e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:57:57.636 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.635+0000 7f6501800640 1 --2- 172.21.15.72:0/100086818 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x559b9c0796e0 0x559b9c08e7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:57.636 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.635+0000 7f6501800640 1 -- 172.21.15.72:0/100086818 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559b9c079300 msgr2=0x559b9c07f080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:57:57.636 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.635+0000 7f6501800640 1 --2- 172.21.15.72:0/100086818 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559b9c079300 0x559b9c07f080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:57.636 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.635+0000 7f6501800640 1 -- 172.21.15.72:0/100086818 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559b9bd946b0 con 0x559b9c06a730 2024-04-04T06:57:57.636 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.635+0000 7f64fbe00640 1 --2- 172.21.15.72:0/100086818 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x559b9c0796e0 0x559b9c08e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-04T06:57:57.636 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.635+0000 7f6501800640 1 --2- 172.21.15.72:0/100086818 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x559b9c06a730 0x559b9c08ed00 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f64f4009f40 tx=0x7f64f4004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c49463df42035597 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:57.636 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.635+0000 7f64e2000640 10 client.0 ms_handle_connect on v2:172.21.15.72:3300/0 2024-04-04T06:57:57.636 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.635+0000 7f64e2000640 1 -- 172.21.15.72:0/100086818 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64f404e070 con 0x559b9c06a730 2024-04-04T06:57:57.636 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.635+0000 7f64e2000640 1 -- 172.21.15.72:0/100086818 <== mon.0 v2:172.21.15.72:3300/0 2 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f64f403eda0 con 0x559b9c06a730 2024-04-04T06:57:57.636 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.635+0000 7f65061fd740 1 -- 172.21.15.72:0/100086818 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f64f403e430 con 0x559b9c06a730 2024-04-04T06:57:57.636 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.636+0000 7f64e2000640 1 -- 172.21.15.72:0/100086818 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f64f40483f0 con 0x559b9c06a730 2024-04-04T06:57:57.636 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.636+0000 7f65061fd740 10 client.5427 fetch_fsmap learned FSMap version 17 2024-04-04T06:57:57.636 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.636+0000 7f65061fd740 1 -- 172.21.15.72:0/100086818 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) -- 0x559b9c07aa90 con 0x559b9c06a730 2024-04-04T06:57:57.636 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.636+0000 7f64e2000640 1 -- 172.21.15.72:0/100086818 <== mon.0 v2:172.21.15.72:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64f403e430 con 0x559b9c06a730 2024-04-04T06:57:57.637 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.636+0000 7f64e2000640 1 -- 172.21.15.72:0/100086818 <== mon.0 v2:172.21.15.72:3300/0 5 ==== fsmap(e 17) ==== 3494+0+0 (secure 0 0 0) 0x7f64f4008040 con 0x559b9c06a730 2024-04-04T06:57:57.638 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.636+0000 7f65061fd740 10 client.5427 fetch_fsmap finished waiting for FSMap version 17 2024-04-04T06:57:57.638 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.636+0000 7f65061fd740 10 client.5427 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-04T06:57:57.638 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.636+0000 7f65061fd740 20 client.5427 populate_metadata read hostname 'smithi072' 2024-04-04T06:57:57.638 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.636+0000 7f65061fd740 1 --2- 172.21.15.72:0/100086818 >> [v2:172.21.15.72:6835/2509618069,v1:172.21.15.72:6837/2509618069] conn(0x559b9c0aaf60 0x559b9c0ab340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:57.638 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.636+0000 7f65061fd740 4 client.5427 mds_command: new command op to 5256 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-04T06:57:57.639 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.636+0000 7f65061fd740 1 -- 172.21.15.72:0/100086818 --> [v2:172.21.15.72:6835/2509618069,v1:172.21.15.72:6837/2509618069] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559b9bfc34e0 con 0x559b9c0aaf60 2024-04-04T06:57:57.639 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.637+0000 7f6500e00640 1 --2- 172.21.15.72:0/100086818 >> [v2:172.21.15.72:6835/2509618069,v1:172.21.15.72:6837/2509618069] conn(0x559b9c0aaf60 0x559b9c0ab340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:57.639 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.637+0000 7f6500e00640 1 --2- 172.21.15.72:0/100086818 >> [v2:172.21.15.72:6835/2509618069,v1:172.21.15.72:6837/2509618069] conn(0x559b9c0aaf60 0x559b9c0ab340 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ee001e445b899391 server_cookie=5fa2fb998bddf137 in_seq=0 out_seq=0 2024-04-04T06:57:57.639 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.637+0000 7f64e2000640 10 client.5427 ms_handle_connect on v2:172.21.15.72:6835/2509618069 2024-04-04T06:57:57.639 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.638+0000 7f64e2000640 1 -- 172.21.15.72:0/100086818 <== mds.0 v2:172.21.15.72:6835/2509618069 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x559b9bfc34e0 con 0x559b9c0aaf60 2024-04-04T06:57:57.639 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.638+0000 7f64e2000640 10 client.5427 handle_command_reply: tid=0 2024-04-04T06:57:57.639 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.638+0000 7f65061fd740 1 client.5427 shutdown 2024-04-04T06:57:57.639 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.638+0000 7f65061fd740 1 -- 172.21.15.72:0/100086818 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x559b9c06a730 msgr2=0x559b9c08ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:57.639 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.638+0000 7f65061fd740 1 --2- 172.21.15.72:0/100086818 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x559b9c06a730 0x559b9c08ed00 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f64f4009f40 tx=0x7f64f4004ab0 comp rx=0 tx=0).stop 2024-04-04T06:57:57.639 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.638+0000 7f65061fd740 1 -- 172.21.15.72:0/100086818 shutdown_connections 2024-04-04T06:57:57.639 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.638+0000 7f65061fd740 1 --2- 172.21.15.72:0/100086818 >> [v2:172.21.15.72:6835/2509618069,v1:172.21.15.72:6837/2509618069] conn(0x559b9c0aaf60 0x559b9c0ab340 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:57.639 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.638+0000 7f65061fd740 1 --2- 172.21.15.72:0/100086818 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x559b9c06a730 0x559b9c08ed00 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:57.639 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.638+0000 7f65061fd740 1 --2- 172.21.15.72:0/100086818 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x559b9c0796e0 0x559b9c08e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:57.639 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.638+0000 7f64e2000640 0 client.5427 ms_handle_reset on v2:172.21.15.72:6835/2509618069 2024-04-04T06:57:57.640 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.638+0000 7f65061fd740 1 --2- 172.21.15.72:0/100086818 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559b9c079300 0x559b9c07f080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:57.640 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.638+0000 7f65061fd740 1 -- 172.21.15.72:0/100086818 >> 172.21.15.72:0/100086818 conn(0x559b9c04c7e0 msgr2=0x559b9c04ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:57.640 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.638+0000 7f65061fd740 1 -- 172.21.15.72:0/100086818 shutdown_connections 2024-04-04T06:57:57.640 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.639+0000 7f65061fd740 1 -- 172.21.15.72:0/100086818 wait complete. 2024-04-04T06:57:57.640 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.639+0000 7f65061fd740 20 client.5427 trim_cache size 0 max 16384 2024-04-04T06:57:57.657 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.658+0000 7f65061fd740 1 Processor -- start 2024-04-04T06:57:57.657 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.658+0000 7f65061fd740 1 -- start start 2024-04-04T06:57:57.658 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.659+0000 7f65061fd740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x559b9c06a730 0x559b9c07d850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:57.659 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.659+0000 7f65061fd740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x559b9c079300 0x559b9c0aa800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:57.659 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.659+0000 7f65061fd740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559b9c0796e0 0x559b9c0bb520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:57.659 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.659+0000 7f65061fd740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f64fc146750 con 0x559b9c06a730 2024-04-04T06:57:57.659 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.659+0000 7f65061fd740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f64fc155960 con 0x559b9c0796e0 2024-04-04T06:57:57.659 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.659+0000 7f65061fd740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f64fc1460c0 con 0x559b9c079300 2024-04-04T06:57:57.659 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.659+0000 7f6500e00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x559b9c06a730 0x559b9c07d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:57.659 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.659+0000 7f6500e00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x559b9c06a730 0x559b9c07d850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:38960/0 (socket says 172.21.15.72:38960) 2024-04-04T06:57:57.659 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.659+0000 7f6500e00640 1 -- 172.21.15.72:0/3975325116 learned_addr learned my addr 172.21.15.72:0/3975325116 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:57:57.659 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.660+0000 7f64fbe00640 1 --2- 172.21.15.72:0/3975325116 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x559b9c079300 0x559b9c0aa800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:57.659 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.660+0000 7f6501800640 1 --2- 172.21.15.72:0/3975325116 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559b9c0796e0 0x559b9c0bb520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:57.659 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.660+0000 7f6500e00640 1 -- 172.21.15.72:0/3975325116 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x559b9c079300 msgr2=0x559b9c0aa800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:57:57.659 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.660+0000 7f6500e00640 1 --2- 172.21.15.72:0/3975325116 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x559b9c079300 0x559b9c0aa800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:57.659 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.660+0000 7f6500e00640 1 -- 172.21.15.72:0/3975325116 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559b9c0796e0 msgr2=0x559b9c0bb520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:57:57.659 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.660+0000 7f6500e00640 1 --2- 172.21.15.72:0/3975325116 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559b9c0796e0 0x559b9c0bb520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:57.660 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.660+0000 7f6500e00640 1 -- 172.21.15.72:0/3975325116 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559b9bfb8440 con 0x559b9c06a730 2024-04-04T06:57:57.660 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.660+0000 7f6500e00640 1 --2- 172.21.15.72:0/3975325116 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x559b9c06a730 0x559b9c07d850 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f64f000dd40 tx=0x7f64f0013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bbb7339d02815fe server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:57.661 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.660+0000 7f64ecc00640 1 -- 172.21.15.72:0/3975325116 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64f002d070 con 0x559b9c06a730 2024-04-04T06:57:57.661 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.660+0000 7f64ecc00640 1 -- 172.21.15.72:0/3975325116 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64f001a040 con 0x559b9c06a730 2024-04-04T06:57:57.661 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.660+0000 7f64ecc00640 1 -- 172.21.15.72:0/3975325116 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64f0019040 con 0x559b9c06a730 2024-04-04T06:57:57.661 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.661+0000 7f65061fd740 1 -- 172.21.15.72:0/3975325116 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x559b9c06a730 msgr2=0x559b9c07d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:57.661 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.661+0000 7f65061fd740 1 --2- 172.21.15.72:0/3975325116 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x559b9c06a730 0x559b9c07d850 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f64f000dd40 tx=0x7f64f0013000 comp rx=0 tx=0).stop 2024-04-04T06:57:57.661 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.661+0000 7f65061fd740 1 -- 172.21.15.72:0/3975325116 shutdown_connections 2024-04-04T06:57:57.661 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.661+0000 7f65061fd740 1 --2- 172.21.15.72:0/3975325116 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559b9c0796e0 0x559b9c0bb520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:57.661 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.661+0000 7f65061fd740 1 --2- 172.21.15.72:0/3975325116 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x559b9c079300 0x559b9c0aa800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:57.661 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.661+0000 7f65061fd740 1 --2- 172.21.15.72:0/3975325116 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x559b9c06a730 0x559b9c07d850 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:57.662 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.661+0000 7f65061fd740 1 -- 172.21.15.72:0/3975325116 >> 172.21.15.72:0/3975325116 conn(0x559b9c04c7e0 msgr2=0x559b9c09a5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:57.662 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.661+0000 7f65061fd740 1 -- 172.21.15.72:0/3975325116 shutdown_connections 2024-04-04T06:57:57.662 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.661+0000 7f65061fd740 1 -- 172.21.15.72:0/3975325116 wait complete. 2024-04-04T06:57:57.662 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.662+0000 7f65061fd740 1 -- start start 2024-04-04T06:57:57.662 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.662+0000 7f65061fd740 1 Processor -- start 2024-04-04T06:57:57.664 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.664+0000 7f65061fd740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x559b9c06a730 0x559b9c096b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:57.665 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.664+0000 7f65061fd740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559b9c079300 0x559b9c119320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:57.665 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.664+0000 7f65061fd740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x559b9c0796e0 0x559b9c09a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:57.665 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.664+0000 7f65061fd740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x559b9bf71920 con 0x559b9c06a730 2024-04-04T06:57:57.665 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.664+0000 7f65061fd740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x559b9bfb1f50 con 0x559b9c079300 2024-04-04T06:57:57.665 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.664+0000 7f65061fd740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x559b9c07b760 con 0x559b9c0796e0 2024-04-04T06:57:57.665 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.664+0000 7f65061fd740 10 client.0 _ll_register_callbacks cb 0x7f64f402c400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-04T06:57:57.665 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.664+0000 7f6500e00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x559b9c06a730 0x559b9c096b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:57.665 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.664+0000 7f6500e00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x559b9c06a730 0x559b9c096b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:38970/0 (socket says 172.21.15.72:38970) 2024-04-04T06:57:57.665 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.664+0000 7f6500e00640 1 -- 172.21.15.72:0/13081482 learned_addr learned my addr 172.21.15.72:0/13081482 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:57:57.665 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.664+0000 7f6500e00640 1 -- 172.21.15.72:0/13081482 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x559b9c0796e0 msgr2=0x559b9c09a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:57:57.665 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.664+0000 7f6500e00640 1 --2- 172.21.15.72:0/13081482 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x559b9c0796e0 0x559b9c09a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:57.665 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.664+0000 7f6500e00640 1 -- 172.21.15.72:0/13081482 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559b9c079300 msgr2=0x559b9c119320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:57:57.665 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.664+0000 7f64fbe00640 1 --2- 172.21.15.72:0/13081482 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559b9c079300 0x559b9c119320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:57.666 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.665+0000 7f6500e00640 1 --2- 172.21.15.72:0/13081482 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559b9c079300 0x559b9c119320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:57.666 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.665+0000 7f6500e00640 1 -- 172.21.15.72:0/13081482 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559b9c119860 con 0x559b9c06a730 2024-04-04T06:57:57.666 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.665+0000 7f64fbe00640 1 --2- 172.21.15.72:0/13081482 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559b9c079300 0x559b9c119320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-04T06:57:57.666 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.665+0000 7f6500e00640 1 --2- 172.21.15.72:0/13081482 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x559b9c06a730 0x559b9c096b90 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f64f002b040 tx=0x7f64f0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d7675354239b8d8 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:57.666 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.665+0000 7f64e2000640 10 client.0 ms_handle_connect on v2:172.21.15.72:3300/0 2024-04-04T06:57:57.666 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.665+0000 7f64e2000640 1 -- 172.21.15.72:0/13081482 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64f0038060 con 0x559b9c06a730 2024-04-04T06:57:57.666 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.665+0000 7f64e2000640 1 -- 172.21.15.72:0/13081482 <== mon.0 v2:172.21.15.72:3300/0 2 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f64f0033440 con 0x559b9c06a730 2024-04-04T06:57:57.666 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.665+0000 7f65061fd740 1 -- 172.21.15.72:0/13081482 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f64f001a040 con 0x559b9c06a730 2024-04-04T06:57:57.666 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.665+0000 7f64e2000640 1 -- 172.21.15.72:0/13081482 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f64f002d070 con 0x559b9c06a730 2024-04-04T06:57:57.666 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.665+0000 7f65061fd740 10 client.5433 fetch_fsmap learned FSMap version 17 2024-04-04T06:57:57.666 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.665+0000 7f65061fd740 1 -- 172.21.15.72:0/13081482 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) -- 0x559b9c08cbc0 con 0x559b9c06a730 2024-04-04T06:57:57.666 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.666+0000 7f64e2000640 1 -- 172.21.15.72:0/13081482 <== mon.0 v2:172.21.15.72:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64f001a040 con 0x559b9c06a730 2024-04-04T06:57:57.666 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.666+0000 7f64e2000640 1 -- 172.21.15.72:0/13081482 <== mon.0 v2:172.21.15.72:3300/0 5 ==== fsmap(e 17) ==== 3494+0+0 (secure 0 0 0) 0x7f64f001f040 con 0x559b9c06a730 2024-04-04T06:57:57.666 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.666+0000 7f65061fd740 10 client.5433 fetch_fsmap finished waiting for FSMap version 17 2024-04-04T06:57:57.666 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.666+0000 7f65061fd740 10 client.5433 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-04T06:57:57.667 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.666+0000 7f65061fd740 20 client.5433 populate_metadata read hostname 'smithi072' 2024-04-04T06:57:57.667 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.666+0000 7f65061fd740 1 --2- 172.21.15.72:0/13081482 >> [v2:172.21.15.72:6835/2509618069,v1:172.21.15.72:6837/2509618069] conn(0x559b9c0981e0 0x559b9c09aae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:57.667 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.666+0000 7f65061fd740 4 client.5433 mds_command: new command op to 5256 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-04T06:57:57.667 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.666+0000 7f65061fd740 1 -- 172.21.15.72:0/13081482 --> [v2:172.21.15.72:6835/2509618069,v1:172.21.15.72:6837/2509618069] -- command(tid 0: {"prefix": "status"}) -- 0x559b9c07e240 con 0x559b9c0981e0 2024-04-04T06:57:57.667 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.666+0000 7f64fbe00640 1 --2- 172.21.15.72:0/13081482 >> [v2:172.21.15.72:6835/2509618069,v1:172.21.15.72:6837/2509618069] conn(0x559b9c0981e0 0x559b9c09aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:57.668 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.666+0000 7f64fbe00640 1 --2- 172.21.15.72:0/13081482 >> [v2:172.21.15.72:6835/2509618069,v1:172.21.15.72:6837/2509618069] conn(0x559b9c0981e0 0x559b9c09aae0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b01720dd3c8358b2 server_cookie=76fb90171f752df0 in_seq=0 out_seq=0 2024-04-04T06:57:57.668 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.666+0000 7f64e2000640 10 client.5433 ms_handle_connect on v2:172.21.15.72:6835/2509618069 2024-04-04T06:57:57.668 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.667+0000 7f64e2000640 1 -- 172.21.15.72:0/13081482 <== mds.0 v2:172.21.15.72:6835/2509618069 1 ==== command_reply(tid 0: 0 ) ==== 8+0+323 (crc 0 0 0) 0x559b9c07e240 con 0x559b9c0981e0 2024-04-04T06:57:57.668 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.667+0000 7f64e2000640 10 client.5433 handle_command_reply: tid=0 2024-04-04T06:57:57.668 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.667+0000 7f65061fd740 1 client.5433 shutdown 2024-04-04T06:57:57.668 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.667+0000 7f65061fd740 1 -- 172.21.15.72:0/13081482 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x559b9c06a730 msgr2=0x559b9c096b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:57.669 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.667+0000 7f65061fd740 1 --2- 172.21.15.72:0/13081482 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x559b9c06a730 0x559b9c096b90 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f64f002b040 tx=0x7f64f0004730 comp rx=0 tx=0).stop 2024-04-04T06:57:57.669 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.667+0000 7f65061fd740 1 -- 172.21.15.72:0/13081482 shutdown_connections 2024-04-04T06:57:57.669 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.667+0000 7f65061fd740 1 --2- 172.21.15.72:0/13081482 >> [v2:172.21.15.72:6835/2509618069,v1:172.21.15.72:6837/2509618069] conn(0x559b9c0981e0 0x559b9c09aae0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:57.669 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.667+0000 7f65061fd740 1 --2- 172.21.15.72:0/13081482 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x559b9c0796e0 0x559b9c09a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:57.669 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.667+0000 7f65061fd740 1 --2- 172.21.15.72:0/13081482 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559b9c079300 0x559b9c119320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:57.669 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.667+0000 7f65061fd740 1 --2- 172.21.15.72:0/13081482 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x559b9c06a730 0x559b9c096b90 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:57.669 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.667+0000 7f64e2000640 0 client.5433 ms_handle_reset on v2:172.21.15.72:6835/2509618069 2024-04-04T06:57:57.669 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.667+0000 7f65061fd740 1 -- 172.21.15.72:0/13081482 >> 172.21.15.72:0/13081482 conn(0x559b9c04c7e0 msgr2=0x559b9c07c950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:57.669 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.667+0000 7f65061fd740 1 -- 172.21.15.72:0/13081482 shutdown_connections 2024-04-04T06:57:57.669 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.667+0000 7f65061fd740 1 -- 172.21.15.72:0/13081482 wait complete. 2024-04-04T06:57:57.669 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.667+0000 7f65061fd740 20 client.5433 trim_cache size 0 max 16384 2024-04-04T06:57:57.671 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-04T06:57:57.671 INFO:teuthology.orchestra.run.smithi072.stdout: "cluster_fsid": "6708bac2-4f50-49b5-87a9-c390fd333eb3", 2024-04-04T06:57:57.671 INFO:teuthology.orchestra.run.smithi072.stdout: "whoami": 0, 2024-04-04T06:57:57.671 INFO:teuthology.orchestra.run.smithi072.stdout: "id": 5256, 2024-04-04T06:57:57.671 INFO:teuthology.orchestra.run.smithi072.stdout: "want_state": "up:active", 2024-04-04T06:57:57.671 INFO:teuthology.orchestra.run.smithi072.stdout: "state": "up:active", 2024-04-04T06:57:57.671 INFO:teuthology.orchestra.run.smithi072.stdout: "fs_name": "cephfs", 2024-04-04T06:57:57.671 INFO:teuthology.orchestra.run.smithi072.stdout: "rank_uptime": 7.11298165, 2024-04-04T06:57:57.671 INFO:teuthology.orchestra.run.smithi072.stdout: "mdsmap_epoch": 17, 2024-04-04T06:57:57.671 INFO:teuthology.orchestra.run.smithi072.stdout: "osdmap_epoch": 33, 2024-04-04T06:57:57.671 INFO:teuthology.orchestra.run.smithi072.stdout: "osdmap_epoch_barrier": 33, 2024-04-04T06:57:57.671 INFO:teuthology.orchestra.run.smithi072.stdout: "uptime": 15.952504618000001 2024-04-04T06:57:57.672 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-04T06:57:57.672 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.668+0000 7f6502200640 1 -- 172.21.15.72:0/2674878718 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f64dc06c8f0 msgr2=0x7f64dc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:57.672 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.668+0000 7f6502200640 1 --2- 172.21.15.72:0/2674878718 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f64dc06c8f0 0x7f64dc06edb0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f64f0006fd0 tx=0x7f64f0008040 comp rx=0 tx=0).stop 2024-04-04T06:57:57.672 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.668+0000 7f6502200640 1 -- 172.21.15.72:0/2674878718 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f64fc15f530 msgr2=0x7f64fc070440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:57.672 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.668+0000 7f6502200640 1 --2- 172.21.15.72:0/2674878718 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f64fc15f530 0x7f64fc070440 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f64e800c820 tx=0x7f64e800cc20 comp rx=0 tx=0).stop 2024-04-04T06:57:57.673 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.668+0000 7f6502200640 1 -- 172.21.15.72:0/2674878718 shutdown_connections 2024-04-04T06:57:57.673 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.668+0000 7f6502200640 1 --2- 172.21.15.72:0/2674878718 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f64dc06c8f0 0x7f64dc06edb0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:57.673 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.668+0000 7f6502200640 1 --2- 172.21.15.72:0/2674878718 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f64fc161e70 0x7f64fc1f7760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:57.673 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.668+0000 7f6502200640 1 --2- 172.21.15.72:0/2674878718 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f64fc15f530 0x7f64fc070440 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:57.673 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.668+0000 7f6502200640 1 --2- 172.21.15.72:0/2674878718 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f64fc15be80 0x7f64fc0cffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:57.673 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.668+0000 7f6502200640 1 -- 172.21.15.72:0/2674878718 >> 172.21.15.72:0/2674878718 conn(0x7f64fc072280 msgr2=0x7f64fc1565b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:57.673 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.668+0000 7f6502200640 1 -- 172.21.15.72:0/2674878718 shutdown_connections 2024-04-04T06:57:57.673 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.668+0000 7f6502200640 1 -- 172.21.15.72:0/2674878718 wait complete. 2024-04-04T06:57:57.683 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-04T06:57:57.881 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.882+0000 7f2eb9000640 1 Processor -- start 2024-04-04T06:57:57.882 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.883+0000 7f2eb9000640 1 -- start start 2024-04-04T06:57:57.883 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.884+0000 7f2eb9000640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f2eb40cd1e0 0x7f2eb4071610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:57.883 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.884+0000 7f2eb9000640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2eb40b3f50 con 0x7f2eb4073570 2024-04-04T06:57:57.883 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.884+0000 7f2eb9000640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2eb40b4230 con 0x7f2eb406eee0 2024-04-04T06:57:57.883 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.884+0000 7f2eb9000640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f2eb4073950 con 0x7f2eb40cd1e0 2024-04-04T06:57:57.883 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.884+0000 7f2eb1e00640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f2eb4073570 0x7f2eb40b3700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:37834/0 (socket says 172.21.15.72:37834) 2024-04-04T06:57:57.883 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.884+0000 7f2eb1e00640 1 -- 172.21.15.72:0/811313848 learned_addr learned my addr 172.21.15.72:0/811313848 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-04-04T06:57:57.883 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.885+0000 7f2eb2800640 1 --2- 172.21.15.72:0/811313848 >> v2:172.21.15.117:3300/0 conn(0x7f2eb40cd1e0 0x7f2eb4071610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:57.884 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.885+0000 7f2eb1400640 1 -- 172.21.15.72:0/811313848 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 295947790 0 0) 0x7f2eb40b3f50 con 0x7f2eb4073570 2024-04-04T06:57:57.884 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.885+0000 7f2eb1400640 1 -- 172.21.15.72:0/811313848 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2e98003520 con 0x7f2eb4073570 2024-04-04T06:57:57.884 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.885+0000 7f2eb2800640 1 -- 172.21.15.72:0/811313848 >> v1:172.21.15.117:6789/0 conn(0x7f2eb406eee0 legacy=0x7f2eb40ccad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:57.884 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.885+0000 7f2eb2800640 1 -- 172.21.15.72:0/811313848 >> v1:172.21.15.72:6789/0 conn(0x7f2eb4073570 legacy=0x7f2eb40b3700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:57.885 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.885+0000 7f2eb2800640 1 -- 172.21.15.72:0/811313848 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2eb40b4510 con 0x7f2eb40cd1e0 2024-04-04T06:57:57.885 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.887+0000 7f2eb2800640 1 --2- 172.21.15.72:0/811313848 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2eb40cd1e0 0x7f2eb4071610 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f2eac009d90 tx=0x7f2eac02bfd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=17b88160c58a6306 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:57.886 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.887+0000 7f2eb1400640 1 -- 172.21.15.72:0/811313848 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2eac039070 con 0x7f2eb40cd1e0 2024-04-04T06:57:57.886 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.887+0000 7f2eb1400640 1 -- 172.21.15.72:0/811313848 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2eac02cd80 con 0x7f2eb40cd1e0 2024-04-04T06:57:57.886 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.887+0000 7f2eb1400640 1 -- 172.21.15.72:0/811313848 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2eac034660 con 0x7f2eb40cd1e0 2024-04-04T06:57:57.887 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.888+0000 7f2eb9000640 1 -- 172.21.15.72:0/811313848 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2eb40cd1e0 msgr2=0x7f2eb4071610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:57.887 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.888+0000 7f2eb9000640 1 --2- 172.21.15.72:0/811313848 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2eb40cd1e0 0x7f2eb4071610 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f2eac009d90 tx=0x7f2eac02bfd0 comp rx=0 tx=0).stop 2024-04-04T06:57:57.887 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.888+0000 7f2eb9000640 1 -- 172.21.15.72:0/811313848 shutdown_connections 2024-04-04T06:57:57.887 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.888+0000 7f2eb9000640 1 --2- 172.21.15.72:0/811313848 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2eb40cd1e0 0x7f2eb4071610 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:57.887 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.888+0000 7f2eb9000640 1 -- 172.21.15.72:0/811313848 >> 172.21.15.72:0/811313848 conn(0x7f2eb406b470 msgr2=0x7f2eb406b880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:57.887 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.888+0000 7f2eb9000640 1 -- 172.21.15.72:0/811313848 shutdown_connections 2024-04-04T06:57:57.887 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.888+0000 7f2eb9000640 1 -- 172.21.15.72:0/811313848 wait complete. 2024-04-04T06:57:57.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.890+0000 7f2eb9000640 1 Processor -- start 2024-04-04T06:57:57.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.890+0000 7f2eb9000640 1 -- start start 2024-04-04T06:57:57.891 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.892+0000 7f2eb9000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2eb406eee0 0x7f2eb40ccab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:57.891 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.892+0000 7f2eb9000640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2eb4073570 0x7f2eb40c61f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:57.891 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.892+0000 7f2eb9000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2eb40cd1e0 0x7f2eb41f7020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:57.892 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.892+0000 7f2eb9000640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f2eb40cb9b0 con 0x7f2eb4073570 2024-04-04T06:57:57.892 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.892+0000 7f2eb9000640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f2eb40cb520 con 0x7f2eb406eee0 2024-04-04T06:57:57.892 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.892+0000 7f2eb9000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f2eb40cbb30 con 0x7f2eb40cd1e0 2024-04-04T06:57:57.892 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.892+0000 7f2eabe00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2eb4073570 0x7f2eb40c61f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:57.892 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.892+0000 7f2eabe00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2eb4073570 0x7f2eb40c61f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:38978/0 (socket says 172.21.15.72:38978) 2024-04-04T06:57:57.892 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.892+0000 7f2eabe00640 1 -- 172.21.15.72:0/2178526071 learned_addr learned my addr 172.21.15.72:0/2178526071 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:57:57.892 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.892+0000 7f2eb1e00640 1 --2- 172.21.15.72:0/2178526071 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2eb406eee0 0x7f2eb40ccab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:57.892 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.892+0000 7f2eb2800640 1 --2- 172.21.15.72:0/2178526071 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2eb40cd1e0 0x7f2eb41f7020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:57.892 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.893+0000 7f2eabe00640 1 -- 172.21.15.72:0/2178526071 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2eb40cd1e0 msgr2=0x7f2eb41f7020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:57.892 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.893+0000 7f2eabe00640 1 --2- 172.21.15.72:0/2178526071 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2eb40cd1e0 0x7f2eb41f7020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:57.892 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.893+0000 7f2eabe00640 1 -- 172.21.15.72:0/2178526071 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2eb406eee0 msgr2=0x7f2eb40ccab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:57.892 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.893+0000 7f2eabe00640 1 --2- 172.21.15.72:0/2178526071 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2eb406eee0 0x7f2eb40ccab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:57.892 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.893+0000 7f2eabe00640 1 -- 172.21.15.72:0/2178526071 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2eb40af250 con 0x7f2eb4073570 2024-04-04T06:57:57.892 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.893+0000 7f2eabe00640 1 --2- 172.21.15.72:0/2178526071 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2eb4073570 0x7f2eb40c61f0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f2e9c00c450 tx=0x7f2e9c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:57.893 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.893+0000 7f2eaa000640 1 -- 172.21.15.72:0/2178526071 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e9c0052d0 con 0x7f2eb4073570 2024-04-04T06:57:57.893 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.893+0000 7f2eaa000640 1 -- 172.21.15.72:0/2178526071 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e9c005470 con 0x7f2eb4073570 2024-04-04T06:57:57.893 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.893+0000 7f2eb9000640 1 -- 172.21.15.72:0/2178526071 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2eb40c5750 con 0x7f2eb4073570 2024-04-04T06:57:57.893 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.893+0000 7f2eaa000640 1 -- 172.21.15.72:0/2178526071 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e9c012870 con 0x7f2eb4073570 2024-04-04T06:57:57.894 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.893+0000 7f2eb9000640 1 -- 172.21.15.72:0/2178526071 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2eb40c59f0 con 0x7f2eb4073570 2024-04-04T06:57:57.894 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.894+0000 7f2eb9000640 1 -- 172.21.15.72:0/2178526071 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2eb4075840 con 0x7f2eb4073570 2024-04-04T06:57:57.894 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.896+0000 7f2eaa000640 1 -- 172.21.15.72:0/2178526071 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2e9c012a10 con 0x7f2eb4073570 2024-04-04T06:57:57.896 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.897+0000 7f2eaa000640 1 --2- 172.21.15.72:0/2178526071 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f2e9006c8f0 0x7f2e9006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:57:57.896 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.897+0000 7f2eaa000640 1 -- 172.21.15.72:0/2178526071 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f2e9c08b690 con 0x7f2eb4073570 2024-04-04T06:57:57.896 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.898+0000 7f2eb1e00640 1 --2- 172.21.15.72:0/2178526071 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f2e9006c8f0 0x7f2e9006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:57:57.897 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.898+0000 7f2eb1e00640 1 --2- 172.21.15.72:0/2178526071 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f2e9006c8f0 0x7f2e9006edb0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f2ea40011e0 tx=0x7f2ea4007d30 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:57:57.900 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:57.901+0000 7f2eaa000640 1 -- 172.21.15.72:0/2178526071 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f2e9c059ad0 con 0x7f2eb4073570 2024-04-04T06:57:58.138 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:58.139+0000 7f2eb9000640 1 -- 172.21.15.72:0/2178526071 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f2eb40b17b0 con 0x7f2eb4073570 2024-04-04T06:57:58.139 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:58.140+0000 7f2eaa000640 1 -- 172.21.15.72:0/2178526071 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) ==== 53+0+73 (secure 0 0 0) 0x7f2e9c0593d0 con 0x7f2eb4073570 2024-04-04T06:57:58.139 INFO:teuthology.orchestra.run.smithi072.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-04T06:57:58.142 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:58.143+0000 7f2eb9000640 1 -- 172.21.15.72:0/2178526071 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f2e9006c8f0 msgr2=0x7f2e9006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:58.143 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:58.143+0000 7f2eb9000640 1 --2- 172.21.15.72:0/2178526071 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f2e9006c8f0 0x7f2e9006edb0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f2ea40011e0 tx=0x7f2ea4007d30 comp rx=0 tx=0).stop 2024-04-04T06:57:58.143 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:58.143+0000 7f2eb9000640 1 -- 172.21.15.72:0/2178526071 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2eb4073570 msgr2=0x7f2eb40c61f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:57:58.143 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:58.143+0000 7f2eb9000640 1 --2- 172.21.15.72:0/2178526071 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2eb4073570 0x7f2eb40c61f0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f2e9c00c450 tx=0x7f2e9c00c910 comp rx=0 tx=0).stop 2024-04-04T06:57:58.143 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:58.143+0000 7f2eb9000640 1 -- 172.21.15.72:0/2178526071 shutdown_connections 2024-04-04T06:57:58.143 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:58.143+0000 7f2eb9000640 1 --2- 172.21.15.72:0/2178526071 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f2e9006c8f0 0x7f2e9006edb0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:58.143 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:58.143+0000 7f2eb9000640 1 --2- 172.21.15.72:0/2178526071 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2eb40cd1e0 0x7f2eb41f7020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:58.143 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:58.143+0000 7f2eb9000640 1 --2- 172.21.15.72:0/2178526071 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2eb4073570 0x7f2eb40c61f0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:58.143 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:58.143+0000 7f2eb9000640 1 --2- 172.21.15.72:0/2178526071 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2eb406eee0 0x7f2eb40ccab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:57:58.143 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:58.143+0000 7f2eb9000640 1 -- 172.21.15.72:0/2178526071 >> 172.21.15.72:0/2178526071 conn(0x7f2eb406b470 msgr2=0x7f2eb40b0620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:57:58.143 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:58.144+0000 7f2eb9000640 1 -- 172.21.15.72:0/2178526071 shutdown_connections 2024-04-04T06:57:58.143 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:58.144+0000 7f2eb9000640 1 -- 172.21.15.72:0/2178526071 wait complete. 2024-04-04T06:57:58.161 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-04T06:57:58.161 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-04T06:57:58.161 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi072.front.sepia.ceph.com 2024-04-04T06:57:58.161 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-04T06:57:58.161 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-04T06:57:58.161 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-04T06:57:58.162 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-04T06:57:58.162 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-04T06:57:58.162 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-04T06:57:58.162 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-04T06:57:58.162 DEBUG:teuthology.orchestra.run.smithi072:> ip addr 2024-04-04T06:57:58.211 INFO:teuthology.orchestra.run.smithi072.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-04T06:57:58.211 INFO:teuthology.orchestra.run.smithi072.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-04T06:57:58.211 INFO:teuthology.orchestra.run.smithi072.stdout: inet 127.0.0.1/8 scope host lo 2024-04-04T06:57:58.211 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2024-04-04T06:57:58.212 INFO:teuthology.orchestra.run.smithi072.stdout: inet6 ::1/128 scope host 2024-04-04T06:57:58.212 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2024-04-04T06:57:58.212 INFO:teuthology.orchestra.run.smithi072.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-04T06:57:58.212 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0c:c4:7a:d8:da:f4 brd ff:ff:ff:ff:ff:ff 2024-04-04T06:57:58.212 INFO:teuthology.orchestra.run.smithi072.stdout: altname enp7s0f0 2024-04-04T06:57:58.212 INFO:teuthology.orchestra.run.smithi072.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-04T06:57:58.212 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0c:c4:7a:d8:da:f5 brd ff:ff:ff:ff:ff:ff 2024-04-04T06:57:58.213 INFO:teuthology.orchestra.run.smithi072.stdout: altname enp7s0f1 2024-04-04T06:57:58.213 INFO:teuthology.orchestra.run.smithi072.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-04T06:57:58.213 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0c:c4:7a:8f:b7:64 brd ff:ff:ff:ff:ff:ff 2024-04-04T06:57:58.213 INFO:teuthology.orchestra.run.smithi072.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-04T06:57:58.213 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0c:c4:7a:8f:b7:65 brd ff:ff:ff:ff:ff:ff 2024-04-04T06:57:58.214 INFO:teuthology.orchestra.run.smithi072.stdout: inet 172.21.15.72/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-04-04T06:57:58.214 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft 42469sec preferred_lft 42469sec 2024-04-04T06:57:58.214 INFO:teuthology.orchestra.run.smithi072.stdout: inet6 fe80::ec4:7aff:fe8f:b765/64 scope link 2024-04-04T06:57:58.214 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2024-04-04T06:57:58.214 INFO:teuthology.orchestra.run.smithi072.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-04T06:57:58.214 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 26:b3:cf:c4:3e:e9 brd ff:ff:ff:ff:ff:ff 2024-04-04T06:57:58.214 INFO:teuthology.orchestra.run.smithi072.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-04T06:57:58.214 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2024-04-04T06:57:58.214 INFO:teuthology.orchestra.run.smithi072.stdout: inet6 fe80::10cc:28ff:fe50:2df/64 scope link 2024-04-04T06:57:58.215 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2024-04-04T06:57:58.215 INFO:teuthology.orchestra.run.smithi072.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-04T06:57:58.215 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 26:b3:cf:c4:3e:e9 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-04T06:57:58.215 INFO:teuthology.orchestra.run.smithi072.stdout: inet6 fe80::24b3:cfff:fec4:3ee9/64 scope link 2024-04-04T06:57:58.215 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2024-04-04T06:57:58.215 INFO:teuthology.orchestra.run.smithi072.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-04T06:57:58.215 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 4a:84:fd:5b:26:4a brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-04T06:57:58.216 INFO:teuthology.orchestra.run.smithi072.stdout: inet6 fe80::4884:fdff:fe5b:264a/64 scope link 2024-04-04T06:57:58.216 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2024-04-04T06:57:58.216 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-04T06:57:58.216 DEBUG:teuthology.orchestra.run.smithi072:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-04T06:57:58.291 INFO:teuthology.orchestra.run.smithi072.stdout:1 2024-04-04T06:57:58.295 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-04T06:57:58.295 DEBUG:teuthology.orchestra.run.smithi072:> route 2024-04-04T06:57:58.339 INFO:teuthology.orchestra.run.smithi072.stdout:Kernel IP routing table 2024-04-04T06:57:58.339 INFO:teuthology.orchestra.run.smithi072.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-04T06:57:58.340 INFO:teuthology.orchestra.run.smithi072.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-04T06:57:58.340 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-04T06:57:58.340 INFO:teuthology.orchestra.run.smithi072.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-04T06:57:58.340 DEBUG:teuthology.orchestra.run.smithi072:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-04T06:57:58.340 DEBUG:teuthology.orchestra.run.smithi072:> set -e 2024-04-04T06:57:58.340 DEBUG:teuthology.orchestra.run.smithi072:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-04T06:57:58.340 DEBUG:teuthology.orchestra.run.smithi072:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-04T06:57:58.340 DEBUG:teuthology.orchestra.run.smithi072:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-04T06:57:58.340 DEBUG:teuthology.orchestra.run.smithi072:> ') 2024-04-04T06:57:58.477 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:58 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-04T06:57:58.616 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:57:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-04T06:57:58.625 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-04T06:57:58.625 DEBUG:teuthology.orchestra.run.smithi072:> ip netns list 2024-04-04T06:57:58.672 INFO:teuthology.orchestra.run.smithi072.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-04T06:57:58.673 INFO:teuthology.orchestra.run.smithi072.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-04T06:57:58.674 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-04T06:57:58.674 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-04T06:57:58.674 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip link set brx.0 up 2024-04-04T06:57:58.770 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-04-04T06:57:58.771 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-04T06:57:58.771 DEBUG:teuthology.orchestra.run.smithi072:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-04T06:57:58.822 INFO:teuthology.orchestra.run.smithi072.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-04T06:57:58.822 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-04T06:57:58.822 DEBUG:teuthology.orchestra.run.smithi072:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-04T06:57:58.869 DEBUG:teuthology.orchestra.run.smithi072:> sudo modprobe fuse 2024-04-04T06:57:58.954 DEBUG:teuthology.orchestra.run.smithi072:> cat /proc/self/mounts | awk '{print $2}' 2024-04-04T06:57:59.004 INFO:teuthology.orchestra.run.smithi072.stdout:/proc 2024-04-04T06:57:59.004 INFO:teuthology.orchestra.run.smithi072.stdout:/sys 2024-04-04T06:57:59.004 INFO:teuthology.orchestra.run.smithi072.stdout:/dev 2024-04-04T06:57:59.005 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/kernel/security 2024-04-04T06:57:59.005 INFO:teuthology.orchestra.run.smithi072.stdout:/dev/shm 2024-04-04T06:57:59.005 INFO:teuthology.orchestra.run.smithi072.stdout:/dev/pts 2024-04-04T06:57:59.005 INFO:teuthology.orchestra.run.smithi072.stdout:/run 2024-04-04T06:57:59.005 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/fs/cgroup 2024-04-04T06:57:59.005 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/fs/pstore 2024-04-04T06:57:59.005 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/fs/bpf 2024-04-04T06:57:59.005 INFO:teuthology.orchestra.run.smithi072.stdout:/ 2024-04-04T06:57:59.005 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/fs/selinux 2024-04-04T06:57:59.005 INFO:teuthology.orchestra.run.smithi072.stdout:/proc/sys/fs/binfmt_misc 2024-04-04T06:57:59.005 INFO:teuthology.orchestra.run.smithi072.stdout:/dev/mqueue 2024-04-04T06:57:59.005 INFO:teuthology.orchestra.run.smithi072.stdout:/dev/hugepages 2024-04-04T06:57:59.005 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/kernel/debug 2024-04-04T06:57:59.005 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/kernel/tracing 2024-04-04T06:57:59.005 INFO:teuthology.orchestra.run.smithi072.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-04T06:57:59.006 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/fs/fuse/connections 2024-04-04T06:57:59.006 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/kernel/config 2024-04-04T06:57:59.006 INFO:teuthology.orchestra.run.smithi072.stdout:/run/credentials/systemd-sysctl.service 2024-04-04T06:57:59.006 INFO:teuthology.orchestra.run.smithi072.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-04T06:57:59.006 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/nfs/rpc_pipefs 2024-04-04T06:57:59.006 INFO:teuthology.orchestra.run.smithi072.stdout:/run/user/1000 2024-04-04T06:57:59.006 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/ceph 2024-04-04T06:57:59.006 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/ceph/osd/ceph-0 2024-04-04T06:57:59.006 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/ceph/osd/ceph-1 2024-04-04T06:57:59.006 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/ceph/osd/ceph-2 2024-04-04T06:57:59.006 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/ceph/osd/ceph-3 2024-04-04T06:57:59.006 INFO:teuthology.orchestra.run.smithi072.stdout:/run/netns 2024-04-04T06:57:59.006 INFO:teuthology.orchestra.run.smithi072.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-04T06:57:59.006 INFO:teuthology.orchestra.run.smithi072.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-04T06:57:59.007 INFO:teuthology.orchestra.run.smithi072.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-04T06:57:59.007 INFO:teuthology.orchestra.run.smithi072.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-04T06:57:59.008 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-04T06:57:59.008 DEBUG:teuthology.orchestra.run.smithi072:> ls /sys/fs/fuse/connections 2024-04-04T06:57:59.053 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-04-04T06:57:59.054 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-04-04T06:57:59.101 DEBUG:teuthology.orchestra.run.smithi072:> sudo modprobe fuse 2024-04-04T06:57:59.180 DEBUG:teuthology.orchestra.run.smithi072:> cat /proc/self/mounts | awk '{print $2}' 2024-04-04T06:57:59.221 INFO:teuthology.orchestra.run.smithi072.stdout:/proc 2024-04-04T06:57:59.221 INFO:teuthology.orchestra.run.smithi072.stdout:/sys 2024-04-04T06:57:59.221 INFO:teuthology.orchestra.run.smithi072.stdout:/dev 2024-04-04T06:57:59.221 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/kernel/security 2024-04-04T06:57:59.221 INFO:teuthology.orchestra.run.smithi072.stdout:/dev/shm 2024-04-04T06:57:59.221 INFO:teuthology.orchestra.run.smithi072.stdout:/dev/pts 2024-04-04T06:57:59.221 INFO:teuthology.orchestra.run.smithi072.stdout:/run 2024-04-04T06:57:59.221 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/fs/cgroup 2024-04-04T06:57:59.221 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/fs/pstore 2024-04-04T06:57:59.221 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/fs/bpf 2024-04-04T06:57:59.221 INFO:teuthology.orchestra.run.smithi072.stdout:/ 2024-04-04T06:57:59.222 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/fs/selinux 2024-04-04T06:57:59.222 INFO:teuthology.orchestra.run.smithi072.stdout:/proc/sys/fs/binfmt_misc 2024-04-04T06:57:59.222 INFO:teuthology.orchestra.run.smithi072.stdout:/dev/mqueue 2024-04-04T06:57:59.222 INFO:teuthology.orchestra.run.smithi072.stdout:/dev/hugepages 2024-04-04T06:57:59.222 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/kernel/debug 2024-04-04T06:57:59.222 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/kernel/tracing 2024-04-04T06:57:59.222 INFO:teuthology.orchestra.run.smithi072.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-04T06:57:59.222 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/fs/fuse/connections 2024-04-04T06:57:59.222 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/kernel/config 2024-04-04T06:57:59.222 INFO:teuthology.orchestra.run.smithi072.stdout:/run/credentials/systemd-sysctl.service 2024-04-04T06:57:59.222 INFO:teuthology.orchestra.run.smithi072.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-04T06:57:59.222 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/nfs/rpc_pipefs 2024-04-04T06:57:59.222 INFO:teuthology.orchestra.run.smithi072.stdout:/run/user/1000 2024-04-04T06:57:59.222 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/ceph 2024-04-04T06:57:59.223 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/ceph/osd/ceph-0 2024-04-04T06:57:59.223 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/ceph/osd/ceph-1 2024-04-04T06:57:59.223 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/ceph/osd/ceph-2 2024-04-04T06:57:59.223 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/ceph/osd/ceph-3 2024-04-04T06:57:59.223 INFO:teuthology.orchestra.run.smithi072.stdout:/run/netns 2024-04-04T06:57:59.223 INFO:teuthology.orchestra.run.smithi072.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-04T06:57:59.223 INFO:teuthology.orchestra.run.smithi072.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-04T06:57:59.223 INFO:teuthology.orchestra.run.smithi072.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-04T06:57:59.223 INFO:teuthology.orchestra.run.smithi072.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-04T06:57:59.224 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-04T06:57:59.224 DEBUG:teuthology.orchestra.run.smithi072:> ls /sys/fs/fuse/connections 2024-04-04T06:57:59.299 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi072.stderr:2024-04-04T06:57:59.301+0000 7ff258637480 -1 init, newargv = 0x563f95e3a660 newargc=15 2024-04-04T06:57:59.300 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi072.stderr:ceph-fuse[50926]: starting ceph client 2024-04-04T06:57:59.307 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi072.stderr:ceph-fuse[50926]: starting fuse 2024-04-04T06:58:00.405 DEBUG:teuthology.orchestra.run.smithi072:> sudo modprobe fuse 2024-04-04T06:58:00.500 DEBUG:teuthology.orchestra.run.smithi072:> cat /proc/self/mounts | awk '{print $2}' 2024-04-04T06:58:00.553 INFO:teuthology.orchestra.run.smithi072.stdout:/proc 2024-04-04T06:58:00.553 INFO:teuthology.orchestra.run.smithi072.stdout:/sys 2024-04-04T06:58:00.553 INFO:teuthology.orchestra.run.smithi072.stdout:/dev 2024-04-04T06:58:00.553 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/kernel/security 2024-04-04T06:58:00.553 INFO:teuthology.orchestra.run.smithi072.stdout:/dev/shm 2024-04-04T06:58:00.553 INFO:teuthology.orchestra.run.smithi072.stdout:/dev/pts 2024-04-04T06:58:00.553 INFO:teuthology.orchestra.run.smithi072.stdout:/run 2024-04-04T06:58:00.553 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/fs/cgroup 2024-04-04T06:58:00.553 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/fs/pstore 2024-04-04T06:58:00.553 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/fs/bpf 2024-04-04T06:58:00.554 INFO:teuthology.orchestra.run.smithi072.stdout:/ 2024-04-04T06:58:00.554 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/fs/selinux 2024-04-04T06:58:00.554 INFO:teuthology.orchestra.run.smithi072.stdout:/proc/sys/fs/binfmt_misc 2024-04-04T06:58:00.554 INFO:teuthology.orchestra.run.smithi072.stdout:/dev/mqueue 2024-04-04T06:58:00.554 INFO:teuthology.orchestra.run.smithi072.stdout:/dev/hugepages 2024-04-04T06:58:00.554 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/kernel/debug 2024-04-04T06:58:00.554 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/kernel/tracing 2024-04-04T06:58:00.555 INFO:teuthology.orchestra.run.smithi072.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-04T06:58:00.555 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/fs/fuse/connections 2024-04-04T06:58:00.555 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/kernel/config 2024-04-04T06:58:00.555 INFO:teuthology.orchestra.run.smithi072.stdout:/run/credentials/systemd-sysctl.service 2024-04-04T06:58:00.555 INFO:teuthology.orchestra.run.smithi072.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-04T06:58:00.555 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/nfs/rpc_pipefs 2024-04-04T06:58:00.555 INFO:teuthology.orchestra.run.smithi072.stdout:/run/user/1000 2024-04-04T06:58:00.555 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/ceph 2024-04-04T06:58:00.555 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/ceph/osd/ceph-0 2024-04-04T06:58:00.555 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/ceph/osd/ceph-1 2024-04-04T06:58:00.555 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/ceph/osd/ceph-2 2024-04-04T06:58:00.555 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/ceph/osd/ceph-3 2024-04-04T06:58:00.555 INFO:teuthology.orchestra.run.smithi072.stdout:/run/netns 2024-04-04T06:58:00.555 INFO:teuthology.orchestra.run.smithi072.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-04T06:58:00.556 INFO:teuthology.orchestra.run.smithi072.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-04T06:58:00.556 INFO:teuthology.orchestra.run.smithi072.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-04T06:58:00.556 INFO:teuthology.orchestra.run.smithi072.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-04T06:58:00.556 INFO:teuthology.orchestra.run.smithi072.stdout:/home/ubuntu/cephtest/mnt.0 2024-04-04T06:58:00.557 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-04T06:58:00.557 DEBUG:teuthology.orchestra.run.smithi072:> ls /sys/fs/fuse/connections 2024-04-04T06:58:00.607 INFO:teuthology.orchestra.run.smithi072.stdout:42 2024-04-04T06:58:00.607 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [42] 2024-04-04T06:58:00.607 DEBUG:teuthology.orchestra.run.smithi072:> sudo stdin-killer -- python3 -c ' 2024-04-04T06:58:00.607 DEBUG:teuthology.orchestra.run.smithi072:> import glob 2024-04-04T06:58:00.607 DEBUG:teuthology.orchestra.run.smithi072:> import re 2024-04-04T06:58:00.608 DEBUG:teuthology.orchestra.run.smithi072:> import os 2024-04-04T06:58:00.608 DEBUG:teuthology.orchestra.run.smithi072:> import subprocess 2024-04-04T06:58:00.608 DEBUG:teuthology.orchestra.run.smithi072:> 2024-04-04T06:58:00.608 DEBUG:teuthology.orchestra.run.smithi072:> def _find_admin_socket(client_name): 2024-04-04T06:58:00.608 DEBUG:teuthology.orchestra.run.smithi072:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-04-04T06:58:00.608 DEBUG:teuthology.orchestra.run.smithi072:> files = glob.glob(asok_path) 2024-04-04T06:58:00.608 DEBUG:teuthology.orchestra.run.smithi072:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-04-04T06:58:00.608 DEBUG:teuthology.orchestra.run.smithi072:> 2024-04-04T06:58:00.608 DEBUG:teuthology.orchestra.run.smithi072:> # Given a non-glob path, it better be there 2024-04-04T06:58:00.608 DEBUG:teuthology.orchestra.run.smithi072:> if "*" not in asok_path: 2024-04-04T06:58:00.608 DEBUG:teuthology.orchestra.run.smithi072:> assert(len(files) == 1) 2024-04-04T06:58:00.608 DEBUG:teuthology.orchestra.run.smithi072:> return files[0] 2024-04-04T06:58:00.608 DEBUG:teuthology.orchestra.run.smithi072:> 2024-04-04T06:58:00.608 DEBUG:teuthology.orchestra.run.smithi072:> for f in files: 2024-04-04T06:58:00.608 DEBUG:teuthology.orchestra.run.smithi072:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-04T06:58:00.608 DEBUG:teuthology.orchestra.run.smithi072:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-04T06:58:00.609 DEBUG:teuthology.orchestra.run.smithi072:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-04T06:58:00.609 DEBUG:teuthology.orchestra.run.smithi072:> contents = proc_f.read() 2024-04-04T06:58:00.609 DEBUG:teuthology.orchestra.run.smithi072:> if mountpoint in contents: 2024-04-04T06:58:00.609 DEBUG:teuthology.orchestra.run.smithi072:> return f 2024-04-04T06:58:00.609 DEBUG:teuthology.orchestra.run.smithi072:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-04T06:58:00.609 DEBUG:teuthology.orchestra.run.smithi072:> 2024-04-04T06:58:00.609 DEBUG:teuthology.orchestra.run.smithi072:> print(_find_admin_socket("client.0")) 2024-04-04T06:58:00.609 DEBUG:teuthology.orchestra.run.smithi072:> ' 2024-04-04T06:58:00.787 INFO:teuthology.orchestra.run.smithi072.stdout:/var/run/ceph/ceph-client.0.50926.asok 2024-04-04T06:58:00.789 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:58:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-04T06:58:00.802 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.50926.asok 2024-04-04T06:58:00.802 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-04T06:58:00.802 DEBUG:teuthology.orchestra.run.smithi072:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.50926.asok status 2024-04-04T06:58:01.028 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-04T06:58:01.029 INFO:teuthology.orchestra.run.smithi072.stdout: "metadata": { 2024-04-04T06:58:01.029 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph_sha1": "addbc488dc763e752c640619b677f10e0da02c9f", 2024-04-04T06:58:01.029 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph_version": "ceph version 19.0.0-2571-gaddbc488 (addbc488dc763e752c640619b677f10e0da02c9f) squid (dev)", 2024-04-04T06:58:01.029 INFO:teuthology.orchestra.run.smithi072.stdout: "entity_id": "0", 2024-04-04T06:58:01.029 INFO:teuthology.orchestra.run.smithi072.stdout: "hostname": "smithi072", 2024-04-04T06:58:01.029 INFO:teuthology.orchestra.run.smithi072.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-04-04T06:58:01.029 INFO:teuthology.orchestra.run.smithi072.stdout: "pid": "50926", 2024-04-04T06:58:01.029 INFO:teuthology.orchestra.run.smithi072.stdout: "root": "/" 2024-04-04T06:58:01.029 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-04T06:58:01.029 INFO:teuthology.orchestra.run.smithi072.stdout: "dentry_count": 0, 2024-04-04T06:58:01.029 INFO:teuthology.orchestra.run.smithi072.stdout: "dentry_pinned_count": 0, 2024-04-04T06:58:01.029 INFO:teuthology.orchestra.run.smithi072.stdout: "id": 5445, 2024-04-04T06:58:01.030 INFO:teuthology.orchestra.run.smithi072.stdout: "inst": { 2024-04-04T06:58:01.030 INFO:teuthology.orchestra.run.smithi072.stdout: "name": { 2024-04-04T06:58:01.030 INFO:teuthology.orchestra.run.smithi072.stdout: "type": "client", 2024-04-04T06:58:01.030 INFO:teuthology.orchestra.run.smithi072.stdout: "num": 5445 2024-04-04T06:58:01.030 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-04T06:58:01.030 INFO:teuthology.orchestra.run.smithi072.stdout: "addr": { 2024-04-04T06:58:01.030 INFO:teuthology.orchestra.run.smithi072.stdout: "type": "v1", 2024-04-04T06:58:01.030 INFO:teuthology.orchestra.run.smithi072.stdout: "addr": "192.168.0.1:0", 2024-04-04T06:58:01.030 INFO:teuthology.orchestra.run.smithi072.stdout: "nonce": 2473977047 2024-04-04T06:58:01.030 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-04T06:58:01.030 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-04T06:58:01.030 INFO:teuthology.orchestra.run.smithi072.stdout: "addr": { 2024-04-04T06:58:01.030 INFO:teuthology.orchestra.run.smithi072.stdout: "type": "v1", 2024-04-04T06:58:01.030 INFO:teuthology.orchestra.run.smithi072.stdout: "addr": "192.168.0.1:0", 2024-04-04T06:58:01.031 INFO:teuthology.orchestra.run.smithi072.stdout: "nonce": 2473977047 2024-04-04T06:58:01.031 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-04T06:58:01.031 INFO:teuthology.orchestra.run.smithi072.stdout: "inst_str": "client.5445 192.168.0.1:0/2473977047", 2024-04-04T06:58:01.031 INFO:teuthology.orchestra.run.smithi072.stdout: "addr_str": "192.168.0.1:0/2473977047", 2024-04-04T06:58:01.031 INFO:teuthology.orchestra.run.smithi072.stdout: "inode_count": 1, 2024-04-04T06:58:01.031 INFO:teuthology.orchestra.run.smithi072.stdout: "mds_epoch": 17, 2024-04-04T06:58:01.031 INFO:teuthology.orchestra.run.smithi072.stdout: "osd_epoch": 33, 2024-04-04T06:58:01.031 INFO:teuthology.orchestra.run.smithi072.stdout: "osd_epoch_barrier": 0, 2024-04-04T06:58:01.031 INFO:teuthology.orchestra.run.smithi072.stdout: "blocklisted": false, 2024-04-04T06:58:01.031 INFO:teuthology.orchestra.run.smithi072.stdout: "fs_name": "cephfs" 2024-04-04T06:58:01.031 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-04T06:58:01.043 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-04T06:58:01.043 DEBUG:teuthology.orchestra.run.smithi072:> stat --file-system '--printf=%T 2024-04-04T06:58:01.043 DEBUG:teuthology.orchestra.run.smithi072:> ' -- /home/ubuntu/cephtest/mnt.0 2024-04-04T06:58:01.097 INFO:teuthology.orchestra.run.smithi072.stdout:fuseblk 2024-04-04T06:58:01.097 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-04-04T06:58:01.097 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-04T06:58:01.097 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-04T06:58:01.189 DEBUG:teuthology.orchestra.run.smithi072:> mktemp -d --suffix=xfstests-dev 2024-04-04T06:58:01.232 INFO:teuthology.orchestra.run.smithi072.stdout:/tmp/tmp.tiFz9P8iUAxfstests-dev 2024-04-04T06:58:01.232 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-04T06:58:01.232 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo chmod a+rx /tmp/tmp.tiFz9P8iUAxfstests-dev) 2024-04-04T06:58:01.368 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-04T06:58:01.368 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec git clone https://git.ceph.com/xfstests-dev.git --depth 1 /tmp/tmp.tiFz9P8iUAxfstests-dev) 2024-04-04T06:58:01.437 INFO:teuthology.orchestra.run.smithi072.stderr:Cloning into '/tmp/tmp.tiFz9P8iUAxfstests-dev'... 2024-04-04T06:58:02.429 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-04T06:58:02.430 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir test) 2024-04-04T06:58:02.490 DEBUG:teuthology.orchestra.run.smithi072:> mktemp -d --suffix=test 2024-04-04T06:58:02.531 INFO:teuthology.orchestra.run.smithi072.stdout:/tmp/tmp.LqGJQhujaOtest 2024-04-04T06:58:02.531 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-04T06:58:02.532 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir scratch) 2024-04-04T06:58:02.629 DEBUG:teuthology.orchestra.run.smithi072:> mktemp -d --suffix=scratch 2024-04-04T06:58:02.673 INFO:teuthology.orchestra.run.smithi072.stdout:/tmp/tmp.xMSjQpfJ28scratch 2024-04-04T06:58:02.673 INFO:tasks.cephfs.xfstests_dev:distro and version detected is "centos" and "9". 2024-04-04T06:58:02.673 DEBUG:teuthology.orchestra.run.smithi072:> sudo yum install -y acl attr automake bc dbench dump e2fsprogs fio gawk gcc gdbm-devel git indent kernel-devel libacl-devel libaio-devel libcap-devel libtool libuuid-devel lvm2 make psmisc python3 quota sed sqlite udftools xfsprogs 2024-04-04T06:58:03.564 INFO:teuthology.orchestra.run.smithi072.stdout:Last metadata expiration check: 0:05:00 ago on Thu 04 Apr 2024 06:53:03 AM UTC. 2024-04-04T06:58:03.672 INFO:teuthology.orchestra.run.smithi072.stdout:Package acl-2.3.1-4.el9.x86_64 is already installed. 2024-04-04T06:58:03.673 INFO:teuthology.orchestra.run.smithi072.stdout:Package attr-2.5.1-3.el9.x86_64 is already installed. 2024-04-04T06:58:03.674 INFO:teuthology.orchestra.run.smithi072.stdout:Package automake-1.16.2-8.el9.noarch is already installed. 2024-04-04T06:58:03.675 INFO:teuthology.orchestra.run.smithi072.stdout:Package bc-1.07.1-14.el9.x86_64 is already installed. 2024-04-04T06:58:03.677 INFO:teuthology.orchestra.run.smithi072.stdout:Package dbench-4.0-25.el9.x86_64 is already installed. 2024-04-04T06:58:03.679 INFO:teuthology.orchestra.run.smithi072.stdout:Package e2fsprogs-1.46.5-3.el9.x86_64 is already installed. 2024-04-04T06:58:03.681 INFO:teuthology.orchestra.run.smithi072.stdout:Package gawk-5.1.0-6.el9.x86_64 is already installed. 2024-04-04T06:58:03.682 INFO:teuthology.orchestra.run.smithi072.stdout:Package gcc-11.4.1-2.1.el9.x86_64 is already installed. 2024-04-04T06:58:03.684 INFO:teuthology.orchestra.run.smithi072.stdout:Package git-2.39.3-1.el9.x86_64 is already installed. 2024-04-04T06:58:03.687 INFO:teuthology.orchestra.run.smithi072.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-04-04T06:58:03.688 INFO:teuthology.orchestra.run.smithi072.stdout:Package libaio-devel-0.3.111-13.el9.x86_64 is already installed. 2024-04-04T06:58:03.690 INFO:teuthology.orchestra.run.smithi072.stdout:Package libtool-2.4.6-45.el9.x86_64 is already installed. 2024-04-04T06:58:03.691 INFO:teuthology.orchestra.run.smithi072.stdout:Package libuuid-devel-2.37.4-18.el9.x86_64 is already installed. 2024-04-04T06:58:03.692 INFO:teuthology.orchestra.run.smithi072.stdout:Package lvm2-9:2.03.21-3.el9.x86_64 is already installed. 2024-04-04T06:58:03.694 INFO:teuthology.orchestra.run.smithi072.stdout:Package make-1:4.3-7.el9.x86_64 is already installed. 2024-04-04T06:58:03.695 INFO:teuthology.orchestra.run.smithi072.stdout:Package psmisc-23.4-3.el9.x86_64 is already installed. 2024-04-04T06:58:03.696 INFO:teuthology.orchestra.run.smithi072.stdout:Package python3-3.9.17-2.el9.x86_64 is already installed. 2024-04-04T06:58:03.697 INFO:teuthology.orchestra.run.smithi072.stdout:Package quota-1:4.06-6.el9.x86_64 is already installed. 2024-04-04T06:58:03.698 INFO:teuthology.orchestra.run.smithi072.stdout:Package sed-4.8-9.el9.x86_64 is already installed. 2024-04-04T06:58:03.701 INFO:teuthology.orchestra.run.smithi072.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-04-04T06:58:03.773 INFO:teuthology.orchestra.run.smithi072.stdout:Dependencies resolved. 2024-04-04T06:58:03.778 INFO:teuthology.orchestra.run.smithi072.stdout:================================================================================ 2024-04-04T06:58:03.779 INFO:teuthology.orchestra.run.smithi072.stdout: Package Arch Version Repository Size 2024-04-04T06:58:03.779 INFO:teuthology.orchestra.run.smithi072.stdout:================================================================================ 2024-04-04T06:58:03.779 INFO:teuthology.orchestra.run.smithi072.stdout:Installing: 2024-04-04T06:58:03.779 INFO:teuthology.orchestra.run.smithi072.stdout: dump x86_64 1:0.4-0.51.b47.el9 epel 88 k 2024-04-04T06:58:03.779 INFO:teuthology.orchestra.run.smithi072.stdout: fio x86_64 3.35-1.el9 CentOS-AppStream 6.2 M 2024-04-04T06:58:03.779 INFO:teuthology.orchestra.run.smithi072.stdout: gdbm-devel x86_64 1:1.19-4.el9 crb 59 k 2024-04-04T06:58:03.780 INFO:teuthology.orchestra.run.smithi072.stdout: indent x86_64 2.2.13-5.el9 epel 179 k 2024-04-04T06:58:03.780 INFO:teuthology.orchestra.run.smithi072.stdout: kernel-devel x86_64 5.14.0-435.el9 CentOS-AppStream 16 M 2024-04-04T06:58:03.780 INFO:teuthology.orchestra.run.smithi072.stdout: libcap-devel x86_64 2.48-9.el9 CentOS-AppStream 33 k 2024-04-04T06:58:03.780 INFO:teuthology.orchestra.run.smithi072.stdout: sqlite x86_64 3.34.1-7.el9 CentOS-AppStream 747 k 2024-04-04T06:58:03.780 INFO:teuthology.orchestra.run.smithi072.stdout: udftools x86_64 2.2-5.el9 CentOS-AppStream 144 k 2024-04-04T06:58:03.781 INFO:teuthology.orchestra.run.smithi072.stdout:Upgrading: 2024-04-04T06:58:03.781 INFO:teuthology.orchestra.run.smithi072.stdout: cpp x86_64 11.4.1-3.el9 appstream 11 M 2024-04-04T06:58:03.781 INFO:teuthology.orchestra.run.smithi072.stdout: device-mapper x86_64 9:1.02.197-2.el9 baseos 141 k 2024-04-04T06:58:03.781 INFO:teuthology.orchestra.run.smithi072.stdout: device-mapper-event x86_64 9:1.02.197-2.el9 baseos 34 k 2024-04-04T06:58:03.781 INFO:teuthology.orchestra.run.smithi072.stdout: device-mapper-event-libs x86_64 9:1.02.197-2.el9 baseos 32 k 2024-04-04T06:58:03.781 INFO:teuthology.orchestra.run.smithi072.stdout: device-mapper-libs x86_64 9:1.02.197-2.el9 baseos 179 k 2024-04-04T06:58:03.781 INFO:teuthology.orchestra.run.smithi072.stdout: e2fsprogs x86_64 1.46.5-5.el9 baseos 1.0 M 2024-04-04T06:58:03.781 INFO:teuthology.orchestra.run.smithi072.stdout: e2fsprogs-libs x86_64 1.46.5-5.el9 baseos 222 k 2024-04-04T06:58:03.782 INFO:teuthology.orchestra.run.smithi072.stdout: gcc x86_64 11.4.1-3.el9 appstream 32 M 2024-04-04T06:58:03.782 INFO:teuthology.orchestra.run.smithi072.stdout: gcc-c++ x86_64 11.4.1-3.el9 appstream 13 M 2024-04-04T06:58:03.782 INFO:teuthology.orchestra.run.smithi072.stdout: gcc-plugin-annobin x86_64 11.4.1-3.el9 appstream 47 k 2024-04-04T06:58:03.782 INFO:teuthology.orchestra.run.smithi072.stdout: git x86_64 2.43.0-1.el9 appstream 51 k 2024-04-04T06:58:03.782 INFO:teuthology.orchestra.run.smithi072.stdout: git-core x86_64 2.43.0-1.el9 appstream 4.4 M 2024-04-04T06:58:03.782 INFO:teuthology.orchestra.run.smithi072.stdout: git-core-doc noarch 2.43.0-1.el9 appstream 2.9 M 2024-04-04T06:58:03.782 INFO:teuthology.orchestra.run.smithi072.stdout: libcom_err x86_64 1.46.5-5.el9 baseos 26 k 2024-04-04T06:58:03.783 INFO:teuthology.orchestra.run.smithi072.stdout: libgcc x86_64 11.4.1-3.el9 baseos 92 k 2024-04-04T06:58:03.783 INFO:teuthology.orchestra.run.smithi072.stdout: libgomp x86_64 11.4.1-3.el9 baseos 268 k 2024-04-04T06:58:03.783 INFO:teuthology.orchestra.run.smithi072.stdout: libss x86_64 1.46.5-5.el9 baseos 32 k 2024-04-04T06:58:03.783 INFO:teuthology.orchestra.run.smithi072.stdout: libstdc++ x86_64 11.4.1-3.el9 baseos 743 k 2024-04-04T06:58:03.783 INFO:teuthology.orchestra.run.smithi072.stdout: libstdc++-devel x86_64 11.4.1-3.el9 appstream 2.4 M 2024-04-04T06:58:03.783 INFO:teuthology.orchestra.run.smithi072.stdout: lvm2 x86_64 9:2.03.23-2.el9 baseos 1.5 M 2024-04-04T06:58:03.783 INFO:teuthology.orchestra.run.smithi072.stdout: lvm2-libs x86_64 9:2.03.23-2.el9 baseos 1.0 M 2024-04-04T06:58:03.784 INFO:teuthology.orchestra.run.smithi072.stdout: make x86_64 1:4.3-8.el9 baseos 536 k 2024-04-04T06:58:03.784 INFO:teuthology.orchestra.run.smithi072.stdout: perl-Git noarch 2.43.0-1.el9 appstream 38 k 2024-04-04T06:58:03.784 INFO:teuthology.orchestra.run.smithi072.stdout: python-unversioned-command noarch 3.9.18-3.el9 CentOS-AppStream 8.3 k 2024-04-04T06:58:03.784 INFO:teuthology.orchestra.run.smithi072.stdout: python3 x86_64 3.9.18-3.el9 CentOS-BaseOS 25 k 2024-04-04T06:58:03.784 INFO:teuthology.orchestra.run.smithi072.stdout: python3-devel x86_64 3.9.18-3.el9 CentOS-AppStream 204 k 2024-04-04T06:58:03.784 INFO:teuthology.orchestra.run.smithi072.stdout: python3-libs x86_64 3.9.18-3.el9 CentOS-BaseOS 7.3 M 2024-04-04T06:58:03.784 INFO:teuthology.orchestra.run.smithi072.stdout: sqlite-libs x86_64 3.34.1-7.el9 CentOS-BaseOS 619 k 2024-04-04T06:58:03.784 INFO:teuthology.orchestra.run.smithi072.stdout:Installing dependencies: 2024-04-04T06:58:03.784 INFO:teuthology.orchestra.run.smithi072.stdout: gdbm x86_64 1:1.19-4.el9 crb 132 k 2024-04-04T06:58:03.784 INFO:teuthology.orchestra.run.smithi072.stdout: libnbd x86_64 1.18.1-3.el9 appstream 166 k 2024-04-04T06:58:03.784 INFO:teuthology.orchestra.run.smithi072.stdout: rmt x86_64 2:1.6-6.el9 CentOS-BaseOS 45 k 2024-04-04T06:58:03.784 INFO:teuthology.orchestra.run.smithi072.stdout:Installing weak dependencies: 2024-04-04T06:58:03.785 INFO:teuthology.orchestra.run.smithi072.stdout: fio-engine-http x86_64 3.35-1.el9 CentOS-AppStream 17 k 2024-04-04T06:58:03.785 INFO:teuthology.orchestra.run.smithi072.stdout: fio-engine-libaio x86_64 3.35-1.el9 CentOS-AppStream 14 k 2024-04-04T06:58:03.785 INFO:teuthology.orchestra.run.smithi072.stdout: fio-engine-nbd x86_64 3.35-1.el9 CentOS-AppStream 13 k 2024-04-04T06:58:03.785 INFO:teuthology.orchestra.run.smithi072.stdout: fio-engine-rados x86_64 3.35-1.el9 CentOS-AppStream 15 k 2024-04-04T06:58:03.785 INFO:teuthology.orchestra.run.smithi072.stdout: fio-engine-rbd x86_64 3.35-1.el9 CentOS-AppStream 15 k 2024-04-04T06:58:03.785 INFO:teuthology.orchestra.run.smithi072.stdout: fio-engine-rdma x86_64 3.35-1.el9 CentOS-AppStream 20 k 2024-04-04T06:58:03.785 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T06:58:03.785 INFO:teuthology.orchestra.run.smithi072.stdout:Transaction Summary 2024-04-04T06:58:03.785 INFO:teuthology.orchestra.run.smithi072.stdout:================================================================================ 2024-04-04T06:58:03.785 INFO:teuthology.orchestra.run.smithi072.stdout:Install 17 Packages 2024-04-04T06:58:03.785 INFO:teuthology.orchestra.run.smithi072.stdout:Upgrade 28 Packages 2024-04-04T06:58:03.785 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T06:58:03.786 INFO:teuthology.orchestra.run.smithi072.stdout:Total download size: 103 M 2024-04-04T06:58:03.786 INFO:teuthology.orchestra.run.smithi072.stdout:Downloading Packages: 2024-04-04T06:58:04.639 INFO:teuthology.orchestra.run.smithi072.stdout:(1/45): fio-engine-http-3.35-1.el9.x86_64.rpm 75 kB/s | 17 kB 00:00 2024-04-04T06:58:04.663 INFO:teuthology.orchestra.run.smithi072.stdout:(2/45): fio-engine-libaio-3.35-1.el9.x86_64.rpm 58 kB/s | 14 kB 00:00 2024-04-04T06:58:04.730 INFO:teuthology.orchestra.run.smithi072.stdout:(3/45): fio-engine-nbd-3.35-1.el9.x86_64.rpm 153 kB/s | 13 kB 00:00 2024-04-04T06:58:04.772 INFO:teuthology.orchestra.run.smithi072.stdout:(4/45): fio-engine-rados-3.35-1.el9.x86_64.rpm 136 kB/s | 15 kB 00:00 2024-04-04T06:58:04.965 INFO:teuthology.orchestra.run.smithi072.stdout:(5/45): fio-3.35-1.el9.x86_64.rpm 11 MB/s | 6.2 MB 00:00 2024-04-04T06:58:04.990 INFO:teuthology.orchestra.run.smithi072.stdout:(6/45): fio-engine-rbd-3.35-1.el9.x86_64.rpm 59 kB/s | 15 kB 00:00 2024-04-04T06:58:05.015 INFO:teuthology.orchestra.run.smithi072.stdout:(7/45): fio-engine-rdma-3.35-1.el9.x86_64.rpm 82 kB/s | 20 kB 00:00 2024-04-04T06:58:05.059 INFO:teuthology.orchestra.run.smithi072.stdout:(8/45): libcap-devel-2.48-9.el9.x86_64.rpm 787 kB/s | 33 kB 00:00 2024-04-04T06:58:05.118 INFO:teuthology.orchestra.run.smithi072.stdout:(9/45): sqlite-3.34.1-7.el9.x86_64.rpm 7.3 MB/s | 747 kB 00:00 2024-04-04T06:58:05.336 INFO:teuthology.orchestra.run.smithi072.stdout:(10/45): udftools-2.2-5.el9.x86_64.rpm 539 kB/s | 144 kB 00:00 2024-04-04T06:58:05.661 INFO:teuthology.orchestra.run.smithi072.stdout:(11/45): kernel-devel-5.14.0-435.el9.x86_64.rpm 24 MB/s | 16 MB 00:00 2024-04-04T06:58:05.686 INFO:teuthology.orchestra.run.smithi072.stdout:(12/45): rmt-1.6-6.el9.x86_64.rpm 81 kB/s | 45 kB 00:00 2024-04-04T06:58:05.787 INFO:teuthology.orchestra.run.smithi072.stdout:(13/45): libnbd-1.18.1-3.el9.x86_64.rpm 382 kB/s | 166 kB 00:00 2024-04-04T06:58:05.912 INFO:teuthology.orchestra.run.smithi072.stdout:(14/45): gdbm-devel-1.19-4.el9.x86_64.rpm 261 kB/s | 59 kB 00:00 2024-04-04T06:58:06.004 INFO:teuthology.orchestra.run.smithi072.stdout:(15/45): gdbm-1.19-4.el9.x86_64.rpm 417 kB/s | 132 kB 00:00 2024-04-04T06:58:06.080 INFO:teuthology.orchestra.run.smithi072.stdout:(16/45): python-unversioned-command-3.9.18-3.el 111 kB/s | 8.3 kB 00:00 2024-04-04T06:58:06.230 INFO:teuthology.orchestra.run.smithi072.stdout:(17/45): python3-devel-3.9.18-3.el9.x86_64.rpm 1.3 MB/s | 204 kB 00:00 2024-04-04T06:58:06.281 INFO:teuthology.orchestra.run.smithi072.stdout:(18/45): python3-3.9.18-3.el9.x86_64.rpm 537 kB/s | 25 kB 00:00 2024-04-04T06:58:06.623 INFO:teuthology.orchestra.run.smithi072.stdout:(19/45): python3-libs-3.9.18-3.el9.x86_64.rpm 22 MB/s | 7.3 MB 00:00 2024-04-04T06:58:06.682 INFO:teuthology.orchestra.run.smithi072.stdout:(20/45): sqlite-libs-3.34.1-7.el9.x86_64.rpm 11 MB/s | 619 kB 00:00 2024-04-04T06:58:06.741 INFO:teuthology.orchestra.run.smithi072.stdout:(21/45): dump-0.4-0.51.b47.el9.x86_64.rpm 92 kB/s | 88 kB 00:00 2024-04-04T06:58:06.869 INFO:teuthology.orchestra.run.smithi072.stdout:(22/45): device-mapper-event-1.02.197-2.el9.x86 272 kB/s | 34 kB 00:00 2024-04-04T06:58:06.902 INFO:teuthology.orchestra.run.smithi072.stdout:(23/45): device-mapper-1.02.197-2.el9.x86_64.rp 645 kB/s | 141 kB 00:00 2024-04-04T06:58:06.928 INFO:teuthology.orchestra.run.smithi072.stdout:(24/45): indent-2.2.13-5.el9.x86_64.rpm 190 kB/s | 179 kB 00:00 2024-04-04T06:58:06.954 INFO:teuthology.orchestra.run.smithi072.stdout:(25/45): device-mapper-event-libs-1.02.197-2.el 380 kB/s | 32 kB 00:00 2024-04-04T06:58:07.046 INFO:teuthology.orchestra.run.smithi072.stdout:(26/45): device-mapper-libs-1.02.197-2.el9.x86_ 1.2 MB/s | 179 kB 00:00 2024-04-04T06:58:07.138 INFO:teuthology.orchestra.run.smithi072.stdout:(27/45): libcom_err-1.46.5-5.el9.x86_64.rpm 289 kB/s | 26 kB 00:00 2024-04-04T06:58:07.180 INFO:teuthology.orchestra.run.smithi072.stdout:(28/45): e2fsprogs-libs-1.46.5-5.el9.x86_64.rpm 988 kB/s | 222 kB 00:00 2024-04-04T06:58:07.230 INFO:teuthology.orchestra.run.smithi072.stdout:(29/45): libgcc-11.4.1-3.el9.x86_64.rpm 1.0 MB/s | 92 kB 00:00 2024-04-04T06:58:07.381 INFO:teuthology.orchestra.run.smithi072.stdout:(30/45): libgomp-11.4.1-3.el9.x86_64.rpm 1.3 MB/s | 268 kB 00:00 2024-04-04T06:58:09.333 INFO:teuthology.orchestra.run.smithi072.stdout:(31/45): libss-1.46.5-5.el9.x86_64.rpm 15 kB/s | 32 kB 00:02 2024-04-04T06:58:10.024 INFO:teuthology.orchestra.run.smithi072.stdout:(32/45): e2fsprogs-1.46.5-5.el9.x86_64.rpm 332 kB/s | 1.0 MB 00:03 2024-04-04T06:58:10.066 INFO:teuthology.orchestra.run.smithi072.stdout:(33/45): libstdc++-11.4.1-3.el9.x86_64.rpm 277 kB/s | 743 kB 00:02 2024-04-04T06:58:10.250 INFO:teuthology.orchestra.run.smithi072.stdout:(34/45): make-4.3-8.el9.x86_64.rpm 2.9 MB/s | 536 kB 00:00 2024-04-04T06:58:10.342 INFO:teuthology.orchestra.run.smithi072.stdout:(35/45): lvm2-2.03.23-2.el9.x86_64.rpm 1.5 MB/s | 1.5 MB 00:01 2024-04-04T06:58:10.459 INFO:teuthology.orchestra.run.smithi072.stdout:(36/45): lvm2-libs-2.03.23-2.el9.x86_64.rpm 2.3 MB/s | 1.0 MB 00:00 2024-04-04T06:58:10.812 INFO:teuthology.orchestra.run.smithi072.stdout:(37/45): cpp-11.4.1-3.el9.x86_64.rpm 19 MB/s | 11 MB 00:00 2024-04-04T06:58:10.879 INFO:teuthology.orchestra.run.smithi072.stdout:(38/45): gcc-plugin-annobin-11.4.1-3.el9.x86_64 719 kB/s | 47 kB 00:00 2024-04-04T06:58:10.938 INFO:teuthology.orchestra.run.smithi072.stdout:(39/45): git-2.43.0-1.el9.x86_64.rpm 886 kB/s | 51 kB 00:00 2024-04-04T06:58:11.330 INFO:teuthology.orchestra.run.smithi072.stdout:(40/45): gcc-c++-11.4.1-3.el9.x86_64.rpm 15 MB/s | 13 MB 00:00 2024-04-04T06:58:11.489 INFO:teuthology.orchestra.run.smithi072.stdout:(41/45): git-core-2.43.0-1.el9.x86_64.rpm 8.1 MB/s | 4.4 MB 00:00 2024-04-04T06:58:11.673 INFO:teuthology.orchestra.run.smithi072.stdout:(42/45): git-core-doc-2.43.0-1.el9.noarch.rpm 8.6 MB/s | 2.9 MB 00:00 2024-04-04T06:58:11.748 INFO:teuthology.orchestra.run.smithi072.stdout:(43/45): perl-Git-2.43.0-1.el9.noarch.rpm 508 kB/s | 38 kB 00:00 2024-04-04T06:58:12.324 INFO:teuthology.orchestra.run.smithi072.stdout:(44/45): gcc-11.4.1-3.el9.x86_64.rpm 16 MB/s | 32 MB 00:01 2024-04-04T06:58:12.399 INFO:teuthology.orchestra.run.smithi072.stdout:(45/45): libstdc++-devel-11.4.1-3.el9.x86_64.rp 2.7 MB/s | 2.4 MB 00:00 2024-04-04T06:58:12.413 INFO:teuthology.orchestra.run.smithi072.stdout:-------------------------------------------------------------------------------- 2024-04-04T06:58:12.414 INFO:teuthology.orchestra.run.smithi072.stdout:Total 12 MB/s | 103 MB 00:08 2024-04-04T06:58:13.960 INFO:teuthology.orchestra.run.smithi072.stdout:Running transaction check 2024-04-04T06:58:14.356 INFO:teuthology.orchestra.run.smithi072.stdout:Transaction check succeeded. 2024-04-04T06:58:14.357 INFO:teuthology.orchestra.run.smithi072.stdout:Running transaction test 2024-04-04T06:58:14.718 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T06:58:14.729 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T06:58:15.918 INFO:teuthology.orchestra.run.smithi072.stdout:Transaction test succeeded. 2024-04-04T06:58:15.919 INFO:teuthology.orchestra.run.smithi072.stdout:Running transaction 2024-04-04T06:58:19.131 INFO:teuthology.orchestra.run.smithi072.stdout: Preparing : 1/1 2024-04-04T06:58:19.195 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : libgcc-11.4.1-3.el9.x86_64 1/73 2024-04-04T06:58:19.303 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: libgcc-11.4.1-3.el9.x86_64 1/73 2024-04-04T06:58:19.423 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : libcom_err-1.46.5-5.el9.x86_64 2/73 2024-04-04T06:58:19.520 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : libstdc++-11.4.1-3.el9.x86_64 3/73 2024-04-04T06:58:19.612 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : e2fsprogs-libs-1.46.5-5.el9.x86_64 4/73 2024-04-04T06:58:19.702 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : device-mapper-libs-9:1.02.197-2.el9.x86_64 5/73 2024-04-04T06:58:19.781 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : device-mapper-9:1.02.197-2.el9.x86_64 6/73 2024-04-04T06:58:20.375 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : device-mapper-event-libs-9:1.02.197-2.el9.x86_64 7/73 2024-04-04T06:58:20.536 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : git-core-2.43.0-1.el9.x86_64 8/73 2024-04-04T06:58:20.606 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : make-1:4.3-8.el9.x86_64 9/73 2024-04-04T06:58:22.239 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : sqlite-libs-3.34.1-7.el9.x86_64 10/73 2024-04-04T06:58:22.357 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : python3-libs-3.9.18-3.el9.x86_64 11/73 2024-04-04T06:58:22.392 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : python3-3.9.18-3.el9.x86_64 12/73 2024-04-04T06:58:23.426 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : python-unversioned-command-3.9.18-3.el9.noarch 13/73 2024-04-04T06:58:23.506 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : git-core-doc-2.43.0-1.el9.noarch 14/73 2024-04-04T06:58:23.576 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : perl-Git-2.43.0-1.el9.noarch 15/73 2024-04-04T06:58:23.620 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : git-2.43.0-1.el9.x86_64 16/73 2024-04-04T06:58:23.648 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : device-mapper-event-9:1.02.197-2.el9.x86_64 17/73 2024-04-04T06:58:24.117 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: device-mapper-event-9:1.02.197-2.el9.x86_64 17/73 2024-04-04T06:58:24.837 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : lvm2-libs-9:2.03.23-2.el9.x86_64 18/73 2024-04-04T06:58:24.905 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : libstdc++-devel-11.4.1-3.el9.x86_64 19/73 2024-04-04T06:58:25.169 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : libss-1.46.5-5.el9.x86_64 20/73 2024-04-04T06:58:25.570 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : cpp-11.4.1-3.el9.x86_64 21/73 2024-04-04T06:58:27.600 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : libgomp-11.4.1-3.el9.x86_64 22/73 2024-04-04T06:58:28.132 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : gcc-11.4.1-3.el9.x86_64 23/73 2024-04-04T06:58:28.230 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: gcc-11.4.1-3.el9.x86_64 23/73 2024-04-04T06:58:28.285 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : gdbm-1:1.19-4.el9.x86_64 24/73 2024-04-04T06:58:28.324 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libnbd-1.18.1-3.el9.x86_64 25/73 2024-04-04T06:58:28.357 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : fio-engine-http-3.35-1.el9.x86_64 26/73 2024-04-04T06:58:28.391 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : fio-engine-libaio-3.35-1.el9.x86_64 27/73 2024-04-04T06:58:28.426 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : fio-engine-nbd-3.35-1.el9.x86_64 28/73 2024-04-04T06:58:28.460 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : fio-engine-rados-3.35-1.el9.x86_64 29/73 2024-04-04T06:58:28.485 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : fio-engine-rbd-3.35-1.el9.x86_64 30/73 2024-04-04T06:58:28.746 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : fio-engine-rdma-3.35-1.el9.x86_64 31/73 2024-04-04T06:58:28.801 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : fio-3.35-1.el9.x86_64 32/73 2024-04-04T06:58:28.842 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : rmt-2:1.6-6.el9.x86_64 33/73 2024-04-04T06:58:28.880 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : dump-1:0.4-0.51.b47.el9.x86_64 34/73 2024-04-04T06:58:40.792 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : gdbm-devel-1:1.19-4.el9.x86_64 35/73 2024-04-04T06:58:41.049 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : kernel-devel-5.14.0-435.el9.x86_64 36/73 2024-04-04T06:58:44.880 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T06:58:44.886 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T06:59:15.025 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T06:59:15.032 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T06:59:29.073 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: kernel-devel-5.14.0-435.el9.x86_64 36/73 2024-04-04T06:59:29.194 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : gcc-c++-11.4.1-3.el9.x86_64 37/73 2024-04-04T06:59:29.225 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : gcc-plugin-annobin-11.4.1-3.el9.x86_64 38/73 2024-04-04T06:59:29.453 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: gcc-plugin-annobin-11.4.1-3.el9.x86_64 38/73 2024-04-04T06:59:29.782 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : e2fsprogs-1.46.5-5.el9.x86_64 39/73 2024-04-04T06:59:29.782 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : lvm2-9:2.03.23-2.el9.x86_64 40/73 2024-04-04T06:59:29.782 INFO:teuthology.orchestra.run.smithi072.stdout:warning: /etc/lvm/lvm.conf created as /etc/lvm/lvm.conf.rpmnew 2024-04-04T06:59:29.782 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T06:59:30.238 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: lvm2-9:2.03.23-2.el9.x86_64 40/73 2024-04-04T06:59:30.284 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : python3-devel-3.9.18-3.el9.x86_64 41/73 2024-04-04T06:59:30.364 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : sqlite-3.34.1-7.el9.x86_64 42/73 2024-04-04T06:59:30.426 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : indent-2.2.13-5.el9.x86_64 43/73 2024-04-04T06:59:30.501 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : udftools-2.2-5.el9.x86_64 44/73 2024-04-04T06:59:30.553 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libcap-devel-2.48-9.el9.x86_64 45/73 2024-04-04T06:59:30.592 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : git-2.39.3-1.el9.x86_64 46/73 2024-04-04T06:59:30.668 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : python3-devel-3.9.17-2.el9.x86_64 47/73 2024-04-04T06:59:30.728 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : e2fsprogs-1.46.5-3.el9.x86_64 48/73 2024-04-04T06:59:30.767 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : gcc-c++-11.4.1-2.1.el9.x86_64 49/73 2024-04-04T06:59:30.799 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : python3-3.9.17-2.el9.x86_64 50/73 2024-04-04T06:59:30.833 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : python-unversioned-command-3.9.17-2.el9.noarch 51/73 2024-04-04T06:59:30.834 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : gcc-plugin-annobin-11.4.1-2.1.el9.x86_64 52/73 2024-04-04T06:59:30.958 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: gcc-plugin-annobin-11.4.1-2.1.el9.x86_64 52/73 2024-04-04T06:59:31.031 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : gcc-11.4.1-2.1.el9.x86_64 53/73 2024-04-04T06:59:31.071 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: lvm2-9:2.03.21-3.el9.x86_64 54/73 2024-04-04T06:59:31.072 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : lvm2-9:2.03.21-3.el9.x86_64 54/73 2024-04-04T06:59:31.194 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: lvm2-9:2.03.21-3.el9.x86_64 54/73 2024-04-04T06:59:31.280 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : libstdc++-devel-11.4.1-2.1.el9.x86_64 55/73 2024-04-04T06:59:31.322 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : git-core-doc-2.39.3-1.el9.noarch 56/73 2024-04-04T06:59:31.357 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : perl-Git-2.39.3-1.el9.noarch 57/73 2024-04-04T06:59:31.398 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : lvm2-libs-9:2.03.21-3.el9.x86_64 58/73 2024-04-04T06:59:31.421 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: device-mapper-event-9:1.02.195-3.el9.x86_64 59/73 2024-04-04T06:59:31.470 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : device-mapper-event-9:1.02.195-3.el9.x86_64 59/73 2024-04-04T06:59:31.509 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : libstdc++-11.4.1-2.1.el9.x86_64 60/73 2024-04-04T06:59:31.543 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : device-mapper-event-libs-9:1.02.195-3.el9.x86_64 61/73 2024-04-04T06:59:31.577 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : e2fsprogs-libs-1.46.5-3.el9.x86_64 62/73 2024-04-04T06:59:31.619 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : libss-1.46.5-3.el9.x86_64 63/73 2024-04-04T06:59:31.664 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : device-mapper-libs-9:1.02.195-3.el9.x86_64 64/73 2024-04-04T06:59:31.798 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : device-mapper-9:1.02.195-3.el9.x86_64 65/73 2024-04-04T06:59:31.903 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : python3-libs-3.9.17-2.el9.x86_64 66/73 2024-04-04T06:59:31.936 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : sqlite-libs-3.34.1-6.el9.x86_64 67/73 2024-04-04T06:59:31.970 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : libcom_err-1.46.5-3.el9.x86_64 68/73 2024-04-04T06:59:31.970 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : libgcc-11.4.1-2.1.el9.x86_64 69/73 2024-04-04T06:59:32.105 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: libgcc-11.4.1-2.1.el9.x86_64 69/73 2024-04-04T06:59:32.161 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : git-core-2.39.3-1.el9.x86_64 70/73 2024-04-04T06:59:32.202 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : cpp-11.4.1-2.1.el9.x86_64 71/73 2024-04-04T06:59:32.237 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : libgomp-11.4.1-2.1.el9.x86_64 72/73 2024-04-04T06:59:32.366 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : make-1:4.3-7.el9.x86_64 73/73 2024-04-04T06:59:34.537 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: make-1:4.3-7.el9.x86_64 73/73 2024-04-04T06:59:34.537 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : fio-3.35-1.el9.x86_64 1/73 2024-04-04T06:59:34.537 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : fio-engine-http-3.35-1.el9.x86_64 2/73 2024-04-04T06:59:34.537 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : fio-engine-libaio-3.35-1.el9.x86_64 3/73 2024-04-04T06:59:34.537 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : fio-engine-nbd-3.35-1.el9.x86_64 4/73 2024-04-04T06:59:34.537 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : fio-engine-rados-3.35-1.el9.x86_64 5/73 2024-04-04T06:59:34.537 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : fio-engine-rbd-3.35-1.el9.x86_64 6/73 2024-04-04T06:59:34.537 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : fio-engine-rdma-3.35-1.el9.x86_64 7/73 2024-04-04T06:59:34.537 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : kernel-devel-5.14.0-435.el9.x86_64 8/73 2024-04-04T06:59:34.537 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libcap-devel-2.48-9.el9.x86_64 9/73 2024-04-04T06:59:34.538 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : sqlite-3.34.1-7.el9.x86_64 10/73 2024-04-04T06:59:34.538 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : udftools-2.2-5.el9.x86_64 11/73 2024-04-04T06:59:34.538 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : rmt-2:1.6-6.el9.x86_64 12/73 2024-04-04T06:59:34.538 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libnbd-1.18.1-3.el9.x86_64 13/73 2024-04-04T06:59:34.538 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : gdbm-1:1.19-4.el9.x86_64 14/73 2024-04-04T06:59:34.538 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : gdbm-devel-1:1.19-4.el9.x86_64 15/73 2024-04-04T06:59:34.538 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : dump-1:0.4-0.51.b47.el9.x86_64 16/73 2024-04-04T06:59:34.538 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : indent-2.2.13-5.el9.x86_64 17/73 2024-04-04T06:59:34.538 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python-unversioned-command-3.9.18-3.el9.noarch 18/73 2024-04-04T06:59:34.538 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python-unversioned-command-3.9.17-2.el9.noarch 19/73 2024-04-04T06:59:34.538 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 20/73 2024-04-04T06:59:34.538 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 21/73 2024-04-04T06:59:34.538 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-3.9.18-3.el9.x86_64 22/73 2024-04-04T06:59:34.538 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-3.9.17-2.el9.x86_64 23/73 2024-04-04T06:59:34.538 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-libs-3.9.18-3.el9.x86_64 24/73 2024-04-04T06:59:34.539 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-libs-3.9.17-2.el9.x86_64 25/73 2024-04-04T06:59:34.539 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : sqlite-libs-3.34.1-7.el9.x86_64 26/73 2024-04-04T06:59:34.539 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : sqlite-libs-3.34.1-6.el9.x86_64 27/73 2024-04-04T06:59:34.539 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : device-mapper-9:1.02.197-2.el9.x86_64 28/73 2024-04-04T06:59:34.539 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : device-mapper-9:1.02.195-3.el9.x86_64 29/73 2024-04-04T06:59:34.539 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : device-mapper-event-9:1.02.197-2.el9.x86_64 30/73 2024-04-04T06:59:34.539 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : device-mapper-event-9:1.02.195-3.el9.x86_64 31/73 2024-04-04T06:59:34.539 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : device-mapper-event-libs-9:1.02.197-2.el9.x86_64 32/73 2024-04-04T06:59:34.539 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : device-mapper-event-libs-9:1.02.195-3.el9.x86_64 33/73 2024-04-04T06:59:34.539 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : device-mapper-libs-9:1.02.197-2.el9.x86_64 34/73 2024-04-04T06:59:34.540 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : device-mapper-libs-9:1.02.195-3.el9.x86_64 35/73 2024-04-04T06:59:34.540 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : e2fsprogs-1.46.5-5.el9.x86_64 36/73 2024-04-04T06:59:34.540 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : e2fsprogs-1.46.5-3.el9.x86_64 37/73 2024-04-04T06:59:34.540 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : e2fsprogs-libs-1.46.5-5.el9.x86_64 38/73 2024-04-04T06:59:34.540 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : e2fsprogs-libs-1.46.5-3.el9.x86_64 39/73 2024-04-04T06:59:34.540 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libcom_err-1.46.5-5.el9.x86_64 40/73 2024-04-04T06:59:34.540 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libcom_err-1.46.5-3.el9.x86_64 41/73 2024-04-04T06:59:34.541 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libgcc-11.4.1-3.el9.x86_64 42/73 2024-04-04T06:59:34.541 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libgcc-11.4.1-2.1.el9.x86_64 43/73 2024-04-04T06:59:34.541 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libgomp-11.4.1-3.el9.x86_64 44/73 2024-04-04T06:59:34.541 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libgomp-11.4.1-2.1.el9.x86_64 45/73 2024-04-04T06:59:34.541 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libss-1.46.5-5.el9.x86_64 46/73 2024-04-04T06:59:34.541 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libss-1.46.5-3.el9.x86_64 47/73 2024-04-04T06:59:34.541 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libstdc++-11.4.1-3.el9.x86_64 48/73 2024-04-04T06:59:34.541 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libstdc++-11.4.1-2.1.el9.x86_64 49/73 2024-04-04T06:59:34.541 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : lvm2-9:2.03.23-2.el9.x86_64 50/73 2024-04-04T06:59:34.541 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : lvm2-9:2.03.21-3.el9.x86_64 51/73 2024-04-04T06:59:34.541 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : lvm2-libs-9:2.03.23-2.el9.x86_64 52/73 2024-04-04T06:59:34.541 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : lvm2-libs-9:2.03.21-3.el9.x86_64 53/73 2024-04-04T06:59:34.541 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : make-1:4.3-8.el9.x86_64 54/73 2024-04-04T06:59:34.541 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : make-1:4.3-7.el9.x86_64 55/73 2024-04-04T06:59:34.542 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : cpp-11.4.1-3.el9.x86_64 56/73 2024-04-04T06:59:34.542 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : cpp-11.4.1-2.1.el9.x86_64 57/73 2024-04-04T06:59:34.542 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : gcc-11.4.1-3.el9.x86_64 58/73 2024-04-04T06:59:34.542 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : gcc-11.4.1-2.1.el9.x86_64 59/73 2024-04-04T06:59:34.542 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : gcc-c++-11.4.1-3.el9.x86_64 60/73 2024-04-04T06:59:34.542 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : gcc-c++-11.4.1-2.1.el9.x86_64 61/73 2024-04-04T06:59:34.542 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : gcc-plugin-annobin-11.4.1-3.el9.x86_64 62/73 2024-04-04T06:59:34.542 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : gcc-plugin-annobin-11.4.1-2.1.el9.x86_64 63/73 2024-04-04T06:59:34.542 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : git-2.43.0-1.el9.x86_64 64/73 2024-04-04T06:59:34.542 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : git-2.39.3-1.el9.x86_64 65/73 2024-04-04T06:59:34.542 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : git-core-2.43.0-1.el9.x86_64 66/73 2024-04-04T06:59:34.542 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : git-core-2.39.3-1.el9.x86_64 67/73 2024-04-04T06:59:34.542 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : git-core-doc-2.43.0-1.el9.noarch 68/73 2024-04-04T06:59:34.542 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : git-core-doc-2.39.3-1.el9.noarch 69/73 2024-04-04T06:59:34.543 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libstdc++-devel-11.4.1-3.el9.x86_64 70/73 2024-04-04T06:59:34.543 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libstdc++-devel-11.4.1-2.1.el9.x86_64 71/73 2024-04-04T06:59:34.543 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : perl-Git-2.43.0-1.el9.noarch 72/73 2024-04-04T06:59:35.600 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : perl-Git-2.39.3-1.el9.noarch 73/73 2024-04-04T06:59:35.600 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T06:59:35.600 INFO:teuthology.orchestra.run.smithi072.stdout:Upgraded: 2024-04-04T06:59:35.600 INFO:teuthology.orchestra.run.smithi072.stdout: cpp-11.4.1-3.el9.x86_64 2024-04-04T06:59:35.600 INFO:teuthology.orchestra.run.smithi072.stdout: device-mapper-9:1.02.197-2.el9.x86_64 2024-04-04T06:59:35.600 INFO:teuthology.orchestra.run.smithi072.stdout: device-mapper-event-9:1.02.197-2.el9.x86_64 2024-04-04T06:59:35.601 INFO:teuthology.orchestra.run.smithi072.stdout: device-mapper-event-libs-9:1.02.197-2.el9.x86_64 2024-04-04T06:59:35.601 INFO:teuthology.orchestra.run.smithi072.stdout: device-mapper-libs-9:1.02.197-2.el9.x86_64 2024-04-04T06:59:35.601 INFO:teuthology.orchestra.run.smithi072.stdout: e2fsprogs-1.46.5-5.el9.x86_64 2024-04-04T06:59:35.601 INFO:teuthology.orchestra.run.smithi072.stdout: e2fsprogs-libs-1.46.5-5.el9.x86_64 2024-04-04T06:59:35.601 INFO:teuthology.orchestra.run.smithi072.stdout: gcc-11.4.1-3.el9.x86_64 2024-04-04T06:59:35.601 INFO:teuthology.orchestra.run.smithi072.stdout: gcc-c++-11.4.1-3.el9.x86_64 2024-04-04T06:59:35.601 INFO:teuthology.orchestra.run.smithi072.stdout: gcc-plugin-annobin-11.4.1-3.el9.x86_64 2024-04-04T06:59:35.601 INFO:teuthology.orchestra.run.smithi072.stdout: git-2.43.0-1.el9.x86_64 2024-04-04T06:59:35.601 INFO:teuthology.orchestra.run.smithi072.stdout: git-core-2.43.0-1.el9.x86_64 2024-04-04T06:59:35.601 INFO:teuthology.orchestra.run.smithi072.stdout: git-core-doc-2.43.0-1.el9.noarch 2024-04-04T06:59:35.601 INFO:teuthology.orchestra.run.smithi072.stdout: libcom_err-1.46.5-5.el9.x86_64 2024-04-04T06:59:35.601 INFO:teuthology.orchestra.run.smithi072.stdout: libgcc-11.4.1-3.el9.x86_64 2024-04-04T06:59:35.601 INFO:teuthology.orchestra.run.smithi072.stdout: libgomp-11.4.1-3.el9.x86_64 2024-04-04T06:59:35.601 INFO:teuthology.orchestra.run.smithi072.stdout: libss-1.46.5-5.el9.x86_64 2024-04-04T06:59:35.602 INFO:teuthology.orchestra.run.smithi072.stdout: libstdc++-11.4.1-3.el9.x86_64 2024-04-04T06:59:35.602 INFO:teuthology.orchestra.run.smithi072.stdout: libstdc++-devel-11.4.1-3.el9.x86_64 2024-04-04T06:59:35.602 INFO:teuthology.orchestra.run.smithi072.stdout: lvm2-9:2.03.23-2.el9.x86_64 2024-04-04T06:59:35.602 INFO:teuthology.orchestra.run.smithi072.stdout: lvm2-libs-9:2.03.23-2.el9.x86_64 2024-04-04T06:59:35.602 INFO:teuthology.orchestra.run.smithi072.stdout: make-1:4.3-8.el9.x86_64 2024-04-04T06:59:35.602 INFO:teuthology.orchestra.run.smithi072.stdout: perl-Git-2.43.0-1.el9.noarch 2024-04-04T06:59:35.602 INFO:teuthology.orchestra.run.smithi072.stdout: python-unversioned-command-3.9.18-3.el9.noarch 2024-04-04T06:59:35.602 INFO:teuthology.orchestra.run.smithi072.stdout: python3-3.9.18-3.el9.x86_64 2024-04-04T06:59:35.602 INFO:teuthology.orchestra.run.smithi072.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-04-04T06:59:35.602 INFO:teuthology.orchestra.run.smithi072.stdout: python3-libs-3.9.18-3.el9.x86_64 2024-04-04T06:59:35.602 INFO:teuthology.orchestra.run.smithi072.stdout: sqlite-libs-3.34.1-7.el9.x86_64 2024-04-04T06:59:35.602 INFO:teuthology.orchestra.run.smithi072.stdout:Installed: 2024-04-04T06:59:35.603 INFO:teuthology.orchestra.run.smithi072.stdout: dump-1:0.4-0.51.b47.el9.x86_64 fio-3.35-1.el9.x86_64 2024-04-04T06:59:35.603 INFO:teuthology.orchestra.run.smithi072.stdout: fio-engine-http-3.35-1.el9.x86_64 fio-engine-libaio-3.35-1.el9.x86_64 2024-04-04T06:59:35.603 INFO:teuthology.orchestra.run.smithi072.stdout: fio-engine-nbd-3.35-1.el9.x86_64 fio-engine-rados-3.35-1.el9.x86_64 2024-04-04T06:59:35.603 INFO:teuthology.orchestra.run.smithi072.stdout: fio-engine-rbd-3.35-1.el9.x86_64 fio-engine-rdma-3.35-1.el9.x86_64 2024-04-04T06:59:35.603 INFO:teuthology.orchestra.run.smithi072.stdout: gdbm-1:1.19-4.el9.x86_64 gdbm-devel-1:1.19-4.el9.x86_64 2024-04-04T06:59:35.603 INFO:teuthology.orchestra.run.smithi072.stdout: indent-2.2.13-5.el9.x86_64 kernel-devel-5.14.0-435.el9.x86_64 2024-04-04T06:59:35.603 INFO:teuthology.orchestra.run.smithi072.stdout: libcap-devel-2.48-9.el9.x86_64 libnbd-1.18.1-3.el9.x86_64 2024-04-04T06:59:35.603 INFO:teuthology.orchestra.run.smithi072.stdout: rmt-2:1.6-6.el9.x86_64 sqlite-3.34.1-7.el9.x86_64 2024-04-04T06:59:35.603 INFO:teuthology.orchestra.run.smithi072.stdout: udftools-2.2-5.el9.x86_64 2024-04-04T06:59:35.603 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T06:59:35.603 INFO:teuthology.orchestra.run.smithi072.stdout:Complete! 2024-04-04T06:59:36.572 DEBUG:teuthology.orchestra.run.smithi072:> sudo useradd -m fsgqa 2024-04-04T06:59:36.652 INFO:teuthology.orchestra.run.smithi072.stderr:useradd: user 'fsgqa' already exists 2024-04-04T06:59:36.655 DEBUG:teuthology.orchestra.run:got remote process result: 9 2024-04-04T06:59:36.655 DEBUG:teuthology.orchestra.run.smithi072:> sudo groupadd fsgqa 2024-04-04T06:59:36.730 INFO:teuthology.orchestra.run.smithi072.stderr:groupadd: group 'fsgqa' already exists 2024-04-04T06:59:36.734 DEBUG:teuthology.orchestra.run:got remote process result: 9 2024-04-04T06:59:36.735 DEBUG:teuthology.orchestra.run.smithi072:> sudo useradd fsgqa2 2024-04-04T06:59:37.370 DEBUG:teuthology.orchestra.run.smithi072:> sudo useradd 123456-fsgqa 2024-04-04T06:59:38.113 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json mon dump 2024-04-04T06:59:38.296 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:59:38.297+0000 7f5d3e200640 1 Processor -- start 2024-04-04T06:59:38.297 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:59:38.297+0000 7f5d3e200640 1 -- start start 2024-04-04T06:59:38.299 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:59:38.299+0000 7f5d3e200640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f5d38071610 0x7f5d380c5e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:59:38.299 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:59:38.299+0000 7f5d3e200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5d380ccb20 0x7f5d380ccfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:59:38.299 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:59:38.300+0000 7f5d3e200640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5d380c6710 con 0x7f5d3815c2d0 2024-04-04T06:59:38.299 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:59:38.300+0000 7f5d3e200640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f5d380c6fb0 con 0x7f5d38071610 2024-04-04T06:59:38.299 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:59:38.300+0000 7f5d3e200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f5d380c69f0 con 0x7f5d380ccb20 2024-04-04T06:59:38.300 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:59:38.300+0000 7f5d36a00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f5d38071610 0x7f5d380c5e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:59:38.300 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:59:38.300+0000 7f5d37e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5d380ccb20 0x7f5d380ccfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:59:38.300 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:59:38.300+0000 7f5d36a00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f5d38071610 0x7f5d380c5e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.72:58270/0 (socket says 172.21.15.72:58270) 2024-04-04T06:59:38.300 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:59:38.300+0000 7f5d36a00640 1 -- 172.21.15.72:0/2132059709 learned_addr learned my addr 172.21.15.72:0/2132059709 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:59:38.300 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:59:38.301+0000 7f5d36a00640 1 -- 172.21.15.72:0/2132059709 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5d380ccb20 msgr2=0x7f5d380ccfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:59:38.300 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:59:38.301+0000 7f5d36a00640 1 --2- 172.21.15.72:0/2132059709 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5d380ccb20 0x7f5d380ccfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:59:38.300 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:59:38.301+0000 7f5d36a00640 1 -- 172.21.15.72:0/2132059709 >> v1:172.21.15.117:6789/0 conn(0x7f5d3815c2d0 legacy=0x7f5d3815c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:59:38.300 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:59:38.301+0000 7f5d36a00640 1 -- 172.21.15.72:0/2132059709 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d380c6cd0 con 0x7f5d38071610 2024-04-04T06:59:38.301 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:59:38.302+0000 7f5d36a00640 1 --2- 172.21.15.72:0/2132059709 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5d38071610 0x7f5d380c5e50 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f5d24009870 tx=0x7f5d2402b8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dd051125fb40da2f server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:59:38.301 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:59:38.303+0000 7f5d36000640 1 -- 172.21.15.72:0/2132059709 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d24035020 con 0x7f5d38071610 2024-04-04T06:59:38.302 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:59:38.303+0000 7f5d36000640 1 -- 172.21.15.72:0/2132059709 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d24031640 con 0x7f5d38071610 2024-04-04T06:59:38.302 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:59:38.303+0000 7f5d36000640 1 -- 172.21.15.72:0/2132059709 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d2402d040 con 0x7f5d38071610 2024-04-04T06:59:38.302 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:59:38.303+0000 7f5d3e200640 1 -- 172.21.15.72:0/2132059709 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5d38071610 msgr2=0x7f5d380c5e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:59:38.303 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:59:38.303+0000 7f5d3e200640 1 --2- 172.21.15.72:0/2132059709 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5d38071610 0x7f5d380c5e50 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f5d24009870 tx=0x7f5d2402b8f0 comp rx=0 tx=0).stop 2024-04-04T06:59:38.303 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:59:38.303+0000 7f5d3e200640 1 -- 172.21.15.72:0/2132059709 shutdown_connections 2024-04-04T06:59:38.303 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:59:38.303+0000 7f5d3e200640 1 --2- 172.21.15.72:0/2132059709 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5d380ccb20 0x7f5d380ccfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:59:38.303 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:59:38.303+0000 7f5d3e200640 1 --2- 172.21.15.72:0/2132059709 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5d38071610 0x7f5d380c5e50 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:59:38.303 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:59:38.303+0000 7f5d3e200640 1 -- 172.21.15.72:0/2132059709 >> 172.21.15.72:0/2132059709 conn(0x7f5d3806b470 msgr2=0x7f5d3806b880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:59:38.303 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:59:38.304+0000 7f5d3e200640 1 -- 172.21.15.72:0/2132059709 shutdown_connections 2024-04-04T06:59:38.303 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:59:38.304+0000 7f5d3e200640 1 -- 172.21.15.72:0/2132059709 wait complete. 2024-04-04T06:59:38.304 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:59:38.305+0000 7f5d3e200640 1 Processor -- start 2024-04-04T06:59:38.304 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:59:38.306+0000 7f5d3e200640 1 -- start start 2024-04-04T06:59:38.306 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:59:38.307+0000 7f5d3e200640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5d38071610 0x7f5d38151550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:59:38.306 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:59:38.307+0000 7f5d3e200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5d380ccb20 0x7f5d3814e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:59:38.306 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:59:38.307+0000 7f5d3e200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5d3815c2d0 0x7f5d38150180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:59:38.306 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:59:38.307+0000 7f5d3e200640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f5d380b4020 con 0x7f5d38071610 2024-04-04T06:59:38.306 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:59:38.307+0000 7f5d3e200640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f5d380b3ea0 con 0x7f5d380ccb20 2024-04-04T06:59:38.306 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:59:38.307+0000 7f5d3e200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f5d380b41a0 con 0x7f5d3815c2d0 2024-04-04T06:59:38.306 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:59:38.307+0000 7f5d37400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5d38071610 0x7f5d38151550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:59:38.306 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:59:38.307+0000 7f5d37400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5d38071610 0x7f5d38151550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60002/0 (socket says 172.21.15.72:60002) 2024-04-04T06:59:38.306 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:59:38.307+0000 7f5d37400640 1 -- 172.21.15.72:0/2513017278 learned_addr learned my addr 172.21.15.72:0/2513017278 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:59:38.308 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:59:38.307+0000 7f5d36a00640 1 --2- 172.21.15.72:0/2513017278 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5d380ccb20 0x7f5d3814e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:59:38.308 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:59:38.307+0000 7f5d37e00640 1 --2- 172.21.15.72:0/2513017278 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5d3815c2d0 0x7f5d38150180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:59:38.308 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:59:38.307+0000 7f5d37400640 1 -- 172.21.15.72:0/2513017278 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5d3815c2d0 msgr2=0x7f5d38150180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:59:38.308 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:59:38.307+0000 7f5d37400640 1 --2- 172.21.15.72:0/2513017278 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5d3815c2d0 0x7f5d38150180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:59:38.308 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:59:38.307+0000 7f5d37400640 1 -- 172.21.15.72:0/2513017278 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5d380ccb20 msgr2=0x7f5d3814e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:59:38.308 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:59:38.307+0000 7f5d37400640 1 --2- 172.21.15.72:0/2513017278 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5d380ccb20 0x7f5d3814e9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:59:38.309 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:59:38.307+0000 7f5d37400640 1 -- 172.21.15.72:0/2513017278 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d3814f0e0 con 0x7f5d38071610 2024-04-04T06:59:38.309 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:59:38.308+0000 7f5d37400640 1 --2- 172.21.15.72:0/2513017278 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5d38071610 0x7f5d38151550 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f5d2800c3c0 tx=0x7f5d2800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:59:38.309 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:59:38.309+0000 7f5d2f400640 1 -- 172.21.15.72:0/2513017278 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d280052d0 con 0x7f5d38071610 2024-04-04T06:59:38.310 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:59:38.309+0000 7f5d2f400640 1 -- 172.21.15.72:0/2513017278 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d28005490 con 0x7f5d38071610 2024-04-04T06:59:38.310 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:59:38.309+0000 7f5d2f400640 1 -- 172.21.15.72:0/2513017278 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d28007260 con 0x7f5d38071610 2024-04-04T06:59:38.310 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:59:38.309+0000 7f5d3e200640 1 -- 172.21.15.72:0/2513017278 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d3814f3c0 con 0x7f5d38071610 2024-04-04T06:59:38.311 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:59:38.309+0000 7f5d3e200640 1 -- 172.21.15.72:0/2513017278 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d3814f980 con 0x7f5d38071610 2024-04-04T06:59:38.312 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:59:38.310+0000 7f5d3e200640 1 -- 172.21.15.72:0/2513017278 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d38075840 con 0x7f5d38071610 2024-04-04T06:59:38.313 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:59:38.311+0000 7f5d2f400640 1 -- 172.21.15.72:0/2513017278 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5d28007400 con 0x7f5d38071610 2024-04-04T06:59:38.313 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:59:38.312+0000 7f5d2f400640 1 --2- 172.21.15.72:0/2513017278 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f5d1806c940 0x7f5d1806ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:59:38.313 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:59:38.312+0000 7f5d2f400640 1 -- 172.21.15.72:0/2513017278 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f5d2808aff0 con 0x7f5d38071610 2024-04-04T06:59:38.313 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:59:38.313+0000 7f5d36a00640 1 --2- 172.21.15.72:0/2513017278 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f5d1806c940 0x7f5d1806ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:59:38.313 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:59:38.313+0000 7f5d36a00640 1 --2- 172.21.15.72:0/2513017278 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f5d1806c940 0x7f5d1806ee00 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f5d24036000 tx=0x7f5d24008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:59:38.319 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:59:38.319+0000 7f5d2f400640 1 -- 172.21.15.72:0/2513017278 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f5d28059440 con 0x7f5d38071610 2024-04-04T06:59:38.623 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:59:38.624+0000 7f5d3e200640 1 -- 172.21.15.72:0/2513017278 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f5d380730f0 con 0x7f5d38071610 2024-04-04T06:59:38.624 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:59:38.625+0000 7f5d2f400640 1 -- 172.21.15.72:0/2513017278 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) ==== 95+0+1285 (secure 0 0 0) 0x7f5d28058d40 con 0x7f5d38071610 2024-04-04T06:59:38.624 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T06:59:38.624 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":1,"fsid":"6708bac2-4f50-49b5-87a9-c390fd333eb3","modified":"2024-04-04T06:55:16.548161Z","created":"2024-04-04T06:55:16.548161Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:3300","nonce":0},{"type":"v1","addr":"172.21.15.72:6789","nonce":0}]},"addr":"172.21.15.72:6789/0","public_addr":"172.21.15.72:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3300","nonce":0},{"type":"v1","addr":"172.21.15.117:6789","nonce":0}]},"addr":"172.21.15.117:6789/0","public_addr":"172.21.15.117:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3301","nonce":0},{"type":"v1","addr":"172.21.15.117:6790","nonce":0}]},"addr":"172.21.15.117:6790/0","public_addr":"172.21.15.117:6790/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2024-04-04T06:59:38.625 INFO:teuthology.orchestra.run.smithi072.stderr:dumped monmap epoch 1 2024-04-04T06:59:38.629 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:59:38.627+0000 7f5d3e200640 1 -- 172.21.15.72:0/2513017278 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f5d1806c940 msgr2=0x7f5d1806ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:59:38.629 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:59:38.627+0000 7f5d3e200640 1 --2- 172.21.15.72:0/2513017278 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f5d1806c940 0x7f5d1806ee00 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f5d24036000 tx=0x7f5d24008030 comp rx=0 tx=0).stop 2024-04-04T06:59:38.629 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:59:38.627+0000 7f5d3e200640 1 -- 172.21.15.72:0/2513017278 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5d38071610 msgr2=0x7f5d38151550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:59:38.629 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:59:38.627+0000 7f5d3e200640 1 --2- 172.21.15.72:0/2513017278 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5d38071610 0x7f5d38151550 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f5d2800c3c0 tx=0x7f5d2800c880 comp rx=0 tx=0).stop 2024-04-04T06:59:38.629 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:59:38.627+0000 7f5d3e200640 1 -- 172.21.15.72:0/2513017278 shutdown_connections 2024-04-04T06:59:38.629 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:59:38.627+0000 7f5d3e200640 1 --2- 172.21.15.72:0/2513017278 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f5d1806c940 0x7f5d1806ee00 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:59:38.629 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:59:38.627+0000 7f5d3e200640 1 --2- 172.21.15.72:0/2513017278 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5d3815c2d0 0x7f5d38150180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:59:38.630 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:59:38.627+0000 7f5d3e200640 1 --2- 172.21.15.72:0/2513017278 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5d380ccb20 0x7f5d3814e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:59:38.630 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:59:38.627+0000 7f5d3e200640 1 --2- 172.21.15.72:0/2513017278 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5d38071610 0x7f5d38151550 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:59:38.630 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:59:38.627+0000 7f5d3e200640 1 -- 172.21.15.72:0/2513017278 >> 172.21.15.72:0/2513017278 conn(0x7f5d3806b470 msgr2=0x7f5d3815ce00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:59:38.630 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:59:38.628+0000 7f5d3e200640 1 -- 172.21.15.72:0/2513017278 shutdown_connections 2024-04-04T06:59:38.630 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:59:38.628+0000 7f5d3e200640 1 -- 172.21.15.72:0/2513017278 wait complete. 2024-04-04T06:59:38.644 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth get client.admin 2024-04-04T06:59:38.811 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:59:38.812+0000 7f51a5c00640 1 Processor -- start 2024-04-04T06:59:38.812 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:59:38.813+0000 7f51a5c00640 1 -- start start 2024-04-04T06:59:38.813 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:59:38.814+0000 7f51a5c00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f51a01427e0 0x7f51a00ce6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:59:38.813 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:59:38.814+0000 7f51a5c00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f51a00cf310 0x7f51a0071580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:59:38.813 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:59:38.814+0000 7f51a5c00640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f51a0142bc0 con 0x7f51a006df20 2024-04-04T06:59:38.813 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:59:38.814+0000 7f51a5c00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f51a006e490 con 0x7f51a01427e0 2024-04-04T06:59:38.813 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:59:38.814+0000 7f51a5c00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f51a006e770 con 0x7f51a00cf310 2024-04-04T06:59:38.813 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:59:38.814+0000 7f519f400640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f51a006df20 0x7f51a00cec00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:49574/0 (socket says 172.21.15.72:49574) 2024-04-04T06:59:38.813 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:59:38.814+0000 7f519f400640 1 -- 172.21.15.72:0/975676370 learned_addr learned my addr 172.21.15.72:0/975676370 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-04-04T06:59:38.815 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:59:38.814+0000 7f519fe00640 1 --2- 172.21.15.72:0/975676370 >> v2:172.21.15.117:3300/0 conn(0x7f51a01427e0 0x7f51a00ce6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:59:38.815 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:59:38.814+0000 7f51a5200640 1 --2- 172.21.15.72:0/975676370 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f51a00cf310 0x7f51a0071580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:59:38.815 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:59:38.815+0000 7f519ea00640 1 -- 172.21.15.72:0/975676370 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2031671275 0 0) 0x7f51a0142bc0 con 0x7f51a006df20 2024-04-04T06:59:38.815 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:59:38.815+0000 7f519ea00640 1 -- 172.21.15.72:0/975676370 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5184003520 con 0x7f51a006df20 2024-04-04T06:59:38.815 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:59:38.815+0000 7f519ea00640 1 -- 172.21.15.72:0/975676370 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1044226211 0 0) 0x7f5184003520 con 0x7f51a006df20 2024-04-04T06:59:38.815 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:59:38.815+0000 7f519ea00640 1 -- 172.21.15.72:0/975676370 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f51a00cf310 msgr2=0x7f51a0071580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:59:38.815 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:59:38.815+0000 7f519ea00640 1 --2- 172.21.15.72:0/975676370 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f51a00cf310 0x7f51a0071580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:59:38.815 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:59:38.815+0000 7f519ea00640 1 -- 172.21.15.72:0/975676370 >> v2:172.21.15.117:3300/0 conn(0x7f51a01427e0 msgr2=0x7f51a00ce6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:59:38.816 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:59:38.815+0000 7f519ea00640 1 --2- 172.21.15.72:0/975676370 >> v2:172.21.15.117:3300/0 conn(0x7f51a01427e0 0x7f51a00ce6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:59:38.816 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:59:38.815+0000 7f519ea00640 1 -- 172.21.15.72:0/975676370 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51a006ea50 con 0x7f51a006df20 2024-04-04T06:59:38.816 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:59:38.815+0000 7f519ea00640 1 -- 172.21.15.72:0/975676370 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2465650867 0 0) 0x7f518c001670 con 0x7f51a006df20 2024-04-04T06:59:38.816 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:59:38.815+0000 7f519ea00640 1 -- 172.21.15.72:0/975676370 >> v1:172.21.15.72:6789/0 conn(0x7f51a006df20 legacy=0x7f51a00cec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:59:38.816 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:59:38.815+0000 7f519ea00640 1 --2- 172.21.15.72:0/975676370 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f51840039b0 0x7f5184003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:59:38.816 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:59:38.815+0000 7f519ea00640 1 --2- 172.21.15.72:0/975676370 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5184004800 0x7f5184004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:59:38.816 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:59:38.815+0000 7f519ea00640 1 --2- 172.21.15.72:0/975676370 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f51a00cf310 0x7f51840051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:59:38.816 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:59:38.815+0000 7f519ea00640 1 -- 172.21.15.72:0/975676370 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f51a006e490 con 0x7f51840039b0 2024-04-04T06:59:38.816 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:59:38.815+0000 7f519ea00640 1 -- 172.21.15.72:0/975676370 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f51a006e770 con 0x7f5184004800 2024-04-04T06:59:38.816 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:59:38.815+0000 7f519ea00640 1 -- 172.21.15.72:0/975676370 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f518400fdd0 con 0x7f51a00cf310 2024-04-04T06:59:38.816 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:59:38.815+0000 7f519fe00640 1 --2- 172.21.15.72:0/975676370 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f51840039b0 0x7f5184003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:59:38.816 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:59:38.816+0000 7f519fe00640 1 -- 172.21.15.72:0/975676370 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f51a00cf310 msgr2=0x7f51840051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:59:38.816 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:59:38.816+0000 7f519fe00640 1 --2- 172.21.15.72:0/975676370 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f51a00cf310 0x7f51840051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:59:38.816 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:59:38.816+0000 7f519fe00640 1 -- 172.21.15.72:0/975676370 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5184004800 msgr2=0x7f5184004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T06:59:38.816 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:59:38.816+0000 7f519fe00640 1 --2- 172.21.15.72:0/975676370 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5184004800 0x7f5184004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:59:38.817 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:59:38.816+0000 7f519fe00640 1 -- 172.21.15.72:0/975676370 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5184003520 con 0x7f51840039b0 2024-04-04T06:59:38.818 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:59:38.817+0000 7f519fe00640 1 --2- 172.21.15.72:0/975676370 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f51840039b0 0x7f5184003dd0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f5190009ac0 tx=0x7f5184005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b0e8abf23352bcc server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:59:38.818 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:59:38.817+0000 7f519ea00640 1 -- 172.21.15.72:0/975676370 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5190039070 con 0x7f51840039b0 2024-04-04T06:59:38.818 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:59:38.817+0000 7f519ea00640 1 -- 172.21.15.72:0/975676370 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f519002c6d0 con 0x7f51840039b0 2024-04-04T06:59:38.818 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:59:38.817+0000 7f519ea00640 1 -- 172.21.15.72:0/975676370 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5190009690 con 0x7f51840039b0 2024-04-04T06:59:38.818 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:59:38.818+0000 7f51a5c00640 1 -- 172.21.15.72:0/975676370 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f51840039b0 msgr2=0x7f5184003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:59:38.818 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:59:38.818+0000 7f51a5c00640 1 --2- 172.21.15.72:0/975676370 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f51840039b0 0x7f5184003dd0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f5190009ac0 tx=0x7f5184005830 comp rx=0 tx=0).stop 2024-04-04T06:59:38.818 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:59:38.818+0000 7f51a5200640 1 -- 172.21.15.72:0/975676370 reap_dead start 2024-04-04T06:59:38.818 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:59:38.818+0000 7f51a5c00640 1 -- 172.21.15.72:0/975676370 shutdown_connections 2024-04-04T06:59:38.818 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:59:38.818+0000 7f51a5c00640 1 -- 172.21.15.72:0/975676370 >> 172.21.15.72:0/975676370 conn(0x7f51a00b1840 msgr2=0x7f51a00b1c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:59:38.818 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:59:38.818+0000 7f51a5c00640 1 -- 172.21.15.72:0/975676370 shutdown_connections 2024-04-04T06:59:38.818 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:59:38.818+0000 7f51a5c00640 1 -- 172.21.15.72:0/975676370 wait complete. 2024-04-04T06:59:38.820 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:59:38.821+0000 7f51a5c00640 1 Processor -- start 2024-04-04T06:59:38.820 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:59:38.821+0000 7f51a5c00640 1 -- start start 2024-04-04T06:59:38.822 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:59:38.823+0000 7f51a5c00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f51840039b0 0x7f51a0154a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:59:38.823 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:59:38.823+0000 7f51a5c00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f51a015b450 0x7f51a013dd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:59:38.823 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:59:38.823+0000 7f51a5c00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f51a013f240 0x7f51a013f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:59:38.823 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:59:38.823+0000 7f51a5c00640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f51a0071580 con 0x7f51840039b0 2024-04-04T06:59:38.823 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:59:38.823+0000 7f51a5c00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f51a0145ca0 con 0x7f51a013f240 2024-04-04T06:59:38.823 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:59:38.823+0000 7f51a5c00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f51a0071700 con 0x7f51a015b450 2024-04-04T06:59:38.823 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:59:38.823+0000 7f519fe00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f51840039b0 0x7f51a0154a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:59:38.823 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:59:38.823+0000 7f519fe00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f51840039b0 0x7f51a0154a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60014/0 (socket says 172.21.15.72:60014) 2024-04-04T06:59:38.823 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:59:38.823+0000 7f519fe00640 1 -- 172.21.15.72:0/302730521 learned_addr learned my addr 172.21.15.72:0/302730521 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T06:59:38.823 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:59:38.823+0000 7f519f400640 1 --2- 172.21.15.72:0/302730521 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f51a015b450 0x7f51a013dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:59:38.823 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:59:38.823+0000 7f519fe00640 1 -- 172.21.15.72:0/302730521 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f51a015b450 msgr2=0x7f51a013dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:59:38.823 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:59:38.823+0000 7f519fe00640 1 --2- 172.21.15.72:0/302730521 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f51a015b450 0x7f51a013dd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:59:38.823 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:59:38.823+0000 7f519fe00640 1 -- 172.21.15.72:0/302730521 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f51a013f240 msgr2=0x7f51a013f6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:59:38.823 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:59:38.823+0000 7f519fe00640 1 --2- 172.21.15.72:0/302730521 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f51a013f240 0x7f51a013f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:59:38.823 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:59:38.823+0000 7f519fe00640 1 -- 172.21.15.72:0/302730521 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51a013d180 con 0x7f51840039b0 2024-04-04T06:59:38.824 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:59:38.824+0000 7f519fe00640 1 --2- 172.21.15.72:0/302730521 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f51840039b0 0x7f51a0154a10 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f5190037040 tx=0x7f5190004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:59:38.825 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:59:38.824+0000 7f5197e00640 1 -- 172.21.15.72:0/302730521 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5190039050 con 0x7f51840039b0 2024-04-04T06:59:38.825 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:59:38.824+0000 7f5197e00640 1 -- 172.21.15.72:0/302730521 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5190045070 con 0x7f51840039b0 2024-04-04T06:59:38.825 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:59:38.824+0000 7f51a5c00640 1 -- 172.21.15.72:0/302730521 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51a0158920 con 0x7f51840039b0 2024-04-04T06:59:38.825 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:59:38.824+0000 7f5197e00640 1 -- 172.21.15.72:0/302730521 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5190003850 con 0x7f51840039b0 2024-04-04T06:59:38.825 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:59:38.824+0000 7f51a5c00640 1 -- 172.21.15.72:0/302730521 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51a013e760 con 0x7f51840039b0 2024-04-04T06:59:38.825 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:59:38.825+0000 7f51a5c00640 1 -- 172.21.15.72:0/302730521 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51a0158750 con 0x7f51840039b0 2024-04-04T06:59:38.825 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:59:38.826+0000 7f5197e00640 1 -- 172.21.15.72:0/302730521 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f51900039f0 con 0x7f51840039b0 2024-04-04T06:59:38.827 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:59:38.828+0000 7f5197e00640 1 --2- 172.21.15.72:0/302730521 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f518006c8f0 0x7f518006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T06:59:38.827 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:59:38.828+0000 7f5197e00640 1 -- 172.21.15.72:0/302730521 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f51900adb20 con 0x7f51840039b0 2024-04-04T06:59:38.827 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:59:38.828+0000 7f519f400640 1 --2- 172.21.15.72:0/302730521 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f518006c8f0 0x7f518006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T06:59:38.828 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:59:38.829+0000 7f519f400640 1 --2- 172.21.15.72:0/302730521 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f518006c8f0 0x7f518006edb0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f51a015ad10 tx=0x7f518c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T06:59:38.836 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:59:38.835+0000 7f5197e00640 1 -- 172.21.15.72:0/302730521 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f519004f020 con 0x7f51840039b0 2024-04-04T06:59:39.169 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:59:39.170+0000 7f51a5c00640 1 -- 172.21.15.72:0/302730521 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "auth get", "entity": "client.admin"} v 0) -- 0x7f51a00756c0 con 0x7f51840039b0 2024-04-04T06:59:39.170 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:59:39.171+0000 7f5197e00640 1 -- 172.21.15.72:0/302730521 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "auth get", "entity": "client.admin"}]=0 v11) ==== 82+0+151 (secure 0 0 0) 0x7f519007beb0 con 0x7f51840039b0 2024-04-04T06:59:39.170 INFO:teuthology.orchestra.run.smithi072.stdout:[client.admin] 2024-04-04T06:59:39.170 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQDUTg5mK1AXORAAlC1pVAaGvWlKo7AeRDsVXg== 2024-04-04T06:59:39.171 INFO:teuthology.orchestra.run.smithi072.stdout: caps mds = "allow *" 2024-04-04T06:59:39.171 INFO:teuthology.orchestra.run.smithi072.stdout: caps mgr = "allow *" 2024-04-04T06:59:39.171 INFO:teuthology.orchestra.run.smithi072.stdout: caps mon = "allow *" 2024-04-04T06:59:39.171 INFO:teuthology.orchestra.run.smithi072.stdout: caps osd = "allow *" 2024-04-04T06:59:39.173 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:59:39.173+0000 7f51a5c00640 1 -- 172.21.15.72:0/302730521 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f518006c8f0 msgr2=0x7f518006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:59:39.173 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:59:39.173+0000 7f51a5c00640 1 --2- 172.21.15.72:0/302730521 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f518006c8f0 0x7f518006edb0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f51a015ad10 tx=0x7f518c009040 comp rx=0 tx=0).stop 2024-04-04T06:59:39.173 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:59:39.173+0000 7f51a5c00640 1 -- 172.21.15.72:0/302730521 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f51840039b0 msgr2=0x7f51a0154a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T06:59:39.173 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:59:39.173+0000 7f51a5c00640 1 --2- 172.21.15.72:0/302730521 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f51840039b0 0x7f51a0154a10 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f5190037040 tx=0x7f5190004730 comp rx=0 tx=0).stop 2024-04-04T06:59:39.173 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:59:39.173+0000 7f51a5c00640 1 -- 172.21.15.72:0/302730521 shutdown_connections 2024-04-04T06:59:39.173 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:59:39.173+0000 7f51a5c00640 1 --2- 172.21.15.72:0/302730521 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f518006c8f0 0x7f518006edb0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:59:39.173 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:59:39.174+0000 7f51a5c00640 1 --2- 172.21.15.72:0/302730521 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f51a013f240 0x7f51a013f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:59:39.174 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:59:39.174+0000 7f51a5c00640 1 --2- 172.21.15.72:0/302730521 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f51a015b450 0x7f51a013dd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:59:39.174 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:59:39.174+0000 7f51a5c00640 1 --2- 172.21.15.72:0/302730521 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f51840039b0 0x7f51a0154a10 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T06:59:39.174 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:59:39.174+0000 7f51a5c00640 1 -- 172.21.15.72:0/302730521 >> 172.21.15.72:0/302730521 conn(0x7f51a00b1840 msgr2=0x7f51a00b2db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T06:59:39.174 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:59:39.174+0000 7f51a5c00640 1 -- 172.21.15.72:0/302730521 shutdown_connections 2024-04-04T06:59:39.174 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T06:59:39.174+0000 7f51a5c00640 1 -- 172.21.15.72:0/302730521 wait complete. 2024-04-04T06:59:39.191 DEBUG:teuthology.orchestra.run.smithi072:> mktemp 2024-04-04T06:59:39.232 INFO:teuthology.orchestra.run.smithi072.stdout:/tmp/tmp.NdsUVGDEEv 2024-04-04T06:59:39.232 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-04-04T06:59:39.232 DEBUG:teuthology.orchestra.run.smithi072:> dd of=/tmp/tmp.NdsUVGDEEv 2024-04-04T06:59:39.316 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-04-04T06:59:39.317 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd of=/tmp/tmp.tiFz9P8iUAxfstests-dev/local.config 2024-04-04T06:59:39.423 INFO:tasks.cephfs.xfstests_dev:local.config's contents - export FSTYP=ceph-fuse export CEPH_FUSE_BIN_PATH=ceph-fuse export TEST_DEV=ceph-fuse # without this tests won't get started export TEST_DIR=/tmp/tmp.LqGJQhujaOtest export SCRATCH_DEV= export SCRATCH_MNT=/tmp/tmp.xMSjQpfJ28scratch export CEPHFS_MOUNT_OPTIONS="-m 172.21.15.72:6789 -k /tmp/tmp.NdsUVGDEEv --client_mountpoint /test" 2024-04-04T06:59:39.424 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-04-04T06:59:39.424 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd of=/tmp/tmp.tiFz9P8iUAxfstests-dev/ceph.exclude 2024-04-04T06:59:39.539 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo make) 2024-04-04T06:59:39.656 INFO:teuthology.orchestra.run.smithi072.stdout:libtoolize -cfi 2024-04-04T06:59:40.350 INFO:teuthology.orchestra.run.smithi072.stdout:libtoolize: putting auxiliary files in '.'. 2024-04-04T06:59:40.350 INFO:teuthology.orchestra.run.smithi072.stdout:libtoolize: copying file './config.guess' 2024-04-04T06:59:40.360 INFO:teuthology.orchestra.run.smithi072.stdout:libtoolize: copying file './config.sub' 2024-04-04T06:59:40.372 INFO:teuthology.orchestra.run.smithi072.stdout:libtoolize: copying file './install-sh' 2024-04-04T06:59:40.383 INFO:teuthology.orchestra.run.smithi072.stdout:libtoolize: copying file './ltmain.sh' 2024-04-04T06:59:40.457 INFO:teuthology.orchestra.run.smithi072.stdout:libtoolize: putting macros in AC_CONFIG_MACRO_DIRS, 'm4'. 2024-04-04T06:59:40.458 INFO:teuthology.orchestra.run.smithi072.stdout:libtoolize: copying file 'm4/libtool.m4' 2024-04-04T06:59:40.475 INFO:teuthology.orchestra.run.smithi072.stdout:libtoolize: copying file 'm4/ltoptions.m4' 2024-04-04T06:59:40.494 INFO:teuthology.orchestra.run.smithi072.stdout:libtoolize: copying file 'm4/ltsugar.m4' 2024-04-04T06:59:40.514 INFO:teuthology.orchestra.run.smithi072.stdout:libtoolize: copying file 'm4/ltversion.m4' 2024-04-04T06:59:40.532 INFO:teuthology.orchestra.run.smithi072.stdout:libtoolize: copying file 'm4/lt~obsolete.m4' 2024-04-04T06:59:40.556 INFO:teuthology.orchestra.run.smithi072.stdout:libtoolize: Consider adding '-I m4' to ACLOCAL_AMFLAGS in Makefile.am. 2024-04-04T06:59:40.562 INFO:teuthology.orchestra.run.smithi072.stdout:cp include/install-sh . 2024-04-04T06:59:40.565 INFO:teuthology.orchestra.run.smithi072.stdout:aclocal -I m4 2024-04-04T06:59:42.202 INFO:teuthology.orchestra.run.smithi072.stdout:autoheader 2024-04-04T06:59:42.626 INFO:teuthology.orchestra.run.smithi072.stdout:autoconf 2024-04-04T06:59:42.874 INFO:teuthology.orchestra.run.smithi072.stdout:./configure \ 2024-04-04T06:59:42.874 INFO:teuthology.orchestra.run.smithi072.stdout: --libexecdir=/usr/lib \ 2024-04-04T06:59:42.874 INFO:teuthology.orchestra.run.smithi072.stdout: --exec_prefix=/var/lib 2024-04-04T06:59:43.311 INFO:teuthology.orchestra.run.smithi072.stdout:checking build system type... x86_64-pc-linux-gnu 2024-04-04T06:59:43.311 INFO:teuthology.orchestra.run.smithi072.stdout:checking host system type... x86_64-pc-linux-gnu 2024-04-04T06:59:43.317 INFO:teuthology.orchestra.run.smithi072.stdout:checking how to print strings... printf 2024-04-04T06:59:43.318 INFO:teuthology.orchestra.run.smithi072.stdout:checking for gcc... gcc 2024-04-04T06:59:43.466 INFO:teuthology.orchestra.run.smithi072.stdout:checking whether the C compiler works... yes 2024-04-04T06:59:43.466 INFO:teuthology.orchestra.run.smithi072.stdout:checking for C compiler default output file name... a.out 2024-04-04T06:59:43.534 INFO:teuthology.orchestra.run.smithi072.stdout:checking for suffix of executables... 2024-04-04T06:59:43.658 INFO:teuthology.orchestra.run.smithi072.stdout:checking whether we are cross compiling... no 2024-04-04T06:59:43.707 INFO:teuthology.orchestra.run.smithi072.stdout:checking for suffix of object files... o 2024-04-04T06:59:43.751 INFO:teuthology.orchestra.run.smithi072.stdout:checking whether we are using the GNU C compiler... yes 2024-04-04T06:59:43.795 INFO:teuthology.orchestra.run.smithi072.stdout:checking whether gcc accepts -g... yes 2024-04-04T06:59:43.861 INFO:teuthology.orchestra.run.smithi072.stdout:checking for gcc option to accept ISO C89... none needed 2024-04-04T06:59:43.870 INFO:teuthology.orchestra.run.smithi072.stdout:checking for a sed that does not truncate output... /bin/sed 2024-04-04T06:59:43.877 INFO:teuthology.orchestra.run.smithi072.stdout:checking for grep that handles long lines and -e... /bin/grep 2024-04-04T06:59:43.882 INFO:teuthology.orchestra.run.smithi072.stdout:checking for egrep... /bin/grep -E 2024-04-04T06:59:43.885 INFO:teuthology.orchestra.run.smithi072.stdout:checking for fgrep... /bin/grep -F 2024-04-04T06:59:43.896 INFO:teuthology.orchestra.run.smithi072.stdout:checking for ld used by gcc... /bin/ld 2024-04-04T06:59:43.901 INFO:teuthology.orchestra.run.smithi072.stdout:checking if the linker (/bin/ld) is GNU ld... yes 2024-04-04T06:59:43.916 INFO:teuthology.orchestra.run.smithi072.stdout:checking for BSD- or MS-compatible name lister (nm)... /bin/nm -B 2024-04-04T06:59:45.161 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T06:59:45.170 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T06:59:46.203 INFO:teuthology.orchestra.run.smithi072.stdout:checking the name lister (/bin/nm -B) interface... BSD nm 2024-04-04T06:59:46.203 INFO:teuthology.orchestra.run.smithi072.stdout:checking whether ln -s works... yes 2024-04-04T06:59:46.223 INFO:teuthology.orchestra.run.smithi072.stdout:checking the maximum length of command line arguments... 1572864 2024-04-04T06:59:46.232 INFO:teuthology.orchestra.run.smithi072.stdout:checking how to convert x86_64-pc-linux-gnu file names to x86_64-pc-linux-gnu format... func_convert_file_noop 2024-04-04T06:59:46.232 INFO:teuthology.orchestra.run.smithi072.stdout:checking how to convert x86_64-pc-linux-gnu file names to toolchain format... func_convert_file_noop 2024-04-04T06:59:46.232 INFO:teuthology.orchestra.run.smithi072.stdout:checking for /bin/ld option to reload object files... -r 2024-04-04T06:59:46.232 INFO:teuthology.orchestra.run.smithi072.stdout:checking for objdump... objdump 2024-04-04T06:59:46.233 INFO:teuthology.orchestra.run.smithi072.stdout:checking how to recognize dependent libraries... pass_all 2024-04-04T06:59:46.234 INFO:teuthology.orchestra.run.smithi072.stdout:checking for dlltool... no 2024-04-04T06:59:46.234 INFO:teuthology.orchestra.run.smithi072.stdout:checking how to associate runtime and link libraries... printf %s\n 2024-04-04T06:59:46.235 INFO:teuthology.orchestra.run.smithi072.stdout:checking for ar... ar 2024-04-04T06:59:46.333 INFO:teuthology.orchestra.run.smithi072.stdout:checking for archiver @FILE support... @ 2024-04-04T06:59:46.333 INFO:teuthology.orchestra.run.smithi072.stdout:checking for strip... strip 2024-04-04T06:59:46.333 INFO:teuthology.orchestra.run.smithi072.stdout:checking for ranlib... ranlib 2024-04-04T06:59:46.333 INFO:teuthology.orchestra.run.smithi072.stdout:checking for gawk... gawk 2024-04-04T06:59:46.472 INFO:teuthology.orchestra.run.smithi072.stdout:checking command to parse /bin/nm -B output from gcc object... ok 2024-04-04T06:59:46.477 INFO:teuthology.orchestra.run.smithi072.stdout:checking for sysroot... no 2024-04-04T06:59:46.486 INFO:teuthology.orchestra.run.smithi072.stdout:checking for a working dd... /bin/dd 2024-04-04T06:59:46.496 INFO:teuthology.orchestra.run.smithi072.stdout:checking how to truncate binary pipes... /bin/dd bs=4096 count=1 2024-04-04T06:59:46.527 INFO:teuthology.orchestra.run.smithi072.stdout:checking for mt... no 2024-04-04T06:59:46.534 INFO:teuthology.orchestra.run.smithi072.stdout:checking if : is a manifest tool... no 2024-04-04T06:59:46.645 INFO:teuthology.orchestra.run.smithi072.stdout:checking how to run the C preprocessor... gcc -E 2024-04-04T06:59:46.953 INFO:teuthology.orchestra.run.smithi072.stdout:checking for ANSI C header files... yes 2024-04-04T06:59:47.003 INFO:teuthology.orchestra.run.smithi072.stdout:checking for sys/types.h... yes 2024-04-04T06:59:47.066 INFO:teuthology.orchestra.run.smithi072.stdout:checking for sys/stat.h... yes 2024-04-04T06:59:47.129 INFO:teuthology.orchestra.run.smithi072.stdout:checking for stdlib.h... yes 2024-04-04T06:59:47.197 INFO:teuthology.orchestra.run.smithi072.stdout:checking for string.h... yes 2024-04-04T06:59:47.269 INFO:teuthology.orchestra.run.smithi072.stdout:checking for memory.h... yes 2024-04-04T06:59:47.333 INFO:teuthology.orchestra.run.smithi072.stdout:checking for strings.h... yes 2024-04-04T06:59:47.410 INFO:teuthology.orchestra.run.smithi072.stdout:checking for inttypes.h... yes 2024-04-04T06:59:47.483 INFO:teuthology.orchestra.run.smithi072.stdout:checking for stdint.h... yes 2024-04-04T06:59:47.565 INFO:teuthology.orchestra.run.smithi072.stdout:checking for unistd.h... yes 2024-04-04T06:59:47.642 INFO:teuthology.orchestra.run.smithi072.stdout:checking for dlfcn.h... yes 2024-04-04T06:59:47.652 INFO:teuthology.orchestra.run.smithi072.stdout:checking for objdir... .libs 2024-04-04T06:59:47.832 INFO:teuthology.orchestra.run.smithi072.stdout:checking if gcc supports -fno-rtti -fno-exceptions... no 2024-04-04T06:59:47.832 INFO:teuthology.orchestra.run.smithi072.stdout:checking for gcc option to produce PIC... -fPIC -DPIC 2024-04-04T06:59:47.887 INFO:teuthology.orchestra.run.smithi072.stdout:checking if gcc PIC flag -fPIC -DPIC works... yes 2024-04-04T06:59:47.936 INFO:teuthology.orchestra.run.smithi072.stdout:checking if gcc static flag -static works... no 2024-04-04T06:59:48.010 INFO:teuthology.orchestra.run.smithi072.stdout:checking if gcc supports -c -o file.o... yes 2024-04-04T06:59:48.010 INFO:teuthology.orchestra.run.smithi072.stdout:checking if gcc supports -c -o file.o... (cached) yes 2024-04-04T06:59:48.033 INFO:teuthology.orchestra.run.smithi072.stdout:checking whether the gcc linker (/bin/ld -m elf_x86_64) supports shared libraries... yes 2024-04-04T06:59:48.096 INFO:teuthology.orchestra.run.smithi072.stdout:checking whether -lc should be explicitly linked in... no 2024-04-04T06:59:48.242 INFO:teuthology.orchestra.run.smithi072.stdout:checking dynamic linker characteristics... GNU/Linux ld.so 2024-04-04T06:59:48.242 INFO:teuthology.orchestra.run.smithi072.stdout:checking how to hardcode library paths into programs... immediate 2024-04-04T06:59:48.246 INFO:teuthology.orchestra.run.smithi072.stdout:checking whether stripping libraries is possible... yes 2024-04-04T06:59:48.247 INFO:teuthology.orchestra.run.smithi072.stdout:checking if libtool supports shared libraries... yes 2024-04-04T06:59:48.247 INFO:teuthology.orchestra.run.smithi072.stdout:checking whether to build shared libraries... yes 2024-04-04T06:59:48.247 INFO:teuthology.orchestra.run.smithi072.stdout:checking whether to build static libraries... yes 2024-04-04T06:59:48.268 INFO:teuthology.orchestra.run.smithi072.stdout:checking for gcc... (cached) gcc 2024-04-04T06:59:48.317 INFO:teuthology.orchestra.run.smithi072.stdout:checking whether we are using the GNU C compiler... (cached) yes 2024-04-04T06:59:48.317 INFO:teuthology.orchestra.run.smithi072.stdout:checking whether gcc accepts -g... (cached) yes 2024-04-04T06:59:48.317 INFO:teuthology.orchestra.run.smithi072.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2024-04-04T06:59:48.318 INFO:teuthology.orchestra.run.smithi072.stdout:checking for gmake... /usr/bin/gmake 2024-04-04T06:59:48.318 INFO:teuthology.orchestra.run.smithi072.stderr:./configure: line 12082: test: $(SHELL): binary operator expected 2024-04-04T06:59:48.319 INFO:teuthology.orchestra.run.smithi072.stdout:checking for tar... /bin/tar 2024-04-04T06:59:48.319 INFO:teuthology.orchestra.run.smithi072.stdout:checking for gzip... /bin/gzip 2024-04-04T06:59:48.344 INFO:teuthology.orchestra.run.smithi072.stdout:checking whether gcc -MM is supported... yes 2024-04-04T06:59:48.344 INFO:teuthology.orchestra.run.smithi072.stdout:checking for sort... /bin/sort 2024-04-04T06:59:48.344 INFO:teuthology.orchestra.run.smithi072.stdout:checking whether ln -s works... yes 2024-04-04T06:59:48.344 INFO:teuthology.orchestra.run.smithi072.stdout:checking for rpm... /bin/rpm 2024-04-04T06:59:48.354 INFO:teuthology.orchestra.run.smithi072.stdout:checking for rpmbuild... no 2024-04-04T06:59:48.414 INFO:teuthology.orchestra.run.smithi072.stdout:checking assert.h usability... yes 2024-04-04T06:59:48.441 INFO:teuthology.orchestra.run.smithi072.stdout:checking assert.h presence... yes 2024-04-04T06:59:48.441 INFO:teuthology.orchestra.run.smithi072.stdout:checking for assert.h... yes 2024-04-04T06:59:48.511 INFO:teuthology.orchestra.run.smithi072.stdout:checking bstring.h usability... no 2024-04-04T06:59:48.544 INFO:teuthology.orchestra.run.smithi072.stdout:checking bstring.h presence... no 2024-04-04T06:59:48.544 INFO:teuthology.orchestra.run.smithi072.stdout:checking for bstring.h... no 2024-04-04T06:59:48.611 INFO:teuthology.orchestra.run.smithi072.stdout:checking libgen.h usability... yes 2024-04-04T06:59:48.635 INFO:teuthology.orchestra.run.smithi072.stdout:checking libgen.h presence... yes 2024-04-04T06:59:48.635 INFO:teuthology.orchestra.run.smithi072.stdout:checking for libgen.h... yes 2024-04-04T06:59:48.714 INFO:teuthology.orchestra.run.smithi072.stdout:checking dirent.h usability... yes 2024-04-04T06:59:48.741 INFO:teuthology.orchestra.run.smithi072.stdout:checking dirent.h presence... yes 2024-04-04T06:59:48.741 INFO:teuthology.orchestra.run.smithi072.stdout:checking for dirent.h... yes 2024-04-04T06:59:48.849 INFO:teuthology.orchestra.run.smithi072.stdout:checking errno.h usability... yes 2024-04-04T06:59:48.874 INFO:teuthology.orchestra.run.smithi072.stdout:checking errno.h presence... yes 2024-04-04T06:59:48.874 INFO:teuthology.orchestra.run.smithi072.stdout:checking for errno.h... yes 2024-04-04T06:59:48.961 INFO:teuthology.orchestra.run.smithi072.stdout:checking malloc.h usability... yes 2024-04-04T06:59:48.991 INFO:teuthology.orchestra.run.smithi072.stdout:checking malloc.h presence... yes 2024-04-04T06:59:48.991 INFO:teuthology.orchestra.run.smithi072.stdout:checking for malloc.h... yes 2024-04-04T06:59:49.066 INFO:teuthology.orchestra.run.smithi072.stdout:checking uuid.h usability... no 2024-04-04T06:59:49.104 INFO:teuthology.orchestra.run.smithi072.stdout:checking uuid.h presence... no 2024-04-04T06:59:49.104 INFO:teuthology.orchestra.run.smithi072.stdout:checking for uuid.h... no 2024-04-04T06:59:49.187 INFO:teuthology.orchestra.run.smithi072.stdout:checking uuid/uuid.h usability... yes 2024-04-04T06:59:49.215 INFO:teuthology.orchestra.run.smithi072.stdout:checking uuid/uuid.h presence... yes 2024-04-04T06:59:49.215 INFO:teuthology.orchestra.run.smithi072.stdout:checking for uuid/uuid.h... yes 2024-04-04T06:59:49.289 INFO:teuthology.orchestra.run.smithi072.stdout:checking sys/uuid.h usability... no 2024-04-04T06:59:49.322 INFO:teuthology.orchestra.run.smithi072.stdout:checking sys/uuid.h presence... no 2024-04-04T06:59:49.323 INFO:teuthology.orchestra.run.smithi072.stdout:checking for sys/uuid.h... no 2024-04-04T06:59:49.395 INFO:teuthology.orchestra.run.smithi072.stdout:checking sys/file.h usability... yes 2024-04-04T06:59:49.425 INFO:teuthology.orchestra.run.smithi072.stdout:checking sys/file.h presence... yes 2024-04-04T06:59:49.425 INFO:teuthology.orchestra.run.smithi072.stdout:checking for sys/file.h... yes 2024-04-04T06:59:49.520 INFO:teuthology.orchestra.run.smithi072.stdout:checking sys/fcntl.h usability... yes 2024-04-04T06:59:49.547 INFO:teuthology.orchestra.run.smithi072.stdout:checking sys/fcntl.h presence... yes 2024-04-04T06:59:49.547 INFO:teuthology.orchestra.run.smithi072.stdout:checking for sys/fcntl.h... yes 2024-04-04T06:59:49.618 INFO:teuthology.orchestra.run.smithi072.stdout:checking sys/syssgi.h usability... no 2024-04-04T06:59:49.657 INFO:teuthology.orchestra.run.smithi072.stdout:checking sys/syssgi.h presence... no 2024-04-04T06:59:49.657 INFO:teuthology.orchestra.run.smithi072.stdout:checking for sys/syssgi.h... no 2024-04-04T06:59:49.750 INFO:teuthology.orchestra.run.smithi072.stdout:checking sys/param.h usability... yes 2024-04-04T06:59:49.782 INFO:teuthology.orchestra.run.smithi072.stdout:checking sys/param.h presence... yes 2024-04-04T06:59:49.782 INFO:teuthology.orchestra.run.smithi072.stdout:checking for sys/param.h... yes 2024-04-04T06:59:49.800 INFO:teuthology.orchestra.run.smithi072.stdout:checking for sys/stat.h... (cached) yes 2024-04-04T06:59:49.867 INFO:teuthology.orchestra.run.smithi072.stdout:checking sys/statvfs.h usability... yes 2024-04-04T06:59:49.893 INFO:teuthology.orchestra.run.smithi072.stdout:checking sys/statvfs.h presence... yes 2024-04-04T06:59:49.893 INFO:teuthology.orchestra.run.smithi072.stdout:checking for sys/statvfs.h... yes 2024-04-04T06:59:49.962 INFO:teuthology.orchestra.run.smithi072.stdout:checking sys/time.h usability... yes 2024-04-04T06:59:49.984 INFO:teuthology.orchestra.run.smithi072.stdout:checking sys/time.h presence... yes 2024-04-04T06:59:49.985 INFO:teuthology.orchestra.run.smithi072.stdout:checking for sys/time.h... yes 2024-04-04T06:59:50.063 INFO:teuthology.orchestra.run.smithi072.stdout:checking sys/ioctl.h usability... yes 2024-04-04T06:59:50.089 INFO:teuthology.orchestra.run.smithi072.stdout:checking sys/ioctl.h presence... yes 2024-04-04T06:59:50.089 INFO:teuthology.orchestra.run.smithi072.stdout:checking for sys/ioctl.h... yes 2024-04-04T06:59:50.163 INFO:teuthology.orchestra.run.smithi072.stdout:checking sys/wait.h usability... yes 2024-04-04T06:59:50.192 INFO:teuthology.orchestra.run.smithi072.stdout:checking sys/wait.h presence... yes 2024-04-04T06:59:50.192 INFO:teuthology.orchestra.run.smithi072.stdout:checking for sys/wait.h... yes 2024-04-04T06:59:50.210 INFO:teuthology.orchestra.run.smithi072.stdout:checking for sys/types.h... (cached) yes 2024-04-04T06:59:50.226 INFO:teuthology.orchestra.run.smithi072.stdout:checking for strings.h... (cached) yes 2024-04-04T06:59:50.301 INFO:teuthology.orchestra.run.smithi072.stdout:checking err.h usability... yes 2024-04-04T06:59:50.327 INFO:teuthology.orchestra.run.smithi072.stdout:checking err.h presence... yes 2024-04-04T06:59:50.328 INFO:teuthology.orchestra.run.smithi072.stdout:checking for err.h... yes 2024-04-04T06:59:50.415 INFO:teuthology.orchestra.run.smithi072.stdout:checking linux/falloc.h usability... yes 2024-04-04T06:59:50.443 INFO:teuthology.orchestra.run.smithi072.stdout:checking linux/falloc.h presence... yes 2024-04-04T06:59:50.443 INFO:teuthology.orchestra.run.smithi072.stdout:checking for linux/falloc.h... yes 2024-04-04T06:59:50.514 INFO:teuthology.orchestra.run.smithi072.stdout:checking sys/fs/xfs_fsops.h usability... no 2024-04-04T06:59:50.554 INFO:teuthology.orchestra.run.smithi072.stdout:checking sys/fs/xfs_fsops.h presence... no 2024-04-04T06:59:50.555 INFO:teuthology.orchestra.run.smithi072.stdout:checking for sys/fs/xfs_fsops.h... no 2024-04-04T06:59:50.627 INFO:teuthology.orchestra.run.smithi072.stdout:checking sys/fs/xfs_itable.h usability... no 2024-04-04T06:59:50.664 INFO:teuthology.orchestra.run.smithi072.stdout:checking sys/fs/xfs_itable.h presence... no 2024-04-04T06:59:50.664 INFO:teuthology.orchestra.run.smithi072.stdout:checking for sys/fs/xfs_itable.h... no 2024-04-04T06:59:50.726 INFO:teuthology.orchestra.run.smithi072.stdout:checking xfs/platform_defs.h usability... no 2024-04-04T06:59:50.764 INFO:teuthology.orchestra.run.smithi072.stdout:checking xfs/platform_defs.h presence... no 2024-04-04T06:59:50.765 INFO:teuthology.orchestra.run.smithi072.stdout:checking for xfs/platform_defs.h... no 2024-04-04T06:59:50.826 INFO:teuthology.orchestra.run.smithi072.stdout:checking btrfs/ioctl.h usability... no 2024-04-04T06:59:50.864 INFO:teuthology.orchestra.run.smithi072.stdout:checking btrfs/ioctl.h presence... no 2024-04-04T06:59:50.865 INFO:teuthology.orchestra.run.smithi072.stdout:checking for btrfs/ioctl.h... no 2024-04-04T06:59:50.933 INFO:teuthology.orchestra.run.smithi072.stdout:checking cifs/ioctl.h usability... no 2024-04-04T06:59:50.973 INFO:teuthology.orchestra.run.smithi072.stdout:checking cifs/ioctl.h presence... no 2024-04-04T06:59:50.973 INFO:teuthology.orchestra.run.smithi072.stdout:checking for cifs/ioctl.h... no 2024-04-04T06:59:51.324 INFO:teuthology.orchestra.run.smithi072.stdout:checking sys/mman.h usability... yes 2024-04-04T06:59:51.353 INFO:teuthology.orchestra.run.smithi072.stdout:checking sys/mman.h presence... yes 2024-04-04T06:59:51.353 INFO:teuthology.orchestra.run.smithi072.stdout:checking for sys/mman.h... yes 2024-04-04T06:59:51.429 INFO:teuthology.orchestra.run.smithi072.stdout:checking linux/ext4.h usability... no 2024-04-04T06:59:51.465 INFO:teuthology.orchestra.run.smithi072.stdout:checking linux/ext4.h presence... no 2024-04-04T06:59:51.466 INFO:teuthology.orchestra.run.smithi072.stdout:checking for linux/ext4.h... no 2024-04-04T06:59:51.501 INFO:teuthology.orchestra.run.smithi072.stdout:checking for xfs/xfs_log_format.h... no 2024-04-04T06:59:51.580 INFO:teuthology.orchestra.run.smithi072.stdout:checking for uuid_compare... no 2024-04-04T06:59:51.654 INFO:teuthology.orchestra.run.smithi072.stdout:checking for uuid_compare in -luuid... yes 2024-04-04T06:59:51.893 INFO:teuthology.orchestra.run.smithi072.stdout:checking for xfs/xfs.h... yes 2024-04-04T06:59:51.938 INFO:teuthology.orchestra.run.smithi072.stdout:checking for xfs/libxfs.h... no 2024-04-04T06:59:51.987 INFO:teuthology.orchestra.run.smithi072.stdout:checking whether xlog_assign_lsn is declared... no 2024-04-04T06:59:52.054 INFO:teuthology.orchestra.run.smithi072.stdout:checking for xfs/xqm.h... yes 2024-04-04T06:59:52.172 INFO:teuthology.orchestra.run.smithi072.stdout:checking xfsctl from xfs/xfs.h... ok 2024-04-04T06:59:52.229 INFO:teuthology.orchestra.run.smithi072.stdout:checking xfs/handle.h usability... yes 2024-04-04T06:59:52.253 INFO:teuthology.orchestra.run.smithi072.stdout:checking xfs/handle.h presence... yes 2024-04-04T06:59:52.253 INFO:teuthology.orchestra.run.smithi072.stdout:checking for xfs/handle.h... yes 2024-04-04T06:59:52.335 INFO:teuthology.orchestra.run.smithi072.stdout:checking for attr_list_by_handle in -lhandle... yes 2024-04-04T06:59:52.397 INFO:teuthology.orchestra.run.smithi072.stdout:checking sys/acl.h usability... yes 2024-04-04T06:59:52.427 INFO:teuthology.orchestra.run.smithi072.stdout:checking sys/acl.h presence... yes 2024-04-04T06:59:52.427 INFO:teuthology.orchestra.run.smithi072.stdout:checking for sys/acl.h... yes 2024-04-04T06:59:52.481 INFO:teuthology.orchestra.run.smithi072.stdout:checking acl/libacl.h usability... yes 2024-04-04T06:59:52.507 INFO:teuthology.orchestra.run.smithi072.stdout:checking acl/libacl.h presence... yes 2024-04-04T06:59:52.507 INFO:teuthology.orchestra.run.smithi072.stdout:checking for acl/libacl.h... yes 2024-04-04T06:59:52.580 INFO:teuthology.orchestra.run.smithi072.stdout:checking for acl_init in -lacl... yes 2024-04-04T06:59:52.632 INFO:teuthology.orchestra.run.smithi072.stdout:checking gdbm-ndbm.h usability... no 2024-04-04T06:59:52.663 INFO:teuthology.orchestra.run.smithi072.stdout:checking gdbm-ndbm.h presence... no 2024-04-04T06:59:52.663 INFO:teuthology.orchestra.run.smithi072.stdout:checking for gdbm-ndbm.h... no 2024-04-04T06:59:52.714 INFO:teuthology.orchestra.run.smithi072.stdout:checking gdbm/ndbm.h usability... yes 2024-04-04T06:59:52.742 INFO:teuthology.orchestra.run.smithi072.stdout:checking gdbm/ndbm.h presence... yes 2024-04-04T06:59:52.742 INFO:teuthology.orchestra.run.smithi072.stdout:checking for gdbm/ndbm.h... yes 2024-04-04T06:59:52.827 INFO:teuthology.orchestra.run.smithi072.stdout:checking for dbm_open in -lgdbm... no 2024-04-04T06:59:52.911 INFO:teuthology.orchestra.run.smithi072.stdout:checking for dbm_fetch in -lgdbm... no 2024-04-04T06:59:52.993 INFO:teuthology.orchestra.run.smithi072.stdout:checking for dbm_store in -lgdbm... no 2024-04-04T06:59:53.086 INFO:teuthology.orchestra.run.smithi072.stdout:checking for dbm_close in -lgdbm... no 2024-04-04T06:59:53.171 INFO:teuthology.orchestra.run.smithi072.stdout:checking for dbm_open in -lgdbm_compat... yes 2024-04-04T06:59:53.247 INFO:teuthology.orchestra.run.smithi072.stdout:checking for dbm_fetch in -lgdbm_compat... yes 2024-04-04T06:59:53.323 INFO:teuthology.orchestra.run.smithi072.stdout:checking for dbm_store in -lgdbm_compat... yes 2024-04-04T06:59:53.403 INFO:teuthology.orchestra.run.smithi072.stdout:checking for dbm_close in -lgdbm_compat... yes 2024-04-04T06:59:53.464 INFO:teuthology.orchestra.run.smithi072.stdout:checking libaio.h usability... yes 2024-04-04T06:59:53.493 INFO:teuthology.orchestra.run.smithi072.stdout:checking libaio.h presence... yes 2024-04-04T06:59:53.494 INFO:teuthology.orchestra.run.smithi072.stdout:checking for libaio.h... yes 2024-04-04T06:59:53.552 INFO:teuthology.orchestra.run.smithi072.stdout:checking liburing.h usability... no 2024-04-04T06:59:53.587 INFO:teuthology.orchestra.run.smithi072.stdout:checking liburing.h presence... no 2024-04-04T06:59:53.588 INFO:teuthology.orchestra.run.smithi072.stdout:checking for liburing.h... no 2024-04-04T06:59:53.645 INFO:teuthology.orchestra.run.smithi072.stdout:checking sys/capability.h usability... yes 2024-04-04T06:59:53.674 INFO:teuthology.orchestra.run.smithi072.stdout:checking sys/capability.h presence... yes 2024-04-04T06:59:53.674 INFO:teuthology.orchestra.run.smithi072.stdout:checking for sys/capability.h... yes 2024-04-04T06:59:53.732 INFO:teuthology.orchestra.run.smithi072.stdout:checking linux/fiemap.h usability... yes 2024-04-04T06:59:53.752 INFO:teuthology.orchestra.run.smithi072.stdout:checking linux/fiemap.h presence... yes 2024-04-04T06:59:53.752 INFO:teuthology.orchestra.run.smithi072.stdout:checking for linux/fiemap.h... yes 2024-04-04T06:59:53.828 INFO:teuthology.orchestra.run.smithi072.stdout:checking for fallocate... yes 2024-04-04T06:59:53.905 INFO:teuthology.orchestra.run.smithi072.stdout:checking for open_by_handle_at... yes 2024-04-04T06:59:53.970 INFO:teuthology.orchestra.run.smithi072.stdout:checking linux/fs.h usability... yes 2024-04-04T06:59:53.996 INFO:teuthology.orchestra.run.smithi072.stdout:checking linux/fs.h presence... yes 2024-04-04T06:59:53.997 INFO:teuthology.orchestra.run.smithi072.stdout:checking for linux/fs.h... yes 2024-04-04T06:59:54.052 INFO:teuthology.orchestra.run.smithi072.stdout:checking btrfsutil.h usability... no 2024-04-04T06:59:54.085 INFO:teuthology.orchestra.run.smithi072.stdout:checking btrfsutil.h presence... no 2024-04-04T06:59:54.085 INFO:teuthology.orchestra.run.smithi072.stdout:checking for btrfsutil.h... no 2024-04-04T06:59:54.159 INFO:teuthology.orchestra.run.smithi072.stdout:checking for copy_file_range... yes 2024-04-04T06:59:54.246 INFO:teuthology.orchestra.run.smithi072.stdout:checking for SEEK_DATA... yes 2024-04-04T06:59:54.347 INFO:teuthology.orchestra.run.smithi072.stdout:checking for BMV_OF_SHARED... yes 2024-04-04T06:59:54.437 INFO:teuthology.orchestra.run.smithi072.stdout:checking for nftw... yes 2024-04-04T06:59:54.529 INFO:teuthology.orchestra.run.smithi072.stdout:checking for RLIMIT_NOFILE... yes 2024-04-04T06:59:54.604 INFO:teuthology.orchestra.run.smithi072.stdout:checking for XFS_IOC_EXCHANGE_RANGE... no 2024-04-04T06:59:54.684 INFO:teuthology.orchestra.run.smithi072.stdout:checking for FICLONE... yes 2024-04-04T06:59:54.762 INFO:teuthology.orchestra.run.smithi072.stdout:checking for renameat2... yes 2024-04-04T06:59:54.842 INFO:teuthology.orchestra.run.smithi072.stdout:checking for reallocarray... yes 2024-04-04T06:59:54.935 INFO:teuthology.orchestra.run.smithi072.stdout:checking for struct mount_attr... yes 2024-04-04T06:59:55.044 INFO:teuthology.orchestra.run.smithi072.stdout:checking for struct btrfs_qgroup_limit... yes 2024-04-04T06:59:55.136 INFO:teuthology.orchestra.run.smithi072.stdout:checking for struct btrfs_qgroup_inherit... yes 2024-04-04T06:59:55.223 INFO:teuthology.orchestra.run.smithi072.stdout:checking for struct btrfs_ioctl_vol_args... yes 2024-04-04T06:59:55.312 INFO:teuthology.orchestra.run.smithi072.stdout:checking for struct btrfs_ioctl_vol_args_v2... yes 2024-04-04T06:59:55.418 INFO:teuthology.orchestra.run.smithi072.stdout:checking for struct btrfs_ioctl_ino_lookup_args... yes 2024-04-04T06:59:55.519 INFO:teuthology.orchestra.run.smithi072.stdout:checking for struct btrfs_ioctl_ino_lookup_user_args... yes 2024-04-04T06:59:55.614 INFO:teuthology.orchestra.run.smithi072.stdout:checking for struct btrfs_ioctl_get_subvol_rootref_args... yes 2024-04-04T06:59:55.680 INFO:teuthology.orchestra.run.smithi072.stdout:checking linux/btrfs.h usability... yes 2024-04-04T06:59:55.707 INFO:teuthology.orchestra.run.smithi072.stdout:checking linux/btrfs.h presence... yes 2024-04-04T06:59:55.707 INFO:teuthology.orchestra.run.smithi072.stdout:checking for linux/btrfs.h... yes 2024-04-04T06:59:55.786 INFO:teuthology.orchestra.run.smithi072.stdout:checking linux/btrfs_tree.h usability... yes 2024-04-04T06:59:55.814 INFO:teuthology.orchestra.run.smithi072.stdout:checking linux/btrfs_tree.h presence... yes 2024-04-04T06:59:55.814 INFO:teuthology.orchestra.run.smithi072.stdout:checking for linux/btrfs_tree.h... yes 2024-04-04T06:59:55.875 INFO:teuthology.orchestra.run.smithi072.stdout:checking for struct btrfs_ioctl_vol_args_v2.subvolid... yes 2024-04-04T06:59:55.945 INFO:teuthology.orchestra.run.smithi072.stdout:checking whether BTRFS_IOC_SNAP_DESTROY_V2 is declared... yes 2024-04-04T06:59:55.982 INFO:teuthology.orchestra.run.smithi072.stdout:configure: creating ./config.status 2024-04-04T06:59:57.095 INFO:teuthology.orchestra.run.smithi072.stdout:config.status: creating include/builddefs 2024-04-04T06:59:57.127 INFO:teuthology.orchestra.run.smithi072.stdout:config.status: creating include/config.h 2024-04-04T06:59:57.152 INFO:teuthology.orchestra.run.smithi072.stdout:config.status: executing libtool commands 2024-04-04T06:59:57.238 INFO:teuthology.orchestra.run.smithi072.stdout:Building include 2024-04-04T06:59:57.247 INFO:teuthology.orchestra.run.smithi072.stdout:Building lib 2024-04-04T06:59:57.255 INFO:teuthology.orchestra.run.smithi072.stdout: [LTDEP] 2024-04-04T06:59:57.578 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] dataascii.lo 2024-04-04T06:59:57.812 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] databin.lo 2024-04-04T06:59:58.092 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] datapid.lo 2024-04-04T06:59:58.351 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] file_lock.lo 2024-04-04T06:59:58.625 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] forker.lo 2024-04-04T06:59:58.893 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] pattern.lo 2024-04-04T06:59:59.122 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] open_flags.lo 2024-04-04T06:59:59.381 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] random_range.lo 2024-04-04T06:59:59.746 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] string_to_tokens.lo 2024-04-04T06:59:59.968 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] str_to_bytes.lo 2024-04-04T07:00:00.243 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] tlibio.lo 2024-04-04T07:00:00.630 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] write_log.lo 2024-04-04T07:00:01.009 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] random.lo 2024-04-04T07:00:01.225 INFO:teuthology.orchestra.run.smithi072.stdout: [LD] 2024-04-04T07:00:01.428 INFO:teuthology.orchestra.run.smithi072.stdout:Building ltp 2024-04-04T07:00:01.437 INFO:teuthology.orchestra.run.smithi072.stdout: [DEP] 2024-04-04T07:00:01.749 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] doio 2024-04-04T07:00:02.695 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] fsstress 2024-04-04T07:00:04.394 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] fsx 2024-04-04T07:00:05.283 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] growfiles 2024-04-04T07:00:05.941 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] iogen 2024-04-04T07:00:06.467 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] aio-stress 2024-04-04T07:00:07.044 INFO:teuthology.orchestra.run.smithi072.stdout:Building src 2024-04-04T07:00:07.058 INFO:teuthology.orchestra.run.smithi072.stdout: [DEP] 2024-04-04T07:00:10.920 INFO:teuthology.orchestra.run.smithi072.stdout: [DEP] 2024-04-04T07:00:10.984 INFO:teuthology.orchestra.run.smithi072.stdout: [DEP] 2024-04-04T07:00:11.002 INFO:teuthology.orchestra.run.smithi072.stdout: [DEP] 2024-04-04T07:00:11.476 INFO:teuthology.orchestra.run.smithi072.stdout: [DEP] 2024-04-04T07:00:11.527 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] dirstress 2024-04-04T07:00:11.904 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] fill 2024-04-04T07:00:12.210 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] fill2 2024-04-04T07:00:12.656 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] getpagesize 2024-04-04T07:00:12.927 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] holes 2024-04-04T07:00:13.266 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] lstat64 2024-04-04T07:00:13.632 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] nametest 2024-04-04T07:00:14.051 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] permname 2024-04-04T07:00:14.387 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] randholes 2024-04-04T07:00:14.776 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] runas 2024-04-04T07:00:15.177 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] truncfile 2024-04-04T07:00:15.311 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T07:00:15.319 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T07:00:15.531 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] usemem 2024-04-04T07:00:15.835 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] mmapcat 2024-04-04T07:00:16.118 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] append_reader 2024-04-04T07:00:16.396 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] append_writer 2024-04-04T07:00:16.668 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] dirperf 2024-04-04T07:00:17.034 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] metaperf 2024-04-04T07:00:17.442 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] devzero 2024-04-04T07:00:17.765 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] feature 2024-04-04T07:00:18.117 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] alloc 2024-04-04T07:00:18.467 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] fault 2024-04-04T07:00:18.795 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] fstest 2024-04-04T07:00:19.166 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] t_access_root 2024-04-04T07:00:19.470 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] godown 2024-04-04T07:00:19.869 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] resvtest 2024-04-04T07:00:20.222 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] writemod 2024-04-04T07:00:20.516 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] writev_on_pagefault 2024-04-04T07:00:20.803 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] makeextents 2024-04-04T07:00:21.124 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] itrash 2024-04-04T07:00:21.414 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] rename 2024-04-04T07:00:21.698 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] multi_open_unlink 2024-04-04T07:00:22.005 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] unwritten_sync 2024-04-04T07:00:22.329 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] genhashnames 2024-04-04T07:00:22.671 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] t_holes 2024-04-04T07:00:22.957 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] t_mmap_writev 2024-04-04T07:00:23.256 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] t_truncate_cmtime 2024-04-04T07:00:23.556 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] dirhash_collide 2024-04-04T07:00:23.906 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] t_rename_overwrite 2024-04-04T07:00:24.183 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] holetest 2024-04-04T07:00:24.550 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] t_truncate_self 2024-04-04T07:00:24.817 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] af_unix 2024-04-04T07:00:25.103 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] t_mmap_stale_pmd 2024-04-04T07:00:25.382 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] t_mmap_cow_race 2024-04-04T07:00:25.678 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] t_mmap_fallocate 2024-04-04T07:00:25.943 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] fsync-err 2024-04-04T07:00:26.250 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] t_mmap_write_ro 2024-04-04T07:00:26.597 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] t_ext4_dax_journal_corruption 2024-04-04T07:00:26.929 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] t_ext4_dax_inline_corruption 2024-04-04T07:00:27.254 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] t_ofd_locks 2024-04-04T07:00:27.605 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] t_mmap_collision 2024-04-04T07:00:27.957 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] mmap-write-concurrent 2024-04-04T07:00:28.296 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] t_get_file_time 2024-04-04T07:00:28.577 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] t_create_short_dirs 2024-04-04T07:00:28.944 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] t_create_long_dirs 2024-04-04T07:00:29.234 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] t_enospc 2024-04-04T07:00:29.575 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] t_mmap_writev_overlap 2024-04-04T07:00:29.950 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] checkpoint_journal 2024-04-04T07:00:30.251 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] mmap-rw-fault 2024-04-04T07:00:30.623 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] allocstale 2024-04-04T07:00:30.915 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] t_mmap_cow_memory_failure 2024-04-04T07:00:31.214 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] fake-dump-rootino 2024-04-04T07:00:31.505 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] dio-buf-fault 2024-04-04T07:00:31.776 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] rewinddir-test 2024-04-04T07:00:32.075 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] readdir-while-renames 2024-04-04T07:00:32.354 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] xfsctl 2024-04-04T07:00:32.685 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] bstat 2024-04-04T07:00:33.044 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] t_mtab 2024-04-04T07:00:33.375 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] getdevicesize 2024-04-04T07:00:33.638 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] preallo_rw_pattern_reader 2024-04-04T07:00:33.929 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] preallo_rw_pattern_writer 2024-04-04T07:00:34.245 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] ftrunc 2024-04-04T07:00:34.508 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] trunc 2024-04-04T07:00:34.788 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] fs_perms 2024-04-04T07:00:35.090 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] testx 2024-04-04T07:00:35.441 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] looptest 2024-04-04T07:00:35.781 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] locktest 2024-04-04T07:00:36.300 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] unwritten_mmap 2024-04-04T07:00:36.612 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] bulkstat_unlink_test 2024-04-04T07:00:36.944 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] deduperace 2024-04-04T07:00:37.276 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] bulkstat_unlink_test_modified 2024-04-04T07:00:37.614 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] t_dir_offset 2024-04-04T07:00:37.931 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] t_futimens 2024-04-04T07:00:38.185 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] t_immutable 2024-04-04T07:00:39.004 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] stale_handle 2024-04-04T07:00:39.412 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] pwrite_mmap_blocked 2024-04-04T07:00:39.741 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] t_dir_offset2 2024-04-04T07:00:40.059 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] seek_sanity_test 2024-04-04T07:00:40.643 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] seek_copy_test 2024-04-04T07:00:40.945 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] t_readdir_1 2024-04-04T07:00:41.216 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] t_readdir_2 2024-04-04T07:00:41.494 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] fsync-tester 2024-04-04T07:00:41.890 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] nsexec 2024-04-04T07:00:42.219 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] cloner 2024-04-04T07:00:42.529 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] renameat2 2024-04-04T07:00:42.829 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] t_getcwd 2024-04-04T07:00:43.112 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] e4compact 2024-04-04T07:00:43.449 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] test-nextquota 2024-04-04T07:00:43.781 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] punch-alternating 2024-04-04T07:00:44.077 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] attr-list-by-handle-cursor-test 2024-04-04T07:00:44.375 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] listxattr 2024-04-04T07:00:44.644 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] dio-interleaved 2024-04-04T07:00:44.946 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] t_dir_type 2024-04-04T07:00:45.259 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] dio-invalidate-cache 2024-04-04T07:00:45.452 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T07:00:45.459 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T07:00:45.652 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] stat_test 2024-04-04T07:00:46.087 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] t_encrypted_d_revalidate 2024-04-04T07:00:46.387 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] attr_replace_test 2024-04-04T07:00:46.671 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] swapon 2024-04-04T07:00:46.951 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] mkswap 2024-04-04T07:00:47.221 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] t_attr_corruption 2024-04-04T07:00:47.503 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] t_open_tmpfiles 2024-04-04T07:00:47.847 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] fscrypt-crypt-util 2024-04-04T07:00:48.715 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] bulkstat_null_ocount 2024-04-04T07:00:49.020 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] splice-test 2024-04-04T07:00:49.356 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] chprojid_fail 2024-04-04T07:00:49.667 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] detached_mounts_propagation 2024-04-04T07:00:49.979 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] ext4_resize 2024-04-04T07:00:50.263 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] t_readdir_3 2024-04-04T07:00:50.603 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] splice2pipe 2024-04-04T07:00:50.893 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] uuid_ioctl 2024-04-04T07:00:51.172 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] t_snapshot_deleted_subvolume 2024-04-04T07:00:51.456 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] fiemap-tester 2024-04-04T07:00:51.897 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] t_stripealign 2024-04-04T07:00:52.194 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] open_by_handle 2024-04-04T07:00:52.579 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] dbtest 2024-04-04T07:00:52.975 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] t_mmap_dio 2024-04-04T07:00:53.257 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] xfsfind 2024-04-04T07:00:53.636 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] t_reflink_read_race 2024-04-04T07:00:53.970 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] fssum 2024-04-04T07:00:54.626 INFO:teuthology.orchestra.run.smithi072.stdout:Building log-writes 2024-04-04T07:00:54.638 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] replay-log 2024-04-04T07:00:55.117 INFO:teuthology.orchestra.run.smithi072.stdout:Building perf 2024-04-04T07:00:55.127 INFO:teuthology.orchestra.run.smithi072.stdout:Building aio-dio-regress 2024-04-04T07:00:55.141 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] aiocp 2024-04-04T07:00:55.508 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] aio-dio-append-write-fallocate-race 2024-04-04T07:00:55.826 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] aio-dio-append-write-read-race 2024-04-04T07:00:56.143 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] aio-dio-cow-race 2024-04-04T07:00:56.453 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] aio-dio-cycle-write 2024-04-04T07:00:56.788 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] aio-dio-eof-race 2024-04-04T07:00:57.149 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] aio-dio-extend-stat 2024-04-04T07:00:57.439 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] aio-dio-fcntl-race 2024-04-04T07:00:57.730 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] aio-dio-hole-filling-race 2024-04-04T07:00:58.005 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] aio-dio-invalidate-failure 2024-04-04T07:00:58.304 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] aio-dio-invalidate-readahead 2024-04-04T07:00:58.664 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] aiodio_sparse2 2024-04-04T07:00:59.059 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] aio-dio-subblock-eof-read 2024-04-04T07:00:59.359 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] aio-dio-write-verify 2024-04-04T07:00:59.702 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] aio-free-ring-with-bogus-nr-pages 2024-04-04T07:00:59.998 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] aio-io-setup-with-nonwritable-context-pointer 2024-04-04T07:01:00.258 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] aio-last-ref-held-by-io 2024-04-04T07:01:00.559 INFO:teuthology.orchestra.run.smithi072.stdout:Building vfs 2024-04-04T07:01:00.573 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] vfstest 2024-04-04T07:01:04.862 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] mount-idmapped 2024-04-04T07:01:05.443 INFO:teuthology.orchestra.run.smithi072.stdout:Building m4 2024-04-04T07:01:05.453 INFO:teuthology.orchestra.run.smithi072.stdout:Building common 2024-04-04T07:01:05.462 INFO:teuthology.orchestra.run.smithi072.stdout:Building tests 2024-04-04T07:01:05.477 INFO:teuthology.orchestra.run.smithi072.stdout:Building btrfs 2024-04-04T07:01:05.492 INFO:teuthology.orchestra.run.smithi072.stdout: [GROUP] /tmp/tmp.tiFz9P8iUAxfstests-dev/tests/btrfs/group.list 2024-04-04T07:01:05.703 INFO:teuthology.orchestra.run.smithi072.stdout:Building ceph 2024-04-04T07:01:05.717 INFO:teuthology.orchestra.run.smithi072.stdout: [GROUP] /tmp/tmp.tiFz9P8iUAxfstests-dev/tests/ceph/group.list 2024-04-04T07:01:05.773 INFO:teuthology.orchestra.run.smithi072.stdout:Building cifs 2024-04-04T07:01:05.787 INFO:teuthology.orchestra.run.smithi072.stdout: [GROUP] /tmp/tmp.tiFz9P8iUAxfstests-dev/tests/cifs/group.list 2024-04-04T07:01:05.833 INFO:teuthology.orchestra.run.smithi072.stdout:Building ext4 2024-04-04T07:01:05.847 INFO:teuthology.orchestra.run.smithi072.stdout: [GROUP] /tmp/tmp.tiFz9P8iUAxfstests-dev/tests/ext4/group.list 2024-04-04T07:01:05.994 INFO:teuthology.orchestra.run.smithi072.stdout:Building f2fs 2024-04-04T07:01:06.008 INFO:teuthology.orchestra.run.smithi072.stdout: [GROUP] /tmp/tmp.tiFz9P8iUAxfstests-dev/tests/f2fs/group.list 2024-04-04T07:01:06.068 INFO:teuthology.orchestra.run.smithi072.stdout:Building generic 2024-04-04T07:01:06.086 INFO:teuthology.orchestra.run.smithi072.stdout: [GROUP] /tmp/tmp.tiFz9P8iUAxfstests-dev/tests/generic/group.list 2024-04-04T07:01:06.442 INFO:teuthology.orchestra.run.smithi072.stdout:Building nfs 2024-04-04T07:01:06.456 INFO:teuthology.orchestra.run.smithi072.stdout: [GROUP] /tmp/tmp.tiFz9P8iUAxfstests-dev/tests/nfs/group.list 2024-04-04T07:01:06.507 INFO:teuthology.orchestra.run.smithi072.stdout:Building ocfs2 2024-04-04T07:01:06.519 INFO:teuthology.orchestra.run.smithi072.stdout: [GROUP] /tmp/tmp.tiFz9P8iUAxfstests-dev/tests/ocfs2/group.list 2024-04-04T07:01:06.561 INFO:teuthology.orchestra.run.smithi072.stdout:Building overlay 2024-04-04T07:01:06.575 INFO:teuthology.orchestra.run.smithi072.stdout: [GROUP] /tmp/tmp.tiFz9P8iUAxfstests-dev/tests/overlay/group.list 2024-04-04T07:01:06.720 INFO:teuthology.orchestra.run.smithi072.stdout:Building perf 2024-04-04T07:01:06.734 INFO:teuthology.orchestra.run.smithi072.stdout: [GROUP] /tmp/tmp.tiFz9P8iUAxfstests-dev/tests/perf/group.list 2024-04-04T07:01:06.774 INFO:teuthology.orchestra.run.smithi072.stdout:Building selftest 2024-04-04T07:01:06.787 INFO:teuthology.orchestra.run.smithi072.stdout: [GROUP] /tmp/tmp.tiFz9P8iUAxfstests-dev/tests/selftest/group.list 2024-04-04T07:01:06.829 INFO:teuthology.orchestra.run.smithi072.stdout:Building shared 2024-04-04T07:01:06.842 INFO:teuthology.orchestra.run.smithi072.stdout: [GROUP] /tmp/tmp.tiFz9P8iUAxfstests-dev/tests/shared/group.list 2024-04-04T07:01:06.910 INFO:teuthology.orchestra.run.smithi072.stdout:Building tmpfs 2024-04-04T07:01:06.924 INFO:teuthology.orchestra.run.smithi072.stdout: [GROUP] /tmp/tmp.tiFz9P8iUAxfstests-dev/tests/tmpfs/group.list 2024-04-04T07:01:06.971 INFO:teuthology.orchestra.run.smithi072.stdout:Building udf 2024-04-04T07:01:06.987 INFO:teuthology.orchestra.run.smithi072.stdout: [GROUP] /tmp/tmp.tiFz9P8iUAxfstests-dev/tests/udf/group.list 2024-04-04T07:01:07.024 INFO:teuthology.orchestra.run.smithi072.stdout:Building xfs 2024-04-04T07:01:07.040 INFO:teuthology.orchestra.run.smithi072.stdout: [GROUP] /tmp/tmp.tiFz9P8iUAxfstests-dev/tests/xfs/group.list 2024-04-04T07:01:07.375 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo make install) 2024-04-04T07:01:07.495 INFO:teuthology.orchestra.run.smithi072.stdout:Building include 2024-04-04T07:01:07.504 INFO:teuthology.orchestra.run.smithi072.stdout:Building lib 2024-04-04T07:01:07.515 INFO:teuthology.orchestra.run.smithi072.stdout:Building ltp 2024-04-04T07:01:07.526 INFO:teuthology.orchestra.run.smithi072.stdout:Building src 2024-04-04T07:01:07.608 INFO:teuthology.orchestra.run.smithi072.stdout:Building log-writes 2024-04-04T07:01:07.617 INFO:teuthology.orchestra.run.smithi072.stdout:Building perf 2024-04-04T07:01:07.627 INFO:teuthology.orchestra.run.smithi072.stdout:Building aio-dio-regress 2024-04-04T07:01:07.637 INFO:teuthology.orchestra.run.smithi072.stdout:Building vfs 2024-04-04T07:01:07.648 INFO:teuthology.orchestra.run.smithi072.stdout:Building m4 2024-04-04T07:01:07.657 INFO:teuthology.orchestra.run.smithi072.stdout:Building common 2024-04-04T07:01:07.666 INFO:teuthology.orchestra.run.smithi072.stdout:Building tests 2024-04-04T07:01:07.678 INFO:teuthology.orchestra.run.smithi072.stdout:Building btrfs 2024-04-04T07:01:07.693 INFO:teuthology.orchestra.run.smithi072.stdout: [GROUP] /tmp/tmp.tiFz9P8iUAxfstests-dev/tests/btrfs/group.list 2024-04-04T07:01:07.914 INFO:teuthology.orchestra.run.smithi072.stdout:Building ceph 2024-04-04T07:01:07.927 INFO:teuthology.orchestra.run.smithi072.stdout: [GROUP] /tmp/tmp.tiFz9P8iUAxfstests-dev/tests/ceph/group.list 2024-04-04T07:01:07.976 INFO:teuthology.orchestra.run.smithi072.stdout:Building cifs 2024-04-04T07:01:07.988 INFO:teuthology.orchestra.run.smithi072.stdout: [GROUP] /tmp/tmp.tiFz9P8iUAxfstests-dev/tests/cifs/group.list 2024-04-04T07:01:08.034 INFO:teuthology.orchestra.run.smithi072.stdout:Building ext4 2024-04-04T07:01:08.048 INFO:teuthology.orchestra.run.smithi072.stdout: [GROUP] /tmp/tmp.tiFz9P8iUAxfstests-dev/tests/ext4/group.list 2024-04-04T07:01:08.179 INFO:teuthology.orchestra.run.smithi072.stdout:Building f2fs 2024-04-04T07:01:08.192 INFO:teuthology.orchestra.run.smithi072.stdout: [GROUP] /tmp/tmp.tiFz9P8iUAxfstests-dev/tests/f2fs/group.list 2024-04-04T07:01:08.246 INFO:teuthology.orchestra.run.smithi072.stdout:Building generic 2024-04-04T07:01:08.262 INFO:teuthology.orchestra.run.smithi072.stdout: [GROUP] /tmp/tmp.tiFz9P8iUAxfstests-dev/tests/generic/group.list 2024-04-04T07:01:08.634 INFO:teuthology.orchestra.run.smithi072.stdout:Building nfs 2024-04-04T07:01:08.648 INFO:teuthology.orchestra.run.smithi072.stdout: [GROUP] /tmp/tmp.tiFz9P8iUAxfstests-dev/tests/nfs/group.list 2024-04-04T07:01:08.699 INFO:teuthology.orchestra.run.smithi072.stdout:Building ocfs2 2024-04-04T07:01:08.713 INFO:teuthology.orchestra.run.smithi072.stdout: [GROUP] /tmp/tmp.tiFz9P8iUAxfstests-dev/tests/ocfs2/group.list 2024-04-04T07:01:08.759 INFO:teuthology.orchestra.run.smithi072.stdout:Building overlay 2024-04-04T07:01:08.773 INFO:teuthology.orchestra.run.smithi072.stdout: [GROUP] /tmp/tmp.tiFz9P8iUAxfstests-dev/tests/overlay/group.list 2024-04-04T07:01:08.910 INFO:teuthology.orchestra.run.smithi072.stdout:Building perf 2024-04-04T07:01:08.923 INFO:teuthology.orchestra.run.smithi072.stdout: [GROUP] /tmp/tmp.tiFz9P8iUAxfstests-dev/tests/perf/group.list 2024-04-04T07:01:08.968 INFO:teuthology.orchestra.run.smithi072.stdout:Building selftest 2024-04-04T07:01:08.981 INFO:teuthology.orchestra.run.smithi072.stdout: [GROUP] /tmp/tmp.tiFz9P8iUAxfstests-dev/tests/selftest/group.list 2024-04-04T07:01:09.025 INFO:teuthology.orchestra.run.smithi072.stdout:Building shared 2024-04-04T07:01:09.038 INFO:teuthology.orchestra.run.smithi072.stdout: [GROUP] /tmp/tmp.tiFz9P8iUAxfstests-dev/tests/shared/group.list 2024-04-04T07:01:09.094 INFO:teuthology.orchestra.run.smithi072.stdout:Building tmpfs 2024-04-04T07:01:09.108 INFO:teuthology.orchestra.run.smithi072.stdout: [GROUP] /tmp/tmp.tiFz9P8iUAxfstests-dev/tests/tmpfs/group.list 2024-04-04T07:01:09.153 INFO:teuthology.orchestra.run.smithi072.stdout:Building udf 2024-04-04T07:01:09.166 INFO:teuthology.orchestra.run.smithi072.stdout: [GROUP] /tmp/tmp.tiFz9P8iUAxfstests-dev/tests/udf/group.list 2024-04-04T07:01:09.206 INFO:teuthology.orchestra.run.smithi072.stdout:Building xfs 2024-04-04T07:01:09.221 INFO:teuthology.orchestra.run.smithi072.stdout: [GROUP] /tmp/tmp.tiFz9P8iUAxfstests-dev/tests/xfs/group.list 2024-04-04T07:01:09.595 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/gmake --no-print-directory Q=@ -C include install 2024-04-04T07:01:09.600 INFO:teuthology.orchestra.run.smithi072.stdout:gmake[1]: Nothing to be done for 'install'. 2024-04-04T07:01:09.600 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/gmake --no-print-directory Q=@ -C lib install 2024-04-04T07:01:09.605 INFO:teuthology.orchestra.run.smithi072.stdout:gmake[1]: Nothing to be done for 'install'. 2024-04-04T07:01:09.605 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/gmake --no-print-directory Q=@ -C ltp install 2024-04-04T07:01:09.610 INFO:teuthology.orchestra.run.smithi072.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/ltp 2024-04-04T07:01:09.638 INFO:teuthology.orchestra.run.smithi072.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 doio fsstress fsx growfiles iogen aio-stress /var/lib/xfstests/ltp 2024-04-04T07:01:09.843 INFO:teuthology.orchestra.run.smithi072.stdout:../install-sh -o root -g root -m 755 rwtest.sh /var/lib/xfstests/ltp 2024-04-04T07:01:09.873 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/gmake --no-print-directory Q=@ -C src install 2024-04-04T07:01:09.915 INFO:teuthology.orchestra.run.smithi072.stdout:Building log-writes 2024-04-04T07:01:09.925 INFO:teuthology.orchestra.run.smithi072.stdout:Building perf 2024-04-04T07:01:09.936 INFO:teuthology.orchestra.run.smithi072.stdout:Building aio-dio-regress 2024-04-04T07:01:09.947 INFO:teuthology.orchestra.run.smithi072.stdout:Building vfs 2024-04-04T07:01:09.954 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/gmake -C log-writes install 2024-04-04T07:01:09.958 INFO:teuthology.orchestra.run.smithi072.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/log-writes 2024-04-04T07:01:09.989 INFO:teuthology.orchestra.run.smithi072.stdout:../../install-sh -o root -g root -m 755 replay-log /var/lib/xfstests/src/log-writes 2024-04-04T07:01:10.017 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/gmake -C perf install 2024-04-04T07:01:10.021 INFO:teuthology.orchestra.run.smithi072.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/perf 2024-04-04T07:01:10.046 INFO:teuthology.orchestra.run.smithi072.stdout:../../install-sh -o root -g root -m 755 FioCompare.py fio-insert-and-compare.py FioResultDecoder.py generate-schema.py ResultData.py fio-results.sql /var/lib/xfstests/src/perf 2024-04-04T07:01:10.118 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/gmake -C aio-dio-regress install 2024-04-04T07:01:10.122 INFO:teuthology.orchestra.run.smithi072.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/aio-dio-regress 2024-04-04T07:01:10.147 INFO:teuthology.orchestra.run.smithi072.stdout:../../install-sh -o root -g root -m 755 aiocp aio-dio-append-write-fallocate-race aio-dio-append-write-read-race aio-dio-cow-race aio-dio-cycle-write aio-dio-eof-race aio-dio-extend-stat aio-dio-fcntl-race aio-dio-hole-filling-race aio-dio-invalidate-failure aio-dio-invalidate-readahead aiodio_sparse2 aio-dio-subblock-eof-read aio-dio-write-verify aio-free-ring-with-bogus-nr-pages aio-io-setup-with-nonwritable-context-pointer aio-last-ref-held-by-io /var/lib/xfstests/src/aio-dio-regress 2024-04-04T07:01:10.318 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/gmake -C vfs install 2024-04-04T07:01:10.321 INFO:teuthology.orchestra.run.smithi072.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/vfs 2024-04-04T07:01:10.353 INFO:teuthology.orchestra.run.smithi072.stdout:../../install-sh -o root -g root -m 755 vfstest mount-idmapped /var/lib/xfstests/src/vfs 2024-04-04T07:01:10.394 INFO:teuthology.orchestra.run.smithi072.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src 2024-04-04T07:01:10.422 INFO:teuthology.orchestra.run.smithi072.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dirstress fill fill2 getpagesize holes lstat64 nametest permname randholes runas truncfile usemem mmapcat append_reader append_writer dirperf metaperf devzero feature alloc fault fstest t_access_root godown resvtest writemod writev_on_pagefault makeextents itrash rename multi_open_unlink unwritten_sync genhashnames t_holes t_mmap_writev t_truncate_cmtime dirhash_collide t_rename_overwrite holetest t_truncate_self af_unix t_mmap_stale_pmd t_mmap_cow_race t_mmap_fallocate fsync-err t_mmap_write_ro t_ext4_dax_journal_corruption t_ext4_dax_inline_corruption t_ofd_locks t_mmap_collision mmap-write-concurrent t_get_file_time t_create_short_dirs t_create_long_dirs t_enospc t_mmap_writev_overlap checkpoint_journal mmap-rw-fault allocstale t_mmap_cow_memory_failure fake-dump-rootino dio-buf-fault rewinddir-test readdir-while-renames xfsctl bstat t_mtab getdevicesize preallo_rw_pattern_reader preallo_rw_pattern_writer ftrunc trunc fs_perms testx looptest locktest unwritten_mmap bulkstat_unlink_test deduperace bulkstat_unlink_test_modified t_dir_offset t_futimens t_immutable stale_handle pwrite_mmap_blocked t_dir_offset2 seek_sanity_test seek_copy_test t_readdir_1 t_readdir_2 fsync-tester nsexec cloner renameat2 t_getcwd e4compact test-nextquota punch-alternating attr-list-by-handle-cursor-test listxattr dio-interleaved t_dir_type dio-invalidate-cache stat_test t_encrypted_d_revalidate attr_replace_test swapon mkswap t_attr_corruption t_open_tmpfiles fscrypt-crypt-util bulkstat_null_ocount splice-test chprojid_fail detached_mounts_propagation ext4_resize t_readdir_3 splice2pipe uuid_ioctl t_snapshot_deleted_subvolume fiemap-tester t_stripealign open_by_handle dbtest t_mmap_dio xfsfind t_reflink_read_race fssum /var/lib/xfstests/src 2024-04-04T07:01:14.519 INFO:teuthology.orchestra.run.smithi072.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dmerror fill2attr fill2fs fill2fs_check scaleread.sh btrfs_crc32c_forged_name.py popdir.pl popattr.py soak_duration.awk /var/lib/xfstests/src 2024-04-04T07:01:14.849 INFO:teuthology.orchestra.run.smithi072.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 644 dumpfile /var/lib/xfstests/src 2024-04-04T07:01:14.906 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/gmake --no-print-directory Q=@ -C m4 install 2024-04-04T07:01:14.910 INFO:teuthology.orchestra.run.smithi072.stdout:gmake[1]: Nothing to be done for 'install'. 2024-04-04T07:01:14.910 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/gmake --no-print-directory Q=@ -C common install 2024-04-04T07:01:14.913 INFO:teuthology.orchestra.run.smithi072.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/common 2024-04-04T07:01:14.941 INFO:teuthology.orchestra.run.smithi072.stdout:../install-sh -o root -g root -m 644 * /var/lib/xfstests/common 2024-04-04T07:01:15.408 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/gmake --no-print-directory Q=@ -C tests install 2024-04-04T07:01:15.411 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.tiFz9P8iUAxfstests-dev/tests/btrfs/ install 2024-04-04T07:01:15.419 INFO:teuthology.orchestra.run.smithi072.stdout: [GROUP] /tmp/tmp.tiFz9P8iUAxfstests-dev/tests/btrfs/group.list 2024-04-04T07:01:15.593 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T07:01:15.598 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T07:01:15.623 INFO:teuthology.orchestra.run.smithi072.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/btrfs 2024-04-04T07:01:15.646 INFO:teuthology.orchestra.run.smithi072.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 320 /var/lib/xfstests/tests/btrfs 2024-04-04T07:01:18.809 INFO:teuthology.orchestra.run.smithi072.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/btrfs 2024-04-04T07:01:18.844 INFO:teuthology.orchestra.run.smithi072.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 071.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 084.out 085.out 086.out 087.out 088.out 089.out 090.out 091.out 092.out 093.out 094.out 095.out 096.out 097.out 098.out 099.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out 118.out 119.out 120.out 121.out 122.out 123.out 124.out 125.out 126.out 127.out 128.out 129.out 130.out 131.out 132.out 133.out 134.out 135.out 136.out 137.out 138.out 139.out 140.out 141.out 142.out 143.out 144.out 145.out 146.out 147.out 148.out 149.out 150.out 151.out 152.out 153.out 154.out 155.out 156.out 157.out 158.out 159.out 160.out 161.out 162.out 163.out 164.out 165.out 166.out 167.out 168.out 169.out 170.out 171.out 172.out 173.out 174.out 175.out 176.out 177.out 178.out 179.out 180.out 181.out 182.out 183.out 184.out 185.out 186.out 187.out 188.out 189.out 190.out 191.out 192.out 193.out 194.out 195.out 196.out 197.out 198.out 199.out 200.out 201.out 202.out 203.out 204.out 205.out 206.out 207.out 208.out 209.out 210.out 211.out 212.out 213.out 214.out 215.out 216.out 217.out 218.out 219.out 220.out 221.out 222.out 223.out 224.out 225.out 226.out 227.out 228.out 229.out 230.out 231.out 232.out 233.out 234.out 235.out 236.out 237.out 238.out 239.out 240.out 241.out 242.out 243.out 244.out 245.out 246.out 247.out 248.out 249.out 250.out 251.out 252.out 253.out 254.out 255.out 256.out 257.out 258.out 259.out 260.out 261.out 262.out 263.out 264.out 265.out 266.out 267.out 268.out 269.out 270.out 271.out 272.out 273.out 274.out 275.out 276.out 277.out 278.out 279.out 280.out 281.out 282.out 283.out 284.out 285.out 286.out 287.out 288.out 289.out 290.out 291.out 292.out 293.out 294.out 295.out 296.out 297.out 298.out 299.out 300.out 301.out 302.out 303.out 304.out 305.out 306.out 307.out 308.out 309.out 310.out 311.out 312.out 313.out 314.out 315.out 316.out 317.out 320.out /var/lib/xfstests/tests/btrfs 2024-04-04T07:01:21.957 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.tiFz9P8iUAxfstests-dev/tests/ceph/ install 2024-04-04T07:01:21.964 INFO:teuthology.orchestra.run.smithi072.stdout: [GROUP] /tmp/tmp.tiFz9P8iUAxfstests-dev/tests/ceph/group.list 2024-04-04T07:01:22.016 INFO:teuthology.orchestra.run.smithi072.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ceph 2024-04-04T07:01:22.043 INFO:teuthology.orchestra.run.smithi072.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 /var/lib/xfstests/tests/ceph 2024-04-04T07:01:22.106 INFO:teuthology.orchestra.run.smithi072.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ceph 2024-04-04T07:01:22.132 INFO:teuthology.orchestra.run.smithi072.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out /var/lib/xfstests/tests/ceph 2024-04-04T07:01:22.198 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.tiFz9P8iUAxfstests-dev/tests/cifs/ install 2024-04-04T07:01:22.205 INFO:teuthology.orchestra.run.smithi072.stdout: [GROUP] /tmp/tmp.tiFz9P8iUAxfstests-dev/tests/cifs/group.list 2024-04-04T07:01:22.244 INFO:teuthology.orchestra.run.smithi072.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/cifs 2024-04-04T07:01:22.268 INFO:teuthology.orchestra.run.smithi072.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/cifs 2024-04-04T07:01:22.299 INFO:teuthology.orchestra.run.smithi072.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/cifs 2024-04-04T07:01:22.328 INFO:teuthology.orchestra.run.smithi072.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/cifs 2024-04-04T07:01:22.362 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.tiFz9P8iUAxfstests-dev/tests/ext4/ install 2024-04-04T07:01:22.369 INFO:teuthology.orchestra.run.smithi072.stdout: [GROUP] /tmp/tmp.tiFz9P8iUAxfstests-dev/tests/ext4/group.list 2024-04-04T07:01:22.504 INFO:teuthology.orchestra.run.smithi072.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ext4 2024-04-04T07:01:22.536 INFO:teuthology.orchestra.run.smithi072.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 271 301 302 303 304 305 306 307 308 /var/lib/xfstests/tests/ext4 2024-04-04T07:01:23.210 INFO:teuthology.orchestra.run.smithi072.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ext4 2024-04-04T07:01:23.242 INFO:teuthology.orchestra.run.smithi072.stdout:../../install-sh -o root -g root -m 644 001.out.default 001.out.nodelalloc 001.out.nozero 001.cfg 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 271.out 301.out 302.out 303.out 304.out 305.out 306.out 307.out 308.out /var/lib/xfstests/tests/ext4 2024-04-04T07:01:23.952 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.tiFz9P8iUAxfstests-dev/tests/f2fs/ install 2024-04-04T07:01:23.959 INFO:teuthology.orchestra.run.smithi072.stdout: [GROUP] /tmp/tmp.tiFz9P8iUAxfstests-dev/tests/f2fs/group.list 2024-04-04T07:01:24.020 INFO:teuthology.orchestra.run.smithi072.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/f2fs 2024-04-04T07:01:24.050 INFO:teuthology.orchestra.run.smithi072.stdout:../../install-sh -o root -g root -m 755 001 002 /var/lib/xfstests/tests/f2fs 2024-04-04T07:01:24.090 INFO:teuthology.orchestra.run.smithi072.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/f2fs 2024-04-04T07:01:24.119 INFO:teuthology.orchestra.run.smithi072.stdout:../../install-sh -o root -g root -m 644 001.out 002.out /var/lib/xfstests/tests/f2fs 2024-04-04T07:01:24.160 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.tiFz9P8iUAxfstests-dev/tests/generic/ install 2024-04-04T07:01:24.169 INFO:teuthology.orchestra.run.smithi072.stdout: [GROUP] /tmp/tmp.tiFz9P8iUAxfstests-dev/tests/generic/group.list 2024-04-04T07:01:24.503 INFO:teuthology.orchestra.run.smithi072.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/generic 2024-04-04T07:01:24.532 INFO:teuthology.orchestra.run.smithi072.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 596 597 598 599 600 601 602 603 604 605 606 607 608 609 610 611 612 613 614 615 616 617 618 619 620 621 622 623 624 625 626 627 628 629 630 631 632 633 634 635 636 637 638 639 640 641 642 643 644 645 646 647 648 649 650 651 652 653 654 655 656 657 658 659 660 661 662 663 664 665 666 667 668 669 670 671 672 673 674 675 676 677 678 679 680 681 682 683 684 685 686 687 688 689 690 691 692 693 694 695 696 697 698 699 700 701 702 703 704 705 706 707 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729 730 731 732 733 734 735 736 737 738 739 /var/lib/xfstests/tests/generic 2024-04-04T07:01:31.918 INFO:teuthology.orchestra.run.smithi072.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/generic 2024-04-04T07:01:31.950 INFO:teuthology.orchestra.run.smithi072.stdout:../../install-sh -o root -g root -m 644 035.out.default 035.out.nfs 050.out.default 050.out.nojournal 050.out.xfsquota 035.cfg 050.cfg 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 071.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 084.out 085.out 086.out 087.out 088.out 089.out 090.out 091.out 092.out 093.out 094.out 095.out 096.out 097.out 098.out 099.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out 118.out 119.out 120.out 121.out 122.out 123.out 124.out 125.out 126.out 127.out 128.out 129.out 130.out 131.out 132.out 133.out 134.out 135.out 136.out 137.out 138.out 139.out 140.out 141.out 142.out 143.out 144.out 145.out 146.out 147.out 148.out 149.out 150.out 151.out 152.out 153.out 154.out 155.out 156.out 157.out 158.out 159.out 160.out 161.out 162.out 163.out 164.out 165.out 166.out 167.out 168.out 169.out 170.out 171.out 172.out 173.out 174.out 175.out 176.out 177.out 178.out 179.out 180.out 181.out 182.out 183.out 184.out 185.out 186.out 187.out 188.out 189.out 190.out 191.out 192.out 193.out 194.out 195.out 196.out 197.out 198.out 199.out 200.out 201.out 202.out 203.out 204.out 205.out 206.out 207.out 208.out 209.out 210.out 211.out 212.out 213.out 214.out 215.out 216.out 217.out 218.out 219.out 220.out 221.out 222.out 223.out 224.out 225.out 226.out 227.out 228.out 229.out 230.out 231.out 232.out 233.out 234.out 235.out 236.out 237.out 238.out 239.out 240.out 241.out 242.out 243.out 244.out 245.out 246.out 247.out 248.out 249.out 250.out 251.out 252.out 253.out 254.out 255.out 256.out 257.out 258.out 259.out 260.out 261.out 262.out 263.out 264.out 265.out 266.out 267.out 268.out 269.out 270.out 271.out 272.out 273.out 274.out 275.out 276.out 277.out 278.out 279.out 280.out 281.out 282.out 283.out 284.out 285.out 286.out 287.out 288.out 289.out 290.out 291.out 292.out 293.out 294.out 295.out 296.out 297.out 298.out 299.out 300.out 301.out 302.out 303.out 304.out 305.out 306.out 307.out 308.out 309.out 310.out 311.out 312.out 313.out 314.out 315.out 316.out 317.out 318.out 319.out 320.out 321.out 322.out 323.out 324.out 325.out 326.out 327.out 328.out 329.out 330.out 331.out 332.out 333.out 334.out 335.out 336.out 337.out 338.out 339.out 340.out 341.out 342.out 343.out 344.out 345.out 346.out 347.out 348.out 349.out 350.out 351.out 352.out 353.out 354.out 355.out 356.out 357.out 358.out 359.out 360.out 361.out 362.out 363.out 364.out 365.out 366.out 367.out 368.out 369.out 370.out 371.out 372.out 373.out 374.out 375.out 376.out 377.out 378.out 379.out 380.out 381.out 382.out 383.out 384.out 385.out 386.out 387.out 388.out 389.out 390.out 391.out 392.out 393.out 394.out 395.out 396.out 397.out 398.out 399.out 400.out 401.out 402.out 403.out 404.out 405.out 406.out 407.out 408.out 409.out 410.out 411.out 412.out 413.out 414.out 415.out 416.out 417.out 418.out 419.out 420.out 421.out 422.out 423.out 424.out 425.out 426.out 427.out 428.out 429.out 430.out 431.out 432.out 433.out 434.out 435.out 436.out 437.out 438.out 439.out 440.out 441.out 442.out 443.out 444.out 445.out 446.out 447.out 448.out 449.out 450.out 451.out 452.out 453.out 454.out 455.out 456.out 457.out 458.out 459.out 460.out 461.out 462.out 463.out 464.out 465.out 466.out 467.out 468.out 469.out 470.out 471.out 472.out 473.out 474.out 475.out 476.out 477.out 478.out 479.out 480.out 481.out 482.out 483.out 484.out 485.out 486.out 487.out 488.out 489.out 490.out 491.out 492.out 493.out 494.out 495.out 496.out 497.out 498.out 499.out 500.out 501.out 502.out 503.out 504.out 505.out 506.out 507.out 508.out 509.out 510.out 511.out 512.out 513.out 514.out 515.out 516.out 517.out 518.out 519.out 520.out 521.out 522.out 523.out 524.out 525.out 526.out 527.out 528.out 529.out 530.out 531.out 532.out 533.out 534.out 535.out 536.out 537.out 538.out 539.out 540.out 541.out 542.out 543.out 544.out 545.out 546.out 547.out 548.out 549.out 550.out 551.out 552.out 553.out 554.out 555.out 556.out 557.out 558.out 559.out 560.out 561.out 562.out 563.out 564.out 565.out 566.out 567.out 568.out 569.out 570.out 571.out 572.out 573.out 574.out 575.out 576.out 577.out 578.out 579.out 580.out 581.out 582.out 583.out 584.out 585.out 586.out 587.out 588.out 589.out 590.out 591.out 592.out 593.out 594.out 595.out 596.out 597.out 598.out 599.out 600.out 601.out 602.out 603.out 604.out 605.out 606.out 607.out 608.out 609.out 610.out 611.out 612.out 613.out 614.out 615.out 616.out 617.out 618.out 619.out 620.out 621.out 622.out 623.out 624.out 625.out 626.out 627.out 628.out 629.out 630.out 631.out 632.out 633.out 634.out 635.out 636.out 637.out 638.out 639.out 640.out 641.out 642.out 643.out 644.out 645.out 646.out 647.out 648.out 649.out 650.out 651.out 652.out 653.out 654.out 655.out 656.out 657.out 658.out 659.out 660.out 661.out 662.out 663.out 664.out 665.out 666.out 667.out 668.out 669.out 670.out 671.out 672.out 673.out 674.out 675.out 676.out 677.out 678.out 679.out 680.out 681.out 682.out 683.out 684.out 685.out 686.out 687.out 688.out 689.out 690.out 691.out 692.out 693.out 694.out 695.out 696.out 697.out 698.out 699.out 700.out 701.out 702.out 703.out 704.out 705.out 706.out 707.out 708.out 709.out 710.out 711.out 712.out 713.out 714.out 715.out 716.out 717.out 718.out 719.out 720.out 721.out 722.out 723.out 724.out 725.out 726.out 727.out 728.out 729.out 730.out 731.out 732.out 733.out 734.out 735.out 736.out 737.out 738.out 739.out /var/lib/xfstests/tests/generic 2024-04-04T07:01:39.394 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.tiFz9P8iUAxfstests-dev/tests/nfs/ install 2024-04-04T07:01:39.401 INFO:teuthology.orchestra.run.smithi072.stdout: [GROUP] /tmp/tmp.tiFz9P8iUAxfstests-dev/tests/nfs/group.list 2024-04-04T07:01:39.449 INFO:teuthology.orchestra.run.smithi072.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/nfs 2024-04-04T07:01:39.478 INFO:teuthology.orchestra.run.smithi072.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/nfs 2024-04-04T07:01:39.508 INFO:teuthology.orchestra.run.smithi072.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/nfs 2024-04-04T07:01:39.539 INFO:teuthology.orchestra.run.smithi072.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/nfs 2024-04-04T07:01:39.570 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.tiFz9P8iUAxfstests-dev/tests/ocfs2/ install 2024-04-04T07:01:39.576 INFO:teuthology.orchestra.run.smithi072.stdout: [GROUP] /tmp/tmp.tiFz9P8iUAxfstests-dev/tests/ocfs2/group.list 2024-04-04T07:01:39.620 INFO:teuthology.orchestra.run.smithi072.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ocfs2 2024-04-04T07:01:39.650 INFO:teuthology.orchestra.run.smithi072.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/ocfs2 2024-04-04T07:01:39.679 INFO:teuthology.orchestra.run.smithi072.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ocfs2 2024-04-04T07:01:39.712 INFO:teuthology.orchestra.run.smithi072.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/ocfs2 2024-04-04T07:01:39.745 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.tiFz9P8iUAxfstests-dev/tests/overlay/ install 2024-04-04T07:01:39.751 INFO:teuthology.orchestra.run.smithi072.stdout: [GROUP] /tmp/tmp.tiFz9P8iUAxfstests-dev/tests/overlay/group.list 2024-04-04T07:01:39.903 INFO:teuthology.orchestra.run.smithi072.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/overlay 2024-04-04T07:01:39.933 INFO:teuthology.orchestra.run.smithi072.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 /var/lib/xfstests/tests/overlay 2024-04-04T07:01:40.960 INFO:teuthology.orchestra.run.smithi072.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/overlay 2024-04-04T07:01:40.990 INFO:teuthology.orchestra.run.smithi072.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 071.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 084.out 085.out 086.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out /var/lib/xfstests/tests/overlay 2024-04-04T07:01:41.977 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.tiFz9P8iUAxfstests-dev/tests/perf/ install 2024-04-04T07:01:41.980 INFO:teuthology.orchestra.run.smithi072.stdout: [GROUP] /tmp/tmp.tiFz9P8iUAxfstests-dev/tests/perf/group.list 2024-04-04T07:01:42.016 INFO:teuthology.orchestra.run.smithi072.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/perf 2024-04-04T07:01:42.045 INFO:teuthology.orchestra.run.smithi072.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/perf 2024-04-04T07:01:42.075 INFO:teuthology.orchestra.run.smithi072.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/perf 2024-04-04T07:01:42.105 INFO:teuthology.orchestra.run.smithi072.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/perf 2024-04-04T07:01:42.138 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.tiFz9P8iUAxfstests-dev/tests/selftest/ install 2024-04-04T07:01:42.146 INFO:teuthology.orchestra.run.smithi072.stdout: [GROUP] /tmp/tmp.tiFz9P8iUAxfstests-dev/tests/selftest/group.list 2024-04-04T07:01:42.186 INFO:teuthology.orchestra.run.smithi072.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/selftest 2024-04-04T07:01:42.215 INFO:teuthology.orchestra.run.smithi072.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 /var/lib/xfstests/tests/selftest 2024-04-04T07:01:42.294 INFO:teuthology.orchestra.run.smithi072.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/selftest 2024-04-04T07:01:42.325 INFO:teuthology.orchestra.run.smithi072.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out 006.out /var/lib/xfstests/tests/selftest 2024-04-04T07:01:42.397 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.tiFz9P8iUAxfstests-dev/tests/shared/ install 2024-04-04T07:01:42.403 INFO:teuthology.orchestra.run.smithi072.stdout: [GROUP] /tmp/tmp.tiFz9P8iUAxfstests-dev/tests/shared/group.list 2024-04-04T07:01:42.461 INFO:teuthology.orchestra.run.smithi072.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/shared 2024-04-04T07:01:42.494 INFO:teuthology.orchestra.run.smithi072.stdout:../../install-sh -o root -g root -m 755 002 032 298 /var/lib/xfstests/tests/shared 2024-04-04T07:01:42.546 INFO:teuthology.orchestra.run.smithi072.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/shared 2024-04-04T07:01:42.576 INFO:teuthology.orchestra.run.smithi072.stdout:../../install-sh -o root -g root -m 644 002.out 032.out 298.out /var/lib/xfstests/tests/shared 2024-04-04T07:01:42.624 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.tiFz9P8iUAxfstests-dev/tests/tmpfs/ install 2024-04-04T07:01:42.630 INFO:teuthology.orchestra.run.smithi072.stdout: [GROUP] /tmp/tmp.tiFz9P8iUAxfstests-dev/tests/tmpfs/group.list 2024-04-04T07:01:42.673 INFO:teuthology.orchestra.run.smithi072.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/tmpfs 2024-04-04T07:01:42.702 INFO:teuthology.orchestra.run.smithi072.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/tmpfs 2024-04-04T07:01:42.733 INFO:teuthology.orchestra.run.smithi072.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/tmpfs 2024-04-04T07:01:42.763 INFO:teuthology.orchestra.run.smithi072.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/tmpfs 2024-04-04T07:01:42.794 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.tiFz9P8iUAxfstests-dev/tests/udf/ install 2024-04-04T07:01:42.800 INFO:teuthology.orchestra.run.smithi072.stdout: [GROUP] /tmp/tmp.tiFz9P8iUAxfstests-dev/tests/udf/group.list 2024-04-04T07:01:42.834 INFO:teuthology.orchestra.run.smithi072.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/udf 2024-04-04T07:01:42.863 INFO:teuthology.orchestra.run.smithi072.stdout:../../install-sh -o root -g root -m 755 102 /var/lib/xfstests/tests/udf 2024-04-04T07:01:42.893 INFO:teuthology.orchestra.run.smithi072.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/udf 2024-04-04T07:01:42.923 INFO:teuthology.orchestra.run.smithi072.stdout:../../install-sh -o root -g root -m 644 102.out /var/lib/xfstests/tests/udf 2024-04-04T07:01:42.955 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.tiFz9P8iUAxfstests-dev/tests/xfs/ install 2024-04-04T07:01:42.963 INFO:teuthology.orchestra.run.smithi072.stdout: [GROUP] /tmp/tmp.tiFz9P8iUAxfstests-dev/tests/xfs/group.list 2024-04-04T07:01:43.325 INFO:teuthology.orchestra.run.smithi072.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/xfs 2024-04-04T07:01:43.357 INFO:teuthology.orchestra.run.smithi072.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 596 597 598 599 600 601 602 603 604 605 606 607 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729 730 731 732 733 734 735 736 737 738 739 740 741 742 743 744 745 746 747 748 749 750 751 752 753 754 755 756 757 758 759 760 761 762 763 764 765 766 767 768 769 770 771 772 773 774 775 776 777 778 779 780 781 782 783 784 785 786 787 788 789 790 791 792 793 794 795 796 797 798 799 800 /var/lib/xfstests/tests/xfs 2024-04-04T07:01:45.750 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T07:01:45.758 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T07:01:50.552 INFO:teuthology.orchestra.run.smithi072.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/xfs 2024-04-04T07:01:50.589 INFO:teuthology.orchestra.run.smithi072.stdout:../../install-sh -o root -g root -m 644 033.out.crc 033.out.default 071.out.32 071.out.64 096.out.external 096.out.internal 216.out.64mblog 216.out.classic 033.cfg 216.cfg 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 084.out 085.out 086.out 087.out 088.out 089.out 090.out 091.out 092.out 093.out 094.out 095.out 097.out 098.out 099.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out 118.out 119.out 120.out 121.out 122.out 123.out 124.out 125.out 126.out 127.out 128.out 129.out 130.out 131.out 132.out 133.out 134.out 135.out 136.out 137.out 138.out 139.out 140.out 141.out 142.out 143.out 144.out 145.out 146.out 147.out 148.out 149.out 150.out 151.out 152.out 153.out 154.out 155.out 156.out 157.out 158.out 159.out 160.out 161.out 162.out 163.out 164.out 165.out 166.out 167.out 168.out 169.out 170.out 171.out 172.out 173.out 174.out 175.out 176.out 177.out 178.out 179.out 180.out 181.out 182.out 183.out 184.out 185.out 186.out 187.out 188.out 189.out 190.out 191.out 192.out 193.out 194.out 195.out 196.out 197.out 198.out 199.out 200.out 201.out 202.out 203.out 204.out 205.out 206.out 207.out 208.out 209.out 210.out 211.out 212.out 213.out 214.out 215.out 217.out 218.out 219.out 220.out 221.out 222.out 223.out 224.out 225.out 226.out 227.out 228.out 229.out 230.out 231.out 232.out 233.out 234.out 235.out 236.out 237.out 238.out 239.out 240.out 241.out 242.out 243.out 244.out 245.out 246.out 247.out 248.out 249.out 250.out 251.out 252.out 253.out 254.out 255.out 256.out 257.out 258.out 259.out 260.out 261.out 262.out 263.out 264.out 265.out 266.out 267.out 268.out 269.out 270.out 271.out 272.out 273.out 274.out 275.out 276.out 277.out 278.out 279.out 280.out 281.out 282.out 283.out 284.out 285.out 286.out 287.out 288.out 289.out 290.out 291.out 292.out 293.out 294.out 295.out 296.out 297.out 298.out 299.out 300.out 301.out 302.out 303.out 304.out 305.out 306.out 307.out 308.out 309.out 310.out 311.out 312.out 313.out 314.out 315.out 316.out 317.out 318.out 319.out 320.out 321.out 322.out 323.out 324.out 325.out 326.out 327.out 328.out 329.out 330.out 331.out 332.out 333.out 334.out 335.out 336.out 337.out 338.out 339.out 340.out 341.out 342.out 343.out 344.out 345.out 346.out 347.out 348.out 349.out 350.out 351.out 352.out 353.out 354.out 355.out 356.out 357.out 358.out 359.out 360.out 361.out 362.out 363.out 364.out 365.out 366.out 367.out 368.out 369.out 370.out 371.out 372.out 373.out 374.out 375.out 376.out 377.out 378.out 379.out 380.out 381.out 382.out 383.out 384.out 385.out 386.out 387.out 388.out 389.out 390.out 391.out 392.out 393.out 394.out 395.out 396.out 397.out 398.out 399.out 400.out 401.out 402.out 403.out 404.out 405.out 406.out 407.out 408.out 409.out 410.out 411.out 412.out 413.out 414.out 415.out 416.out 417.out 418.out 419.out 420.out 421.out 422.out 423.out 424.out 425.out 426.out 427.out 428.out 429.out 430.out 431.out 432.out 433.out 434.out 435.out 436.out 437.out 438.out 439.out 440.out 441.out 442.out 443.out 444.out 445.out 446.out 447.out 448.out 449.out 450.out 451.out 452.out 453.out 454.out 455.out 456.out 457.out 458.out 459.out 460.out 461.out 462.out 463.out 464.out 465.out 466.out 467.out 468.out 469.out 470.out 471.out 472.out 473.out 474.out 475.out 476.out 477.out 478.out 479.out 480.out 481.out 482.out 483.out 484.out 485.out 486.out 487.out 488.out 489.out 490.out 491.out 492.out 493.out 494.out 495.out 496.out 497.out 498.out 499.out 500.out 501.out 502.out 503.out 504.out 505.out 506.out 507.out 508.out 509.out 510.out 511.out 512.out 513.out 514.out 515.out 516.out 517.out 518.out 519.out 520.out 521.out 522.out 523.out 524.out 525.out 526.out 527.out 528.out 529.out 530.out 531.out 532.out 533.out 534.out 535.out 536.out 537.out 538.out 539.out 540.out 541.out 542.out 543.out 544.out 545.out 546.out 547.out 548.out 549.out 550.out 551.out 552.out 553.out 554.out 555.out 556.out 557.out 558.out 559.out 560.out 561.out 562.out 563.out 564.out 565.out 566.out 567.out 568.out 569.out 570.out 571.out 572.out 573.out 574.out 575.out 576.out 577.out 578.out 579.out 580.out 581.out 582.out 583.out 584.out 585.out 586.out 587.out 588.out 589.out 590.out 591.out 592.out 593.out 594.out 595.out 596.out 597.out 598.out 599.out 600.out 601.out 602.out 603.out 604.out 605.out 606.out 607.out 708.out 709.out 710.out 711.out 712.out 713.out 714.out 715.out 716.out 717.out 718.out 719.out 720.out 721.out 722.out 723.out 724.out 725.out 726.out 727.out 728.out 729.out 730.out 731.out 732.out 733.out 734.out 735.out 736.out 737.out 738.out 739.out 740.out 741.out 742.out 743.out 744.out 745.out 746.out 747.out 748.out 749.out 750.out 751.out 752.out 753.out 754.out 755.out 756.out 757.out 758.out 759.out 760.out 761.out 762.out 763.out 764.out 765.out 766.out 767.out 768.out 769.out 770.out 771.out 772.out 773.out 774.out 775.out 776.out 777.out 778.out 779.out 780.out 781.out 782.out 783.out 784.out 785.out 786.out 787.out 788.out 789.out 790.out 791.out 792.out 793.out 794.out 795.out 796.out 797.out 798.out 799.out 800.out /var/lib/xfstests/tests/xfs 2024-04-04T07:01:58.035 INFO:teuthology.orchestra.run.smithi072.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests 2024-04-04T07:01:58.065 INFO:teuthology.orchestra.run.smithi072.stdout:./install-sh -o root -g root -m 755 -d /var/lib/xfstests 2024-04-04T07:01:58.093 INFO:teuthology.orchestra.run.smithi072.stdout:./install-sh -o root -g root -m 755 check /var/lib/xfstests 2024-04-04T07:01:58.124 INFO:teuthology.orchestra.run.smithi072.stdout:./install-sh -o root -g root -m 644 randomize.awk /var/lib/xfstests 2024-04-04T07:01:58.163 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-04T07:01:58.163 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec ls tests/generic) 2024-04-04T07:01:58.220 INFO:teuthology.orchestra.run.smithi072.stdout:001 2024-04-04T07:01:58.220 INFO:teuthology.orchestra.run.smithi072.stdout:001.out 2024-04-04T07:01:58.220 INFO:teuthology.orchestra.run.smithi072.stdout:002 2024-04-04T07:01:58.220 INFO:teuthology.orchestra.run.smithi072.stdout:002.out 2024-04-04T07:01:58.220 INFO:teuthology.orchestra.run.smithi072.stdout:003 2024-04-04T07:01:58.220 INFO:teuthology.orchestra.run.smithi072.stdout:003.out 2024-04-04T07:01:58.220 INFO:teuthology.orchestra.run.smithi072.stdout:004 2024-04-04T07:01:58.220 INFO:teuthology.orchestra.run.smithi072.stdout:004.out 2024-04-04T07:01:58.220 INFO:teuthology.orchestra.run.smithi072.stdout:005 2024-04-04T07:01:58.221 INFO:teuthology.orchestra.run.smithi072.stdout:005.out 2024-04-04T07:01:58.221 INFO:teuthology.orchestra.run.smithi072.stdout:006 2024-04-04T07:01:58.221 INFO:teuthology.orchestra.run.smithi072.stdout:006.out 2024-04-04T07:01:58.221 INFO:teuthology.orchestra.run.smithi072.stdout:007 2024-04-04T07:01:58.221 INFO:teuthology.orchestra.run.smithi072.stdout:007.out 2024-04-04T07:01:58.221 INFO:teuthology.orchestra.run.smithi072.stdout:008 2024-04-04T07:01:58.221 INFO:teuthology.orchestra.run.smithi072.stdout:008.out 2024-04-04T07:01:58.221 INFO:teuthology.orchestra.run.smithi072.stdout:009 2024-04-04T07:01:58.221 INFO:teuthology.orchestra.run.smithi072.stdout:009.out 2024-04-04T07:01:58.221 INFO:teuthology.orchestra.run.smithi072.stdout:010 2024-04-04T07:01:58.221 INFO:teuthology.orchestra.run.smithi072.stdout:010.out 2024-04-04T07:01:58.221 INFO:teuthology.orchestra.run.smithi072.stdout:011 2024-04-04T07:01:58.221 INFO:teuthology.orchestra.run.smithi072.stdout:011.out 2024-04-04T07:01:58.221 INFO:teuthology.orchestra.run.smithi072.stdout:012 2024-04-04T07:01:58.222 INFO:teuthology.orchestra.run.smithi072.stdout:012.out 2024-04-04T07:01:58.222 INFO:teuthology.orchestra.run.smithi072.stdout:013 2024-04-04T07:01:58.222 INFO:teuthology.orchestra.run.smithi072.stdout:013.out 2024-04-04T07:01:58.222 INFO:teuthology.orchestra.run.smithi072.stdout:014 2024-04-04T07:01:58.222 INFO:teuthology.orchestra.run.smithi072.stdout:014.out 2024-04-04T07:01:58.222 INFO:teuthology.orchestra.run.smithi072.stdout:015 2024-04-04T07:01:58.222 INFO:teuthology.orchestra.run.smithi072.stdout:015.out 2024-04-04T07:01:58.222 INFO:teuthology.orchestra.run.smithi072.stdout:016 2024-04-04T07:01:58.222 INFO:teuthology.orchestra.run.smithi072.stdout:016.out 2024-04-04T07:01:58.222 INFO:teuthology.orchestra.run.smithi072.stdout:017 2024-04-04T07:01:58.222 INFO:teuthology.orchestra.run.smithi072.stdout:017.out 2024-04-04T07:01:58.223 INFO:teuthology.orchestra.run.smithi072.stdout:018 2024-04-04T07:01:58.223 INFO:teuthology.orchestra.run.smithi072.stdout:018.out 2024-04-04T07:01:58.223 INFO:teuthology.orchestra.run.smithi072.stdout:019 2024-04-04T07:01:58.223 INFO:teuthology.orchestra.run.smithi072.stdout:019.out 2024-04-04T07:01:58.223 INFO:teuthology.orchestra.run.smithi072.stdout:020 2024-04-04T07:01:58.223 INFO:teuthology.orchestra.run.smithi072.stdout:020.out 2024-04-04T07:01:58.223 INFO:teuthology.orchestra.run.smithi072.stdout:021 2024-04-04T07:01:58.223 INFO:teuthology.orchestra.run.smithi072.stdout:021.out 2024-04-04T07:01:58.223 INFO:teuthology.orchestra.run.smithi072.stdout:022 2024-04-04T07:01:58.224 INFO:teuthology.orchestra.run.smithi072.stdout:022.out 2024-04-04T07:01:58.224 INFO:teuthology.orchestra.run.smithi072.stdout:023 2024-04-04T07:01:58.224 INFO:teuthology.orchestra.run.smithi072.stdout:023.out 2024-04-04T07:01:58.224 INFO:teuthology.orchestra.run.smithi072.stdout:024 2024-04-04T07:01:58.224 INFO:teuthology.orchestra.run.smithi072.stdout:024.out 2024-04-04T07:01:58.224 INFO:teuthology.orchestra.run.smithi072.stdout:025 2024-04-04T07:01:58.225 INFO:teuthology.orchestra.run.smithi072.stdout:025.out 2024-04-04T07:01:58.225 INFO:teuthology.orchestra.run.smithi072.stdout:026 2024-04-04T07:01:58.225 INFO:teuthology.orchestra.run.smithi072.stdout:026.out 2024-04-04T07:01:58.225 INFO:teuthology.orchestra.run.smithi072.stdout:027 2024-04-04T07:01:58.225 INFO:teuthology.orchestra.run.smithi072.stdout:027.out 2024-04-04T07:01:58.225 INFO:teuthology.orchestra.run.smithi072.stdout:028 2024-04-04T07:01:58.226 INFO:teuthology.orchestra.run.smithi072.stdout:028.out 2024-04-04T07:01:58.226 INFO:teuthology.orchestra.run.smithi072.stdout:029 2024-04-04T07:01:58.226 INFO:teuthology.orchestra.run.smithi072.stdout:029.out 2024-04-04T07:01:58.226 INFO:teuthology.orchestra.run.smithi072.stdout:030 2024-04-04T07:01:58.226 INFO:teuthology.orchestra.run.smithi072.stdout:030.out 2024-04-04T07:01:58.227 INFO:teuthology.orchestra.run.smithi072.stdout:031 2024-04-04T07:01:58.227 INFO:teuthology.orchestra.run.smithi072.stdout:031.out 2024-04-04T07:01:58.227 INFO:teuthology.orchestra.run.smithi072.stdout:032 2024-04-04T07:01:58.227 INFO:teuthology.orchestra.run.smithi072.stdout:032.out 2024-04-04T07:01:58.227 INFO:teuthology.orchestra.run.smithi072.stdout:033 2024-04-04T07:01:58.227 INFO:teuthology.orchestra.run.smithi072.stdout:033.out 2024-04-04T07:01:58.227 INFO:teuthology.orchestra.run.smithi072.stdout:034 2024-04-04T07:01:58.228 INFO:teuthology.orchestra.run.smithi072.stdout:034.out 2024-04-04T07:01:58.228 INFO:teuthology.orchestra.run.smithi072.stdout:035 2024-04-04T07:01:58.228 INFO:teuthology.orchestra.run.smithi072.stdout:035.cfg 2024-04-04T07:01:58.228 INFO:teuthology.orchestra.run.smithi072.stdout:035.out.default 2024-04-04T07:01:58.228 INFO:teuthology.orchestra.run.smithi072.stdout:035.out.nfs 2024-04-04T07:01:58.228 INFO:teuthology.orchestra.run.smithi072.stdout:036 2024-04-04T07:01:58.228 INFO:teuthology.orchestra.run.smithi072.stdout:036.out 2024-04-04T07:01:58.228 INFO:teuthology.orchestra.run.smithi072.stdout:037 2024-04-04T07:01:58.228 INFO:teuthology.orchestra.run.smithi072.stdout:037.out 2024-04-04T07:01:58.228 INFO:teuthology.orchestra.run.smithi072.stdout:038 2024-04-04T07:01:58.229 INFO:teuthology.orchestra.run.smithi072.stdout:038.out 2024-04-04T07:01:58.229 INFO:teuthology.orchestra.run.smithi072.stdout:039 2024-04-04T07:01:58.229 INFO:teuthology.orchestra.run.smithi072.stdout:039.out 2024-04-04T07:01:58.229 INFO:teuthology.orchestra.run.smithi072.stdout:040 2024-04-04T07:01:58.229 INFO:teuthology.orchestra.run.smithi072.stdout:040.out 2024-04-04T07:01:58.229 INFO:teuthology.orchestra.run.smithi072.stdout:041 2024-04-04T07:01:58.229 INFO:teuthology.orchestra.run.smithi072.stdout:041.out 2024-04-04T07:01:58.229 INFO:teuthology.orchestra.run.smithi072.stdout:042 2024-04-04T07:01:58.229 INFO:teuthology.orchestra.run.smithi072.stdout:042.out 2024-04-04T07:01:58.229 INFO:teuthology.orchestra.run.smithi072.stdout:043 2024-04-04T07:01:58.229 INFO:teuthology.orchestra.run.smithi072.stdout:043.out 2024-04-04T07:01:58.229 INFO:teuthology.orchestra.run.smithi072.stdout:044 2024-04-04T07:01:58.229 INFO:teuthology.orchestra.run.smithi072.stdout:044.out 2024-04-04T07:01:58.229 INFO:teuthology.orchestra.run.smithi072.stdout:045 2024-04-04T07:01:58.230 INFO:teuthology.orchestra.run.smithi072.stdout:045.out 2024-04-04T07:01:58.230 INFO:teuthology.orchestra.run.smithi072.stdout:046 2024-04-04T07:01:58.230 INFO:teuthology.orchestra.run.smithi072.stdout:046.out 2024-04-04T07:01:58.230 INFO:teuthology.orchestra.run.smithi072.stdout:047 2024-04-04T07:01:58.230 INFO:teuthology.orchestra.run.smithi072.stdout:047.out 2024-04-04T07:01:58.230 INFO:teuthology.orchestra.run.smithi072.stdout:048 2024-04-04T07:01:58.231 INFO:teuthology.orchestra.run.smithi072.stdout:048.out 2024-04-04T07:01:58.231 INFO:teuthology.orchestra.run.smithi072.stdout:049 2024-04-04T07:01:58.231 INFO:teuthology.orchestra.run.smithi072.stdout:049.out 2024-04-04T07:01:58.231 INFO:teuthology.orchestra.run.smithi072.stdout:050 2024-04-04T07:01:58.231 INFO:teuthology.orchestra.run.smithi072.stdout:050.cfg 2024-04-04T07:01:58.231 INFO:teuthology.orchestra.run.smithi072.stdout:050.out.default 2024-04-04T07:01:58.231 INFO:teuthology.orchestra.run.smithi072.stdout:050.out.nojournal 2024-04-04T07:01:58.231 INFO:teuthology.orchestra.run.smithi072.stdout:050.out.xfsquota 2024-04-04T07:01:58.231 INFO:teuthology.orchestra.run.smithi072.stdout:051 2024-04-04T07:01:58.231 INFO:teuthology.orchestra.run.smithi072.stdout:051.out 2024-04-04T07:01:58.231 INFO:teuthology.orchestra.run.smithi072.stdout:052 2024-04-04T07:01:58.231 INFO:teuthology.orchestra.run.smithi072.stdout:052.out 2024-04-04T07:01:58.231 INFO:teuthology.orchestra.run.smithi072.stdout:053 2024-04-04T07:01:58.231 INFO:teuthology.orchestra.run.smithi072.stdout:053.out 2024-04-04T07:01:58.232 INFO:teuthology.orchestra.run.smithi072.stdout:054 2024-04-04T07:01:58.232 INFO:teuthology.orchestra.run.smithi072.stdout:054.out 2024-04-04T07:01:58.232 INFO:teuthology.orchestra.run.smithi072.stdout:055 2024-04-04T07:01:58.232 INFO:teuthology.orchestra.run.smithi072.stdout:055.out 2024-04-04T07:01:58.232 INFO:teuthology.orchestra.run.smithi072.stdout:056 2024-04-04T07:01:58.232 INFO:teuthology.orchestra.run.smithi072.stdout:056.out 2024-04-04T07:01:58.232 INFO:teuthology.orchestra.run.smithi072.stdout:057 2024-04-04T07:01:58.232 INFO:teuthology.orchestra.run.smithi072.stdout:057.out 2024-04-04T07:01:58.232 INFO:teuthology.orchestra.run.smithi072.stdout:058 2024-04-04T07:01:58.232 INFO:teuthology.orchestra.run.smithi072.stdout:058.out 2024-04-04T07:01:58.232 INFO:teuthology.orchestra.run.smithi072.stdout:059 2024-04-04T07:01:58.232 INFO:teuthology.orchestra.run.smithi072.stdout:059.out 2024-04-04T07:01:58.232 INFO:teuthology.orchestra.run.smithi072.stdout:060 2024-04-04T07:01:58.232 INFO:teuthology.orchestra.run.smithi072.stdout:060.out 2024-04-04T07:01:58.232 INFO:teuthology.orchestra.run.smithi072.stdout:061 2024-04-04T07:01:58.232 INFO:teuthology.orchestra.run.smithi072.stdout:061.out 2024-04-04T07:01:58.233 INFO:teuthology.orchestra.run.smithi072.stdout:062 2024-04-04T07:01:58.233 INFO:teuthology.orchestra.run.smithi072.stdout:062.out 2024-04-04T07:01:58.233 INFO:teuthology.orchestra.run.smithi072.stdout:063 2024-04-04T07:01:58.233 INFO:teuthology.orchestra.run.smithi072.stdout:063.out 2024-04-04T07:01:58.233 INFO:teuthology.orchestra.run.smithi072.stdout:064 2024-04-04T07:01:58.233 INFO:teuthology.orchestra.run.smithi072.stdout:064.out 2024-04-04T07:01:58.233 INFO:teuthology.orchestra.run.smithi072.stdout:065 2024-04-04T07:01:58.233 INFO:teuthology.orchestra.run.smithi072.stdout:065.out 2024-04-04T07:01:58.233 INFO:teuthology.orchestra.run.smithi072.stdout:066 2024-04-04T07:01:58.233 INFO:teuthology.orchestra.run.smithi072.stdout:066.out 2024-04-04T07:01:58.233 INFO:teuthology.orchestra.run.smithi072.stdout:067 2024-04-04T07:01:58.233 INFO:teuthology.orchestra.run.smithi072.stdout:067.out 2024-04-04T07:01:58.233 INFO:teuthology.orchestra.run.smithi072.stdout:068 2024-04-04T07:01:58.233 INFO:teuthology.orchestra.run.smithi072.stdout:068.out 2024-04-04T07:01:58.234 INFO:teuthology.orchestra.run.smithi072.stdout:069 2024-04-04T07:01:58.234 INFO:teuthology.orchestra.run.smithi072.stdout:069.out 2024-04-04T07:01:58.234 INFO:teuthology.orchestra.run.smithi072.stdout:070 2024-04-04T07:01:58.234 INFO:teuthology.orchestra.run.smithi072.stdout:070.out 2024-04-04T07:01:58.234 INFO:teuthology.orchestra.run.smithi072.stdout:071 2024-04-04T07:01:58.234 INFO:teuthology.orchestra.run.smithi072.stdout:071.out 2024-04-04T07:01:58.234 INFO:teuthology.orchestra.run.smithi072.stdout:072 2024-04-04T07:01:58.234 INFO:teuthology.orchestra.run.smithi072.stdout:072.out 2024-04-04T07:01:58.235 INFO:teuthology.orchestra.run.smithi072.stdout:073 2024-04-04T07:01:58.235 INFO:teuthology.orchestra.run.smithi072.stdout:073.out 2024-04-04T07:01:58.235 INFO:teuthology.orchestra.run.smithi072.stdout:074 2024-04-04T07:01:58.235 INFO:teuthology.orchestra.run.smithi072.stdout:074.out 2024-04-04T07:01:58.235 INFO:teuthology.orchestra.run.smithi072.stdout:075 2024-04-04T07:01:58.235 INFO:teuthology.orchestra.run.smithi072.stdout:075.out 2024-04-04T07:01:58.235 INFO:teuthology.orchestra.run.smithi072.stdout:076 2024-04-04T07:01:58.235 INFO:teuthology.orchestra.run.smithi072.stdout:076.out 2024-04-04T07:01:58.235 INFO:teuthology.orchestra.run.smithi072.stdout:077 2024-04-04T07:01:58.235 INFO:teuthology.orchestra.run.smithi072.stdout:077.out 2024-04-04T07:01:58.235 INFO:teuthology.orchestra.run.smithi072.stdout:078 2024-04-04T07:01:58.235 INFO:teuthology.orchestra.run.smithi072.stdout:078.out 2024-04-04T07:01:58.235 INFO:teuthology.orchestra.run.smithi072.stdout:079 2024-04-04T07:01:58.235 INFO:teuthology.orchestra.run.smithi072.stdout:079.out 2024-04-04T07:01:58.236 INFO:teuthology.orchestra.run.smithi072.stdout:080 2024-04-04T07:01:58.236 INFO:teuthology.orchestra.run.smithi072.stdout:080.out 2024-04-04T07:01:58.236 INFO:teuthology.orchestra.run.smithi072.stdout:081 2024-04-04T07:01:58.236 INFO:teuthology.orchestra.run.smithi072.stdout:081.out 2024-04-04T07:01:58.236 INFO:teuthology.orchestra.run.smithi072.stdout:082 2024-04-04T07:01:58.236 INFO:teuthology.orchestra.run.smithi072.stdout:082.out 2024-04-04T07:01:58.236 INFO:teuthology.orchestra.run.smithi072.stdout:083 2024-04-04T07:01:58.236 INFO:teuthology.orchestra.run.smithi072.stdout:083.out 2024-04-04T07:01:58.236 INFO:teuthology.orchestra.run.smithi072.stdout:084 2024-04-04T07:01:58.236 INFO:teuthology.orchestra.run.smithi072.stdout:084.out 2024-04-04T07:01:58.236 INFO:teuthology.orchestra.run.smithi072.stdout:085 2024-04-04T07:01:58.236 INFO:teuthology.orchestra.run.smithi072.stdout:085.out 2024-04-04T07:01:58.236 INFO:teuthology.orchestra.run.smithi072.stdout:086 2024-04-04T07:01:58.237 INFO:teuthology.orchestra.run.smithi072.stdout:086.out 2024-04-04T07:01:58.237 INFO:teuthology.orchestra.run.smithi072.stdout:087 2024-04-04T07:01:58.237 INFO:teuthology.orchestra.run.smithi072.stdout:087.out 2024-04-04T07:01:58.237 INFO:teuthology.orchestra.run.smithi072.stdout:088 2024-04-04T07:01:58.237 INFO:teuthology.orchestra.run.smithi072.stdout:088.out 2024-04-04T07:01:58.237 INFO:teuthology.orchestra.run.smithi072.stdout:089 2024-04-04T07:01:58.238 INFO:teuthology.orchestra.run.smithi072.stdout:089.out 2024-04-04T07:01:58.238 INFO:teuthology.orchestra.run.smithi072.stdout:090 2024-04-04T07:01:58.238 INFO:teuthology.orchestra.run.smithi072.stdout:090.out 2024-04-04T07:01:58.238 INFO:teuthology.orchestra.run.smithi072.stdout:091 2024-04-04T07:01:58.238 INFO:teuthology.orchestra.run.smithi072.stdout:091.out 2024-04-04T07:01:58.239 INFO:teuthology.orchestra.run.smithi072.stdout:092 2024-04-04T07:01:58.239 INFO:teuthology.orchestra.run.smithi072.stdout:092.out 2024-04-04T07:01:58.239 INFO:teuthology.orchestra.run.smithi072.stdout:093 2024-04-04T07:01:58.239 INFO:teuthology.orchestra.run.smithi072.stdout:093.out 2024-04-04T07:01:58.239 INFO:teuthology.orchestra.run.smithi072.stdout:094 2024-04-04T07:01:58.239 INFO:teuthology.orchestra.run.smithi072.stdout:094.out 2024-04-04T07:01:58.240 INFO:teuthology.orchestra.run.smithi072.stdout:095 2024-04-04T07:01:58.240 INFO:teuthology.orchestra.run.smithi072.stdout:095.out 2024-04-04T07:01:58.240 INFO:teuthology.orchestra.run.smithi072.stdout:096 2024-04-04T07:01:58.240 INFO:teuthology.orchestra.run.smithi072.stdout:096.out 2024-04-04T07:01:58.240 INFO:teuthology.orchestra.run.smithi072.stdout:097 2024-04-04T07:01:58.240 INFO:teuthology.orchestra.run.smithi072.stdout:097.out 2024-04-04T07:01:58.241 INFO:teuthology.orchestra.run.smithi072.stdout:098 2024-04-04T07:01:58.241 INFO:teuthology.orchestra.run.smithi072.stdout:098.out 2024-04-04T07:01:58.241 INFO:teuthology.orchestra.run.smithi072.stdout:099 2024-04-04T07:01:58.241 INFO:teuthology.orchestra.run.smithi072.stdout:099.out 2024-04-04T07:01:58.241 INFO:teuthology.orchestra.run.smithi072.stdout:100 2024-04-04T07:01:58.241 INFO:teuthology.orchestra.run.smithi072.stdout:100.out 2024-04-04T07:01:58.242 INFO:teuthology.orchestra.run.smithi072.stdout:101 2024-04-04T07:01:58.242 INFO:teuthology.orchestra.run.smithi072.stdout:101.out 2024-04-04T07:01:58.242 INFO:teuthology.orchestra.run.smithi072.stdout:102 2024-04-04T07:01:58.242 INFO:teuthology.orchestra.run.smithi072.stdout:102.out 2024-04-04T07:01:58.242 INFO:teuthology.orchestra.run.smithi072.stdout:103 2024-04-04T07:01:58.242 INFO:teuthology.orchestra.run.smithi072.stdout:103.out 2024-04-04T07:01:58.243 INFO:teuthology.orchestra.run.smithi072.stdout:104 2024-04-04T07:01:58.243 INFO:teuthology.orchestra.run.smithi072.stdout:104.out 2024-04-04T07:01:58.243 INFO:teuthology.orchestra.run.smithi072.stdout:105 2024-04-04T07:01:58.244 INFO:teuthology.orchestra.run.smithi072.stdout:105.out 2024-04-04T07:01:58.244 INFO:teuthology.orchestra.run.smithi072.stdout:106 2024-04-04T07:01:58.244 INFO:teuthology.orchestra.run.smithi072.stdout:106.out 2024-04-04T07:01:58.244 INFO:teuthology.orchestra.run.smithi072.stdout:107 2024-04-04T07:01:58.244 INFO:teuthology.orchestra.run.smithi072.stdout:107.out 2024-04-04T07:01:58.245 INFO:teuthology.orchestra.run.smithi072.stdout:108 2024-04-04T07:01:58.245 INFO:teuthology.orchestra.run.smithi072.stdout:108.out 2024-04-04T07:01:58.245 INFO:teuthology.orchestra.run.smithi072.stdout:109 2024-04-04T07:01:58.245 INFO:teuthology.orchestra.run.smithi072.stdout:109.out 2024-04-04T07:01:58.245 INFO:teuthology.orchestra.run.smithi072.stdout:110 2024-04-04T07:01:58.245 INFO:teuthology.orchestra.run.smithi072.stdout:110.out 2024-04-04T07:01:58.246 INFO:teuthology.orchestra.run.smithi072.stdout:111 2024-04-04T07:01:58.246 INFO:teuthology.orchestra.run.smithi072.stdout:111.out 2024-04-04T07:01:58.246 INFO:teuthology.orchestra.run.smithi072.stdout:112 2024-04-04T07:01:58.246 INFO:teuthology.orchestra.run.smithi072.stdout:112.out 2024-04-04T07:01:58.246 INFO:teuthology.orchestra.run.smithi072.stdout:113 2024-04-04T07:01:58.246 INFO:teuthology.orchestra.run.smithi072.stdout:113.out 2024-04-04T07:01:58.247 INFO:teuthology.orchestra.run.smithi072.stdout:114 2024-04-04T07:01:58.247 INFO:teuthology.orchestra.run.smithi072.stdout:114.out 2024-04-04T07:01:58.247 INFO:teuthology.orchestra.run.smithi072.stdout:115 2024-04-04T07:01:58.247 INFO:teuthology.orchestra.run.smithi072.stdout:115.out 2024-04-04T07:01:58.247 INFO:teuthology.orchestra.run.smithi072.stdout:116 2024-04-04T07:01:58.247 INFO:teuthology.orchestra.run.smithi072.stdout:116.out 2024-04-04T07:01:58.247 INFO:teuthology.orchestra.run.smithi072.stdout:117 2024-04-04T07:01:58.248 INFO:teuthology.orchestra.run.smithi072.stdout:117.out 2024-04-04T07:01:58.248 INFO:teuthology.orchestra.run.smithi072.stdout:118 2024-04-04T07:01:58.248 INFO:teuthology.orchestra.run.smithi072.stdout:118.out 2024-04-04T07:01:58.248 INFO:teuthology.orchestra.run.smithi072.stdout:119 2024-04-04T07:01:58.248 INFO:teuthology.orchestra.run.smithi072.stdout:119.out 2024-04-04T07:01:58.248 INFO:teuthology.orchestra.run.smithi072.stdout:120 2024-04-04T07:01:58.248 INFO:teuthology.orchestra.run.smithi072.stdout:120.out 2024-04-04T07:01:58.249 INFO:teuthology.orchestra.run.smithi072.stdout:121 2024-04-04T07:01:58.249 INFO:teuthology.orchestra.run.smithi072.stdout:121.out 2024-04-04T07:01:58.249 INFO:teuthology.orchestra.run.smithi072.stdout:122 2024-04-04T07:01:58.249 INFO:teuthology.orchestra.run.smithi072.stdout:122.out 2024-04-04T07:01:58.249 INFO:teuthology.orchestra.run.smithi072.stdout:123 2024-04-04T07:01:58.249 INFO:teuthology.orchestra.run.smithi072.stdout:123.out 2024-04-04T07:01:58.250 INFO:teuthology.orchestra.run.smithi072.stdout:124 2024-04-04T07:01:58.250 INFO:teuthology.orchestra.run.smithi072.stdout:124.out 2024-04-04T07:01:58.250 INFO:teuthology.orchestra.run.smithi072.stdout:125 2024-04-04T07:01:58.250 INFO:teuthology.orchestra.run.smithi072.stdout:125.out 2024-04-04T07:01:58.250 INFO:teuthology.orchestra.run.smithi072.stdout:126 2024-04-04T07:01:58.250 INFO:teuthology.orchestra.run.smithi072.stdout:126.out 2024-04-04T07:01:58.250 INFO:teuthology.orchestra.run.smithi072.stdout:127 2024-04-04T07:01:58.251 INFO:teuthology.orchestra.run.smithi072.stdout:127.out 2024-04-04T07:01:58.251 INFO:teuthology.orchestra.run.smithi072.stdout:128 2024-04-04T07:01:58.251 INFO:teuthology.orchestra.run.smithi072.stdout:128.out 2024-04-04T07:01:58.251 INFO:teuthology.orchestra.run.smithi072.stdout:129 2024-04-04T07:01:58.251 INFO:teuthology.orchestra.run.smithi072.stdout:129.out 2024-04-04T07:01:58.251 INFO:teuthology.orchestra.run.smithi072.stdout:130 2024-04-04T07:01:58.251 INFO:teuthology.orchestra.run.smithi072.stdout:130.out 2024-04-04T07:01:58.252 INFO:teuthology.orchestra.run.smithi072.stdout:131 2024-04-04T07:01:58.252 INFO:teuthology.orchestra.run.smithi072.stdout:131.out 2024-04-04T07:01:58.252 INFO:teuthology.orchestra.run.smithi072.stdout:132 2024-04-04T07:01:58.252 INFO:teuthology.orchestra.run.smithi072.stdout:132.out 2024-04-04T07:01:58.252 INFO:teuthology.orchestra.run.smithi072.stdout:133 2024-04-04T07:01:58.252 INFO:teuthology.orchestra.run.smithi072.stdout:133.out 2024-04-04T07:01:58.252 INFO:teuthology.orchestra.run.smithi072.stdout:134 2024-04-04T07:01:58.252 INFO:teuthology.orchestra.run.smithi072.stdout:134.out 2024-04-04T07:01:58.252 INFO:teuthology.orchestra.run.smithi072.stdout:135 2024-04-04T07:01:58.252 INFO:teuthology.orchestra.run.smithi072.stdout:135.out 2024-04-04T07:01:58.252 INFO:teuthology.orchestra.run.smithi072.stdout:136 2024-04-04T07:01:58.252 INFO:teuthology.orchestra.run.smithi072.stdout:136.out 2024-04-04T07:01:58.252 INFO:teuthology.orchestra.run.smithi072.stdout:137 2024-04-04T07:01:58.252 INFO:teuthology.orchestra.run.smithi072.stdout:137.out 2024-04-04T07:01:58.253 INFO:teuthology.orchestra.run.smithi072.stdout:138 2024-04-04T07:01:58.253 INFO:teuthology.orchestra.run.smithi072.stdout:138.out 2024-04-04T07:01:58.253 INFO:teuthology.orchestra.run.smithi072.stdout:139 2024-04-04T07:01:58.253 INFO:teuthology.orchestra.run.smithi072.stdout:139.out 2024-04-04T07:01:58.253 INFO:teuthology.orchestra.run.smithi072.stdout:140 2024-04-04T07:01:58.253 INFO:teuthology.orchestra.run.smithi072.stdout:140.out 2024-04-04T07:01:58.253 INFO:teuthology.orchestra.run.smithi072.stdout:141 2024-04-04T07:01:58.253 INFO:teuthology.orchestra.run.smithi072.stdout:141.out 2024-04-04T07:01:58.253 INFO:teuthology.orchestra.run.smithi072.stdout:142 2024-04-04T07:01:58.253 INFO:teuthology.orchestra.run.smithi072.stdout:142.out 2024-04-04T07:01:58.253 INFO:teuthology.orchestra.run.smithi072.stdout:143 2024-04-04T07:01:58.253 INFO:teuthology.orchestra.run.smithi072.stdout:143.out 2024-04-04T07:01:58.253 INFO:teuthology.orchestra.run.smithi072.stdout:144 2024-04-04T07:01:58.253 INFO:teuthology.orchestra.run.smithi072.stdout:144.out 2024-04-04T07:01:58.254 INFO:teuthology.orchestra.run.smithi072.stdout:145 2024-04-04T07:01:58.254 INFO:teuthology.orchestra.run.smithi072.stdout:145.out 2024-04-04T07:01:58.254 INFO:teuthology.orchestra.run.smithi072.stdout:146 2024-04-04T07:01:58.254 INFO:teuthology.orchestra.run.smithi072.stdout:146.out 2024-04-04T07:01:58.254 INFO:teuthology.orchestra.run.smithi072.stdout:147 2024-04-04T07:01:58.254 INFO:teuthology.orchestra.run.smithi072.stdout:147.out 2024-04-04T07:01:58.254 INFO:teuthology.orchestra.run.smithi072.stdout:148 2024-04-04T07:01:58.254 INFO:teuthology.orchestra.run.smithi072.stdout:148.out 2024-04-04T07:01:58.254 INFO:teuthology.orchestra.run.smithi072.stdout:149 2024-04-04T07:01:58.254 INFO:teuthology.orchestra.run.smithi072.stdout:149.out 2024-04-04T07:01:58.254 INFO:teuthology.orchestra.run.smithi072.stdout:150 2024-04-04T07:01:58.254 INFO:teuthology.orchestra.run.smithi072.stdout:150.out 2024-04-04T07:01:58.254 INFO:teuthology.orchestra.run.smithi072.stdout:151 2024-04-04T07:01:58.255 INFO:teuthology.orchestra.run.smithi072.stdout:151.out 2024-04-04T07:01:58.255 INFO:teuthology.orchestra.run.smithi072.stdout:152 2024-04-04T07:01:58.255 INFO:teuthology.orchestra.run.smithi072.stdout:152.out 2024-04-04T07:01:58.255 INFO:teuthology.orchestra.run.smithi072.stdout:153 2024-04-04T07:01:58.255 INFO:teuthology.orchestra.run.smithi072.stdout:153.out 2024-04-04T07:01:58.255 INFO:teuthology.orchestra.run.smithi072.stdout:154 2024-04-04T07:01:58.255 INFO:teuthology.orchestra.run.smithi072.stdout:154.out 2024-04-04T07:01:58.255 INFO:teuthology.orchestra.run.smithi072.stdout:155 2024-04-04T07:01:58.255 INFO:teuthology.orchestra.run.smithi072.stdout:155.out 2024-04-04T07:01:58.256 INFO:teuthology.orchestra.run.smithi072.stdout:156 2024-04-04T07:01:58.256 INFO:teuthology.orchestra.run.smithi072.stdout:156.out 2024-04-04T07:01:58.256 INFO:teuthology.orchestra.run.smithi072.stdout:157 2024-04-04T07:01:58.256 INFO:teuthology.orchestra.run.smithi072.stdout:157.out 2024-04-04T07:01:58.256 INFO:teuthology.orchestra.run.smithi072.stdout:158 2024-04-04T07:01:58.256 INFO:teuthology.orchestra.run.smithi072.stdout:158.out 2024-04-04T07:01:58.256 INFO:teuthology.orchestra.run.smithi072.stdout:159 2024-04-04T07:01:58.256 INFO:teuthology.orchestra.run.smithi072.stdout:159.out 2024-04-04T07:01:58.256 INFO:teuthology.orchestra.run.smithi072.stdout:160 2024-04-04T07:01:58.256 INFO:teuthology.orchestra.run.smithi072.stdout:160.out 2024-04-04T07:01:58.256 INFO:teuthology.orchestra.run.smithi072.stdout:161 2024-04-04T07:01:58.256 INFO:teuthology.orchestra.run.smithi072.stdout:161.out 2024-04-04T07:01:58.256 INFO:teuthology.orchestra.run.smithi072.stdout:162 2024-04-04T07:01:58.256 INFO:teuthology.orchestra.run.smithi072.stdout:162.out 2024-04-04T07:01:58.257 INFO:teuthology.orchestra.run.smithi072.stdout:163 2024-04-04T07:01:58.257 INFO:teuthology.orchestra.run.smithi072.stdout:163.out 2024-04-04T07:01:58.257 INFO:teuthology.orchestra.run.smithi072.stdout:164 2024-04-04T07:01:58.257 INFO:teuthology.orchestra.run.smithi072.stdout:164.out 2024-04-04T07:01:58.257 INFO:teuthology.orchestra.run.smithi072.stdout:165 2024-04-04T07:01:58.257 INFO:teuthology.orchestra.run.smithi072.stdout:165.out 2024-04-04T07:01:58.257 INFO:teuthology.orchestra.run.smithi072.stdout:166 2024-04-04T07:01:58.257 INFO:teuthology.orchestra.run.smithi072.stdout:166.out 2024-04-04T07:01:58.257 INFO:teuthology.orchestra.run.smithi072.stdout:167 2024-04-04T07:01:58.257 INFO:teuthology.orchestra.run.smithi072.stdout:167.out 2024-04-04T07:01:58.257 INFO:teuthology.orchestra.run.smithi072.stdout:168 2024-04-04T07:01:58.257 INFO:teuthology.orchestra.run.smithi072.stdout:168.out 2024-04-04T07:01:58.257 INFO:teuthology.orchestra.run.smithi072.stdout:169 2024-04-04T07:01:58.257 INFO:teuthology.orchestra.run.smithi072.stdout:169.out 2024-04-04T07:01:58.257 INFO:teuthology.orchestra.run.smithi072.stdout:170 2024-04-04T07:01:58.258 INFO:teuthology.orchestra.run.smithi072.stdout:170.out 2024-04-04T07:01:58.258 INFO:teuthology.orchestra.run.smithi072.stdout:171 2024-04-04T07:01:58.258 INFO:teuthology.orchestra.run.smithi072.stdout:171.out 2024-04-04T07:01:58.258 INFO:teuthology.orchestra.run.smithi072.stdout:172 2024-04-04T07:01:58.258 INFO:teuthology.orchestra.run.smithi072.stdout:172.out 2024-04-04T07:01:58.258 INFO:teuthology.orchestra.run.smithi072.stdout:173 2024-04-04T07:01:58.258 INFO:teuthology.orchestra.run.smithi072.stdout:173.out 2024-04-04T07:01:58.258 INFO:teuthology.orchestra.run.smithi072.stdout:174 2024-04-04T07:01:58.258 INFO:teuthology.orchestra.run.smithi072.stdout:174.out 2024-04-04T07:01:58.258 INFO:teuthology.orchestra.run.smithi072.stdout:175 2024-04-04T07:01:58.258 INFO:teuthology.orchestra.run.smithi072.stdout:175.out 2024-04-04T07:01:58.258 INFO:teuthology.orchestra.run.smithi072.stdout:176 2024-04-04T07:01:58.259 INFO:teuthology.orchestra.run.smithi072.stdout:176.out 2024-04-04T07:01:58.259 INFO:teuthology.orchestra.run.smithi072.stdout:177 2024-04-04T07:01:58.259 INFO:teuthology.orchestra.run.smithi072.stdout:177.out 2024-04-04T07:01:58.259 INFO:teuthology.orchestra.run.smithi072.stdout:178 2024-04-04T07:01:58.259 INFO:teuthology.orchestra.run.smithi072.stdout:178.out 2024-04-04T07:01:58.259 INFO:teuthology.orchestra.run.smithi072.stdout:179 2024-04-04T07:01:58.259 INFO:teuthology.orchestra.run.smithi072.stdout:179.out 2024-04-04T07:01:58.259 INFO:teuthology.orchestra.run.smithi072.stdout:180 2024-04-04T07:01:58.259 INFO:teuthology.orchestra.run.smithi072.stdout:180.out 2024-04-04T07:01:58.259 INFO:teuthology.orchestra.run.smithi072.stdout:181 2024-04-04T07:01:58.259 INFO:teuthology.orchestra.run.smithi072.stdout:181.out 2024-04-04T07:01:58.259 INFO:teuthology.orchestra.run.smithi072.stdout:182 2024-04-04T07:01:58.259 INFO:teuthology.orchestra.run.smithi072.stdout:182.out 2024-04-04T07:01:58.259 INFO:teuthology.orchestra.run.smithi072.stdout:183 2024-04-04T07:01:58.260 INFO:teuthology.orchestra.run.smithi072.stdout:183.out 2024-04-04T07:01:58.260 INFO:teuthology.orchestra.run.smithi072.stdout:184 2024-04-04T07:01:58.260 INFO:teuthology.orchestra.run.smithi072.stdout:184.out 2024-04-04T07:01:58.260 INFO:teuthology.orchestra.run.smithi072.stdout:185 2024-04-04T07:01:58.260 INFO:teuthology.orchestra.run.smithi072.stdout:185.out 2024-04-04T07:01:58.260 INFO:teuthology.orchestra.run.smithi072.stdout:186 2024-04-04T07:01:58.260 INFO:teuthology.orchestra.run.smithi072.stdout:186.out 2024-04-04T07:01:58.260 INFO:teuthology.orchestra.run.smithi072.stdout:187 2024-04-04T07:01:58.260 INFO:teuthology.orchestra.run.smithi072.stdout:187.out 2024-04-04T07:01:58.260 INFO:teuthology.orchestra.run.smithi072.stdout:188 2024-04-04T07:01:58.260 INFO:teuthology.orchestra.run.smithi072.stdout:188.out 2024-04-04T07:01:58.260 INFO:teuthology.orchestra.run.smithi072.stdout:189 2024-04-04T07:01:58.260 INFO:teuthology.orchestra.run.smithi072.stdout:189.out 2024-04-04T07:01:58.260 INFO:teuthology.orchestra.run.smithi072.stdout:190 2024-04-04T07:01:58.260 INFO:teuthology.orchestra.run.smithi072.stdout:190.out 2024-04-04T07:01:58.261 INFO:teuthology.orchestra.run.smithi072.stdout:191 2024-04-04T07:01:58.261 INFO:teuthology.orchestra.run.smithi072.stdout:191.out 2024-04-04T07:01:58.261 INFO:teuthology.orchestra.run.smithi072.stdout:192 2024-04-04T07:01:58.261 INFO:teuthology.orchestra.run.smithi072.stdout:192.out 2024-04-04T07:01:58.261 INFO:teuthology.orchestra.run.smithi072.stdout:193 2024-04-04T07:01:58.261 INFO:teuthology.orchestra.run.smithi072.stdout:193.out 2024-04-04T07:01:58.261 INFO:teuthology.orchestra.run.smithi072.stdout:194 2024-04-04T07:01:58.261 INFO:teuthology.orchestra.run.smithi072.stdout:194.out 2024-04-04T07:01:58.261 INFO:teuthology.orchestra.run.smithi072.stdout:195 2024-04-04T07:01:58.261 INFO:teuthology.orchestra.run.smithi072.stdout:195.out 2024-04-04T07:01:58.261 INFO:teuthology.orchestra.run.smithi072.stdout:196 2024-04-04T07:01:58.261 INFO:teuthology.orchestra.run.smithi072.stdout:196.out 2024-04-04T07:01:58.261 INFO:teuthology.orchestra.run.smithi072.stdout:197 2024-04-04T07:01:58.261 INFO:teuthology.orchestra.run.smithi072.stdout:197.out 2024-04-04T07:01:58.262 INFO:teuthology.orchestra.run.smithi072.stdout:198 2024-04-04T07:01:58.262 INFO:teuthology.orchestra.run.smithi072.stdout:198.out 2024-04-04T07:01:58.262 INFO:teuthology.orchestra.run.smithi072.stdout:199 2024-04-04T07:01:58.262 INFO:teuthology.orchestra.run.smithi072.stdout:199.out 2024-04-04T07:01:58.262 INFO:teuthology.orchestra.run.smithi072.stdout:200 2024-04-04T07:01:58.262 INFO:teuthology.orchestra.run.smithi072.stdout:200.out 2024-04-04T07:01:58.262 INFO:teuthology.orchestra.run.smithi072.stdout:201 2024-04-04T07:01:58.262 INFO:teuthology.orchestra.run.smithi072.stdout:201.out 2024-04-04T07:01:58.263 INFO:teuthology.orchestra.run.smithi072.stdout:202 2024-04-04T07:01:58.263 INFO:teuthology.orchestra.run.smithi072.stdout:202.out 2024-04-04T07:01:58.263 INFO:teuthology.orchestra.run.smithi072.stdout:203 2024-04-04T07:01:58.263 INFO:teuthology.orchestra.run.smithi072.stdout:203.out 2024-04-04T07:01:58.263 INFO:teuthology.orchestra.run.smithi072.stdout:204 2024-04-04T07:01:58.263 INFO:teuthology.orchestra.run.smithi072.stdout:204.out 2024-04-04T07:01:58.263 INFO:teuthology.orchestra.run.smithi072.stdout:205 2024-04-04T07:01:58.263 INFO:teuthology.orchestra.run.smithi072.stdout:205.out 2024-04-04T07:01:58.263 INFO:teuthology.orchestra.run.smithi072.stdout:206 2024-04-04T07:01:58.263 INFO:teuthology.orchestra.run.smithi072.stdout:206.out 2024-04-04T07:01:58.263 INFO:teuthology.orchestra.run.smithi072.stdout:207 2024-04-04T07:01:58.263 INFO:teuthology.orchestra.run.smithi072.stdout:207.out 2024-04-04T07:01:58.263 INFO:teuthology.orchestra.run.smithi072.stdout:208 2024-04-04T07:01:58.263 INFO:teuthology.orchestra.run.smithi072.stdout:208.out 2024-04-04T07:01:58.263 INFO:teuthology.orchestra.run.smithi072.stdout:209 2024-04-04T07:01:58.264 INFO:teuthology.orchestra.run.smithi072.stdout:209.out 2024-04-04T07:01:58.264 INFO:teuthology.orchestra.run.smithi072.stdout:210 2024-04-04T07:01:58.264 INFO:teuthology.orchestra.run.smithi072.stdout:210.out 2024-04-04T07:01:58.264 INFO:teuthology.orchestra.run.smithi072.stdout:211 2024-04-04T07:01:58.264 INFO:teuthology.orchestra.run.smithi072.stdout:211.out 2024-04-04T07:01:58.264 INFO:teuthology.orchestra.run.smithi072.stdout:212 2024-04-04T07:01:58.264 INFO:teuthology.orchestra.run.smithi072.stdout:212.out 2024-04-04T07:01:58.264 INFO:teuthology.orchestra.run.smithi072.stdout:213 2024-04-04T07:01:58.264 INFO:teuthology.orchestra.run.smithi072.stdout:213.out 2024-04-04T07:01:58.264 INFO:teuthology.orchestra.run.smithi072.stdout:214 2024-04-04T07:01:58.264 INFO:teuthology.orchestra.run.smithi072.stdout:214.out 2024-04-04T07:01:58.264 INFO:teuthology.orchestra.run.smithi072.stdout:215 2024-04-04T07:01:58.264 INFO:teuthology.orchestra.run.smithi072.stdout:215.out 2024-04-04T07:01:58.264 INFO:teuthology.orchestra.run.smithi072.stdout:216 2024-04-04T07:01:58.265 INFO:teuthology.orchestra.run.smithi072.stdout:216.out 2024-04-04T07:01:58.265 INFO:teuthology.orchestra.run.smithi072.stdout:217 2024-04-04T07:01:58.265 INFO:teuthology.orchestra.run.smithi072.stdout:217.out 2024-04-04T07:01:58.265 INFO:teuthology.orchestra.run.smithi072.stdout:218 2024-04-04T07:01:58.265 INFO:teuthology.orchestra.run.smithi072.stdout:218.out 2024-04-04T07:01:58.265 INFO:teuthology.orchestra.run.smithi072.stdout:219 2024-04-04T07:01:58.265 INFO:teuthology.orchestra.run.smithi072.stdout:219.out 2024-04-04T07:01:58.265 INFO:teuthology.orchestra.run.smithi072.stdout:220 2024-04-04T07:01:58.265 INFO:teuthology.orchestra.run.smithi072.stdout:220.out 2024-04-04T07:01:58.265 INFO:teuthology.orchestra.run.smithi072.stdout:221 2024-04-04T07:01:58.266 INFO:teuthology.orchestra.run.smithi072.stdout:221.out 2024-04-04T07:01:58.266 INFO:teuthology.orchestra.run.smithi072.stdout:222 2024-04-04T07:01:58.266 INFO:teuthology.orchestra.run.smithi072.stdout:222.out 2024-04-04T07:01:58.266 INFO:teuthology.orchestra.run.smithi072.stdout:223 2024-04-04T07:01:58.266 INFO:teuthology.orchestra.run.smithi072.stdout:223.out 2024-04-04T07:01:58.266 INFO:teuthology.orchestra.run.smithi072.stdout:224 2024-04-04T07:01:58.266 INFO:teuthology.orchestra.run.smithi072.stdout:224.out 2024-04-04T07:01:58.266 INFO:teuthology.orchestra.run.smithi072.stdout:225 2024-04-04T07:01:58.266 INFO:teuthology.orchestra.run.smithi072.stdout:225.out 2024-04-04T07:01:58.267 INFO:teuthology.orchestra.run.smithi072.stdout:226 2024-04-04T07:01:58.267 INFO:teuthology.orchestra.run.smithi072.stdout:226.out 2024-04-04T07:01:58.267 INFO:teuthology.orchestra.run.smithi072.stdout:227 2024-04-04T07:01:58.267 INFO:teuthology.orchestra.run.smithi072.stdout:227.out 2024-04-04T07:01:58.267 INFO:teuthology.orchestra.run.smithi072.stdout:228 2024-04-04T07:01:58.268 INFO:teuthology.orchestra.run.smithi072.stdout:228.out 2024-04-04T07:01:58.268 INFO:teuthology.orchestra.run.smithi072.stdout:229 2024-04-04T07:01:58.268 INFO:teuthology.orchestra.run.smithi072.stdout:229.out 2024-04-04T07:01:58.268 INFO:teuthology.orchestra.run.smithi072.stdout:230 2024-04-04T07:01:58.268 INFO:teuthology.orchestra.run.smithi072.stdout:230.out 2024-04-04T07:01:58.268 INFO:teuthology.orchestra.run.smithi072.stdout:231 2024-04-04T07:01:58.269 INFO:teuthology.orchestra.run.smithi072.stdout:231.out 2024-04-04T07:01:58.269 INFO:teuthology.orchestra.run.smithi072.stdout:232 2024-04-04T07:01:58.269 INFO:teuthology.orchestra.run.smithi072.stdout:232.out 2024-04-04T07:01:58.269 INFO:teuthology.orchestra.run.smithi072.stdout:233 2024-04-04T07:01:58.269 INFO:teuthology.orchestra.run.smithi072.stdout:233.out 2024-04-04T07:01:58.269 INFO:teuthology.orchestra.run.smithi072.stdout:234 2024-04-04T07:01:58.270 INFO:teuthology.orchestra.run.smithi072.stdout:234.out 2024-04-04T07:01:58.270 INFO:teuthology.orchestra.run.smithi072.stdout:235 2024-04-04T07:01:58.270 INFO:teuthology.orchestra.run.smithi072.stdout:235.out 2024-04-04T07:01:58.270 INFO:teuthology.orchestra.run.smithi072.stdout:236 2024-04-04T07:01:58.270 INFO:teuthology.orchestra.run.smithi072.stdout:236.out 2024-04-04T07:01:58.271 INFO:teuthology.orchestra.run.smithi072.stdout:237 2024-04-04T07:01:58.271 INFO:teuthology.orchestra.run.smithi072.stdout:237.out 2024-04-04T07:01:58.271 INFO:teuthology.orchestra.run.smithi072.stdout:238 2024-04-04T07:01:58.271 INFO:teuthology.orchestra.run.smithi072.stdout:238.out 2024-04-04T07:01:58.271 INFO:teuthology.orchestra.run.smithi072.stdout:239 2024-04-04T07:01:58.271 INFO:teuthology.orchestra.run.smithi072.stdout:239.out 2024-04-04T07:01:58.272 INFO:teuthology.orchestra.run.smithi072.stdout:240 2024-04-04T07:01:58.272 INFO:teuthology.orchestra.run.smithi072.stdout:240.out 2024-04-04T07:01:58.272 INFO:teuthology.orchestra.run.smithi072.stdout:241 2024-04-04T07:01:58.272 INFO:teuthology.orchestra.run.smithi072.stdout:241.out 2024-04-04T07:01:58.272 INFO:teuthology.orchestra.run.smithi072.stdout:242 2024-04-04T07:01:58.272 INFO:teuthology.orchestra.run.smithi072.stdout:242.out 2024-04-04T07:01:58.273 INFO:teuthology.orchestra.run.smithi072.stdout:243 2024-04-04T07:01:58.273 INFO:teuthology.orchestra.run.smithi072.stdout:243.out 2024-04-04T07:01:58.273 INFO:teuthology.orchestra.run.smithi072.stdout:244 2024-04-04T07:01:58.273 INFO:teuthology.orchestra.run.smithi072.stdout:244.out 2024-04-04T07:01:58.273 INFO:teuthology.orchestra.run.smithi072.stdout:245 2024-04-04T07:01:58.273 INFO:teuthology.orchestra.run.smithi072.stdout:245.out 2024-04-04T07:01:58.274 INFO:teuthology.orchestra.run.smithi072.stdout:246 2024-04-04T07:01:58.274 INFO:teuthology.orchestra.run.smithi072.stdout:246.out 2024-04-04T07:01:58.274 INFO:teuthology.orchestra.run.smithi072.stdout:247 2024-04-04T07:01:58.274 INFO:teuthology.orchestra.run.smithi072.stdout:247.out 2024-04-04T07:01:58.274 INFO:teuthology.orchestra.run.smithi072.stdout:248 2024-04-04T07:01:58.274 INFO:teuthology.orchestra.run.smithi072.stdout:248.out 2024-04-04T07:01:58.275 INFO:teuthology.orchestra.run.smithi072.stdout:249 2024-04-04T07:01:58.275 INFO:teuthology.orchestra.run.smithi072.stdout:249.out 2024-04-04T07:01:58.275 INFO:teuthology.orchestra.run.smithi072.stdout:250 2024-04-04T07:01:58.275 INFO:teuthology.orchestra.run.smithi072.stdout:250.out 2024-04-04T07:01:58.275 INFO:teuthology.orchestra.run.smithi072.stdout:251 2024-04-04T07:01:58.275 INFO:teuthology.orchestra.run.smithi072.stdout:251.out 2024-04-04T07:01:58.275 INFO:teuthology.orchestra.run.smithi072.stdout:252 2024-04-04T07:01:58.276 INFO:teuthology.orchestra.run.smithi072.stdout:252.out 2024-04-04T07:01:58.276 INFO:teuthology.orchestra.run.smithi072.stdout:253 2024-04-04T07:01:58.276 INFO:teuthology.orchestra.run.smithi072.stdout:253.out 2024-04-04T07:01:58.276 INFO:teuthology.orchestra.run.smithi072.stdout:254 2024-04-04T07:01:58.276 INFO:teuthology.orchestra.run.smithi072.stdout:254.out 2024-04-04T07:01:58.276 INFO:teuthology.orchestra.run.smithi072.stdout:255 2024-04-04T07:01:58.276 INFO:teuthology.orchestra.run.smithi072.stdout:255.out 2024-04-04T07:01:58.276 INFO:teuthology.orchestra.run.smithi072.stdout:256 2024-04-04T07:01:58.276 INFO:teuthology.orchestra.run.smithi072.stdout:256.out 2024-04-04T07:01:58.277 INFO:teuthology.orchestra.run.smithi072.stdout:257 2024-04-04T07:01:58.277 INFO:teuthology.orchestra.run.smithi072.stdout:257.out 2024-04-04T07:01:58.277 INFO:teuthology.orchestra.run.smithi072.stdout:258 2024-04-04T07:01:58.277 INFO:teuthology.orchestra.run.smithi072.stdout:258.out 2024-04-04T07:01:58.277 INFO:teuthology.orchestra.run.smithi072.stdout:259 2024-04-04T07:01:58.277 INFO:teuthology.orchestra.run.smithi072.stdout:259.out 2024-04-04T07:01:58.278 INFO:teuthology.orchestra.run.smithi072.stdout:260 2024-04-04T07:01:58.278 INFO:teuthology.orchestra.run.smithi072.stdout:260.out 2024-04-04T07:01:58.278 INFO:teuthology.orchestra.run.smithi072.stdout:261 2024-04-04T07:01:58.278 INFO:teuthology.orchestra.run.smithi072.stdout:261.out 2024-04-04T07:01:58.278 INFO:teuthology.orchestra.run.smithi072.stdout:262 2024-04-04T07:01:58.278 INFO:teuthology.orchestra.run.smithi072.stdout:262.out 2024-04-04T07:01:58.278 INFO:teuthology.orchestra.run.smithi072.stdout:263 2024-04-04T07:01:58.278 INFO:teuthology.orchestra.run.smithi072.stdout:263.out 2024-04-04T07:01:58.279 INFO:teuthology.orchestra.run.smithi072.stdout:264 2024-04-04T07:01:58.279 INFO:teuthology.orchestra.run.smithi072.stdout:264.out 2024-04-04T07:01:58.279 INFO:teuthology.orchestra.run.smithi072.stdout:265 2024-04-04T07:01:58.279 INFO:teuthology.orchestra.run.smithi072.stdout:265.out 2024-04-04T07:01:58.279 INFO:teuthology.orchestra.run.smithi072.stdout:266 2024-04-04T07:01:58.279 INFO:teuthology.orchestra.run.smithi072.stdout:266.out 2024-04-04T07:01:58.279 INFO:teuthology.orchestra.run.smithi072.stdout:267 2024-04-04T07:01:58.279 INFO:teuthology.orchestra.run.smithi072.stdout:267.out 2024-04-04T07:01:58.279 INFO:teuthology.orchestra.run.smithi072.stdout:268 2024-04-04T07:01:58.279 INFO:teuthology.orchestra.run.smithi072.stdout:268.out 2024-04-04T07:01:58.279 INFO:teuthology.orchestra.run.smithi072.stdout:269 2024-04-04T07:01:58.279 INFO:teuthology.orchestra.run.smithi072.stdout:269.out 2024-04-04T07:01:58.279 INFO:teuthology.orchestra.run.smithi072.stdout:270 2024-04-04T07:01:58.279 INFO:teuthology.orchestra.run.smithi072.stdout:270.out 2024-04-04T07:01:58.279 INFO:teuthology.orchestra.run.smithi072.stdout:271 2024-04-04T07:01:58.280 INFO:teuthology.orchestra.run.smithi072.stdout:271.out 2024-04-04T07:01:58.280 INFO:teuthology.orchestra.run.smithi072.stdout:272 2024-04-04T07:01:58.280 INFO:teuthology.orchestra.run.smithi072.stdout:272.out 2024-04-04T07:01:58.280 INFO:teuthology.orchestra.run.smithi072.stdout:273 2024-04-04T07:01:58.280 INFO:teuthology.orchestra.run.smithi072.stdout:273.out 2024-04-04T07:01:58.280 INFO:teuthology.orchestra.run.smithi072.stdout:274 2024-04-04T07:01:58.280 INFO:teuthology.orchestra.run.smithi072.stdout:274.out 2024-04-04T07:01:58.280 INFO:teuthology.orchestra.run.smithi072.stdout:275 2024-04-04T07:01:58.280 INFO:teuthology.orchestra.run.smithi072.stdout:275.out 2024-04-04T07:01:58.280 INFO:teuthology.orchestra.run.smithi072.stdout:276 2024-04-04T07:01:58.280 INFO:teuthology.orchestra.run.smithi072.stdout:276.out 2024-04-04T07:01:58.280 INFO:teuthology.orchestra.run.smithi072.stdout:277 2024-04-04T07:01:58.280 INFO:teuthology.orchestra.run.smithi072.stdout:277.out 2024-04-04T07:01:58.281 INFO:teuthology.orchestra.run.smithi072.stdout:278 2024-04-04T07:01:58.281 INFO:teuthology.orchestra.run.smithi072.stdout:278.out 2024-04-04T07:01:58.281 INFO:teuthology.orchestra.run.smithi072.stdout:279 2024-04-04T07:01:58.281 INFO:teuthology.orchestra.run.smithi072.stdout:279.out 2024-04-04T07:01:58.281 INFO:teuthology.orchestra.run.smithi072.stdout:280 2024-04-04T07:01:58.281 INFO:teuthology.orchestra.run.smithi072.stdout:280.out 2024-04-04T07:01:58.281 INFO:teuthology.orchestra.run.smithi072.stdout:281 2024-04-04T07:01:58.281 INFO:teuthology.orchestra.run.smithi072.stdout:281.out 2024-04-04T07:01:58.281 INFO:teuthology.orchestra.run.smithi072.stdout:282 2024-04-04T07:01:58.281 INFO:teuthology.orchestra.run.smithi072.stdout:282.out 2024-04-04T07:01:58.281 INFO:teuthology.orchestra.run.smithi072.stdout:283 2024-04-04T07:01:58.281 INFO:teuthology.orchestra.run.smithi072.stdout:283.out 2024-04-04T07:01:58.281 INFO:teuthology.orchestra.run.smithi072.stdout:284 2024-04-04T07:01:58.281 INFO:teuthology.orchestra.run.smithi072.stdout:284.out 2024-04-04T07:01:58.282 INFO:teuthology.orchestra.run.smithi072.stdout:285 2024-04-04T07:01:58.282 INFO:teuthology.orchestra.run.smithi072.stdout:285.out 2024-04-04T07:01:58.282 INFO:teuthology.orchestra.run.smithi072.stdout:286 2024-04-04T07:01:58.282 INFO:teuthology.orchestra.run.smithi072.stdout:286.out 2024-04-04T07:01:58.282 INFO:teuthology.orchestra.run.smithi072.stdout:287 2024-04-04T07:01:58.282 INFO:teuthology.orchestra.run.smithi072.stdout:287.out 2024-04-04T07:01:58.282 INFO:teuthology.orchestra.run.smithi072.stdout:288 2024-04-04T07:01:58.282 INFO:teuthology.orchestra.run.smithi072.stdout:288.out 2024-04-04T07:01:58.282 INFO:teuthology.orchestra.run.smithi072.stdout:289 2024-04-04T07:01:58.282 INFO:teuthology.orchestra.run.smithi072.stdout:289.out 2024-04-04T07:01:58.282 INFO:teuthology.orchestra.run.smithi072.stdout:290 2024-04-04T07:01:58.282 INFO:teuthology.orchestra.run.smithi072.stdout:290.out 2024-04-04T07:01:58.282 INFO:teuthology.orchestra.run.smithi072.stdout:291 2024-04-04T07:01:58.283 INFO:teuthology.orchestra.run.smithi072.stdout:291.out 2024-04-04T07:01:58.283 INFO:teuthology.orchestra.run.smithi072.stdout:292 2024-04-04T07:01:58.283 INFO:teuthology.orchestra.run.smithi072.stdout:292.out 2024-04-04T07:01:58.283 INFO:teuthology.orchestra.run.smithi072.stdout:293 2024-04-04T07:01:58.283 INFO:teuthology.orchestra.run.smithi072.stdout:293.out 2024-04-04T07:01:58.283 INFO:teuthology.orchestra.run.smithi072.stdout:294 2024-04-04T07:01:58.283 INFO:teuthology.orchestra.run.smithi072.stdout:294.out 2024-04-04T07:01:58.283 INFO:teuthology.orchestra.run.smithi072.stdout:295 2024-04-04T07:01:58.283 INFO:teuthology.orchestra.run.smithi072.stdout:295.out 2024-04-04T07:01:58.283 INFO:teuthology.orchestra.run.smithi072.stdout:296 2024-04-04T07:01:58.283 INFO:teuthology.orchestra.run.smithi072.stdout:296.out 2024-04-04T07:01:58.283 INFO:teuthology.orchestra.run.smithi072.stdout:297 2024-04-04T07:01:58.283 INFO:teuthology.orchestra.run.smithi072.stdout:297.out 2024-04-04T07:01:58.284 INFO:teuthology.orchestra.run.smithi072.stdout:298 2024-04-04T07:01:58.284 INFO:teuthology.orchestra.run.smithi072.stdout:298.out 2024-04-04T07:01:58.284 INFO:teuthology.orchestra.run.smithi072.stdout:299 2024-04-04T07:01:58.284 INFO:teuthology.orchestra.run.smithi072.stdout:299.out 2024-04-04T07:01:58.284 INFO:teuthology.orchestra.run.smithi072.stdout:300 2024-04-04T07:01:58.284 INFO:teuthology.orchestra.run.smithi072.stdout:300.out 2024-04-04T07:01:58.284 INFO:teuthology.orchestra.run.smithi072.stdout:301 2024-04-04T07:01:58.284 INFO:teuthology.orchestra.run.smithi072.stdout:301.out 2024-04-04T07:01:58.284 INFO:teuthology.orchestra.run.smithi072.stdout:302 2024-04-04T07:01:58.284 INFO:teuthology.orchestra.run.smithi072.stdout:302.out 2024-04-04T07:01:58.285 INFO:teuthology.orchestra.run.smithi072.stdout:303 2024-04-04T07:01:58.285 INFO:teuthology.orchestra.run.smithi072.stdout:303.out 2024-04-04T07:01:58.285 INFO:teuthology.orchestra.run.smithi072.stdout:304 2024-04-04T07:01:58.285 INFO:teuthology.orchestra.run.smithi072.stdout:304.out 2024-04-04T07:01:58.285 INFO:teuthology.orchestra.run.smithi072.stdout:305 2024-04-04T07:01:58.285 INFO:teuthology.orchestra.run.smithi072.stdout:305.out 2024-04-04T07:01:58.285 INFO:teuthology.orchestra.run.smithi072.stdout:306 2024-04-04T07:01:58.285 INFO:teuthology.orchestra.run.smithi072.stdout:306.out 2024-04-04T07:01:58.285 INFO:teuthology.orchestra.run.smithi072.stdout:307 2024-04-04T07:01:58.285 INFO:teuthology.orchestra.run.smithi072.stdout:307.out 2024-04-04T07:01:58.286 INFO:teuthology.orchestra.run.smithi072.stdout:308 2024-04-04T07:01:58.286 INFO:teuthology.orchestra.run.smithi072.stdout:308.out 2024-04-04T07:01:58.286 INFO:teuthology.orchestra.run.smithi072.stdout:309 2024-04-04T07:01:58.286 INFO:teuthology.orchestra.run.smithi072.stdout:309.out 2024-04-04T07:01:58.286 INFO:teuthology.orchestra.run.smithi072.stdout:310 2024-04-04T07:01:58.286 INFO:teuthology.orchestra.run.smithi072.stdout:310.out 2024-04-04T07:01:58.286 INFO:teuthology.orchestra.run.smithi072.stdout:311 2024-04-04T07:01:58.286 INFO:teuthology.orchestra.run.smithi072.stdout:311.out 2024-04-04T07:01:58.286 INFO:teuthology.orchestra.run.smithi072.stdout:312 2024-04-04T07:01:58.286 INFO:teuthology.orchestra.run.smithi072.stdout:312.out 2024-04-04T07:01:58.287 INFO:teuthology.orchestra.run.smithi072.stdout:313 2024-04-04T07:01:58.287 INFO:teuthology.orchestra.run.smithi072.stdout:313.out 2024-04-04T07:01:58.287 INFO:teuthology.orchestra.run.smithi072.stdout:314 2024-04-04T07:01:58.287 INFO:teuthology.orchestra.run.smithi072.stdout:314.out 2024-04-04T07:01:58.287 INFO:teuthology.orchestra.run.smithi072.stdout:315 2024-04-04T07:01:58.287 INFO:teuthology.orchestra.run.smithi072.stdout:315.out 2024-04-04T07:01:58.288 INFO:teuthology.orchestra.run.smithi072.stdout:316 2024-04-04T07:01:58.288 INFO:teuthology.orchestra.run.smithi072.stdout:316.out 2024-04-04T07:01:58.288 INFO:teuthology.orchestra.run.smithi072.stdout:317 2024-04-04T07:01:58.288 INFO:teuthology.orchestra.run.smithi072.stdout:317.out 2024-04-04T07:01:58.289 INFO:teuthology.orchestra.run.smithi072.stdout:318 2024-04-04T07:01:58.289 INFO:teuthology.orchestra.run.smithi072.stdout:318.out 2024-04-04T07:01:58.289 INFO:teuthology.orchestra.run.smithi072.stdout:319 2024-04-04T07:01:58.289 INFO:teuthology.orchestra.run.smithi072.stdout:319.out 2024-04-04T07:01:58.289 INFO:teuthology.orchestra.run.smithi072.stdout:320 2024-04-04T07:01:58.289 INFO:teuthology.orchestra.run.smithi072.stdout:320.out 2024-04-04T07:01:58.289 INFO:teuthology.orchestra.run.smithi072.stdout:321 2024-04-04T07:01:58.289 INFO:teuthology.orchestra.run.smithi072.stdout:321.out 2024-04-04T07:01:58.289 INFO:teuthology.orchestra.run.smithi072.stdout:322 2024-04-04T07:01:58.289 INFO:teuthology.orchestra.run.smithi072.stdout:322.out 2024-04-04T07:01:58.289 INFO:teuthology.orchestra.run.smithi072.stdout:323 2024-04-04T07:01:58.289 INFO:teuthology.orchestra.run.smithi072.stdout:323.out 2024-04-04T07:01:58.289 INFO:teuthology.orchestra.run.smithi072.stdout:324 2024-04-04T07:01:58.289 INFO:teuthology.orchestra.run.smithi072.stdout:324.out 2024-04-04T07:01:58.290 INFO:teuthology.orchestra.run.smithi072.stdout:325 2024-04-04T07:01:58.290 INFO:teuthology.orchestra.run.smithi072.stdout:325.out 2024-04-04T07:01:58.290 INFO:teuthology.orchestra.run.smithi072.stdout:326 2024-04-04T07:01:58.290 INFO:teuthology.orchestra.run.smithi072.stdout:326.out 2024-04-04T07:01:58.290 INFO:teuthology.orchestra.run.smithi072.stdout:327 2024-04-04T07:01:58.290 INFO:teuthology.orchestra.run.smithi072.stdout:327.out 2024-04-04T07:01:58.290 INFO:teuthology.orchestra.run.smithi072.stdout:328 2024-04-04T07:01:58.290 INFO:teuthology.orchestra.run.smithi072.stdout:328.out 2024-04-04T07:01:58.290 INFO:teuthology.orchestra.run.smithi072.stdout:329 2024-04-04T07:01:58.290 INFO:teuthology.orchestra.run.smithi072.stdout:329.out 2024-04-04T07:01:58.290 INFO:teuthology.orchestra.run.smithi072.stdout:330 2024-04-04T07:01:58.290 INFO:teuthology.orchestra.run.smithi072.stdout:330.out 2024-04-04T07:01:58.290 INFO:teuthology.orchestra.run.smithi072.stdout:331 2024-04-04T07:01:58.291 INFO:teuthology.orchestra.run.smithi072.stdout:331.out 2024-04-04T07:01:58.291 INFO:teuthology.orchestra.run.smithi072.stdout:332 2024-04-04T07:01:58.291 INFO:teuthology.orchestra.run.smithi072.stdout:332.out 2024-04-04T07:01:58.291 INFO:teuthology.orchestra.run.smithi072.stdout:333 2024-04-04T07:01:58.291 INFO:teuthology.orchestra.run.smithi072.stdout:333.out 2024-04-04T07:01:58.291 INFO:teuthology.orchestra.run.smithi072.stdout:334 2024-04-04T07:01:58.291 INFO:teuthology.orchestra.run.smithi072.stdout:334.out 2024-04-04T07:01:58.291 INFO:teuthology.orchestra.run.smithi072.stdout:335 2024-04-04T07:01:58.291 INFO:teuthology.orchestra.run.smithi072.stdout:335.out 2024-04-04T07:01:58.291 INFO:teuthology.orchestra.run.smithi072.stdout:336 2024-04-04T07:01:58.291 INFO:teuthology.orchestra.run.smithi072.stdout:336.out 2024-04-04T07:01:58.291 INFO:teuthology.orchestra.run.smithi072.stdout:337 2024-04-04T07:01:58.291 INFO:teuthology.orchestra.run.smithi072.stdout:337.out 2024-04-04T07:01:58.291 INFO:teuthology.orchestra.run.smithi072.stdout:338 2024-04-04T07:01:58.291 INFO:teuthology.orchestra.run.smithi072.stdout:338.out 2024-04-04T07:01:58.292 INFO:teuthology.orchestra.run.smithi072.stdout:339 2024-04-04T07:01:58.292 INFO:teuthology.orchestra.run.smithi072.stdout:339.out 2024-04-04T07:01:58.292 INFO:teuthology.orchestra.run.smithi072.stdout:340 2024-04-04T07:01:58.292 INFO:teuthology.orchestra.run.smithi072.stdout:340.out 2024-04-04T07:01:58.293 INFO:teuthology.orchestra.run.smithi072.stdout:341 2024-04-04T07:01:58.293 INFO:teuthology.orchestra.run.smithi072.stdout:341.out 2024-04-04T07:01:58.293 INFO:teuthology.orchestra.run.smithi072.stdout:342 2024-04-04T07:01:58.293 INFO:teuthology.orchestra.run.smithi072.stdout:342.out 2024-04-04T07:01:58.293 INFO:teuthology.orchestra.run.smithi072.stdout:343 2024-04-04T07:01:58.293 INFO:teuthology.orchestra.run.smithi072.stdout:343.out 2024-04-04T07:01:58.293 INFO:teuthology.orchestra.run.smithi072.stdout:344 2024-04-04T07:01:58.293 INFO:teuthology.orchestra.run.smithi072.stdout:344.out 2024-04-04T07:01:58.293 INFO:teuthology.orchestra.run.smithi072.stdout:345 2024-04-04T07:01:58.293 INFO:teuthology.orchestra.run.smithi072.stdout:345.out 2024-04-04T07:01:58.293 INFO:teuthology.orchestra.run.smithi072.stdout:346 2024-04-04T07:01:58.293 INFO:teuthology.orchestra.run.smithi072.stdout:346.out 2024-04-04T07:01:58.293 INFO:teuthology.orchestra.run.smithi072.stdout:347 2024-04-04T07:01:58.294 INFO:teuthology.orchestra.run.smithi072.stdout:347.out 2024-04-04T07:01:58.294 INFO:teuthology.orchestra.run.smithi072.stdout:348 2024-04-04T07:01:58.294 INFO:teuthology.orchestra.run.smithi072.stdout:348.out 2024-04-04T07:01:58.294 INFO:teuthology.orchestra.run.smithi072.stdout:349 2024-04-04T07:01:58.294 INFO:teuthology.orchestra.run.smithi072.stdout:349.out 2024-04-04T07:01:58.294 INFO:teuthology.orchestra.run.smithi072.stdout:350 2024-04-04T07:01:58.294 INFO:teuthology.orchestra.run.smithi072.stdout:350.out 2024-04-04T07:01:58.294 INFO:teuthology.orchestra.run.smithi072.stdout:351 2024-04-04T07:01:58.295 INFO:teuthology.orchestra.run.smithi072.stdout:351.out 2024-04-04T07:01:58.295 INFO:teuthology.orchestra.run.smithi072.stdout:352 2024-04-04T07:01:58.295 INFO:teuthology.orchestra.run.smithi072.stdout:352.out 2024-04-04T07:01:58.295 INFO:teuthology.orchestra.run.smithi072.stdout:353 2024-04-04T07:01:58.295 INFO:teuthology.orchestra.run.smithi072.stdout:353.out 2024-04-04T07:01:58.295 INFO:teuthology.orchestra.run.smithi072.stdout:354 2024-04-04T07:01:58.295 INFO:teuthology.orchestra.run.smithi072.stdout:354.out 2024-04-04T07:01:58.295 INFO:teuthology.orchestra.run.smithi072.stdout:355 2024-04-04T07:01:58.295 INFO:teuthology.orchestra.run.smithi072.stdout:355.out 2024-04-04T07:01:58.295 INFO:teuthology.orchestra.run.smithi072.stdout:356 2024-04-04T07:01:58.295 INFO:teuthology.orchestra.run.smithi072.stdout:356.out 2024-04-04T07:01:58.295 INFO:teuthology.orchestra.run.smithi072.stdout:357 2024-04-04T07:01:58.295 INFO:teuthology.orchestra.run.smithi072.stdout:357.out 2024-04-04T07:01:58.295 INFO:teuthology.orchestra.run.smithi072.stdout:358 2024-04-04T07:01:58.296 INFO:teuthology.orchestra.run.smithi072.stdout:358.out 2024-04-04T07:01:58.296 INFO:teuthology.orchestra.run.smithi072.stdout:359 2024-04-04T07:01:58.296 INFO:teuthology.orchestra.run.smithi072.stdout:359.out 2024-04-04T07:01:58.296 INFO:teuthology.orchestra.run.smithi072.stdout:360 2024-04-04T07:01:58.296 INFO:teuthology.orchestra.run.smithi072.stdout:360.out 2024-04-04T07:01:58.296 INFO:teuthology.orchestra.run.smithi072.stdout:361 2024-04-04T07:01:58.296 INFO:teuthology.orchestra.run.smithi072.stdout:361.out 2024-04-04T07:01:58.296 INFO:teuthology.orchestra.run.smithi072.stdout:362 2024-04-04T07:01:58.296 INFO:teuthology.orchestra.run.smithi072.stdout:362.out 2024-04-04T07:01:58.296 INFO:teuthology.orchestra.run.smithi072.stdout:363 2024-04-04T07:01:58.296 INFO:teuthology.orchestra.run.smithi072.stdout:363.out 2024-04-04T07:01:58.297 INFO:teuthology.orchestra.run.smithi072.stdout:364 2024-04-04T07:01:58.297 INFO:teuthology.orchestra.run.smithi072.stdout:364.out 2024-04-04T07:01:58.297 INFO:teuthology.orchestra.run.smithi072.stdout:365 2024-04-04T07:01:58.297 INFO:teuthology.orchestra.run.smithi072.stdout:365.out 2024-04-04T07:01:58.297 INFO:teuthology.orchestra.run.smithi072.stdout:366 2024-04-04T07:01:58.297 INFO:teuthology.orchestra.run.smithi072.stdout:366.out 2024-04-04T07:01:58.297 INFO:teuthology.orchestra.run.smithi072.stdout:367 2024-04-04T07:01:58.297 INFO:teuthology.orchestra.run.smithi072.stdout:367.out 2024-04-04T07:01:58.297 INFO:teuthology.orchestra.run.smithi072.stdout:368 2024-04-04T07:01:58.297 INFO:teuthology.orchestra.run.smithi072.stdout:368.out 2024-04-04T07:01:58.297 INFO:teuthology.orchestra.run.smithi072.stdout:369 2024-04-04T07:01:58.297 INFO:teuthology.orchestra.run.smithi072.stdout:369.out 2024-04-04T07:01:58.297 INFO:teuthology.orchestra.run.smithi072.stdout:370 2024-04-04T07:01:58.297 INFO:teuthology.orchestra.run.smithi072.stdout:370.out 2024-04-04T07:01:58.297 INFO:teuthology.orchestra.run.smithi072.stdout:371 2024-04-04T07:01:58.298 INFO:teuthology.orchestra.run.smithi072.stdout:371.out 2024-04-04T07:01:58.298 INFO:teuthology.orchestra.run.smithi072.stdout:372 2024-04-04T07:01:58.298 INFO:teuthology.orchestra.run.smithi072.stdout:372.out 2024-04-04T07:01:58.298 INFO:teuthology.orchestra.run.smithi072.stdout:373 2024-04-04T07:01:58.298 INFO:teuthology.orchestra.run.smithi072.stdout:373.out 2024-04-04T07:01:58.298 INFO:teuthology.orchestra.run.smithi072.stdout:374 2024-04-04T07:01:58.298 INFO:teuthology.orchestra.run.smithi072.stdout:374.out 2024-04-04T07:01:58.298 INFO:teuthology.orchestra.run.smithi072.stdout:375 2024-04-04T07:01:58.298 INFO:teuthology.orchestra.run.smithi072.stdout:375.out 2024-04-04T07:01:58.298 INFO:teuthology.orchestra.run.smithi072.stdout:376 2024-04-04T07:01:58.298 INFO:teuthology.orchestra.run.smithi072.stdout:376.out 2024-04-04T07:01:58.298 INFO:teuthology.orchestra.run.smithi072.stdout:377 2024-04-04T07:01:58.298 INFO:teuthology.orchestra.run.smithi072.stdout:377.out 2024-04-04T07:01:58.299 INFO:teuthology.orchestra.run.smithi072.stdout:378 2024-04-04T07:01:58.299 INFO:teuthology.orchestra.run.smithi072.stdout:378.out 2024-04-04T07:01:58.299 INFO:teuthology.orchestra.run.smithi072.stdout:379 2024-04-04T07:01:58.299 INFO:teuthology.orchestra.run.smithi072.stdout:379.out 2024-04-04T07:01:58.299 INFO:teuthology.orchestra.run.smithi072.stdout:380 2024-04-04T07:01:58.299 INFO:teuthology.orchestra.run.smithi072.stdout:380.out 2024-04-04T07:01:58.299 INFO:teuthology.orchestra.run.smithi072.stdout:381 2024-04-04T07:01:58.299 INFO:teuthology.orchestra.run.smithi072.stdout:381.out 2024-04-04T07:01:58.299 INFO:teuthology.orchestra.run.smithi072.stdout:382 2024-04-04T07:01:58.299 INFO:teuthology.orchestra.run.smithi072.stdout:382.out 2024-04-04T07:01:58.299 INFO:teuthology.orchestra.run.smithi072.stdout:383 2024-04-04T07:01:58.299 INFO:teuthology.orchestra.run.smithi072.stdout:383.out 2024-04-04T07:01:58.299 INFO:teuthology.orchestra.run.smithi072.stdout:384 2024-04-04T07:01:58.299 INFO:teuthology.orchestra.run.smithi072.stdout:384.out 2024-04-04T07:01:58.300 INFO:teuthology.orchestra.run.smithi072.stdout:385 2024-04-04T07:01:58.300 INFO:teuthology.orchestra.run.smithi072.stdout:385.out 2024-04-04T07:01:58.300 INFO:teuthology.orchestra.run.smithi072.stdout:386 2024-04-04T07:01:58.300 INFO:teuthology.orchestra.run.smithi072.stdout:386.out 2024-04-04T07:01:58.300 INFO:teuthology.orchestra.run.smithi072.stdout:387 2024-04-04T07:01:58.300 INFO:teuthology.orchestra.run.smithi072.stdout:387.out 2024-04-04T07:01:58.300 INFO:teuthology.orchestra.run.smithi072.stdout:388 2024-04-04T07:01:58.300 INFO:teuthology.orchestra.run.smithi072.stdout:388.out 2024-04-04T07:01:58.300 INFO:teuthology.orchestra.run.smithi072.stdout:389 2024-04-04T07:01:58.300 INFO:teuthology.orchestra.run.smithi072.stdout:389.out 2024-04-04T07:01:58.300 INFO:teuthology.orchestra.run.smithi072.stdout:390 2024-04-04T07:01:58.300 INFO:teuthology.orchestra.run.smithi072.stdout:390.out 2024-04-04T07:01:58.300 INFO:teuthology.orchestra.run.smithi072.stdout:391 2024-04-04T07:01:58.300 INFO:teuthology.orchestra.run.smithi072.stdout:391.out 2024-04-04T07:01:58.301 INFO:teuthology.orchestra.run.smithi072.stdout:392 2024-04-04T07:01:58.301 INFO:teuthology.orchestra.run.smithi072.stdout:392.out 2024-04-04T07:01:58.301 INFO:teuthology.orchestra.run.smithi072.stdout:393 2024-04-04T07:01:58.301 INFO:teuthology.orchestra.run.smithi072.stdout:393.out 2024-04-04T07:01:58.301 INFO:teuthology.orchestra.run.smithi072.stdout:394 2024-04-04T07:01:58.301 INFO:teuthology.orchestra.run.smithi072.stdout:394.out 2024-04-04T07:01:58.301 INFO:teuthology.orchestra.run.smithi072.stdout:395 2024-04-04T07:01:58.301 INFO:teuthology.orchestra.run.smithi072.stdout:395.out 2024-04-04T07:01:58.301 INFO:teuthology.orchestra.run.smithi072.stdout:396 2024-04-04T07:01:58.301 INFO:teuthology.orchestra.run.smithi072.stdout:396.out 2024-04-04T07:01:58.301 INFO:teuthology.orchestra.run.smithi072.stdout:397 2024-04-04T07:01:58.301 INFO:teuthology.orchestra.run.smithi072.stdout:397.out 2024-04-04T07:01:58.301 INFO:teuthology.orchestra.run.smithi072.stdout:398 2024-04-04T07:01:58.301 INFO:teuthology.orchestra.run.smithi072.stdout:398.out 2024-04-04T07:01:58.301 INFO:teuthology.orchestra.run.smithi072.stdout:399 2024-04-04T07:01:58.302 INFO:teuthology.orchestra.run.smithi072.stdout:399.out 2024-04-04T07:01:58.302 INFO:teuthology.orchestra.run.smithi072.stdout:400 2024-04-04T07:01:58.302 INFO:teuthology.orchestra.run.smithi072.stdout:400.out 2024-04-04T07:01:58.302 INFO:teuthology.orchestra.run.smithi072.stdout:401 2024-04-04T07:01:58.302 INFO:teuthology.orchestra.run.smithi072.stdout:401.out 2024-04-04T07:01:58.302 INFO:teuthology.orchestra.run.smithi072.stdout:402 2024-04-04T07:01:58.302 INFO:teuthology.orchestra.run.smithi072.stdout:402.out 2024-04-04T07:01:58.302 INFO:teuthology.orchestra.run.smithi072.stdout:403 2024-04-04T07:01:58.302 INFO:teuthology.orchestra.run.smithi072.stdout:403.out 2024-04-04T07:01:58.302 INFO:teuthology.orchestra.run.smithi072.stdout:404 2024-04-04T07:01:58.302 INFO:teuthology.orchestra.run.smithi072.stdout:404.out 2024-04-04T07:01:58.303 INFO:teuthology.orchestra.run.smithi072.stdout:405 2024-04-04T07:01:58.303 INFO:teuthology.orchestra.run.smithi072.stdout:405.out 2024-04-04T07:01:58.303 INFO:teuthology.orchestra.run.smithi072.stdout:406 2024-04-04T07:01:58.303 INFO:teuthology.orchestra.run.smithi072.stdout:406.out 2024-04-04T07:01:58.303 INFO:teuthology.orchestra.run.smithi072.stdout:407 2024-04-04T07:01:58.303 INFO:teuthology.orchestra.run.smithi072.stdout:407.out 2024-04-04T07:01:58.304 INFO:teuthology.orchestra.run.smithi072.stdout:408 2024-04-04T07:01:58.304 INFO:teuthology.orchestra.run.smithi072.stdout:408.out 2024-04-04T07:01:58.304 INFO:teuthology.orchestra.run.smithi072.stdout:409 2024-04-04T07:01:58.304 INFO:teuthology.orchestra.run.smithi072.stdout:409.out 2024-04-04T07:01:58.304 INFO:teuthology.orchestra.run.smithi072.stdout:410 2024-04-04T07:01:58.304 INFO:teuthology.orchestra.run.smithi072.stdout:410.out 2024-04-04T07:01:58.304 INFO:teuthology.orchestra.run.smithi072.stdout:411 2024-04-04T07:01:58.304 INFO:teuthology.orchestra.run.smithi072.stdout:411.out 2024-04-04T07:01:58.305 INFO:teuthology.orchestra.run.smithi072.stdout:412 2024-04-04T07:01:58.305 INFO:teuthology.orchestra.run.smithi072.stdout:412.out 2024-04-04T07:01:58.305 INFO:teuthology.orchestra.run.smithi072.stdout:413 2024-04-04T07:01:58.305 INFO:teuthology.orchestra.run.smithi072.stdout:413.out 2024-04-04T07:01:58.305 INFO:teuthology.orchestra.run.smithi072.stdout:414 2024-04-04T07:01:58.305 INFO:teuthology.orchestra.run.smithi072.stdout:414.out 2024-04-04T07:01:58.305 INFO:teuthology.orchestra.run.smithi072.stdout:415 2024-04-04T07:01:58.305 INFO:teuthology.orchestra.run.smithi072.stdout:415.out 2024-04-04T07:01:58.306 INFO:teuthology.orchestra.run.smithi072.stdout:416 2024-04-04T07:01:58.306 INFO:teuthology.orchestra.run.smithi072.stdout:416.out 2024-04-04T07:01:58.306 INFO:teuthology.orchestra.run.smithi072.stdout:417 2024-04-04T07:01:58.306 INFO:teuthology.orchestra.run.smithi072.stdout:417.out 2024-04-04T07:01:58.306 INFO:teuthology.orchestra.run.smithi072.stdout:418 2024-04-04T07:01:58.306 INFO:teuthology.orchestra.run.smithi072.stdout:418.out 2024-04-04T07:01:58.306 INFO:teuthology.orchestra.run.smithi072.stdout:419 2024-04-04T07:01:58.306 INFO:teuthology.orchestra.run.smithi072.stdout:419.out 2024-04-04T07:01:58.306 INFO:teuthology.orchestra.run.smithi072.stdout:420 2024-04-04T07:01:58.306 INFO:teuthology.orchestra.run.smithi072.stdout:420.out 2024-04-04T07:01:58.306 INFO:teuthology.orchestra.run.smithi072.stdout:421 2024-04-04T07:01:58.306 INFO:teuthology.orchestra.run.smithi072.stdout:421.out 2024-04-04T07:01:58.306 INFO:teuthology.orchestra.run.smithi072.stdout:422 2024-04-04T07:01:58.307 INFO:teuthology.orchestra.run.smithi072.stdout:422.out 2024-04-04T07:01:58.307 INFO:teuthology.orchestra.run.smithi072.stdout:423 2024-04-04T07:01:58.307 INFO:teuthology.orchestra.run.smithi072.stdout:423.out 2024-04-04T07:01:58.307 INFO:teuthology.orchestra.run.smithi072.stdout:424 2024-04-04T07:01:58.307 INFO:teuthology.orchestra.run.smithi072.stdout:424.out 2024-04-04T07:01:58.307 INFO:teuthology.orchestra.run.smithi072.stdout:425 2024-04-04T07:01:58.307 INFO:teuthology.orchestra.run.smithi072.stdout:425.out 2024-04-04T07:01:58.307 INFO:teuthology.orchestra.run.smithi072.stdout:426 2024-04-04T07:01:58.307 INFO:teuthology.orchestra.run.smithi072.stdout:426.out 2024-04-04T07:01:58.307 INFO:teuthology.orchestra.run.smithi072.stdout:427 2024-04-04T07:01:58.307 INFO:teuthology.orchestra.run.smithi072.stdout:427.out 2024-04-04T07:01:58.307 INFO:teuthology.orchestra.run.smithi072.stdout:428 2024-04-04T07:01:58.307 INFO:teuthology.orchestra.run.smithi072.stdout:428.out 2024-04-04T07:01:58.307 INFO:teuthology.orchestra.run.smithi072.stdout:429 2024-04-04T07:01:58.308 INFO:teuthology.orchestra.run.smithi072.stdout:429.out 2024-04-04T07:01:58.308 INFO:teuthology.orchestra.run.smithi072.stdout:430 2024-04-04T07:01:58.308 INFO:teuthology.orchestra.run.smithi072.stdout:430.out 2024-04-04T07:01:58.308 INFO:teuthology.orchestra.run.smithi072.stdout:431 2024-04-04T07:01:58.308 INFO:teuthology.orchestra.run.smithi072.stdout:431.out 2024-04-04T07:01:58.308 INFO:teuthology.orchestra.run.smithi072.stdout:432 2024-04-04T07:01:58.308 INFO:teuthology.orchestra.run.smithi072.stdout:432.out 2024-04-04T07:01:58.308 INFO:teuthology.orchestra.run.smithi072.stdout:433 2024-04-04T07:01:58.308 INFO:teuthology.orchestra.run.smithi072.stdout:433.out 2024-04-04T07:01:58.308 INFO:teuthology.orchestra.run.smithi072.stdout:434 2024-04-04T07:01:58.308 INFO:teuthology.orchestra.run.smithi072.stdout:434.out 2024-04-04T07:01:58.308 INFO:teuthology.orchestra.run.smithi072.stdout:435 2024-04-04T07:01:58.308 INFO:teuthology.orchestra.run.smithi072.stdout:435.out 2024-04-04T07:01:58.308 INFO:teuthology.orchestra.run.smithi072.stdout:436 2024-04-04T07:01:58.309 INFO:teuthology.orchestra.run.smithi072.stdout:436.out 2024-04-04T07:01:58.309 INFO:teuthology.orchestra.run.smithi072.stdout:437 2024-04-04T07:01:58.309 INFO:teuthology.orchestra.run.smithi072.stdout:437.out 2024-04-04T07:01:58.309 INFO:teuthology.orchestra.run.smithi072.stdout:438 2024-04-04T07:01:58.309 INFO:teuthology.orchestra.run.smithi072.stdout:438.out 2024-04-04T07:01:58.309 INFO:teuthology.orchestra.run.smithi072.stdout:439 2024-04-04T07:01:58.309 INFO:teuthology.orchestra.run.smithi072.stdout:439.out 2024-04-04T07:01:58.309 INFO:teuthology.orchestra.run.smithi072.stdout:440 2024-04-04T07:01:58.309 INFO:teuthology.orchestra.run.smithi072.stdout:440.out 2024-04-04T07:01:58.309 INFO:teuthology.orchestra.run.smithi072.stdout:441 2024-04-04T07:01:58.309 INFO:teuthology.orchestra.run.smithi072.stdout:441.out 2024-04-04T07:01:58.309 INFO:teuthology.orchestra.run.smithi072.stdout:442 2024-04-04T07:01:58.309 INFO:teuthology.orchestra.run.smithi072.stdout:442.out 2024-04-04T07:01:58.309 INFO:teuthology.orchestra.run.smithi072.stdout:443 2024-04-04T07:01:58.310 INFO:teuthology.orchestra.run.smithi072.stdout:443.out 2024-04-04T07:01:58.310 INFO:teuthology.orchestra.run.smithi072.stdout:444 2024-04-04T07:01:58.310 INFO:teuthology.orchestra.run.smithi072.stdout:444.out 2024-04-04T07:01:58.310 INFO:teuthology.orchestra.run.smithi072.stdout:445 2024-04-04T07:01:58.310 INFO:teuthology.orchestra.run.smithi072.stdout:445.out 2024-04-04T07:01:58.310 INFO:teuthology.orchestra.run.smithi072.stdout:446 2024-04-04T07:01:58.310 INFO:teuthology.orchestra.run.smithi072.stdout:446.out 2024-04-04T07:01:58.310 INFO:teuthology.orchestra.run.smithi072.stdout:447 2024-04-04T07:01:58.310 INFO:teuthology.orchestra.run.smithi072.stdout:447.out 2024-04-04T07:01:58.310 INFO:teuthology.orchestra.run.smithi072.stdout:448 2024-04-04T07:01:58.310 INFO:teuthology.orchestra.run.smithi072.stdout:448.out 2024-04-04T07:01:58.310 INFO:teuthology.orchestra.run.smithi072.stdout:449 2024-04-04T07:01:58.310 INFO:teuthology.orchestra.run.smithi072.stdout:449.out 2024-04-04T07:01:58.311 INFO:teuthology.orchestra.run.smithi072.stdout:450 2024-04-04T07:01:58.311 INFO:teuthology.orchestra.run.smithi072.stdout:450.out 2024-04-04T07:01:58.311 INFO:teuthology.orchestra.run.smithi072.stdout:451 2024-04-04T07:01:58.311 INFO:teuthology.orchestra.run.smithi072.stdout:451.out 2024-04-04T07:01:58.311 INFO:teuthology.orchestra.run.smithi072.stdout:452 2024-04-04T07:01:58.311 INFO:teuthology.orchestra.run.smithi072.stdout:452.out 2024-04-04T07:01:58.311 INFO:teuthology.orchestra.run.smithi072.stdout:453 2024-04-04T07:01:58.311 INFO:teuthology.orchestra.run.smithi072.stdout:453.out 2024-04-04T07:01:58.311 INFO:teuthology.orchestra.run.smithi072.stdout:454 2024-04-04T07:01:58.311 INFO:teuthology.orchestra.run.smithi072.stdout:454.out 2024-04-04T07:01:58.312 INFO:teuthology.orchestra.run.smithi072.stdout:455 2024-04-04T07:01:58.312 INFO:teuthology.orchestra.run.smithi072.stdout:455.out 2024-04-04T07:01:58.312 INFO:teuthology.orchestra.run.smithi072.stdout:456 2024-04-04T07:01:58.312 INFO:teuthology.orchestra.run.smithi072.stdout:456.out 2024-04-04T07:01:58.312 INFO:teuthology.orchestra.run.smithi072.stdout:457 2024-04-04T07:01:58.312 INFO:teuthology.orchestra.run.smithi072.stdout:457.out 2024-04-04T07:01:58.312 INFO:teuthology.orchestra.run.smithi072.stdout:458 2024-04-04T07:01:58.312 INFO:teuthology.orchestra.run.smithi072.stdout:458.out 2024-04-04T07:01:58.312 INFO:teuthology.orchestra.run.smithi072.stdout:459 2024-04-04T07:01:58.312 INFO:teuthology.orchestra.run.smithi072.stdout:459.out 2024-04-04T07:01:58.312 INFO:teuthology.orchestra.run.smithi072.stdout:460 2024-04-04T07:01:58.312 INFO:teuthology.orchestra.run.smithi072.stdout:460.out 2024-04-04T07:01:58.312 INFO:teuthology.orchestra.run.smithi072.stdout:461 2024-04-04T07:01:58.312 INFO:teuthology.orchestra.run.smithi072.stdout:461.out 2024-04-04T07:01:58.313 INFO:teuthology.orchestra.run.smithi072.stdout:462 2024-04-04T07:01:58.313 INFO:teuthology.orchestra.run.smithi072.stdout:462.out 2024-04-04T07:01:58.313 INFO:teuthology.orchestra.run.smithi072.stdout:463 2024-04-04T07:01:58.313 INFO:teuthology.orchestra.run.smithi072.stdout:463.out 2024-04-04T07:01:58.313 INFO:teuthology.orchestra.run.smithi072.stdout:464 2024-04-04T07:01:58.313 INFO:teuthology.orchestra.run.smithi072.stdout:464.out 2024-04-04T07:01:58.313 INFO:teuthology.orchestra.run.smithi072.stdout:465 2024-04-04T07:01:58.313 INFO:teuthology.orchestra.run.smithi072.stdout:465.out 2024-04-04T07:01:58.313 INFO:teuthology.orchestra.run.smithi072.stdout:466 2024-04-04T07:01:58.313 INFO:teuthology.orchestra.run.smithi072.stdout:466.out 2024-04-04T07:01:58.313 INFO:teuthology.orchestra.run.smithi072.stdout:467 2024-04-04T07:01:58.313 INFO:teuthology.orchestra.run.smithi072.stdout:467.out 2024-04-04T07:01:58.313 INFO:teuthology.orchestra.run.smithi072.stdout:468 2024-04-04T07:01:58.313 INFO:teuthology.orchestra.run.smithi072.stdout:468.out 2024-04-04T07:01:58.313 INFO:teuthology.orchestra.run.smithi072.stdout:469 2024-04-04T07:01:58.314 INFO:teuthology.orchestra.run.smithi072.stdout:469.out 2024-04-04T07:01:58.314 INFO:teuthology.orchestra.run.smithi072.stdout:470 2024-04-04T07:01:58.314 INFO:teuthology.orchestra.run.smithi072.stdout:470.out 2024-04-04T07:01:58.314 INFO:teuthology.orchestra.run.smithi072.stdout:471 2024-04-04T07:01:58.314 INFO:teuthology.orchestra.run.smithi072.stdout:471.out 2024-04-04T07:01:58.314 INFO:teuthology.orchestra.run.smithi072.stdout:472 2024-04-04T07:01:58.314 INFO:teuthology.orchestra.run.smithi072.stdout:472.out 2024-04-04T07:01:58.314 INFO:teuthology.orchestra.run.smithi072.stdout:473 2024-04-04T07:01:58.315 INFO:teuthology.orchestra.run.smithi072.stdout:473.out 2024-04-04T07:01:58.315 INFO:teuthology.orchestra.run.smithi072.stdout:474 2024-04-04T07:01:58.315 INFO:teuthology.orchestra.run.smithi072.stdout:474.out 2024-04-04T07:01:58.315 INFO:teuthology.orchestra.run.smithi072.stdout:475 2024-04-04T07:01:58.316 INFO:teuthology.orchestra.run.smithi072.stdout:475.out 2024-04-04T07:01:58.316 INFO:teuthology.orchestra.run.smithi072.stdout:476 2024-04-04T07:01:58.316 INFO:teuthology.orchestra.run.smithi072.stdout:476.out 2024-04-04T07:01:58.316 INFO:teuthology.orchestra.run.smithi072.stdout:477 2024-04-04T07:01:58.316 INFO:teuthology.orchestra.run.smithi072.stdout:477.out 2024-04-04T07:01:58.316 INFO:teuthology.orchestra.run.smithi072.stdout:478 2024-04-04T07:01:58.317 INFO:teuthology.orchestra.run.smithi072.stdout:478.out 2024-04-04T07:01:58.317 INFO:teuthology.orchestra.run.smithi072.stdout:479 2024-04-04T07:01:58.317 INFO:teuthology.orchestra.run.smithi072.stdout:479.out 2024-04-04T07:01:58.317 INFO:teuthology.orchestra.run.smithi072.stdout:480 2024-04-04T07:01:58.317 INFO:teuthology.orchestra.run.smithi072.stdout:480.out 2024-04-04T07:01:58.317 INFO:teuthology.orchestra.run.smithi072.stdout:481 2024-04-04T07:01:58.318 INFO:teuthology.orchestra.run.smithi072.stdout:481.out 2024-04-04T07:01:58.318 INFO:teuthology.orchestra.run.smithi072.stdout:482 2024-04-04T07:01:58.318 INFO:teuthology.orchestra.run.smithi072.stdout:482.out 2024-04-04T07:01:58.318 INFO:teuthology.orchestra.run.smithi072.stdout:483 2024-04-04T07:01:58.318 INFO:teuthology.orchestra.run.smithi072.stdout:483.out 2024-04-04T07:01:58.319 INFO:teuthology.orchestra.run.smithi072.stdout:484 2024-04-04T07:01:58.319 INFO:teuthology.orchestra.run.smithi072.stdout:484.out 2024-04-04T07:01:58.319 INFO:teuthology.orchestra.run.smithi072.stdout:485 2024-04-04T07:01:58.319 INFO:teuthology.orchestra.run.smithi072.stdout:485.out 2024-04-04T07:01:58.319 INFO:teuthology.orchestra.run.smithi072.stdout:486 2024-04-04T07:01:58.319 INFO:teuthology.orchestra.run.smithi072.stdout:486.out 2024-04-04T07:01:58.320 INFO:teuthology.orchestra.run.smithi072.stdout:487 2024-04-04T07:01:58.320 INFO:teuthology.orchestra.run.smithi072.stdout:487.out 2024-04-04T07:01:58.320 INFO:teuthology.orchestra.run.smithi072.stdout:488 2024-04-04T07:01:58.320 INFO:teuthology.orchestra.run.smithi072.stdout:488.out 2024-04-04T07:01:58.320 INFO:teuthology.orchestra.run.smithi072.stdout:489 2024-04-04T07:01:58.321 INFO:teuthology.orchestra.run.smithi072.stdout:489.out 2024-04-04T07:01:58.321 INFO:teuthology.orchestra.run.smithi072.stdout:490 2024-04-04T07:01:58.321 INFO:teuthology.orchestra.run.smithi072.stdout:490.out 2024-04-04T07:01:58.321 INFO:teuthology.orchestra.run.smithi072.stdout:491 2024-04-04T07:01:58.321 INFO:teuthology.orchestra.run.smithi072.stdout:491.out 2024-04-04T07:01:58.321 INFO:teuthology.orchestra.run.smithi072.stdout:492 2024-04-04T07:01:58.322 INFO:teuthology.orchestra.run.smithi072.stdout:492.out 2024-04-04T07:01:58.322 INFO:teuthology.orchestra.run.smithi072.stdout:493 2024-04-04T07:01:58.322 INFO:teuthology.orchestra.run.smithi072.stdout:493.out 2024-04-04T07:01:58.322 INFO:teuthology.orchestra.run.smithi072.stdout:494 2024-04-04T07:01:58.323 INFO:teuthology.orchestra.run.smithi072.stdout:494.out 2024-04-04T07:01:58.323 INFO:teuthology.orchestra.run.smithi072.stdout:495 2024-04-04T07:01:58.323 INFO:teuthology.orchestra.run.smithi072.stdout:495.out 2024-04-04T07:01:58.323 INFO:teuthology.orchestra.run.smithi072.stdout:496 2024-04-04T07:01:58.323 INFO:teuthology.orchestra.run.smithi072.stdout:496.out 2024-04-04T07:01:58.323 INFO:teuthology.orchestra.run.smithi072.stdout:497 2024-04-04T07:01:58.323 INFO:teuthology.orchestra.run.smithi072.stdout:497.out 2024-04-04T07:01:58.324 INFO:teuthology.orchestra.run.smithi072.stdout:498 2024-04-04T07:01:58.324 INFO:teuthology.orchestra.run.smithi072.stdout:498.out 2024-04-04T07:01:58.324 INFO:teuthology.orchestra.run.smithi072.stdout:499 2024-04-04T07:01:58.324 INFO:teuthology.orchestra.run.smithi072.stdout:499.out 2024-04-04T07:01:58.324 INFO:teuthology.orchestra.run.smithi072.stdout:500 2024-04-04T07:01:58.324 INFO:teuthology.orchestra.run.smithi072.stdout:500.out 2024-04-04T07:01:58.325 INFO:teuthology.orchestra.run.smithi072.stdout:501 2024-04-04T07:01:58.325 INFO:teuthology.orchestra.run.smithi072.stdout:501.out 2024-04-04T07:01:58.325 INFO:teuthology.orchestra.run.smithi072.stdout:502 2024-04-04T07:01:58.325 INFO:teuthology.orchestra.run.smithi072.stdout:502.out 2024-04-04T07:01:58.325 INFO:teuthology.orchestra.run.smithi072.stdout:503 2024-04-04T07:01:58.325 INFO:teuthology.orchestra.run.smithi072.stdout:503.out 2024-04-04T07:01:58.326 INFO:teuthology.orchestra.run.smithi072.stdout:504 2024-04-04T07:01:58.326 INFO:teuthology.orchestra.run.smithi072.stdout:504.out 2024-04-04T07:01:58.326 INFO:teuthology.orchestra.run.smithi072.stdout:505 2024-04-04T07:01:58.326 INFO:teuthology.orchestra.run.smithi072.stdout:505.out 2024-04-04T07:01:58.326 INFO:teuthology.orchestra.run.smithi072.stdout:506 2024-04-04T07:01:58.326 INFO:teuthology.orchestra.run.smithi072.stdout:506.out 2024-04-04T07:01:58.326 INFO:teuthology.orchestra.run.smithi072.stdout:507 2024-04-04T07:01:58.327 INFO:teuthology.orchestra.run.smithi072.stdout:507.out 2024-04-04T07:01:58.327 INFO:teuthology.orchestra.run.smithi072.stdout:508 2024-04-04T07:01:58.327 INFO:teuthology.orchestra.run.smithi072.stdout:508.out 2024-04-04T07:01:58.327 INFO:teuthology.orchestra.run.smithi072.stdout:509 2024-04-04T07:01:58.328 INFO:teuthology.orchestra.run.smithi072.stdout:509.out 2024-04-04T07:01:58.328 INFO:teuthology.orchestra.run.smithi072.stdout:510 2024-04-04T07:01:58.328 INFO:teuthology.orchestra.run.smithi072.stdout:510.out 2024-04-04T07:01:58.328 INFO:teuthology.orchestra.run.smithi072.stdout:511 2024-04-04T07:01:58.328 INFO:teuthology.orchestra.run.smithi072.stdout:511.out 2024-04-04T07:01:58.328 INFO:teuthology.orchestra.run.smithi072.stdout:512 2024-04-04T07:01:58.328 INFO:teuthology.orchestra.run.smithi072.stdout:512.out 2024-04-04T07:01:58.329 INFO:teuthology.orchestra.run.smithi072.stdout:513 2024-04-04T07:01:58.329 INFO:teuthology.orchestra.run.smithi072.stdout:513.out 2024-04-04T07:01:58.329 INFO:teuthology.orchestra.run.smithi072.stdout:514 2024-04-04T07:01:58.329 INFO:teuthology.orchestra.run.smithi072.stdout:514.out 2024-04-04T07:01:58.329 INFO:teuthology.orchestra.run.smithi072.stdout:515 2024-04-04T07:01:58.329 INFO:teuthology.orchestra.run.smithi072.stdout:515.out 2024-04-04T07:01:58.330 INFO:teuthology.orchestra.run.smithi072.stdout:516 2024-04-04T07:01:58.330 INFO:teuthology.orchestra.run.smithi072.stdout:516.out 2024-04-04T07:01:58.330 INFO:teuthology.orchestra.run.smithi072.stdout:517 2024-04-04T07:01:58.330 INFO:teuthology.orchestra.run.smithi072.stdout:517.out 2024-04-04T07:01:58.331 INFO:teuthology.orchestra.run.smithi072.stdout:518 2024-04-04T07:01:58.331 INFO:teuthology.orchestra.run.smithi072.stdout:518.out 2024-04-04T07:01:58.331 INFO:teuthology.orchestra.run.smithi072.stdout:519 2024-04-04T07:01:58.331 INFO:teuthology.orchestra.run.smithi072.stdout:519.out 2024-04-04T07:01:58.331 INFO:teuthology.orchestra.run.smithi072.stdout:520 2024-04-04T07:01:58.331 INFO:teuthology.orchestra.run.smithi072.stdout:520.out 2024-04-04T07:01:58.332 INFO:teuthology.orchestra.run.smithi072.stdout:521 2024-04-04T07:01:58.332 INFO:teuthology.orchestra.run.smithi072.stdout:521.out 2024-04-04T07:01:58.332 INFO:teuthology.orchestra.run.smithi072.stdout:522 2024-04-04T07:01:58.332 INFO:teuthology.orchestra.run.smithi072.stdout:522.out 2024-04-04T07:01:58.332 INFO:teuthology.orchestra.run.smithi072.stdout:523 2024-04-04T07:01:58.332 INFO:teuthology.orchestra.run.smithi072.stdout:523.out 2024-04-04T07:01:58.332 INFO:teuthology.orchestra.run.smithi072.stdout:524 2024-04-04T07:01:58.332 INFO:teuthology.orchestra.run.smithi072.stdout:524.out 2024-04-04T07:01:58.332 INFO:teuthology.orchestra.run.smithi072.stdout:525 2024-04-04T07:01:58.333 INFO:teuthology.orchestra.run.smithi072.stdout:525.out 2024-04-04T07:01:58.333 INFO:teuthology.orchestra.run.smithi072.stdout:526 2024-04-04T07:01:58.333 INFO:teuthology.orchestra.run.smithi072.stdout:526.out 2024-04-04T07:01:58.333 INFO:teuthology.orchestra.run.smithi072.stdout:527 2024-04-04T07:01:58.333 INFO:teuthology.orchestra.run.smithi072.stdout:527.out 2024-04-04T07:01:58.333 INFO:teuthology.orchestra.run.smithi072.stdout:528 2024-04-04T07:01:58.333 INFO:teuthology.orchestra.run.smithi072.stdout:528.out 2024-04-04T07:01:58.334 INFO:teuthology.orchestra.run.smithi072.stdout:529 2024-04-04T07:01:58.334 INFO:teuthology.orchestra.run.smithi072.stdout:529.out 2024-04-04T07:01:58.334 INFO:teuthology.orchestra.run.smithi072.stdout:530 2024-04-04T07:01:58.334 INFO:teuthology.orchestra.run.smithi072.stdout:530.out 2024-04-04T07:01:58.334 INFO:teuthology.orchestra.run.smithi072.stdout:531 2024-04-04T07:01:58.334 INFO:teuthology.orchestra.run.smithi072.stdout:531.out 2024-04-04T07:01:58.335 INFO:teuthology.orchestra.run.smithi072.stdout:532 2024-04-04T07:01:58.335 INFO:teuthology.orchestra.run.smithi072.stdout:532.out 2024-04-04T07:01:58.335 INFO:teuthology.orchestra.run.smithi072.stdout:533 2024-04-04T07:01:58.335 INFO:teuthology.orchestra.run.smithi072.stdout:533.out 2024-04-04T07:01:58.335 INFO:teuthology.orchestra.run.smithi072.stdout:534 2024-04-04T07:01:58.335 INFO:teuthology.orchestra.run.smithi072.stdout:534.out 2024-04-04T07:01:58.335 INFO:teuthology.orchestra.run.smithi072.stdout:535 2024-04-04T07:01:58.335 INFO:teuthology.orchestra.run.smithi072.stdout:535.out 2024-04-04T07:01:58.335 INFO:teuthology.orchestra.run.smithi072.stdout:536 2024-04-04T07:01:58.335 INFO:teuthology.orchestra.run.smithi072.stdout:536.out 2024-04-04T07:01:58.335 INFO:teuthology.orchestra.run.smithi072.stdout:537 2024-04-04T07:01:58.335 INFO:teuthology.orchestra.run.smithi072.stdout:537.out 2024-04-04T07:01:58.335 INFO:teuthology.orchestra.run.smithi072.stdout:538 2024-04-04T07:01:58.335 INFO:teuthology.orchestra.run.smithi072.stdout:538.out 2024-04-04T07:01:58.335 INFO:teuthology.orchestra.run.smithi072.stdout:539 2024-04-04T07:01:58.336 INFO:teuthology.orchestra.run.smithi072.stdout:539.out 2024-04-04T07:01:58.336 INFO:teuthology.orchestra.run.smithi072.stdout:540 2024-04-04T07:01:58.336 INFO:teuthology.orchestra.run.smithi072.stdout:540.out 2024-04-04T07:01:58.336 INFO:teuthology.orchestra.run.smithi072.stdout:541 2024-04-04T07:01:58.336 INFO:teuthology.orchestra.run.smithi072.stdout:541.out 2024-04-04T07:01:58.336 INFO:teuthology.orchestra.run.smithi072.stdout:542 2024-04-04T07:01:58.336 INFO:teuthology.orchestra.run.smithi072.stdout:542.out 2024-04-04T07:01:58.336 INFO:teuthology.orchestra.run.smithi072.stdout:543 2024-04-04T07:01:58.336 INFO:teuthology.orchestra.run.smithi072.stdout:543.out 2024-04-04T07:01:58.336 INFO:teuthology.orchestra.run.smithi072.stdout:544 2024-04-04T07:01:58.336 INFO:teuthology.orchestra.run.smithi072.stdout:544.out 2024-04-04T07:01:58.336 INFO:teuthology.orchestra.run.smithi072.stdout:545 2024-04-04T07:01:58.336 INFO:teuthology.orchestra.run.smithi072.stdout:545.out 2024-04-04T07:01:58.336 INFO:teuthology.orchestra.run.smithi072.stdout:546 2024-04-04T07:01:58.336 INFO:teuthology.orchestra.run.smithi072.stdout:546.out 2024-04-04T07:01:58.337 INFO:teuthology.orchestra.run.smithi072.stdout:547 2024-04-04T07:01:58.337 INFO:teuthology.orchestra.run.smithi072.stdout:547.out 2024-04-04T07:01:58.337 INFO:teuthology.orchestra.run.smithi072.stdout:548 2024-04-04T07:01:58.337 INFO:teuthology.orchestra.run.smithi072.stdout:548.out 2024-04-04T07:01:58.337 INFO:teuthology.orchestra.run.smithi072.stdout:549 2024-04-04T07:01:58.337 INFO:teuthology.orchestra.run.smithi072.stdout:549.out 2024-04-04T07:01:58.337 INFO:teuthology.orchestra.run.smithi072.stdout:550 2024-04-04T07:01:58.337 INFO:teuthology.orchestra.run.smithi072.stdout:550.out 2024-04-04T07:01:58.337 INFO:teuthology.orchestra.run.smithi072.stdout:551 2024-04-04T07:01:58.337 INFO:teuthology.orchestra.run.smithi072.stdout:551.out 2024-04-04T07:01:58.337 INFO:teuthology.orchestra.run.smithi072.stdout:552 2024-04-04T07:01:58.337 INFO:teuthology.orchestra.run.smithi072.stdout:552.out 2024-04-04T07:01:58.337 INFO:teuthology.orchestra.run.smithi072.stdout:553 2024-04-04T07:01:58.337 INFO:teuthology.orchestra.run.smithi072.stdout:553.out 2024-04-04T07:01:58.338 INFO:teuthology.orchestra.run.smithi072.stdout:554 2024-04-04T07:01:58.338 INFO:teuthology.orchestra.run.smithi072.stdout:554.out 2024-04-04T07:01:58.338 INFO:teuthology.orchestra.run.smithi072.stdout:555 2024-04-04T07:01:58.338 INFO:teuthology.orchestra.run.smithi072.stdout:555.out 2024-04-04T07:01:58.338 INFO:teuthology.orchestra.run.smithi072.stdout:556 2024-04-04T07:01:58.338 INFO:teuthology.orchestra.run.smithi072.stdout:556.out 2024-04-04T07:01:58.338 INFO:teuthology.orchestra.run.smithi072.stdout:557 2024-04-04T07:01:58.338 INFO:teuthology.orchestra.run.smithi072.stdout:557.out 2024-04-04T07:01:58.338 INFO:teuthology.orchestra.run.smithi072.stdout:558 2024-04-04T07:01:58.338 INFO:teuthology.orchestra.run.smithi072.stdout:558.out 2024-04-04T07:01:58.338 INFO:teuthology.orchestra.run.smithi072.stdout:559 2024-04-04T07:01:58.338 INFO:teuthology.orchestra.run.smithi072.stdout:559.out 2024-04-04T07:01:58.338 INFO:teuthology.orchestra.run.smithi072.stdout:560 2024-04-04T07:01:58.339 INFO:teuthology.orchestra.run.smithi072.stdout:560.out 2024-04-04T07:01:58.339 INFO:teuthology.orchestra.run.smithi072.stdout:561 2024-04-04T07:01:58.339 INFO:teuthology.orchestra.run.smithi072.stdout:561.out 2024-04-04T07:01:58.339 INFO:teuthology.orchestra.run.smithi072.stdout:562 2024-04-04T07:01:58.339 INFO:teuthology.orchestra.run.smithi072.stdout:562.out 2024-04-04T07:01:58.339 INFO:teuthology.orchestra.run.smithi072.stdout:563 2024-04-04T07:01:58.339 INFO:teuthology.orchestra.run.smithi072.stdout:563.out 2024-04-04T07:01:58.339 INFO:teuthology.orchestra.run.smithi072.stdout:564 2024-04-04T07:01:58.339 INFO:teuthology.orchestra.run.smithi072.stdout:564.out 2024-04-04T07:01:58.339 INFO:teuthology.orchestra.run.smithi072.stdout:565 2024-04-04T07:01:58.339 INFO:teuthology.orchestra.run.smithi072.stdout:565.out 2024-04-04T07:01:58.339 INFO:teuthology.orchestra.run.smithi072.stdout:566 2024-04-04T07:01:58.339 INFO:teuthology.orchestra.run.smithi072.stdout:566.out 2024-04-04T07:01:58.340 INFO:teuthology.orchestra.run.smithi072.stdout:567 2024-04-04T07:01:58.340 INFO:teuthology.orchestra.run.smithi072.stdout:567.out 2024-04-04T07:01:58.340 INFO:teuthology.orchestra.run.smithi072.stdout:568 2024-04-04T07:01:58.340 INFO:teuthology.orchestra.run.smithi072.stdout:568.out 2024-04-04T07:01:58.340 INFO:teuthology.orchestra.run.smithi072.stdout:569 2024-04-04T07:01:58.340 INFO:teuthology.orchestra.run.smithi072.stdout:569.out 2024-04-04T07:01:58.340 INFO:teuthology.orchestra.run.smithi072.stdout:570 2024-04-04T07:01:58.340 INFO:teuthology.orchestra.run.smithi072.stdout:570.out 2024-04-04T07:01:58.340 INFO:teuthology.orchestra.run.smithi072.stdout:571 2024-04-04T07:01:58.340 INFO:teuthology.orchestra.run.smithi072.stdout:571.out 2024-04-04T07:01:58.340 INFO:teuthology.orchestra.run.smithi072.stdout:572 2024-04-04T07:01:58.341 INFO:teuthology.orchestra.run.smithi072.stdout:572.out 2024-04-04T07:01:58.341 INFO:teuthology.orchestra.run.smithi072.stdout:573 2024-04-04T07:01:58.341 INFO:teuthology.orchestra.run.smithi072.stdout:573.out 2024-04-04T07:01:58.341 INFO:teuthology.orchestra.run.smithi072.stdout:574 2024-04-04T07:01:58.341 INFO:teuthology.orchestra.run.smithi072.stdout:574.out 2024-04-04T07:01:58.341 INFO:teuthology.orchestra.run.smithi072.stdout:575 2024-04-04T07:01:58.341 INFO:teuthology.orchestra.run.smithi072.stdout:575.out 2024-04-04T07:01:58.341 INFO:teuthology.orchestra.run.smithi072.stdout:576 2024-04-04T07:01:58.341 INFO:teuthology.orchestra.run.smithi072.stdout:576.out 2024-04-04T07:01:58.341 INFO:teuthology.orchestra.run.smithi072.stdout:577 2024-04-04T07:01:58.341 INFO:teuthology.orchestra.run.smithi072.stdout:577.out 2024-04-04T07:01:58.341 INFO:teuthology.orchestra.run.smithi072.stdout:578 2024-04-04T07:01:58.341 INFO:teuthology.orchestra.run.smithi072.stdout:578.out 2024-04-04T07:01:58.341 INFO:teuthology.orchestra.run.smithi072.stdout:579 2024-04-04T07:01:58.342 INFO:teuthology.orchestra.run.smithi072.stdout:579.out 2024-04-04T07:01:58.342 INFO:teuthology.orchestra.run.smithi072.stdout:580 2024-04-04T07:01:58.342 INFO:teuthology.orchestra.run.smithi072.stdout:580.out 2024-04-04T07:01:58.342 INFO:teuthology.orchestra.run.smithi072.stdout:581 2024-04-04T07:01:58.342 INFO:teuthology.orchestra.run.smithi072.stdout:581.out 2024-04-04T07:01:58.342 INFO:teuthology.orchestra.run.smithi072.stdout:582 2024-04-04T07:01:58.342 INFO:teuthology.orchestra.run.smithi072.stdout:582.out 2024-04-04T07:01:58.342 INFO:teuthology.orchestra.run.smithi072.stdout:583 2024-04-04T07:01:58.342 INFO:teuthology.orchestra.run.smithi072.stdout:583.out 2024-04-04T07:01:58.342 INFO:teuthology.orchestra.run.smithi072.stdout:584 2024-04-04T07:01:58.342 INFO:teuthology.orchestra.run.smithi072.stdout:584.out 2024-04-04T07:01:58.343 INFO:teuthology.orchestra.run.smithi072.stdout:585 2024-04-04T07:01:58.343 INFO:teuthology.orchestra.run.smithi072.stdout:585.out 2024-04-04T07:01:58.343 INFO:teuthology.orchestra.run.smithi072.stdout:586 2024-04-04T07:01:58.343 INFO:teuthology.orchestra.run.smithi072.stdout:586.out 2024-04-04T07:01:58.343 INFO:teuthology.orchestra.run.smithi072.stdout:587 2024-04-04T07:01:58.343 INFO:teuthology.orchestra.run.smithi072.stdout:587.out 2024-04-04T07:01:58.343 INFO:teuthology.orchestra.run.smithi072.stdout:588 2024-04-04T07:01:58.343 INFO:teuthology.orchestra.run.smithi072.stdout:588.out 2024-04-04T07:01:58.343 INFO:teuthology.orchestra.run.smithi072.stdout:589 2024-04-04T07:01:58.343 INFO:teuthology.orchestra.run.smithi072.stdout:589.out 2024-04-04T07:01:58.343 INFO:teuthology.orchestra.run.smithi072.stdout:590 2024-04-04T07:01:58.343 INFO:teuthology.orchestra.run.smithi072.stdout:590.out 2024-04-04T07:01:58.343 INFO:teuthology.orchestra.run.smithi072.stdout:591 2024-04-04T07:01:58.343 INFO:teuthology.orchestra.run.smithi072.stdout:591.out 2024-04-04T07:01:58.344 INFO:teuthology.orchestra.run.smithi072.stdout:592 2024-04-04T07:01:58.344 INFO:teuthology.orchestra.run.smithi072.stdout:592.out 2024-04-04T07:01:58.344 INFO:teuthology.orchestra.run.smithi072.stdout:593 2024-04-04T07:01:58.344 INFO:teuthology.orchestra.run.smithi072.stdout:593.out 2024-04-04T07:01:58.344 INFO:teuthology.orchestra.run.smithi072.stdout:594 2024-04-04T07:01:58.344 INFO:teuthology.orchestra.run.smithi072.stdout:594.out 2024-04-04T07:01:58.344 INFO:teuthology.orchestra.run.smithi072.stdout:595 2024-04-04T07:01:58.344 INFO:teuthology.orchestra.run.smithi072.stdout:595.out 2024-04-04T07:01:58.344 INFO:teuthology.orchestra.run.smithi072.stdout:596 2024-04-04T07:01:58.344 INFO:teuthology.orchestra.run.smithi072.stdout:596.out 2024-04-04T07:01:58.344 INFO:teuthology.orchestra.run.smithi072.stdout:597 2024-04-04T07:01:58.344 INFO:teuthology.orchestra.run.smithi072.stdout:597.out 2024-04-04T07:01:58.344 INFO:teuthology.orchestra.run.smithi072.stdout:598 2024-04-04T07:01:58.344 INFO:teuthology.orchestra.run.smithi072.stdout:598.out 2024-04-04T07:01:58.344 INFO:teuthology.orchestra.run.smithi072.stdout:599 2024-04-04T07:01:58.345 INFO:teuthology.orchestra.run.smithi072.stdout:599.out 2024-04-04T07:01:58.345 INFO:teuthology.orchestra.run.smithi072.stdout:600 2024-04-04T07:01:58.345 INFO:teuthology.orchestra.run.smithi072.stdout:600.out 2024-04-04T07:01:58.345 INFO:teuthology.orchestra.run.smithi072.stdout:601 2024-04-04T07:01:58.345 INFO:teuthology.orchestra.run.smithi072.stdout:601.out 2024-04-04T07:01:58.345 INFO:teuthology.orchestra.run.smithi072.stdout:602 2024-04-04T07:01:58.345 INFO:teuthology.orchestra.run.smithi072.stdout:602.out 2024-04-04T07:01:58.345 INFO:teuthology.orchestra.run.smithi072.stdout:603 2024-04-04T07:01:58.345 INFO:teuthology.orchestra.run.smithi072.stdout:603.out 2024-04-04T07:01:58.345 INFO:teuthology.orchestra.run.smithi072.stdout:604 2024-04-04T07:01:58.345 INFO:teuthology.orchestra.run.smithi072.stdout:604.out 2024-04-04T07:01:58.345 INFO:teuthology.orchestra.run.smithi072.stdout:605 2024-04-04T07:01:58.345 INFO:teuthology.orchestra.run.smithi072.stdout:605.out 2024-04-04T07:01:58.345 INFO:teuthology.orchestra.run.smithi072.stdout:606 2024-04-04T07:01:58.345 INFO:teuthology.orchestra.run.smithi072.stdout:606.out 2024-04-04T07:01:58.346 INFO:teuthology.orchestra.run.smithi072.stdout:607 2024-04-04T07:01:58.346 INFO:teuthology.orchestra.run.smithi072.stdout:607.out 2024-04-04T07:01:58.346 INFO:teuthology.orchestra.run.smithi072.stdout:608 2024-04-04T07:01:58.346 INFO:teuthology.orchestra.run.smithi072.stdout:608.out 2024-04-04T07:01:58.346 INFO:teuthology.orchestra.run.smithi072.stdout:609 2024-04-04T07:01:58.346 INFO:teuthology.orchestra.run.smithi072.stdout:609.out 2024-04-04T07:01:58.346 INFO:teuthology.orchestra.run.smithi072.stdout:610 2024-04-04T07:01:58.346 INFO:teuthology.orchestra.run.smithi072.stdout:610.out 2024-04-04T07:01:58.346 INFO:teuthology.orchestra.run.smithi072.stdout:611 2024-04-04T07:01:58.346 INFO:teuthology.orchestra.run.smithi072.stdout:611.out 2024-04-04T07:01:58.346 INFO:teuthology.orchestra.run.smithi072.stdout:612 2024-04-04T07:01:58.346 INFO:teuthology.orchestra.run.smithi072.stdout:612.out 2024-04-04T07:01:58.346 INFO:teuthology.orchestra.run.smithi072.stdout:613 2024-04-04T07:01:58.346 INFO:teuthology.orchestra.run.smithi072.stdout:613.out 2024-04-04T07:01:58.347 INFO:teuthology.orchestra.run.smithi072.stdout:614 2024-04-04T07:01:58.347 INFO:teuthology.orchestra.run.smithi072.stdout:614.out 2024-04-04T07:01:58.347 INFO:teuthology.orchestra.run.smithi072.stdout:615 2024-04-04T07:01:58.347 INFO:teuthology.orchestra.run.smithi072.stdout:615.out 2024-04-04T07:01:58.347 INFO:teuthology.orchestra.run.smithi072.stdout:616 2024-04-04T07:01:58.347 INFO:teuthology.orchestra.run.smithi072.stdout:616.out 2024-04-04T07:01:58.347 INFO:teuthology.orchestra.run.smithi072.stdout:617 2024-04-04T07:01:58.347 INFO:teuthology.orchestra.run.smithi072.stdout:617.out 2024-04-04T07:01:58.347 INFO:teuthology.orchestra.run.smithi072.stdout:618 2024-04-04T07:01:58.347 INFO:teuthology.orchestra.run.smithi072.stdout:618.out 2024-04-04T07:01:58.347 INFO:teuthology.orchestra.run.smithi072.stdout:619 2024-04-04T07:01:58.347 INFO:teuthology.orchestra.run.smithi072.stdout:619.out 2024-04-04T07:01:58.347 INFO:teuthology.orchestra.run.smithi072.stdout:620 2024-04-04T07:01:58.347 INFO:teuthology.orchestra.run.smithi072.stdout:620.out 2024-04-04T07:01:58.348 INFO:teuthology.orchestra.run.smithi072.stdout:621 2024-04-04T07:01:58.348 INFO:teuthology.orchestra.run.smithi072.stdout:621.out 2024-04-04T07:01:58.348 INFO:teuthology.orchestra.run.smithi072.stdout:622 2024-04-04T07:01:58.348 INFO:teuthology.orchestra.run.smithi072.stdout:622.out 2024-04-04T07:01:58.348 INFO:teuthology.orchestra.run.smithi072.stdout:623 2024-04-04T07:01:58.348 INFO:teuthology.orchestra.run.smithi072.stdout:623.out 2024-04-04T07:01:58.348 INFO:teuthology.orchestra.run.smithi072.stdout:624 2024-04-04T07:01:58.348 INFO:teuthology.orchestra.run.smithi072.stdout:624.out 2024-04-04T07:01:58.348 INFO:teuthology.orchestra.run.smithi072.stdout:625 2024-04-04T07:01:58.348 INFO:teuthology.orchestra.run.smithi072.stdout:625.out 2024-04-04T07:01:58.348 INFO:teuthology.orchestra.run.smithi072.stdout:626 2024-04-04T07:01:58.348 INFO:teuthology.orchestra.run.smithi072.stdout:626.out 2024-04-04T07:01:58.348 INFO:teuthology.orchestra.run.smithi072.stdout:627 2024-04-04T07:01:58.349 INFO:teuthology.orchestra.run.smithi072.stdout:627.out 2024-04-04T07:01:58.349 INFO:teuthology.orchestra.run.smithi072.stdout:628 2024-04-04T07:01:58.349 INFO:teuthology.orchestra.run.smithi072.stdout:628.out 2024-04-04T07:01:58.349 INFO:teuthology.orchestra.run.smithi072.stdout:629 2024-04-04T07:01:58.349 INFO:teuthology.orchestra.run.smithi072.stdout:629.out 2024-04-04T07:01:58.349 INFO:teuthology.orchestra.run.smithi072.stdout:630 2024-04-04T07:01:58.349 INFO:teuthology.orchestra.run.smithi072.stdout:630.out 2024-04-04T07:01:58.349 INFO:teuthology.orchestra.run.smithi072.stdout:631 2024-04-04T07:01:58.349 INFO:teuthology.orchestra.run.smithi072.stdout:631.out 2024-04-04T07:01:58.349 INFO:teuthology.orchestra.run.smithi072.stdout:632 2024-04-04T07:01:58.349 INFO:teuthology.orchestra.run.smithi072.stdout:632.out 2024-04-04T07:01:58.350 INFO:teuthology.orchestra.run.smithi072.stdout:633 2024-04-04T07:01:58.350 INFO:teuthology.orchestra.run.smithi072.stdout:633.out 2024-04-04T07:01:58.350 INFO:teuthology.orchestra.run.smithi072.stdout:634 2024-04-04T07:01:58.350 INFO:teuthology.orchestra.run.smithi072.stdout:634.out 2024-04-04T07:01:58.350 INFO:teuthology.orchestra.run.smithi072.stdout:635 2024-04-04T07:01:58.350 INFO:teuthology.orchestra.run.smithi072.stdout:635.out 2024-04-04T07:01:58.350 INFO:teuthology.orchestra.run.smithi072.stdout:636 2024-04-04T07:01:58.350 INFO:teuthology.orchestra.run.smithi072.stdout:636.out 2024-04-04T07:01:58.350 INFO:teuthology.orchestra.run.smithi072.stdout:637 2024-04-04T07:01:58.350 INFO:teuthology.orchestra.run.smithi072.stdout:637.out 2024-04-04T07:01:58.350 INFO:teuthology.orchestra.run.smithi072.stdout:638 2024-04-04T07:01:58.350 INFO:teuthology.orchestra.run.smithi072.stdout:638.out 2024-04-04T07:01:58.350 INFO:teuthology.orchestra.run.smithi072.stdout:639 2024-04-04T07:01:58.350 INFO:teuthology.orchestra.run.smithi072.stdout:639.out 2024-04-04T07:01:58.351 INFO:teuthology.orchestra.run.smithi072.stdout:640 2024-04-04T07:01:58.351 INFO:teuthology.orchestra.run.smithi072.stdout:640.out 2024-04-04T07:01:58.351 INFO:teuthology.orchestra.run.smithi072.stdout:641 2024-04-04T07:01:58.351 INFO:teuthology.orchestra.run.smithi072.stdout:641.out 2024-04-04T07:01:58.351 INFO:teuthology.orchestra.run.smithi072.stdout:642 2024-04-04T07:01:58.351 INFO:teuthology.orchestra.run.smithi072.stdout:642.out 2024-04-04T07:01:58.351 INFO:teuthology.orchestra.run.smithi072.stdout:643 2024-04-04T07:01:58.351 INFO:teuthology.orchestra.run.smithi072.stdout:643.out 2024-04-04T07:01:58.351 INFO:teuthology.orchestra.run.smithi072.stdout:644 2024-04-04T07:01:58.351 INFO:teuthology.orchestra.run.smithi072.stdout:644.out 2024-04-04T07:01:58.351 INFO:teuthology.orchestra.run.smithi072.stdout:645 2024-04-04T07:01:58.351 INFO:teuthology.orchestra.run.smithi072.stdout:645.out 2024-04-04T07:01:58.351 INFO:teuthology.orchestra.run.smithi072.stdout:646 2024-04-04T07:01:58.352 INFO:teuthology.orchestra.run.smithi072.stdout:646.out 2024-04-04T07:01:58.352 INFO:teuthology.orchestra.run.smithi072.stdout:647 2024-04-04T07:01:58.352 INFO:teuthology.orchestra.run.smithi072.stdout:647.out 2024-04-04T07:01:58.352 INFO:teuthology.orchestra.run.smithi072.stdout:648 2024-04-04T07:01:58.352 INFO:teuthology.orchestra.run.smithi072.stdout:648.out 2024-04-04T07:01:58.352 INFO:teuthology.orchestra.run.smithi072.stdout:649 2024-04-04T07:01:58.352 INFO:teuthology.orchestra.run.smithi072.stdout:649.out 2024-04-04T07:01:58.352 INFO:teuthology.orchestra.run.smithi072.stdout:650 2024-04-04T07:01:58.352 INFO:teuthology.orchestra.run.smithi072.stdout:650.out 2024-04-04T07:01:58.352 INFO:teuthology.orchestra.run.smithi072.stdout:651 2024-04-04T07:01:58.352 INFO:teuthology.orchestra.run.smithi072.stdout:651.out 2024-04-04T07:01:58.352 INFO:teuthology.orchestra.run.smithi072.stdout:652 2024-04-04T07:01:58.352 INFO:teuthology.orchestra.run.smithi072.stdout:652.out 2024-04-04T07:01:58.352 INFO:teuthology.orchestra.run.smithi072.stdout:653 2024-04-04T07:01:58.352 INFO:teuthology.orchestra.run.smithi072.stdout:653.out 2024-04-04T07:01:58.353 INFO:teuthology.orchestra.run.smithi072.stdout:654 2024-04-04T07:01:58.353 INFO:teuthology.orchestra.run.smithi072.stdout:654.out 2024-04-04T07:01:58.353 INFO:teuthology.orchestra.run.smithi072.stdout:655 2024-04-04T07:01:58.353 INFO:teuthology.orchestra.run.smithi072.stdout:655.out 2024-04-04T07:01:58.353 INFO:teuthology.orchestra.run.smithi072.stdout:656 2024-04-04T07:01:58.353 INFO:teuthology.orchestra.run.smithi072.stdout:656.out 2024-04-04T07:01:58.353 INFO:teuthology.orchestra.run.smithi072.stdout:657 2024-04-04T07:01:58.353 INFO:teuthology.orchestra.run.smithi072.stdout:657.out 2024-04-04T07:01:58.353 INFO:teuthology.orchestra.run.smithi072.stdout:658 2024-04-04T07:01:58.353 INFO:teuthology.orchestra.run.smithi072.stdout:658.out 2024-04-04T07:01:58.353 INFO:teuthology.orchestra.run.smithi072.stdout:659 2024-04-04T07:01:58.353 INFO:teuthology.orchestra.run.smithi072.stdout:659.out 2024-04-04T07:01:58.353 INFO:teuthology.orchestra.run.smithi072.stdout:660 2024-04-04T07:01:58.353 INFO:teuthology.orchestra.run.smithi072.stdout:660.out 2024-04-04T07:01:58.353 INFO:teuthology.orchestra.run.smithi072.stdout:661 2024-04-04T07:01:58.354 INFO:teuthology.orchestra.run.smithi072.stdout:661.out 2024-04-04T07:01:58.354 INFO:teuthology.orchestra.run.smithi072.stdout:662 2024-04-04T07:01:58.354 INFO:teuthology.orchestra.run.smithi072.stdout:662.out 2024-04-04T07:01:58.354 INFO:teuthology.orchestra.run.smithi072.stdout:663 2024-04-04T07:01:58.354 INFO:teuthology.orchestra.run.smithi072.stdout:663.out 2024-04-04T07:01:58.354 INFO:teuthology.orchestra.run.smithi072.stdout:664 2024-04-04T07:01:58.354 INFO:teuthology.orchestra.run.smithi072.stdout:664.out 2024-04-04T07:01:58.354 INFO:teuthology.orchestra.run.smithi072.stdout:665 2024-04-04T07:01:58.354 INFO:teuthology.orchestra.run.smithi072.stdout:665.out 2024-04-04T07:01:58.354 INFO:teuthology.orchestra.run.smithi072.stdout:666 2024-04-04T07:01:58.354 INFO:teuthology.orchestra.run.smithi072.stdout:666.out 2024-04-04T07:01:58.354 INFO:teuthology.orchestra.run.smithi072.stdout:667 2024-04-04T07:01:58.354 INFO:teuthology.orchestra.run.smithi072.stdout:667.out 2024-04-04T07:01:58.354 INFO:teuthology.orchestra.run.smithi072.stdout:668 2024-04-04T07:01:58.355 INFO:teuthology.orchestra.run.smithi072.stdout:668.out 2024-04-04T07:01:58.355 INFO:teuthology.orchestra.run.smithi072.stdout:669 2024-04-04T07:01:58.355 INFO:teuthology.orchestra.run.smithi072.stdout:669.out 2024-04-04T07:01:58.355 INFO:teuthology.orchestra.run.smithi072.stdout:670 2024-04-04T07:01:58.355 INFO:teuthology.orchestra.run.smithi072.stdout:670.out 2024-04-04T07:01:58.355 INFO:teuthology.orchestra.run.smithi072.stdout:671 2024-04-04T07:01:58.355 INFO:teuthology.orchestra.run.smithi072.stdout:671.out 2024-04-04T07:01:58.355 INFO:teuthology.orchestra.run.smithi072.stdout:672 2024-04-04T07:01:58.355 INFO:teuthology.orchestra.run.smithi072.stdout:672.out 2024-04-04T07:01:58.355 INFO:teuthology.orchestra.run.smithi072.stdout:673 2024-04-04T07:01:58.355 INFO:teuthology.orchestra.run.smithi072.stdout:673.out 2024-04-04T07:01:58.355 INFO:teuthology.orchestra.run.smithi072.stdout:674 2024-04-04T07:01:58.355 INFO:teuthology.orchestra.run.smithi072.stdout:674.out 2024-04-04T07:01:58.355 INFO:teuthology.orchestra.run.smithi072.stdout:675 2024-04-04T07:01:58.355 INFO:teuthology.orchestra.run.smithi072.stdout:675.out 2024-04-04T07:01:58.356 INFO:teuthology.orchestra.run.smithi072.stdout:676 2024-04-04T07:01:58.356 INFO:teuthology.orchestra.run.smithi072.stdout:676.out 2024-04-04T07:01:58.356 INFO:teuthology.orchestra.run.smithi072.stdout:677 2024-04-04T07:01:58.356 INFO:teuthology.orchestra.run.smithi072.stdout:677.out 2024-04-04T07:01:58.356 INFO:teuthology.orchestra.run.smithi072.stdout:678 2024-04-04T07:01:58.356 INFO:teuthology.orchestra.run.smithi072.stdout:678.out 2024-04-04T07:01:58.356 INFO:teuthology.orchestra.run.smithi072.stdout:679 2024-04-04T07:01:58.356 INFO:teuthology.orchestra.run.smithi072.stdout:679.out 2024-04-04T07:01:58.356 INFO:teuthology.orchestra.run.smithi072.stdout:680 2024-04-04T07:01:58.356 INFO:teuthology.orchestra.run.smithi072.stdout:680.out 2024-04-04T07:01:58.356 INFO:teuthology.orchestra.run.smithi072.stdout:681 2024-04-04T07:01:58.356 INFO:teuthology.orchestra.run.smithi072.stdout:681.out 2024-04-04T07:01:58.356 INFO:teuthology.orchestra.run.smithi072.stdout:682 2024-04-04T07:01:58.357 INFO:teuthology.orchestra.run.smithi072.stdout:682.out 2024-04-04T07:01:58.357 INFO:teuthology.orchestra.run.smithi072.stdout:683 2024-04-04T07:01:58.357 INFO:teuthology.orchestra.run.smithi072.stdout:683.out 2024-04-04T07:01:58.357 INFO:teuthology.orchestra.run.smithi072.stdout:684 2024-04-04T07:01:58.357 INFO:teuthology.orchestra.run.smithi072.stdout:684.out 2024-04-04T07:01:58.357 INFO:teuthology.orchestra.run.smithi072.stdout:685 2024-04-04T07:01:58.357 INFO:teuthology.orchestra.run.smithi072.stdout:685.out 2024-04-04T07:01:58.357 INFO:teuthology.orchestra.run.smithi072.stdout:686 2024-04-04T07:01:58.357 INFO:teuthology.orchestra.run.smithi072.stdout:686.out 2024-04-04T07:01:58.357 INFO:teuthology.orchestra.run.smithi072.stdout:687 2024-04-04T07:01:58.357 INFO:teuthology.orchestra.run.smithi072.stdout:687.out 2024-04-04T07:01:58.357 INFO:teuthology.orchestra.run.smithi072.stdout:688 2024-04-04T07:01:58.357 INFO:teuthology.orchestra.run.smithi072.stdout:688.out 2024-04-04T07:01:58.357 INFO:teuthology.orchestra.run.smithi072.stdout:689 2024-04-04T07:01:58.358 INFO:teuthology.orchestra.run.smithi072.stdout:689.out 2024-04-04T07:01:58.358 INFO:teuthology.orchestra.run.smithi072.stdout:690 2024-04-04T07:01:58.358 INFO:teuthology.orchestra.run.smithi072.stdout:690.out 2024-04-04T07:01:58.358 INFO:teuthology.orchestra.run.smithi072.stdout:691 2024-04-04T07:01:58.358 INFO:teuthology.orchestra.run.smithi072.stdout:691.out 2024-04-04T07:01:58.358 INFO:teuthology.orchestra.run.smithi072.stdout:692 2024-04-04T07:01:58.358 INFO:teuthology.orchestra.run.smithi072.stdout:692.out 2024-04-04T07:01:58.358 INFO:teuthology.orchestra.run.smithi072.stdout:693 2024-04-04T07:01:58.358 INFO:teuthology.orchestra.run.smithi072.stdout:693.out 2024-04-04T07:01:58.358 INFO:teuthology.orchestra.run.smithi072.stdout:694 2024-04-04T07:01:58.358 INFO:teuthology.orchestra.run.smithi072.stdout:694.out 2024-04-04T07:01:58.358 INFO:teuthology.orchestra.run.smithi072.stdout:695 2024-04-04T07:01:58.358 INFO:teuthology.orchestra.run.smithi072.stdout:695.out 2024-04-04T07:01:58.358 INFO:teuthology.orchestra.run.smithi072.stdout:696 2024-04-04T07:01:58.359 INFO:teuthology.orchestra.run.smithi072.stdout:696.out 2024-04-04T07:01:58.359 INFO:teuthology.orchestra.run.smithi072.stdout:697 2024-04-04T07:01:58.359 INFO:teuthology.orchestra.run.smithi072.stdout:697.out 2024-04-04T07:01:58.359 INFO:teuthology.orchestra.run.smithi072.stdout:698 2024-04-04T07:01:58.359 INFO:teuthology.orchestra.run.smithi072.stdout:698.out 2024-04-04T07:01:58.359 INFO:teuthology.orchestra.run.smithi072.stdout:699 2024-04-04T07:01:58.359 INFO:teuthology.orchestra.run.smithi072.stdout:699.out 2024-04-04T07:01:58.359 INFO:teuthology.orchestra.run.smithi072.stdout:700 2024-04-04T07:01:58.359 INFO:teuthology.orchestra.run.smithi072.stdout:700.out 2024-04-04T07:01:58.359 INFO:teuthology.orchestra.run.smithi072.stdout:701 2024-04-04T07:01:58.359 INFO:teuthology.orchestra.run.smithi072.stdout:701.out 2024-04-04T07:01:58.359 INFO:teuthology.orchestra.run.smithi072.stdout:702 2024-04-04T07:01:58.359 INFO:teuthology.orchestra.run.smithi072.stdout:702.out 2024-04-04T07:01:58.359 INFO:teuthology.orchestra.run.smithi072.stdout:703 2024-04-04T07:01:58.359 INFO:teuthology.orchestra.run.smithi072.stdout:703.out 2024-04-04T07:01:58.360 INFO:teuthology.orchestra.run.smithi072.stdout:704 2024-04-04T07:01:58.360 INFO:teuthology.orchestra.run.smithi072.stdout:704.out 2024-04-04T07:01:58.360 INFO:teuthology.orchestra.run.smithi072.stdout:705 2024-04-04T07:01:58.360 INFO:teuthology.orchestra.run.smithi072.stdout:705.out 2024-04-04T07:01:58.360 INFO:teuthology.orchestra.run.smithi072.stdout:706 2024-04-04T07:01:58.360 INFO:teuthology.orchestra.run.smithi072.stdout:706.out 2024-04-04T07:01:58.360 INFO:teuthology.orchestra.run.smithi072.stdout:707 2024-04-04T07:01:58.360 INFO:teuthology.orchestra.run.smithi072.stdout:707.out 2024-04-04T07:01:58.360 INFO:teuthology.orchestra.run.smithi072.stdout:708 2024-04-04T07:01:58.360 INFO:teuthology.orchestra.run.smithi072.stdout:708.out 2024-04-04T07:01:58.360 INFO:teuthology.orchestra.run.smithi072.stdout:709 2024-04-04T07:01:58.360 INFO:teuthology.orchestra.run.smithi072.stdout:709.out 2024-04-04T07:01:58.360 INFO:teuthology.orchestra.run.smithi072.stdout:710 2024-04-04T07:01:58.360 INFO:teuthology.orchestra.run.smithi072.stdout:710.out 2024-04-04T07:01:58.361 INFO:teuthology.orchestra.run.smithi072.stdout:711 2024-04-04T07:01:58.361 INFO:teuthology.orchestra.run.smithi072.stdout:711.out 2024-04-04T07:01:58.361 INFO:teuthology.orchestra.run.smithi072.stdout:712 2024-04-04T07:01:58.361 INFO:teuthology.orchestra.run.smithi072.stdout:712.out 2024-04-04T07:01:58.361 INFO:teuthology.orchestra.run.smithi072.stdout:713 2024-04-04T07:01:58.361 INFO:teuthology.orchestra.run.smithi072.stdout:713.out 2024-04-04T07:01:58.361 INFO:teuthology.orchestra.run.smithi072.stdout:714 2024-04-04T07:01:58.361 INFO:teuthology.orchestra.run.smithi072.stdout:714.out 2024-04-04T07:01:58.361 INFO:teuthology.orchestra.run.smithi072.stdout:715 2024-04-04T07:01:58.361 INFO:teuthology.orchestra.run.smithi072.stdout:715.out 2024-04-04T07:01:58.361 INFO:teuthology.orchestra.run.smithi072.stdout:716 2024-04-04T07:01:58.361 INFO:teuthology.orchestra.run.smithi072.stdout:716.out 2024-04-04T07:01:58.361 INFO:teuthology.orchestra.run.smithi072.stdout:717 2024-04-04T07:01:58.361 INFO:teuthology.orchestra.run.smithi072.stdout:717.out 2024-04-04T07:01:58.362 INFO:teuthology.orchestra.run.smithi072.stdout:718 2024-04-04T07:01:58.362 INFO:teuthology.orchestra.run.smithi072.stdout:718.out 2024-04-04T07:01:58.362 INFO:teuthology.orchestra.run.smithi072.stdout:719 2024-04-04T07:01:58.362 INFO:teuthology.orchestra.run.smithi072.stdout:719.out 2024-04-04T07:01:58.362 INFO:teuthology.orchestra.run.smithi072.stdout:720 2024-04-04T07:01:58.362 INFO:teuthology.orchestra.run.smithi072.stdout:720.out 2024-04-04T07:01:58.362 INFO:teuthology.orchestra.run.smithi072.stdout:721 2024-04-04T07:01:58.362 INFO:teuthology.orchestra.run.smithi072.stdout:721.out 2024-04-04T07:01:58.362 INFO:teuthology.orchestra.run.smithi072.stdout:722 2024-04-04T07:01:58.362 INFO:teuthology.orchestra.run.smithi072.stdout:722.out 2024-04-04T07:01:58.362 INFO:teuthology.orchestra.run.smithi072.stdout:723 2024-04-04T07:01:58.362 INFO:teuthology.orchestra.run.smithi072.stdout:723.out 2024-04-04T07:01:58.362 INFO:teuthology.orchestra.run.smithi072.stdout:724 2024-04-04T07:01:58.362 INFO:teuthology.orchestra.run.smithi072.stdout:724.out 2024-04-04T07:01:58.363 INFO:teuthology.orchestra.run.smithi072.stdout:725 2024-04-04T07:01:58.363 INFO:teuthology.orchestra.run.smithi072.stdout:725.out 2024-04-04T07:01:58.363 INFO:teuthology.orchestra.run.smithi072.stdout:726 2024-04-04T07:01:58.363 INFO:teuthology.orchestra.run.smithi072.stdout:726.out 2024-04-04T07:01:58.363 INFO:teuthology.orchestra.run.smithi072.stdout:727 2024-04-04T07:01:58.363 INFO:teuthology.orchestra.run.smithi072.stdout:727.out 2024-04-04T07:01:58.363 INFO:teuthology.orchestra.run.smithi072.stdout:728 2024-04-04T07:01:58.363 INFO:teuthology.orchestra.run.smithi072.stdout:728.out 2024-04-04T07:01:58.363 INFO:teuthology.orchestra.run.smithi072.stdout:729 2024-04-04T07:01:58.363 INFO:teuthology.orchestra.run.smithi072.stdout:729.out 2024-04-04T07:01:58.363 INFO:teuthology.orchestra.run.smithi072.stdout:730 2024-04-04T07:01:58.363 INFO:teuthology.orchestra.run.smithi072.stdout:730.out 2024-04-04T07:01:58.363 INFO:teuthology.orchestra.run.smithi072.stdout:731 2024-04-04T07:01:58.363 INFO:teuthology.orchestra.run.smithi072.stdout:731.out 2024-04-04T07:01:58.364 INFO:teuthology.orchestra.run.smithi072.stdout:732 2024-04-04T07:01:58.364 INFO:teuthology.orchestra.run.smithi072.stdout:732.out 2024-04-04T07:01:58.364 INFO:teuthology.orchestra.run.smithi072.stdout:733 2024-04-04T07:01:58.364 INFO:teuthology.orchestra.run.smithi072.stdout:733.out 2024-04-04T07:01:58.364 INFO:teuthology.orchestra.run.smithi072.stdout:734 2024-04-04T07:01:58.364 INFO:teuthology.orchestra.run.smithi072.stdout:734.out 2024-04-04T07:01:58.364 INFO:teuthology.orchestra.run.smithi072.stdout:735 2024-04-04T07:01:58.364 INFO:teuthology.orchestra.run.smithi072.stdout:735.out 2024-04-04T07:01:58.364 INFO:teuthology.orchestra.run.smithi072.stdout:736 2024-04-04T07:01:58.364 INFO:teuthology.orchestra.run.smithi072.stdout:736.out 2024-04-04T07:01:58.364 INFO:teuthology.orchestra.run.smithi072.stdout:737 2024-04-04T07:01:58.364 INFO:teuthology.orchestra.run.smithi072.stdout:737.out 2024-04-04T07:01:58.364 INFO:teuthology.orchestra.run.smithi072.stdout:738 2024-04-04T07:01:58.364 INFO:teuthology.orchestra.run.smithi072.stdout:738.out 2024-04-04T07:01:58.364 INFO:teuthology.orchestra.run.smithi072.stdout:739 2024-04-04T07:01:58.365 INFO:teuthology.orchestra.run.smithi072.stdout:739.out 2024-04-04T07:01:58.365 INFO:teuthology.orchestra.run.smithi072.stdout:group.list 2024-04-04T07:01:58.365 INFO:teuthology.orchestra.run.smithi072.stdout:Makefile 2024-04-04T07:01:58.366 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/001) 2024-04-04T07:01:58.834 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T07:01:58.848 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T07:01:58.848 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T07:02:07.015 INFO:teuthology.orchestra.run.smithi072.stdout:generic/001 9s 2024-04-04T07:02:07.029 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/001 2024-04-04T07:02:07.029 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T07:02:07.038 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T07:02:07.042 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi072.stderr:ceph-fuse[50926]: fuse finished with error 0 and tester_r 0 2024-04-04T07:02:07.064 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T07:02:07.064 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/002) 2024-04-04T07:02:07.532 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T07:02:07.543 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T07:02:07.543 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T07:02:08.592 INFO:teuthology.orchestra.run.smithi072.stdout:generic/002 1s 2024-04-04T07:02:08.606 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/002 2024-04-04T07:02:08.606 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T07:02:08.613 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T07:02:08.649 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T07:02:08.650 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/003) 2024-04-04T07:02:09.114 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T07:02:09.125 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T07:02:09.125 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T07:02:09.481 INFO:teuthology.orchestra.run.smithi072.stdout:generic/003 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T07:02:09.493 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/003 2024-04-04T07:02:09.493 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/003 2024-04-04T07:02:09.493 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T07:02:09.502 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T07:02:09.529 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T07:02:09.529 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/004) 2024-04-04T07:02:10.045 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T07:02:10.057 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T07:02:10.057 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T07:02:10.498 INFO:teuthology.orchestra.run.smithi072.stdout:generic/004 [not run] O_TMPFILE is not supported 2024-04-04T07:02:10.509 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/004 2024-04-04T07:02:10.509 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/004 2024-04-04T07:02:10.510 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T07:02:10.517 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T07:02:10.546 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T07:02:10.546 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/005) 2024-04-04T07:02:11.035 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T07:02:11.047 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T07:02:11.047 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T07:02:13.114 INFO:teuthology.orchestra.run.smithi072.stdout:generic/005 2s 2024-04-04T07:02:13.134 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/005 2024-04-04T07:02:13.134 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T07:02:13.142 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T07:02:13.174 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T07:02:13.175 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/006) 2024-04-04T07:02:13.658 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T07:02:13.670 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T07:02:13.670 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T07:02:15.886 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T07:02:15.894 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T07:02:46.031 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T07:02:46.040 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T07:03:16.168 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T07:03:16.172 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T07:03:27.874 INFO:teuthology.orchestra.run.smithi072.stdout:generic/006 74s 2024-04-04T07:03:28.325 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/006 2024-04-04T07:03:28.325 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T07:03:28.337 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T07:03:28.402 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T07:03:28.402 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/007) 2024-04-04T07:03:28.838 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T07:03:28.849 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T07:03:28.849 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T07:03:47.839 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T07:03:47.845 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T07:04:17.982 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T07:04:17.987 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T07:04:49.697 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T07:04:49.706 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T07:05:20.293 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T07:05:20.301 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T07:05:50.425 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T07:05:50.431 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T07:06:08.505 INFO:teuthology.orchestra.run.smithi072.stdout:generic/007 160s 2024-04-04T07:06:08.520 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/007 2024-04-04T07:06:08.520 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T07:06:08.526 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T07:06:08.555 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T07:06:08.555 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/008) 2024-04-04T07:06:09.158 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T07:06:09.171 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T07:06:09.171 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T07:06:12.395 INFO:teuthology.orchestra.run.smithi072.stdout:generic/008 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2024-04-04T07:06:12.408 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/008 2024-04-04T07:06:12.408 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/008 2024-04-04T07:06:12.409 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T07:06:12.419 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T07:06:12.454 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T07:06:12.454 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/009) 2024-04-04T07:06:12.957 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T07:06:12.968 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T07:06:12.968 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T07:06:16.096 INFO:teuthology.orchestra.run.smithi072.stdout:generic/009 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2024-04-04T07:06:16.107 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/009 2024-04-04T07:06:16.107 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/009 2024-04-04T07:06:16.107 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T07:06:16.116 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T07:06:16.143 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T07:06:16.143 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/010) 2024-04-04T07:06:16.650 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T07:06:16.662 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T07:06:16.663 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T07:06:18.423 INFO:teuthology.orchestra.run.smithi072.stdout:generic/010 2s 2024-04-04T07:06:19.191 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/010 2024-04-04T07:06:19.191 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T07:06:19.202 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T07:06:19.245 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T07:06:19.246 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/011) 2024-04-04T07:06:19.716 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T07:06:19.727 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T07:06:19.727 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T07:06:22.937 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T07:06:22.947 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T07:06:54.779 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T07:06:54.786 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T07:07:24.917 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T07:07:24.925 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T07:07:25.528 INFO:teuthology.orchestra.run.smithi072.stdout:generic/011 66s 2024-04-04T07:07:25.920 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/011 2024-04-04T07:07:25.921 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T07:07:25.932 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T07:07:25.978 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T07:07:25.978 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/012) 2024-04-04T07:07:26.476 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T07:07:26.488 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T07:07:26.488 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T07:07:29.929 INFO:teuthology.orchestra.run.smithi072.stdout:generic/012 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-04-04T07:07:29.942 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/012 2024-04-04T07:07:29.942 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/012 2024-04-04T07:07:29.942 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T07:07:29.954 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T07:07:29.992 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T07:07:29.992 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/013) 2024-04-04T07:07:30.472 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T07:07:30.483 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T07:07:30.483 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T07:07:56.081 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T07:07:56.089 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T07:08:26.250 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T07:08:26.259 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T07:08:57.231 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T07:08:57.245 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T07:08:57.576 INFO:tasks.ceph.mds.a.smithi072.stderr:2024-04-04T07:08:57.575+0000 7fa395800640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 117954) UID: 0 2024-04-04T07:08:57.576 INFO:tasks.ceph.mds.c.smithi072.stderr:2024-04-04T07:08:57.575+0000 7fc131e00640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 117954) UID: 0 2024-04-04T07:09:58.922 INFO:teuthology.orchestra.run.smithi072.stdout:generic/013 148s 2024-04-04T07:09:59.657 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/013 2024-04-04T07:09:59.657 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T07:09:59.667 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T07:09:59.697 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T07:09:59.697 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/014) 2024-04-04T07:10:00.493 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T07:10:00.512 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T07:10:00.512 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T07:10:05.462 INFO:teuthology.orchestra.run.smithi072.stdout:generic/014 [not run] Sparse files are not supported or do not work as expected 2024-04-04T07:10:05.476 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/014 2024-04-04T07:10:05.476 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/014 2024-04-04T07:10:05.476 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T07:10:05.487 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T07:10:05.522 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T07:10:05.522 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/015) 2024-04-04T07:10:06.299 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T07:10:06.324 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T07:10:06.324 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T07:10:06.806 INFO:teuthology.orchestra.run.smithi072.stdout:generic/015 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T07:10:06.822 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/015 2024-04-04T07:10:06.822 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/015 2024-04-04T07:10:06.822 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T07:10:06.835 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T07:10:06.871 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T07:10:06.871 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/016) 2024-04-04T07:10:07.618 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T07:10:07.639 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T07:10:07.639 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T07:10:11.001 INFO:teuthology.orchestra.run.smithi072.stdout:generic/016 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-04-04T07:10:11.013 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/016 2024-04-04T07:10:11.013 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/016 2024-04-04T07:10:11.013 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T07:10:11.028 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T07:10:11.062 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T07:10:11.062 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/017) 2024-04-04T07:10:11.854 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T07:10:11.880 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T07:10:11.880 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T07:10:12.354 INFO:teuthology.orchestra.run.smithi072.stdout:generic/017 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T07:10:12.368 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/017 2024-04-04T07:10:12.369 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/017 2024-04-04T07:10:12.369 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T07:10:12.379 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T07:10:12.415 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T07:10:12.416 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/018) 2024-04-04T07:10:13.130 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T07:10:13.150 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T07:10:13.150 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T07:10:13.648 INFO:teuthology.orchestra.run.smithi072.stdout:generic/018 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T07:10:13.659 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/018 2024-04-04T07:10:13.660 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/018 2024-04-04T07:10:13.660 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T07:10:13.670 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T07:10:13.707 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T07:10:13.707 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/019) 2024-04-04T07:10:14.437 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T07:10:14.455 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T07:10:14.455 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T07:10:14.957 INFO:teuthology.orchestra.run.smithi072.stdout:generic/019 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T07:10:14.971 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/019 2024-04-04T07:10:14.971 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/019 2024-04-04T07:10:14.971 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T07:10:14.982 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T07:10:15.017 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T07:10:15.018 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/020) 2024-04-04T07:10:15.720 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T07:10:15.738 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T07:10:15.739 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T07:10:39.156 INFO:teuthology.orchestra.run.smithi072.stdout:generic/020 - output mismatch (see /tmp/tmp.tiFz9P8iUAxfstests-dev/results//generic/020.out.bad) 2024-04-04T07:10:39.168 INFO:teuthology.orchestra.run.smithi072.stdout: --- tests/generic/020.out 2024-04-04 06:58:02.166454524 +0000 2024-04-04T07:10:39.168 INFO:teuthology.orchestra.run.smithi072.stdout: +++ /tmp/tmp.tiFz9P8iUAxfstests-dev/results//generic/020.out.bad 2024-04-04 07:10:39.152833163 +0000 2024-04-04T07:10:39.168 INFO:teuthology.orchestra.run.smithi072.stdout: @@ -47,9 +47,13 @@ 2024-04-04T07:10:39.168 INFO:teuthology.orchestra.run.smithi072.stdout: user.snrub="fish2\012" 2024-04-04T07:10:39.168 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T07:10:39.168 INFO:teuthology.orchestra.run.smithi072.stdout: *** really long value 2024-04-04T07:10:39.168 INFO:teuthology.orchestra.run.smithi072.stdout: -0000000 00 2024-04-04T07:10:39.168 INFO:teuthology.orchestra.run.smithi072.stdout: -* 2024-04-04T07:10:39.168 INFO:teuthology.orchestra.run.smithi072.stdout: -ATTRSIZE 2024-04-04T07:10:39.168 INFO:teuthology.orchestra.run.smithi072.stdout: +attr_set: No space left on device 2024-04-04T07:10:39.168 INFO:teuthology.orchestra.run.smithi072.stdout: +Could not set "long_attr" for 2024-04-04T07:10:39.168 INFO:teuthology.orchestra.run.smithi072.stdout: +attr_get: No data available 2024-04-04T07:10:39.168 INFO:teuthology.orchestra.run.smithi072.stdout: +Could not get "long_attr" for 2024-04-04T07:10:39.169 INFO:teuthology.orchestra.run.smithi072.stdout: +0000000 2024-04-04T07:10:39.169 INFO:teuthology.orchestra.run.smithi072.stdout: +attr_remove: No data available 2024-04-04T07:10:39.169 INFO:teuthology.orchestra.run.smithi072.stdout: +Could not remove "long_attr" for 2024-04-04T07:10:39.169 INFO:teuthology.orchestra.run.smithi072.stdout: *** set/get/remove really long names (expect failure) 2024-04-04T07:10:39.169 INFO:teuthology.orchestra.run.smithi072.stdout: attr_set: Invalid argument 2024-04-04T07:10:39.169 INFO:teuthology.orchestra.run.smithi072.stdout: Could not set "XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX" for 2024-04-04T07:10:39.178 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/020 2024-04-04T07:10:39.178 INFO:teuthology.orchestra.run.smithi072.stdout:Failures: generic/020 2024-04-04T07:10:39.178 INFO:teuthology.orchestra.run.smithi072.stdout:Failed 1 of 1 tests 2024-04-04T07:10:39.189 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T07:10:39.229 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-04T07:10:39.229 INFO:tasks.cephfs.xfstests_dev:Command failed 2024-04-04T07:10:39.229 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2024-04-04T07:10:39.229 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/021) 2024-04-04T07:10:40.034 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T07:10:40.060 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T07:10:40.060 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T07:10:43.507 INFO:teuthology.orchestra.run.smithi072.stdout:generic/021 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-04-04T07:10:43.522 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/021 2024-04-04T07:10:43.522 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/021 2024-04-04T07:10:43.522 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T07:10:43.536 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T07:10:43.584 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T07:10:43.584 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/022) 2024-04-04T07:10:44.720 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T07:10:44.739 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T07:10:44.739 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T07:10:48.144 INFO:teuthology.orchestra.run.smithi072.stdout:generic/022 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-04-04T07:10:48.158 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/022 2024-04-04T07:10:48.159 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/022 2024-04-04T07:10:48.159 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T07:10:48.167 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T07:10:48.226 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T07:10:48.227 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/023) 2024-04-04T07:10:49.006 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T07:10:49.025 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T07:10:49.025 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T07:10:53.142 INFO:teuthology.orchestra.run.smithi072.stdout:generic/023 4s 2024-04-04T07:10:53.168 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/023 2024-04-04T07:10:53.168 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T07:10:53.177 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T07:10:53.225 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T07:10:53.226 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/024) 2024-04-04T07:10:54.099 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T07:10:54.117 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T07:10:54.117 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T07:10:54.714 INFO:teuthology.orchestra.run.smithi072.stdout:generic/024 [not run] kernel doesn't support renameat2 syscall 2024-04-04T07:10:54.730 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/024 2024-04-04T07:10:54.730 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/024 2024-04-04T07:10:54.730 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T07:10:54.744 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T07:10:54.783 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T07:10:54.783 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/025) 2024-04-04T07:10:55.592 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T07:10:55.613 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T07:10:55.613 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T07:10:56.179 INFO:teuthology.orchestra.run.smithi072.stdout:generic/025 [not run] kernel doesn't support renameat2 syscall 2024-04-04T07:10:56.190 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/025 2024-04-04T07:10:56.190 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/025 2024-04-04T07:10:56.190 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T07:10:56.201 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T07:10:56.244 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T07:10:56.244 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/026) 2024-04-04T07:10:57.101 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T07:10:57.114 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T07:10:57.115 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T07:10:57.711 INFO:teuthology.orchestra.run.smithi072.stdout:generic/026 [not run] ACLs not supported by this filesystem type: ceph-fuse 2024-04-04T07:10:57.728 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/026 2024-04-04T07:10:57.728 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/026 2024-04-04T07:10:57.728 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T07:10:57.742 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T07:10:57.778 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T07:10:57.778 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/027) 2024-04-04T07:10:58.471 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T07:10:58.490 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T07:10:58.490 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T07:10:58.949 INFO:teuthology.orchestra.run.smithi072.stdout:generic/027 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T07:10:58.964 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/027 2024-04-04T07:10:58.965 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/027 2024-04-04T07:10:58.965 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T07:10:58.976 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T07:10:59.015 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T07:10:59.015 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/028) 2024-04-04T07:10:59.741 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T07:10:59.761 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T07:10:59.761 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T07:11:05.313 INFO:teuthology.orchestra.run.smithi072.stdout:generic/028 6s 2024-04-04T07:11:06.346 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/028 2024-04-04T07:11:06.346 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T07:11:06.358 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T07:11:06.397 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T07:11:06.397 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/029) 2024-04-04T07:11:07.117 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T07:11:07.142 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T07:11:07.143 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T07:11:07.611 INFO:teuthology.orchestra.run.smithi072.stdout:generic/029 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T07:11:07.627 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/029 2024-04-04T07:11:07.627 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/029 2024-04-04T07:11:07.628 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T07:11:07.641 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T07:11:07.679 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T07:11:07.679 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/030) 2024-04-04T07:11:08.497 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T07:11:08.516 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T07:11:08.516 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T07:11:08.969 INFO:teuthology.orchestra.run.smithi072.stdout:generic/030 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T07:11:08.982 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/030 2024-04-04T07:11:08.982 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/030 2024-04-04T07:11:08.983 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T07:11:08.994 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T07:11:09.029 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T07:11:09.029 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/031) 2024-04-04T07:11:09.754 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T07:11:09.774 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T07:11:09.774 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T07:11:10.263 INFO:teuthology.orchestra.run.smithi072.stdout:generic/031 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T07:11:10.277 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/031 2024-04-04T07:11:10.277 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/031 2024-04-04T07:11:10.277 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T07:11:10.290 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T07:11:10.326 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T07:11:10.326 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/032) 2024-04-04T07:11:11.050 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T07:11:11.068 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T07:11:11.068 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T07:11:11.555 INFO:teuthology.orchestra.run.smithi072.stdout:generic/032 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T07:11:11.572 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/032 2024-04-04T07:11:11.572 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/032 2024-04-04T07:11:11.572 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T07:11:11.583 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T07:11:11.619 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T07:11:11.619 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/033) 2024-04-04T07:11:12.344 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T07:11:12.363 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T07:11:12.363 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T07:11:12.815 INFO:teuthology.orchestra.run.smithi072.stdout:generic/033 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T07:11:12.831 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/033 2024-04-04T07:11:12.831 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/033 2024-04-04T07:11:12.831 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T07:11:12.840 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T07:11:12.881 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T07:11:12.881 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/034) 2024-04-04T07:11:13.602 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T07:11:13.620 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T07:11:13.620 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T07:11:14.148 INFO:teuthology.orchestra.run.smithi072.stdout:generic/034 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T07:11:14.161 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/034 2024-04-04T07:11:14.161 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/034 2024-04-04T07:11:14.161 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T07:11:14.174 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T07:11:14.205 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T07:11:14.205 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/035) 2024-04-04T07:11:14.921 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T07:11:14.938 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T07:11:14.938 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T07:11:15.623 INFO:teuthology.orchestra.run.smithi072.stdout:generic/035 1s 2024-04-04T07:11:15.647 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/035 2024-04-04T07:11:15.648 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T07:11:15.659 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T07:11:15.698 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T07:11:15.698 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/036) 2024-04-04T07:11:16.552 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T07:11:16.568 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T07:11:16.568 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T07:11:27.576 INFO:teuthology.orchestra.run.smithi072.stdout:generic/036 11s 2024-04-04T07:11:27.600 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/036 2024-04-04T07:11:27.600 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T07:11:27.614 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T07:11:27.653 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T07:11:27.653 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/037) 2024-04-04T07:11:28.501 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T07:11:28.519 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T07:11:28.519 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T07:11:28.989 INFO:teuthology.orchestra.run.smithi072.stdout:generic/037 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T07:11:29.002 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/037 2024-04-04T07:11:29.002 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/037 2024-04-04T07:11:29.002 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T07:11:29.013 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T07:11:29.045 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T07:11:29.045 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/038) 2024-04-04T07:11:29.783 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T07:11:29.800 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T07:11:29.800 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T07:11:30.269 INFO:teuthology.orchestra.run.smithi072.stdout:generic/038 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T07:11:30.280 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/038 2024-04-04T07:11:30.280 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/038 2024-04-04T07:11:30.280 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T07:11:30.289 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T07:11:30.324 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T07:11:30.325 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/039) 2024-04-04T07:11:31.046 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T07:11:31.069 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T07:11:31.069 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T07:11:31.562 INFO:teuthology.orchestra.run.smithi072.stdout:generic/039 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T07:11:31.576 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/039 2024-04-04T07:11:31.576 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/039 2024-04-04T07:11:31.576 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T07:11:31.586 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T07:11:31.623 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T07:11:31.624 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/040) 2024-04-04T07:11:32.352 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T07:11:32.369 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T07:11:32.370 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T07:11:32.865 INFO:teuthology.orchestra.run.smithi072.stdout:generic/040 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T07:11:32.879 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/040 2024-04-04T07:11:32.880 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/040 2024-04-04T07:11:32.880 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T07:11:32.890 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T07:11:32.927 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T07:11:32.928 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/041) 2024-04-04T07:11:33.650 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T07:11:33.663 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T07:11:33.663 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T07:11:34.189 INFO:teuthology.orchestra.run.smithi072.stdout:generic/041 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T07:11:34.202 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/041 2024-04-04T07:11:34.202 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/041 2024-04-04T07:11:34.202 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T07:11:34.213 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T07:11:34.249 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T07:11:34.249 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/042) 2024-04-04T07:11:34.974 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T07:11:34.991 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T07:11:34.991 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T07:11:35.470 INFO:teuthology.orchestra.run.smithi072.stdout:generic/042 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T07:11:35.482 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/042 2024-04-04T07:11:35.483 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/042 2024-04-04T07:11:35.483 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T07:11:35.495 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T07:11:35.534 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T07:11:35.534 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/043) 2024-04-04T07:11:36.252 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T07:11:36.267 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T07:11:36.267 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T07:11:36.728 INFO:teuthology.orchestra.run.smithi072.stdout:generic/043 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T07:11:36.746 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/043 2024-04-04T07:11:36.746 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/043 2024-04-04T07:11:36.746 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T07:11:36.757 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T07:11:36.792 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T07:11:36.792 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/044) 2024-04-04T07:11:37.503 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T07:11:37.519 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T07:11:37.520 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T07:11:37.988 INFO:teuthology.orchestra.run.smithi072.stdout:generic/044 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T07:11:38.002 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/044 2024-04-04T07:11:38.002 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/044 2024-04-04T07:11:38.003 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T07:11:38.013 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T07:11:38.056 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T07:11:38.056 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/045) 2024-04-04T07:11:38.768 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T07:11:38.785 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T07:11:38.785 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T07:11:39.234 INFO:teuthology.orchestra.run.smithi072.stdout:generic/045 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T07:11:39.248 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/045 2024-04-04T07:11:39.248 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/045 2024-04-04T07:11:39.248 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T07:11:39.258 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T07:11:39.290 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T07:11:39.290 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/046) 2024-04-04T07:11:39.951 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T07:11:39.967 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T07:11:39.967 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T07:11:40.403 INFO:teuthology.orchestra.run.smithi072.stdout:generic/046 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T07:11:40.417 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/046 2024-04-04T07:11:40.417 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/046 2024-04-04T07:11:40.417 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T07:11:40.927 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T07:11:40.957 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T07:11:40.958 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/047) 2024-04-04T07:11:41.617 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T07:11:41.637 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T07:11:41.637 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T07:11:42.079 INFO:teuthology.orchestra.run.smithi072.stdout:generic/047 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T07:11:42.091 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/047 2024-04-04T07:11:42.091 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/047 2024-04-04T07:11:42.091 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T07:11:42.101 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T07:11:42.135 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T07:11:42.136 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/048) 2024-04-04T07:11:42.821 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T07:11:42.837 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T07:11:42.837 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T07:11:43.302 INFO:teuthology.orchestra.run.smithi072.stdout:generic/048 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T07:11:43.314 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/048 2024-04-04T07:11:43.314 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/048 2024-04-04T07:11:43.314 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T07:11:43.331 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T07:11:43.372 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T07:11:43.373 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/049) 2024-04-04T07:11:44.077 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T07:11:44.093 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T07:11:44.093 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T07:11:44.567 INFO:teuthology.orchestra.run.smithi072.stdout:generic/049 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T07:11:44.582 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/049 2024-04-04T07:11:44.582 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/049 2024-04-04T07:11:44.582 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T07:11:44.592 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T07:11:44.628 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T07:11:44.628 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/050) 2024-04-04T07:11:45.376 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T07:11:45.395 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T07:11:45.395 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T07:11:45.906 INFO:teuthology.orchestra.run.smithi072.stdout:generic/050 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T07:11:45.925 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/050 2024-04-04T07:11:45.925 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/050 2024-04-04T07:11:45.925 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T07:11:45.935 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T07:11:45.970 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T07:11:45.970 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/051) 2024-04-04T07:11:46.672 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T07:11:46.688 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T07:11:46.689 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T07:11:47.163 INFO:teuthology.orchestra.run.smithi072.stdout:generic/051 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T07:11:47.176 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/051 2024-04-04T07:11:47.177 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/051 2024-04-04T07:11:47.177 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T07:11:47.189 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T07:11:47.705 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T07:11:47.705 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/052) 2024-04-04T07:11:48.419 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T07:11:48.434 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T07:11:48.434 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T07:11:48.874 INFO:teuthology.orchestra.run.smithi072.stdout:generic/052 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T07:11:48.886 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/052 2024-04-04T07:11:48.887 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/052 2024-04-04T07:11:48.887 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T07:11:48.896 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T07:11:48.931 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T07:11:48.932 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/053) 2024-04-04T07:11:49.611 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T07:11:49.627 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T07:11:49.627 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T07:11:50.063 INFO:teuthology.orchestra.run.smithi072.stdout:generic/053 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T07:11:50.075 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/053 2024-04-04T07:11:50.075 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/053 2024-04-04T07:11:50.075 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T07:11:50.087 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T07:11:50.118 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T07:11:50.118 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/054) 2024-04-04T07:11:50.782 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T07:11:50.797 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T07:11:50.797 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T07:11:51.221 INFO:teuthology.orchestra.run.smithi072.stdout:generic/054 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T07:11:51.233 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/054 2024-04-04T07:11:51.233 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/054 2024-04-04T07:11:51.233 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T07:11:51.244 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T07:11:51.277 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T07:11:51.277 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/055) 2024-04-04T07:11:51.925 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T07:11:51.942 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T07:11:51.942 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T07:11:52.400 INFO:teuthology.orchestra.run.smithi072.stdout:generic/055 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T07:11:52.416 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/055 2024-04-04T07:11:52.416 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/055 2024-04-04T07:11:52.416 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T07:11:52.426 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T07:11:52.458 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T07:11:52.458 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/056) 2024-04-04T07:11:53.059 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T07:11:53.074 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T07:11:53.074 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T07:11:54.100 INFO:teuthology.orchestra.run.smithi072.stdout:generic/056 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T07:11:54.112 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/056 2024-04-04T07:11:54.113 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/056 2024-04-04T07:11:54.113 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T07:11:54.124 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T07:11:54.168 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T07:11:54.168 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/057) 2024-04-04T07:11:54.808 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T07:11:54.824 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T07:11:54.824 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T07:11:55.298 INFO:teuthology.orchestra.run.smithi072.stdout:generic/057 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T07:11:55.311 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/057 2024-04-04T07:11:55.311 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/057 2024-04-04T07:11:55.311 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T07:11:55.320 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T07:11:55.359 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T07:11:55.359 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/058) 2024-04-04T07:11:55.987 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T07:11:56.003 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T07:11:56.003 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T07:11:59.246 INFO:teuthology.orchestra.run.smithi072.stdout:generic/058 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-04-04T07:11:59.258 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/058 2024-04-04T07:11:59.258 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/058 2024-04-04T07:11:59.258 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T07:11:59.270 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T07:11:59.322 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T07:11:59.322 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/059) 2024-04-04T07:12:00.091 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T07:12:00.106 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T07:12:00.106 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T07:12:00.589 INFO:teuthology.orchestra.run.smithi072.stdout:generic/059 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T07:12:00.603 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/059 2024-04-04T07:12:00.603 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/059 2024-04-04T07:12:00.604 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T07:12:00.613 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T07:12:00.646 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T07:12:00.647 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/060) 2024-04-04T07:12:01.313 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T07:12:01.331 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T07:12:01.332 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T07:12:04.593 INFO:teuthology.orchestra.run.smithi072.stdout:generic/060 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-04-04T07:12:04.604 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/060 2024-04-04T07:12:04.604 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/060 2024-04-04T07:12:04.604 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T07:12:04.616 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T07:12:04.663 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T07:12:04.663 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/061) 2024-04-04T07:12:05.423 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T07:12:05.442 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T07:12:05.442 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T07:12:08.688 INFO:teuthology.orchestra.run.smithi072.stdout:generic/061 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-04-04T07:12:08.706 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/061 2024-04-04T07:12:08.707 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/061 2024-04-04T07:12:08.707 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T07:12:08.716 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T07:12:08.764 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T07:12:08.764 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/062) 2024-04-04T07:12:09.549 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T07:12:09.566 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T07:12:09.566 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T07:12:10.014 INFO:teuthology.orchestra.run.smithi072.stdout:generic/062 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T07:12:10.026 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/062 2024-04-04T07:12:10.026 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/062 2024-04-04T07:12:10.026 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T07:12:10.043 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T07:12:10.073 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T07:12:10.073 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/063) 2024-04-04T07:12:10.740 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T07:12:10.757 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T07:12:10.757 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T07:12:14.086 INFO:teuthology.orchestra.run.smithi072.stdout:generic/063 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-04-04T07:12:14.097 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/063 2024-04-04T07:12:14.098 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/063 2024-04-04T07:12:14.098 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T07:12:14.109 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T07:12:14.156 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T07:12:14.156 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/064) 2024-04-04T07:12:14.948 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T07:12:14.963 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T07:12:14.963 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T07:12:15.408 INFO:teuthology.orchestra.run.smithi072.stdout:generic/064 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T07:12:15.420 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/064 2024-04-04T07:12:15.420 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/064 2024-04-04T07:12:15.420 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T07:12:15.433 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T07:12:15.463 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T07:12:15.463 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/065) 2024-04-04T07:12:16.122 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T07:12:16.142 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T07:12:16.142 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T07:12:16.627 INFO:teuthology.orchestra.run.smithi072.stdout:generic/065 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T07:12:16.639 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/065 2024-04-04T07:12:16.639 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/065 2024-04-04T07:12:16.640 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T07:12:16.648 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T07:12:16.680 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T07:12:16.681 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/066) 2024-04-04T07:12:17.343 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T07:12:17.362 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T07:12:17.362 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T07:12:17.836 INFO:teuthology.orchestra.run.smithi072.stdout:generic/066 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T07:12:17.850 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/066 2024-04-04T07:12:17.851 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/066 2024-04-04T07:12:17.851 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T07:12:17.860 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T07:12:17.899 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T07:12:17.900 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/067) 2024-04-04T07:12:18.391 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T07:12:18.398 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T07:12:18.545 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T07:12:18.563 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T07:12:18.563 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T07:12:19.078 INFO:teuthology.orchestra.run.smithi072.stdout:generic/067 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T07:12:19.091 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/067 2024-04-04T07:12:19.091 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/067 2024-04-04T07:12:19.091 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T07:12:19.102 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T07:12:19.135 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T07:12:19.135 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/068) 2024-04-04T07:12:19.812 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T07:12:19.826 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T07:12:19.826 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T07:12:20.258 INFO:teuthology.orchestra.run.smithi072.stdout:generic/068 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T07:12:20.270 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/068 2024-04-04T07:12:20.270 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/068 2024-04-04T07:12:20.270 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T07:12:20.278 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T07:12:20.313 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T07:12:20.313 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/069) 2024-04-04T07:12:21.001 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T07:12:21.020 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T07:12:21.020 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T07:12:21.460 INFO:teuthology.orchestra.run.smithi072.stdout:generic/069 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T07:12:21.472 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/069 2024-04-04T07:12:21.473 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/069 2024-04-04T07:12:21.473 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T07:12:21.482 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T07:12:21.517 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T07:12:21.517 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/070) 2024-04-04T07:12:22.178 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T07:12:22.198 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T07:12:22.198 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T07:12:48.537 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T07:12:48.542 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T07:13:19.558 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T07:13:19.565 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T07:13:49.762 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T07:13:49.773 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T07:14:19.937 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T07:14:19.946 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T07:14:39.035 INFO:teuthology.orchestra.run.smithi072.stdout:generic/070 137s 2024-04-04T07:14:39.055 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/070 2024-04-04T07:14:39.055 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T07:14:39.066 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T07:14:39.101 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T07:14:39.102 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/071) 2024-04-04T07:14:39.879 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T07:14:39.893 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T07:14:39.893 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T07:14:40.308 INFO:teuthology.orchestra.run.smithi072.stdout:generic/071 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T07:14:40.323 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/071 2024-04-04T07:14:40.323 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/071 2024-04-04T07:14:40.323 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T07:14:40.335 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T07:14:40.373 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T07:14:40.374 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/072) 2024-04-04T07:14:41.026 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T07:14:41.042 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T07:14:41.043 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T07:14:43.788 INFO:teuthology.orchestra.run.smithi072.stdout:generic/072 [not run] xfs_io fcollapse failed (old kernel/wrong fs?) 2024-04-04T07:14:43.802 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/072 2024-04-04T07:14:43.802 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/072 2024-04-04T07:14:43.802 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T07:14:43.813 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T07:14:43.850 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T07:14:43.851 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/073) 2024-04-04T07:14:44.490 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T07:14:44.505 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T07:14:44.506 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T07:14:44.963 INFO:teuthology.orchestra.run.smithi072.stdout:generic/073 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T07:14:44.975 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/073 2024-04-04T07:14:44.975 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/073 2024-04-04T07:14:44.976 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T07:14:44.985 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T07:14:45.015 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T07:14:45.016 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/074) 2024-04-04T07:14:45.667 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T07:14:45.683 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T07:14:45.683 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T07:14:50.077 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T07:14:50.084 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T07:15:20.214 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T07:15:20.226 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T07:15:57.476 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T07:15:57.484 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T07:16:27.627 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T07:16:27.639 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T07:16:57.786 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T07:16:57.792 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T07:17:27.935 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T07:17:27.941 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T07:17:58.081 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T07:17:58.087 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T07:18:28.245 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T07:18:28.251 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T07:18:58.580 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T07:18:58.595 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T07:19:28.821 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T07:19:28.831 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T07:19:59.135 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T07:19:59.140 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T07:20:29.275 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T07:20:29.281 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T07:20:59.420 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T07:20:59.430 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T07:21:29.610 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T07:21:29.628 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T07:22:02.361 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T07:22:02.369 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T07:22:33.150 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T07:22:33.160 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T07:23:03.927 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T07:23:03.934 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T07:23:35.285 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T07:23:35.292 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T07:24:05.479 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T07:24:05.489 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T07:24:37.516 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T07:24:37.529 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T07:25:11.744 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T07:25:11.754 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T07:25:41.922 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T07:25:41.928 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T07:26:12.066 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T07:26:12.073 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T07:26:42.264 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T07:26:42.272 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T07:27:12.435 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T07:27:12.442 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T07:27:42.588 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T07:27:42.597 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T07:28:12.758 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T07:28:12.764 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T07:28:42.908 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T07:28:42.913 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T07:29:14.707 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T07:29:14.718 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T07:29:44.893 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T07:29:44.899 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T07:30:15.196 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T07:30:15.203 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T07:30:49.461 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T07:30:49.468 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T07:31:20.364 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T07:31:20.371 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T07:31:50.909 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T07:31:50.917 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T07:32:23.028 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T07:32:23.042 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T07:32:57.677 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T07:32:57.686 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T07:33:27.883 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T07:33:27.891 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T07:33:58.068 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T07:33:58.077 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T07:34:28.250 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T07:34:28.259 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T07:34:58.419 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T07:34:58.429 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T07:35:32.462 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T07:35:32.469 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T07:36:07.349 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T07:36:07.356 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T07:36:37.521 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T07:36:37.527 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T07:37:08.229 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T07:37:08.234 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T07:37:38.782 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T07:37:38.792 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T07:38:09.012 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T07:38:09.019 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T07:38:39.159 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T07:38:39.168 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T07:39:09.387 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T07:39:09.395 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T07:39:39.552 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T07:39:39.561 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T07:40:09.722 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T07:40:09.730 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T07:40:39.876 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T07:40:39.885 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T07:41:10.323 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T07:41:10.336 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T07:41:41.580 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T07:41:41.588 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T07:42:13.089 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T07:42:13.097 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T07:42:43.233 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T07:42:43.243 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T07:43:13.381 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T07:43:13.392 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T07:43:43.538 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T07:43:43.546 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T07:44:14.093 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T07:44:14.101 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T07:44:14.492 INFO:teuthology.orchestra.run.smithi072.stdout:generic/074 1769s 2024-04-04T07:44:14.547 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/074 2024-04-04T07:44:14.547 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T07:44:14.564 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T07:44:14.638 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T07:44:14.639 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/075) 2024-04-04T07:44:15.600 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T07:44:15.612 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T07:44:15.612 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T07:44:44.432 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T07:44:44.441 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T07:45:14.569 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T07:45:14.580 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T07:45:44.724 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T07:45:44.733 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T07:45:53.837 INFO:teuthology.orchestra.run.smithi072.stdout:generic/075 98s 2024-04-04T07:45:53.856 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/075 2024-04-04T07:45:53.856 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T07:45:53.868 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T07:45:53.933 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T07:45:53.933 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/076) 2024-04-04T07:45:54.655 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T07:45:54.667 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T07:45:54.667 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T07:45:55.060 INFO:teuthology.orchestra.run.smithi072.stdout:generic/076 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T07:45:55.071 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/076 2024-04-04T07:45:55.071 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/076 2024-04-04T07:45:55.071 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T07:45:55.079 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T07:45:55.108 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T07:45:55.108 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/077) 2024-04-04T07:45:55.598 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T07:45:55.609 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T07:45:55.609 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T07:45:56.666 INFO:teuthology.orchestra.run.smithi072.stdout:generic/077 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T07:45:56.679 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/077 2024-04-04T07:45:56.679 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/077 2024-04-04T07:45:56.680 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T07:45:56.691 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T07:45:56.721 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T07:45:56.721 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/078) 2024-04-04T07:45:57.222 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T07:45:57.233 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T07:45:57.234 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T07:45:57.684 INFO:teuthology.orchestra.run.smithi072.stdout:generic/078 [not run] kernel doesn't support renameat2 syscall 2024-04-04T07:45:57.698 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/078 2024-04-04T07:45:57.698 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/078 2024-04-04T07:45:57.698 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T07:45:57.709 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T07:45:57.766 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T07:45:57.767 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/079) 2024-04-04T07:45:58.467 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T07:45:58.477 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T07:45:58.478 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T07:45:58.934 INFO:teuthology.orchestra.run.smithi072.stdout:generic/079 [not run] file system doesn't support chattr +ia 2024-04-04T07:45:58.943 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/079 2024-04-04T07:45:58.943 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/079 2024-04-04T07:45:58.943 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T07:45:58.951 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T07:45:58.975 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T07:45:58.976 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/080) 2024-04-04T07:45:59.445 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T07:45:59.455 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T07:45:59.456 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T07:46:01.928 INFO:teuthology.orchestra.run.smithi072.stdout:generic/080 2s 2024-04-04T07:46:01.945 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/080 2024-04-04T07:46:01.945 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T07:46:01.954 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T07:46:01.981 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T07:46:01.981 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/081) 2024-04-04T07:46:02.493 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T07:46:02.504 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T07:46:02.504 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T07:46:02.869 INFO:teuthology.orchestra.run.smithi072.stdout:generic/081 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T07:46:02.881 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/081 2024-04-04T07:46:02.881 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/081 2024-04-04T07:46:02.881 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T07:46:02.887 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T07:46:02.914 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T07:46:02.914 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/082) 2024-04-04T07:46:03.417 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T07:46:03.429 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T07:46:03.430 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T07:46:03.808 INFO:teuthology.orchestra.run.smithi072.stdout:generic/082 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T07:46:03.819 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/082 2024-04-04T07:46:03.819 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/082 2024-04-04T07:46:03.819 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T07:46:03.828 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T07:46:03.854 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T07:46:03.854 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/083) 2024-04-04T07:46:04.353 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T07:46:04.365 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T07:46:04.366 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T07:46:04.760 INFO:teuthology.orchestra.run.smithi072.stdout:generic/083 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T07:46:04.770 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/083 2024-04-04T07:46:04.771 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/083 2024-04-04T07:46:04.771 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T07:46:04.780 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T07:46:04.811 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T07:46:04.811 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/084) 2024-04-04T07:46:05.282 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T07:46:05.292 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T07:46:05.292 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T07:46:05.715 INFO:teuthology.orchestra.run.smithi072.stdout:generic/084 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T07:46:05.728 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/084 2024-04-04T07:46:05.728 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/084 2024-04-04T07:46:05.729 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T07:46:05.739 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T07:46:05.766 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T07:46:05.767 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/085) 2024-04-04T07:46:06.268 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T07:46:06.279 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T07:46:06.279 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T07:46:06.724 INFO:teuthology.orchestra.run.smithi072.stdout:generic/085 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T07:46:06.737 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/085 2024-04-04T07:46:06.737 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/085 2024-04-04T07:46:06.737 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T07:46:06.747 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T07:46:06.774 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T07:46:06.775 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/086) 2024-04-04T07:46:07.296 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T07:46:07.307 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T07:46:07.307 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T07:46:15.399 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T07:46:15.408 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T07:46:27.668 INFO:teuthology.orchestra.run.smithi072.stdout:generic/086 20s 2024-04-04T07:46:27.784 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/086 2024-04-04T07:46:27.784 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T07:46:27.795 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T07:46:28.074 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T07:46:28.074 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/087) 2024-04-04T07:46:29.873 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T07:46:29.885 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T07:46:29.886 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T07:46:30.748 INFO:teuthology.orchestra.run.smithi072.stdout:generic/087 1s 2024-04-04T07:46:30.766 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/087 2024-04-04T07:46:30.766 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T07:46:30.775 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T07:46:30.808 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T07:46:30.808 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/088) 2024-04-04T07:46:31.554 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T07:46:31.564 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T07:46:31.565 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T07:46:32.076 INFO:teuthology.orchestra.run.smithi072.stdout:generic/088 1s 2024-04-04T07:46:32.091 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/088 2024-04-04T07:46:32.092 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T07:46:32.099 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T07:46:32.140 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T07:46:32.140 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/089) 2024-04-04T07:46:32.838 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T07:46:32.849 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T07:46:32.849 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T07:46:45.582 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T07:46:45.587 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T07:47:15.747 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T07:47:15.754 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T07:47:46.423 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T07:47:46.429 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T07:48:20.362 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T07:48:20.368 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T07:48:52.068 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T07:48:52.081 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T07:49:22.225 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T07:49:22.230 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T07:49:54.697 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T07:49:54.704 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T07:50:24.835 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T07:50:24.841 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T07:50:58.146 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T07:50:58.152 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T07:51:28.299 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T07:51:28.307 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T07:51:30.244 INFO:tasks.ceph.mds.a.smithi072.stderr:2024-04-04T07:51:30.245+0000 7fa395800640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 158189) UID: 0 2024-04-04T07:51:30.244 INFO:tasks.ceph.mds.c.smithi072.stderr:2024-04-04T07:51:30.245+0000 7fc131e00640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 158189) UID: 0 2024-04-04T07:55:39.216 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T07:55:39.221 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T07:56:09.344 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T07:56:09.350 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T07:56:39.520 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T07:56:39.525 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T07:57:11.348 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T07:57:11.354 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T07:57:41.526 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T07:57:41.534 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T07:57:41.623 INFO:tasks.ceph.mds.a.smithi072.stderr:2024-04-04T07:57:41.624+0000 7fa395800640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 158499) UID: 0 2024-04-04T07:57:41.623 INFO:tasks.ceph.mds.c.smithi072.stderr:2024-04-04T07:57:41.624+0000 7fc131e00640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 158499) UID: 0 2024-04-04T08:00:45.351 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T08:00:45.360 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T08:01:17.420 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T08:01:17.429 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T08:01:47.608 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T08:01:47.615 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T08:02:20.382 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T08:02:20.391 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T08:02:50.587 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T08:02:50.614 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T08:03:22.336 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T08:03:22.344 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T08:03:52.746 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T08:03:52.756 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T08:04:22.885 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T08:04:22.898 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T08:04:23.010 INFO:tasks.ceph.mds.a.smithi072.stderr:2024-04-04T08:04:23.010+0000 7fa395800640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 160684) UID: 0 2024-04-04T08:04:23.010 INFO:tasks.ceph.mds.c.smithi072.stderr:2024-04-04T08:04:23.010+0000 7fc131e00640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 160684) UID: 0 2024-04-04T08:07:01.043 INFO:tasks.ceph.osd.1.smithi072.stderr:2024-04-04T08:07:01.042+0000 7fa436800640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 160689) UID: 0 2024-04-04T08:07:01.043 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-04T08:07:01.042+0000 7f4e66800640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 160689) UID: 0 2024-04-04T08:07:01.044 INFO:tasks.ceph.osd.2.smithi072.stderr:2024-04-04T08:07:01.042+0000 7f7521000640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 160689) UID: 0 2024-04-04T08:07:01.044 INFO:tasks.ceph.osd.3.smithi072.stderr:2024-04-04T08:07:01.042+0000 7f0d67400640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 160689) UID: 0 2024-04-04T08:12:09.175 INFO:teuthology.orchestra.run.smithi072.stdout:generic/089 1537s 2024-04-04T08:12:09.248 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/089 2024-04-04T08:12:09.248 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T08:12:09.255 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T08:12:09.286 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T08:12:09.286 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/090) 2024-04-04T08:12:10.460 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T08:12:10.471 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T08:12:10.472 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T08:12:11.059 INFO:teuthology.orchestra.run.smithi072.stdout:generic/090 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T08:12:11.071 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/090 2024-04-04T08:12:11.071 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/090 2024-04-04T08:12:11.071 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T08:12:11.080 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T08:12:11.108 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T08:12:11.109 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/091) 2024-04-04T08:12:11.622 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T08:12:11.633 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T08:12:11.633 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T08:12:12.689 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T08:12:12.699 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T08:12:12.837 INFO:tasks.ceph.mds.a.smithi072.stderr:2024-04-04T08:12:12.837+0000 7fa395800640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 161602) UID: 0 2024-04-04T08:12:12.837 INFO:tasks.ceph.mds.c.smithi072.stderr:2024-04-04T08:12:12.837+0000 7fc131e00640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 161602) UID: 0 2024-04-04T08:15:18.925 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T08:15:18.952 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T08:15:19.077 INFO:tasks.ceph.osd.5.smithi117.stderr:2024-04-04T08:15:19.077+0000 7f144e000640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 46538) UID: 0 2024-04-04T08:15:19.077 INFO:tasks.ceph.osd.4.smithi117.stderr:2024-04-04T08:15:19.077+0000 7f248de00640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 46538) UID: 0 2024-04-04T08:15:19.078 INFO:tasks.ceph.osd.6.smithi117.stderr:2024-04-04T08:15:19.077+0000 7fb935800640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 46538) UID: 0 2024-04-04T08:15:19.078 INFO:tasks.ceph.osd.7.smithi117.stderr:2024-04-04T08:15:19.077+0000 7f3028600640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 46538) UID: 0 2024-04-04T08:17:03.848 INFO:teuthology.orchestra.run.smithi072.stdout:generic/091 292s 2024-04-04T08:17:03.861 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/091 2024-04-04T08:17:03.862 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T08:17:03.871 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T08:17:03.922 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T08:17:03.923 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/092) 2024-04-04T08:17:04.675 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T08:17:04.685 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T08:17:04.685 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T08:17:05.184 INFO:teuthology.orchestra.run.smithi072.stdout:generic/092 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-04-04T08:17:05.195 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/092 2024-04-04T08:17:05.195 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/092 2024-04-04T08:17:05.195 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T08:17:05.202 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T08:17:05.241 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T08:17:05.241 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/093) 2024-04-04T08:17:05.955 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T08:17:05.967 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T08:17:05.967 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T08:17:07.529 INFO:teuthology.orchestra.run.smithi072.stdout:generic/093 2s 2024-04-04T08:17:07.549 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/093 2024-04-04T08:17:07.550 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T08:17:07.561 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T08:17:07.598 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T08:17:07.598 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/094) 2024-04-04T08:17:08.343 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T08:17:08.350 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T08:17:08.350 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T08:17:09.062 INFO:teuthology.orchestra.run.smithi072.stdout:generic/094 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T08:17:09.071 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/094 2024-04-04T08:17:09.071 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/094 2024-04-04T08:17:09.072 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T08:17:09.079 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T08:17:09.106 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T08:17:09.106 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/095) 2024-04-04T08:17:09.554 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T08:17:09.567 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T08:17:09.567 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T08:17:10.252 INFO:teuthology.orchestra.run.smithi072.stdout:generic/095 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T08:17:10.265 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/095 2024-04-04T08:17:10.266 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/095 2024-04-04T08:17:10.266 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T08:17:10.276 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T08:17:10.303 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T08:17:10.304 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/096) 2024-04-04T08:17:10.811 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T08:17:10.825 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T08:17:10.825 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T08:17:11.222 INFO:teuthology.orchestra.run.smithi072.stdout:generic/096 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T08:17:11.232 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/096 2024-04-04T08:17:11.232 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/096 2024-04-04T08:17:11.232 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T08:17:11.239 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T08:17:11.265 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T08:17:11.266 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/097) 2024-04-04T08:17:11.800 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T08:17:11.812 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T08:17:11.813 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T08:17:12.962 INFO:teuthology.orchestra.run.smithi072.stdout:generic/097 1s 2024-04-04T08:17:12.975 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/097 2024-04-04T08:17:12.976 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T08:17:12.982 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T08:17:13.010 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T08:17:13.011 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/098) 2024-04-04T08:17:13.497 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T08:17:13.509 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T08:17:13.509 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T08:17:13.847 INFO:teuthology.orchestra.run.smithi072.stdout:generic/098 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T08:17:13.859 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/098 2024-04-04T08:17:13.859 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/098 2024-04-04T08:17:13.859 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T08:17:13.868 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T08:17:13.896 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T08:17:13.896 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/099) 2024-04-04T08:17:14.382 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T08:17:14.394 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T08:17:14.395 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T08:17:14.846 INFO:teuthology.orchestra.run.smithi072.stdout:generic/099 [not run] ACLs not supported by this filesystem type: ceph-fuse 2024-04-04T08:17:14.857 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/099 2024-04-04T08:17:14.857 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/099 2024-04-04T08:17:14.858 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T08:17:14.867 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T08:17:14.893 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T08:17:14.894 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/100) 2024-04-04T08:17:15.418 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T08:17:15.430 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T08:17:15.430 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T08:17:39.336 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T08:17:39.343 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T08:18:09.471 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T08:18:09.482 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T08:18:39.692 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T08:18:39.703 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T08:18:45.758 INFO:teuthology.orchestra.run.smithi072.stdout:generic/100 90s 2024-04-04T08:18:45.775 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/100 2024-04-04T08:18:45.775 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T08:18:45.784 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T08:18:45.852 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T08:18:45.852 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/101) 2024-04-04T08:18:46.668 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T08:18:46.679 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T08:18:46.679 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T08:18:47.071 INFO:teuthology.orchestra.run.smithi072.stdout:generic/101 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T08:18:47.081 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/101 2024-04-04T08:18:47.081 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/101 2024-04-04T08:18:47.081 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T08:18:47.091 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T08:18:47.110 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T08:18:47.110 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/102) 2024-04-04T08:18:47.625 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T08:18:47.636 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T08:18:47.636 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T08:18:48.056 INFO:teuthology.orchestra.run.smithi072.stdout:generic/102 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T08:18:48.069 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/102 2024-04-04T08:18:48.069 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/102 2024-04-04T08:18:48.069 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T08:18:48.080 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T08:18:48.107 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T08:18:48.107 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/103) 2024-04-04T08:18:48.623 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T08:18:48.635 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T08:18:48.635 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T08:18:49.036 INFO:teuthology.orchestra.run.smithi072.stdout:generic/103 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T08:18:49.048 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/103 2024-04-04T08:18:49.049 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/103 2024-04-04T08:18:49.049 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T08:18:49.057 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T08:18:49.084 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T08:18:49.084 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/104) 2024-04-04T08:18:49.631 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T08:18:49.642 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T08:18:49.643 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T08:18:50.121 INFO:teuthology.orchestra.run.smithi072.stdout:generic/104 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T08:18:50.135 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/104 2024-04-04T08:18:50.136 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/104 2024-04-04T08:18:50.136 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T08:18:50.150 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T08:18:50.176 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T08:18:50.177 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/105) 2024-04-04T08:18:50.699 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T08:18:50.713 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T08:18:50.713 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T08:18:51.084 INFO:teuthology.orchestra.run.smithi072.stdout:generic/105 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T08:18:51.095 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/105 2024-04-04T08:18:51.095 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/105 2024-04-04T08:18:51.095 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T08:18:51.105 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T08:18:51.132 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T08:18:51.132 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/106) 2024-04-04T08:18:51.685 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T08:18:51.698 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T08:18:51.699 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T08:18:52.090 INFO:teuthology.orchestra.run.smithi072.stdout:generic/106 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T08:18:52.102 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/106 2024-04-04T08:18:52.102 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/106 2024-04-04T08:18:52.103 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T08:18:52.111 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T08:18:52.140 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T08:18:52.140 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/107) 2024-04-04T08:18:52.651 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T08:18:52.662 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T08:18:52.662 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T08:18:53.565 INFO:teuthology.orchestra.run.smithi072.stdout:generic/107 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T08:18:53.578 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/107 2024-04-04T08:18:53.578 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/107 2024-04-04T08:18:53.578 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T08:18:53.590 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T08:18:53.621 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T08:18:53.621 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/108) 2024-04-04T08:18:54.130 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T08:18:54.141 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T08:18:54.142 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T08:18:54.828 INFO:teuthology.orchestra.run.smithi072.stdout:generic/108 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T08:18:54.841 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/108 2024-04-04T08:18:54.841 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/108 2024-04-04T08:18:54.841 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T08:18:54.853 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T08:18:54.885 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T08:18:54.885 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/109) 2024-04-04T08:18:55.390 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T08:18:55.401 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T08:18:55.401 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T08:18:55.765 INFO:teuthology.orchestra.run.smithi072.stdout:generic/109 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T08:18:55.776 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/109 2024-04-04T08:18:55.777 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/109 2024-04-04T08:18:55.777 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T08:18:55.785 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T08:18:55.813 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T08:18:55.813 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/110) 2024-04-04T08:18:56.313 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T08:18:56.324 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T08:18:56.324 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T08:18:56.808 INFO:teuthology.orchestra.run.smithi072.stdout:generic/110 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-04-04T08:18:56.818 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/110 2024-04-04T08:18:56.818 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/110 2024-04-04T08:18:56.818 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T08:18:56.826 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T08:18:56.857 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T08:18:56.857 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/111) 2024-04-04T08:18:57.591 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T08:18:57.603 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T08:18:57.603 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T08:18:58.128 INFO:teuthology.orchestra.run.smithi072.stdout:generic/111 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-04-04T08:18:58.139 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/111 2024-04-04T08:18:58.139 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/111 2024-04-04T08:18:58.139 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T08:18:58.147 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T08:18:58.172 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T08:18:58.172 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/112) 2024-04-04T08:18:59.389 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T08:18:59.401 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T08:18:59.401 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T08:19:09.897 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T08:19:09.905 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T08:19:40.108 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T08:19:40.116 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T08:20:10.236 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T08:20:10.245 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T08:20:40.371 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T08:20:40.380 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T08:20:42.328 INFO:teuthology.orchestra.run.smithi072.stdout:generic/112 103s 2024-04-04T08:20:42.344 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/112 2024-04-04T08:20:42.344 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T08:20:42.353 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T08:20:42.391 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T08:20:42.392 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/113) 2024-04-04T08:20:43.146 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T08:20:43.158 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T08:20:43.158 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T08:21:10.560 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T08:21:10.568 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T08:21:31.067 INFO:teuthology.orchestra.run.smithi072.stdout:generic/113 48s 2024-04-04T08:21:31.078 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/113 2024-04-04T08:21:31.078 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T08:21:31.086 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T08:21:31.142 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T08:21:31.142 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/114) 2024-04-04T08:21:31.891 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T08:21:31.902 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T08:21:31.902 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T08:21:33.659 INFO:teuthology.orchestra.run.smithi072.stdout:generic/114 [not run] Sparse files are not supported or do not work as expected 2024-04-04T08:21:33.670 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/114 2024-04-04T08:21:33.671 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/114 2024-04-04T08:21:33.671 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T08:21:33.679 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T08:21:33.710 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T08:21:33.710 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/115) 2024-04-04T08:21:34.194 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T08:21:34.206 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T08:21:34.206 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T08:21:35.016 INFO:teuthology.orchestra.run.smithi072.stdout:generic/115 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-04-04T08:21:35.027 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/115 2024-04-04T08:21:35.027 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/115 2024-04-04T08:21:35.027 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T08:21:35.034 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T08:21:35.060 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T08:21:35.061 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/116) 2024-04-04T08:21:36.212 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T08:21:36.223 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T08:21:36.223 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T08:21:37.863 INFO:teuthology.orchestra.run.smithi072.stdout:generic/116 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-04-04T08:21:37.876 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/116 2024-04-04T08:21:37.876 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/116 2024-04-04T08:21:37.876 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T08:21:37.887 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T08:21:37.926 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T08:21:37.927 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/117) 2024-04-04T08:21:38.674 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T08:21:38.685 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T08:21:38.685 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T08:21:40.492 INFO:teuthology.orchestra.run.smithi072.stdout:generic/117 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T08:21:40.504 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/117 2024-04-04T08:21:40.504 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/117 2024-04-04T08:21:40.504 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T08:21:40.514 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T08:21:40.544 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T08:21:40.544 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/118) 2024-04-04T08:21:40.689 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T08:21:40.693 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T08:21:41.014 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T08:21:41.026 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T08:21:41.026 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T08:21:41.471 INFO:teuthology.orchestra.run.smithi072.stdout:generic/118 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-04-04T08:21:41.481 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/118 2024-04-04T08:21:41.481 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/118 2024-04-04T08:21:41.481 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T08:21:41.489 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T08:21:41.527 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T08:21:41.528 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/119) 2024-04-04T08:21:42.275 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T08:21:42.286 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T08:21:42.286 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T08:21:42.800 INFO:teuthology.orchestra.run.smithi072.stdout:generic/119 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-04-04T08:21:42.810 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/119 2024-04-04T08:21:42.810 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/119 2024-04-04T08:21:42.811 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T08:21:42.818 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T08:21:42.862 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T08:21:42.863 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/120) 2024-04-04T08:21:43.572 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T08:21:43.583 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T08:21:43.583 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T08:21:43.950 INFO:teuthology.orchestra.run.smithi072.stdout:generic/120 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T08:21:43.960 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/120 2024-04-04T08:21:43.960 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/120 2024-04-04T08:21:43.960 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T08:21:43.968 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T08:21:43.996 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T08:21:43.996 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/121) 2024-04-04T08:21:44.506 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T08:21:44.519 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T08:21:44.519 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T08:21:45.039 INFO:teuthology.orchestra.run.smithi072.stdout:generic/121 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2024-04-04T08:21:45.049 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/121 2024-04-04T08:21:45.049 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/121 2024-04-04T08:21:45.049 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T08:21:45.057 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T08:21:45.097 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T08:21:45.097 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/122) 2024-04-04T08:21:45.848 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T08:21:45.859 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T08:21:45.859 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T08:21:46.336 INFO:teuthology.orchestra.run.smithi072.stdout:generic/122 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2024-04-04T08:21:46.344 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/122 2024-04-04T08:21:46.344 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/122 2024-04-04T08:21:46.344 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T08:21:46.351 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T08:21:46.374 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T08:21:46.374 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/123) 2024-04-04T08:21:47.198 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T08:21:47.219 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T08:21:47.219 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T08:21:48.253 INFO:teuthology.orchestra.run.smithi072.stdout:generic/123 1s 2024-04-04T08:21:48.986 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/123 2024-04-04T08:21:48.986 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T08:21:48.986 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T08:21:48.986 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T08:21:48.987 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/124) 2024-04-04T08:21:49.509 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T08:21:49.520 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T08:21:49.520 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T08:21:49.887 INFO:teuthology.orchestra.run.smithi072.stdout:generic/124 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T08:21:49.900 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/124 2024-04-04T08:21:49.901 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/124 2024-04-04T08:21:49.901 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T08:21:49.912 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T08:21:49.939 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T08:21:49.939 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/125) 2024-04-04T08:21:50.432 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T08:21:50.443 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T08:21:50.443 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T08:22:10.825 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T08:22:10.834 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T08:22:40.979 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T08:22:40.987 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T08:22:52.818 INFO:teuthology.orchestra.run.smithi072.stdout:generic/125 62s 2024-04-04T08:22:52.835 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/125 2024-04-04T08:22:52.835 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T08:22:52.845 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T08:22:52.883 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T08:22:52.883 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/126) 2024-04-04T08:22:53.610 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T08:22:53.620 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T08:22:53.620 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T08:22:54.756 INFO:teuthology.orchestra.run.smithi072.stdout:generic/126 - output mismatch (see /tmp/tmp.tiFz9P8iUAxfstests-dev/results//generic/126.out.bad) 2024-04-04T08:22:54.762 INFO:teuthology.orchestra.run.smithi072.stdout: --- tests/generic/126.out 2024-04-04 06:58:02.181454211 +0000 2024-04-04T08:22:54.762 INFO:teuthology.orchestra.run.smithi072.stdout: +++ /tmp/tmp.tiFz9P8iUAxfstests-dev/results//generic/126.out.bad 2024-04-04 08:22:54.754318129 +0000 2024-04-04T08:22:54.762 INFO:teuthology.orchestra.run.smithi072.stdout: @@ -1,7 +1,7 @@ 2024-04-04T08:22:54.762 INFO:teuthology.orchestra.run.smithi072.stdout: QA output created by 126 2024-04-04T08:22:54.762 INFO:teuthology.orchestra.run.smithi072.stdout: -x a 001 file owned by (99/99) as user/group(12/100) PASS 2024-04-04T08:22:54.762 INFO:teuthology.orchestra.run.smithi072.stdout: -x a 010 file owned by (99/99) as user/group(200/99) PASS 2024-04-04T08:22:54.762 INFO:teuthology.orchestra.run.smithi072.stdout: -x a 100 file owned by (99/99) as user/group(99/500) PASS 2024-04-04T08:22:54.762 INFO:teuthology.orchestra.run.smithi072.stdout: +x a 001 file owned by (99/99) as user/group(12/100) FAIL 2024-04-04T08:22:54.762 INFO:teuthology.orchestra.run.smithi072.stdout: +x a 010 file owned by (99/99) as user/group(200/99) FAIL 2024-04-04T08:22:54.763 INFO:teuthology.orchestra.run.smithi072.stdout: +x a 100 file owned by (99/99) as user/group(99/500) FAIL 2024-04-04T08:22:54.763 INFO:teuthology.orchestra.run.smithi072.stdout: w a 002 file owned by (99/99) as user/group(12/100) PASS 2024-04-04T08:22:54.763 INFO:teuthology.orchestra.run.smithi072.stdout: w a 020 file owned by (99/99) as user/group(200/99) PASS 2024-04-04T08:22:54.763 INFO:teuthology.orchestra.run.smithi072.stdout: w a 200 file owned by (99/99) as user/group(99/500) PASS 2024-04-04T08:22:54.768 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/126 2024-04-04T08:22:54.768 INFO:teuthology.orchestra.run.smithi072.stdout:Failures: generic/126 2024-04-04T08:22:54.768 INFO:teuthology.orchestra.run.smithi072.stdout:Failed 1 of 1 tests 2024-04-04T08:22:54.775 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T08:22:54.798 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-04T08:22:54.799 INFO:tasks.cephfs.xfstests_dev:Command failed 2024-04-04T08:22:54.799 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2024-04-04T08:22:54.799 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/127) 2024-04-04T08:22:55.558 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T08:22:55.569 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T08:22:55.569 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T08:23:11.118 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T08:23:11.127 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T08:23:41.327 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T08:23:41.335 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T08:24:11.521 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T08:24:11.531 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T08:24:41.725 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T08:24:41.735 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T08:25:11.920 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T08:25:11.929 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T08:25:42.157 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T08:25:42.166 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T08:26:12.295 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T08:26:12.306 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T08:26:42.431 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T08:26:42.439 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T08:27:12.570 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T08:27:12.578 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T08:27:42.695 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T08:27:42.704 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T08:28:12.849 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T08:28:12.858 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T08:28:42.985 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T08:28:42.994 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T08:29:13.119 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T08:29:13.127 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T08:29:43.249 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T08:29:43.257 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T08:30:13.377 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T08:30:13.387 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T08:30:43.530 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T08:30:43.538 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T08:31:13.676 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T08:31:13.684 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T08:31:43.849 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T08:31:43.859 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T08:32:13.991 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T08:32:13.999 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T08:32:44.128 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T08:32:44.138 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T08:33:14.276 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T08:33:14.283 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T08:33:44.401 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T08:33:44.413 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T08:34:14.567 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T08:34:14.576 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T08:34:44.700 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T08:34:44.709 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T08:35:14.837 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T08:35:14.846 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T08:35:44.966 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T08:35:44.975 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T08:36:16.778 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T08:36:16.787 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T08:36:47.218 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T08:36:47.226 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T08:37:17.368 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T08:37:17.377 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T08:37:47.547 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T08:37:47.555 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T08:38:17.684 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T08:38:17.693 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T08:38:47.837 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T08:38:47.847 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T08:39:17.974 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T08:39:17.983 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T08:39:48.142 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T08:39:48.150 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T08:40:18.303 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T08:40:18.309 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T08:40:48.500 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T08:40:48.508 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T08:41:18.654 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T08:41:18.661 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T08:41:48.832 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T08:41:48.839 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T08:42:19.034 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T08:42:19.045 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T08:42:49.246 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T08:42:49.256 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T08:43:19.467 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T08:43:19.476 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T08:43:50.266 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T08:43:50.273 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T08:44:20.440 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T08:44:20.449 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T08:44:50.576 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T08:44:50.585 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T08:45:20.738 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T08:45:20.747 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T08:45:50.874 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T08:45:50.884 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T08:46:21.177 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T08:46:21.187 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T08:46:51.331 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T08:46:51.340 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T08:46:51.441 INFO:tasks.ceph.osd.1.smithi072.stderr:2024-04-04T08:46:51.442+0000 7fa436800640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 193191) UID: 0 2024-04-04T08:46:51.442 INFO:tasks.ceph.osd.2.smithi072.stderr:2024-04-04T08:46:51.442+0000 7f7521000640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 193191) UID: 0 2024-04-04T08:46:51.442 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-04T08:46:51.442+0000 7f4e66800640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 193191) UID: 0 2024-04-04T08:46:51.443 INFO:tasks.ceph.osd.3.smithi072.stderr:2024-04-04T08:46:51.442+0000 7f0d67400640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 193191) UID: 0 2024-04-04T08:50:04.481 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T08:50:04.492 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T08:50:35.119 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T08:50:35.128 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T08:51:05.500 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T08:51:05.543 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T08:51:35.672 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T08:51:35.682 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T08:52:05.903 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T08:52:05.911 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T08:52:36.046 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T08:52:36.055 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T08:53:06.189 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T08:53:06.201 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T08:53:36.402 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T08:53:36.409 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T08:54:06.539 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T08:54:06.546 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T08:54:36.768 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T08:54:36.792 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T08:55:06.987 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T08:55:06.994 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T08:55:37.224 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T08:55:37.233 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T08:56:07.815 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T08:56:07.822 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T08:56:37.948 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T08:56:37.953 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T08:57:08.160 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T08:57:08.166 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T08:57:38.370 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T08:57:38.381 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T08:57:39.572 INFO:teuthology.orchestra.run.smithi072.stdout:generic/127 2084s 2024-04-04T08:57:39.589 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/127 2024-04-04T08:57:39.589 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T08:57:39.597 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T08:57:39.625 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T08:57:39.626 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/128) 2024-04-04T08:57:40.434 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T08:57:40.444 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T08:57:40.444 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T08:57:40.828 INFO:teuthology.orchestra.run.smithi072.stdout:generic/128 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T08:57:40.842 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/128 2024-04-04T08:57:40.842 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/128 2024-04-04T08:57:40.842 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T08:57:40.853 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T08:57:40.880 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T08:57:40.881 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/129) 2024-04-04T08:57:41.384 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T08:57:41.395 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T08:57:41.395 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T08:57:41.794 INFO:teuthology.orchestra.run.smithi072.stdout:generic/129 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T08:57:41.806 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/129 2024-04-04T08:57:41.806 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/129 2024-04-04T08:57:41.806 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T08:57:41.814 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T08:57:41.847 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T08:57:41.847 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/130) 2024-04-04T08:57:42.369 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T08:57:42.382 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T08:57:42.382 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T08:57:42.745 INFO:teuthology.orchestra.run.smithi072.stdout:generic/130 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T08:57:42.757 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/130 2024-04-04T08:57:42.758 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/130 2024-04-04T08:57:42.758 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T08:57:42.768 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T08:57:42.799 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T08:57:42.799 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/131) 2024-04-04T08:57:43.324 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T08:57:43.335 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T08:57:43.335 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T08:57:45.239 INFO:teuthology.orchestra.run.smithi072.stdout:generic/131 2s 2024-04-04T08:57:45.253 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/131 2024-04-04T08:57:45.253 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T08:57:45.260 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T08:57:45.283 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T08:57:45.283 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/132) 2024-04-04T08:57:46.064 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T08:57:46.075 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T08:57:46.075 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T08:57:46.443 INFO:teuthology.orchestra.run.smithi072.stdout:generic/132 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T08:57:46.454 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/132 2024-04-04T08:57:46.454 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/132 2024-04-04T08:57:46.454 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T08:57:46.463 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T08:57:46.494 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T08:57:46.494 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/133) 2024-04-04T08:57:47.040 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T08:57:47.052 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T08:57:47.052 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T08:58:09.528 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T08:58:09.538 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T08:58:39.678 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T08:58:39.687 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T08:59:09.814 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T08:59:09.822 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T08:59:39.967 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T08:59:39.976 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T09:00:10.130 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T09:00:10.140 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T09:00:40.267 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T09:00:40.275 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T09:01:10.431 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T09:01:10.439 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T09:01:40.644 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T09:01:40.657 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T09:02:10.785 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T09:02:10.795 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T09:02:40.949 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T09:02:40.958 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T09:03:11.438 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T09:03:11.451 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T09:03:41.612 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T09:03:41.622 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T09:04:11.740 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T09:04:11.746 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T09:04:41.936 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T09:04:41.945 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T09:05:12.097 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T09:05:12.106 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T09:05:42.300 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T09:05:42.308 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T09:06:12.447 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T09:06:12.456 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T09:06:42.589 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T09:06:42.597 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T09:07:12.726 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T09:07:12.735 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T09:07:33.050 INFO:teuthology.orchestra.run.smithi072.stdout:generic/133 586s 2024-04-04T09:07:33.066 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/133 2024-04-04T09:07:33.066 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:07:33.076 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:07:33.103 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:07:33.103 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/134) 2024-04-04T09:07:33.962 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:07:33.973 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:07:33.973 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:07:34.438 INFO:teuthology.orchestra.run.smithi072.stdout:generic/134 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-04-04T09:07:34.449 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/134 2024-04-04T09:07:34.449 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/134 2024-04-04T09:07:34.450 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:07:34.459 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:07:34.488 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:07:34.488 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/135) 2024-04-04T09:07:35.203 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:07:35.215 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:07:35.215 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:07:35.653 INFO:teuthology.orchestra.run.smithi072.stdout:generic/135 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:07:35.664 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/135 2024-04-04T09:07:35.664 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/135 2024-04-04T09:07:35.664 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:07:35.674 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:07:35.702 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:07:35.702 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/136) 2024-04-04T09:07:36.192 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:07:36.203 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:07:36.203 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:07:36.727 INFO:teuthology.orchestra.run.smithi072.stdout:generic/136 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2024-04-04T09:07:36.739 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/136 2024-04-04T09:07:36.739 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/136 2024-04-04T09:07:36.739 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:07:36.748 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:07:36.778 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:07:36.778 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/137) 2024-04-04T09:07:37.523 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:07:37.534 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:07:37.534 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:07:38.034 INFO:teuthology.orchestra.run.smithi072.stdout:generic/137 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-04-04T09:07:38.046 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/137 2024-04-04T09:07:38.046 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/137 2024-04-04T09:07:38.047 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:07:38.057 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:07:38.098 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:07:38.099 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/138) 2024-04-04T09:07:38.816 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:07:38.829 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:07:38.829 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:07:39.311 INFO:teuthology.orchestra.run.smithi072.stdout:generic/138 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-04-04T09:07:39.321 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/138 2024-04-04T09:07:39.321 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/138 2024-04-04T09:07:39.321 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:07:39.328 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:07:39.351 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:07:39.351 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/139) 2024-04-04T09:07:40.063 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:07:40.075 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:07:40.076 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:07:40.566 INFO:teuthology.orchestra.run.smithi072.stdout:generic/139 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-04-04T09:07:40.577 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/139 2024-04-04T09:07:40.577 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/139 2024-04-04T09:07:40.577 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:07:40.585 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:07:40.610 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:07:40.610 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/140) 2024-04-04T09:07:41.330 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:07:41.341 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:07:41.341 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:07:41.796 INFO:teuthology.orchestra.run.smithi072.stdout:generic/140 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-04-04T09:07:41.806 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/140 2024-04-04T09:07:41.806 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/140 2024-04-04T09:07:41.806 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:07:41.813 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:07:41.837 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:07:41.837 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/141) 2024-04-04T09:07:42.565 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:07:42.575 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:07:42.575 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:07:42.854 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T09:07:42.871 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T09:07:42.935 INFO:teuthology.orchestra.run.smithi072.stdout:generic/141 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:07:42.944 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/141 2024-04-04T09:07:42.944 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/141 2024-04-04T09:07:42.944 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:07:42.951 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:07:42.974 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:07:42.974 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/142) 2024-04-04T09:07:43.541 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:07:43.553 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:07:43.553 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:07:44.002 INFO:teuthology.orchestra.run.smithi072.stdout:generic/142 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-04-04T09:07:44.011 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/142 2024-04-04T09:07:44.011 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/142 2024-04-04T09:07:44.012 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:07:44.019 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:07:44.043 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:07:44.043 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/143) 2024-04-04T09:07:44.867 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:07:44.879 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:07:44.879 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:07:45.334 INFO:teuthology.orchestra.run.smithi072.stdout:generic/143 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-04-04T09:07:45.345 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/143 2024-04-04T09:07:45.345 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/143 2024-04-04T09:07:45.345 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:07:45.355 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:07:45.383 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:07:45.383 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/144) 2024-04-04T09:07:46.125 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:07:46.137 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:07:46.137 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:07:46.626 INFO:teuthology.orchestra.run.smithi072.stdout:generic/144 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-04-04T09:07:46.637 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/144 2024-04-04T09:07:46.637 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/144 2024-04-04T09:07:46.637 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:07:46.645 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:07:46.672 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:07:46.673 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/145) 2024-04-04T09:07:47.386 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:07:47.396 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:07:47.397 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:07:47.904 INFO:teuthology.orchestra.run.smithi072.stdout:generic/145 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-04-04T09:07:47.914 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/145 2024-04-04T09:07:47.915 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/145 2024-04-04T09:07:47.915 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:07:47.922 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:07:47.947 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:07:47.947 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/146) 2024-04-04T09:07:48.683 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:07:48.694 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:07:48.694 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:07:49.982 INFO:teuthology.orchestra.run.smithi072.stdout:generic/146 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-04-04T09:07:49.993 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/146 2024-04-04T09:07:49.993 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/146 2024-04-04T09:07:49.993 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:07:50.001 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:07:50.032 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:07:50.032 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/147) 2024-04-04T09:07:50.787 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:07:50.799 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:07:50.799 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:07:51.260 INFO:teuthology.orchestra.run.smithi072.stdout:generic/147 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-04-04T09:07:51.273 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/147 2024-04-04T09:07:51.273 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/147 2024-04-04T09:07:51.273 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:07:51.282 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:07:51.310 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:07:51.310 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/148) 2024-04-04T09:07:52.011 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:07:52.022 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:07:52.022 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:07:52.499 INFO:teuthology.orchestra.run.smithi072.stdout:generic/148 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-04-04T09:07:52.508 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/148 2024-04-04T09:07:52.508 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/148 2024-04-04T09:07:52.508 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:07:52.515 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:07:52.542 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:07:52.543 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/149) 2024-04-04T09:07:53.259 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:07:53.271 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:07:53.271 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:07:53.759 INFO:teuthology.orchestra.run.smithi072.stdout:generic/149 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-04-04T09:07:53.771 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/149 2024-04-04T09:07:53.771 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/149 2024-04-04T09:07:53.771 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:07:53.781 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:07:53.808 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:07:53.808 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/150) 2024-04-04T09:07:54.578 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:07:54.589 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:07:54.589 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:07:55.076 INFO:teuthology.orchestra.run.smithi072.stdout:generic/150 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-04-04T09:07:55.086 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/150 2024-04-04T09:07:55.086 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/150 2024-04-04T09:07:55.087 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:07:55.096 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:07:55.121 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:07:55.121 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/151) 2024-04-04T09:07:55.860 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:07:55.870 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:07:55.870 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:07:56.329 INFO:teuthology.orchestra.run.smithi072.stdout:generic/151 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-04-04T09:07:56.341 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/151 2024-04-04T09:07:56.341 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/151 2024-04-04T09:07:56.341 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:07:56.350 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:07:56.377 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:07:56.377 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/152) 2024-04-04T09:07:57.101 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:07:57.112 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:07:57.113 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:07:57.624 INFO:teuthology.orchestra.run.smithi072.stdout:generic/152 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-04-04T09:07:57.635 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/152 2024-04-04T09:07:57.636 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/152 2024-04-04T09:07:57.636 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:07:57.643 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:07:57.673 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:07:57.673 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/153) 2024-04-04T09:07:58.410 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:07:58.421 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:07:58.421 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:07:58.905 INFO:teuthology.orchestra.run.smithi072.stdout:generic/153 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-04-04T09:07:58.916 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/153 2024-04-04T09:07:58.916 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/153 2024-04-04T09:07:58.916 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:07:58.925 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:07:58.952 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:07:58.953 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/154) 2024-04-04T09:07:59.683 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:07:59.694 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:07:59.694 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:08:00.176 INFO:teuthology.orchestra.run.smithi072.stdout:generic/154 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-04-04T09:08:00.186 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/154 2024-04-04T09:08:00.187 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/154 2024-04-04T09:08:00.187 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:08:00.194 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:08:00.224 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:08:00.224 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/155) 2024-04-04T09:08:00.942 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:08:00.952 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:08:00.952 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:08:01.444 INFO:teuthology.orchestra.run.smithi072.stdout:generic/155 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-04-04T09:08:01.454 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/155 2024-04-04T09:08:01.454 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/155 2024-04-04T09:08:01.454 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:08:01.461 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:08:01.497 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:08:01.497 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/156) 2024-04-04T09:08:02.181 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:08:02.192 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:08:02.192 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:08:02.651 INFO:teuthology.orchestra.run.smithi072.stdout:generic/156 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-04-04T09:08:02.662 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/156 2024-04-04T09:08:02.662 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/156 2024-04-04T09:08:02.662 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:08:02.670 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:08:02.695 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:08:02.695 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/157) 2024-04-04T09:08:03.398 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:08:03.409 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:08:03.409 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:08:03.931 INFO:teuthology.orchestra.run.smithi072.stdout:generic/157 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-04-04T09:08:03.943 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/157 2024-04-04T09:08:03.943 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/157 2024-04-04T09:08:03.944 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:08:03.955 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:08:03.985 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:08:03.985 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/158) 2024-04-04T09:08:04.731 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:08:04.742 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:08:04.742 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:08:05.202 INFO:teuthology.orchestra.run.smithi072.stdout:generic/158 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2024-04-04T09:08:05.214 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/158 2024-04-04T09:08:05.214 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/158 2024-04-04T09:08:05.214 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:08:05.224 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:08:05.262 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:08:05.262 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/159) 2024-04-04T09:08:06.000 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:08:06.011 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:08:06.014 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:08:06.478 INFO:teuthology.orchestra.run.smithi072.stdout:generic/159 [not run] file system doesn't support chattr +i 2024-04-04T09:08:06.489 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/159 2024-04-04T09:08:06.489 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/159 2024-04-04T09:08:06.489 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:08:06.500 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:08:06.529 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:08:06.530 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/160) 2024-04-04T09:08:07.055 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:08:07.065 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:08:07.065 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:08:07.536 INFO:teuthology.orchestra.run.smithi072.stdout:generic/160 [not run] file system doesn't support chattr +i 2024-04-04T09:08:07.547 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/160 2024-04-04T09:08:07.547 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/160 2024-04-04T09:08:07.547 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:08:07.555 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:08:07.580 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:08:07.581 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/161) 2024-04-04T09:08:08.107 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:08:08.117 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:08:08.117 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:08:08.491 INFO:teuthology.orchestra.run.smithi072.stdout:generic/161 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:08:08.500 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/161 2024-04-04T09:08:08.500 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/161 2024-04-04T09:08:08.501 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:08:08.512 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:08:08.537 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:08:08.538 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/162) 2024-04-04T09:08:09.028 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:08:09.040 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:08:09.040 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:08:09.378 INFO:teuthology.orchestra.run.smithi072.stdout:generic/162 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:08:09.388 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/162 2024-04-04T09:08:09.388 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/162 2024-04-04T09:08:09.388 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:08:09.396 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:08:09.429 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:08:09.430 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/163) 2024-04-04T09:08:09.966 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:08:09.978 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:08:09.978 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:08:10.428 INFO:teuthology.orchestra.run.smithi072.stdout:generic/163 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:08:10.440 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/163 2024-04-04T09:08:10.440 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/163 2024-04-04T09:08:10.441 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:08:10.451 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:08:10.477 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:08:10.478 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/164) 2024-04-04T09:08:10.982 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:08:10.994 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:08:10.995 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:08:11.376 INFO:teuthology.orchestra.run.smithi072.stdout:generic/164 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:08:11.385 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/164 2024-04-04T09:08:11.385 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/164 2024-04-04T09:08:11.386 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:08:11.394 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:08:11.423 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:08:11.424 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/165) 2024-04-04T09:08:11.942 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:08:11.953 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:08:11.954 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:08:12.309 INFO:teuthology.orchestra.run.smithi072.stdout:generic/165 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:08:12.321 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/165 2024-04-04T09:08:12.321 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/165 2024-04-04T09:08:12.321 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:08:12.331 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:08:12.358 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:08:12.359 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/166) 2024-04-04T09:08:12.899 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:08:12.913 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:08:12.913 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:08:13.050 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T09:08:13.055 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T09:08:13.240 INFO:teuthology.orchestra.run.smithi072.stdout:generic/166 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:08:13.250 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/166 2024-04-04T09:08:13.250 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/166 2024-04-04T09:08:13.250 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:08:13.257 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:08:13.286 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:08:13.286 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/167) 2024-04-04T09:08:13.783 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:08:13.794 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:08:13.794 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:08:14.166 INFO:teuthology.orchestra.run.smithi072.stdout:generic/167 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:08:14.179 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/167 2024-04-04T09:08:14.179 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/167 2024-04-04T09:08:14.179 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:08:14.191 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:08:14.218 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:08:14.218 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/168) 2024-04-04T09:08:14.754 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:08:14.766 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:08:14.766 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:08:15.134 INFO:teuthology.orchestra.run.smithi072.stdout:generic/168 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:08:15.144 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/168 2024-04-04T09:08:15.145 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/168 2024-04-04T09:08:15.145 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:08:15.154 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:08:15.177 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:08:15.178 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/169) 2024-04-04T09:08:15.691 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:08:15.703 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:08:15.703 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:08:16.055 INFO:teuthology.orchestra.run.smithi072.stdout:generic/169 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:08:16.064 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/169 2024-04-04T09:08:16.065 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/169 2024-04-04T09:08:16.065 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:08:16.071 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:08:16.095 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:08:16.095 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/170) 2024-04-04T09:08:16.616 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:08:16.629 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:08:16.629 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:08:17.013 INFO:teuthology.orchestra.run.smithi072.stdout:generic/170 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:08:17.024 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/170 2024-04-04T09:08:17.024 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/170 2024-04-04T09:08:17.024 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:08:17.033 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:08:17.061 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:08:17.061 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/171) 2024-04-04T09:08:17.592 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:08:17.603 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:08:17.603 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:08:18.054 INFO:teuthology.orchestra.run.smithi072.stdout:generic/171 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:08:18.067 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/171 2024-04-04T09:08:18.067 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/171 2024-04-04T09:08:18.067 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:08:18.078 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:08:18.110 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:08:18.111 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/172) 2024-04-04T09:08:18.697 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:08:18.708 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:08:18.708 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:08:19.164 INFO:teuthology.orchestra.run.smithi072.stdout:generic/172 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:08:19.176 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/172 2024-04-04T09:08:19.176 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/172 2024-04-04T09:08:19.176 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:08:19.185 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:08:19.212 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:08:19.213 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/173) 2024-04-04T09:08:19.708 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:08:19.720 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:08:19.720 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:08:20.115 INFO:teuthology.orchestra.run.smithi072.stdout:generic/173 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:08:20.128 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/173 2024-04-04T09:08:20.128 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/173 2024-04-04T09:08:20.128 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:08:20.140 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:08:20.168 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:08:20.168 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/174) 2024-04-04T09:08:20.668 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:08:20.682 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:08:20.682 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:08:21.063 INFO:teuthology.orchestra.run.smithi072.stdout:generic/174 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:08:21.075 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/174 2024-04-04T09:08:21.075 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/174 2024-04-04T09:08:21.075 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:08:21.085 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:08:21.115 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:08:21.116 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/175) 2024-04-04T09:08:21.680 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:08:21.691 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:08:21.691 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:08:22.387 INFO:teuthology.orchestra.run.smithi072.stdout:generic/175 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:08:22.398 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/175 2024-04-04T09:08:22.398 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/175 2024-04-04T09:08:22.398 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:08:22.407 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:08:22.433 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:08:22.434 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/176) 2024-04-04T09:08:22.964 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:08:22.975 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:08:22.975 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:08:23.375 INFO:teuthology.orchestra.run.smithi072.stdout:generic/176 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:08:23.386 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/176 2024-04-04T09:08:23.386 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/176 2024-04-04T09:08:23.386 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:08:23.395 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:08:23.419 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:08:23.420 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/177) 2024-04-04T09:08:23.989 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:08:24.003 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:08:24.003 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:08:24.471 INFO:teuthology.orchestra.run.smithi072.stdout:generic/177 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:08:24.484 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/177 2024-04-04T09:08:24.484 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/177 2024-04-04T09:08:24.484 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:08:24.495 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:08:24.521 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:08:24.521 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/178) 2024-04-04T09:08:25.066 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:08:25.077 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:08:25.077 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:08:25.567 INFO:teuthology.orchestra.run.smithi072.stdout:generic/178 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-04-04T09:08:25.579 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/178 2024-04-04T09:08:25.579 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/178 2024-04-04T09:08:25.580 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:08:25.590 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:08:25.623 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:08:25.623 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/179) 2024-04-04T09:08:26.376 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:08:26.387 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:08:26.387 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:08:26.812 INFO:teuthology.orchestra.run.smithi072.stdout:generic/179 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-04-04T09:08:26.822 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/179 2024-04-04T09:08:26.822 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/179 2024-04-04T09:08:26.822 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:08:26.829 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:08:26.853 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:08:26.853 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/180) 2024-04-04T09:08:27.574 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:08:27.585 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:08:27.585 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:08:28.037 INFO:teuthology.orchestra.run.smithi072.stdout:generic/180 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-04-04T09:08:28.046 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/180 2024-04-04T09:08:28.046 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/180 2024-04-04T09:08:28.047 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:08:28.054 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:08:28.079 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:08:28.080 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/181) 2024-04-04T09:08:28.784 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:08:28.794 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:08:28.795 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:08:29.293 INFO:teuthology.orchestra.run.smithi072.stdout:generic/181 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-04-04T09:08:29.307 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/181 2024-04-04T09:08:29.307 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/181 2024-04-04T09:08:29.307 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:08:29.317 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:08:29.343 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:08:29.344 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/182) 2024-04-04T09:08:30.047 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:08:30.058 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:08:30.058 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:08:30.512 INFO:teuthology.orchestra.run.smithi072.stdout:generic/182 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2024-04-04T09:08:30.521 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/182 2024-04-04T09:08:30.521 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/182 2024-04-04T09:08:30.521 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:08:30.528 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:08:30.551 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:08:30.552 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/183) 2024-04-04T09:08:31.279 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:08:31.289 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:08:31.290 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:08:31.626 INFO:teuthology.orchestra.run.smithi072.stdout:generic/183 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:08:31.636 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/183 2024-04-04T09:08:31.636 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/183 2024-04-04T09:08:31.637 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:08:31.647 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:08:31.672 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:08:31.672 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/184) 2024-04-04T09:08:32.157 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:08:32.173 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:08:32.174 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:08:32.712 INFO:teuthology.orchestra.run.smithi072.stdout:generic/184 [failed, exit status 1]- output mismatch (see /tmp/tmp.tiFz9P8iUAxfstests-dev/results//generic/184.out.bad) 2024-04-04T09:08:32.722 INFO:teuthology.orchestra.run.smithi072.stdout: --- tests/generic/184.out 2024-04-04 06:58:02.191454002 +0000 2024-04-04T09:08:32.722 INFO:teuthology.orchestra.run.smithi072.stdout: +++ /tmp/tmp.tiFz9P8iUAxfstests-dev/results//generic/184.out.bad 2024-04-04 09:08:32.710832007 +0000 2024-04-04T09:08:32.722 INFO:teuthology.orchestra.run.smithi072.stdout: @@ -1 +1,2 @@ 2024-04-04T09:08:32.722 INFO:teuthology.orchestra.run.smithi072.stdout: QA output created by 184 2024-04-04T09:08:32.723 INFO:teuthology.orchestra.run.smithi072.stdout: +/tmp/tmp.tiFz9P8iUAxfstests-dev/tests/generic/184: line 23: /tmp/tmp.LqGJQhujaOtest/null: Permission denied 2024-04-04T09:08:32.729 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/184 2024-04-04T09:08:32.729 INFO:teuthology.orchestra.run.smithi072.stdout:Failures: generic/184 2024-04-04T09:08:32.729 INFO:teuthology.orchestra.run.smithi072.stdout:Failed 1 of 1 tests 2024-04-04T09:08:32.736 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:08:32.762 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-04T09:08:32.762 INFO:tasks.cephfs.xfstests_dev:Command failed 2024-04-04T09:08:32.762 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2024-04-04T09:08:32.763 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/185) 2024-04-04T09:08:33.267 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:08:33.279 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:08:33.279 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:08:33.677 INFO:teuthology.orchestra.run.smithi072.stdout:generic/185 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:08:33.687 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/185 2024-04-04T09:08:33.687 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/185 2024-04-04T09:08:33.687 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:08:33.696 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:08:33.726 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:08:33.726 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/186) 2024-04-04T09:08:34.262 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:08:34.273 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:08:34.273 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:08:34.645 INFO:teuthology.orchestra.run.smithi072.stdout:generic/186 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:08:34.654 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/186 2024-04-04T09:08:34.655 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/186 2024-04-04T09:08:34.655 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:08:34.662 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:08:34.687 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:08:34.687 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/187) 2024-04-04T09:08:35.178 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:08:35.191 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:08:35.191 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:08:35.585 INFO:teuthology.orchestra.run.smithi072.stdout:generic/187 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:08:35.597 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/187 2024-04-04T09:08:35.597 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/187 2024-04-04T09:08:35.597 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:08:35.607 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:08:35.635 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:08:35.635 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/188) 2024-04-04T09:08:36.175 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:08:36.187 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:08:36.187 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:08:36.573 INFO:teuthology.orchestra.run.smithi072.stdout:generic/188 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:08:36.586 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/188 2024-04-04T09:08:36.586 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/188 2024-04-04T09:08:36.587 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:08:36.597 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:08:36.624 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:08:36.625 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/189) 2024-04-04T09:08:37.148 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:08:37.160 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:08:37.160 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:08:37.568 INFO:teuthology.orchestra.run.smithi072.stdout:generic/189 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:08:37.580 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/189 2024-04-04T09:08:37.580 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/189 2024-04-04T09:08:37.580 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:08:37.588 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:08:37.613 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:08:37.614 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/190) 2024-04-04T09:08:38.163 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:08:38.179 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:08:38.179 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:08:38.580 INFO:teuthology.orchestra.run.smithi072.stdout:generic/190 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:08:38.592 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/190 2024-04-04T09:08:38.592 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/190 2024-04-04T09:08:38.592 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:08:38.600 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:08:38.626 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:08:38.626 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/191) 2024-04-04T09:08:39.120 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:08:39.132 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:08:39.133 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:08:39.488 INFO:teuthology.orchestra.run.smithi072.stdout:generic/191 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:08:39.502 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/191 2024-04-04T09:08:39.502 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/191 2024-04-04T09:08:39.502 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:08:39.512 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:08:39.543 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:08:39.544 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/192) 2024-04-04T09:08:40.056 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:08:40.071 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:08:40.071 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:08:40.472 INFO:teuthology.orchestra.run.smithi072.stdout:generic/192 [not run] atime not maintained by ceph-fuse 2024-04-04T09:08:40.484 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/192 2024-04-04T09:08:40.485 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/192 2024-04-04T09:08:40.485 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:08:40.494 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:08:40.519 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:08:40.520 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/193) 2024-04-04T09:08:41.031 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:08:41.042 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:08:41.042 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:08:43.252 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T09:08:43.258 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T09:08:43.391 INFO:teuthology.orchestra.run.smithi072.stdout:generic/193 - output mismatch (see /tmp/tmp.tiFz9P8iUAxfstests-dev/results//generic/193.out.bad) 2024-04-04T09:08:43.401 INFO:teuthology.orchestra.run.smithi072.stdout: --- tests/generic/193.out 2024-04-04 06:58:02.192453981 +0000 2024-04-04T09:08:43.401 INFO:teuthology.orchestra.run.smithi072.stdout: +++ /tmp/tmp.tiFz9P8iUAxfstests-dev/results//generic/193.out.bad 2024-04-04 09:08:43.361614579 +0000 2024-04-04T09:08:43.401 INFO:teuthology.orchestra.run.smithi072.stdout: @@ -24,7 +24,6 @@ 2024-04-04T09:08:43.401 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:08:43.401 INFO:teuthology.orchestra.run.smithi072.stdout: user: chmod a+r on qa_user owned file (should succeed) 2024-04-04T09:08:43.401 INFO:teuthology.orchestra.run.smithi072.stdout: user: chmod a+r on root owned file (should fail) 2024-04-04T09:08:43.401 INFO:teuthology.orchestra.run.smithi072.stdout: -chmod: changing permissions of 'test.root': Operation not permitted 2024-04-04T09:08:43.401 INFO:teuthology.orchestra.run.smithi072.stdout: check that the sgid bit is cleared 2024-04-04T09:08:43.401 INFO:teuthology.orchestra.run.smithi072.stdout: -rw-rw-rw- 2024-04-04T09:08:43.401 INFO:teuthology.orchestra.run.smithi072.stdout: check that suid bit is not cleared 2024-04-04T09:08:43.407 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/193 2024-04-04T09:08:43.407 INFO:teuthology.orchestra.run.smithi072.stdout:Failures: generic/193 2024-04-04T09:08:43.407 INFO:teuthology.orchestra.run.smithi072.stdout:Failed 1 of 1 tests 2024-04-04T09:08:43.414 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:08:43.444 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-04T09:08:43.445 INFO:tasks.cephfs.xfstests_dev:Command failed 2024-04-04T09:08:43.445 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2024-04-04T09:08:43.445 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/194) 2024-04-04T09:08:44.291 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:08:44.302 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:08:44.302 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:08:44.678 INFO:teuthology.orchestra.run.smithi072.stdout:generic/194 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:08:44.692 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/194 2024-04-04T09:08:44.692 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/194 2024-04-04T09:08:44.692 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:08:44.703 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:08:44.735 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:08:44.735 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/195) 2024-04-04T09:08:45.223 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:08:45.236 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:08:45.236 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:08:45.623 INFO:teuthology.orchestra.run.smithi072.stdout:generic/195 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:08:45.636 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/195 2024-04-04T09:08:45.636 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/195 2024-04-04T09:08:45.636 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:08:45.645 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:08:45.673 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:08:45.674 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/196) 2024-04-04T09:08:46.205 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:08:46.216 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:08:46.216 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:08:46.597 INFO:teuthology.orchestra.run.smithi072.stdout:generic/196 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:08:46.608 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/196 2024-04-04T09:08:46.608 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/196 2024-04-04T09:08:46.608 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:08:46.617 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:08:46.644 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:08:46.645 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/197) 2024-04-04T09:08:47.140 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:08:47.151 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:08:47.151 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:08:47.542 INFO:teuthology.orchestra.run.smithi072.stdout:generic/197 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:08:47.553 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/197 2024-04-04T09:08:47.554 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/197 2024-04-04T09:08:47.554 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:08:47.564 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:08:47.593 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:08:47.593 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/198) 2024-04-04T09:08:48.104 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:08:48.117 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:08:48.117 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:08:50.027 INFO:teuthology.orchestra.run.smithi072.stdout:generic/198 2s 2024-04-04T09:08:50.046 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/198 2024-04-04T09:08:50.046 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:08:50.055 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:08:50.082 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:08:50.082 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/199) 2024-04-04T09:08:50.879 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:08:50.891 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:08:50.891 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:08:51.260 INFO:teuthology.orchestra.run.smithi072.stdout:generic/199 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:08:51.271 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/199 2024-04-04T09:08:51.271 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/199 2024-04-04T09:08:51.271 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:08:51.279 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:08:51.307 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:08:51.308 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/200) 2024-04-04T09:08:51.784 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:08:51.795 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:08:51.795 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:08:52.194 INFO:teuthology.orchestra.run.smithi072.stdout:generic/200 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:08:52.208 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/200 2024-04-04T09:08:52.208 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/200 2024-04-04T09:08:52.208 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:08:52.220 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:08:52.249 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:08:52.249 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/201) 2024-04-04T09:08:52.758 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:08:52.768 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:08:52.768 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:08:53.139 INFO:teuthology.orchestra.run.smithi072.stdout:generic/201 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:08:53.152 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/201 2024-04-04T09:08:53.152 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/201 2024-04-04T09:08:53.152 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:08:53.163 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:08:53.190 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:08:53.190 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/202) 2024-04-04T09:08:53.675 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:08:53.687 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:08:53.687 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:08:54.069 INFO:teuthology.orchestra.run.smithi072.stdout:generic/202 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:08:54.079 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/202 2024-04-04T09:08:54.079 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/202 2024-04-04T09:08:54.080 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:08:54.087 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:08:54.115 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:08:54.115 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/203) 2024-04-04T09:08:54.634 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:08:54.646 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:08:54.646 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:08:55.018 INFO:teuthology.orchestra.run.smithi072.stdout:generic/203 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:08:55.028 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/203 2024-04-04T09:08:55.028 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/203 2024-04-04T09:08:55.028 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:08:55.036 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:08:55.061 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:08:55.061 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/204) 2024-04-04T09:08:55.605 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:08:55.615 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:08:55.615 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:08:56.561 INFO:teuthology.orchestra.run.smithi072.stdout:generic/204 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:08:56.574 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/204 2024-04-04T09:08:56.575 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/204 2024-04-04T09:08:56.575 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:08:56.586 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:08:56.614 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:08:56.614 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/205) 2024-04-04T09:08:57.136 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:08:57.148 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:08:57.148 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:08:57.514 INFO:teuthology.orchestra.run.smithi072.stdout:generic/205 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:08:57.525 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/205 2024-04-04T09:08:57.525 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/205 2024-04-04T09:08:57.525 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:08:57.533 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:08:57.562 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:08:57.562 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/206) 2024-04-04T09:08:58.090 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:08:58.106 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:08:58.106 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:08:58.481 INFO:teuthology.orchestra.run.smithi072.stdout:generic/206 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:08:58.495 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/206 2024-04-04T09:08:58.496 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/206 2024-04-04T09:08:58.496 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:08:58.505 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:08:58.533 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:08:58.533 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/207) 2024-04-04T09:08:59.056 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:08:59.068 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:08:59.068 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:09:13.465 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T09:09:13.476 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T09:09:41.901 INFO:teuthology.orchestra.run.smithi072.stdout:generic/207 42s 2024-04-04T09:09:41.918 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/207 2024-04-04T09:09:41.918 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:09:41.927 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:09:41.952 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:09:41.953 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/208) 2024-04-04T09:09:42.726 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:09:42.737 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:09:42.737 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:09:43.726 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T09:09:43.733 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T09:10:13.862 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T09:10:13.872 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T09:10:44.083 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T09:10:44.091 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T09:11:14.365 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T09:11:14.392 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T09:11:44.523 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T09:11:44.531 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T09:12:14.658 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T09:12:14.666 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T09:12:44.832 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T09:12:44.840 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T09:13:03.359 INFO:teuthology.orchestra.run.smithi072.stdout:generic/208 201s 2024-04-04T09:13:03.377 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/208 2024-04-04T09:13:03.377 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:13:03.386 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:13:03.415 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:13:03.415 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/209) 2024-04-04T09:13:04.173 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:13:04.184 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:13:04.184 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:13:14.982 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T09:13:14.991 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T09:13:27.172 INFO:teuthology.orchestra.run.smithi072.stdout:generic/209 [failed, exit status 1]- output mismatch (see /tmp/tmp.tiFz9P8iUAxfstests-dev/results//generic/209.out.bad) 2024-04-04T09:13:27.189 INFO:teuthology.orchestra.run.smithi072.stdout: --- tests/generic/209.out 2024-04-04 06:58:02.194453939 +0000 2024-04-04T09:13:27.189 INFO:teuthology.orchestra.run.smithi072.stdout: +++ /tmp/tmp.tiFz9P8iUAxfstests-dev/results//generic/209.out.bad 2024-04-04 09:13:27.167817026 +0000 2024-04-04T09:13:27.189 INFO:teuthology.orchestra.run.smithi072.stdout: @@ -1,2 +1,2 @@ 2024-04-04T09:13:27.189 INFO:teuthology.orchestra.run.smithi072.stdout: QA output created by 209 2024-04-04T09:13:27.189 INFO:teuthology.orchestra.run.smithi072.stdout: -test ran for 30 seconds without error 2024-04-04T09:13:27.189 INFO:teuthology.orchestra.run.smithi072.stdout: +reader found old byte at pos 4096 2024-04-04T09:13:27.190 INFO:teuthology.orchestra.run.smithi072.stdout: \ No newline at end of file 2024-04-04T09:13:27.200 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/209 2024-04-04T09:13:27.200 INFO:teuthology.orchestra.run.smithi072.stdout:Failures: generic/209 2024-04-04T09:13:27.200 INFO:teuthology.orchestra.run.smithi072.stdout:Failed 1 of 1 tests 2024-04-04T09:13:27.212 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:13:27.254 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-04T09:13:27.255 INFO:tasks.cephfs.xfstests_dev:Command failed 2024-04-04T09:13:27.255 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2024-04-04T09:13:27.255 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/210) 2024-04-04T09:13:27.935 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:13:27.947 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:13:27.947 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:13:28.801 INFO:teuthology.orchestra.run.smithi072.stdout:generic/210 1s 2024-04-04T09:13:28.818 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/210 2024-04-04T09:13:28.818 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:13:28.827 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:13:28.871 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:13:28.872 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/211) 2024-04-04T09:13:29.631 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:13:29.643 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:13:29.643 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:13:30.563 INFO:teuthology.orchestra.run.smithi072.stdout:generic/211 1s 2024-04-04T09:13:30.577 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/211 2024-04-04T09:13:30.577 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:13:30.584 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:13:30.611 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:13:30.611 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/212) 2024-04-04T09:13:31.139 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:13:31.152 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:13:31.152 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:13:31.711 INFO:teuthology.orchestra.run.smithi072.stdout:generic/212 0s 2024-04-04T09:13:31.730 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/212 2024-04-04T09:13:31.730 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:13:31.740 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:13:31.768 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:13:31.768 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/213) 2024-04-04T09:13:32.261 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:13:32.272 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:13:32.272 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:13:33.081 INFO:teuthology.orchestra.run.smithi072.stdout:generic/213 - output mismatch (see /tmp/tmp.tiFz9P8iUAxfstests-dev/results//generic/213.out.bad) 2024-04-04T09:13:33.086 INFO:teuthology.orchestra.run.smithi072.stdout: --- tests/generic/213.out 2024-04-04 06:58:02.195453918 +0000 2024-04-04T09:13:33.086 INFO:teuthology.orchestra.run.smithi072.stdout: +++ /tmp/tmp.tiFz9P8iUAxfstests-dev/results//generic/213.out.bad 2024-04-04 09:13:33.079695847 +0000 2024-04-04T09:13:33.086 INFO:teuthology.orchestra.run.smithi072.stdout: @@ -1,4 +1,3 @@ 2024-04-04T09:13:33.087 INFO:teuthology.orchestra.run.smithi072.stdout: QA output created by 213 2024-04-04T09:13:33.087 INFO:teuthology.orchestra.run.smithi072.stdout: We should get: fallocate: No space left on device 2024-04-04T09:13:33.087 INFO:teuthology.orchestra.run.smithi072.stdout: Strangely, xfs_io sometimes says "Success" when something went wrong, FYI 2024-04-04T09:13:33.087 INFO:teuthology.orchestra.run.smithi072.stdout: -fallocate: No space left on device 2024-04-04T09:13:33.093 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/213 2024-04-04T09:13:33.093 INFO:teuthology.orchestra.run.smithi072.stdout:Failures: generic/213 2024-04-04T09:13:33.093 INFO:teuthology.orchestra.run.smithi072.stdout:Failed 1 of 1 tests 2024-04-04T09:13:33.101 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:13:33.134 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-04T09:13:33.134 INFO:tasks.cephfs.xfstests_dev:Command failed 2024-04-04T09:13:33.134 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2024-04-04T09:13:33.134 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/214) 2024-04-04T09:13:33.886 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:13:33.897 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:13:33.897 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:13:35.004 INFO:teuthology.orchestra.run.smithi072.stdout:generic/214 1s 2024-04-04T09:13:35.027 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/214 2024-04-04T09:13:35.027 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:13:35.033 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:13:35.063 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:13:35.064 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/215) 2024-04-04T09:13:35.934 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:13:35.949 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:13:35.950 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:13:40.225 INFO:teuthology.orchestra.run.smithi072.stdout:generic/215 5s 2024-04-04T09:13:40.244 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/215 2024-04-04T09:13:40.244 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:13:40.255 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:13:40.287 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:13:40.288 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/216) 2024-04-04T09:13:40.899 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:13:41.013 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:13:41.013 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:13:41.329 INFO:teuthology.orchestra.run.smithi072.stdout:generic/216 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:13:41.341 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/216 2024-04-04T09:13:41.341 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/216 2024-04-04T09:13:41.341 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:13:41.352 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:13:41.387 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:13:41.387 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/217) 2024-04-04T09:13:42.038 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:13:42.053 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:13:42.053 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:13:42.474 INFO:teuthology.orchestra.run.smithi072.stdout:generic/217 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:13:42.487 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/217 2024-04-04T09:13:42.488 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/217 2024-04-04T09:13:42.488 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:13:42.497 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:13:42.528 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:13:42.529 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/218) 2024-04-04T09:13:43.162 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:13:43.180 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:13:43.180 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:13:43.564 INFO:teuthology.orchestra.run.smithi072.stdout:generic/218 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:13:43.577 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/218 2024-04-04T09:13:43.577 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/218 2024-04-04T09:13:43.577 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:13:43.586 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:13:43.616 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:13:43.617 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/219) 2024-04-04T09:13:44.238 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:13:44.256 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:13:44.256 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:13:44.669 INFO:teuthology.orchestra.run.smithi072.stdout:generic/219 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:13:44.679 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/219 2024-04-04T09:13:44.679 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/219 2024-04-04T09:13:44.679 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:13:44.686 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:13:44.713 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:13:44.713 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/220) 2024-04-04T09:13:45.202 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T09:13:45.209 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T09:13:45.347 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:13:45.365 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:13:45.365 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:13:45.802 INFO:teuthology.orchestra.run.smithi072.stdout:generic/220 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:13:45.814 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/220 2024-04-04T09:13:45.815 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/220 2024-04-04T09:13:45.815 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:13:45.826 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:13:45.857 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:13:45.858 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/221) 2024-04-04T09:13:46.527 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:13:46.544 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:13:46.545 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:13:48.049 INFO:teuthology.orchestra.run.smithi072.stdout:generic/221 2s 2024-04-04T09:13:48.069 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/221 2024-04-04T09:13:48.069 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:13:48.081 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:13:48.107 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:13:48.107 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/222) 2024-04-04T09:13:48.749 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:13:48.764 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:13:48.765 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:13:49.165 INFO:teuthology.orchestra.run.smithi072.stdout:generic/222 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:13:49.176 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/222 2024-04-04T09:13:49.176 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/222 2024-04-04T09:13:49.176 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:13:49.186 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:13:49.221 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:13:49.221 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/223) 2024-04-04T09:13:49.818 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:13:49.837 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:13:49.837 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:13:50.243 INFO:teuthology.orchestra.run.smithi072.stdout:generic/223 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:13:50.255 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/223 2024-04-04T09:13:50.255 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/223 2024-04-04T09:13:50.255 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:13:50.264 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:13:50.290 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:13:50.290 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/224) 2024-04-04T09:13:50.854 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:13:50.867 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:13:50.867 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:13:51.309 INFO:teuthology.orchestra.run.smithi072.stdout:generic/224 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:13:51.320 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/224 2024-04-04T09:13:51.320 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/224 2024-04-04T09:13:51.320 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:13:51.327 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:13:51.355 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:13:51.355 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/225) 2024-04-04T09:13:51.988 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:13:52.001 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:13:52.001 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:13:52.422 INFO:teuthology.orchestra.run.smithi072.stdout:generic/225 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:13:52.435 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/225 2024-04-04T09:13:52.435 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/225 2024-04-04T09:13:52.435 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:13:52.445 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:13:52.477 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:13:52.477 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/226) 2024-04-04T09:13:53.106 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:13:53.126 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:13:53.127 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:13:53.517 INFO:teuthology.orchestra.run.smithi072.stdout:generic/226 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:13:53.530 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/226 2024-04-04T09:13:53.530 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/226 2024-04-04T09:13:53.531 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:13:53.539 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:13:53.569 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:13:53.569 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/227) 2024-04-04T09:13:54.218 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:13:54.236 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:13:54.236 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:13:54.643 INFO:teuthology.orchestra.run.smithi072.stdout:generic/227 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:13:54.656 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/227 2024-04-04T09:13:54.656 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/227 2024-04-04T09:13:54.656 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:13:54.667 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:13:54.700 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:13:54.700 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/228) 2024-04-04T09:13:55.319 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:13:55.336 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:13:55.336 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:13:55.980 INFO:teuthology.orchestra.run.smithi072.stdout:generic/228 0s 2024-04-04T09:13:55.999 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/228 2024-04-04T09:13:55.999 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:13:56.008 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:13:56.057 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:13:56.057 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/229) 2024-04-04T09:13:56.907 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:13:56.926 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:13:56.926 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:13:57.353 INFO:teuthology.orchestra.run.smithi072.stdout:generic/229 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:13:57.365 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/229 2024-04-04T09:13:57.365 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/229 2024-04-04T09:13:57.365 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:13:57.374 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:13:57.403 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:13:57.404 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/230) 2024-04-04T09:13:58.044 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:13:58.059 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:13:58.060 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:13:58.490 INFO:teuthology.orchestra.run.smithi072.stdout:generic/230 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:13:58.503 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/230 2024-04-04T09:13:58.504 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/230 2024-04-04T09:13:58.504 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:13:58.514 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:13:58.546 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:13:58.546 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/231) 2024-04-04T09:13:59.160 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:13:59.174 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:13:59.174 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:13:59.583 INFO:teuthology.orchestra.run.smithi072.stdout:generic/231 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:13:59.594 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/231 2024-04-04T09:13:59.594 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/231 2024-04-04T09:13:59.594 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:13:59.601 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:13:59.630 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:13:59.630 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/232) 2024-04-04T09:14:00.273 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:14:00.289 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:14:00.290 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:14:00.978 INFO:teuthology.orchestra.run.smithi072.stdout:generic/232 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:14:00.990 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/232 2024-04-04T09:14:00.990 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/232 2024-04-04T09:14:00.991 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:14:01.001 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:14:01.036 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:14:01.037 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/233) 2024-04-04T09:14:02.058 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:14:02.075 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:14:02.075 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:14:03.363 INFO:teuthology.orchestra.run.smithi072.stdout:generic/233 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:14:03.375 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/233 2024-04-04T09:14:03.375 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/233 2024-04-04T09:14:03.375 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:14:03.385 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:14:03.422 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:14:03.422 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/234) 2024-04-04T09:14:04.063 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:14:04.081 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:14:04.082 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:14:05.295 INFO:teuthology.orchestra.run.smithi072.stdout:generic/234 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:14:05.308 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/234 2024-04-04T09:14:05.308 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/234 2024-04-04T09:14:05.308 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:14:05.318 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:14:05.352 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:14:05.353 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/235) 2024-04-04T09:14:05.989 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:14:06.004 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:14:06.004 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:14:06.412 INFO:teuthology.orchestra.run.smithi072.stdout:generic/235 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:14:06.427 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/235 2024-04-04T09:14:06.427 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/235 2024-04-04T09:14:06.427 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:14:06.437 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:14:06.466 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:14:06.466 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/236) 2024-04-04T09:14:07.090 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:14:07.105 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:14:07.105 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:14:08.787 INFO:teuthology.orchestra.run.smithi072.stdout:generic/236 1s 2024-04-04T09:14:08.809 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/236 2024-04-04T09:14:08.809 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:14:08.819 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:14:08.864 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:14:08.864 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/237) 2024-04-04T09:14:09.705 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:14:09.719 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:14:09.719 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:14:10.282 INFO:teuthology.orchestra.run.smithi072.stdout:generic/237 [not run] ACLs not supported by this filesystem type: ceph-fuse 2024-04-04T09:14:10.296 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/237 2024-04-04T09:14:10.296 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/237 2024-04-04T09:14:10.296 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:14:10.305 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:14:10.338 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:14:10.339 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/238) 2024-04-04T09:14:10.977 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:14:10.992 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:14:10.992 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:14:11.430 INFO:teuthology.orchestra.run.smithi072.stdout:generic/238 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:14:11.446 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/238 2024-04-04T09:14:11.446 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/238 2024-04-04T09:14:11.446 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:14:11.454 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:14:11.485 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:14:11.485 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/239) 2024-04-04T09:14:12.118 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:14:12.133 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:14:12.133 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:14:12.627 INFO:teuthology.orchestra.run.smithi072.stdout:generic/239 [not run] Sparse files are not supported or do not work as expected 2024-04-04T09:14:12.638 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/239 2024-04-04T09:14:12.639 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/239 2024-04-04T09:14:12.639 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:14:12.649 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:14:12.677 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:14:12.678 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/240) 2024-04-04T09:14:13.312 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:14:13.330 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:14:13.330 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:14:13.830 INFO:teuthology.orchestra.run.smithi072.stdout:generic/240 [not run] Sparse files are not supported or do not work as expected 2024-04-04T09:14:13.843 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/240 2024-04-04T09:14:13.843 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/240 2024-04-04T09:14:13.843 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:14:13.854 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:14:13.883 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:14:13.884 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/241) 2024-04-04T09:14:14.498 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:14:14.519 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:14:14.520 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:14:15.366 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T09:14:15.372 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T09:14:15.469 INFO:tasks.ceph.osd.5.smithi117.stderr:2024-04-04T09:14:15.470+0000 7f144e000640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48543) UID: 0 2024-04-04T09:14:15.470 INFO:tasks.ceph.osd.4.smithi117.stderr:2024-04-04T09:14:15.470+0000 7f248de00640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48543) UID: 0 2024-04-04T09:14:15.470 INFO:tasks.ceph.osd.6.smithi117.stderr:2024-04-04T09:14:15.470+0000 7fb935800640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48543) UID: 0 2024-04-04T09:14:15.473 INFO:tasks.ceph.osd.7.smithi117.stderr:2024-04-04T09:14:15.474+0000 7f3028600640 -1 Fail to open '/proc/48543/cmdline' error = (2) No such file or directory 2024-04-04T09:14:15.473 INFO:tasks.ceph.osd.7.smithi117.stderr:2024-04-04T09:14:15.474+0000 7f3028600640 -1 received signal: Hangup from (PID: 48543) UID: 0 2024-04-04T09:15:31.613 INFO:teuthology.orchestra.run.smithi072.stdout:generic/241 75s 2024-04-04T09:15:32.211 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/241 2024-04-04T09:15:32.212 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:15:32.220 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:15:32.259 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:15:32.260 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/242) 2024-04-04T09:15:34.239 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:15:34.254 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:15:34.254 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:15:34.926 INFO:teuthology.orchestra.run.smithi072.stdout:generic/242 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:15:34.938 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/242 2024-04-04T09:15:34.938 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/242 2024-04-04T09:15:34.938 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:15:34.949 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:15:34.980 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:15:34.980 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/243) 2024-04-04T09:15:35.631 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:15:35.650 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:15:35.650 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:15:37.919 INFO:teuthology.orchestra.run.smithi072.stdout:generic/243 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:15:37.933 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/243 2024-04-04T09:15:37.933 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/243 2024-04-04T09:15:37.933 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:15:37.947 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:15:37.979 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:15:37.979 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/244) 2024-04-04T09:15:38.634 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:15:38.651 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:15:38.651 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:15:41.924 INFO:teuthology.orchestra.run.smithi072.stdout:generic/244 [not run] disk quotas not supported by this filesystem type: ceph-fuse 2024-04-04T09:15:41.938 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/244 2024-04-04T09:15:41.938 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/244 2024-04-04T09:15:41.938 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:15:41.949 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:15:41.985 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:15:41.985 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/245) 2024-04-04T09:15:42.565 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:15:42.584 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:15:42.584 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:15:46.987 INFO:teuthology.orchestra.run.smithi072.stdout:generic/245 4s 2024-04-04T09:15:47.009 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/245 2024-04-04T09:15:47.009 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:15:47.016 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:15:47.042 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:15:47.043 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/246) 2024-04-04T09:15:48.282 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:15:48.298 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:15:48.298 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:15:48.911 INFO:teuthology.orchestra.run.smithi072.stdout:generic/246 0s 2024-04-04T09:15:48.933 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/246 2024-04-04T09:15:48.933 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:15:48.945 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:15:48.972 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:15:48.972 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/247) 2024-04-04T09:15:49.808 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:15:49.824 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:15:49.824 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:16:42.793 INFO:teuthology.orchestra.run.smithi072.stdout:generic/247 53s 2024-04-04T09:16:42.816 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/247 2024-04-04T09:16:42.816 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:16:42.826 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:16:42.854 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:16:42.855 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/248) 2024-04-04T09:16:43.511 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:16:43.529 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:16:43.529 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:16:44.100 INFO:teuthology.orchestra.run.smithi072.stdout:generic/248 1s 2024-04-04T09:16:44.120 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/248 2024-04-04T09:16:44.120 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:16:44.132 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:16:44.164 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:16:44.164 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/249) 2024-04-04T09:16:44.776 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:16:44.794 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:16:44.795 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:16:49.266 INFO:teuthology.orchestra.run.smithi072.stdout:generic/249 5s 2024-04-04T09:16:49.287 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/249 2024-04-04T09:16:49.288 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:16:49.298 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:16:49.336 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:16:49.336 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/250) 2024-04-04T09:16:50.216 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:16:50.229 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:16:50.230 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:16:51.439 INFO:teuthology.orchestra.run.smithi072.stdout:generic/250 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:16:51.449 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/250 2024-04-04T09:16:51.450 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/250 2024-04-04T09:16:51.450 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:16:51.461 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:16:51.492 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:16:51.493 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/251) 2024-04-04T09:16:52.142 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:16:52.157 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:16:52.157 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:16:52.580 INFO:teuthology.orchestra.run.smithi072.stdout:generic/251 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:16:52.594 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/251 2024-04-04T09:16:52.594 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/251 2024-04-04T09:16:52.594 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:16:52.602 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:16:52.636 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:16:52.636 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/252) 2024-04-04T09:16:53.264 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:16:53.279 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:16:53.279 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:16:53.721 INFO:teuthology.orchestra.run.smithi072.stdout:generic/252 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:16:53.739 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/252 2024-04-04T09:16:53.739 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/252 2024-04-04T09:16:53.739 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:16:53.749 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:16:53.778 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:16:53.779 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/253) 2024-04-04T09:16:54.389 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:16:54.402 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:16:54.402 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:16:54.804 INFO:teuthology.orchestra.run.smithi072.stdout:generic/253 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:16:54.817 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/253 2024-04-04T09:16:54.817 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/253 2024-04-04T09:16:54.817 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:16:54.828 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:16:54.861 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:16:54.862 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/254) 2024-04-04T09:16:55.508 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:16:55.526 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:16:55.526 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:16:55.954 INFO:teuthology.orchestra.run.smithi072.stdout:generic/254 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:16:55.965 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/254 2024-04-04T09:16:55.965 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/254 2024-04-04T09:16:55.965 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:16:55.977 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:16:56.116 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:16:56.116 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/255) 2024-04-04T09:16:56.767 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:16:56.784 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:16:56.784 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:17:00.394 INFO:teuthology.orchestra.run.smithi072.stdout:generic/255 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-04-04T09:17:00.410 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/255 2024-04-04T09:17:00.411 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/255 2024-04-04T09:17:00.411 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:17:00.418 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:17:00.457 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:17:00.457 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/256) 2024-04-04T09:17:01.291 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:17:01.310 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:17:01.310 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:17:05.357 INFO:teuthology.orchestra.run.smithi072.stdout:generic/256 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:17:05.371 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/256 2024-04-04T09:17:05.371 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/256 2024-04-04T09:17:05.371 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:17:05.381 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:17:05.414 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:17:05.414 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/257) 2024-04-04T09:17:06.047 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:17:06.066 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:17:06.066 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:17:08.748 INFO:teuthology.orchestra.run.smithi072.stdout:generic/257 2s 2024-04-04T09:17:08.768 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/257 2024-04-04T09:17:08.768 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:17:08.777 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:17:08.817 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:17:08.818 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/258) 2024-04-04T09:17:09.701 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:17:09.715 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:17:09.715 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:17:10.256 INFO:teuthology.orchestra.run.smithi072.stdout:generic/258 [failed, exit status 1]- output mismatch (see /tmp/tmp.tiFz9P8iUAxfstests-dev/results//generic/258.out.bad) 2024-04-04T09:17:10.263 INFO:teuthology.orchestra.run.smithi072.stdout: --- tests/generic/258.out 2024-04-04 06:58:02.202453772 +0000 2024-04-04T09:17:10.263 INFO:teuthology.orchestra.run.smithi072.stdout: +++ /tmp/tmp.tiFz9P8iUAxfstests-dev/results//generic/258.out.bad 2024-04-04 09:17:10.254262938 +0000 2024-04-04T09:17:10.263 INFO:teuthology.orchestra.run.smithi072.stdout: @@ -1,5 +1,6 @@ 2024-04-04T09:17:10.263 INFO:teuthology.orchestra.run.smithi072.stdout: QA output created by 258 2024-04-04T09:17:10.263 INFO:teuthology.orchestra.run.smithi072.stdout: Creating file with timestamp of Jan 1, 1960 2024-04-04T09:17:10.263 INFO:teuthology.orchestra.run.smithi072.stdout: Testing for negative seconds since epoch 2024-04-04T09:17:10.264 INFO:teuthology.orchestra.run.smithi072.stdout: -Remounting to flush cache 2024-04-04T09:17:10.264 INFO:teuthology.orchestra.run.smithi072.stdout: -Testing for negative seconds since epoch 2024-04-04T09:17:10.264 INFO:teuthology.orchestra.run.smithi072.stdout: +Timestamp wrapped: 3979351756 2024-04-04T09:17:10.264 INFO:teuthology.orchestra.run.smithi072.stdout: +Timestamp wrapped 2024-04-04T09:17:10.264 INFO:teuthology.orchestra.run.smithi072.stdout: +(see /tmp/tmp.tiFz9P8iUAxfstests-dev/results//generic/258.full for details) 2024-04-04T09:17:10.273 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/258 2024-04-04T09:17:10.273 INFO:teuthology.orchestra.run.smithi072.stdout:Failures: generic/258 2024-04-04T09:17:10.273 INFO:teuthology.orchestra.run.smithi072.stdout:Failed 1 of 1 tests 2024-04-04T09:17:10.283 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:17:10.314 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-04T09:17:10.315 INFO:tasks.cephfs.xfstests_dev:Command failed 2024-04-04T09:17:10.315 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2024-04-04T09:17:10.315 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/259) 2024-04-04T09:17:10.487 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T09:17:10.494 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T09:17:10.925 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:17:10.942 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:17:10.942 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:17:11.363 INFO:teuthology.orchestra.run.smithi072.stdout:generic/259 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:17:11.376 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/259 2024-04-04T09:17:11.376 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/259 2024-04-04T09:17:11.376 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:17:11.385 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:17:11.417 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:17:11.417 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/260) 2024-04-04T09:17:12.078 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:17:12.093 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:17:12.093 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:17:12.517 INFO:teuthology.orchestra.run.smithi072.stdout:generic/260 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:17:12.531 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/260 2024-04-04T09:17:12.532 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/260 2024-04-04T09:17:12.532 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:17:12.541 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:17:12.575 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:17:12.576 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/261) 2024-04-04T09:17:13.204 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:17:13.219 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:17:13.219 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:17:13.623 INFO:teuthology.orchestra.run.smithi072.stdout:generic/261 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:17:13.639 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/261 2024-04-04T09:17:13.639 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/261 2024-04-04T09:17:13.639 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:17:13.650 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:17:13.687 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:17:13.687 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/262) 2024-04-04T09:17:14.316 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:17:14.336 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:17:14.336 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:17:14.754 INFO:teuthology.orchestra.run.smithi072.stdout:generic/262 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:17:14.768 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/262 2024-04-04T09:17:14.768 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/262 2024-04-04T09:17:14.768 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:17:14.776 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:17:14.810 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:17:14.811 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/263) 2024-04-04T09:17:15.449 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:17:15.465 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:17:15.465 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:17:40.617 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T09:17:40.625 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T09:18:11.434 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T09:18:11.444 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T09:18:41.565 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T09:18:41.576 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T09:19:11.705 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T09:19:11.713 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T09:19:14.945 INFO:teuthology.orchestra.run.smithi072.stdout:generic/263 119s 2024-04-04T09:19:14.965 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/263 2024-04-04T09:19:14.965 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:19:14.974 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:19:15.010 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:19:15.016 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/264) 2024-04-04T09:19:15.789 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:19:15.800 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:19:15.800 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:19:16.149 INFO:teuthology.orchestra.run.smithi072.stdout:generic/264 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:19:16.163 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/264 2024-04-04T09:19:16.163 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/264 2024-04-04T09:19:16.163 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:19:16.174 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:19:16.201 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:19:16.202 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/265) 2024-04-04T09:19:16.796 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:19:16.809 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:19:16.809 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:19:17.266 INFO:teuthology.orchestra.run.smithi072.stdout:generic/265 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:19:17.277 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/265 2024-04-04T09:19:17.277 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/265 2024-04-04T09:19:17.277 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:19:17.285 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:19:17.312 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:19:17.312 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/266) 2024-04-04T09:19:17.836 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:19:17.851 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:19:17.851 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:19:18.281 INFO:teuthology.orchestra.run.smithi072.stdout:generic/266 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:19:18.295 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/266 2024-04-04T09:19:18.295 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/266 2024-04-04T09:19:18.295 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:19:18.306 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:19:18.336 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:19:18.336 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/267) 2024-04-04T09:19:18.873 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:19:18.885 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:19:18.885 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:19:19.335 INFO:teuthology.orchestra.run.smithi072.stdout:generic/267 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:19:19.344 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/267 2024-04-04T09:19:19.344 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/267 2024-04-04T09:19:19.344 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:19:19.353 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:19:19.377 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:19:19.378 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/268) 2024-04-04T09:19:19.884 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:19:19.896 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:19:19.897 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:19:20.303 INFO:teuthology.orchestra.run.smithi072.stdout:generic/268 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:19:20.314 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/268 2024-04-04T09:19:20.314 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/268 2024-04-04T09:19:20.314 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:19:20.323 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:19:20.347 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:19:20.347 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/269) 2024-04-04T09:19:20.860 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:19:20.872 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:19:20.872 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:19:21.247 INFO:teuthology.orchestra.run.smithi072.stdout:generic/269 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:19:21.259 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/269 2024-04-04T09:19:21.259 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/269 2024-04-04T09:19:21.260 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:19:21.270 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:19:21.298 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:19:21.298 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/270) 2024-04-04T09:19:21.827 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:19:21.839 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:19:21.839 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:19:22.808 INFO:teuthology.orchestra.run.smithi072.stdout:generic/270 [not run] disk quotas not supported by this filesystem type: ceph-fuse 2024-04-04T09:19:22.817 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/270 2024-04-04T09:19:22.818 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/270 2024-04-04T09:19:22.818 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:19:22.825 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:19:22.853 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:19:22.853 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/271) 2024-04-04T09:19:23.378 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:19:23.390 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:19:23.391 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:19:23.786 INFO:teuthology.orchestra.run.smithi072.stdout:generic/271 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:19:23.798 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/271 2024-04-04T09:19:23.798 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/271 2024-04-04T09:19:23.798 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:19:23.807 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:19:23.837 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:19:23.837 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/272) 2024-04-04T09:19:24.367 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:19:24.379 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:19:24.379 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:19:24.812 INFO:teuthology.orchestra.run.smithi072.stdout:generic/272 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:19:24.826 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/272 2024-04-04T09:19:24.826 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/272 2024-04-04T09:19:24.826 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:19:24.838 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:19:24.865 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:19:24.865 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/273) 2024-04-04T09:19:25.378 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:19:25.392 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:19:25.392 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:19:25.782 INFO:teuthology.orchestra.run.smithi072.stdout:generic/273 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:19:25.793 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/273 2024-04-04T09:19:25.794 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/273 2024-04-04T09:19:25.794 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:19:25.804 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:19:25.833 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:19:25.834 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/274) 2024-04-04T09:19:26.341 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:19:26.354 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:19:26.354 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:19:26.710 INFO:teuthology.orchestra.run.smithi072.stdout:generic/274 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:19:26.720 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/274 2024-04-04T09:19:26.720 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/274 2024-04-04T09:19:26.720 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:19:26.728 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:19:26.756 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:19:26.756 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/275) 2024-04-04T09:19:27.261 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:19:27.273 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:19:27.273 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:19:27.694 INFO:teuthology.orchestra.run.smithi072.stdout:generic/275 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:19:27.708 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/275 2024-04-04T09:19:27.708 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/275 2024-04-04T09:19:27.708 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:19:27.718 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:19:27.748 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:19:27.748 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/276) 2024-04-04T09:19:28.263 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:19:28.276 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:19:28.276 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:19:28.683 INFO:teuthology.orchestra.run.smithi072.stdout:generic/276 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:19:28.695 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/276 2024-04-04T09:19:28.695 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/276 2024-04-04T09:19:28.695 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:19:28.704 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:19:28.735 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:19:28.736 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/277) 2024-04-04T09:19:29.272 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:19:29.284 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:19:29.285 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:19:29.691 INFO:teuthology.orchestra.run.smithi072.stdout:generic/277 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:19:29.705 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/277 2024-04-04T09:19:29.705 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/277 2024-04-04T09:19:29.705 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:19:29.716 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:19:29.744 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:19:29.744 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/278) 2024-04-04T09:19:30.241 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:19:30.252 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:19:30.252 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:19:30.678 INFO:teuthology.orchestra.run.smithi072.stdout:generic/278 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:19:30.692 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/278 2024-04-04T09:19:30.692 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/278 2024-04-04T09:19:30.692 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:19:30.703 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:19:30.733 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:19:30.733 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/279) 2024-04-04T09:19:31.284 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:19:31.296 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:19:31.297 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:19:31.722 INFO:teuthology.orchestra.run.smithi072.stdout:generic/279 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:19:31.732 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/279 2024-04-04T09:19:31.732 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/279 2024-04-04T09:19:31.732 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:19:31.740 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:19:31.767 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:19:31.767 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/280) 2024-04-04T09:19:32.278 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:19:32.290 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:19:32.291 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:19:32.710 INFO:teuthology.orchestra.run.smithi072.stdout:generic/280 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:19:32.723 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/280 2024-04-04T09:19:32.723 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/280 2024-04-04T09:19:32.723 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:19:32.733 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:19:32.761 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:19:32.761 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/281) 2024-04-04T09:19:33.270 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:19:33.282 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:19:33.282 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:19:33.740 INFO:teuthology.orchestra.run.smithi072.stdout:generic/281 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:19:33.755 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/281 2024-04-04T09:19:33.755 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/281 2024-04-04T09:19:33.755 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:19:33.767 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:19:33.797 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:19:33.797 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/282) 2024-04-04T09:19:34.329 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:19:34.341 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:19:34.341 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:19:34.758 INFO:teuthology.orchestra.run.smithi072.stdout:generic/282 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:19:34.771 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/282 2024-04-04T09:19:34.771 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/282 2024-04-04T09:19:34.771 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:19:34.782 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:19:34.811 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:19:34.811 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/283) 2024-04-04T09:19:35.338 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:19:35.349 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:19:35.349 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:19:36.024 INFO:teuthology.orchestra.run.smithi072.stdout:generic/283 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:19:36.035 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/283 2024-04-04T09:19:36.035 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/283 2024-04-04T09:19:36.035 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:19:36.043 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:19:36.066 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:19:36.066 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/284) 2024-04-04T09:19:36.503 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:19:36.515 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:19:36.515 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:19:36.863 INFO:teuthology.orchestra.run.smithi072.stdout:generic/284 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:19:36.873 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/284 2024-04-04T09:19:36.873 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/284 2024-04-04T09:19:36.873 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:19:36.881 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:19:36.909 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:19:36.909 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/285) 2024-04-04T09:19:37.396 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:19:37.406 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:19:37.406 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:19:41.834 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T09:19:41.840 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T09:19:41.925 INFO:teuthology.orchestra.run.smithi072.stdout:generic/285 4s 2024-04-04T09:19:41.941 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/285 2024-04-04T09:19:41.941 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:19:41.949 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:19:41.973 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:19:41.973 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/286) 2024-04-04T09:19:42.895 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:19:42.912 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:19:42.912 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:20:12.074 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T09:20:12.083 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T09:20:42.221 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T09:20:42.229 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T09:21:12.432 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T09:21:12.441 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T09:21:44.609 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T09:21:44.618 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T09:22:16.539 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T09:22:16.548 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T09:22:23.173 INFO:teuthology.orchestra.run.smithi072.stdout:generic/286 161s 2024-04-04T09:22:23.224 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/286 2024-04-04T09:22:23.224 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:22:23.237 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:22:23.269 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:22:23.269 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/287) 2024-04-04T09:22:24.366 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:22:24.378 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:22:24.378 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:22:24.794 INFO:teuthology.orchestra.run.smithi072.stdout:generic/287 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:22:24.803 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/287 2024-04-04T09:22:24.803 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/287 2024-04-04T09:22:24.803 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:22:24.810 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:22:24.833 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:22:24.833 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/288) 2024-04-04T09:22:25.324 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:22:25.335 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:22:25.335 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:22:25.722 INFO:teuthology.orchestra.run.smithi072.stdout:generic/288 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:22:25.735 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/288 2024-04-04T09:22:25.735 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/288 2024-04-04T09:22:25.735 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:22:25.742 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:22:25.765 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:22:25.765 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/289) 2024-04-04T09:22:26.296 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:22:26.309 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:22:26.310 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:22:26.719 INFO:teuthology.orchestra.run.smithi072.stdout:generic/289 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:22:26.732 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/289 2024-04-04T09:22:26.733 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/289 2024-04-04T09:22:26.733 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:22:26.744 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:22:26.776 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:22:26.776 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/290) 2024-04-04T09:22:27.311 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:22:27.322 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:22:27.322 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:22:27.717 INFO:teuthology.orchestra.run.smithi072.stdout:generic/290 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:22:27.727 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/290 2024-04-04T09:22:27.727 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/290 2024-04-04T09:22:27.727 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:22:27.736 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:22:27.761 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:22:27.761 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/291) 2024-04-04T09:22:28.297 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:22:28.310 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:22:28.310 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:22:28.698 INFO:teuthology.orchestra.run.smithi072.stdout:generic/291 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:22:28.708 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/291 2024-04-04T09:22:28.708 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/291 2024-04-04T09:22:28.708 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:22:28.717 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:22:28.748 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:22:28.748 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/292) 2024-04-04T09:22:29.256 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:22:29.269 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:22:29.269 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:22:29.680 INFO:teuthology.orchestra.run.smithi072.stdout:generic/292 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:22:29.691 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/292 2024-04-04T09:22:29.691 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/292 2024-04-04T09:22:29.691 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:22:29.701 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:22:29.732 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:22:29.733 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/293) 2024-04-04T09:22:30.302 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:22:30.315 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:22:30.315 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:22:30.736 INFO:teuthology.orchestra.run.smithi072.stdout:generic/293 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:22:30.750 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/293 2024-04-04T09:22:30.751 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/293 2024-04-04T09:22:30.751 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:22:30.758 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:22:30.789 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:22:30.789 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/294) 2024-04-04T09:22:31.321 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:22:31.332 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:22:31.332 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:22:31.724 INFO:teuthology.orchestra.run.smithi072.stdout:generic/294 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:22:31.736 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/294 2024-04-04T09:22:31.736 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/294 2024-04-04T09:22:31.737 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:22:31.748 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:22:31.776 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:22:31.776 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/295) 2024-04-04T09:22:32.323 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:22:32.335 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:22:32.335 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:22:32.687 INFO:teuthology.orchestra.run.smithi072.stdout:generic/295 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:22:32.697 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/295 2024-04-04T09:22:32.697 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/295 2024-04-04T09:22:32.697 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:22:32.706 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:22:32.731 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:22:32.732 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/296) 2024-04-04T09:22:33.212 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:22:33.225 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:22:33.226 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:22:33.594 INFO:teuthology.orchestra.run.smithi072.stdout:generic/296 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:22:33.606 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/296 2024-04-04T09:22:33.607 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/296 2024-04-04T09:22:33.607 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:22:33.615 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:22:33.640 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:22:33.640 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/297) 2024-04-04T09:22:34.144 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:22:34.155 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:22:34.156 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:22:34.571 INFO:teuthology.orchestra.run.smithi072.stdout:generic/297 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:22:34.583 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/297 2024-04-04T09:22:34.583 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/297 2024-04-04T09:22:34.583 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:22:34.594 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:22:34.619 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:22:34.620 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/298) 2024-04-04T09:22:35.157 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:22:35.170 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:22:35.170 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:22:35.556 INFO:teuthology.orchestra.run.smithi072.stdout:generic/298 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:22:35.568 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/298 2024-04-04T09:22:35.569 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/298 2024-04-04T09:22:35.569 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:22:35.574 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:22:35.602 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:22:35.602 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/299) 2024-04-04T09:22:36.113 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:22:36.124 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:22:36.124 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:22:36.468 INFO:teuthology.orchestra.run.smithi072.stdout:generic/299 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:22:36.476 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/299 2024-04-04T09:22:36.476 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/299 2024-04-04T09:22:36.476 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:22:36.483 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:22:36.506 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:22:36.506 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/300) 2024-04-04T09:22:37.002 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:22:37.015 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:22:37.015 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:22:37.401 INFO:teuthology.orchestra.run.smithi072.stdout:generic/300 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:22:37.416 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/300 2024-04-04T09:22:37.416 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/300 2024-04-04T09:22:37.416 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:22:37.428 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:22:37.459 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:22:37.459 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/301) 2024-04-04T09:22:38.006 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:22:38.021 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:22:38.021 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:22:38.411 INFO:teuthology.orchestra.run.smithi072.stdout:generic/301 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:22:38.423 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/301 2024-04-04T09:22:38.423 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/301 2024-04-04T09:22:38.423 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:22:38.434 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:22:38.460 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:22:38.461 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/302) 2024-04-04T09:22:38.966 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:22:38.980 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:22:38.980 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:22:39.368 INFO:teuthology.orchestra.run.smithi072.stdout:generic/302 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:22:39.379 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/302 2024-04-04T09:22:39.379 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/302 2024-04-04T09:22:39.379 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:22:39.388 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:22:39.414 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:22:39.414 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/303) 2024-04-04T09:22:39.947 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:22:39.958 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:22:39.958 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:22:40.466 INFO:teuthology.orchestra.run.smithi072.stdout:generic/303 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-04-04T09:22:40.477 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/303 2024-04-04T09:22:40.477 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/303 2024-04-04T09:22:40.477 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:22:40.484 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:22:40.512 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:22:40.512 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/304) 2024-04-04T09:22:41.292 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:22:41.302 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:22:41.302 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:22:41.793 INFO:teuthology.orchestra.run.smithi072.stdout:generic/304 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2024-04-04T09:22:41.800 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/304 2024-04-04T09:22:41.800 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/304 2024-04-04T09:22:41.800 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:22:41.807 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:22:41.856 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:22:41.856 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/305) 2024-04-04T09:22:42.592 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:22:42.603 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:22:42.603 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:22:42.947 INFO:teuthology.orchestra.run.smithi072.stdout:generic/305 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:22:42.959 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/305 2024-04-04T09:22:42.959 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/305 2024-04-04T09:22:42.959 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:22:42.967 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:22:42.991 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:22:42.991 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/306) 2024-04-04T09:22:43.500 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:22:43.510 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:22:43.510 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:22:43.850 INFO:teuthology.orchestra.run.smithi072.stdout:generic/306 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:22:43.859 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/306 2024-04-04T09:22:43.860 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/306 2024-04-04T09:22:43.860 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:22:43.867 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:22:43.896 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:22:43.896 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/307) 2024-04-04T09:22:44.404 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:22:44.416 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:22:44.416 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:22:44.866 INFO:teuthology.orchestra.run.smithi072.stdout:generic/307 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:22:44.880 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/307 2024-04-04T09:22:44.880 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/307 2024-04-04T09:22:44.880 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:22:44.891 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:22:44.923 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:22:44.924 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/308) 2024-04-04T09:22:45.489 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:22:45.500 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:22:45.500 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:22:45.957 INFO:teuthology.orchestra.run.smithi072.stdout:generic/308 0s 2024-04-04T09:22:45.973 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/308 2024-04-04T09:22:45.973 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:22:45.981 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:22:46.008 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:22:46.008 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/309) 2024-04-04T09:22:46.508 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:22:46.519 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:22:46.519 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:22:46.741 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T09:22:46.746 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T09:22:48.031 INFO:teuthology.orchestra.run.smithi072.stdout:generic/309 2s 2024-04-04T09:22:48.047 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/309 2024-04-04T09:22:48.047 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:22:48.054 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:22:48.080 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:22:48.081 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/310) 2024-04-04T09:22:48.807 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:22:48.817 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:22:48.817 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:23:16.954 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T09:23:16.960 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T09:23:47.174 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T09:23:47.186 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T09:24:21.573 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T09:24:21.582 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T09:24:40.028 INFO:teuthology.orchestra.run.smithi072.stdout:generic/310 109s 2024-04-04T09:24:41.132 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/310 2024-04-04T09:24:41.133 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:24:41.142 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:24:41.194 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:24:41.194 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/311) 2024-04-04T09:24:42.080 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:24:42.090 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:24:42.090 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:24:42.596 INFO:teuthology.orchestra.run.smithi072.stdout:generic/311 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:24:42.609 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/311 2024-04-04T09:24:42.609 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/311 2024-04-04T09:24:42.610 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:24:42.621 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:24:42.651 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:24:42.651 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/312) 2024-04-04T09:24:43.139 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:24:43.152 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:24:43.152 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:24:43.569 INFO:teuthology.orchestra.run.smithi072.stdout:generic/312 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:24:43.579 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/312 2024-04-04T09:24:43.579 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/312 2024-04-04T09:24:43.579 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:24:43.587 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:24:43.614 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:24:43.615 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/313) 2024-04-04T09:24:44.104 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:24:44.118 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:24:44.118 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:24:48.702 INFO:teuthology.orchestra.run.smithi072.stdout:generic/313 4s 2024-04-04T09:24:48.721 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/313 2024-04-04T09:24:48.722 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:24:48.732 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:24:48.759 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:24:48.759 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/314) 2024-04-04T09:24:49.259 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:24:49.270 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:24:49.271 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:24:50.557 INFO:teuthology.orchestra.run.smithi072.stdout:generic/314 1s 2024-04-04T09:24:50.577 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/314 2024-04-04T09:24:50.577 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:24:50.587 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:24:50.616 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:24:50.616 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/315) 2024-04-04T09:24:51.169 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:24:51.183 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:24:51.183 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:24:51.786 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T09:24:51.796 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T09:24:53.390 INFO:teuthology.orchestra.run.smithi072.stdout:generic/315 2s 2024-04-04T09:24:53.406 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/315 2024-04-04T09:24:53.407 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:24:53.414 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:24:53.471 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:24:53.471 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/316) 2024-04-04T09:24:54.252 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:24:54.263 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:24:54.263 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:24:57.614 INFO:teuthology.orchestra.run.smithi072.stdout:generic/316 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-04-04T09:24:57.624 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/316 2024-04-04T09:24:57.624 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/316 2024-04-04T09:24:57.624 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:24:57.632 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:24:57.671 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:24:57.671 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/317) 2024-04-04T09:24:58.423 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:24:58.434 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:24:58.434 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:24:58.807 INFO:teuthology.orchestra.run.smithi072.stdout:generic/317 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:24:58.820 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/317 2024-04-04T09:24:58.821 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/317 2024-04-04T09:24:58.821 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:24:58.831 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:24:58.861 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:24:58.861 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/318) 2024-04-04T09:24:59.394 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:24:59.406 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:24:59.406 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:24:59.854 INFO:teuthology.orchestra.run.smithi072.stdout:generic/318 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:24:59.865 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/318 2024-04-04T09:24:59.865 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/318 2024-04-04T09:24:59.865 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:24:59.876 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:24:59.902 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:24:59.902 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/319) 2024-04-04T09:25:00.433 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:25:00.445 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:25:00.445 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:25:00.893 INFO:teuthology.orchestra.run.smithi072.stdout:generic/319 [not run] ACLs not supported by this filesystem type: ceph-fuse 2024-04-04T09:25:00.903 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/319 2024-04-04T09:25:00.903 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/319 2024-04-04T09:25:00.903 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:25:00.911 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:25:00.938 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:25:00.938 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/320) 2024-04-04T09:25:01.419 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:25:01.430 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:25:01.430 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:25:01.840 INFO:teuthology.orchestra.run.smithi072.stdout:generic/320 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:25:01.850 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/320 2024-04-04T09:25:01.850 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/320 2024-04-04T09:25:01.850 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:25:01.859 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:25:01.884 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:25:01.885 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/321) 2024-04-04T09:25:02.374 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:25:02.387 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:25:02.387 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:25:02.885 INFO:teuthology.orchestra.run.smithi072.stdout:generic/321 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:25:02.898 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/321 2024-04-04T09:25:02.898 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/321 2024-04-04T09:25:02.899 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:25:02.909 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:25:02.939 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:25:02.939 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/322) 2024-04-04T09:25:03.458 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:25:03.469 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:25:03.469 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:25:03.860 INFO:teuthology.orchestra.run.smithi072.stdout:generic/322 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:25:03.871 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/322 2024-04-04T09:25:03.872 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/322 2024-04-04T09:25:03.872 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:25:03.883 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:25:03.912 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:25:03.912 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/323) 2024-04-04T09:25:04.429 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:25:04.441 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:25:04.441 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:25:23.180 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T09:25:23.185 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T09:25:53.345 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T09:25:53.353 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T09:26:23.555 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T09:26:23.562 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T09:26:56.916 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T09:26:56.923 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T09:27:07.302 INFO:teuthology.orchestra.run.smithi072.stdout:generic/323 122s 2024-04-04T09:27:08.760 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/323 2024-04-04T09:27:08.760 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:27:08.770 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:27:08.813 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:27:08.814 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/324) 2024-04-04T09:27:09.526 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:27:09.538 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:27:09.538 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:27:13.909 INFO:teuthology.orchestra.run.smithi072.stdout:generic/324 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:27:13.923 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/324 2024-04-04T09:27:13.923 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/324 2024-04-04T09:27:13.923 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:27:13.934 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:27:13.962 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:27:13.962 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/325) 2024-04-04T09:27:14.465 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:27:14.477 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:27:14.477 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:27:14.969 INFO:teuthology.orchestra.run.smithi072.stdout:generic/325 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:27:14.981 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/325 2024-04-04T09:27:14.981 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/325 2024-04-04T09:27:14.981 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:27:14.990 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:27:15.019 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:27:15.019 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/326) 2024-04-04T09:27:15.529 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:27:15.541 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:27:15.542 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:27:15.956 INFO:teuthology.orchestra.run.smithi072.stdout:generic/326 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:27:15.969 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/326 2024-04-04T09:27:15.969 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/326 2024-04-04T09:27:15.969 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:27:15.980 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:27:16.005 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:27:16.006 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/327) 2024-04-04T09:27:16.542 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:27:16.554 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:27:16.555 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:27:16.932 INFO:teuthology.orchestra.run.smithi072.stdout:generic/327 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:27:16.944 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/327 2024-04-04T09:27:16.944 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/327 2024-04-04T09:27:16.944 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:27:16.953 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:27:16.982 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:27:16.983 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/328) 2024-04-04T09:27:17.539 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:27:17.554 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:27:17.554 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:27:17.943 INFO:teuthology.orchestra.run.smithi072.stdout:generic/328 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:27:17.957 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/328 2024-04-04T09:27:17.957 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/328 2024-04-04T09:27:17.957 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:27:17.968 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:27:17.999 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:27:18.000 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/329) 2024-04-04T09:27:18.502 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:27:18.513 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:27:18.514 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:27:18.919 INFO:teuthology.orchestra.run.smithi072.stdout:generic/329 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:27:18.933 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/329 2024-04-04T09:27:18.933 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/329 2024-04-04T09:27:18.933 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:27:18.943 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:27:18.972 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:27:18.972 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/330) 2024-04-04T09:27:19.488 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:27:19.500 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:27:19.500 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:27:20.821 INFO:teuthology.orchestra.run.smithi072.stdout:generic/330 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:27:20.831 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/330 2024-04-04T09:27:20.831 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/330 2024-04-04T09:27:20.832 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:27:20.840 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:27:20.869 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:27:20.870 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/331) 2024-04-04T09:27:21.360 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:27:21.371 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:27:21.371 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:27:24.802 INFO:teuthology.orchestra.run.smithi072.stdout:generic/331 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:27:24.811 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/331 2024-04-04T09:27:24.811 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/331 2024-04-04T09:27:24.811 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:27:24.819 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:27:24.845 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:27:24.846 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/332) 2024-04-04T09:27:25.320 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:27:25.331 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:27:25.332 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:27:26.285 INFO:teuthology.orchestra.run.smithi072.stdout:generic/332 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:27:26.296 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/332 2024-04-04T09:27:26.296 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/332 2024-04-04T09:27:26.296 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:27:26.306 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:27:26.334 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:27:26.334 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/333) 2024-04-04T09:27:26.844 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:27:26.857 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:27:26.857 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:27:27.224 INFO:teuthology.orchestra.run.smithi072.stdout:generic/333 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:27:27.235 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/333 2024-04-04T09:27:27.235 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/333 2024-04-04T09:27:27.235 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:27:27.244 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:27:27.273 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:27:27.273 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/334) 2024-04-04T09:27:27.786 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:27:27.798 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:27:27.798 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:27:28.217 INFO:teuthology.orchestra.run.smithi072.stdout:generic/334 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:27:28.230 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/334 2024-04-04T09:27:28.231 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/334 2024-04-04T09:27:28.231 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:27:28.240 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:27:28.267 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:27:28.267 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/335) 2024-04-04T09:27:28.775 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:27:28.788 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:27:28.788 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:27:29.196 INFO:teuthology.orchestra.run.smithi072.stdout:generic/335 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:27:29.210 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/335 2024-04-04T09:27:29.211 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/335 2024-04-04T09:27:29.212 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:27:29.222 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:27:29.251 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:27:29.252 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/336) 2024-04-04T09:27:29.448 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T09:27:29.454 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T09:27:29.770 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:27:29.782 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:27:29.782 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:27:30.203 INFO:teuthology.orchestra.run.smithi072.stdout:generic/336 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:27:30.216 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/336 2024-04-04T09:27:30.216 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/336 2024-04-04T09:27:30.216 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:27:30.225 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:27:30.248 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:27:30.249 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/337) 2024-04-04T09:27:30.732 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:27:30.743 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:27:30.743 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:27:31.149 INFO:teuthology.orchestra.run.smithi072.stdout:generic/337 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:27:31.160 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/337 2024-04-04T09:27:31.160 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/337 2024-04-04T09:27:31.160 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:27:31.168 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:27:31.198 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:27:31.199 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/338) 2024-04-04T09:27:31.728 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:27:31.740 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:27:31.741 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:27:32.193 INFO:teuthology.orchestra.run.smithi072.stdout:generic/338 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:27:32.206 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/338 2024-04-04T09:27:32.207 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/338 2024-04-04T09:27:32.207 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:27:32.217 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:27:32.247 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:27:32.247 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/339) 2024-04-04T09:27:32.753 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:27:32.766 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:27:32.766 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:27:33.167 INFO:teuthology.orchestra.run.smithi072.stdout:generic/339 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:27:33.178 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/339 2024-04-04T09:27:33.178 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/339 2024-04-04T09:27:33.179 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:27:33.188 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:27:33.217 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:27:33.218 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/340) 2024-04-04T09:27:33.764 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:27:33.776 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:27:33.777 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:27:34.184 INFO:teuthology.orchestra.run.smithi072.stdout:generic/340 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:27:34.192 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/340 2024-04-04T09:27:34.193 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/340 2024-04-04T09:27:34.193 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:27:34.199 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:27:34.226 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:27:34.227 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/341) 2024-04-04T09:27:34.736 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:27:34.748 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:27:34.748 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:27:35.157 INFO:teuthology.orchestra.run.smithi072.stdout:generic/341 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:27:35.171 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/341 2024-04-04T09:27:35.171 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/341 2024-04-04T09:27:35.172 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:27:35.176 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:27:35.204 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:27:35.205 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/342) 2024-04-04T09:27:35.706 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:27:35.718 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:27:35.718 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:27:36.131 INFO:teuthology.orchestra.run.smithi072.stdout:generic/342 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:27:36.143 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/342 2024-04-04T09:27:36.144 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/342 2024-04-04T09:27:36.144 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:27:36.151 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:27:36.178 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:27:36.179 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/343) 2024-04-04T09:27:36.697 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:27:36.708 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:27:36.709 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:27:37.116 INFO:teuthology.orchestra.run.smithi072.stdout:generic/343 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:27:37.126 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/343 2024-04-04T09:27:37.127 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/343 2024-04-04T09:27:37.127 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:27:37.134 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:27:37.160 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:27:37.160 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/344) 2024-04-04T09:27:37.687 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:27:37.700 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:27:37.700 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:27:38.065 INFO:teuthology.orchestra.run.smithi072.stdout:generic/344 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:27:38.079 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/344 2024-04-04T09:27:38.079 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/344 2024-04-04T09:27:38.080 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:27:38.091 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:27:38.121 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:27:38.121 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/345) 2024-04-04T09:27:38.636 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:27:38.650 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:27:38.651 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:27:38.985 INFO:teuthology.orchestra.run.smithi072.stdout:generic/345 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:27:38.996 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/345 2024-04-04T09:27:38.997 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/345 2024-04-04T09:27:38.997 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:27:39.005 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:27:39.033 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:27:39.033 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/346) 2024-04-04T09:27:39.565 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:27:39.578 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:27:39.578 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:27:39.955 INFO:teuthology.orchestra.run.smithi072.stdout:generic/346 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:27:39.968 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/346 2024-04-04T09:27:39.968 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/346 2024-04-04T09:27:39.969 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:27:39.980 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:27:40.006 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:27:40.007 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/347) 2024-04-04T09:27:40.530 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:27:40.542 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:27:40.542 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:27:41.029 INFO:teuthology.orchestra.run.smithi072.stdout:generic/347 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:27:41.043 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/347 2024-04-04T09:27:41.044 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/347 2024-04-04T09:27:41.044 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:27:41.055 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:27:41.084 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:27:41.084 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/348) 2024-04-04T09:27:41.594 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:27:41.605 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:27:41.605 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:27:42.018 INFO:teuthology.orchestra.run.smithi072.stdout:generic/348 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:27:42.030 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/348 2024-04-04T09:27:42.030 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/348 2024-04-04T09:27:42.030 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:27:42.041 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:27:42.071 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:27:42.071 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/349) 2024-04-04T09:27:42.599 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:27:42.611 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:27:42.611 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:27:46.871 INFO:teuthology.orchestra.run.smithi072.stdout:generic/349 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2024-04-04T09:27:46.884 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/349 2024-04-04T09:27:46.884 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/349 2024-04-04T09:27:46.884 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:27:46.896 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:27:46.922 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:27:46.922 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/350) 2024-04-04T09:27:47.400 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:27:47.414 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:27:47.415 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:27:52.412 INFO:teuthology.orchestra.run.smithi072.stdout:generic/350 5s 2024-04-04T09:27:52.428 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/350 2024-04-04T09:27:52.428 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:27:52.436 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:27:52.462 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:27:52.462 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/351) 2024-04-04T09:27:52.967 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:27:52.979 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:27:52.979 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:27:56.718 INFO:teuthology.orchestra.run.smithi072.stdout:generic/351 [not run] xfs_io finsert failed (old kernel/wrong fs?) 2024-04-04T09:27:56.731 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/351 2024-04-04T09:27:56.732 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/351 2024-04-04T09:27:56.732 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:27:56.743 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:27:56.787 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:27:56.788 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/352) 2024-04-04T09:27:57.521 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:27:57.533 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:27:57.533 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:27:57.868 INFO:teuthology.orchestra.run.smithi072.stdout:generic/352 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:27:57.877 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/352 2024-04-04T09:27:57.877 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/352 2024-04-04T09:27:57.877 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:27:57.885 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:27:57.912 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:27:57.913 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/353) 2024-04-04T09:27:58.413 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:27:58.425 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:27:58.425 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:27:58.817 INFO:teuthology.orchestra.run.smithi072.stdout:generic/353 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:27:58.830 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/353 2024-04-04T09:27:58.830 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/353 2024-04-04T09:27:58.830 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:27:58.838 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:27:58.865 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:27:58.866 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/354) 2024-04-04T09:27:59.396 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:27:59.409 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:27:59.409 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:27:59.658 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T09:27:59.663 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T09:27:59.758 INFO:tasks.ceph.osd.1.smithi072.stderr:2024-04-04T09:27:59.759+0000 7fa436800640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 327947) UID: 0 2024-04-04T09:27:59.758 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-04T09:27:59.759+0000 7f4e66800640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 327947) UID: 0 2024-04-04T09:27:59.759 INFO:tasks.ceph.osd.2.smithi072.stderr:2024-04-04T09:27:59.759+0000 7f7521000640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 327947) UID: 0 2024-04-04T09:27:59.759 INFO:tasks.ceph.osd.3.smithi072.stderr:2024-04-04T09:27:59.759+0000 7f0d67400640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 327947) UID: 0 2024-04-04T09:27:59.781 INFO:teuthology.orchestra.run.smithi072.stdout:generic/354 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:27:59.790 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/354 2024-04-04T09:27:59.790 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/354 2024-04-04T09:27:59.790 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:27:59.798 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:27:59.821 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:27:59.821 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/355) 2024-04-04T09:28:00.297 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:28:00.308 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:28:00.309 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:28:02.644 INFO:teuthology.orchestra.run.smithi072.stdout:generic/355 2s 2024-04-04T09:28:02.661 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/355 2024-04-04T09:28:02.661 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:28:02.669 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:28:02.695 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:28:02.695 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/356) 2024-04-04T09:28:03.489 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:28:03.499 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:28:03.500 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:28:04.028 INFO:teuthology.orchestra.run.smithi072.stdout:generic/356 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:28:04.037 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/356 2024-04-04T09:28:04.037 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/356 2024-04-04T09:28:04.037 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:28:04.095 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:28:04.119 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:28:04.119 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/357) 2024-04-04T09:28:04.575 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:28:04.586 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:28:04.587 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:28:04.970 INFO:teuthology.orchestra.run.smithi072.stdout:generic/357 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:28:04.980 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/357 2024-04-04T09:28:04.980 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/357 2024-04-04T09:28:04.980 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:28:04.988 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:28:05.012 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:28:05.013 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/358) 2024-04-04T09:28:05.481 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:28:05.492 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:28:05.492 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:28:05.895 INFO:teuthology.orchestra.run.smithi072.stdout:generic/358 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:28:05.906 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/358 2024-04-04T09:28:05.907 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/358 2024-04-04T09:28:05.907 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:28:05.917 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:28:05.944 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:28:05.944 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/359) 2024-04-04T09:28:06.396 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:28:06.408 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:28:06.409 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:28:06.948 INFO:teuthology.orchestra.run.smithi072.stdout:generic/359 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:28:06.960 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/359 2024-04-04T09:28:06.960 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/359 2024-04-04T09:28:06.960 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:28:06.970 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:28:06.995 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:28:06.995 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/360) 2024-04-04T09:28:07.546 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:28:07.556 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:28:07.556 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:28:08.470 INFO:teuthology.orchestra.run.smithi072.stdout:generic/360 1s 2024-04-04T09:28:08.486 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/360 2024-04-04T09:28:08.486 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:28:08.494 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:28:08.522 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:28:08.522 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/361) 2024-04-04T09:28:09.003 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:28:09.014 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:28:09.014 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:28:09.485 INFO:teuthology.orchestra.run.smithi072.stdout:generic/361 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:28:09.496 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/361 2024-04-04T09:28:09.496 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/361 2024-04-04T09:28:09.496 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:28:09.505 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:28:09.532 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:28:09.533 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/362) 2024-04-04T09:28:10.038 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:28:10.050 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:28:10.051 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:28:10.495 INFO:teuthology.orchestra.run.smithi072.stdout:generic/362 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:28:10.507 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/362 2024-04-04T09:28:10.507 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/362 2024-04-04T09:28:10.507 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:28:10.516 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:28:10.543 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:28:10.544 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/363) 2024-04-04T09:28:11.050 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:28:11.060 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:28:11.060 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:28:11.433 INFO:teuthology.orchestra.run.smithi072.stdout:generic/363 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:28:11.442 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/363 2024-04-04T09:28:11.442 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/363 2024-04-04T09:28:11.442 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:28:11.449 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:28:11.474 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:28:11.474 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/364) 2024-04-04T09:28:11.992 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:28:12.003 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:28:12.004 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:28:12.406 INFO:teuthology.orchestra.run.smithi072.stdout:generic/364 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:28:12.415 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/364 2024-04-04T09:28:12.416 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/364 2024-04-04T09:28:12.416 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:28:12.424 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:28:12.448 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:28:12.448 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/365) 2024-04-04T09:28:12.943 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:28:12.953 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:28:12.954 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:28:13.328 INFO:teuthology.orchestra.run.smithi072.stdout:generic/365 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:28:13.339 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/365 2024-04-04T09:28:13.339 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/365 2024-04-04T09:28:13.339 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:28:13.346 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:28:13.373 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:28:13.373 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/366) 2024-04-04T09:28:13.874 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:28:13.885 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:28:13.885 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:28:14.293 INFO:teuthology.orchestra.run.smithi072.stdout:generic/366 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:28:14.303 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/366 2024-04-04T09:28:14.303 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/366 2024-04-04T09:28:14.303 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:28:14.312 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:28:14.338 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:28:14.339 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/367) 2024-04-04T09:28:14.830 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:28:14.841 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:28:14.841 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:28:15.214 INFO:teuthology.orchestra.run.smithi072.stdout:generic/367 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:28:15.224 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/367 2024-04-04T09:28:15.224 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/367 2024-04-04T09:28:15.224 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:28:15.231 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:28:15.261 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:28:15.262 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/368) 2024-04-04T09:28:15.751 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:28:15.764 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:28:15.764 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:28:16.161 INFO:teuthology.orchestra.run.smithi072.stdout:generic/368 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:28:16.172 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/368 2024-04-04T09:28:16.172 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/368 2024-04-04T09:28:16.172 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:28:16.178 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:28:16.204 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:28:16.205 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/369) 2024-04-04T09:28:16.722 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:28:16.732 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:28:16.732 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:28:17.084 INFO:teuthology.orchestra.run.smithi072.stdout:generic/369 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:28:17.094 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/369 2024-04-04T09:28:17.094 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/369 2024-04-04T09:28:17.095 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:28:17.102 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:28:17.129 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:28:17.129 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/370) 2024-04-04T09:28:17.628 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:28:17.639 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:28:17.640 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:28:18.009 INFO:teuthology.orchestra.run.smithi072.stdout:generic/370 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:28:18.020 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/370 2024-04-04T09:28:18.020 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/370 2024-04-04T09:28:18.020 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:28:18.029 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:28:18.055 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:28:18.055 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/371) 2024-04-04T09:28:18.538 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:28:18.550 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:28:18.551 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:28:18.916 INFO:teuthology.orchestra.run.smithi072.stdout:generic/371 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:28:18.928 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/371 2024-04-04T09:28:18.928 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/371 2024-04-04T09:28:18.928 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:28:18.937 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:28:18.967 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:28:18.968 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/372) 2024-04-04T09:28:19.462 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:28:19.473 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:28:19.473 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:28:19.858 INFO:teuthology.orchestra.run.smithi072.stdout:generic/372 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:28:19.868 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/372 2024-04-04T09:28:19.868 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/372 2024-04-04T09:28:19.868 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:28:19.877 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:28:19.901 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:28:19.902 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/373) 2024-04-04T09:28:20.397 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:28:20.410 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:28:20.410 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:28:20.796 INFO:teuthology.orchestra.run.smithi072.stdout:generic/373 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:28:20.808 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/373 2024-04-04T09:28:20.808 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/373 2024-04-04T09:28:20.808 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:28:20.818 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:28:20.845 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:28:20.846 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/374) 2024-04-04T09:28:21.346 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:28:21.356 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:28:21.356 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:28:21.835 INFO:teuthology.orchestra.run.smithi072.stdout:generic/374 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:28:21.847 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/374 2024-04-04T09:28:21.847 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/374 2024-04-04T09:28:21.847 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:28:21.858 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:28:21.881 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:28:21.881 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/375) 2024-04-04T09:28:22.360 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:28:22.373 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:28:22.373 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:28:22.999 INFO:teuthology.orchestra.run.smithi072.stdout:generic/375 [not run] ACLs not supported by this filesystem type: ceph-fuse 2024-04-04T09:28:23.009 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/375 2024-04-04T09:28:23.009 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/375 2024-04-04T09:28:23.009 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:28:23.017 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:28:23.052 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:28:23.053 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/376) 2024-04-04T09:28:23.545 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:28:23.556 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:28:23.556 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:28:24.214 INFO:teuthology.orchestra.run.smithi072.stdout:generic/376 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:28:24.225 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/376 2024-04-04T09:28:24.226 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/376 2024-04-04T09:28:24.226 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:28:24.237 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:28:24.261 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:28:24.262 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/377) 2024-04-04T09:28:24.776 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:28:24.787 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:28:24.787 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:28:25.173 INFO:teuthology.orchestra.run.smithi072.stdout:generic/377 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:28:25.182 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/377 2024-04-04T09:28:25.182 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/377 2024-04-04T09:28:25.182 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:28:25.190 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:28:25.217 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:28:25.218 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/378) 2024-04-04T09:28:25.724 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:28:25.735 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:28:25.735 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:28:28.521 INFO:teuthology.orchestra.run.smithi072.stdout:generic/378 3s 2024-04-04T09:28:28.541 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/378 2024-04-04T09:28:28.541 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:28:28.551 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:28:28.581 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:28:28.581 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/379) 2024-04-04T09:28:29.376 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:28:29.388 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:28:29.388 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:28:29.972 INFO:teuthology.orchestra.run.smithi072.stdout:generic/379 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:28:29.986 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/379 2024-04-04T09:28:29.986 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/379 2024-04-04T09:28:29.986 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:28:29.995 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:28:30.025 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:28:30.025 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/380) 2024-04-04T09:28:30.514 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:28:30.525 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:28:30.525 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:28:30.919 INFO:teuthology.orchestra.run.smithi072.stdout:generic/380 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:28:30.928 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/380 2024-04-04T09:28:30.929 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/380 2024-04-04T09:28:30.929 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:28:30.936 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:28:30.958 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:28:30.959 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/381) 2024-04-04T09:28:31.434 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:28:31.444 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:28:31.444 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:28:31.853 INFO:teuthology.orchestra.run.smithi072.stdout:generic/381 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:28:31.864 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/381 2024-04-04T09:28:31.864 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/381 2024-04-04T09:28:31.864 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:28:31.871 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:28:31.901 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:28:31.902 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/382) 2024-04-04T09:28:32.424 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:28:32.435 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:28:32.435 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:28:32.935 INFO:teuthology.orchestra.run.smithi072.stdout:generic/382 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:28:32.946 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/382 2024-04-04T09:28:32.946 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/382 2024-04-04T09:28:32.946 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:28:32.955 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:28:32.984 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:28:32.984 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/383) 2024-04-04T09:28:33.455 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:28:33.467 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:28:33.467 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:28:33.948 INFO:teuthology.orchestra.run.smithi072.stdout:generic/383 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:28:33.960 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/383 2024-04-04T09:28:33.961 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/383 2024-04-04T09:28:33.961 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:28:33.966 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:28:33.993 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:28:33.993 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/384) 2024-04-04T09:28:34.452 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:28:34.463 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:28:34.463 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:28:34.856 INFO:teuthology.orchestra.run.smithi072.stdout:generic/384 [not run] disk quotas not supported by this filesystem type: ceph-fuse 2024-04-04T09:28:34.870 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/384 2024-04-04T09:28:34.870 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/384 2024-04-04T09:28:34.870 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:28:34.880 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:28:34.907 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:28:34.907 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/385) 2024-04-04T09:28:35.398 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:28:35.410 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:28:35.410 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:28:35.825 INFO:teuthology.orchestra.run.smithi072.stdout:generic/385 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:28:35.834 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/385 2024-04-04T09:28:35.834 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/385 2024-04-04T09:28:35.835 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:28:35.841 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:28:35.866 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:28:35.867 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/386) 2024-04-04T09:28:36.368 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:28:36.380 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:28:36.380 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:28:36.788 INFO:teuthology.orchestra.run.smithi072.stdout:generic/386 [not run] disk quotas not supported by this filesystem type: ceph-fuse 2024-04-04T09:28:36.799 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/386 2024-04-04T09:28:36.799 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/386 2024-04-04T09:28:36.799 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:28:36.807 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:28:36.832 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:28:36.832 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/387) 2024-04-04T09:28:37.303 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:28:37.314 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:28:37.314 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:28:37.770 INFO:teuthology.orchestra.run.smithi072.stdout:generic/387 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:28:37.780 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/387 2024-04-04T09:28:37.781 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/387 2024-04-04T09:28:37.781 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:28:37.789 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:28:37.817 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:28:37.818 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/388) 2024-04-04T09:28:38.327 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:28:38.341 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:28:38.342 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:28:38.953 INFO:teuthology.orchestra.run.smithi072.stdout:generic/388 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:28:38.964 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/388 2024-04-04T09:28:38.964 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/388 2024-04-04T09:28:38.964 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:28:38.971 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:28:38.997 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:28:38.997 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/389) 2024-04-04T09:28:39.465 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:28:39.476 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:28:39.476 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:28:39.888 INFO:teuthology.orchestra.run.smithi072.stdout:generic/389 [not run] O_TMPFILE is not supported 2024-04-04T09:28:39.898 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/389 2024-04-04T09:28:39.898 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/389 2024-04-04T09:28:39.898 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:28:39.906 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:28:39.931 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:28:39.931 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/390) 2024-04-04T09:28:40.446 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:28:40.459 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:28:40.459 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:28:40.899 INFO:teuthology.orchestra.run.smithi072.stdout:generic/390 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:28:40.909 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/390 2024-04-04T09:28:40.910 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/390 2024-04-04T09:28:40.910 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:28:40.919 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:28:40.949 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:28:40.949 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/391) 2024-04-04T09:28:41.422 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:28:41.433 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:28:41.433 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:29:45.992 INFO:teuthology.orchestra.run.smithi072.stdout:generic/391 64s 2024-04-04T09:29:46.305 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/391 2024-04-04T09:29:46.305 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:29:46.317 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:29:46.637 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:29:46.638 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/392) 2024-04-04T09:29:51.166 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:29:51.189 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:29:51.189 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:29:51.701 INFO:teuthology.orchestra.run.smithi072.stdout:generic/392 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:29:51.710 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/392 2024-04-04T09:29:51.710 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/392 2024-04-04T09:29:51.710 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:29:51.717 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:29:51.744 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:29:51.745 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/393) 2024-04-04T09:29:52.289 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:29:52.300 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:29:52.300 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:29:52.818 INFO:teuthology.orchestra.run.smithi072.stdout:generic/393 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:29:52.828 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/393 2024-04-04T09:29:52.828 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/393 2024-04-04T09:29:52.829 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:29:52.836 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:29:52.860 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:29:52.860 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/394) 2024-04-04T09:29:53.370 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:29:53.382 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:29:53.382 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:29:53.946 INFO:teuthology.orchestra.run.smithi072.stdout:generic/394 0s 2024-04-04T09:29:53.962 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/394 2024-04-04T09:29:53.962 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:29:53.970 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:29:53.997 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:29:53.997 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/395) 2024-04-04T09:29:54.866 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:29:54.884 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:29:54.885 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:29:55.494 INFO:teuthology.orchestra.run.smithi072.stdout:generic/395 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:29:55.507 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/395 2024-04-04T09:29:55.507 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/395 2024-04-04T09:29:55.507 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:29:55.518 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:29:55.561 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:29:55.561 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/396) 2024-04-04T09:29:56.046 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:29:56.057 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:29:56.057 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:29:56.745 INFO:teuthology.orchestra.run.smithi072.stdout:generic/396 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:29:56.755 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/396 2024-04-04T09:29:56.755 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/396 2024-04-04T09:29:56.755 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:29:56.764 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:29:56.789 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:29:56.790 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/397) 2024-04-04T09:29:57.254 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:29:57.265 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:29:57.265 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:29:59.856 INFO:teuthology.orchestra.run.smithi072.stdout:generic/397 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:29:59.869 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/397 2024-04-04T09:29:59.869 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/397 2024-04-04T09:29:59.869 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:29:59.878 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:29:59.909 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:29:59.910 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/398) 2024-04-04T09:30:00.410 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:30:00.420 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:30:00.421 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:30:00.988 INFO:teuthology.orchestra.run.smithi072.stdout:generic/398 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:30:00.999 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/398 2024-04-04T09:30:00.999 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/398 2024-04-04T09:30:00.999 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:30:01.010 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:30:01.032 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:30:01.033 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/399) 2024-04-04T09:30:01.527 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:30:01.538 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:30:01.538 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:30:01.996 INFO:teuthology.orchestra.run.smithi072.stdout:generic/399 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:30:02.006 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/399 2024-04-04T09:30:02.006 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/399 2024-04-04T09:30:02.006 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:30:02.016 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:30:02.043 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:30:02.043 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/400) 2024-04-04T09:30:02.537 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:30:02.549 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:30:02.549 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:30:02.951 INFO:teuthology.orchestra.run.smithi072.stdout:generic/400 [not run] disk quotas not supported by this filesystem type: ceph-fuse 2024-04-04T09:30:02.963 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/400 2024-04-04T09:30:02.963 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/400 2024-04-04T09:30:02.963 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:30:02.972 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:30:03.001 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:30:03.001 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/401) 2024-04-04T09:30:03.496 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:30:03.508 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:30:03.508 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:30:03.881 INFO:teuthology.orchestra.run.smithi072.stdout:generic/401 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:30:03.891 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/401 2024-04-04T09:30:03.891 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/401 2024-04-04T09:30:03.891 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:30:03.899 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:30:03.925 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:30:03.926 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/402) 2024-04-04T09:30:04.463 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:30:04.475 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:30:04.475 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:30:04.884 INFO:teuthology.orchestra.run.smithi072.stdout:generic/402 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:30:04.895 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/402 2024-04-04T09:30:04.896 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/402 2024-04-04T09:30:04.896 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:30:04.906 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:30:04.933 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:30:04.933 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/403) 2024-04-04T09:30:05.440 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:30:05.453 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:30:05.453 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:30:05.849 INFO:teuthology.orchestra.run.smithi072.stdout:generic/403 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:30:05.859 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/403 2024-04-04T09:30:05.859 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/403 2024-04-04T09:30:05.859 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:30:05.867 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:30:05.893 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:30:05.893 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/404) 2024-04-04T09:30:06.391 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:30:06.402 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:30:06.403 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:30:08.699 INFO:teuthology.orchestra.run.smithi072.stdout:generic/404 [not run] xfs_io finsert failed (old kernel/wrong fs?) 2024-04-04T09:30:08.708 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/404 2024-04-04T09:30:08.708 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/404 2024-04-04T09:30:08.708 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:30:08.716 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:30:08.746 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:30:08.746 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/405) 2024-04-04T09:30:09.569 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:30:09.579 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:30:09.580 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:30:10.259 INFO:teuthology.orchestra.run.smithi072.stdout:generic/405 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:30:10.272 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/405 2024-04-04T09:30:10.272 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/405 2024-04-04T09:30:10.272 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:30:10.282 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:30:10.312 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:30:10.313 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/406) 2024-04-04T09:30:10.784 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:30:10.795 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:30:10.796 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:30:11.154 INFO:teuthology.orchestra.run.smithi072.stdout:generic/406 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:30:11.165 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/406 2024-04-04T09:30:11.165 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/406 2024-04-04T09:30:11.165 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:30:11.174 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:30:11.200 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:30:11.201 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/407) 2024-04-04T09:30:11.740 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:30:11.751 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:30:11.751 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:30:12.327 INFO:teuthology.orchestra.run.smithi072.stdout:generic/407 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-04-04T09:30:12.337 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/407 2024-04-04T09:30:12.337 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/407 2024-04-04T09:30:12.337 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:30:12.345 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:30:12.371 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:30:12.372 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/408) 2024-04-04T09:30:13.205 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:30:13.215 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:30:13.215 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:30:13.798 INFO:teuthology.orchestra.run.smithi072.stdout:generic/408 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2024-04-04T09:30:13.807 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/408 2024-04-04T09:30:13.807 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/408 2024-04-04T09:30:13.807 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:30:13.813 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:30:13.837 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:30:13.837 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/409) 2024-04-04T09:30:14.597 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:30:14.607 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:30:14.607 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:30:14.990 INFO:teuthology.orchestra.run.smithi072.stdout:generic/409 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:30:15.000 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/409 2024-04-04T09:30:15.000 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/409 2024-04-04T09:30:15.000 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:30:15.008 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:30:15.031 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:30:15.031 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/410) 2024-04-04T09:30:15.511 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:30:15.523 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:30:15.523 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:30:15.909 INFO:teuthology.orchestra.run.smithi072.stdout:generic/410 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:30:15.920 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/410 2024-04-04T09:30:15.920 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/410 2024-04-04T09:30:15.920 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:30:15.928 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:30:15.953 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:30:15.953 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/411) 2024-04-04T09:30:16.433 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:30:16.444 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:30:16.444 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:30:16.791 INFO:teuthology.orchestra.run.smithi072.stdout:generic/411 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:30:16.801 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/411 2024-04-04T09:30:16.801 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/411 2024-04-04T09:30:16.801 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:30:16.810 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:30:16.833 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:30:16.833 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/412) 2024-04-04T09:30:17.357 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:30:17.368 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:30:17.368 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:30:17.735 INFO:teuthology.orchestra.run.smithi072.stdout:generic/412 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:30:17.744 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/412 2024-04-04T09:30:17.744 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/412 2024-04-04T09:30:17.745 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:30:17.752 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:30:17.775 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:30:17.775 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/413) 2024-04-04T09:30:18.247 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:30:18.259 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:30:18.259 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:30:18.646 INFO:teuthology.orchestra.run.smithi072.stdout:generic/413 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:30:18.656 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/413 2024-04-04T09:30:18.656 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/413 2024-04-04T09:30:18.656 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:30:18.664 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:30:18.690 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:30:18.690 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/414) 2024-04-04T09:30:19.182 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:30:19.193 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:30:19.193 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:30:19.587 INFO:teuthology.orchestra.run.smithi072.stdout:generic/414 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:30:19.597 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/414 2024-04-04T09:30:19.597 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/414 2024-04-04T09:30:19.597 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:30:19.605 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:30:19.631 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:30:19.631 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/415) 2024-04-04T09:30:20.098 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:30:20.110 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:30:20.110 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:30:20.472 INFO:teuthology.orchestra.run.smithi072.stdout:generic/415 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:30:20.483 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/415 2024-04-04T09:30:20.484 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/415 2024-04-04T09:30:20.484 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:30:20.494 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:30:20.519 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:30:20.519 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/416) 2024-04-04T09:30:21.010 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:30:21.022 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:30:21.023 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:30:21.390 INFO:teuthology.orchestra.run.smithi072.stdout:generic/416 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:30:21.399 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/416 2024-04-04T09:30:21.399 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/416 2024-04-04T09:30:21.399 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:30:21.406 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:30:21.432 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:30:21.432 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/417) 2024-04-04T09:30:21.955 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:30:21.968 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:30:21.968 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:30:22.378 INFO:teuthology.orchestra.run.smithi072.stdout:generic/417 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:30:22.389 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/417 2024-04-04T09:30:22.389 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/417 2024-04-04T09:30:22.389 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:30:22.397 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:30:22.424 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:30:22.424 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/418) 2024-04-04T09:30:22.960 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:30:22.970 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:30:22.971 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:30:23.505 INFO:teuthology.orchestra.run.smithi072.stdout:generic/418 [not run] require ceph-fuse to be valid block disk 2024-04-04T09:30:23.517 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/418 2024-04-04T09:30:23.517 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/418 2024-04-04T09:30:23.517 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:30:23.526 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:30:23.551 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:30:23.551 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/419) 2024-04-04T09:30:24.071 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:30:24.082 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:30:24.083 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:30:24.542 INFO:teuthology.orchestra.run.smithi072.stdout:generic/419 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:30:24.551 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/419 2024-04-04T09:30:24.552 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/419 2024-04-04T09:30:24.552 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:30:24.559 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:30:24.584 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:30:24.584 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/420) 2024-04-04T09:30:25.040 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:30:25.051 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:30:25.051 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:30:28.169 INFO:teuthology.orchestra.run.smithi072.stdout:generic/420 3s 2024-04-04T09:30:28.186 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/420 2024-04-04T09:30:28.186 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:30:28.194 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:30:28.218 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:30:28.219 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/421) 2024-04-04T09:30:28.984 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:30:28.995 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:30:28.995 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:30:29.440 INFO:teuthology.orchestra.run.smithi072.stdout:generic/421 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:30:29.453 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/421 2024-04-04T09:30:29.453 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/421 2024-04-04T09:30:29.454 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:30:29.465 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:30:29.492 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:30:29.492 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/422) 2024-04-04T09:30:29.959 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:30:29.969 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:30:29.970 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:30:30.333 INFO:teuthology.orchestra.run.smithi072.stdout:generic/422 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:30:30.343 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/422 2024-04-04T09:30:30.343 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/422 2024-04-04T09:30:30.343 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:30:30.351 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:30:30.376 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:30:30.376 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/423) 2024-04-04T09:30:30.839 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:30:30.851 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:30:30.851 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:30:32.842 INFO:teuthology.orchestra.run.smithi072.stdout:generic/423 2s 2024-04-04T09:30:32.861 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/423 2024-04-04T09:30:32.862 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:30:32.870 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:30:32.902 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:30:32.902 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/424) 2024-04-04T09:30:33.708 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:30:33.718 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:30:33.718 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:30:34.176 INFO:teuthology.orchestra.run.smithi072.stdout:generic/424 [not run] file system doesn't support any of /bin/chattr +a/+c/+d/+i 2024-04-04T09:30:34.189 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/424 2024-04-04T09:30:34.189 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/424 2024-04-04T09:30:34.190 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:30:34.194 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:30:34.222 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:30:34.223 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/425) 2024-04-04T09:30:34.666 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:30:34.679 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:30:34.679 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:30:35.078 INFO:teuthology.orchestra.run.smithi072.stdout:generic/425 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:30:35.088 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/425 2024-04-04T09:30:35.088 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/425 2024-04-04T09:30:35.088 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:30:35.095 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:30:35.121 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:30:35.122 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/426) 2024-04-04T09:30:35.597 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:30:35.609 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:30:35.609 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:32:02.660 INFO:teuthology.orchestra.run.smithi072.stdout:generic/426 87s 2024-04-04T09:32:03.037 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/426 2024-04-04T09:32:03.037 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:32:03.063 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:32:03.535 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:32:03.535 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/427) 2024-04-04T09:32:07.843 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:32:07.854 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:32:07.854 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:32:08.474 INFO:teuthology.orchestra.run.smithi072.stdout:generic/427 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:32:08.483 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/427 2024-04-04T09:32:08.484 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/427 2024-04-04T09:32:08.484 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:32:08.490 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:32:08.515 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:32:08.516 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/428) 2024-04-04T09:32:09.063 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:32:09.074 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:32:09.074 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:32:09.741 INFO:teuthology.orchestra.run.smithi072.stdout:generic/428 0s 2024-04-04T09:32:09.763 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/428 2024-04-04T09:32:09.763 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:32:09.773 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:32:09.801 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:32:09.802 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/429) 2024-04-04T09:32:10.369 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:32:10.380 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:32:10.380 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:32:10.864 INFO:teuthology.orchestra.run.smithi072.stdout:generic/429 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:32:10.874 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/429 2024-04-04T09:32:10.874 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/429 2024-04-04T09:32:10.874 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:32:10.882 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:32:10.910 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:32:10.910 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/430) 2024-04-04T09:32:11.413 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:32:11.424 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:32:11.424 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:32:12.287 INFO:teuthology.orchestra.run.smithi072.stdout:generic/430 1s 2024-04-04T09:32:12.306 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/430 2024-04-04T09:32:12.306 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:32:12.316 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:32:12.344 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:32:12.344 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/431) 2024-04-04T09:32:13.099 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:32:13.113 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:32:13.114 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:32:13.750 INFO:teuthology.orchestra.run.smithi072.stdout:generic/431 0s 2024-04-04T09:32:13.763 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/431 2024-04-04T09:32:13.763 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:32:13.769 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:32:13.792 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:32:13.793 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/432) 2024-04-04T09:32:14.514 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:32:14.526 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:32:14.526 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:32:15.223 INFO:teuthology.orchestra.run.smithi072.stdout:generic/432 1s 2024-04-04T09:32:15.239 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/432 2024-04-04T09:32:15.239 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:32:15.248 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:32:15.278 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:32:15.279 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/433) 2024-04-04T09:32:16.010 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:32:16.021 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:32:16.021 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:32:16.633 INFO:teuthology.orchestra.run.smithi072.stdout:generic/433 0s 2024-04-04T09:32:16.650 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/433 2024-04-04T09:32:16.650 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:32:16.658 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:32:16.684 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:32:16.684 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/434) 2024-04-04T09:32:17.439 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:32:17.449 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:32:17.449 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:32:18.043 INFO:teuthology.orchestra.run.smithi072.stdout:generic/434 - output mismatch (see /tmp/tmp.tiFz9P8iUAxfstests-dev/results//generic/434.out.bad) 2024-04-04T09:32:18.050 INFO:teuthology.orchestra.run.smithi072.stdout: --- tests/generic/434.out 2024-04-04 06:58:02.231453165 +0000 2024-04-04T09:32:18.050 INFO:teuthology.orchestra.run.smithi072.stdout: +++ /tmp/tmp.tiFz9P8iUAxfstests-dev/results//generic/434.out.bad 2024-04-04 09:32:18.041076799 +0000 2024-04-04T09:32:18.050 INFO:teuthology.orchestra.run.smithi072.stdout: @@ -9,6 +9,6 @@ 2024-04-04T09:32:18.050 INFO:teuthology.orchestra.run.smithi072.stdout: copy_range: Bad file descriptor 2024-04-04T09:32:18.050 INFO:teuthology.orchestra.run.smithi072.stdout: d41d8cd98f00b204e9800998ecf8427e TEST_DIR/test-434/copy 2024-04-04T09:32:18.050 INFO:teuthology.orchestra.run.smithi072.stdout: Try to copy to a device 2024-04-04T09:32:18.050 INFO:teuthology.orchestra.run.smithi072.stdout: -copy_range: Invalid argument 2024-04-04T09:32:18.050 INFO:teuthology.orchestra.run.smithi072.stdout: +/tmp/tmp.LqGJQhujaOtest/test-434/dev1: Permission denied 2024-04-04T09:32:18.050 INFO:teuthology.orchestra.run.smithi072.stdout: Try to copy to a fifo 2024-04-04T09:32:18.050 INFO:teuthology.orchestra.run.smithi072.stdout: copy_range: Invalid argument 2024-04-04T09:32:18.055 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/434 2024-04-04T09:32:18.056 INFO:teuthology.orchestra.run.smithi072.stdout:Failures: generic/434 2024-04-04T09:32:18.056 INFO:teuthology.orchestra.run.smithi072.stdout:Failed 1 of 1 tests 2024-04-04T09:32:18.063 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:32:18.089 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-04T09:32:18.089 INFO:tasks.cephfs.xfstests_dev:Command failed 2024-04-04T09:32:18.089 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2024-04-04T09:32:18.090 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/435) 2024-04-04T09:32:18.811 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:32:18.822 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:32:18.822 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:32:19.273 INFO:teuthology.orchestra.run.smithi072.stdout:generic/435 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:32:19.286 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/435 2024-04-04T09:32:19.286 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/435 2024-04-04T09:32:19.287 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:32:19.298 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:32:19.324 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:32:19.324 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/436) 2024-04-04T09:32:19.817 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:32:19.830 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:32:19.830 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:32:22.337 INFO:teuthology.orchestra.run.smithi072.stdout:generic/436 3s 2024-04-04T09:32:22.354 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/436 2024-04-04T09:32:22.355 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:32:22.363 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:32:22.391 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:32:22.391 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/437) 2024-04-04T09:32:23.137 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:32:23.148 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:32:23.148 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:32:24.381 INFO:teuthology.orchestra.run.smithi072.stdout:generic/437 1s 2024-04-04T09:32:24.397 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/437 2024-04-04T09:32:24.397 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:32:24.406 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:32:24.434 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:32:24.434 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/438) 2024-04-04T09:32:24.927 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:32:24.938 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:32:24.938 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:32:39.750 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T09:32:39.755 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T09:33:09.967 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T09:33:09.973 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T09:33:40.188 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T09:33:40.193 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T09:33:40.304 INFO:tasks.ceph.osd.5.smithi117.stderr:2024-04-04T09:33:40.304+0000 7f144e000640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 49007) UID: 0 2024-04-04T09:33:40.304 INFO:tasks.ceph.osd.4.smithi117.stderr:2024-04-04T09:33:40.304+0000 7f248de00640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 49007) UID: 0 2024-04-04T09:33:40.304 INFO:tasks.ceph.osd.6.smithi117.stderr:2024-04-04T09:33:40.304+0000 7fb935800640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 49007) UID: 0 2024-04-04T09:33:40.305 INFO:tasks.ceph.osd.7.smithi117.stderr:2024-04-04T09:33:40.304+0000 7f3028600640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 49007) UID: 0 2024-04-04T09:34:57.845 INFO:teuthology.orchestra.run.smithi072.stdout:generic/438 153s 2024-04-04T09:34:57.857 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/438 2024-04-04T09:34:57.857 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:34:57.865 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:34:57.890 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:34:57.890 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/439) 2024-04-04T09:34:58.391 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:34:58.402 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:34:58.402 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:34:58.778 INFO:teuthology.orchestra.run.smithi072.stdout:generic/439 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:34:58.787 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/439 2024-04-04T09:34:58.788 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/439 2024-04-04T09:34:58.788 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:34:58.797 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:34:58.823 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:34:58.823 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/440) 2024-04-04T09:34:59.314 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:34:59.325 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:34:59.325 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:34:59.827 INFO:teuthology.orchestra.run.smithi072.stdout:generic/440 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:34:59.837 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/440 2024-04-04T09:34:59.837 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/440 2024-04-04T09:34:59.837 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:34:59.845 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:34:59.873 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:34:59.873 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/441) 2024-04-04T09:35:00.388 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:35:00.399 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:35:00.400 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:35:00.878 INFO:teuthology.orchestra.run.smithi072.stdout:generic/441 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:35:00.889 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/441 2024-04-04T09:35:00.889 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/441 2024-04-04T09:35:00.889 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:35:00.899 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:35:00.929 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:35:00.929 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/442) 2024-04-04T09:35:01.432 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:35:01.444 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:35:01.444 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:35:01.893 INFO:teuthology.orchestra.run.smithi072.stdout:generic/442 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:35:01.905 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/442 2024-04-04T09:35:01.905 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/442 2024-04-04T09:35:01.905 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:35:01.913 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:35:01.940 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:35:01.940 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/443) 2024-04-04T09:35:02.438 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:35:02.450 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:35:02.450 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:35:02.952 INFO:teuthology.orchestra.run.smithi072.stdout:generic/443 0s 2024-04-04T09:35:02.970 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/443 2024-04-04T09:35:02.970 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:35:02.979 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:35:03.008 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:35:03.009 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/444) 2024-04-04T09:35:03.502 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:35:03.514 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:35:03.515 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:35:03.954 INFO:teuthology.orchestra.run.smithi072.stdout:generic/444 [not run] ACLs not supported by this filesystem type: ceph-fuse 2024-04-04T09:35:03.963 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/444 2024-04-04T09:35:03.963 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/444 2024-04-04T09:35:03.963 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:35:03.971 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:35:03.996 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:35:03.996 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/445) 2024-04-04T09:35:04.501 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:35:04.512 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:35:04.512 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:35:06.231 INFO:teuthology.orchestra.run.smithi072.stdout:generic/445 2s 2024-04-04T09:35:06.244 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/445 2024-04-04T09:35:06.244 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:35:06.251 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:35:06.280 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:35:06.281 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/446) 2024-04-04T09:35:07.044 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:35:07.055 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:35:07.055 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:35:07.403 INFO:teuthology.orchestra.run.smithi072.stdout:generic/446 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:35:07.414 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/446 2024-04-04T09:35:07.414 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/446 2024-04-04T09:35:07.414 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:35:07.422 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:35:07.447 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:35:07.447 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/447) 2024-04-04T09:35:07.938 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:35:07.948 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:35:07.948 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:35:08.299 INFO:teuthology.orchestra.run.smithi072.stdout:generic/447 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:35:08.313 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/447 2024-04-04T09:35:08.313 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/447 2024-04-04T09:35:08.313 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:35:08.323 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:35:08.351 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:35:08.351 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/448) 2024-04-04T09:35:08.853 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:35:08.866 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:35:08.867 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:35:10.724 INFO:teuthology.orchestra.run.smithi072.stdout:generic/448 2s 2024-04-04T09:35:10.745 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/448 2024-04-04T09:35:10.745 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:35:10.754 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:35:10.792 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:35:10.792 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/449) 2024-04-04T09:35:11.539 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:35:11.550 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:35:11.550 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:35:11.907 INFO:teuthology.orchestra.run.smithi072.stdout:generic/449 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:35:11.915 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/449 2024-04-04T09:35:11.915 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/449 2024-04-04T09:35:11.916 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:35:11.923 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:35:11.951 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:35:11.951 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/450) 2024-04-04T09:35:12.468 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:35:12.481 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:35:12.481 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:35:15.552 INFO:teuthology.orchestra.run.smithi072.stdout:generic/450 3s 2024-04-04T09:35:15.571 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/450 2024-04-04T09:35:15.571 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:35:15.580 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:35:15.620 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:35:15.620 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/451) 2024-04-04T09:35:16.379 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:35:16.390 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:35:16.390 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:35:17.080 INFO:teuthology.orchestra.run.smithi072.stdout:generic/451 - output mismatch (see /tmp/tmp.tiFz9P8iUAxfstests-dev/results//generic/451.out.bad) 2024-04-04T09:35:17.088 INFO:teuthology.orchestra.run.smithi072.stdout: --- tests/generic/451.out 2024-04-04 06:58:02.236453061 +0000 2024-04-04T09:35:17.088 INFO:teuthology.orchestra.run.smithi072.stdout: +++ /tmp/tmp.tiFz9P8iUAxfstests-dev/results//generic/451.out.bad 2024-04-04 09:35:17.078529660 +0000 2024-04-04T09:35:17.088 INFO:teuthology.orchestra.run.smithi072.stdout: @@ -1,2 +1,5 @@ 2024-04-04T09:35:17.088 INFO:teuthology.orchestra.run.smithi072.stdout: QA output created by 451 2024-04-04T09:35:17.088 INFO:teuthology.orchestra.run.smithi072.stdout: +get stale data from buffer read 2024-04-04T09:35:17.088 INFO:teuthology.orchestra.run.smithi072.stdout: +00000000 55 55 55 55 55 55 55 55 55 55 55 55 55 55 55 55 UUUUUUUUUUUUUUUU 2024-04-04T09:35:17.088 INFO:teuthology.orchestra.run.smithi072.stdout: +000a0000 2024-04-04T09:35:17.088 INFO:teuthology.orchestra.run.smithi072.stdout: Silence is golden 2024-04-04T09:35:17.095 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/451 2024-04-04T09:35:17.095 INFO:teuthology.orchestra.run.smithi072.stdout:Failures: generic/451 2024-04-04T09:35:17.095 INFO:teuthology.orchestra.run.smithi072.stdout:Failed 1 of 1 tests 2024-04-04T09:35:17.102 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:35:17.125 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-04T09:35:17.125 INFO:tasks.cephfs.xfstests_dev:Command failed 2024-04-04T09:35:17.126 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2024-04-04T09:35:17.126 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/452) 2024-04-04T09:35:17.881 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:35:17.905 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:35:17.905 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:35:18.250 INFO:teuthology.orchestra.run.smithi072.stdout:generic/452 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:35:18.261 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/452 2024-04-04T09:35:18.261 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/452 2024-04-04T09:35:18.261 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:35:18.269 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:35:18.294 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:35:18.295 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/453) 2024-04-04T09:35:18.798 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:35:18.809 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:35:18.809 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:35:19.206 INFO:teuthology.orchestra.run.smithi072.stdout:generic/453 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:35:19.216 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/453 2024-04-04T09:35:19.216 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/453 2024-04-04T09:35:19.216 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:35:19.227 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:35:19.256 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:35:19.256 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/454) 2024-04-04T09:35:19.786 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:35:19.798 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:35:19.798 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:35:20.152 INFO:teuthology.orchestra.run.smithi072.stdout:generic/454 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:35:20.165 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/454 2024-04-04T09:35:20.165 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/454 2024-04-04T09:35:20.165 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:35:20.175 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:35:20.204 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:35:20.204 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/455) 2024-04-04T09:35:20.726 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:35:20.737 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:35:20.737 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:35:21.697 INFO:teuthology.orchestra.run.smithi072.stdout:generic/455 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:35:21.708 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/455 2024-04-04T09:35:21.708 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/455 2024-04-04T09:35:21.708 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:35:21.720 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:35:21.746 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:35:21.746 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/456) 2024-04-04T09:35:22.289 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:35:22.300 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:35:22.300 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:35:22.721 INFO:teuthology.orchestra.run.smithi072.stdout:generic/456 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:35:22.732 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/456 2024-04-04T09:35:22.732 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/456 2024-04-04T09:35:22.732 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:35:22.740 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:35:22.764 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:35:22.764 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/457) 2024-04-04T09:35:23.272 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:35:23.284 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:35:23.284 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:35:23.809 INFO:teuthology.orchestra.run.smithi072.stdout:generic/457 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:35:23.822 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/457 2024-04-04T09:35:23.822 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/457 2024-04-04T09:35:23.823 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:35:23.833 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:35:23.867 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:35:23.868 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/458) 2024-04-04T09:35:24.364 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:35:24.375 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:35:24.375 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:35:24.746 INFO:teuthology.orchestra.run.smithi072.stdout:generic/458 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:35:24.759 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/458 2024-04-04T09:35:24.759 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/458 2024-04-04T09:35:24.759 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:35:24.769 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:35:24.795 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:35:24.795 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/459) 2024-04-04T09:35:25.281 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:35:25.293 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:35:25.294 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:35:25.924 INFO:teuthology.orchestra.run.smithi072.stdout:generic/459 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:35:25.937 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/459 2024-04-04T09:35:25.938 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/459 2024-04-04T09:35:25.938 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:35:25.949 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:35:25.978 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:35:25.978 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/460) 2024-04-04T09:35:26.496 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:35:26.506 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:35:26.507 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:35:26.939 INFO:teuthology.orchestra.run.smithi072.stdout:generic/460 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:35:26.950 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/460 2024-04-04T09:35:26.950 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/460 2024-04-04T09:35:26.950 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:35:26.958 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:35:26.986 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:35:26.986 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/461) 2024-04-04T09:35:27.475 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:35:27.486 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:35:27.487 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:35:27.881 INFO:teuthology.orchestra.run.smithi072.stdout:generic/461 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:35:27.892 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/461 2024-04-04T09:35:27.892 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/461 2024-04-04T09:35:27.892 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:35:27.902 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:35:27.933 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:35:27.933 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/462) 2024-04-04T09:35:28.437 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:35:28.450 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:35:28.450 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:35:28.834 INFO:teuthology.orchestra.run.smithi072.stdout:generic/462 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:35:28.846 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/462 2024-04-04T09:35:28.847 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/462 2024-04-04T09:35:28.847 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:35:28.856 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:35:28.886 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:35:28.887 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/463) 2024-04-04T09:35:29.419 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:35:29.432 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:35:29.432 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:35:29.968 INFO:teuthology.orchestra.run.smithi072.stdout:generic/463 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-04-04T09:35:29.979 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/463 2024-04-04T09:35:29.980 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/463 2024-04-04T09:35:29.980 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:35:29.989 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:35:30.035 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:35:30.035 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/464) 2024-04-04T09:35:30.759 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:35:30.769 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:35:30.769 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:35:31.121 INFO:teuthology.orchestra.run.smithi072.stdout:generic/464 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:35:31.132 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/464 2024-04-04T09:35:31.132 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/464 2024-04-04T09:35:31.132 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:35:31.141 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:35:31.169 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:35:31.169 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/465) 2024-04-04T09:35:31.629 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:35:31.640 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:35:31.640 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:35:58.957 INFO:teuthology.orchestra.run.smithi072.stdout:generic/465 27s 2024-04-04T09:35:58.995 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/465 2024-04-04T09:35:58.997 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:35:59.019 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:35:59.074 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:35:59.074 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/466) 2024-04-04T09:35:59.711 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:35:59.722 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:35:59.722 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:36:00.090 INFO:teuthology.orchestra.run.smithi072.stdout:generic/466 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:36:00.100 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/466 2024-04-04T09:36:00.100 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/466 2024-04-04T09:36:00.100 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:36:00.109 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:36:00.137 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:36:00.138 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/467) 2024-04-04T09:36:00.644 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:36:00.657 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:36:00.657 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:36:05.301 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T09:36:05.310 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T09:36:14.073 INFO:teuthology.orchestra.run.smithi072.stdout:generic/467 - output mismatch (see /tmp/tmp.tiFz9P8iUAxfstests-dev/results//generic/467.out.bad) 2024-04-04T09:36:14.095 INFO:teuthology.orchestra.run.smithi072.stdout: --- tests/generic/467.out 2024-04-04 06:58:02.240452977 +0000 2024-04-04T09:36:14.095 INFO:teuthology.orchestra.run.smithi072.stdout: +++ /tmp/tmp.tiFz9P8iUAxfstests-dev/results//generic/467.out.bad 2024-04-04 09:36:14.028411570 +0000 2024-04-04T09:36:14.096 INFO:teuthology.orchestra.run.smithi072.stdout: @@ -1,5 +1,15 @@ 2024-04-04T09:36:14.096 INFO:teuthology.orchestra.run.smithi072.stdout: QA output created by 467 2024-04-04T09:36:14.096 INFO:teuthology.orchestra.run.smithi072.stdout: test_file_handles TEST_DIR/467-dir -dp 2024-04-04T09:36:14.096 INFO:teuthology.orchestra.run.smithi072.stdout: +open_by_handle(/tmp/tmp.LqGJQhujaOtest/467-dir/file000000) opened an unlinked file! 2024-04-04T09:36:14.096 INFO:teuthology.orchestra.run.smithi072.stdout: +open_by_handle(/tmp/tmp.LqGJQhujaOtest/467-dir/file000001) opened an unlinked file! 2024-04-04T09:36:14.096 INFO:teuthology.orchestra.run.smithi072.stdout: +open_by_handle(/tmp/tmp.LqGJQhujaOtest/467-dir/file000002) opened an unlinked file! 2024-04-04T09:36:14.096 INFO:teuthology.orchestra.run.smithi072.stdout: +open_by_handle(/tmp/tmp.LqGJQhujaOtest/467-dir/file000003) opened an unlinked file! 2024-04-04T09:36:14.096 INFO:teuthology.orchestra.run.smithi072.stdout: +open_by_handle(/tmp/tmp.LqGJQhujaOtest/467-dir/file000004) opened an unlinked file! 2024-04-04T09:36:14.096 INFO:teuthology.orchestra.run.smithi072.stdout: +open_by_handle(/tmp/tmp.LqGJQhujaOtest/467-dir/file000005) opened an unlinked file! 2024-04-04T09:36:14.096 INFO:teuthology.orchestra.run.smithi072.stdout: +open_by_handle(/tmp/tmp.LqGJQhujaOtest/467-dir/file000006) opened an unlinked file! 2024-04-04T09:36:14.096 INFO:teuthology.orchestra.run.smithi072.stdout: +open_by_handle(/tmp/tmp.LqGJQhujaOtest/467-dir/file000007) opened an unlinked file! 2024-04-04T09:36:14.096 INFO:teuthology.orchestra.run.smithi072.stdout: +open_by_handle(/tmp/tmp.LqGJQhujaOtest/467-dir/file000008) opened an unlinked file! 2024-04-04T09:36:14.096 INFO:teuthology.orchestra.run.smithi072.stdout: +open_by_handle(/tmp/tmp.LqGJQhujaOtest/467-dir/file000009) opened an unlinked file! 2024-04-04T09:36:14.096 INFO:teuthology.orchestra.run.smithi072.stdout: test_file_handles TEST_DIR/467-dir -rp 2024-04-04T09:36:14.096 INFO:teuthology.orchestra.run.smithi072.stdout: test_file_handles TEST_DIR/467-dir -dkr 2024-04-04T09:36:14.097 INFO:teuthology.orchestra.run.smithi072.stdout: test_file_handles TEST_DIR/467-dir -lr 2024-04-04T09:36:14.125 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/467 2024-04-04T09:36:14.125 INFO:teuthology.orchestra.run.smithi072.stdout:Failures: generic/467 2024-04-04T09:36:14.125 INFO:teuthology.orchestra.run.smithi072.stdout:Failed 1 of 1 tests 2024-04-04T09:36:14.182 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:36:14.538 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-04T09:36:14.538 INFO:tasks.cephfs.xfstests_dev:Command failed 2024-04-04T09:36:14.539 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2024-04-04T09:36:14.539 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/468) 2024-04-04T09:36:16.462 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:36:16.477 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:36:16.477 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:36:16.951 INFO:teuthology.orchestra.run.smithi072.stdout:generic/468 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:36:16.961 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/468 2024-04-04T09:36:16.961 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/468 2024-04-04T09:36:16.961 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:36:16.969 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:36:16.994 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:36:16.994 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/469) 2024-04-04T09:36:17.519 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:36:17.531 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:36:17.531 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:36:24.647 INFO:teuthology.orchestra.run.smithi072.stdout:generic/469 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2024-04-04T09:36:24.663 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/469 2024-04-04T09:36:24.664 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/469 2024-04-04T09:36:24.664 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:36:24.675 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:36:24.716 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:36:24.716 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/470) 2024-04-04T09:36:25.443 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:36:25.454 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:36:25.454 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:36:25.946 INFO:teuthology.orchestra.run.smithi072.stdout:generic/470 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:36:25.958 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/470 2024-04-04T09:36:25.958 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/470 2024-04-04T09:36:25.958 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:36:25.969 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:36:25.997 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:36:25.997 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/471) 2024-04-04T09:36:26.480 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:36:26.491 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:36:26.492 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:36:39.285 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T09:36:39.293 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T09:37:09.656 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T09:37:09.665 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T09:37:39.809 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T09:37:39.814 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T09:38:10.008 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T09:38:10.013 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T09:38:10.121 INFO:tasks.ceph.mds.a.smithi072.stderr:2024-04-04T09:38:10.122+0000 7fa395800640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 398763) UID: 0 2024-04-04T09:38:10.122 INFO:tasks.ceph.mds.c.smithi072.stderr:2024-04-04T09:38:10.122+0000 7fc131e00640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 398763) UID: 0 2024-04-04T09:38:22.924 INFO:teuthology.orchestra.run.smithi072.stdout:generic/471 115s 2024-04-04T09:38:25.495 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/471 2024-04-04T09:38:25.495 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:38:26.775 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:38:26.822 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:38:26.823 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/472) 2024-04-04T09:38:27.574 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:38:27.588 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:38:27.588 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:38:30.614 INFO:teuthology.orchestra.run.smithi072.stdout:generic/472 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:38:30.627 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/472 2024-04-04T09:38:30.627 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/472 2024-04-04T09:38:30.627 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:38:30.636 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:38:30.663 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:38:30.663 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/473) 2024-04-04T09:38:31.115 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:38:31.126 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:38:31.126 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:38:35.193 INFO:teuthology.orchestra.run.smithi072.stdout:generic/473 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-04-04T09:38:35.203 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/473 2024-04-04T09:38:35.204 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/473 2024-04-04T09:38:35.204 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:38:35.212 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:38:35.240 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:38:35.240 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/474) 2024-04-04T09:38:35.686 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:38:35.697 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:38:35.697 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:38:36.087 INFO:teuthology.orchestra.run.smithi072.stdout:generic/474 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:38:36.097 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/474 2024-04-04T09:38:36.097 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/474 2024-04-04T09:38:36.097 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:38:36.105 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:38:36.132 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:38:36.133 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/475) 2024-04-04T09:38:36.647 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:38:36.657 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:38:36.657 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:38:37.122 INFO:teuthology.orchestra.run.smithi072.stdout:generic/475 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:38:37.135 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/475 2024-04-04T09:38:37.135 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/475 2024-04-04T09:38:37.135 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:38:37.147 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:38:37.172 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:38:37.172 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/476) 2024-04-04T09:38:37.649 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:38:37.660 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:38:37.660 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:38:38.015 INFO:teuthology.orchestra.run.smithi072.stdout:generic/476 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:38:38.023 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/476 2024-04-04T09:38:38.023 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/476 2024-04-04T09:38:38.023 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:38:38.030 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:38:38.052 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:38:38.053 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/477) 2024-04-04T09:38:38.549 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:38:38.560 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:38:38.560 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:38:59.446 INFO:teuthology.orchestra.run.smithi072.stdout:generic/477 20s 2024-04-04T09:38:59.782 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/477 2024-04-04T09:38:59.782 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:38:59.805 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:39:00.017 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:39:00.017 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/478) 2024-04-04T09:39:04.020 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:39:04.033 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:39:04.033 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:39:16.227 INFO:teuthology.orchestra.run.smithi072.stdout:generic/478 - output mismatch (see /tmp/tmp.tiFz9P8iUAxfstests-dev/results//generic/478.out.bad) 2024-04-04T09:39:16.235 INFO:teuthology.orchestra.run.smithi072.stdout: --- tests/generic/478.out 2024-04-04 06:58:02.243452914 +0000 2024-04-04T09:39:16.235 INFO:teuthology.orchestra.run.smithi072.stdout: +++ /tmp/tmp.tiFz9P8iUAxfstests-dev/results//generic/478.out.bad 2024-04-04 09:39:16.208807333 +0000 2024-04-04T09:39:16.235 INFO:teuthology.orchestra.run.smithi072.stdout: @@ -10,7 +10,7 @@ 2024-04-04T09:39:16.236 INFO:teuthology.orchestra.run.smithi072.stdout: lock could be placed 2024-04-04T09:39:16.236 INFO:teuthology.orchestra.run.smithi072.stdout: get wrlck 2024-04-04T09:39:16.236 INFO:teuthology.orchestra.run.smithi072.stdout: lock could be placed 2024-04-04T09:39:16.236 INFO:teuthology.orchestra.run.smithi072.stdout: -lock could be placed 2024-04-04T09:39:16.236 INFO:teuthology.orchestra.run.smithi072.stdout: +get wrlck 2024-04-04T09:39:16.236 INFO:teuthology.orchestra.run.smithi072.stdout: lock could be placed 2024-04-04T09:39:16.236 INFO:teuthology.orchestra.run.smithi072.stdout: lock could be placed 2024-04-04T09:39:16.236 INFO:teuthology.orchestra.run.smithi072.stdout: lock could be placed 2024-04-04T09:39:16.236 INFO:teuthology.orchestra.run.smithi072.stdout: @@ -25,7 +25,7 @@ 2024-04-04T09:39:16.236 INFO:teuthology.orchestra.run.smithi072.stdout: lock could be placed 2024-04-04T09:39:16.236 INFO:teuthology.orchestra.run.smithi072.stdout: get wrlck 2024-04-04T09:39:16.236 INFO:teuthology.orchestra.run.smithi072.stdout: lock could be placed 2024-04-04T09:39:16.236 INFO:teuthology.orchestra.run.smithi072.stdout: -lock could be placed 2024-04-04T09:39:16.237 INFO:teuthology.orchestra.run.smithi072.stdout: +get wrlck 2024-04-04T09:39:16.237 INFO:teuthology.orchestra.run.smithi072.stdout: lock could be placed 2024-04-04T09:39:16.237 INFO:teuthology.orchestra.run.smithi072.stdout: lock could be placed 2024-04-04T09:39:16.237 INFO:teuthology.orchestra.run.smithi072.stdout: lock could be placed 2024-04-04T09:39:16.237 INFO:teuthology.orchestra.run.smithi072.stdout: @@ -37,7 +37,7 @@ 2024-04-04T09:39:16.237 INFO:teuthology.orchestra.run.smithi072.stdout: get rdlck 2024-04-04T09:39:16.237 INFO:teuthology.orchestra.run.smithi072.stdout: get rdlck 2024-04-04T09:39:16.237 INFO:teuthology.orchestra.run.smithi072.stdout: lock could be placed 2024-04-04T09:39:16.237 INFO:teuthology.orchestra.run.smithi072.stdout: -lock could be placed 2024-04-04T09:39:16.237 INFO:teuthology.orchestra.run.smithi072.stdout: +get rdlck 2024-04-04T09:39:16.237 INFO:teuthology.orchestra.run.smithi072.stdout: get rdlck 2024-04-04T09:39:16.237 INFO:teuthology.orchestra.run.smithi072.stdout: lock could be placed 2024-04-04T09:39:16.237 INFO:teuthology.orchestra.run.smithi072.stdout: get rdlck 2024-04-04T09:39:16.238 INFO:teuthology.orchestra.run.smithi072.stdout: @@ -46,7 +46,7 @@ 2024-04-04T09:39:16.238 INFO:teuthology.orchestra.run.smithi072.stdout: get rdlck 2024-04-04T09:39:16.238 INFO:teuthology.orchestra.run.smithi072.stdout: get rdlck 2024-04-04T09:39:16.238 INFO:teuthology.orchestra.run.smithi072.stdout: lock could be placed 2024-04-04T09:39:16.238 INFO:teuthology.orchestra.run.smithi072.stdout: -lock could be placed 2024-04-04T09:39:16.238 INFO:teuthology.orchestra.run.smithi072.stdout: +get rdlck 2024-04-04T09:39:16.238 INFO:teuthology.orchestra.run.smithi072.stdout: lock could be placed 2024-04-04T09:39:16.238 INFO:teuthology.orchestra.run.smithi072.stdout: lock could be placed 2024-04-04T09:39:16.238 INFO:teuthology.orchestra.run.smithi072.stdout: lock could be placed 2024-04-04T09:39:16.243 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/478 2024-04-04T09:39:16.243 INFO:teuthology.orchestra.run.smithi072.stdout:Failures: generic/478 2024-04-04T09:39:16.243 INFO:teuthology.orchestra.run.smithi072.stdout:Failed 1 of 1 tests 2024-04-04T09:39:16.253 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:39:16.278 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-04T09:39:16.278 INFO:tasks.cephfs.xfstests_dev:Command failed 2024-04-04T09:39:16.279 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2024-04-04T09:39:16.279 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/479) 2024-04-04T09:39:16.763 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:39:16.774 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:39:16.774 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:39:17.411 INFO:teuthology.orchestra.run.smithi072.stdout:generic/479 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:39:17.422 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/479 2024-04-04T09:39:17.422 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/479 2024-04-04T09:39:17.423 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:39:17.431 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:39:17.462 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:39:17.462 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/480) 2024-04-04T09:39:17.952 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:39:17.963 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:39:17.963 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:39:18.394 INFO:teuthology.orchestra.run.smithi072.stdout:generic/480 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:39:18.405 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/480 2024-04-04T09:39:18.406 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/480 2024-04-04T09:39:18.406 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:39:18.416 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:39:18.443 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:39:18.443 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/481) 2024-04-04T09:39:18.912 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:39:18.923 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:39:18.923 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:39:19.292 INFO:teuthology.orchestra.run.smithi072.stdout:generic/481 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:39:19.301 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/481 2024-04-04T09:39:19.301 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/481 2024-04-04T09:39:19.302 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:39:19.309 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:39:19.335 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:39:19.335 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/482) 2024-04-04T09:39:19.850 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:39:19.861 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:39:19.861 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:39:20.414 INFO:teuthology.orchestra.run.smithi072.stdout:generic/482 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:39:20.425 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/482 2024-04-04T09:39:20.426 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/482 2024-04-04T09:39:20.426 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:39:20.436 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:39:20.464 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:39:20.464 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/483) 2024-04-04T09:39:20.937 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:39:20.948 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:39:20.948 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:39:21.353 INFO:teuthology.orchestra.run.smithi072.stdout:generic/483 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:39:21.366 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/483 2024-04-04T09:39:21.367 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/483 2024-04-04T09:39:21.367 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:39:21.376 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:39:21.401 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:39:21.401 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/484) 2024-04-04T09:39:21.897 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:39:21.907 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:39:21.908 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:39:22.718 INFO:teuthology.orchestra.run.smithi072.stdout:generic/484 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:39:22.730 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/484 2024-04-04T09:39:22.730 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/484 2024-04-04T09:39:22.730 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:39:22.740 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:39:22.766 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:39:22.766 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/485) 2024-04-04T09:39:23.275 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:39:23.286 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:39:23.286 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:39:25.696 INFO:teuthology.orchestra.run.smithi072.stdout:generic/485 [not run] xfs_io finsert failed (old kernel/wrong fs?) 2024-04-04T09:39:25.709 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/485 2024-04-04T09:39:25.709 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/485 2024-04-04T09:39:25.709 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:39:25.718 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:39:25.755 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:39:25.755 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/486) 2024-04-04T09:39:26.544 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:39:26.555 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:39:26.555 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:39:26.990 INFO:teuthology.orchestra.run.smithi072.stdout:generic/486 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:39:26.999 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/486 2024-04-04T09:39:26.999 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/486 2024-04-04T09:39:26.999 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:39:27.006 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:39:27.030 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:39:27.030 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/487) 2024-04-04T09:39:27.512 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:39:27.524 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:39:27.524 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:39:29.094 INFO:teuthology.orchestra.run.smithi072.stdout:generic/487 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:39:29.106 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/487 2024-04-04T09:39:29.107 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/487 2024-04-04T09:39:29.107 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:39:29.116 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:39:29.144 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:39:29.144 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/488) 2024-04-04T09:39:29.644 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:39:29.655 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:39:29.655 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:39:30.036 INFO:teuthology.orchestra.run.smithi072.stdout:generic/488 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:39:30.046 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/488 2024-04-04T09:39:30.046 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/488 2024-04-04T09:39:30.046 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:39:30.054 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:39:30.076 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:39:30.077 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/489) 2024-04-04T09:39:30.559 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:39:30.572 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:39:30.572 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:39:30.963 INFO:teuthology.orchestra.run.smithi072.stdout:generic/489 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:39:30.973 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/489 2024-04-04T09:39:30.973 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/489 2024-04-04T09:39:30.973 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:39:30.982 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:39:31.006 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:39:31.007 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/490) 2024-04-04T09:39:31.498 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:39:31.508 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:39:31.509 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:39:33.724 INFO:teuthology.orchestra.run.smithi072.stdout:generic/490 2s 2024-04-04T09:39:33.740 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/490 2024-04-04T09:39:33.740 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:39:33.748 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:39:33.773 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:39:33.773 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/491) 2024-04-04T09:39:34.535 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:39:34.545 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:39:34.545 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:39:34.934 INFO:teuthology.orchestra.run.smithi072.stdout:generic/491 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:39:34.945 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/491 2024-04-04T09:39:34.945 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/491 2024-04-04T09:39:34.945 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:39:34.953 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:39:34.977 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:39:34.977 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/492) 2024-04-04T09:39:35.499 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:39:35.513 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:39:35.513 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:39:35.891 INFO:teuthology.orchestra.run.smithi072.stdout:generic/492 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:39:35.903 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/492 2024-04-04T09:39:35.904 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/492 2024-04-04T09:39:35.904 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:39:35.914 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:39:35.937 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:39:35.938 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/493) 2024-04-04T09:39:36.385 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:39:36.395 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:39:36.396 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:39:36.767 INFO:teuthology.orchestra.run.smithi072.stdout:generic/493 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:39:36.777 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/493 2024-04-04T09:39:36.777 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/493 2024-04-04T09:39:36.777 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:39:36.785 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:39:36.808 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:39:36.808 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/494) 2024-04-04T09:39:37.279 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:39:37.290 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:39:37.290 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:39:37.650 INFO:teuthology.orchestra.run.smithi072.stdout:generic/494 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:39:37.660 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/494 2024-04-04T09:39:37.660 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/494 2024-04-04T09:39:37.660 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:39:37.668 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:39:37.695 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:39:37.695 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/495) 2024-04-04T09:39:38.181 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:39:38.195 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:39:38.196 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:39:38.602 INFO:teuthology.orchestra.run.smithi072.stdout:generic/495 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:39:38.612 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/495 2024-04-04T09:39:38.612 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/495 2024-04-04T09:39:38.612 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:39:38.621 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:39:38.645 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:39:38.645 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/496) 2024-04-04T09:39:39.109 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:39:39.120 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:39:39.120 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:39:39.516 INFO:teuthology.orchestra.run.smithi072.stdout:generic/496 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:39:39.529 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/496 2024-04-04T09:39:39.529 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/496 2024-04-04T09:39:39.529 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:39:39.539 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:39:39.566 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:39:39.566 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/497) 2024-04-04T09:39:40.047 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:39:40.058 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:39:40.058 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:39:40.435 INFO:teuthology.orchestra.run.smithi072.stdout:generic/497 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:39:40.447 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/497 2024-04-04T09:39:40.447 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/497 2024-04-04T09:39:40.447 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:39:40.458 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:39:40.485 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:39:40.485 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/498) 2024-04-04T09:39:40.918 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:39:40.929 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:39:40.929 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:39:41.341 INFO:teuthology.orchestra.run.smithi072.stdout:generic/498 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:39:41.351 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/498 2024-04-04T09:39:41.351 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/498 2024-04-04T09:39:41.351 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:39:41.360 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:39:41.388 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:39:41.388 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/499) 2024-04-04T09:39:41.858 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:39:41.869 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:39:41.869 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:39:42.232 INFO:teuthology.orchestra.run.smithi072.stdout:generic/499 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:39:42.242 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/499 2024-04-04T09:39:42.242 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/499 2024-04-04T09:39:42.242 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:39:42.251 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:39:42.276 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:39:42.277 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/500) 2024-04-04T09:39:42.737 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:39:42.747 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:39:42.747 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:39:43.189 INFO:teuthology.orchestra.run.smithi072.stdout:generic/500 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:39:43.201 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/500 2024-04-04T09:39:43.201 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/500 2024-04-04T09:39:43.201 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:39:43.211 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:39:43.237 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:39:43.237 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/501) 2024-04-04T09:39:43.706 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:39:43.717 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:39:43.717 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:39:44.102 INFO:teuthology.orchestra.run.smithi072.stdout:generic/501 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:39:44.112 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/501 2024-04-04T09:39:44.112 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/501 2024-04-04T09:39:44.112 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:39:44.120 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:39:44.144 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:39:44.144 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/502) 2024-04-04T09:39:44.616 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:39:44.628 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:39:44.629 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:39:45.046 INFO:teuthology.orchestra.run.smithi072.stdout:generic/502 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:39:45.056 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/502 2024-04-04T09:39:45.057 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/502 2024-04-04T09:39:45.057 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:39:45.066 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:39:45.091 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:39:45.092 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/503) 2024-04-04T09:39:45.579 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:39:45.590 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:39:45.590 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:39:45.959 INFO:teuthology.orchestra.run.smithi072.stdout:generic/503 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:39:45.967 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/503 2024-04-04T09:39:45.967 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/503 2024-04-04T09:39:45.967 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:39:45.974 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:39:45.999 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:39:46.000 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/504) 2024-04-04T09:39:46.475 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:39:46.486 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:39:46.486 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:39:46.958 INFO:teuthology.orchestra.run.smithi072.stdout:generic/504 - output mismatch (see /tmp/tmp.tiFz9P8iUAxfstests-dev/results//generic/504.out.bad) 2024-04-04T09:39:46.969 INFO:teuthology.orchestra.run.smithi072.stdout: --- tests/generic/504.out 2024-04-04 06:58:02.250452768 +0000 2024-04-04T09:39:46.969 INFO:teuthology.orchestra.run.smithi072.stdout: +++ /tmp/tmp.tiFz9P8iUAxfstests-dev/results//generic/504.out.bad 2024-04-04 09:39:46.935192289 +0000 2024-04-04T09:39:46.969 INFO:teuthology.orchestra.run.smithi072.stdout: @@ -1,2 +1,3 @@ 2024-04-04T09:39:46.969 INFO:teuthology.orchestra.run.smithi072.stdout: QA output created by 504 2024-04-04T09:39:46.969 INFO:teuthology.orchestra.run.smithi072.stdout: +lock info not found 2024-04-04T09:39:46.969 INFO:teuthology.orchestra.run.smithi072.stdout: Silence is golden 2024-04-04T09:39:46.976 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/504 2024-04-04T09:39:46.976 INFO:teuthology.orchestra.run.smithi072.stdout:Failures: generic/504 2024-04-04T09:39:46.976 INFO:teuthology.orchestra.run.smithi072.stdout:Failed 1 of 1 tests 2024-04-04T09:39:46.985 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:39:47.010 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-04T09:39:47.010 INFO:tasks.cephfs.xfstests_dev:Command failed 2024-04-04T09:39:47.010 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2024-04-04T09:39:47.011 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/505) 2024-04-04T09:39:47.472 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:39:47.483 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:39:47.483 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:39:47.823 INFO:teuthology.orchestra.run.smithi072.stdout:generic/505 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:39:47.833 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/505 2024-04-04T09:39:47.833 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/505 2024-04-04T09:39:47.833 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:39:47.840 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:39:47.864 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:39:47.865 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/506) 2024-04-04T09:39:48.323 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:39:48.335 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:39:48.335 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:39:48.745 INFO:teuthology.orchestra.run.smithi072.stdout:generic/506 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:39:48.755 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/506 2024-04-04T09:39:48.755 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/506 2024-04-04T09:39:48.755 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:39:48.763 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:39:48.791 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:39:48.791 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/507) 2024-04-04T09:39:49.290 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:39:49.300 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:39:49.300 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:39:49.799 INFO:teuthology.orchestra.run.smithi072.stdout:generic/507 [not run] file system doesn't support chattr +ASai 2024-04-04T09:39:49.811 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/507 2024-04-04T09:39:49.812 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/507 2024-04-04T09:39:49.812 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:39:49.822 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:39:49.849 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:39:49.850 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/508) 2024-04-04T09:39:50.328 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:39:50.339 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:39:50.339 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:39:50.711 INFO:teuthology.orchestra.run.smithi072.stdout:generic/508 [not run] lsattr not supported by test filesystem type: ceph-fuse 2024-04-04T09:39:50.719 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/508 2024-04-04T09:39:50.719 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/508 2024-04-04T09:39:50.719 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:39:50.727 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:39:50.749 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:39:50.749 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/509) 2024-04-04T09:39:51.257 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:39:51.269 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:39:51.269 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:39:51.662 INFO:teuthology.orchestra.run.smithi072.stdout:generic/509 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:39:51.674 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/509 2024-04-04T09:39:51.674 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/509 2024-04-04T09:39:51.674 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:39:51.682 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:39:51.710 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:39:51.710 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/510) 2024-04-04T09:39:52.206 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:39:52.217 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:39:52.217 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:39:52.629 INFO:teuthology.orchestra.run.smithi072.stdout:generic/510 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:39:52.640 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/510 2024-04-04T09:39:52.640 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/510 2024-04-04T09:39:52.640 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:39:52.648 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:39:52.677 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:39:52.677 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/511) 2024-04-04T09:39:53.177 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:39:53.187 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:39:53.187 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:39:53.539 INFO:teuthology.orchestra.run.smithi072.stdout:generic/511 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:39:53.547 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/511 2024-04-04T09:39:53.547 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/511 2024-04-04T09:39:53.548 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:39:53.555 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:39:53.581 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:39:53.581 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/512) 2024-04-04T09:39:54.107 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:39:54.117 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:39:54.117 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:39:54.498 INFO:teuthology.orchestra.run.smithi072.stdout:generic/512 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:39:54.510 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/512 2024-04-04T09:39:54.511 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/512 2024-04-04T09:39:54.511 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:39:54.522 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:39:54.550 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:39:54.551 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/513) 2024-04-04T09:39:55.050 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:39:55.060 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:39:55.060 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:39:55.960 INFO:teuthology.orchestra.run.smithi072.stdout:generic/513 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:39:55.970 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/513 2024-04-04T09:39:55.970 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/513 2024-04-04T09:39:55.971 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:39:55.979 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:39:56.007 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:39:56.007 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/514) 2024-04-04T09:39:56.512 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:39:56.523 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:39:56.523 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:39:56.898 INFO:teuthology.orchestra.run.smithi072.stdout:generic/514 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:39:56.907 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/514 2024-04-04T09:39:56.907 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/514 2024-04-04T09:39:56.908 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:39:56.914 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:39:56.939 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:39:56.939 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/515) 2024-04-04T09:39:57.425 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:39:57.436 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:39:57.436 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:39:57.821 INFO:teuthology.orchestra.run.smithi072.stdout:generic/515 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:39:57.833 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/515 2024-04-04T09:39:57.834 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/515 2024-04-04T09:39:57.834 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:39:57.845 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:39:57.872 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:39:57.872 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/516) 2024-04-04T09:39:58.374 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:39:58.386 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:39:58.386 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:39:58.877 INFO:teuthology.orchestra.run.smithi072.stdout:generic/516 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2024-04-04T09:39:58.887 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/516 2024-04-04T09:39:58.887 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/516 2024-04-04T09:39:58.888 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:39:58.896 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:39:58.945 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:39:58.946 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/517) 2024-04-04T09:39:59.758 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:39:59.768 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:39:59.769 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:40:00.109 INFO:teuthology.orchestra.run.smithi072.stdout:generic/517 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:40:00.117 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/517 2024-04-04T09:40:00.117 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/517 2024-04-04T09:40:00.118 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:40:00.124 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:40:00.147 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:40:00.147 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/518) 2024-04-04T09:40:00.624 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:40:00.634 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:40:00.634 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:40:01.010 INFO:teuthology.orchestra.run.smithi072.stdout:generic/518 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:40:01.023 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/518 2024-04-04T09:40:01.023 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/518 2024-04-04T09:40:01.023 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:40:01.035 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:40:01.059 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:40:01.059 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/519) 2024-04-04T09:40:01.557 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:40:01.568 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:40:01.568 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:40:02.753 INFO:teuthology.orchestra.run.smithi072.stdout:generic/519 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:40:02.766 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/519 2024-04-04T09:40:02.766 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/519 2024-04-04T09:40:02.766 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:40:02.775 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:40:02.803 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:40:02.803 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/520) 2024-04-04T09:40:03.296 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:40:03.306 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:40:03.307 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:40:03.718 INFO:teuthology.orchestra.run.smithi072.stdout:generic/520 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T09:40:03.730 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/520 2024-04-04T09:40:03.730 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/520 2024-04-04T09:40:03.730 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T09:40:03.739 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:40:03.765 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T09:40:03.766 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/521) 2024-04-04T09:40:04.271 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T09:40:04.282 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T09:40:04.282 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T09:42:14.122 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T09:42:14.131 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T09:42:44.339 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T09:42:44.347 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T09:43:14.484 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T09:43:14.494 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T09:43:44.622 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T09:43:44.631 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T09:44:14.773 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T09:44:14.782 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T09:44:44.909 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T09:44:44.918 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T09:45:15.064 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T09:45:15.073 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T09:45:45.256 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T09:45:45.264 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T09:46:15.389 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T09:46:15.397 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T09:46:45.516 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T09:46:45.524 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T09:47:15.660 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T09:47:15.669 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T09:47:46.205 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T09:47:46.214 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T09:48:16.367 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T09:48:16.377 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T09:48:46.531 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T09:48:46.596 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T09:49:16.723 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T09:49:16.731 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T09:49:46.864 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T09:49:46.872 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T09:50:17.005 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T09:50:17.016 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T09:50:47.142 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T09:50:47.151 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T09:51:17.364 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T09:51:17.373 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T09:51:47.499 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T09:51:47.507 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T09:52:17.629 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T09:52:17.639 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T09:52:47.765 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T09:52:47.773 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T09:53:17.901 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T09:53:17.911 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T09:53:48.037 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T09:53:48.045 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T09:54:18.184 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T09:54:18.197 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T09:54:48.318 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T09:54:48.328 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T09:55:18.463 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T09:55:18.473 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T09:55:48.604 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T09:55:48.613 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T09:56:18.736 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T09:56:18.745 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T09:56:48.874 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T09:56:48.884 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T09:57:19.466 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T09:57:19.475 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T09:57:49.597 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T09:57:49.606 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T09:58:19.726 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T09:58:19.735 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T09:58:49.870 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T09:58:49.879 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T09:59:19.999 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T09:59:20.008 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T09:59:50.134 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T09:59:50.146 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:00:20.272 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:00:20.281 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:00:50.416 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:00:50.425 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:01:20.554 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:01:20.563 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:01:50.692 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:01:50.701 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:02:20.828 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:02:20.837 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:02:50.962 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:02:50.971 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:03:21.087 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:03:21.096 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:03:51.239 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:03:51.249 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:04:21.374 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:04:21.382 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:04:51.510 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:04:51.521 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:05:21.656 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:05:21.664 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:05:51.794 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:05:51.802 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:06:21.930 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:06:21.942 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:06:52.083 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:06:52.092 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:07:22.213 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:07:22.223 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:07:52.358 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:07:52.367 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:08:22.495 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:08:22.504 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:08:52.632 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:08:52.641 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:09:22.769 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:09:22.778 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:09:52.941 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:09:52.950 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:10:23.088 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:10:23.098 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:10:53.324 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:10:53.333 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:11:23.458 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:11:23.466 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:11:53.595 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:11:53.603 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:12:23.725 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:12:23.734 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:12:53.885 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:12:53.898 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:13:24.069 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:13:24.078 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:13:54.208 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:13:54.219 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:14:24.351 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:14:24.361 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:14:54.489 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:14:54.498 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:15:24.620 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:15:24.629 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:15:54.756 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:15:54.765 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:16:24.941 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:16:24.948 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:16:55.069 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:16:55.077 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:17:25.239 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:17:25.251 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:17:55.387 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:17:55.397 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:18:25.521 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:18:25.530 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:18:55.661 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:18:55.668 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:19:25.801 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:19:25.808 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:19:55.940 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:19:55.950 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:20:26.076 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:20:26.084 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:20:56.206 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:20:56.215 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:21:26.333 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:21:26.342 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:21:56.469 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:21:56.480 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:22:26.615 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:22:26.624 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:22:56.743 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:22:56.754 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:23:26.863 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:23:26.873 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:23:56.991 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:23:57.001 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:24:27.120 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:24:27.132 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:24:57.247 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:24:57.255 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:25:27.394 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:25:27.402 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:25:57.532 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:25:57.540 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:26:27.667 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:26:27.676 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:26:57.802 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:26:57.811 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:27:27.939 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:27:27.948 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:27:58.085 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:27:58.094 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:28:28.222 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:28:28.231 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:28:58.355 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:28:58.364 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:29:28.503 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:29:28.514 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:29:59.033 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:29:59.041 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:30:29.167 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:30:29.177 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:30:59.324 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:30:59.332 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:31:29.552 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:31:29.560 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:31:59.845 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:31:59.855 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:32:29.982 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:32:29.991 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:33:00.134 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:33:00.143 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:33:30.264 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:33:30.273 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:34:00.396 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:34:00.404 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:34:30.537 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:34:30.547 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:35:00.673 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:35:00.681 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:35:31.083 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:35:31.090 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:36:01.220 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:36:01.228 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:36:31.351 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:36:31.358 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:37:01.553 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:37:01.560 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:37:31.681 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:37:31.690 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:38:01.833 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:38:01.843 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:38:31.961 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:38:31.970 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:39:02.108 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:39:02.117 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:39:32.235 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:39:32.244 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:40:02.380 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:40:02.389 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:40:32.543 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:40:32.551 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:41:02.704 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:41:02.713 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:41:32.849 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:41:32.858 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:42:02.993 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:42:03.001 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:42:33.128 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:42:33.137 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:43:03.267 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:43:03.276 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:43:33.406 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:43:33.414 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:44:03.558 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:44:03.566 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:44:33.686 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:44:33.696 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:45:03.823 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:45:03.831 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:45:33.960 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:45:33.971 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:46:04.097 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:46:04.106 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:46:34.233 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:46:34.241 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:47:04.379 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:47:04.388 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:47:34.558 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:47:34.566 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:48:04.710 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:48:04.718 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:48:34.848 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:48:34.857 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:49:04.992 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:49:05.001 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:49:35.131 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:49:35.140 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:50:05.256 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:50:05.265 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:50:35.428 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:50:35.494 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:51:05.623 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:51:05.632 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:51:35.768 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:51:35.777 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:52:05.974 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:52:05.983 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:52:36.216 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:52:36.226 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:53:06.350 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:53:06.359 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:53:36.482 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:53:36.491 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:54:06.619 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:54:06.630 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:54:36.770 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:54:36.779 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:55:06.908 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:55:06.917 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:55:37.037 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:55:37.045 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:56:07.165 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:56:07.173 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:56:37.520 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:56:37.529 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:57:07.959 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:57:07.970 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:57:38.092 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:57:38.101 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:57:38.208 INFO:tasks.ceph.osd.5.smithi117.stderr:2024-04-04T10:57:38.208+0000 7f144e000640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 51889) UID: 0 2024-04-04T10:57:38.208 INFO:tasks.ceph.osd.6.smithi117.stderr:2024-04-04T10:57:38.208+0000 7fb935800640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 51889) UID: 0 2024-04-04T10:57:38.209 INFO:tasks.ceph.osd.4.smithi117.stderr:2024-04-04T10:57:38.208+0000 7f248de00640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 51889) UID: 0 2024-04-04T10:57:38.209 INFO:tasks.ceph.osd.7.smithi117.stderr:2024-04-04T10:57:38.208+0000 7f3028600640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 51889) UID: 0 2024-04-04T10:59:53.734 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T10:59:53.743 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:00:23.875 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:00:23.884 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:00:54.010 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:00:54.018 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:01:24.149 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:01:24.158 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:01:54.288 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:01:54.297 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:02:24.422 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:02:24.430 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:02:54.550 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:02:54.559 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:03:24.695 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:03:24.703 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:03:54.834 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:03:54.843 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:04:24.977 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:04:24.987 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:04:55.113 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:04:55.122 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:05:25.241 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:05:25.250 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:05:55.486 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:05:55.497 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:06:25.614 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:06:25.657 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:06:55.787 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:06:55.796 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:07:25.931 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:07:25.940 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:07:56.055 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:07:56.067 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:08:26.222 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:08:26.231 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:08:56.357 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:08:56.367 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:09:26.496 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:09:26.505 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:09:56.634 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:09:56.644 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:10:26.768 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:10:26.775 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:10:56.930 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:10:56.939 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:11:27.070 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:11:27.078 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:11:57.200 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:11:57.210 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:12:27.332 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:12:27.341 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:12:57.457 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:12:57.466 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:13:27.602 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:13:27.609 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:13:57.736 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:13:57.744 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:14:28.124 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:14:28.133 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:14:58.260 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:14:58.268 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:15:28.396 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:15:28.403 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:15:58.542 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:15:58.552 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:16:28.871 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:16:28.882 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:16:59.023 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:16:59.031 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:17:29.185 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:17:29.194 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:17:59.323 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:17:59.332 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:18:29.460 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:18:29.469 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:18:59.595 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:18:59.603 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:19:29.723 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:19:29.733 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:19:59.868 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:19:59.876 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:20:29.996 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:20:30.006 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:21:00.132 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:21:00.141 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:21:30.270 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:21:30.279 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:22:00.410 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:22:00.419 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:22:30.542 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:22:30.551 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:23:00.704 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:23:00.713 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:23:30.836 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:23:30.843 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:24:00.969 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:24:00.977 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:24:31.102 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:24:31.112 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:25:01.244 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:25:01.253 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:25:31.379 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:25:31.389 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:26:01.519 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:26:01.527 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:26:31.661 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:26:31.670 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:27:01.788 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:27:01.799 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:27:31.927 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:27:31.936 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:28:02.062 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:28:02.071 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:28:32.198 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:28:32.206 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:29:02.553 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:29:02.562 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:29:33.321 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:29:33.329 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:30:03.466 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:30:03.475 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:30:33.603 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:30:33.613 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:31:03.806 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:31:03.815 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:31:33.951 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:31:33.960 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:32:04.113 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:32:04.119 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:32:34.778 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:32:34.786 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:33:04.917 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:33:04.928 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:33:35.090 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:33:35.098 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:34:05.368 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:34:05.376 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:34:35.522 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:34:35.533 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:35:05.666 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:35:05.676 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:35:35.810 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:35:35.819 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:36:05.940 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:36:05.950 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:36:36.293 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:36:36.302 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:37:06.429 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:37:06.439 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:37:36.565 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:37:36.576 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:38:06.703 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:38:06.712 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:38:36.865 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:38:36.874 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:39:07.008 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:39:07.015 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:39:37.149 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:39:37.158 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:40:07.281 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:40:07.290 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:40:37.461 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:40:37.470 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:41:07.605 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:41:07.613 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:41:37.752 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:41:37.760 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:42:08.162 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:42:08.171 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:42:27.725 INFO:teuthology.orchestra.run.smithi072.stdout:generic/521 7343s 2024-04-04T11:42:27.743 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/521 2024-04-04T11:42:27.743 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T11:42:27.751 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T11:42:27.798 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T11:42:27.798 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/522) 2024-04-04T11:42:28.518 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T11:42:28.530 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T11:42:28.530 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T11:42:38.299 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:42:38.307 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:43:08.460 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:43:08.471 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:43:38.617 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:43:38.626 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:44:08.750 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:44:08.759 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:44:38.887 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:44:38.897 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:45:09.015 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:45:09.023 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:45:39.244 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:45:39.250 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:46:09.406 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:46:09.414 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:46:39.686 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:46:39.693 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:47:09.832 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:47:09.839 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:47:39.981 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:47:39.990 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:48:10.170 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:48:10.180 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:48:40.665 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:48:40.672 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:49:10.837 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:49:10.846 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:49:40.970 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:49:40.978 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:50:11.115 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:50:11.124 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:50:41.276 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:50:41.286 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:51:11.448 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:51:11.457 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:51:41.592 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:51:41.599 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:52:11.730 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:52:11.739 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:52:42.401 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:52:42.407 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:53:12.535 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:53:12.544 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:53:42.672 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:53:42.679 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:54:12.869 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:54:12.878 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:54:43.022 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:54:43.031 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:55:13.227 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:55:13.234 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:55:43.363 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:55:43.372 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:56:13.510 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:56:13.519 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:56:43.696 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:56:43.705 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:57:13.832 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:57:13.840 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:57:43.968 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:57:43.978 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:58:14.122 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:58:14.128 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:58:44.276 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:58:44.284 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:59:14.518 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:59:14.527 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:59:44.736 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T11:59:44.744 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:00:14.880 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:00:14.888 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:00:45.032 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:00:45.040 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:01:15.169 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:01:15.179 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:01:45.366 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:01:45.375 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:02:15.517 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:02:15.525 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:02:45.645 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:02:45.654 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:03:15.801 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:03:15.809 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:03:46.004 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:03:46.013 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:04:16.148 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:04:16.157 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:04:46.293 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:04:46.303 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:05:16.451 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:05:16.460 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:05:46.577 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:05:46.587 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:06:16.729 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:06:16.735 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:06:46.882 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:06:46.892 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:07:17.018 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:07:17.028 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:07:47.164 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:07:47.174 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:08:17.301 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:08:17.309 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:08:47.451 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:08:47.460 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:09:17.589 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:09:17.597 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:09:47.726 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:09:47.735 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:09:47.846 INFO:tasks.ceph.mds.a.smithi072.stderr:2024-04-04T12:09:47.854+0000 7fa395800640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 427438) UID: 0 2024-04-04T12:09:47.846 INFO:tasks.ceph.mds.c.smithi072.stderr:2024-04-04T12:09:47.854+0000 7fc131e00640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 427438) UID: 0 2024-04-04T12:12:46.405 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:12:46.413 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:13:16.869 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:13:16.876 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:13:47.001 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:13:47.011 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:14:17.188 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:14:17.199 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:14:47.351 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:14:47.359 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:15:17.495 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:15:17.505 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:15:47.816 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:15:47.825 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:16:17.952 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:16:17.960 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:16:48.087 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:16:48.097 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:17:18.224 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:17:18.233 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:17:48.361 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:17:48.372 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:18:18.515 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:18:18.525 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:18:48.828 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:18:48.837 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:19:18.963 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:19:18.973 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:19:49.108 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:19:49.118 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:20:19.254 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:20:19.262 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:20:49.457 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:20:49.465 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:21:19.618 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:21:19.626 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:21:49.814 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:21:49.826 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:22:20.008 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:22:20.020 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:22:50.146 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:22:50.155 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:23:20.294 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:23:20.302 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:23:50.429 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:23:50.436 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:24:20.582 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:24:20.590 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:24:51.207 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:24:51.215 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:25:21.338 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:25:21.346 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:25:51.492 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:25:51.502 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:26:21.633 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:26:21.639 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:26:51.756 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:26:51.764 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:27:21.886 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:27:21.897 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:27:52.014 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:27:52.024 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:28:22.145 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:28:22.155 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:28:52.279 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:28:52.290 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:29:22.424 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:29:22.433 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:29:52.553 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:29:52.563 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:30:22.698 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:30:22.708 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:30:53.332 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:30:53.343 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:31:23.471 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:31:23.480 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:31:53.609 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:31:53.618 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:32:23.752 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:32:23.762 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:32:53.885 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:32:53.896 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:33:24.017 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:33:24.029 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:33:54.173 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:33:54.183 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:34:24.302 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:34:24.309 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:34:54.452 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:34:54.461 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:35:24.590 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:35:24.599 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:35:54.725 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:35:54.738 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:36:24.865 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:36:24.875 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:36:55.044 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:36:55.052 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:37:25.187 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:37:25.194 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:37:55.954 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:37:55.969 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:38:26.606 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:38:26.613 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:38:56.756 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:38:56.766 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:39:26.890 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:39:26.899 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:39:57.019 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:39:57.028 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:40:27.154 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:40:27.162 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:40:57.302 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:40:57.309 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:41:27.820 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:41:27.826 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:41:57.978 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:41:57.987 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:42:28.120 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:42:28.130 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:42:58.274 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:42:58.283 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:43:28.411 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:43:28.420 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:43:58.548 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:43:58.557 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:44:28.676 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:44:28.682 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:44:58.816 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:44:58.825 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:45:28.967 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:45:28.976 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:45:59.108 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:45:59.117 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:46:29.263 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:46:29.270 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:46:59.393 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:46:59.402 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:47:29.537 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:47:29.546 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:47:59.675 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:47:59.682 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:48:29.837 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:48:29.848 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:48:59.972 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:48:59.980 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:49:30.102 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:49:30.112 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:50:00.237 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:50:00.244 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:50:30.408 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:50:30.417 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:51:00.545 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:51:00.553 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:51:30.698 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:51:30.706 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:52:00.878 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:52:00.886 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:52:31.004 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:52:31.013 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:53:01.493 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:53:01.502 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:53:31.633 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:53:31.641 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:54:01.763 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:54:01.771 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:54:32.169 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:54:32.178 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:55:02.349 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:55:02.358 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:55:32.491 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:55:32.500 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:56:02.619 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:56:02.627 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:56:02.720 INFO:tasks.ceph.osd.1.smithi072.stderr:2024-04-04T12:56:02.733+0000 7fa436800640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 429069) UID: 0 2024-04-04T12:56:02.720 INFO:tasks.ceph.osd.2.smithi072.stderr:2024-04-04T12:56:02.733+0000 7f7521000640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 429069) UID: 0 2024-04-04T12:56:02.721 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-04T12:56:02.733+0000 7f4e66800640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 429069) UID: 0 2024-04-04T12:56:02.721 INFO:tasks.ceph.osd.3.smithi072.stderr:2024-04-04T12:56:02.733+0000 7f0d67400640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 429069) UID: 0 2024-04-04T12:58:34.219 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:58:34.226 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:59:04.406 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:59:04.415 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:59:34.585 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T12:59:34.596 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:00:04.739 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:00:04.750 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:00:34.902 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:00:34.911 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:01:05.038 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:01:05.047 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:01:35.177 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:01:35.188 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:02:05.313 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:02:05.322 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:02:35.441 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:02:35.450 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:03:05.587 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:03:05.595 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:03:35.723 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:03:35.732 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:04:06.073 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:04:06.082 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:04:30.600 INFO:teuthology.orchestra.run.smithi072.stdout:generic/522 4922s 2024-04-04T13:04:30.692 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/522 2024-04-04T13:04:30.692 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T13:04:30.706 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T13:04:30.738 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T13:04:30.739 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/523) 2024-04-04T13:04:31.548 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T13:04:31.560 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T13:04:31.560 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T13:04:31.990 INFO:teuthology.orchestra.run.smithi072.stdout:generic/523 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T13:04:32.002 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/523 2024-04-04T13:04:32.002 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/523 2024-04-04T13:04:32.002 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T13:04:32.013 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T13:04:32.043 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T13:04:32.044 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/524) 2024-04-04T13:04:32.540 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T13:04:32.551 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T13:04:32.552 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T13:04:32.908 INFO:teuthology.orchestra.run.smithi072.stdout:generic/524 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T13:04:32.918 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/524 2024-04-04T13:04:32.918 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/524 2024-04-04T13:04:32.918 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T13:04:32.925 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T13:04:32.950 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T13:04:32.950 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/525) 2024-04-04T13:04:33.467 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T13:04:33.480 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T13:04:33.481 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T13:04:33.867 INFO:teuthology.orchestra.run.smithi072.stdout:generic/525 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T13:04:33.877 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/525 2024-04-04T13:04:33.877 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/525 2024-04-04T13:04:33.878 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T13:04:33.885 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T13:04:33.914 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T13:04:33.914 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/526) 2024-04-04T13:04:34.414 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T13:04:34.426 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T13:04:34.426 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T13:04:34.869 INFO:teuthology.orchestra.run.smithi072.stdout:generic/526 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T13:04:34.881 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/526 2024-04-04T13:04:34.881 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/526 2024-04-04T13:04:34.881 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T13:04:34.893 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T13:04:34.923 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T13:04:34.923 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/527) 2024-04-04T13:04:35.441 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T13:04:35.451 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T13:04:35.451 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T13:04:35.818 INFO:teuthology.orchestra.run.smithi072.stdout:generic/527 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T13:04:35.830 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/527 2024-04-04T13:04:35.830 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/527 2024-04-04T13:04:35.830 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T13:04:35.838 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T13:04:35.867 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T13:04:35.867 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/528) 2024-04-04T13:04:36.205 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:04:36.211 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:04:36.365 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T13:04:36.376 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T13:04:36.376 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T13:04:36.854 INFO:teuthology.orchestra.run.smithi072.stdout:generic/528 [not run] inode creation time not supported by this filesystem 2024-04-04T13:04:36.865 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/528 2024-04-04T13:04:36.865 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/528 2024-04-04T13:04:36.865 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T13:04:36.872 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T13:04:36.897 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T13:04:36.897 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/529) 2024-04-04T13:04:37.368 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T13:04:37.380 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T13:04:37.380 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T13:04:37.804 INFO:teuthology.orchestra.run.smithi072.stdout:generic/529 [not run] ACLs not supported by this filesystem type: ceph-fuse 2024-04-04T13:04:37.813 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/529 2024-04-04T13:04:37.813 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/529 2024-04-04T13:04:37.813 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T13:04:37.820 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T13:04:37.846 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T13:04:37.846 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/530) 2024-04-04T13:04:38.338 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T13:04:38.350 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T13:04:38.351 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T13:04:38.754 INFO:teuthology.orchestra.run.smithi072.stdout:generic/530 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T13:04:38.764 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/530 2024-04-04T13:04:38.765 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/530 2024-04-04T13:04:38.765 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T13:04:38.773 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T13:04:38.803 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T13:04:38.803 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/531) 2024-04-04T13:04:39.271 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T13:04:39.284 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T13:04:39.284 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T13:04:39.697 INFO:teuthology.orchestra.run.smithi072.stdout:generic/531 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T13:04:39.709 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/531 2024-04-04T13:04:39.709 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/531 2024-04-04T13:04:39.709 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T13:04:39.719 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T13:04:39.748 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T13:04:39.748 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/532) 2024-04-04T13:04:40.229 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T13:04:40.240 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T13:04:40.240 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T13:04:40.750 INFO:teuthology.orchestra.run.smithi072.stdout:generic/532 0s 2024-04-04T13:04:40.766 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/532 2024-04-04T13:04:40.767 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T13:04:40.775 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T13:04:40.803 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T13:04:40.803 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/533) 2024-04-04T13:04:41.273 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T13:04:41.284 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T13:04:41.284 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T13:04:42.122 INFO:teuthology.orchestra.run.smithi072.stdout:generic/533 1s 2024-04-04T13:04:42.136 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/533 2024-04-04T13:04:42.136 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T13:04:42.144 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T13:04:42.169 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T13:04:42.169 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/534) 2024-04-04T13:04:42.753 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T13:04:42.765 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T13:04:42.765 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T13:04:43.221 INFO:teuthology.orchestra.run.smithi072.stdout:generic/534 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T13:04:43.234 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/534 2024-04-04T13:04:43.234 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/534 2024-04-04T13:04:43.234 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T13:04:43.245 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T13:04:43.275 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T13:04:43.275 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/535) 2024-04-04T13:04:43.750 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T13:04:43.762 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T13:04:43.762 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T13:04:44.200 INFO:teuthology.orchestra.run.smithi072.stdout:generic/535 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T13:04:44.212 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/535 2024-04-04T13:04:44.212 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/535 2024-04-04T13:04:44.212 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T13:04:44.222 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T13:04:44.250 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T13:04:44.251 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/536) 2024-04-04T13:04:44.770 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T13:04:44.781 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T13:04:44.782 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T13:04:45.156 INFO:teuthology.orchestra.run.smithi072.stdout:generic/536 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T13:04:45.168 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/536 2024-04-04T13:04:45.168 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/536 2024-04-04T13:04:45.168 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T13:04:45.176 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T13:04:45.209 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T13:04:45.209 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/537) 2024-04-04T13:04:45.717 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T13:04:45.730 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T13:04:45.730 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T13:04:46.096 INFO:teuthology.orchestra.run.smithi072.stdout:generic/537 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T13:04:46.106 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/537 2024-04-04T13:04:46.106 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/537 2024-04-04T13:04:46.106 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T13:04:46.114 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T13:04:46.141 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T13:04:46.141 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/538) 2024-04-04T13:04:46.623 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T13:04:46.634 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T13:04:46.634 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T13:05:06.370 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:05:06.379 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:05:36.603 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:05:36.611 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:06:06.757 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:06:06.765 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:06:36.895 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:06:36.905 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:06:37.014 INFO:tasks.ceph.osd.2.smithi072.stderr:2024-04-04T13:06:37.028+0000 7f7521000640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 436601) UID: 0 2024-04-04T13:06:37.014 INFO:tasks.ceph.osd.1.smithi072.stderr:2024-04-04T13:06:37.028+0000 7fa436800640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 436601) UID: 0 2024-04-04T13:06:37.015 INFO:tasks.ceph.osd.3.smithi072.stderr:2024-04-04T13:06:37.028+0000 7f0d67400640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 436601) UID: 0 2024-04-04T13:06:37.015 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-04T13:06:37.028+0000 7f4e66800640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 436601) UID: 0 2024-04-04T13:09:38.081 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:09:38.090 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:10:08.219 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:10:08.227 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:10:38.483 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:10:38.494 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:11:08.633 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:11:08.641 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:11:38.816 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:11:38.825 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:12:09.026 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:12:09.035 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:12:39.720 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:12:39.729 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:13:09.857 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:13:09.866 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:13:40.053 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:13:40.059 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:14:10.198 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:14:10.206 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:14:40.376 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:14:40.386 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:15:10.573 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:15:10.581 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:15:40.710 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:15:40.718 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:16:10.862 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:16:10.870 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:16:41.040 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:16:41.046 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:17:11.159 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:17:11.167 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:17:41.299 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:17:41.307 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:18:11.432 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:18:11.441 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:18:41.663 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:18:41.672 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:19:11.795 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:19:11.803 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:19:41.927 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:19:41.935 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:20:12.157 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:20:12.166 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:20:42.303 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:20:42.311 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:21:12.482 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:21:12.490 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:21:42.693 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:21:42.701 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:22:12.830 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:22:12.839 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:22:42.975 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:22:42.984 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:23:13.103 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:23:13.113 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:23:43.272 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:23:43.281 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:24:13.486 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:24:13.494 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:24:43.621 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:24:43.629 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:25:13.749 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:25:13.758 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:25:43.929 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:25:43.937 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:26:14.073 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:26:14.081 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:26:44.217 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:26:44.226 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:27:14.372 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:27:14.383 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:27:44.508 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:27:44.517 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:28:14.694 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:28:14.703 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:28:44.907 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:28:44.916 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:29:15.051 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:29:15.059 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:29:45.232 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:29:45.243 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:30:15.375 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:30:15.384 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:30:45.503 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:30:45.511 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:31:15.641 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:31:15.651 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:31:45.779 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:31:45.787 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:32:15.914 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:32:15.924 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:32:46.058 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:32:46.068 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:33:16.659 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:33:16.668 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:33:47.352 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:33:47.362 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:34:17.504 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:34:17.514 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:34:47.640 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:34:47.650 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:35:17.778 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:35:17.786 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:35:47.989 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:35:47.997 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:36:18.124 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:36:18.133 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:36:48.263 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:36:48.271 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:37:18.443 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:37:18.450 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:37:48.750 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:37:48.759 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:38:18.883 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:38:18.891 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:38:49.013 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:38:49.021 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:39:19.151 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:39:19.157 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:39:49.304 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:39:49.312 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:40:19.441 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:40:19.450 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:40:49.679 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:40:49.688 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:40:49.823 INFO:tasks.ceph.osd.5.smithi117.stderr:2024-04-04T13:40:49.831+0000 7f144e000640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 57588) UID: 0 2024-04-04T13:40:49.823 INFO:tasks.ceph.osd.6.smithi117.stderr:2024-04-04T13:40:49.831+0000 7fb935800640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 57588) UID: 0 2024-04-04T13:40:49.824 INFO:tasks.ceph.osd.7.smithi117.stderr:2024-04-04T13:40:49.831+0000 7f3028600640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 57588) UID: 0 2024-04-04T13:40:49.824 INFO:tasks.ceph.osd.4.smithi117.stderr:2024-04-04T13:40:49.831+0000 7f248de00640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 57588) UID: 0 2024-04-04T13:43:24.223 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:43:24.233 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:43:54.592 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:43:54.600 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:44:24.905 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:44:24.914 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:44:55.055 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:44:55.063 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:45:25.228 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:45:25.238 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:45:55.357 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:45:55.366 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:46:25.491 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:46:25.499 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:46:55.635 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:46:55.642 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:47:25.775 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:47:25.784 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:47:56.006 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:47:56.016 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:48:26.201 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:48:26.208 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:48:56.429 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:48:56.438 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:49:26.557 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:49:26.566 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:49:56.710 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:49:56.718 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:50:26.835 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:50:26.844 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:50:56.996 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:50:57.003 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:51:27.183 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:51:27.193 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:51:57.344 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:51:57.353 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:52:27.540 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:52:27.548 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:52:57.677 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:52:57.686 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:53:27.820 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:53:27.828 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:53:57.966 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:53:57.975 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:54:28.102 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:54:28.112 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:54:58.240 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:54:58.249 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:55:28.420 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:55:28.428 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:55:58.706 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:55:58.715 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:56:28.853 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:56:28.862 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:56:59.073 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:56:59.082 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:57:29.246 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:57:29.255 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:57:59.420 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:57:59.429 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:58:29.556 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:58:29.565 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:58:59.698 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:58:59.707 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:59:29.857 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T13:59:29.869 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T14:00:00.069 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T14:00:00.077 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T14:00:30.213 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T14:00:30.222 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T14:01:00.418 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T14:01:00.427 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T14:01:30.591 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T14:01:30.599 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T14:02:01.053 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T14:02:01.063 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T14:02:31.227 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T14:02:31.236 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T14:03:01.458 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T14:03:01.464 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T14:03:31.651 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T14:03:31.662 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T14:04:01.795 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T14:04:01.804 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T14:04:31.926 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T14:04:31.934 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T14:05:02.067 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T14:05:02.075 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T14:05:32.220 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T14:05:32.229 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T14:06:02.375 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T14:06:02.384 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T14:06:32.681 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T14:06:32.691 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T14:07:02.815 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T14:07:02.824 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T14:07:33.038 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T14:07:33.046 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T14:08:03.181 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T14:08:03.190 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T14:08:33.335 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T14:08:33.343 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T14:09:03.538 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T14:09:03.546 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T14:09:33.749 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T14:09:33.757 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T14:10:03.878 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T14:10:03.886 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T14:10:34.038 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T14:10:34.046 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T14:11:04.243 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T14:11:04.249 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T14:11:34.369 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T14:11:34.378 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T14:11:34.497 INFO:tasks.ceph.osd.1.smithi072.stderr:2024-04-04T14:11:34.489+0000 7fa436800640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 442897) UID: 0 2024-04-04T14:11:34.497 INFO:tasks.ceph.osd.2.smithi072.stderr:2024-04-04T14:11:34.489+0000 7f7521000640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 442897) UID: 0 2024-04-04T14:11:34.497 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-04T14:11:34.489+0000 7f4e66800640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 442897) UID: 0 2024-04-04T14:11:34.498 INFO:tasks.ceph.osd.3.smithi072.stderr:2024-04-04T14:11:34.489+0000 7f0d67400640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 442897) UID: 0 2024-04-04T14:14:27.277 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T14:14:27.286 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T14:14:57.482 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T14:14:57.490 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T14:15:27.643 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T14:15:27.652 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T14:15:58.049 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T14:15:58.059 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T14:16:28.191 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T14:16:28.200 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T14:16:58.318 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T14:16:58.327 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T14:17:28.449 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T14:17:28.459 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T14:17:58.601 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T14:17:58.611 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T14:18:28.788 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T14:18:28.795 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T14:18:58.924 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T14:18:58.934 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T14:19:29.060 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T14:19:29.069 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T14:19:59.188 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T14:19:59.196 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T14:20:29.324 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T14:20:29.334 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T14:20:59.470 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T14:20:59.478 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T14:21:29.606 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T14:21:29.614 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T14:21:59.811 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T14:21:59.820 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T14:22:29.987 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T14:22:29.996 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T14:23:00.165 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T14:23:00.172 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T14:23:30.362 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T14:23:30.370 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T14:24:00.539 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T14:24:00.548 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T14:24:30.668 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T14:24:30.677 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T14:25:00.863 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T14:25:00.875 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T14:25:31.099 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T14:25:31.107 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T14:26:01.310 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T14:26:01.318 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T14:26:31.480 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T14:26:31.488 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T14:27:01.657 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T14:27:01.667 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T14:27:31.861 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T14:27:31.869 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T14:28:02.006 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T14:28:02.016 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T14:28:32.228 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T14:28:32.237 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T14:29:02.355 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T14:29:02.364 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T14:29:32.575 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T14:29:32.583 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T14:30:02.710 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T14:30:02.720 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T14:30:32.940 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T14:30:32.949 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T14:31:03.077 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T14:31:03.085 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T14:31:33.264 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T14:31:33.272 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T14:32:03.393 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T14:32:03.402 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T14:32:33.544 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T14:32:33.555 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T14:33:03.724 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T14:33:03.732 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T14:33:33.861 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T14:33:33.869 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T14:34:04.089 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T14:34:04.098 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T14:34:34.251 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T14:34:34.260 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T14:35:04.454 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T14:35:04.463 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T14:35:34.599 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T14:35:34.608 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T14:36:04.735 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T14:36:04.743 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T14:36:34.962 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T14:36:34.970 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T14:37:05.109 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T14:37:05.119 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T14:37:35.337 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T14:37:35.345 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T14:38:05.472 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T14:38:05.480 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T14:38:35.628 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T14:38:35.636 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T14:39:05.765 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T14:39:05.774 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T14:39:35.908 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T14:39:35.916 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T14:40:06.121 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T14:40:06.128 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T14:40:36.341 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T14:40:36.350 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T14:41:06.473 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T14:41:06.482 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T14:41:36.681 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T14:41:36.692 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T14:42:06.859 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T14:42:06.867 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T14:42:37.071 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T14:42:37.078 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T14:43:07.205 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T14:43:07.213 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T14:43:37.411 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T14:43:37.420 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T14:44:03.595 INFO:teuthology.orchestra.run.smithi072.stdout:generic/538 5957s 2024-04-04T14:44:03.611 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/538 2024-04-04T14:44:03.611 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T14:44:03.620 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:44:03.661 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T14:44:03.662 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/539) 2024-04-04T14:44:04.423 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T14:44:04.435 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T14:44:04.435 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:44:07.645 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T14:44:07.652 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T14:44:09.595 INFO:teuthology.orchestra.run.smithi072.stdout:generic/539 5s 2024-04-04T14:44:09.614 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/539 2024-04-04T14:44:09.614 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T14:44:09.623 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:44:09.658 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T14:44:09.658 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/540) 2024-04-04T14:44:10.471 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T14:44:10.482 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T14:44:10.482 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:44:10.859 INFO:teuthology.orchestra.run.smithi072.stdout:generic/540 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T14:44:10.868 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/540 2024-04-04T14:44:10.868 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/540 2024-04-04T14:44:10.869 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T14:44:10.875 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:44:10.897 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T14:44:10.897 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/541) 2024-04-04T14:44:11.417 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T14:44:11.429 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T14:44:11.429 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:44:11.756 INFO:teuthology.orchestra.run.smithi072.stdout:generic/541 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T14:44:11.767 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/541 2024-04-04T14:44:11.767 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/541 2024-04-04T14:44:11.767 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T14:44:11.774 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:44:11.798 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T14:44:11.798 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/542) 2024-04-04T14:44:12.319 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T14:44:12.331 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T14:44:12.331 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:44:12.692 INFO:teuthology.orchestra.run.smithi072.stdout:generic/542 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T14:44:12.703 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/542 2024-04-04T14:44:12.703 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/542 2024-04-04T14:44:12.703 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T14:44:12.714 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:44:12.740 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T14:44:12.740 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/543) 2024-04-04T14:44:13.243 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T14:44:13.255 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T14:44:13.255 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:44:13.674 INFO:teuthology.orchestra.run.smithi072.stdout:generic/543 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T14:44:13.685 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/543 2024-04-04T14:44:13.685 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/543 2024-04-04T14:44:13.685 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T14:44:13.693 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:44:13.722 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T14:44:13.722 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/544) 2024-04-04T14:44:14.243 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T14:44:14.255 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T14:44:14.255 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:44:14.698 INFO:teuthology.orchestra.run.smithi072.stdout:generic/544 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T14:44:14.709 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/544 2024-04-04T14:44:14.709 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/544 2024-04-04T14:44:14.709 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T14:44:14.719 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:44:14.746 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T14:44:14.746 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/545) 2024-04-04T14:44:15.242 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T14:44:15.254 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T14:44:15.254 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:44:15.754 INFO:teuthology.orchestra.run.smithi072.stdout:generic/545 [not run] file system doesn't support chattr +i 2024-04-04T14:44:15.764 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/545 2024-04-04T14:44:15.764 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/545 2024-04-04T14:44:15.764 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T14:44:15.773 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:44:15.800 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T14:44:15.800 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/546) 2024-04-04T14:44:16.257 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T14:44:16.268 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T14:44:16.268 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:44:16.802 INFO:teuthology.orchestra.run.smithi072.stdout:generic/546 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T14:44:16.813 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/546 2024-04-04T14:44:16.813 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/546 2024-04-04T14:44:16.813 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T14:44:16.824 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:44:16.854 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T14:44:16.854 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/547) 2024-04-04T14:44:17.346 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T14:44:17.357 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T14:44:17.357 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:44:17.753 INFO:teuthology.orchestra.run.smithi072.stdout:generic/547 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T14:44:17.764 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/547 2024-04-04T14:44:17.764 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/547 2024-04-04T14:44:17.764 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T14:44:17.773 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:44:17.800 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T14:44:17.800 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/548) 2024-04-04T14:44:18.346 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T14:44:18.358 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T14:44:18.358 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:44:18.804 INFO:teuthology.orchestra.run.smithi072.stdout:generic/548 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T14:44:18.815 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/548 2024-04-04T14:44:18.815 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/548 2024-04-04T14:44:18.815 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T14:44:18.824 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:44:18.852 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T14:44:18.852 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/549) 2024-04-04T14:44:19.358 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T14:44:19.371 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T14:44:19.371 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:44:19.840 INFO:teuthology.orchestra.run.smithi072.stdout:generic/549 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T14:44:19.853 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/549 2024-04-04T14:44:19.853 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/549 2024-04-04T14:44:19.853 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T14:44:19.864 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:44:19.894 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T14:44:19.894 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/550) 2024-04-04T14:44:20.427 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T14:44:20.438 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T14:44:20.438 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:44:20.959 INFO:teuthology.orchestra.run.smithi072.stdout:generic/550 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T14:44:20.969 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/550 2024-04-04T14:44:20.969 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/550 2024-04-04T14:44:20.969 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T14:44:20.978 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:44:21.005 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T14:44:21.005 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/551) 2024-04-04T14:44:21.517 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T14:44:21.529 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T14:44:21.529 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:44:21.907 INFO:teuthology.orchestra.run.smithi072.stdout:generic/551 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T14:44:21.918 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/551 2024-04-04T14:44:21.918 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/551 2024-04-04T14:44:21.918 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T14:44:21.927 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:44:21.955 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T14:44:21.955 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/552) 2024-04-04T14:44:22.461 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T14:44:22.472 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T14:44:22.473 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:44:22.923 INFO:teuthology.orchestra.run.smithi072.stdout:generic/552 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T14:44:22.936 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/552 2024-04-04T14:44:22.936 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/552 2024-04-04T14:44:22.936 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T14:44:22.946 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:44:22.976 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T14:44:22.976 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/553) 2024-04-04T14:44:23.489 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T14:44:23.502 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T14:44:23.502 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:44:24.041 INFO:teuthology.orchestra.run.smithi072.stdout:generic/553 [not run] xfs_io chattr +i failed (old kernel/wrong fs/bad args?) 2024-04-04T14:44:24.052 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/553 2024-04-04T14:44:24.052 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/553 2024-04-04T14:44:24.052 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T14:44:24.060 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:44:24.087 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T14:44:24.088 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/554) 2024-04-04T14:44:24.827 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T14:44:24.838 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T14:44:24.838 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:44:25.186 INFO:teuthology.orchestra.run.smithi072.stdout:generic/554 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T14:44:25.199 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/554 2024-04-04T14:44:25.200 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/554 2024-04-04T14:44:25.200 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T14:44:25.211 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:44:25.239 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T14:44:25.239 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/555) 2024-04-04T14:44:25.744 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T14:44:25.755 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T14:44:25.756 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:44:26.211 INFO:teuthology.orchestra.run.smithi072.stdout:generic/555 [not run] xfs_io chattr +ia failed (old kernel/wrong fs/bad args?) 2024-04-04T14:44:26.221 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/555 2024-04-04T14:44:26.221 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/555 2024-04-04T14:44:26.221 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T14:44:26.229 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:44:26.270 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T14:44:26.271 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/556) 2024-04-04T14:44:27.012 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T14:44:27.022 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T14:44:27.022 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:44:27.404 INFO:teuthology.orchestra.run.smithi072.stdout:generic/556 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T14:44:27.415 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/556 2024-04-04T14:44:27.415 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/556 2024-04-04T14:44:27.415 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T14:44:27.423 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:44:27.451 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T14:44:27.452 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/557) 2024-04-04T14:44:27.915 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T14:44:27.927 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T14:44:27.928 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:44:28.313 INFO:teuthology.orchestra.run.smithi072.stdout:generic/557 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T14:44:28.324 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/557 2024-04-04T14:44:28.324 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/557 2024-04-04T14:44:28.324 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T14:44:28.332 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:44:28.354 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T14:44:28.355 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/558) 2024-04-04T14:44:28.824 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T14:44:28.835 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T14:44:28.835 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:44:29.379 INFO:teuthology.orchestra.run.smithi072.stdout:generic/558 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T14:44:29.390 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/558 2024-04-04T14:44:29.390 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/558 2024-04-04T14:44:29.390 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T14:44:29.399 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:44:29.428 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T14:44:29.428 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/559) 2024-04-04T14:44:29.926 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T14:44:29.937 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T14:44:29.937 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:44:30.340 INFO:teuthology.orchestra.run.smithi072.stdout:generic/559 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T14:44:30.352 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/559 2024-04-04T14:44:30.353 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/559 2024-04-04T14:44:30.353 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T14:44:30.362 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:44:30.389 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T14:44:30.389 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/560) 2024-04-04T14:44:30.911 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T14:44:30.924 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T14:44:30.924 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:44:31.357 INFO:teuthology.orchestra.run.smithi072.stdout:generic/560 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T14:44:31.367 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/560 2024-04-04T14:44:31.367 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/560 2024-04-04T14:44:31.367 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T14:44:31.376 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:44:31.404 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T14:44:31.404 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/561) 2024-04-04T14:44:31.908 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T14:44:31.919 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T14:44:31.919 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:44:32.294 INFO:teuthology.orchestra.run.smithi072.stdout:generic/561 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T14:44:32.304 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/561 2024-04-04T14:44:32.304 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/561 2024-04-04T14:44:32.304 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T14:44:32.314 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:44:32.339 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T14:44:32.340 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/562) 2024-04-04T14:44:32.851 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T14:44:32.863 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T14:44:32.863 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:44:33.279 INFO:teuthology.orchestra.run.smithi072.stdout:generic/562 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T14:44:33.289 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/562 2024-04-04T14:44:33.289 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/562 2024-04-04T14:44:33.289 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T14:44:33.297 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:44:33.324 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T14:44:33.324 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/563) 2024-04-04T14:44:33.828 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T14:44:33.842 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T14:44:33.842 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:44:34.287 INFO:teuthology.orchestra.run.smithi072.stdout:generic/563 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T14:44:34.300 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/563 2024-04-04T14:44:34.300 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/563 2024-04-04T14:44:34.300 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T14:44:34.311 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:44:34.340 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T14:44:34.340 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/564) 2024-04-04T14:44:34.873 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T14:44:34.884 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T14:44:34.884 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:44:35.938 INFO:teuthology.orchestra.run.smithi072.stdout:generic/564 1s 2024-04-04T14:44:35.955 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/564 2024-04-04T14:44:35.955 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T14:44:35.963 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:44:36.005 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T14:44:36.006 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/565) 2024-04-04T14:44:36.758 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T14:44:36.769 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T14:44:36.769 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:44:37.129 INFO:teuthology.orchestra.run.smithi072.stdout:generic/565 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T14:44:37.141 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/565 2024-04-04T14:44:37.141 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/565 2024-04-04T14:44:37.141 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T14:44:37.150 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:44:37.174 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T14:44:37.174 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/566) 2024-04-04T14:44:37.683 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T14:44:37.693 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T14:44:37.693 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:44:37.784 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T14:44:37.789 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T14:44:38.025 INFO:teuthology.orchestra.run.smithi072.stdout:generic/566 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T14:44:38.034 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/566 2024-04-04T14:44:38.035 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/566 2024-04-04T14:44:38.035 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T14:44:38.043 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:44:38.068 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T14:44:38.069 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/567) 2024-04-04T14:44:38.596 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T14:44:38.607 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T14:44:38.607 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:44:38.972 INFO:teuthology.orchestra.run.smithi072.stdout:generic/567 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T14:44:38.983 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/567 2024-04-04T14:44:38.983 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/567 2024-04-04T14:44:38.983 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T14:44:38.991 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:44:39.018 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T14:44:39.019 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/568) 2024-04-04T14:44:39.487 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T14:44:39.499 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T14:44:39.499 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:44:40.029 INFO:teuthology.orchestra.run.smithi072.stdout:generic/568 0s 2024-04-04T14:44:40.060 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/568 2024-04-04T14:44:40.060 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T14:44:40.075 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:44:40.122 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T14:44:40.122 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/569) 2024-04-04T14:44:40.767 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T14:44:40.778 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T14:44:40.778 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:44:41.202 INFO:teuthology.orchestra.run.smithi072.stdout:generic/569 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T14:44:41.214 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/569 2024-04-04T14:44:41.214 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/569 2024-04-04T14:44:41.214 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T14:44:41.225 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:44:41.253 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T14:44:41.253 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/570) 2024-04-04T14:44:41.786 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T14:44:41.800 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T14:44:41.800 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:44:42.180 INFO:teuthology.orchestra.run.smithi072.stdout:generic/570 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T14:44:42.194 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/570 2024-04-04T14:44:42.194 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/570 2024-04-04T14:44:42.195 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T14:44:42.207 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:44:42.238 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T14:44:42.239 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/571) 2024-04-04T14:44:42.744 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T14:44:42.759 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T14:44:42.759 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:44:49.400 INFO:teuthology.orchestra.run.smithi072.stdout:generic/571 7s 2024-04-04T14:44:49.415 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/571 2024-04-04T14:44:49.415 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T14:44:49.423 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:44:49.453 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T14:44:49.454 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/572) 2024-04-04T14:44:50.197 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T14:44:50.208 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T14:44:50.208 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:44:50.562 INFO:teuthology.orchestra.run.smithi072.stdout:generic/572 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T14:44:50.572 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/572 2024-04-04T14:44:50.572 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/572 2024-04-04T14:44:50.572 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T14:44:50.580 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:44:50.603 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T14:44:50.603 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/573) 2024-04-04T14:44:51.065 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T14:44:51.076 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T14:44:51.076 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:44:51.434 INFO:teuthology.orchestra.run.smithi072.stdout:generic/573 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T14:44:51.443 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/573 2024-04-04T14:44:51.444 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/573 2024-04-04T14:44:51.444 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T14:44:51.452 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:44:51.477 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T14:44:51.478 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/574) 2024-04-04T14:44:51.958 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T14:44:51.970 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T14:44:51.970 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:44:52.350 INFO:teuthology.orchestra.run.smithi072.stdout:generic/574 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T14:44:52.363 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/574 2024-04-04T14:44:52.363 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/574 2024-04-04T14:44:52.363 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T14:44:52.373 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:44:52.399 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T14:44:52.399 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/575) 2024-04-04T14:44:52.937 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T14:44:52.949 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T14:44:52.949 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:44:53.313 INFO:teuthology.orchestra.run.smithi072.stdout:generic/575 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T14:44:53.323 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/575 2024-04-04T14:44:53.323 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/575 2024-04-04T14:44:53.323 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T14:44:53.333 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:44:53.361 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T14:44:53.361 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/576) 2024-04-04T14:44:53.871 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T14:44:53.883 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T14:44:53.883 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:44:54.321 INFO:teuthology.orchestra.run.smithi072.stdout:generic/576 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T14:44:54.335 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/576 2024-04-04T14:44:54.335 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/576 2024-04-04T14:44:54.335 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T14:44:54.345 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:44:54.376 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T14:44:54.377 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/577) 2024-04-04T14:44:54.905 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T14:44:54.916 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T14:44:54.916 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:44:55.280 INFO:teuthology.orchestra.run.smithi072.stdout:generic/577 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T14:44:55.290 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/577 2024-04-04T14:44:55.290 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/577 2024-04-04T14:44:55.290 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T14:44:55.298 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:44:55.327 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T14:44:55.327 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/578) 2024-04-04T14:44:55.816 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T14:44:55.826 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T14:44:55.827 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:44:56.254 INFO:teuthology.orchestra.run.smithi072.stdout:generic/578 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-04-04T14:44:56.264 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/578 2024-04-04T14:44:56.264 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/578 2024-04-04T14:44:56.264 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T14:44:56.272 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:44:56.301 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T14:44:56.301 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/579) 2024-04-04T14:44:56.783 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T14:44:56.794 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T14:44:56.794 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:44:57.187 INFO:teuthology.orchestra.run.smithi072.stdout:generic/579 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T14:44:57.198 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/579 2024-04-04T14:44:57.198 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/579 2024-04-04T14:44:57.198 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T14:44:57.207 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:44:57.234 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T14:44:57.234 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/580) 2024-04-04T14:44:57.749 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T14:44:57.760 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T14:44:57.760 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:44:58.211 INFO:teuthology.orchestra.run.smithi072.stdout:generic/580 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T14:44:58.223 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/580 2024-04-04T14:44:58.223 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/580 2024-04-04T14:44:58.223 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T14:44:58.233 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:44:58.262 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T14:44:58.262 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/581) 2024-04-04T14:44:58.837 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T14:44:58.849 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T14:44:58.849 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:45:00.386 INFO:teuthology.orchestra.run.smithi072.stdout:generic/581 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T14:45:00.401 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/581 2024-04-04T14:45:00.401 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/581 2024-04-04T14:45:00.401 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T14:45:00.412 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:45:00.443 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T14:45:00.443 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/582) 2024-04-04T14:45:00.934 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T14:45:00.947 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T14:45:00.947 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:45:01.428 INFO:teuthology.orchestra.run.smithi072.stdout:generic/582 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T14:45:01.439 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/582 2024-04-04T14:45:01.439 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/582 2024-04-04T14:45:01.439 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T14:45:01.448 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:45:01.484 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T14:45:01.484 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/583) 2024-04-04T14:45:02.018 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T14:45:02.030 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T14:45:02.030 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:45:02.481 INFO:teuthology.orchestra.run.smithi072.stdout:generic/583 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T14:45:02.490 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/583 2024-04-04T14:45:02.491 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/583 2024-04-04T14:45:02.491 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T14:45:02.498 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:45:02.526 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T14:45:02.527 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/584) 2024-04-04T14:45:03.057 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T14:45:03.069 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T14:45:03.069 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:45:03.536 INFO:teuthology.orchestra.run.smithi072.stdout:generic/584 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T14:45:03.549 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/584 2024-04-04T14:45:03.549 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/584 2024-04-04T14:45:03.549 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T14:45:03.559 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:45:03.586 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T14:45:03.586 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/585) 2024-04-04T14:45:04.110 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T14:45:04.124 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T14:45:04.124 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:45:04.527 INFO:teuthology.orchestra.run.smithi072.stdout:generic/585 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T14:45:04.539 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/585 2024-04-04T14:45:04.539 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/585 2024-04-04T14:45:04.539 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T14:45:04.547 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:45:04.573 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T14:45:04.573 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/586) 2024-04-04T14:45:05.091 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T14:45:05.103 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T14:45:05.104 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:45:07.920 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T14:45:07.928 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T14:45:38.124 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T14:45:38.134 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T14:45:54.697 INFO:teuthology.orchestra.run.smithi072.stdout:generic/586 49s 2024-04-04T14:45:54.718 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/586 2024-04-04T14:45:54.718 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T14:45:54.727 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:45:54.793 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T14:45:54.793 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/587) 2024-04-04T14:45:55.552 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T14:45:55.564 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T14:45:55.564 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:45:56.247 INFO:teuthology.orchestra.run.smithi072.stdout:generic/587 [not run] disk quotas not supported by this filesystem type: ceph-fuse 2024-04-04T14:45:56.257 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/587 2024-04-04T14:45:56.257 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/587 2024-04-04T14:45:56.257 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T14:45:56.264 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:45:56.290 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T14:45:56.290 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/588) 2024-04-04T14:45:56.762 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T14:45:56.775 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T14:45:56.775 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:45:57.240 INFO:teuthology.orchestra.run.smithi072.stdout:generic/588 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T14:45:57.250 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/588 2024-04-04T14:45:57.250 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/588 2024-04-04T14:45:57.250 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T14:45:57.258 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:45:57.285 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T14:45:57.285 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/589) 2024-04-04T14:45:57.839 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T14:45:57.849 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T14:45:57.850 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:45:58.241 INFO:teuthology.orchestra.run.smithi072.stdout:generic/589 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T14:45:58.252 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/589 2024-04-04T14:45:58.252 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/589 2024-04-04T14:45:58.252 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T14:45:58.261 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:45:58.288 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T14:45:58.288 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/590) 2024-04-04T14:45:58.785 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T14:45:58.797 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T14:45:58.797 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:45:59.187 INFO:teuthology.orchestra.run.smithi072.stdout:generic/590 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T14:45:59.199 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/590 2024-04-04T14:45:59.199 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/590 2024-04-04T14:45:59.200 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T14:45:59.210 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:45:59.238 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T14:45:59.239 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/591) 2024-04-04T14:45:59.765 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T14:45:59.777 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T14:45:59.777 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:46:00.527 INFO:teuthology.orchestra.run.smithi072.stdout:generic/591 1s 2024-04-04T14:46:00.542 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/591 2024-04-04T14:46:00.542 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T14:46:00.550 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:46:00.577 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T14:46:00.577 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/592) 2024-04-04T14:46:01.368 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T14:46:01.380 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T14:46:01.380 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:46:01.801 INFO:teuthology.orchestra.run.smithi072.stdout:generic/592 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T14:46:01.811 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/592 2024-04-04T14:46:01.811 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/592 2024-04-04T14:46:01.811 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T14:46:01.819 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:46:01.847 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T14:46:01.847 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/593) 2024-04-04T14:46:02.337 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T14:46:02.349 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T14:46:02.349 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:46:02.824 INFO:teuthology.orchestra.run.smithi072.stdout:generic/593 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T14:46:02.834 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/593 2024-04-04T14:46:02.834 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/593 2024-04-04T14:46:02.834 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T14:46:02.842 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:46:02.869 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T14:46:02.869 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/594) 2024-04-04T14:46:03.375 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T14:46:03.386 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T14:46:03.387 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:46:03.761 INFO:teuthology.orchestra.run.smithi072.stdout:generic/594 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T14:46:03.775 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/594 2024-04-04T14:46:03.775 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/594 2024-04-04T14:46:03.775 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T14:46:03.785 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:46:03.815 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T14:46:03.815 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/595) 2024-04-04T14:46:04.325 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T14:46:04.336 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T14:46:04.336 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:46:04.873 INFO:teuthology.orchestra.run.smithi072.stdout:generic/595 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T14:46:04.886 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/595 2024-04-04T14:46:04.886 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/595 2024-04-04T14:46:04.886 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T14:46:04.897 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:46:04.928 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T14:46:04.928 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/596) 2024-04-04T14:46:05.419 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T14:46:05.429 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T14:46:05.430 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:46:05.913 INFO:teuthology.orchestra.run.smithi072.stdout:generic/596 [not run] file system doesn't support chattr +S 2024-04-04T14:46:05.921 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/596 2024-04-04T14:46:05.922 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/596 2024-04-04T14:46:05.922 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T14:46:05.930 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:46:05.956 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T14:46:05.956 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/597) 2024-04-04T14:46:06.463 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T14:46:06.475 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T14:46:06.475 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:46:08.158 INFO:teuthology.orchestra.run.smithi072.stdout:generic/597 - output mismatch (see /tmp/tmp.tiFz9P8iUAxfstests-dev/results//generic/597.out.bad) 2024-04-04T14:46:08.165 INFO:teuthology.orchestra.run.smithi072.stdout: --- tests/generic/597.out 2024-04-04 06:58:02.273452287 +0000 2024-04-04T14:46:08.166 INFO:teuthology.orchestra.run.smithi072.stdout: +++ /tmp/tmp.tiFz9P8iUAxfstests-dev/results//generic/597.out.bad 2024-04-04 14:46:08.154502193 +0000 2024-04-04T14:46:08.166 INFO:teuthology.orchestra.run.smithi072.stdout: @@ -4,11 +4,11 @@ 2024-04-04T14:46:08.166 INFO:teuthology.orchestra.run.smithi072.stdout: fs.protected_symlinks = 0 2024-04-04T14:46:08.166 INFO:teuthology.orchestra.run.smithi072.stdout: successfully followed symlink 2024-04-04T14:46:08.166 INFO:teuthology.orchestra.run.smithi072.stdout: fs.protected_symlinks = 1 2024-04-04T14:46:08.166 INFO:teuthology.orchestra.run.smithi072.stdout: -Permission denied 2024-04-04T14:46:08.166 INFO:teuthology.orchestra.run.smithi072.stdout: +successfully followed symlink 2024-04-04T14:46:08.166 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:46:08.166 INFO:teuthology.orchestra.run.smithi072.stdout: == Test hardlink create protection when 2024-04-04T14:46:08.166 INFO:teuthology.orchestra.run.smithi072.stdout: == process != target owner and process cannot read target 2024-04-04T14:46:08.166 INFO:teuthology.orchestra.run.smithi072.stdout: fs.protected_hardlinks = 0 2024-04-04T14:46:08.166 INFO:teuthology.orchestra.run.smithi072.stdout: -successfully created hardlink 2024-04-04T14:46:08.167 INFO:teuthology.orchestra.run.smithi072.stdout: +Permission denied 2024-04-04T14:46:08.167 INFO:teuthology.orchestra.run.smithi072.stdout: fs.protected_hardlinks = 1 2024-04-04T14:46:08.167 INFO:teuthology.orchestra.run.smithi072.stdout: -ln: failed to create hard link 'TEST_DIR/597/sticky_dir/hardlink' => 'TEST_DIR/597/target': Operation not permitted 2024-04-04T14:46:08.167 INFO:teuthology.orchestra.run.smithi072.stdout: +Permission denied 2024-04-04T14:46:08.172 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/597 2024-04-04T14:46:08.173 INFO:teuthology.orchestra.run.smithi072.stdout:Failures: generic/597 2024-04-04T14:46:08.173 INFO:teuthology.orchestra.run.smithi072.stdout:Failed 1 of 1 tests 2024-04-04T14:46:08.181 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:46:08.207 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-04T14:46:08.207 INFO:tasks.cephfs.xfstests_dev:Command failed 2024-04-04T14:46:08.207 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2024-04-04T14:46:08.208 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/598) 2024-04-04T14:46:08.259 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T14:46:08.279 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T14:46:08.945 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T14:46:08.956 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T14:46:08.956 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:46:10.421 INFO:teuthology.orchestra.run.smithi072.stdout:generic/598 - output mismatch (see /tmp/tmp.tiFz9P8iUAxfstests-dev/results//generic/598.out.bad) 2024-04-04T14:46:10.427 INFO:teuthology.orchestra.run.smithi072.stdout: --- tests/generic/598.out 2024-04-04 06:58:02.273452287 +0000 2024-04-04T14:46:10.427 INFO:teuthology.orchestra.run.smithi072.stdout: +++ /tmp/tmp.tiFz9P8iUAxfstests-dev/results//generic/598.out.bad 2024-04-04 14:46:10.416455675 +0000 2024-04-04T14:46:10.427 INFO:teuthology.orchestra.run.smithi072.stdout: @@ -5,13 +5,10 @@ 2024-04-04T14:46:10.427 INFO:teuthology.orchestra.run.smithi072.stdout: = only group writable dir 2024-04-04T14:46:10.427 INFO:teuthology.orchestra.run.smithi072.stdout: fs.protected_regular = 1 2024-04-04T14:46:10.427 INFO:teuthology.orchestra.run.smithi072.stdout: = group & world writable dir 2024-04-04T14:46:10.427 INFO:teuthology.orchestra.run.smithi072.stdout: -Permission denied 2024-04-04T14:46:10.427 INFO:teuthology.orchestra.run.smithi072.stdout: = only group writable dir 2024-04-04T14:46:10.428 INFO:teuthology.orchestra.run.smithi072.stdout: fs.protected_regular = 2 2024-04-04T14:46:10.428 INFO:teuthology.orchestra.run.smithi072.stdout: = group & world writable dir 2024-04-04T14:46:10.428 INFO:teuthology.orchestra.run.smithi072.stdout: -Permission denied 2024-04-04T14:46:10.428 INFO:teuthology.orchestra.run.smithi072.stdout: = only group writable dir 2024-04-04T14:46:10.428 INFO:teuthology.orchestra.run.smithi072.stdout: -Permission denied 2024-04-04T14:46:10.428 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:46:10.428 INFO:teuthology.orchestra.run.smithi072.stdout: == Test fifo open when owned by another and fifo owner != dir owner 2024-04-04T14:46:10.428 INFO:teuthology.orchestra.run.smithi072.stdout: fs.protected_fifos = 0 2024-04-04T14:46:10.428 INFO:teuthology.orchestra.run.smithi072.stdout: @@ -19,10 +16,7 @@ 2024-04-04T14:46:10.428 INFO:teuthology.orchestra.run.smithi072.stdout: = only group writable dir 2024-04-04T14:46:10.428 INFO:teuthology.orchestra.run.smithi072.stdout: fs.protected_fifos = 1 2024-04-04T14:46:10.428 INFO:teuthology.orchestra.run.smithi072.stdout: = group & world writable dir 2024-04-04T14:46:10.428 INFO:teuthology.orchestra.run.smithi072.stdout: -Permission denied 2024-04-04T14:46:10.428 INFO:teuthology.orchestra.run.smithi072.stdout: = only group writable dir 2024-04-04T14:46:10.429 INFO:teuthology.orchestra.run.smithi072.stdout: fs.protected_fifos = 2 2024-04-04T14:46:10.429 INFO:teuthology.orchestra.run.smithi072.stdout: = group & world writable dir 2024-04-04T14:46:10.429 INFO:teuthology.orchestra.run.smithi072.stdout: -Permission denied 2024-04-04T14:46:10.429 INFO:teuthology.orchestra.run.smithi072.stdout: = only group writable dir 2024-04-04T14:46:10.429 INFO:teuthology.orchestra.run.smithi072.stdout: -Permission denied 2024-04-04T14:46:10.434 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/598 2024-04-04T14:46:10.434 INFO:teuthology.orchestra.run.smithi072.stdout:Failures: generic/598 2024-04-04T14:46:10.434 INFO:teuthology.orchestra.run.smithi072.stdout:Failed 1 of 1 tests 2024-04-04T14:46:10.442 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:46:10.468 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-04T14:46:10.468 INFO:tasks.cephfs.xfstests_dev:Command failed 2024-04-04T14:46:10.468 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2024-04-04T14:46:10.468 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/599) 2024-04-04T14:46:11.220 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T14:46:11.230 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T14:46:11.253 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:46:11.571 INFO:teuthology.orchestra.run.smithi072.stdout:generic/599 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T14:46:11.581 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/599 2024-04-04T14:46:11.582 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/599 2024-04-04T14:46:11.582 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T14:46:11.590 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:46:11.616 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T14:46:11.617 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/600) 2024-04-04T14:46:12.124 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T14:46:12.139 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T14:46:12.140 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:46:12.551 INFO:teuthology.orchestra.run.smithi072.stdout:generic/600 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T14:46:12.563 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/600 2024-04-04T14:46:12.563 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/600 2024-04-04T14:46:12.563 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T14:46:12.574 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:46:12.604 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T14:46:12.604 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/601) 2024-04-04T14:46:13.104 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T14:46:13.115 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T14:46:13.115 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:46:13.488 INFO:teuthology.orchestra.run.smithi072.stdout:generic/601 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T14:46:13.499 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/601 2024-04-04T14:46:13.499 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/601 2024-04-04T14:46:13.499 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T14:46:13.507 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:46:13.534 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T14:46:13.534 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/602) 2024-04-04T14:46:14.035 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T14:46:14.046 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T14:46:14.046 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:46:14.562 INFO:teuthology.orchestra.run.smithi072.stdout:generic/602 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T14:46:14.575 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/602 2024-04-04T14:46:14.575 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/602 2024-04-04T14:46:14.575 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T14:46:14.585 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:46:14.617 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T14:46:14.617 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/603) 2024-04-04T14:46:15.147 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T14:46:15.160 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T14:46:15.160 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:46:15.545 INFO:teuthology.orchestra.run.smithi072.stdout:generic/603 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T14:46:15.555 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/603 2024-04-04T14:46:15.556 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/603 2024-04-04T14:46:15.556 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T14:46:15.564 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:46:15.593 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T14:46:15.593 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/604) 2024-04-04T14:46:16.129 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T14:46:16.141 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T14:46:16.141 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:46:16.584 INFO:teuthology.orchestra.run.smithi072.stdout:generic/604 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T14:46:16.598 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/604 2024-04-04T14:46:16.599 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/604 2024-04-04T14:46:16.599 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T14:46:16.609 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:46:16.639 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T14:46:16.639 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/605) 2024-04-04T14:46:17.186 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T14:46:17.200 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T14:46:17.200 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:46:17.569 INFO:teuthology.orchestra.run.smithi072.stdout:generic/605 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T14:46:17.579 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/605 2024-04-04T14:46:17.579 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/605 2024-04-04T14:46:17.579 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T14:46:17.587 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:46:17.614 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T14:46:17.614 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/606) 2024-04-04T14:46:18.101 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T14:46:18.113 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T14:46:18.114 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:46:18.482 INFO:teuthology.orchestra.run.smithi072.stdout:generic/606 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T14:46:18.493 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/606 2024-04-04T14:46:18.493 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/606 2024-04-04T14:46:18.493 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T14:46:18.502 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:46:18.530 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T14:46:18.530 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/607) 2024-04-04T14:46:19.034 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T14:46:19.044 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T14:46:19.045 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:46:19.408 INFO:teuthology.orchestra.run.smithi072.stdout:generic/607 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T14:46:19.421 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/607 2024-04-04T14:46:19.421 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/607 2024-04-04T14:46:19.421 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T14:46:19.429 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:46:19.455 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T14:46:19.456 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/608) 2024-04-04T14:46:19.949 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T14:46:19.960 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T14:46:19.960 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:46:20.371 INFO:teuthology.orchestra.run.smithi072.stdout:generic/608 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T14:46:20.381 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/608 2024-04-04T14:46:20.381 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/608 2024-04-04T14:46:20.381 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T14:46:20.389 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:46:20.414 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T14:46:20.414 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/609) 2024-04-04T14:46:20.922 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T14:46:20.934 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T14:46:20.934 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:46:21.965 INFO:teuthology.orchestra.run.smithi072.stdout:generic/609 1s 2024-04-04T14:46:21.983 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/609 2024-04-04T14:46:21.983 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T14:46:21.994 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:46:22.026 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T14:46:22.026 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/610) 2024-04-04T14:46:22.790 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T14:46:22.801 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T14:46:22.801 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:46:23.185 INFO:teuthology.orchestra.run.smithi072.stdout:generic/610 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T14:46:23.198 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/610 2024-04-04T14:46:23.198 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/610 2024-04-04T14:46:23.198 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T14:46:23.207 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:46:23.236 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T14:46:23.236 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/611) 2024-04-04T14:46:23.764 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T14:46:23.776 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T14:46:23.776 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:46:24.125 INFO:teuthology.orchestra.run.smithi072.stdout:generic/611 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T14:46:24.136 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/611 2024-04-04T14:46:24.136 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/611 2024-04-04T14:46:24.136 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T14:46:24.145 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:46:24.173 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T14:46:24.173 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/612) 2024-04-04T14:46:24.656 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T14:46:24.667 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T14:46:24.667 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:46:25.220 INFO:teuthology.orchestra.run.smithi072.stdout:generic/612 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-04-04T14:46:25.232 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/612 2024-04-04T14:46:25.232 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/612 2024-04-04T14:46:25.232 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T14:46:25.241 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:46:25.293 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T14:46:25.293 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/613) 2024-04-04T14:46:26.061 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T14:46:26.072 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T14:46:26.072 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:46:26.540 INFO:teuthology.orchestra.run.smithi072.stdout:generic/613 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T14:46:26.551 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/613 2024-04-04T14:46:26.551 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/613 2024-04-04T14:46:26.552 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T14:46:26.559 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:46:26.585 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T14:46:26.585 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/614) 2024-04-04T14:46:27.142 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T14:46:27.154 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T14:46:27.154 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:46:27.548 INFO:teuthology.orchestra.run.smithi072.stdout:generic/614 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T14:46:27.559 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/614 2024-04-04T14:46:27.560 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/614 2024-04-04T14:46:27.560 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T14:46:27.570 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:46:27.598 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T14:46:27.599 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/615) 2024-04-04T14:46:28.100 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T14:46:28.113 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T14:46:28.113 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:46:28.478 INFO:teuthology.orchestra.run.smithi072.stdout:generic/615 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T14:46:28.487 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/615 2024-04-04T14:46:28.487 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/615 2024-04-04T14:46:28.488 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T14:46:28.496 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:46:28.522 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T14:46:28.522 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/616) 2024-04-04T14:46:29.004 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T14:46:29.015 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T14:46:29.016 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:46:29.434 INFO:teuthology.orchestra.run.smithi072.stdout:generic/616 [not run] kernel does not support IO_URING 2024-04-04T14:46:29.444 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/616 2024-04-04T14:46:29.444 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/616 2024-04-04T14:46:29.445 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T14:46:29.452 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:46:29.479 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T14:46:29.479 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/617) 2024-04-04T14:46:29.988 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T14:46:30.000 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T14:46:30.000 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:46:30.479 INFO:teuthology.orchestra.run.smithi072.stdout:generic/617 [not run] kernel does not support IO_URING 2024-04-04T14:46:30.493 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/617 2024-04-04T14:46:30.493 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/617 2024-04-04T14:46:30.493 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T14:46:30.504 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:46:30.536 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T14:46:30.536 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/618) 2024-04-04T14:46:31.049 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T14:46:31.061 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T14:46:31.061 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:46:31.454 INFO:teuthology.orchestra.run.smithi072.stdout:generic/618 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T14:46:31.467 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/618 2024-04-04T14:46:31.467 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/618 2024-04-04T14:46:31.467 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T14:46:31.476 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:46:31.504 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T14:46:31.504 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/619) 2024-04-04T14:46:31.981 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T14:46:31.993 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T14:46:31.993 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:46:32.381 INFO:teuthology.orchestra.run.smithi072.stdout:generic/619 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T14:46:32.393 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/619 2024-04-04T14:46:32.393 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/619 2024-04-04T14:46:32.393 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T14:46:32.403 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:46:32.432 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T14:46:32.432 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/620) 2024-04-04T14:46:32.934 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T14:46:32.947 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T14:46:32.947 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:46:33.366 INFO:teuthology.orchestra.run.smithi072.stdout:generic/620 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T14:46:33.379 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/620 2024-04-04T14:46:33.380 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/620 2024-04-04T14:46:33.380 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T14:46:33.392 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:46:33.422 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T14:46:33.423 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/621) 2024-04-04T14:46:33.940 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T14:46:33.951 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T14:46:33.951 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:46:34.489 INFO:teuthology.orchestra.run.smithi072.stdout:generic/621 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T14:46:34.500 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/621 2024-04-04T14:46:34.500 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/621 2024-04-04T14:46:34.501 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T14:46:34.510 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:46:34.540 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T14:46:34.540 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/622) 2024-04-04T14:46:35.057 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T14:46:35.068 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T14:46:35.069 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:46:35.459 INFO:teuthology.orchestra.run.smithi072.stdout:generic/622 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T14:46:35.472 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/622 2024-04-04T14:46:35.472 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/622 2024-04-04T14:46:35.473 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T14:46:35.483 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:46:35.513 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T14:46:35.514 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/623) 2024-04-04T14:46:35.998 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T14:46:36.010 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T14:46:36.011 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:46:36.398 INFO:teuthology.orchestra.run.smithi072.stdout:generic/623 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T14:46:36.411 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/623 2024-04-04T14:46:36.411 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/623 2024-04-04T14:46:36.412 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T14:46:36.422 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:46:36.451 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T14:46:36.451 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/624) 2024-04-04T14:46:36.941 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T14:46:36.952 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T14:46:36.953 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:46:37.349 INFO:teuthology.orchestra.run.smithi072.stdout:generic/624 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T14:46:37.360 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/624 2024-04-04T14:46:37.360 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/624 2024-04-04T14:46:37.360 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T14:46:37.369 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:46:37.395 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T14:46:37.395 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/625) 2024-04-04T14:46:37.897 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T14:46:37.908 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T14:46:37.908 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:46:38.253 INFO:teuthology.orchestra.run.smithi072.stdout:generic/625 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T14:46:38.266 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/625 2024-04-04T14:46:38.266 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/625 2024-04-04T14:46:38.266 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T14:46:38.276 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:46:38.302 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T14:46:38.303 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/626) 2024-04-04T14:46:38.550 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T14:46:38.555 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T14:46:38.810 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T14:46:38.823 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T14:46:38.823 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:46:39.207 INFO:teuthology.orchestra.run.smithi072.stdout:generic/626 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T14:46:39.217 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/626 2024-04-04T14:46:39.218 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/626 2024-04-04T14:46:39.218 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T14:46:39.226 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:46:39.256 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T14:46:39.256 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/627) 2024-04-04T14:46:39.794 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T14:46:39.807 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T14:46:39.807 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:46:40.175 INFO:teuthology.orchestra.run.smithi072.stdout:generic/627 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T14:46:40.186 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/627 2024-04-04T14:46:40.187 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/627 2024-04-04T14:46:40.187 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T14:46:40.198 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:46:40.224 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T14:46:40.225 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/628) 2024-04-04T14:46:40.771 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T14:46:40.784 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T14:46:40.784 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:46:41.197 INFO:teuthology.orchestra.run.smithi072.stdout:generic/628 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T14:46:41.209 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/628 2024-04-04T14:46:41.209 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/628 2024-04-04T14:46:41.209 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T14:46:41.219 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:46:41.245 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T14:46:41.245 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/629) 2024-04-04T14:46:41.728 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T14:46:41.742 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T14:46:41.742 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:46:42.138 INFO:teuthology.orchestra.run.smithi072.stdout:generic/629 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T14:46:42.148 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/629 2024-04-04T14:46:42.149 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/629 2024-04-04T14:46:42.149 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T14:46:42.156 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:46:42.183 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T14:46:42.183 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/630) 2024-04-04T14:46:42.754 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T14:46:42.763 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T14:46:42.764 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:46:43.110 INFO:teuthology.orchestra.run.smithi072.stdout:generic/630 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T14:46:43.123 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/630 2024-04-04T14:46:43.123 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/630 2024-04-04T14:46:43.123 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T14:46:43.134 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:46:43.159 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T14:46:43.160 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/631) 2024-04-04T14:46:43.673 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T14:46:43.684 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T14:46:43.684 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:46:44.100 INFO:teuthology.orchestra.run.smithi072.stdout:generic/631 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T14:46:44.110 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/631 2024-04-04T14:46:44.110 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/631 2024-04-04T14:46:44.110 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T14:46:44.117 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:46:44.142 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T14:46:44.143 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/632) 2024-04-04T14:46:44.648 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T14:46:44.659 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T14:46:44.659 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:47:04.413 INFO:teuthology.orchestra.run.smithi072.stdout:generic/632 20s 2024-04-04T14:47:04.428 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/632 2024-04-04T14:47:04.428 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T14:47:04.436 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:47:04.464 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T14:47:04.465 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/633) 2024-04-04T14:47:04.958 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T14:47:04.968 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T14:47:04.969 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:47:05.723 INFO:teuthology.orchestra.run.smithi072.stdout:generic/633 [failed, exit status 1]- output mismatch (see /tmp/tmp.tiFz9P8iUAxfstests-dev/results//generic/633.out.bad) 2024-04-04T14:47:05.745 INFO:teuthology.orchestra.run.smithi072.stdout: --- tests/generic/633.out 2024-04-04 06:58:02.278452183 +0000 2024-04-04T14:47:05.745 INFO:teuthology.orchestra.run.smithi072.stdout: +++ /tmp/tmp.tiFz9P8iUAxfstests-dev/results//generic/633.out.bad 2024-04-04 14:47:05.713318479 +0000 2024-04-04T14:47:05.745 INFO:teuthology.orchestra.run.smithi072.stdout: @@ -1,2 +1,5 @@ 2024-04-04T14:47:05.745 INFO:teuthology.orchestra.run.smithi072.stdout: QA output created by 633 2024-04-04T14:47:05.745 INFO:teuthology.orchestra.run.smithi072.stdout: Silence is golden 2024-04-04T14:47:05.745 INFO:teuthology.orchestra.run.smithi072.stdout: +vfstest.c: 1164: protected_symlinks - Success - failure: openat 2024-04-04T14:47:05.745 INFO:teuthology.orchestra.run.smithi072.stdout: +vfstest.c: 1171: protected_symlinks - Success - failure: wait_for_pid 2024-04-04T14:47:05.745 INFO:teuthology.orchestra.run.smithi072.stdout: +vfstest.c: 2418: run_test - Success - failure: following protected symlinks on regular mounts 2024-04-04T14:47:05.756 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/633 2024-04-04T14:47:05.756 INFO:teuthology.orchestra.run.smithi072.stdout:Failures: generic/633 2024-04-04T14:47:05.756 INFO:teuthology.orchestra.run.smithi072.stdout:Failed 1 of 1 tests 2024-04-04T14:47:05.768 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:47:05.806 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-04T14:47:05.807 INFO:tasks.cephfs.xfstests_dev:Command failed 2024-04-04T14:47:05.807 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2024-04-04T14:47:05.807 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/634) 2024-04-04T14:47:06.481 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T14:47:06.494 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T14:47:06.494 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:47:06.853 INFO:teuthology.orchestra.run.smithi072.stdout:generic/634 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T14:47:06.865 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/634 2024-04-04T14:47:06.865 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/634 2024-04-04T14:47:06.865 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T14:47:06.875 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:47:06.902 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T14:47:06.902 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/635) 2024-04-04T14:47:07.431 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T14:47:07.441 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T14:47:07.442 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:47:07.806 INFO:teuthology.orchestra.run.smithi072.stdout:generic/635 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T14:47:07.816 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/635 2024-04-04T14:47:07.816 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/635 2024-04-04T14:47:07.816 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T14:47:07.824 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:47:07.848 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T14:47:07.849 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/636) 2024-04-04T14:47:08.354 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T14:47:08.364 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T14:47:08.364 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:47:08.743 INFO:teuthology.orchestra.run.smithi072.stdout:generic/636 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T14:47:08.756 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/636 2024-04-04T14:47:08.756 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/636 2024-04-04T14:47:08.756 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T14:47:08.765 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:47:08.776 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T14:47:08.781 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T14:47:08.792 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T14:47:08.793 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/637) 2024-04-04T14:47:09.298 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T14:47:09.308 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T14:47:09.308 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:47:11.616 INFO:teuthology.orchestra.run.smithi072.stdout:generic/637 2s 2024-04-04T14:47:11.636 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/637 2024-04-04T14:47:11.636 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T14:47:11.647 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:47:11.681 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T14:47:11.682 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/638) 2024-04-04T14:47:12.446 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T14:47:12.456 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T14:47:12.457 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:47:12.869 INFO:teuthology.orchestra.run.smithi072.stdout:generic/638 0s 2024-04-04T14:47:12.885 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/638 2024-04-04T14:47:12.885 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T14:47:12.893 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:47:12.921 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T14:47:12.921 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/639) 2024-04-04T14:47:13.426 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T14:47:13.438 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T14:47:13.438 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:47:18.518 INFO:teuthology.orchestra.run.smithi072.stdout:generic/639 5s 2024-04-04T14:47:18.534 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/639 2024-04-04T14:47:18.534 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T14:47:18.542 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:47:18.567 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T14:47:18.567 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/640) 2024-04-04T14:47:19.085 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T14:47:19.096 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T14:47:19.096 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:47:19.545 INFO:teuthology.orchestra.run.smithi072.stdout:generic/640 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T14:47:19.556 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/640 2024-04-04T14:47:19.556 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/640 2024-04-04T14:47:19.556 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T14:47:19.565 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:47:19.591 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T14:47:19.591 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/641) 2024-04-04T14:47:20.090 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T14:47:20.101 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T14:47:20.101 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:47:20.472 INFO:teuthology.orchestra.run.smithi072.stdout:generic/641 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T14:47:20.483 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/641 2024-04-04T14:47:20.484 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/641 2024-04-04T14:47:20.484 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T14:47:20.495 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:47:20.528 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T14:47:20.528 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/642) 2024-04-04T14:47:21.042 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T14:47:21.055 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T14:47:21.055 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:47:21.422 INFO:teuthology.orchestra.run.smithi072.stdout:generic/642 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T14:47:21.434 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/642 2024-04-04T14:47:21.434 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/642 2024-04-04T14:47:21.435 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T14:47:21.446 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:47:21.474 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T14:47:21.474 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/643) 2024-04-04T14:47:22.001 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T14:47:22.013 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T14:47:22.013 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:47:22.376 INFO:teuthology.orchestra.run.smithi072.stdout:generic/643 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T14:47:22.386 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/643 2024-04-04T14:47:22.387 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/643 2024-04-04T14:47:22.387 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T14:47:22.397 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:47:22.427 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T14:47:22.427 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/644) 2024-04-04T14:47:22.926 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T14:47:22.937 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T14:47:22.937 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:47:23.306 INFO:teuthology.orchestra.run.smithi072.stdout:generic/644 [not run] vfstest not support by ceph-fuse 2024-04-04T14:47:23.319 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/644 2024-04-04T14:47:23.319 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/644 2024-04-04T14:47:23.319 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T14:47:23.332 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:47:23.358 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T14:47:23.358 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/645) 2024-04-04T14:47:23.868 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T14:47:23.879 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T14:47:23.880 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:47:24.248 INFO:teuthology.orchestra.run.smithi072.stdout:generic/645 [not run] vfstest not support by ceph-fuse 2024-04-04T14:47:24.260 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/645 2024-04-04T14:47:24.261 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/645 2024-04-04T14:47:24.261 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T14:47:24.269 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:47:24.297 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T14:47:24.297 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/646) 2024-04-04T14:47:24.818 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T14:47:24.830 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T14:47:24.830 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:47:25.217 INFO:teuthology.orchestra.run.smithi072.stdout:generic/646 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T14:47:25.229 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/646 2024-04-04T14:47:25.229 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/646 2024-04-04T14:47:25.229 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T14:47:25.238 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:47:25.265 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T14:47:25.265 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/647) 2024-04-04T14:47:25.766 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T14:47:25.778 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T14:47:25.778 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:47:26.521 INFO:teuthology.orchestra.run.smithi072.stdout:generic/647 1s 2024-04-04T14:47:26.538 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/647 2024-04-04T14:47:26.538 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T14:47:26.546 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:47:26.575 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T14:47:26.575 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/648) 2024-04-04T14:47:27.338 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T14:47:27.354 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T14:47:27.354 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:47:27.726 INFO:teuthology.orchestra.run.smithi072.stdout:generic/648 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T14:47:27.739 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/648 2024-04-04T14:47:27.739 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/648 2024-04-04T14:47:27.739 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T14:47:27.747 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:47:27.772 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T14:47:27.772 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/649) 2024-04-04T14:47:28.332 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T14:47:28.343 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T14:47:28.343 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:47:28.855 INFO:teuthology.orchestra.run.smithi072.stdout:generic/649 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-04-04T14:47:28.866 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/649 2024-04-04T14:47:28.866 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/649 2024-04-04T14:47:28.866 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T14:47:28.875 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:47:28.901 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T14:47:28.901 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/650) 2024-04-04T14:47:29.675 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T14:47:29.686 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T14:47:29.686 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T14:47:38.911 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T14:47:38.922 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T14:48:09.802 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T14:48:09.812 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T14:48:10.043 INFO:tasks.ceph.osd.1.smithi072.stderr:2024-04-04T14:48:10.040+0000 7fa436800640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 496036) UID: 0 2024-04-04T14:48:10.051 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-04T14:48:10.044+0000 7f4e66800640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 496036) UID: 0 2024-04-04T14:48:10.053 INFO:tasks.ceph.osd.2.smithi072.stderr:2024-04-04T14:48:10.051+0000 7f7521000640 -1 Fail to open '/proc/496036/cmdline' error = (2) No such file or directory 2024-04-04T14:48:10.053 INFO:tasks.ceph.osd.2.smithi072.stderr:2024-04-04T14:48:10.051+0000 7f7521000640 -1 received signal: Hangup from (PID: 496036) UID: 0 2024-04-04T14:48:10.059 INFO:tasks.ceph.osd.3.smithi072.stderr:2024-04-04T14:48:10.056+0000 7f0d67400640 -1 Fail to open '/proc/496036/cmdline' error = (2) No such file or directory 2024-04-04T14:48:10.059 INFO:tasks.ceph.osd.3.smithi072.stderr:2024-04-04T14:48:10.056+0000 7f0d67400640 -1 received signal: Hangup from (PID: 496036) UID: 0 2024-04-04T14:53:51.458 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T14:53:51.471 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T14:54:21.806 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T14:54:21.820 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T14:54:52.223 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T14:54:52.234 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T14:55:22.354 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T14:55:22.365 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T14:55:52.672 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T14:55:52.682 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T14:56:22.930 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T14:56:22.938 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T14:56:53.169 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T14:56:53.177 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T14:57:23.419 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T14:57:23.445 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T14:57:53.602 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T14:57:53.608 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T14:57:53.708 INFO:tasks.ceph.osd.4.smithi117.stderr:2024-04-04T14:57:53.706+0000 7f248de00640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 60104) UID: 0 2024-04-04T14:57:53.722 INFO:tasks.ceph.osd.5.smithi117.stderr:2024-04-04T14:57:53.718+0000 7f144e000640 -1 Fail to open '/proc/60104/cmdline' error = (2) No such file or directory 2024-04-04T14:57:53.722 INFO:tasks.ceph.osd.5.smithi117.stderr:2024-04-04T14:57:53.718+0000 7f144e000640 -1 received signal: Hangup from (PID: 60104) UID: 0 2024-04-04T14:57:53.723 INFO:tasks.ceph.osd.6.smithi117.stderr:2024-04-04T14:57:53.711+0000 7fb935800640 -1 Fail to open '/proc/60104/cmdline' error = (2) No such file or directory 2024-04-04T14:57:53.723 INFO:tasks.ceph.osd.6.smithi117.stderr:2024-04-04T14:57:53.711+0000 7fb935800640 -1 received signal: Hangup from (PID: 60104) UID: 0 2024-04-04T14:57:53.723 INFO:tasks.ceph.osd.7.smithi117.stderr:2024-04-04T14:57:53.721+0000 7f3028600640 -1 Fail to open '/proc/60104/cmdline' error = (2) No such file or directory 2024-04-04T14:57:53.723 INFO:tasks.ceph.osd.7.smithi117.stderr:2024-04-04T14:57:53.721+0000 7f3028600640 -1 received signal: Hangup from (PID: 60104) UID: 0 2024-04-04T14:57:53.728 INFO:tasks.ceph.mds.c.smithi072.stderr:2024-04-04T14:57:53.727+0000 7fc131e00640 -1 Fail to open '/proc/497956/cmdline' error = (2) No such file or directory 2024-04-04T14:57:53.728 INFO:tasks.ceph.mds.c.smithi072.stderr:2024-04-04T14:57:53.727+0000 7fc131e00640 -1 received signal: Hangup from (PID: 497956) UID: 0 2024-04-04T14:57:53.734 INFO:tasks.ceph.mds.a.smithi072.stderr:2024-04-04T14:57:53.727+0000 7fa395800640 -1 Fail to open '/proc/497956/cmdline' error = (2) No such file or directory 2024-04-04T14:57:53.734 INFO:tasks.ceph.mds.a.smithi072.stderr:2024-04-04T14:57:53.727+0000 7fa395800640 -1 received signal: Hangup from (PID: 497956) UID: 0 2024-04-04T15:00:04.814 INFO:teuthology.orchestra.run.smithi117.stderr:error: Compressing program wrote following message to stderr when compressing log /var/log/ceph/ceph-osd.5.log.1: 2024-04-04T15:00:04.814 INFO:teuthology.orchestra.run.smithi117.stderr:gzip: stdin: file size changed while zipping 2024-04-04T15:03:08.594 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T15:03:08.602 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T15:03:08.692 INFO:tasks.ceph.osd.5.smithi117.stderr:2024-04-04T15:03:08.691+0000 7f144e000640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 60149) UID: 0 2024-04-04T15:03:08.693 INFO:tasks.ceph.osd.6.smithi117.stderr:2024-04-04T15:03:08.691+0000 7fb935800640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 60149) UID: 0 2024-04-04T15:03:08.693 INFO:tasks.ceph.osd.7.smithi117.stderr:2024-04-04T15:03:08.691+0000 7f3028600640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 60149) UID: 0 2024-04-04T15:03:08.693 INFO:tasks.ceph.osd.4.smithi117.stderr:2024-04-04T15:03:08.691+0000 7f248de00640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 60149) UID: 0 2024-04-04T15:06:08.461 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T15:06:08.466 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T15:06:38.593 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T15:06:38.603 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T15:07:08.746 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T15:07:08.762 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T15:07:38.939 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T15:07:38.946 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T15:08:09.061 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T15:08:09.073 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T15:08:39.247 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T15:08:39.258 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T15:09:09.435 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T15:09:09.443 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T15:09:39.824 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T15:09:39.831 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T15:10:11.308 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T15:10:11.316 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T15:10:41.587 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T15:10:41.597 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T15:11:11.906 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T15:11:11.912 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T15:11:42.047 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T15:11:42.055 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T15:12:12.208 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T15:12:12.214 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T15:12:42.797 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T15:12:42.807 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T15:13:13.064 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T15:13:13.074 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T15:13:43.218 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T15:13:43.226 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T15:14:14.189 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T15:14:14.200 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T15:14:44.584 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T15:14:44.595 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T15:15:15.074 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T15:15:15.082 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T15:15:45.553 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T15:15:45.567 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T15:16:15.682 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T15:16:15.695 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T15:16:46.105 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T15:16:46.112 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T15:17:16.365 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T15:17:16.370 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T15:17:47.002 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T15:17:47.008 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T15:17:47.108 INFO:tasks.ceph.osd.5.smithi117.stderr:2024-04-04T15:17:47.106+0000 7f144e000640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 60615) UID: 0 2024-04-04T15:17:47.108 INFO:tasks.ceph.osd.6.smithi117.stderr:2024-04-04T15:17:47.106+0000 7fb935800640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 60615) UID: 0 2024-04-04T15:17:47.109 INFO:tasks.ceph.osd.4.smithi117.stderr:2024-04-04T15:17:47.106+0000 7f248de00640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 60615) UID: 0 2024-04-04T15:17:47.109 INFO:tasks.ceph.osd.7.smithi117.stderr:2024-04-04T15:17:47.106+0000 7f3028600640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 60615) UID: 0 2024-04-04T15:20:32.314 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T15:20:32.322 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T15:21:02.519 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T15:21:02.527 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T15:21:32.739 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T15:21:32.749 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T15:22:03.065 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T15:22:03.075 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T15:22:34.341 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T15:22:34.348 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T15:22:34.472 INFO:tasks.ceph.mds.a.smithi072.stderr:2024-04-04T15:22:34.472+0000 7fa395800640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 502908) UID: 0 2024-04-04T15:22:34.473 INFO:tasks.ceph.mds.c.smithi072.stderr:2024-04-04T15:22:34.472+0000 7fc131e00640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 502908) UID: 0 2024-04-04T15:27:09.410 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-04T15:27:09.408+0000 7f4e66800640 -1 Fail to open '/proc/503689/cmdline' error = (2) No such file or directory 2024-04-04T15:27:09.411 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-04T15:27:09.408+0000 7f4e66800640 -1 received signal: Hangup from (PID: 503689) UID: 0 2024-04-04T15:27:09.411 INFO:tasks.ceph.osd.1.smithi072.stderr:2024-04-04T15:27:09.404+0000 7fa436800640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 503689) UID: 0 2024-04-04T15:27:09.411 INFO:tasks.ceph.osd.2.smithi072.stderr:2024-04-04T15:27:09.404+0000 7f7521000640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 503689) UID: 0 2024-04-04T15:27:09.413 INFO:tasks.ceph.osd.3.smithi072.stderr:2024-04-04T15:27:09.410+0000 7f0d67400640 -1 Fail to open '/proc/503689/cmdline' error = (2) No such file or directory 2024-04-04T15:27:09.413 INFO:tasks.ceph.osd.3.smithi072.stderr:2024-04-04T15:27:09.410+0000 7f0d67400640 -1 received signal: Hangup from (PID: 503689) UID: 0 2024-04-04T15:32:20.511 INFO:teuthology.orchestra.run.smithi072.stderr:error: Compressing program wrote following message to stderr when compressing log /var/log/ceph/ceph-osd.3.log.1: 2024-04-04T15:32:20.511 INFO:teuthology.orchestra.run.smithi072.stderr:gzip: stdin: file size changed while zipping 2024-04-04T15:32:57.213 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T15:32:57.225 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T15:33:27.378 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T15:33:27.384 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T15:33:57.700 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T15:33:57.709 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T15:34:27.894 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T15:34:27.902 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T15:34:58.911 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T15:34:58.922 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T15:35:29.131 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T15:35:29.136 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T15:36:00.586 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T15:36:00.594 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T15:36:31.261 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T15:36:31.271 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T15:37:01.754 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T15:37:01.765 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T15:37:31.913 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T15:37:31.928 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T15:38:02.123 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T15:38:02.131 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T15:38:32.278 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T15:38:32.287 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T15:39:02.497 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T15:39:02.506 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T15:39:32.929 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T15:39:32.941 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T15:40:03.185 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T15:40:03.191 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T15:40:34.406 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T15:40:34.418 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T15:41:04.724 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T15:41:04.736 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T15:41:34.853 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T15:41:34.866 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T15:42:05.022 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T15:42:05.031 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T15:42:35.316 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T15:42:35.322 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T15:43:05.777 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T15:43:05.790 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T15:43:37.723 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T15:43:37.732 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T15:44:09.140 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T15:44:09.150 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T15:44:39.419 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T15:44:39.431 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T15:45:09.722 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T15:45:09.731 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T15:45:40.082 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T15:45:40.093 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T15:46:10.302 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T15:46:10.310 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T15:46:40.556 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T15:46:40.567 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T15:47:10.673 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T15:47:10.687 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T15:47:40.937 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T15:47:40.954 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T15:48:11.125 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T15:48:11.139 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T15:48:11.258 INFO:tasks.ceph.mds.c.smithi072.stderr:2024-04-04T15:48:11.257+0000 7fc131e00640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 508121) UID: 0 2024-04-04T15:48:11.258 INFO:tasks.ceph.mds.a.smithi072.stderr:2024-04-04T15:48:11.258+0000 7fa395800640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 508121) UID: 0 2024-04-04T15:53:56.058 INFO:tasks.ceph.osd.1.smithi072.stderr:2024-04-04T15:53:56.057+0000 7fa436800640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 508662) UID: 0 2024-04-04T15:53:56.059 INFO:tasks.ceph.osd.2.smithi072.stderr:2024-04-04T15:53:56.058+0000 7f7521000640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 508662) UID: 0 2024-04-04T15:53:56.059 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-04T15:53:56.057+0000 7f4e66800640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 508662) UID: 0 2024-04-04T15:53:56.060 INFO:tasks.ceph.osd.3.smithi072.stderr:2024-04-04T15:53:56.060+0000 7f0d67400640 -1 Fail to open '/proc/508662/cmdline' error = (2) No such file or directory 2024-04-04T15:53:56.060 INFO:tasks.ceph.osd.3.smithi072.stderr:2024-04-04T15:53:56.060+0000 7f0d67400640 -1 received signal: Hangup from (PID: 508662) UID: 0 2024-04-04T15:54:53.027 INFO:teuthology.orchestra.run.smithi072.stdout:generic/650 4043s 2024-04-04T15:54:53.192 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/650 2024-04-04T15:54:53.192 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T15:54:53.204 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T15:54:53.235 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T15:54:53.236 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/651) 2024-04-04T15:54:54.214 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T15:54:54.233 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T15:54:54.233 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T15:54:54.953 INFO:teuthology.orchestra.run.smithi072.stdout:generic/651 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T15:54:54.968 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/651 2024-04-04T15:54:54.968 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/651 2024-04-04T15:54:54.969 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T15:54:54.978 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T15:54:55.012 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T15:54:55.012 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/652) 2024-04-04T15:54:55.745 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T15:54:55.760 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T15:54:55.760 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T15:54:56.251 INFO:teuthology.orchestra.run.smithi072.stdout:generic/652 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T15:54:56.267 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/652 2024-04-04T15:54:56.267 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/652 2024-04-04T15:54:56.267 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T15:54:56.276 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T15:54:56.308 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T15:54:56.308 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/653) 2024-04-04T15:54:57.033 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T15:54:57.054 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T15:54:57.054 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T15:54:57.533 INFO:teuthology.orchestra.run.smithi072.stdout:generic/653 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T15:54:57.547 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/653 2024-04-04T15:54:57.547 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/653 2024-04-04T15:54:57.547 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T15:54:57.564 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T15:54:57.597 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T15:54:57.597 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/654) 2024-04-04T15:54:58.350 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T15:54:58.370 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T15:54:58.370 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T15:54:58.872 INFO:teuthology.orchestra.run.smithi072.stdout:generic/654 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T15:54:58.886 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/654 2024-04-04T15:54:58.886 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/654 2024-04-04T15:54:58.886 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T15:54:58.898 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T15:54:58.932 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T15:54:58.932 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/655) 2024-04-04T15:54:59.678 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T15:54:59.694 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T15:54:59.694 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T15:55:00.213 INFO:teuthology.orchestra.run.smithi072.stdout:generic/655 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T15:55:00.226 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/655 2024-04-04T15:55:00.226 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/655 2024-04-04T15:55:00.226 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T15:55:00.237 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T15:55:00.284 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T15:55:00.284 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/656) 2024-04-04T15:55:00.949 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T15:55:00.965 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T15:55:00.965 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T15:55:05.290 INFO:teuthology.orchestra.run.smithi072.stdout:generic/656 [not run] vfstest not support by ceph-fuse 2024-04-04T15:55:05.306 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/656 2024-04-04T15:55:05.307 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/656 2024-04-04T15:55:05.307 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T15:55:05.318 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T15:55:05.348 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T15:55:05.348 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/657) 2024-04-04T15:55:06.088 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T15:55:06.109 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T15:55:06.109 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T15:55:06.618 INFO:teuthology.orchestra.run.smithi072.stdout:generic/657 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T15:55:06.629 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/657 2024-04-04T15:55:06.629 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/657 2024-04-04T15:55:06.629 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T15:55:06.641 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T15:55:06.680 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T15:55:06.680 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/658) 2024-04-04T15:55:07.407 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T15:55:07.423 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T15:55:07.423 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T15:55:07.889 INFO:teuthology.orchestra.run.smithi072.stdout:generic/658 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T15:55:07.901 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/658 2024-04-04T15:55:07.902 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/658 2024-04-04T15:55:07.902 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T15:55:07.911 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T15:55:07.952 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T15:55:07.952 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/659) 2024-04-04T15:55:08.641 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T15:55:08.659 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T15:55:08.660 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T15:55:09.128 INFO:teuthology.orchestra.run.smithi072.stdout:generic/659 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T15:55:09.143 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/659 2024-04-04T15:55:09.143 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/659 2024-04-04T15:55:09.143 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T15:55:09.150 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T15:55:09.179 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T15:55:09.179 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/660) 2024-04-04T15:55:09.889 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T15:55:09.903 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T15:55:09.903 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T15:55:10.911 INFO:teuthology.orchestra.run.smithi072.stdout:generic/660 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T15:55:10.926 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/660 2024-04-04T15:55:10.927 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/660 2024-04-04T15:55:10.927 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T15:55:10.940 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T15:55:10.971 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T15:55:10.971 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/661) 2024-04-04T15:55:11.691 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T15:55:11.712 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T15:55:11.712 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T15:55:12.179 INFO:teuthology.orchestra.run.smithi072.stdout:generic/661 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T15:55:12.194 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/661 2024-04-04T15:55:12.194 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/661 2024-04-04T15:55:12.194 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T15:55:12.205 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T15:55:12.246 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T15:55:12.246 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/662) 2024-04-04T15:55:12.948 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T15:55:12.971 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T15:55:12.971 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T15:55:13.485 INFO:teuthology.orchestra.run.smithi072.stdout:generic/662 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T15:55:13.500 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/662 2024-04-04T15:55:13.500 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/662 2024-04-04T15:55:13.500 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T15:55:13.513 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T15:55:13.545 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T15:55:13.545 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/663) 2024-04-04T15:55:14.268 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T15:55:14.286 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T15:55:14.286 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T15:55:14.784 INFO:teuthology.orchestra.run.smithi072.stdout:generic/663 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T15:55:14.799 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/663 2024-04-04T15:55:14.799 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/663 2024-04-04T15:55:14.800 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T15:55:14.811 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T15:55:14.852 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T15:55:14.852 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/664) 2024-04-04T15:55:15.555 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T15:55:15.571 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T15:55:15.571 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T15:55:16.026 INFO:teuthology.orchestra.run.smithi072.stdout:generic/664 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T15:55:16.038 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/664 2024-04-04T15:55:16.038 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/664 2024-04-04T15:55:16.038 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T15:55:16.050 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T15:55:16.091 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T15:55:16.092 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/665) 2024-04-04T15:55:16.831 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T15:55:16.853 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T15:55:16.854 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T15:55:17.341 INFO:teuthology.orchestra.run.smithi072.stdout:generic/665 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T15:55:17.350 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/665 2024-04-04T15:55:17.350 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/665 2024-04-04T15:55:17.350 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T15:55:17.362 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T15:55:17.398 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T15:55:17.398 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/666) 2024-04-04T15:55:18.162 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T15:55:18.181 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T15:55:18.181 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T15:55:18.686 INFO:teuthology.orchestra.run.smithi072.stdout:generic/666 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T15:55:18.702 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/666 2024-04-04T15:55:18.702 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/666 2024-04-04T15:55:18.702 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T15:55:18.715 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T15:55:18.751 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T15:55:18.751 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/667) 2024-04-04T15:55:19.467 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T15:55:19.481 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T15:55:19.481 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T15:55:19.979 INFO:teuthology.orchestra.run.smithi072.stdout:generic/667 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T15:55:19.996 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/667 2024-04-04T15:55:19.997 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/667 2024-04-04T15:55:19.997 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T15:55:20.008 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T15:55:20.049 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T15:55:20.049 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/668) 2024-04-04T15:55:20.784 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T15:55:20.800 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T15:55:20.800 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T15:55:21.897 INFO:teuthology.orchestra.run.smithi072.stdout:generic/668 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T15:55:21.911 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/668 2024-04-04T15:55:21.911 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/668 2024-04-04T15:55:21.911 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T15:55:21.922 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T15:55:21.959 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T15:55:21.959 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/669) 2024-04-04T15:55:22.704 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T15:55:22.723 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T15:55:22.723 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T15:55:23.229 INFO:teuthology.orchestra.run.smithi072.stdout:generic/669 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T15:55:23.242 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/669 2024-04-04T15:55:23.243 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/669 2024-04-04T15:55:23.243 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T15:55:23.255 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T15:55:23.288 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T15:55:23.289 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/670) 2024-04-04T15:55:24.035 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T15:55:24.052 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T15:55:24.052 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T15:55:24.548 INFO:teuthology.orchestra.run.smithi072.stdout:generic/670 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T15:55:24.561 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/670 2024-04-04T15:55:24.561 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/670 2024-04-04T15:55:24.561 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T15:55:24.571 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T15:55:24.608 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T15:55:24.609 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/671) 2024-04-04T15:55:25.254 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T15:55:25.273 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T15:55:25.273 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T15:55:25.759 INFO:teuthology.orchestra.run.smithi072.stdout:generic/671 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T15:55:25.774 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/671 2024-04-04T15:55:25.774 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/671 2024-04-04T15:55:25.775 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T15:55:25.785 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T15:55:25.819 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T15:55:25.820 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/672) 2024-04-04T15:55:26.492 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T15:55:26.509 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T15:55:26.509 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T15:55:26.983 INFO:teuthology.orchestra.run.smithi072.stdout:generic/672 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T15:55:26.996 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/672 2024-04-04T15:55:26.996 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/672 2024-04-04T15:55:26.996 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T15:55:27.006 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T15:55:27.039 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T15:55:27.039 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/673) 2024-04-04T15:55:27.717 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T15:55:27.734 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T15:55:27.734 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T15:55:30.132 INFO:teuthology.orchestra.run.smithi072.stdout:generic/673 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T15:55:30.149 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/673 2024-04-04T15:55:30.149 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/673 2024-04-04T15:55:30.149 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T15:55:30.159 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T15:55:30.195 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T15:55:30.196 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/674) 2024-04-04T15:55:30.879 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T15:55:30.896 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T15:55:30.896 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T15:55:31.469 INFO:teuthology.orchestra.run.smithi072.stdout:generic/674 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T15:55:31.485 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/674 2024-04-04T15:55:31.485 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/674 2024-04-04T15:55:31.485 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T15:55:31.496 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T15:55:31.527 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T15:55:31.527 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/675) 2024-04-04T15:55:32.262 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T15:55:32.280 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T15:55:32.280 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T15:55:32.953 INFO:teuthology.orchestra.run.smithi072.stdout:generic/675 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T15:55:32.967 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/675 2024-04-04T15:55:32.968 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/675 2024-04-04T15:55:32.968 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T15:55:32.978 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T15:55:33.007 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T15:55:33.007 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/676) 2024-04-04T15:55:33.778 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T15:55:33.808 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T15:55:33.808 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T16:25:53.371 INFO:teuthology.orchestra.run.smithi072.stdout:generic/676 1817s 2024-04-04T16:25:56.160 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/676 2024-04-04T16:25:56.160 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T16:25:56.170 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T16:25:56.203 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T16:25:56.204 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/677) 2024-04-04T16:26:33.915 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T16:26:33.930 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T16:26:33.930 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T16:26:43.177 INFO:teuthology.orchestra.run.smithi072.stdout:generic/677 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T16:26:43.189 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/677 2024-04-04T16:26:43.189 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/677 2024-04-04T16:26:43.190 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T16:26:43.200 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T16:26:43.234 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T16:26:43.234 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/678) 2024-04-04T16:26:43.898 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T16:26:43.919 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T16:26:43.919 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T16:26:44.648 INFO:teuthology.orchestra.run.smithi072.stdout:generic/678 [not run] kernel does not support IO_URING 2024-04-04T16:26:44.657 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/678 2024-04-04T16:26:44.657 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/678 2024-04-04T16:26:44.657 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T16:26:44.666 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T16:26:44.699 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T16:26:44.700 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/679) 2024-04-04T16:26:45.387 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T16:26:45.407 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T16:26:45.407 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T16:26:48.923 INFO:teuthology.orchestra.run.smithi072.stdout:generic/679 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T16:26:48.933 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/679 2024-04-04T16:26:48.933 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/679 2024-04-04T16:26:48.934 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T16:26:48.943 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T16:26:48.973 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T16:26:48.974 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/680) 2024-04-04T16:26:49.588 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T16:26:49.601 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T16:26:49.601 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T16:26:55.071 INFO:teuthology.orchestra.run.smithi072.stdout:generic/680 6s 2024-04-04T16:26:55.092 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/680 2024-04-04T16:26:55.092 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T16:26:55.103 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T16:26:55.151 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T16:26:55.151 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/681) 2024-04-04T16:26:56.104 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T16:26:56.122 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T16:26:56.122 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T16:26:56.758 INFO:teuthology.orchestra.run.smithi072.stdout:generic/681 [not run] disk quotas not supported by this filesystem type: ceph-fuse 2024-04-04T16:26:56.778 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/681 2024-04-04T16:26:56.779 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/681 2024-04-04T16:26:56.779 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T16:26:56.792 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T16:26:56.829 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T16:26:56.829 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/682) 2024-04-04T16:26:57.522 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T16:26:57.540 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T16:26:57.540 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T16:26:58.094 INFO:teuthology.orchestra.run.smithi072.stdout:generic/682 [not run] disk quotas not supported by this filesystem type: ceph-fuse 2024-04-04T16:26:58.106 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/682 2024-04-04T16:26:58.106 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/682 2024-04-04T16:26:58.106 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T16:26:58.116 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T16:26:58.152 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T16:26:58.153 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/683) 2024-04-04T16:26:58.872 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T16:26:58.894 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T16:26:58.895 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T16:26:59.868 INFO:teuthology.orchestra.run.smithi072.stdout:generic/683 [not run] /tmp/tmp.LqGJQhujaOtest: file alloc unit 4194304 larger than op length 65536 2024-04-04T16:26:59.878 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/683 2024-04-04T16:26:59.879 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/683 2024-04-04T16:26:59.879 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T16:26:59.889 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T16:26:59.931 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T16:26:59.931 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/684) 2024-04-04T16:27:00.620 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T16:27:00.638 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T16:27:00.639 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T16:27:03.838 INFO:teuthology.orchestra.run.smithi072.stdout:generic/684 [not run] /tmp/tmp.LqGJQhujaOtest: file alloc unit 4194304 larger than op length 65536 2024-04-04T16:27:03.852 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/684 2024-04-04T16:27:03.853 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/684 2024-04-04T16:27:03.853 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T16:27:03.864 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T16:27:03.906 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T16:27:03.907 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/685) 2024-04-04T16:27:04.654 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T16:27:04.674 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T16:27:04.674 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T16:27:07.883 INFO:teuthology.orchestra.run.smithi072.stdout:generic/685 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2024-04-04T16:27:07.897 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/685 2024-04-04T16:27:07.897 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/685 2024-04-04T16:27:07.897 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T16:27:07.908 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T16:27:07.948 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T16:27:07.948 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/686) 2024-04-04T16:27:08.666 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T16:27:08.682 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T16:27:08.682 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T16:27:12.761 INFO:teuthology.orchestra.run.smithi072.stdout:generic/686 [not run] xfs_io finsert failed (old kernel/wrong fs?) 2024-04-04T16:27:12.778 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/686 2024-04-04T16:27:12.778 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/686 2024-04-04T16:27:12.778 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T16:27:12.793 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T16:27:12.835 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T16:27:12.836 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/687) 2024-04-04T16:27:13.564 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T16:27:13.586 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T16:27:13.586 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T16:27:17.205 INFO:teuthology.orchestra.run.smithi072.stdout:generic/687 [not run] xfs_io fcollapse failed (old kernel/wrong fs?) 2024-04-04T16:27:17.220 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/687 2024-04-04T16:27:17.221 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/687 2024-04-04T16:27:17.221 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T16:27:17.229 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T16:27:17.264 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T16:27:17.265 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/688) 2024-04-04T16:27:17.939 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T16:27:17.959 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T16:27:17.959 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T16:27:18.817 INFO:teuthology.orchestra.run.smithi072.stdout:generic/688 [not run] /tmp/tmp.LqGJQhujaOtest: file alloc unit 4194304 larger than op length 65536 2024-04-04T16:27:18.830 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/688 2024-04-04T16:27:18.830 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/688 2024-04-04T16:27:18.830 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T16:27:18.843 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T16:27:18.878 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T16:27:18.878 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/689) 2024-04-04T16:27:19.589 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T16:27:19.610 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T16:27:19.610 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T16:27:20.343 INFO:teuthology.orchestra.run.smithi072.stdout:generic/689 [not run] vfstest not support by ceph-fuse 2024-04-04T16:27:20.356 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/689 2024-04-04T16:27:20.356 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/689 2024-04-04T16:27:20.356 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T16:27:20.368 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T16:27:20.412 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T16:27:20.412 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/690) 2024-04-04T16:27:21.146 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T16:27:21.166 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T16:27:21.166 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T16:27:23.232 INFO:teuthology.orchestra.run.smithi072.stdout:generic/690 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T16:27:23.246 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/690 2024-04-04T16:27:23.246 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/690 2024-04-04T16:27:23.246 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T16:27:23.257 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T16:27:23.296 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T16:27:23.296 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/691) 2024-04-04T16:27:24.013 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T16:27:24.026 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T16:27:24.026 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T16:27:24.528 INFO:teuthology.orchestra.run.smithi072.stdout:generic/691 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T16:27:24.543 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/691 2024-04-04T16:27:24.543 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/691 2024-04-04T16:27:24.543 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T16:27:24.555 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T16:27:24.591 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T16:27:24.591 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/692) 2024-04-04T16:27:25.243 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T16:27:25.264 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T16:27:25.264 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T16:27:25.805 INFO:teuthology.orchestra.run.smithi072.stdout:generic/692 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T16:27:25.819 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/692 2024-04-04T16:27:25.819 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/692 2024-04-04T16:27:25.819 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T16:27:25.831 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T16:27:25.877 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T16:27:25.878 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/693) 2024-04-04T16:27:26.538 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T16:27:26.557 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T16:27:26.557 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T16:27:27.187 INFO:teuthology.orchestra.run.smithi072.stdout:generic/693 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T16:27:27.204 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/693 2024-04-04T16:27:27.204 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/693 2024-04-04T16:27:27.204 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T16:27:27.215 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T16:27:27.259 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T16:27:27.259 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/694) 2024-04-04T16:27:28.012 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T16:27:28.033 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T16:27:28.033 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T16:27:29.739 INFO:teuthology.orchestra.run.smithi072.stdout:generic/694 1s 2024-04-04T16:27:29.768 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/694 2024-04-04T16:27:29.768 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T16:27:29.776 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T16:27:29.814 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T16:27:29.814 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/695) 2024-04-04T16:27:30.535 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T16:27:30.553 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T16:27:30.553 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T16:27:31.336 INFO:teuthology.orchestra.run.smithi072.stdout:generic/695 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T16:27:31.348 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/695 2024-04-04T16:27:31.348 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/695 2024-04-04T16:27:31.348 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T16:27:31.359 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T16:27:31.398 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T16:27:31.398 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/696) 2024-04-04T16:27:32.176 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T16:27:32.195 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T16:27:32.195 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T16:27:32.708 INFO:teuthology.orchestra.run.smithi072.stdout:generic/696 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T16:27:32.727 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/696 2024-04-04T16:27:32.727 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/696 2024-04-04T16:27:32.727 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T16:27:32.741 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T16:27:32.780 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T16:27:32.781 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/697) 2024-04-04T16:27:33.463 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T16:27:33.479 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T16:27:33.480 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T16:27:34.103 INFO:teuthology.orchestra.run.smithi072.stdout:generic/697 [not run] ACLs not supported by this filesystem type: ceph-fuse 2024-04-04T16:27:34.119 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/697 2024-04-04T16:27:34.119 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/697 2024-04-04T16:27:34.119 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T16:27:34.131 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T16:27:34.167 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T16:27:34.168 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/698) 2024-04-04T16:27:34.826 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T16:27:34.842 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T16:27:34.842 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T16:27:35.929 INFO:teuthology.orchestra.run.smithi072.stdout:generic/698 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T16:27:35.943 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/698 2024-04-04T16:27:35.944 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/698 2024-04-04T16:27:35.944 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T16:27:35.954 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T16:27:35.996 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T16:27:35.996 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/699) 2024-04-04T16:27:36.703 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T16:27:36.722 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T16:27:36.722 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T16:27:37.812 INFO:teuthology.orchestra.run.smithi072.stdout:generic/699 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T16:27:37.822 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/699 2024-04-04T16:27:37.822 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/699 2024-04-04T16:27:37.822 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T16:27:37.831 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T16:27:37.867 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T16:27:37.867 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/700) 2024-04-04T16:27:38.575 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T16:27:38.593 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T16:27:38.594 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T16:27:39.093 INFO:teuthology.orchestra.run.smithi072.stdout:generic/700 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T16:27:39.109 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/700 2024-04-04T16:27:39.109 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/700 2024-04-04T16:27:39.109 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T16:27:39.119 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T16:27:39.150 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T16:27:39.150 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/701) 2024-04-04T16:27:39.907 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T16:27:39.924 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T16:27:39.924 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T16:27:40.983 INFO:teuthology.orchestra.run.smithi072.stdout:generic/701 1s 2024-04-04T16:27:41.005 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/701 2024-04-04T16:27:41.006 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T16:27:41.015 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T16:27:41.077 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T16:27:41.077 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/702) 2024-04-04T16:27:41.981 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T16:27:42.010 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T16:27:42.010 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T16:27:43.349 INFO:teuthology.orchestra.run.smithi072.stdout:generic/702 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T16:27:43.367 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/702 2024-04-04T16:27:43.367 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/702 2024-04-04T16:27:43.368 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T16:27:43.396 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T16:27:43.427 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T16:27:43.427 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/703) 2024-04-04T16:27:44.158 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T16:27:44.181 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T16:27:44.181 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T16:27:44.886 INFO:teuthology.orchestra.run.smithi072.stdout:generic/703 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T16:27:44.899 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/703 2024-04-04T16:27:44.899 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/703 2024-04-04T16:27:44.899 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T16:27:44.914 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T16:27:44.953 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T16:27:44.954 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/704) 2024-04-04T16:27:45.653 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T16:27:45.673 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T16:27:45.673 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T16:27:46.471 INFO:teuthology.orchestra.run.smithi072.stdout:generic/704 [not run] require ceph-fuse to be valid block disk 2024-04-04T16:27:46.484 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/704 2024-04-04T16:27:46.484 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/704 2024-04-04T16:27:46.484 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T16:27:46.495 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T16:27:46.531 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T16:27:46.531 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/705) 2024-04-04T16:27:47.108 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T16:27:47.119 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T16:27:47.119 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T16:27:48.244 INFO:teuthology.orchestra.run.smithi072.stdout:generic/705 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T16:27:48.257 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/705 2024-04-04T16:27:48.257 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/705 2024-04-04T16:27:48.257 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T16:27:48.266 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T16:27:48.304 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T16:27:48.304 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/706) 2024-04-04T16:27:49.009 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T16:27:49.028 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T16:27:49.028 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T16:27:51.623 INFO:teuthology.orchestra.run.smithi072.stdout:generic/706 2s 2024-04-04T16:27:51.646 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/706 2024-04-04T16:27:51.647 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T16:27:51.656 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T16:27:51.700 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T16:27:51.700 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/707) 2024-04-04T16:27:52.664 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T16:27:52.694 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T16:27:52.694 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T16:27:53.193 INFO:teuthology.orchestra.run.smithi072.stdout:generic/707 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T16:27:53.204 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/707 2024-04-04T16:27:53.205 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/707 2024-04-04T16:27:53.205 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T16:27:53.214 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T16:27:53.249 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T16:27:53.250 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/708) 2024-04-04T16:27:53.926 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T16:27:53.940 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T16:27:53.940 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T16:27:56.522 INFO:teuthology.orchestra.run.smithi072.stdout:generic/708 3s 2024-04-04T16:27:56.547 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/708 2024-04-04T16:27:56.547 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T16:27:56.554 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T16:27:56.586 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T16:27:56.586 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/709) 2024-04-04T16:27:57.550 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T16:27:57.588 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T16:27:57.588 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T16:27:58.270 INFO:teuthology.orchestra.run.smithi072.stdout:generic/709 [not run] xfs_io swapext -v exchrange not supported on ceph-fuse 2024-04-04T16:27:58.284 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/709 2024-04-04T16:27:58.285 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/709 2024-04-04T16:27:58.285 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T16:27:58.293 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T16:27:58.343 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T16:27:58.344 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/710) 2024-04-04T16:27:59.340 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T16:27:59.352 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T16:27:59.353 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T16:28:00.010 INFO:teuthology.orchestra.run.smithi072.stdout:generic/710 [not run] xfs_io swapext -v exchrange not supported on ceph-fuse 2024-04-04T16:28:00.024 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/710 2024-04-04T16:28:00.024 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/710 2024-04-04T16:28:00.024 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T16:28:00.037 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T16:28:00.077 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T16:28:00.077 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/711) 2024-04-04T16:28:00.980 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T16:28:01.000 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T16:28:01.000 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T16:28:02.366 INFO:teuthology.orchestra.run.smithi072.stdout:generic/711 [not run] xfs_io swapext -v exchrange not supported on ceph-fuse 2024-04-04T16:28:02.381 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/711 2024-04-04T16:28:02.381 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/711 2024-04-04T16:28:02.381 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T16:28:02.393 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T16:28:02.424 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T16:28:02.424 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/712) 2024-04-04T16:28:03.385 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T16:28:03.408 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T16:28:03.408 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T16:28:04.164 INFO:teuthology.orchestra.run.smithi072.stdout:generic/712 [not run] xfs_io swapext -v exchrange not supported on ceph-fuse 2024-04-04T16:28:04.179 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/712 2024-04-04T16:28:04.181 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/712 2024-04-04T16:28:04.182 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T16:28:04.193 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T16:28:04.239 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T16:28:04.240 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/713) 2024-04-04T16:28:05.166 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T16:28:05.186 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T16:28:05.186 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T16:28:05.844 INFO:teuthology.orchestra.run.smithi072.stdout:generic/713 [not run] xfs_io swapext -v exchrange -s 64k -l 64k not supported on ceph-fuse 2024-04-04T16:28:05.859 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/713 2024-04-04T16:28:05.859 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/713 2024-04-04T16:28:05.859 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T16:28:05.869 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T16:28:05.913 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T16:28:05.914 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/714) 2024-04-04T16:28:06.884 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T16:28:06.898 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T16:28:06.898 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T16:28:07.546 INFO:teuthology.orchestra.run.smithi072.stdout:generic/714 [not run] xfs_io swapext -v exchrange not supported on ceph-fuse 2024-04-04T16:28:07.562 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/714 2024-04-04T16:28:07.562 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/714 2024-04-04T16:28:07.562 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T16:28:07.575 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T16:28:07.646 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T16:28:07.646 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/715) 2024-04-04T16:28:08.516 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T16:28:08.533 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T16:28:08.533 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T16:28:09.310 INFO:teuthology.orchestra.run.smithi072.stdout:generic/715 [not run] xfs_io swapext -v exchrange -s 64k -l 64k not supported on ceph-fuse 2024-04-04T16:28:09.326 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/715 2024-04-04T16:28:09.326 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/715 2024-04-04T16:28:09.326 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T16:28:09.334 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T16:28:09.371 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T16:28:09.371 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/716) 2024-04-04T16:28:10.269 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T16:28:10.293 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T16:28:10.294 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T16:28:10.911 INFO:teuthology.orchestra.run.smithi072.stdout:generic/716 [not run] xfs_io swapext -v exchrange not supported on ceph-fuse 2024-04-04T16:28:10.926 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/716 2024-04-04T16:28:10.926 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/716 2024-04-04T16:28:10.926 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T16:28:10.936 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T16:28:10.984 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T16:28:10.984 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/717) 2024-04-04T16:28:11.903 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T16:28:11.921 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T16:28:11.921 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T16:28:12.545 INFO:teuthology.orchestra.run.smithi072.stdout:generic/717 [not run] xfs_io swapext -v exchrange not supported on ceph-fuse 2024-04-04T16:28:12.566 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/717 2024-04-04T16:28:12.566 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/717 2024-04-04T16:28:12.566 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T16:28:12.575 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T16:28:12.620 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T16:28:12.620 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/718) 2024-04-04T16:28:13.499 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T16:28:13.518 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T16:28:13.518 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T16:28:14.126 INFO:teuthology.orchestra.run.smithi072.stdout:generic/718 [not run] xfs_io swapext -v exchrange not supported on ceph-fuse 2024-04-04T16:28:14.142 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/718 2024-04-04T16:28:14.142 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/718 2024-04-04T16:28:14.142 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T16:28:14.154 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T16:28:14.183 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T16:28:14.184 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/719) 2024-04-04T16:28:15.058 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T16:28:15.074 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T16:28:15.075 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T16:28:16.055 INFO:teuthology.orchestra.run.smithi072.stdout:generic/719 [not run] xfs_io swapext -v exchrange not supported on ceph-fuse 2024-04-04T16:28:16.068 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/719 2024-04-04T16:28:16.068 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/719 2024-04-04T16:28:16.068 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T16:28:16.081 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T16:28:16.127 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T16:28:16.127 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/720) 2024-04-04T16:28:17.057 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T16:28:17.078 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T16:28:17.078 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T16:28:17.732 INFO:teuthology.orchestra.run.smithi072.stdout:generic/720 [not run] xfs_io swapext -v exchrange not supported on ceph-fuse 2024-04-04T16:28:17.747 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/720 2024-04-04T16:28:17.747 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/720 2024-04-04T16:28:17.747 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T16:28:17.758 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T16:28:17.792 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T16:28:17.793 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/721) 2024-04-04T16:28:18.730 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T16:28:18.749 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T16:28:18.749 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T16:28:19.382 INFO:teuthology.orchestra.run.smithi072.stdout:generic/721 [not run] xfs_io startupdate support is missing 2024-04-04T16:28:19.397 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/721 2024-04-04T16:28:19.398 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/721 2024-04-04T16:28:19.398 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T16:28:19.408 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T16:28:19.451 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T16:28:19.451 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/722) 2024-04-04T16:28:20.021 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T16:28:20.035 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T16:28:20.036 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T16:28:20.936 INFO:teuthology.orchestra.run.smithi072.stdout:generic/722 [not run] xfs_io swapext -v exchrange -a not supported on ceph-fuse 2024-04-04T16:28:20.950 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/722 2024-04-04T16:28:20.950 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/722 2024-04-04T16:28:20.950 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T16:28:20.957 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T16:28:20.997 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T16:28:20.997 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/723) 2024-04-04T16:28:21.956 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T16:28:21.971 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T16:28:21.971 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T16:28:22.616 INFO:teuthology.orchestra.run.smithi072.stdout:generic/723 [not run] xfs_io swapext -v exchrange not supported on ceph-fuse 2024-04-04T16:28:22.631 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/723 2024-04-04T16:28:22.632 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/723 2024-04-04T16:28:22.632 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T16:28:22.643 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T16:28:22.690 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T16:28:22.690 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/724) 2024-04-04T16:28:23.649 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T16:28:23.680 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T16:28:23.680 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T16:28:24.318 INFO:teuthology.orchestra.run.smithi072.stdout:generic/724 [not run] xfs_io swapext -v exchrange -a not supported on ceph-fuse 2024-04-04T16:28:24.333 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/724 2024-04-04T16:28:24.334 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/724 2024-04-04T16:28:24.334 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T16:28:24.348 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T16:28:24.389 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T16:28:24.389 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/725) 2024-04-04T16:28:25.306 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T16:28:25.324 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T16:28:25.324 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T16:28:26.594 INFO:teuthology.orchestra.run.smithi072.stdout:generic/725 [not run] xfs_io swapext -v exchrange -a not supported on ceph-fuse 2024-04-04T16:28:26.607 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/725 2024-04-04T16:28:26.607 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/725 2024-04-04T16:28:26.608 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T16:28:26.621 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T16:28:26.684 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T16:28:26.685 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/726) 2024-04-04T16:28:27.701 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T16:28:27.719 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T16:28:27.719 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T16:28:29.057 INFO:teuthology.orchestra.run.smithi072.stdout:generic/726 [not run] xfs_io swapext -v exchrange -a not supported on ceph-fuse 2024-04-04T16:28:29.073 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/726 2024-04-04T16:28:29.073 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/726 2024-04-04T16:28:29.073 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T16:28:29.085 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T16:28:29.154 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T16:28:29.155 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/727) 2024-04-04T16:28:30.053 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T16:28:30.069 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T16:28:30.069 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T16:28:30.760 INFO:teuthology.orchestra.run.smithi072.stdout:generic/727 [not run] xfs_io swapext -v exchrange -a not supported on ceph-fuse 2024-04-04T16:28:30.771 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/727 2024-04-04T16:28:30.771 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/727 2024-04-04T16:28:30.771 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T16:28:30.781 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T16:28:30.810 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T16:28:30.810 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/728) 2024-04-04T16:28:31.662 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T16:28:31.693 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T16:28:31.693 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T16:28:36.341 INFO:teuthology.orchestra.run.smithi072.stdout:generic/728 5s 2024-04-04T16:28:36.366 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/728 2024-04-04T16:28:36.366 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T16:28:36.376 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T16:28:36.416 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T16:28:36.416 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/729) 2024-04-04T16:28:37.157 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T16:28:37.176 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T16:28:37.176 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T16:28:38.238 INFO:teuthology.orchestra.run.smithi072.stdout:generic/729 1s 2024-04-04T16:28:38.256 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/729 2024-04-04T16:28:38.256 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T16:28:38.264 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T16:28:38.324 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T16:28:38.325 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/730) 2024-04-04T16:28:39.175 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T16:28:39.191 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T16:28:39.191 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T16:28:39.683 INFO:teuthology.orchestra.run.smithi072.stdout:generic/730 [not run] require ceph-fuse to be valid block disk 2024-04-04T16:28:39.697 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/730 2024-04-04T16:28:39.697 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/730 2024-04-04T16:28:39.697 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T16:28:39.707 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T16:28:39.737 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T16:28:39.738 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/731) 2024-04-04T16:28:40.408 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T16:28:40.425 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T16:28:40.425 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T16:28:40.904 INFO:teuthology.orchestra.run.smithi072.stdout:generic/731 [not run] require ceph-fuse to be valid block disk 2024-04-04T16:28:40.918 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/731 2024-04-04T16:28:40.919 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/731 2024-04-04T16:28:40.919 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T16:28:40.928 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T16:28:40.959 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T16:28:40.959 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/732) 2024-04-04T16:28:41.602 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T16:28:41.615 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T16:28:41.616 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T16:28:42.073 INFO:teuthology.orchestra.run.smithi072.stdout:generic/732 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T16:28:42.085 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/732 2024-04-04T16:28:42.085 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/732 2024-04-04T16:28:42.085 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T16:28:42.095 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T16:28:42.129 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T16:28:42.129 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/733) 2024-04-04T16:28:42.754 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T16:28:42.774 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T16:28:42.774 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T16:28:43.209 INFO:teuthology.orchestra.run.smithi072.stdout:generic/733 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T16:28:43.220 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/733 2024-04-04T16:28:43.220 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/733 2024-04-04T16:28:43.220 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T16:28:43.234 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T16:28:43.270 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T16:28:43.271 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/734) 2024-04-04T16:28:43.902 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T16:28:43.917 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T16:28:43.917 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T16:28:44.499 INFO:teuthology.orchestra.run.smithi072.stdout:generic/734 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-04-04T16:28:44.513 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/734 2024-04-04T16:28:44.513 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/734 2024-04-04T16:28:44.513 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T16:28:44.524 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T16:28:44.573 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T16:28:44.573 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/735) 2024-04-04T16:28:45.430 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T16:28:45.447 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T16:28:45.447 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T16:28:48.440 INFO:teuthology.orchestra.run.smithi072.stdout:generic/735 [not run] xfs_io finsert failed (old kernel/wrong fs?) 2024-04-04T16:28:48.452 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/735 2024-04-04T16:28:48.454 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/735 2024-04-04T16:28:48.454 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T16:28:48.473 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T16:28:48.521 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T16:28:48.521 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/736) 2024-04-04T16:28:49.391 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T16:28:49.409 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T16:28:49.410 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T16:28:58.725 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T16:28:58.733 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-04T16:28:58.882 INFO:tasks.ceph.mds.a.smithi072.stderr:2024-04-04T16:28:58.886+0000 7fa395800640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 546432) UID: 0 2024-04-04T16:28:58.883 INFO:tasks.ceph.mds.c.smithi072.stderr:2024-04-04T16:28:58.887+0000 7fc131e00640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 546432) UID: 0 2024-04-04T16:28:58.892 INFO:tasks.ceph.osd.5.smithi117.stderr:2024-04-04T16:28:58.897+0000 7f144e000640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 61387) UID: 0 2024-04-04T16:28:58.893 INFO:tasks.ceph.osd.6.smithi117.stderr:2024-04-04T16:28:58.897+0000 7fb935800640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 61387) UID: 0 2024-04-04T16:28:58.893 INFO:tasks.ceph.osd.7.smithi117.stderr:2024-04-04T16:28:58.897+0000 7f3028600640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 61387) UID: 0 2024-04-04T16:28:58.893 INFO:tasks.ceph.osd.4.smithi117.stderr:2024-04-04T16:28:58.897+0000 7f248de00640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 61387) UID: 0 2024-04-04T16:33:16.579 INFO:teuthology.orchestra.run.smithi072.stdout:generic/736 266s 2024-04-04T16:33:16.667 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/736 2024-04-04T16:33:16.668 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T16:33:16.678 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T16:33:16.715 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T16:33:16.715 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/737) 2024-04-04T16:33:17.914 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T16:33:17.930 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T16:33:17.930 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T16:33:19.375 INFO:teuthology.orchestra.run.smithi072.stdout:generic/737 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T16:33:19.387 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/737 2024-04-04T16:33:19.387 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/737 2024-04-04T16:33:19.388 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T16:33:19.397 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T16:33:19.436 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T16:33:19.437 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/738) 2024-04-04T16:33:20.100 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T16:33:20.115 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T16:33:20.115 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T16:33:23.260 INFO:teuthology.orchestra.run.smithi072.stdout:generic/738 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T16:33:23.277 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/738 2024-04-04T16:33:23.278 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/738 2024-04-04T16:33:23.278 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T16:33:23.291 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T16:33:23.329 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T16:33:23.329 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.tiFz9P8iUAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/739) 2024-04-04T16:33:24.010 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2024-04-04T16:33:24.024 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-04-04T16:33:24.024 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T16:33:25.698 INFO:teuthology.orchestra.run.smithi072.stdout:generic/739 [not run] this test requires a valid $SCRATCH_DEV 2024-04-04T16:33:25.706 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/739 2024-04-04T16:33:25.707 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/739 2024-04-04T16:33:25.707 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-04-04T16:33:25.713 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T16:33:25.736 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-04T16:33:25.737 INFO:tasks.cephfs.xfstests_dev:=========================================================Total number of tests failed = 15========================================================= 2024-04-04T16:33:25.737 DEBUG:teuthology.orchestra.run.smithi072:> sudo userdel --force --remove fsgqa 2024-04-04T16:33:29.794 DEBUG:teuthology.orchestra.run.smithi072:> sudo userdel --force --remove 123456-fsgqa 2024-04-04T16:33:31.754 DEBUG:teuthology.orchestra.run.smithi072:> sudo groupdel fsgqa 2024-04-04T16:33:31.955 INFO:teuthology.orchestra.run.smithi072.stderr:groupdel: group 'fsgqa' does not exist 2024-04-04T16:33:31.957 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-04T16:33:31.958 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-04T16:33:31.958 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo stat /tmp/tmp.tiFz9P8iUAxfstests-dev/results) 2024-04-04T16:33:32.018 INFO:teuthology.orchestra.run.smithi072.stderr:bash: line 1: cd: /home/ubuntu/cephtest/mnt.0: Permission denied 2024-04-04T16:33:32.019 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-04T16:33:32.020 INFO:tasks.cephfs.xfstests_dev:xfstests-dev repo contains not directory named "results". repo location: /tmp/tmp.tiFz9P8iUAxfstests-dev 2024-04-04T16:33:32.020 DEBUG:teuthology.orchestra.run.smithi072:> sudo rm -rf /tmp/tmp.tiFz9P8iUAxfstests-dev 2024-04-04T16:33:33.096 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-04T16:33:33.096 DEBUG:teuthology.orchestra.run.smithi072:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-04T16:33:33.571 DEBUG:teuthology.orchestra.run.smithi117:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-04T16:33:33.819 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-04T16:33:33.819 INFO:tasks.cephfs.mount:Terminating background process 2024-04-04T16:33:33.819 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-04-04T16:33:33.819 DEBUG:teuthology.orchestra.run.smithi072:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-04T16:33:33.953 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053387,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498296k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249148k,nr_inodes=812287,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498296k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-04T16:33:33.953 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi072.front.sepia.ceph.com 2024-04-04T16:33:33.953 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-04T16:33:33.953 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-04T16:33:34.099 INFO:tasks.cephfs.mount:Terminating background process 2024-04-04T16:33:34.099 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-04-04T16:33:34.099 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-04T16:33:34.150 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053428,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498364k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249180k,nr_inodes=812295,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498364k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-04T16:33:34.150 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi117.front.sepia.ceph.com 2024-04-04T16:33:34.150 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-04T16:33:34.150 DEBUG:teuthology.orchestra.run.smithi117:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-04-04T16:33:34.245 INFO:teuthology.orchestra.run.smithi117.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2024-04-04T16:33:34.246 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-04T16:33:34.246 INFO:tasks.cephfs.mount:Terminating background process 2024-04-04T16:33:34.246 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-04-04T16:33:34.246 DEBUG:teuthology.orchestra.run.smithi072:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-04T16:33:34.324 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053387,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498296k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249148k,nr_inodes=812287,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498296k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-04T16:33:34.325 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi072.front.sepia.ceph.com 2024-04-04T16:33:34.325 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-04T16:33:34.325 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-04-04T16:33:34.396 INFO:teuthology.orchestra.run.smithi072.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2024-04-04T16:33:34.397 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-04T16:33:34.398 INFO:tasks.cephfs.mount:Terminating background process 2024-04-04T16:33:34.398 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-04-04T16:33:34.398 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-04T16:33:34.450 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053428,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498364k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249180k,nr_inodes=812295,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498364k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-04T16:33:34.450 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi117.front.sepia.ceph.com 2024-04-04T16:33:34.450 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-04T16:33:34.450 DEBUG:teuthology.orchestra.run.smithi117:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-04-04T16:33:34.545 INFO:teuthology.orchestra.run.smithi117.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2024-04-04T16:33:34.546 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-04T16:33:34.546 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-04T16:33:35.696 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:35.698+0000 7f4d01a00640 1 Processor -- start 2024-04-04T16:33:35.696 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:35.698+0000 7f4d01a00640 1 -- start start 2024-04-04T16:33:35.698 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:35.700+0000 7f4d01a00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f4cf4050dd0 0x7f4cf4038630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:35.698 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:35.700+0000 7f4d01a00640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4cf404f540 con 0x7f4cf40e1090 2024-04-04T16:33:35.698 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:35.700+0000 7f4d01a00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4cf404f820 con 0x7f4cf403a5d0 2024-04-04T16:33:35.699 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:35.700+0000 7f4d01a00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f4cf404fb00 con 0x7f4cf4050dd0 2024-04-04T16:33:35.699 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:35.701+0000 7f4d01000640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f4cf403a5d0 0x7f4cf4005f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.72:39994/0 (socket says 172.21.15.72:39994) 2024-04-04T16:33:35.699 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:35.701+0000 7f4d01000640 1 -- 172.21.15.72:0/2586664012 learned_addr learned my addr 172.21.15.72:0/2586664012 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-04-04T16:33:35.699 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:35.701+0000 7f4cfb400640 1 --2- 172.21.15.72:0/2586664012 >> v2:172.21.15.117:3300/0 conn(0x7f4cf4050dd0 0x7f4cf4038630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:35.699 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:35.701+0000 7f4cfb400640 1 -- 172.21.15.72:0/2586664012 >> v1:172.21.15.117:6789/0 conn(0x7f4cf403a5d0 legacy=0x7f4cf4005f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:35.699 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:35.701+0000 7f4cfb400640 1 -- 172.21.15.72:0/2586664012 >> v1:172.21.15.72:6789/0 conn(0x7f4cf40e1090 legacy=0x7f4cf4039ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:35.699 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:35.701+0000 7f4cfb400640 1 -- 172.21.15.72:0/2586664012 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cf404fde0 con 0x7f4cf4050dd0 2024-04-04T16:33:35.700 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:35.701+0000 7f4cfaa00640 1 -- 172.21.15.72:0/2586664012 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3748383665 0 0) 0x7f4cf404f540 con 0x7f4cf40e1090 2024-04-04T16:33:35.701 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:35.703+0000 7f4cfb400640 1 --2- 172.21.15.72:0/2586664012 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4cf4050dd0 0x7f4cf4038630 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f4ce80097a0 tx=0x7f4ce802b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c8415f6556b9a018 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T16:33:35.701 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:35.704+0000 7f4cfaa00640 1 -- 172.21.15.72:0/2586664012 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ce8034070 con 0x7f4cf4050dd0 2024-04-04T16:33:35.701 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:35.704+0000 7f4cfaa00640 1 -- 172.21.15.72:0/2586664012 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ce8030610 con 0x7f4cf4050dd0 2024-04-04T16:33:35.701 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:35.704+0000 7f4cfaa00640 1 -- 172.21.15.72:0/2586664012 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ce80309e0 con 0x7f4cf4050dd0 2024-04-04T16:33:35.702 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:35.705+0000 7f4d01a00640 1 -- 172.21.15.72:0/2586664012 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4cf4050dd0 msgr2=0x7f4cf4038630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:35.702 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:35.705+0000 7f4d01a00640 1 --2- 172.21.15.72:0/2586664012 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4cf4050dd0 0x7f4cf4038630 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f4ce80097a0 tx=0x7f4ce802b960 comp rx=0 tx=0).stop 2024-04-04T16:33:35.705 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:35.707+0000 7f4d01a00640 1 -- 172.21.15.72:0/2586664012 shutdown_connections 2024-04-04T16:33:35.705 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:35.707+0000 7f4d01a00640 1 --2- 172.21.15.72:0/2586664012 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4cf4050dd0 0x7f4cf4038630 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:35.705 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:35.707+0000 7f4d01a00640 1 -- 172.21.15.72:0/2586664012 >> 172.21.15.72:0/2586664012 conn(0x7f4cf4009fb0 msgr2=0x7f4cf400a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T16:33:35.707 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:35.709+0000 7f4d01a00640 1 -- 172.21.15.72:0/2586664012 shutdown_connections 2024-04-04T16:33:35.707 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:35.709+0000 7f4d01a00640 1 -- 172.21.15.72:0/2586664012 wait complete. 2024-04-04T16:33:35.709 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:35.712+0000 7f4d01a00640 1 Processor -- start 2024-04-04T16:33:35.710 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:35.712+0000 7f4d01a00640 1 -- start start 2024-04-04T16:33:35.711 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:35.713+0000 7f4d01a00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4cf403a5d0 0x7f4cf40e3510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:35.711 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:35.714+0000 7f4d01a00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4cf4050dd0 0x7f4cf40e1a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:35.711 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:35.714+0000 7f4d01a00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4cf40e1090 0x7f4cf4006be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:35.712 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:35.714+0000 7f4cfb400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4cf4050dd0 0x7f4cf40e1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:35.712 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:35.714+0000 7f4cfb400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4cf4050dd0 0x7f4cf40e1a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.72:47202/0 (socket says 172.21.15.72:47202) 2024-04-04T16:33:35.713 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:35.714+0000 7f4cfb400640 1 -- 172.21.15.72:0/1989167986 learned_addr learned my addr 172.21.15.72:0/1989167986 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T16:33:35.713 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:35.714+0000 7f4cfbe00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4cf403a5d0 0x7f4cf40e3510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:35.713 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:35.714+0000 7f4d01a00640 1 -- 172.21.15.72:0/1989167986 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f4cf40066a0 con 0x7f4cf40e1090 2024-04-04T16:33:35.713 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:35.714+0000 7f4d01a00640 1 -- 172.21.15.72:0/1989167986 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f4cf40503a0 con 0x7f4cf403a5d0 2024-04-04T16:33:35.713 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:35.714+0000 7f4d01a00640 1 -- 172.21.15.72:0/1989167986 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f4cf4006820 con 0x7f4cf4050dd0 2024-04-04T16:33:35.713 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:35.714+0000 7f4d01000640 1 --2- 172.21.15.72:0/1989167986 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4cf40e1090 0x7f4cf4006be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:35.713 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:35.715+0000 7f4d01000640 1 -- 172.21.15.72:0/1989167986 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4cf4050dd0 msgr2=0x7f4cf40e1a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:35.713 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:35.715+0000 7f4d01000640 1 --2- 172.21.15.72:0/1989167986 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4cf4050dd0 0x7f4cf40e1a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:35.714 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:35.715+0000 7f4d01000640 1 -- 172.21.15.72:0/1989167986 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4cf403a5d0 msgr2=0x7f4cf40e3510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:35.714 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:35.715+0000 7f4d01000640 1 --2- 172.21.15.72:0/1989167986 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4cf403a5d0 0x7f4cf40e3510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:35.714 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:35.715+0000 7f4d01000640 1 -- 172.21.15.72:0/1989167986 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cf40e4340 con 0x7f4cf40e1090 2024-04-04T16:33:35.714 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:35.715+0000 7f4cfb400640 1 --2- 172.21.15.72:0/1989167986 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4cf4050dd0 0x7f4cf40e1a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-04T16:33:35.715 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:35.715+0000 7f4cfbe00640 1 --2- 172.21.15.72:0/1989167986 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4cf403a5d0 0x7f4cf40e3510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-04T16:33:35.715 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:35.716+0000 7f4d01000640 1 --2- 172.21.15.72:0/1989167986 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4cf40e1090 0x7f4cf4006be0 secure :-1 s=READY pgs=2144 cs=0 l=1 rev1=1 crypto rx=0x7f4cfc050660 tx=0x7f4cfc069080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T16:33:35.715 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:35.716+0000 7f4cefe00640 1 -- 172.21.15.72:0/1989167986 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cfc06cbe0 con 0x7f4cf40e1090 2024-04-04T16:33:35.715 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:35.716+0000 7f4d01a00640 1 -- 172.21.15.72:0/1989167986 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4cf40e3d80 con 0x7f4cf40e1090 2024-04-04T16:33:35.715 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:35.717+0000 7f4d01a00640 1 -- 172.21.15.72:0/1989167986 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4cf404bc30 con 0x7f4cf40e1090 2024-04-04T16:33:35.715 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:35.717+0000 7f4cefe00640 1 -- 172.21.15.72:0/1989167986 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4cfc06cde0 con 0x7f4cf40e1090 2024-04-04T16:33:35.715 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:35.717+0000 7f4cefe00640 1 -- 172.21.15.72:0/1989167986 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cfc073400 con 0x7f4cf40e1090 2024-04-04T16:33:35.717 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:35.719+0000 7f4d01a00640 1 -- 172.21.15.72:0/1989167986 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4cd8005290 con 0x7f4cf40e1090 2024-04-04T16:33:35.721 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:35.724+0000 7f4cefe00640 1 -- 172.21.15.72:0/1989167986 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4cfc0735a0 con 0x7f4cf40e1090 2024-04-04T16:33:35.730 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:35.725+0000 7f4cefe00640 1 --2- 172.21.15.72:0/1989167986 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f4cdc06c940 0x7f4cdc06ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:35.730 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:35.725+0000 7f4cefe00640 1 -- 172.21.15.72:0/1989167986 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f4cfc106b10 con 0x7f4cf40e1090 2024-04-04T16:33:35.730 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:35.731+0000 7f4cfbe00640 1 --2- 172.21.15.72:0/1989167986 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f4cdc06c940 0x7f4cdc06ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:35.730 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:35.732+0000 7f4cfbe00640 1 --2- 172.21.15.72:0/1989167986 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f4cdc06c940 0x7f4cdc06ee00 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f4cf0000f60 tx=0x7f4cf0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T16:33:35.730 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:35.732+0000 7f4cefe00640 1 -- 172.21.15.72:0/1989167986 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f4cfc08f030 con 0x7f4cf40e1090 2024-04-04T16:33:36.150 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:36.152+0000 7f4d01a00640 1 -- 172.21.15.72:0/1989167986 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4cd8005580 con 0x7f4cf40e1090 2024-04-04T16:33:36.151 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:36.153+0000 7f4cefe00640 1 -- 172.21.15.72:0/1989167986 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+5184 (secure 0 0 0) 0x7f4cfc0d4f30 con 0x7f4cf40e1090 2024-04-04T16:33:36.152 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T16:33:36.152 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4619,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/2380537280","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6833","nonce":2380537280},{"type":"v1","addr":"172.21.15.117:6835","nonce":2380537280}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4840,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6834/108808341","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":108808341},{"type":"v1","addr":"172.21.15.117:6834","nonce":108808341}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":5253,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6836/3494332623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":3494332623},{"type":"v1","addr":"172.21.15.72:6836","nonce":3494332623}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-04T06:57:50.020152+0000","modified":"2024-04-04T06:57:53.165429+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5256},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5256":{"gid":5256,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.72:6837/2509618069","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6835","nonce":2509618069},{"type":"v1","addr":"172.21.15.72:6837","nonce":2509618069}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5256,"qdb_cluster":[5256]},"id":2}]} 2024-04-04T16:33:36.152 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 17 2024-04-04T16:33:36.156 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:36.157+0000 7f4d01a00640 1 -- 172.21.15.72:0/1989167986 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f4cdc06c940 msgr2=0x7f4cdc06ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:36.156 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:36.157+0000 7f4d01a00640 1 --2- 172.21.15.72:0/1989167986 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f4cdc06c940 0x7f4cdc06ee00 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f4cf0000f60 tx=0x7f4cf0009040 comp rx=0 tx=0).stop 2024-04-04T16:33:36.156 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:36.157+0000 7f4d01a00640 1 -- 172.21.15.72:0/1989167986 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4cf40e1090 msgr2=0x7f4cf4006be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:36.156 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:36.157+0000 7f4d01a00640 1 --2- 172.21.15.72:0/1989167986 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4cf40e1090 0x7f4cf4006be0 secure :-1 s=READY pgs=2144 cs=0 l=1 rev1=1 crypto rx=0x7f4cfc050660 tx=0x7f4cfc069080 comp rx=0 tx=0).stop 2024-04-04T16:33:36.156 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:36.157+0000 7f4d01a00640 1 -- 172.21.15.72:0/1989167986 shutdown_connections 2024-04-04T16:33:36.156 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:36.157+0000 7f4d01a00640 1 --2- 172.21.15.72:0/1989167986 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f4cdc06c940 0x7f4cdc06ee00 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:36.156 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:36.157+0000 7f4d01a00640 1 --2- 172.21.15.72:0/1989167986 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4cf40e1090 0x7f4cf4006be0 unknown :-1 s=CLOSED pgs=2144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:36.156 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:36.157+0000 7f4d01a00640 1 --2- 172.21.15.72:0/1989167986 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4cf4050dd0 0x7f4cf40e1a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:36.157 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:36.157+0000 7f4d01a00640 1 --2- 172.21.15.72:0/1989167986 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4cf403a5d0 0x7f4cf40e3510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:36.157 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:36.157+0000 7f4d01a00640 1 -- 172.21.15.72:0/1989167986 >> 172.21.15.72:0/1989167986 conn(0x7f4cf4009fb0 msgr2=0x7f4cf4004930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T16:33:36.157 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:36.158+0000 7f4d01a00640 1 -- 172.21.15.72:0/1989167986 shutdown_connections 2024-04-04T16:33:36.157 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:36.158+0000 7f4d01a00640 1 -- 172.21.15.72:0/1989167986 wait complete. 2024-04-04T16:33:36.199 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-04T16:33:36.478 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:36.481+0000 7f8ebb400640 1 Processor -- start 2024-04-04T16:33:36.479 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:36.481+0000 7f8ebb400640 1 -- start start 2024-04-04T16:33:36.480 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:36.482+0000 7f8ebb400640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f8eb4162850 0x7f8eb40cea40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:36.480 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:36.482+0000 7f8ebb400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8eb40ccad0 0x7f8eb40ccf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:36.480 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:36.482+0000 7f8ebb400640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8eb40b3080 con 0x7f8eb4166460 2024-04-04T16:33:36.480 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:36.482+0000 7f8ebb400640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f8eb40cd470 con 0x7f8eb4162850 2024-04-04T16:33:36.480 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:36.482+0000 7f8ebb400640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f8eb40cf5a0 con 0x7f8eb40ccad0 2024-04-04T16:33:36.481 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:36.483+0000 7f8eb3e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8eb40ccad0 0x7f8eb40ccf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:36.482 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:36.483+0000 7f8eb8a00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f8eb4162850 0x7f8eb40cea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:36.482 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:36.483+0000 7f8eb9400640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f8eb4166460 0x7f8eb41668f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:41074/0 (socket says 172.21.15.72:41074) 2024-04-04T16:33:36.482 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:36.483+0000 7f8eb9400640 1 -- 172.21.15.72:0/186236419 learned_addr learned my addr 172.21.15.72:0/186236419 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-04-04T16:33:36.482 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:36.483+0000 7f8eb3400640 1 -- 172.21.15.72:0/186236419 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1082963705 0 0) 0x7f8eb40b3080 con 0x7f8eb4166460 2024-04-04T16:33:36.482 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:36.483+0000 7f8eb3400640 1 -- 172.21.15.72:0/186236419 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8e9c003520 con 0x7f8eb4166460 2024-04-04T16:33:36.482 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:36.484+0000 7f8eb3e00640 1 -- 172.21.15.72:0/186236419 >> v2:172.21.15.117:3300/0 conn(0x7f8eb4162850 msgr2=0x7f8eb40cea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T16:33:36.482 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:36.484+0000 7f8eb3e00640 1 --2- 172.21.15.72:0/186236419 >> v2:172.21.15.117:3300/0 conn(0x7f8eb4162850 0x7f8eb40cea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:36.482 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:36.484+0000 7f8eb3e00640 1 -- 172.21.15.72:0/186236419 >> v1:172.21.15.72:6789/0 conn(0x7f8eb4166460 legacy=0x7f8eb41668f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:36.482 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:36.484+0000 7f8eb3e00640 1 -- 172.21.15.72:0/186236419 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8eb40b38e0 con 0x7f8eb40ccad0 2024-04-04T16:33:36.482 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:36.484+0000 7f8eb8a00640 1 --2- 172.21.15.72:0/186236419 >> v2:172.21.15.117:3300/0 conn(0x7f8eb4162850 0x7f8eb40cea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-04T16:33:36.485 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:36.488+0000 7f8eb3e00640 1 --2- 172.21.15.72:0/186236419 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8eb40ccad0 0x7f8eb40ccf30 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f8ea00097a0 tx=0x7f8ea002b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ba8e2ad2ad05268b server_cookie=0 in_seq=0 out_seq=0 2024-04-04T16:33:36.486 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:36.488+0000 7f8eb3400640 1 -- 172.21.15.72:0/186236419 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ea0035020 con 0x7f8eb40ccad0 2024-04-04T16:33:36.486 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:36.488+0000 7f8eb3400640 1 -- 172.21.15.72:0/186236419 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ea0031810 con 0x7f8eb40ccad0 2024-04-04T16:33:36.486 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:36.488+0000 7f8eb3400640 1 -- 172.21.15.72:0/186236419 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ea0031be0 con 0x7f8eb40ccad0 2024-04-04T16:33:36.487 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:36.489+0000 7f8ebb400640 1 -- 172.21.15.72:0/186236419 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8eb40ccad0 msgr2=0x7f8eb40ccf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:36.487 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:36.489+0000 7f8ebb400640 1 --2- 172.21.15.72:0/186236419 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8eb40ccad0 0x7f8eb40ccf30 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f8ea00097a0 tx=0x7f8ea002b8b0 comp rx=0 tx=0).stop 2024-04-04T16:33:36.487 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:36.490+0000 7f8ebb400640 1 -- 172.21.15.72:0/186236419 shutdown_connections 2024-04-04T16:33:36.487 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:36.490+0000 7f8ebb400640 1 --2- 172.21.15.72:0/186236419 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8eb40ccad0 0x7f8eb40ccf30 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:36.487 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:36.490+0000 7f8ebb400640 1 --2- 172.21.15.72:0/186236419 >> v2:172.21.15.117:3300/0 conn(0x7f8eb4162850 0x7f8eb40cea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:36.487 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:36.490+0000 7f8ebb400640 1 -- 172.21.15.72:0/186236419 >> 172.21.15.72:0/186236419 conn(0x7f8eb406b470 msgr2=0x7f8eb406b880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T16:33:36.488 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:36.490+0000 7f8ebb400640 1 -- 172.21.15.72:0/186236419 shutdown_connections 2024-04-04T16:33:36.488 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:36.490+0000 7f8ebb400640 1 -- 172.21.15.72:0/186236419 wait complete. 2024-04-04T16:33:36.490 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:36.492+0000 7f8ebb400640 1 Processor -- start 2024-04-04T16:33:36.490 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:36.493+0000 7f8ebb400640 1 -- start start 2024-04-04T16:33:36.492 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:36.494+0000 7f8ebb400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8eb40ccad0 0x7f8eb41545f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:36.492 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:36.494+0000 7f8ebb400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8eb4162850 0x7f8eb41654b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:36.492 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:36.494+0000 7f8ebb400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8eb4166460 0x7f8eb40aea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:36.492 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:36.494+0000 7f8ebb400640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f8eb40cf840 con 0x7f8eb4162850 2024-04-04T16:33:36.492 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:36.494+0000 7f8ebb400640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f8eb40b3600 con 0x7f8eb4166460 2024-04-04T16:33:36.492 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:36.494+0000 7f8ebb400640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f8eb40cef80 con 0x7f8eb40ccad0 2024-04-04T16:33:36.493 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:36.495+0000 7f8eb3e00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8eb4162850 0x7f8eb41654b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:36.493 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:36.495+0000 7f8eb8a00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8eb40ccad0 0x7f8eb41545f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:36.493 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:36.495+0000 7f8eb8a00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8eb40ccad0 0x7f8eb41545f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.72:47212/0 (socket says 172.21.15.72:47212) 2024-04-04T16:33:36.493 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:36.495+0000 7f8eb3e00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8eb4162850 0x7f8eb41654b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:39728/0 (socket says 172.21.15.72:39728) 2024-04-04T16:33:36.493 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:36.495+0000 7f8eb8a00640 1 -- 172.21.15.72:0/2446527703 learned_addr learned my addr 172.21.15.72:0/2446527703 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T16:33:36.493 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:36.495+0000 7f8eb9400640 1 --2- 172.21.15.72:0/2446527703 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8eb4166460 0x7f8eb40aea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:36.493 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:36.495+0000 7f8eb3e00640 1 -- 172.21.15.72:0/2446527703 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8eb40ccad0 msgr2=0x7f8eb41545f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:36.493 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:36.495+0000 7f8eb3e00640 1 --2- 172.21.15.72:0/2446527703 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8eb40ccad0 0x7f8eb41545f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:36.494 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:36.495+0000 7f8eb3e00640 1 -- 172.21.15.72:0/2446527703 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8eb4166460 msgr2=0x7f8eb40aea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:36.494 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:36.495+0000 7f8eb3e00640 1 --2- 172.21.15.72:0/2446527703 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8eb4166460 0x7f8eb40aea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:36.494 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:36.495+0000 7f8eb3e00640 1 -- 172.21.15.72:0/2446527703 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8eb415f8d0 con 0x7f8eb4162850 2024-04-04T16:33:36.494 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:36.496+0000 7f8eb8a00640 1 --2- 172.21.15.72:0/2446527703 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8eb40ccad0 0x7f8eb41545f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-04T16:33:36.494 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:36.496+0000 7f8eb3e00640 1 --2- 172.21.15.72:0/2446527703 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8eb4162850 0x7f8eb41654b0 secure :-1 s=READY pgs=2146 cs=0 l=1 rev1=1 crypto rx=0x7f8eb40b3250 tx=0x7f8ea00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T16:33:36.495 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:36.496+0000 7f8eb0c00640 1 -- 172.21.15.72:0/2446527703 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ea0035040 con 0x7f8eb4162850 2024-04-04T16:33:36.495 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:36.496+0000 7f8eb0c00640 1 -- 172.21.15.72:0/2446527703 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ea003ad00 con 0x7f8eb4162850 2024-04-04T16:33:36.495 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:36.496+0000 7f8eb0c00640 1 -- 172.21.15.72:0/2446527703 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ea00466a0 con 0x7f8eb4162850 2024-04-04T16:33:36.495 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:36.497+0000 7f8ebb400640 1 -- 172.21.15.72:0/2446527703 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8eb4154b30 con 0x7f8eb4162850 2024-04-04T16:33:36.495 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:36.497+0000 7f8ebb400640 1 -- 172.21.15.72:0/2446527703 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8eb40adfb0 con 0x7f8eb4162850 2024-04-04T16:33:36.497 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:36.499+0000 7f8ebb400640 1 -- 172.21.15.72:0/2446527703 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8eb4075840 con 0x7f8eb4162850 2024-04-04T16:33:36.497 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:36.500+0000 7f8eb0c00640 1 -- 172.21.15.72:0/2446527703 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8ea0038020 con 0x7f8eb4162850 2024-04-04T16:33:36.498 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:36.501+0000 7f8eb0c00640 1 --2- 172.21.15.72:0/2446527703 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f8e9406c940 0x7f8e9406ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:36.499 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:36.502+0000 7f8eb0c00640 1 -- 172.21.15.72:0/2446527703 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f8ea00ada10 con 0x7f8eb4162850 2024-04-04T16:33:36.499 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:36.502+0000 7f8eb8a00640 1 --2- 172.21.15.72:0/2446527703 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f8e9406c940 0x7f8e9406ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:36.500 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:36.502+0000 7f8eb8a00640 1 --2- 172.21.15.72:0/2446527703 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f8e9406c940 0x7f8e9406ee00 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f8ea8009560 tx=0x7f8ea8009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T16:33:36.507 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:36.509+0000 7f8eb0c00640 1 -- 172.21.15.72:0/2446527703 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f8eb415f8d0 con 0x7f8eb4162850 2024-04-04T16:33:36.847 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:36.849+0000 7f8ebb400640 1 -- 172.21.15.72:0/2446527703 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8eb40b50a0 con 0x7f8eb4162850 2024-04-04T16:33:36.848 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:36.851+0000 7f8eb0c00640 1 -- 172.21.15.72:0/2446527703 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) ==== 74+0+16645 (secure 0 0 0) 0x7f8ea007b8d0 con 0x7f8eb4162850 2024-04-04T16:33:36.849 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T16:33:36.849 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":33,"fsid":"6708bac2-4f50-49b5-87a9-c390fd333eb3","created":"2024-04-04T06:56:04.282498+0000","modified":"2024-04-04T06:57:51.552734+0000","last_up_change":"2024-04-04T06:56:16.716089+0000","last_in_change":"2024-04-04T06:56:07.768593+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-04T06:56:17.421685+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-04-04T06:57:47.865021+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-04-04T06:57:48.981181+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7c345991-5af8-4dc6-a481-28610c40e128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":3889813953},{"type":"v1","addr":"172.21.15.72:6818","nonce":3889813953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":3889813953},{"type":"v1","addr":"172.21.15.72:6821","nonce":3889813953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":3889813953},{"type":"v1","addr":"172.21.15.72:6826","nonce":3889813953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":3889813953},{"type":"v1","addr":"172.21.15.72:6823","nonce":3889813953}]},"public_addr":"172.21.15.72:6818/3889813953","cluster_addr":"172.21.15.72:6821/3889813953","heartbeat_back_addr":"172.21.15.72:6826/3889813953","heartbeat_front_addr":"172.21.15.72:6823/3889813953","state":["exists","up"]},{"osd":1,"uuid":"1b3f7ab2-a56c-488d-a89a-1f3572361c95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":3101663154},{"type":"v1","addr":"172.21.15.72:6801","nonce":3101663154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":3101663154},{"type":"v1","addr":"172.21.15.72:6803","nonce":3101663154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":3101663154},{"type":"v1","addr":"172.21.15.72:6807","nonce":3101663154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":3101663154},{"type":"v1","addr":"172.21.15.72:6805","nonce":3101663154}]},"public_addr":"172.21.15.72:6801/3101663154","cluster_addr":"172.21.15.72:6803/3101663154","heartbeat_back_addr":"172.21.15.72:6807/3101663154","heartbeat_front_addr":"172.21.15.72:6805/3101663154","state":["exists","up"]},{"osd":2,"uuid":"fc9aa512-53df-40d7-ba04-3e6b7dcd1e34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":235374192},{"type":"v1","addr":"172.21.15.72:6809","nonce":235374192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":235374192},{"type":"v1","addr":"172.21.15.72:6811","nonce":235374192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":235374192},{"type":"v1","addr":"172.21.15.72:6815","nonce":235374192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":235374192},{"type":"v1","addr":"172.21.15.72:6813","nonce":235374192}]},"public_addr":"172.21.15.72:6809/235374192","cluster_addr":"172.21.15.72:6811/235374192","heartbeat_back_addr":"172.21.15.72:6815/235374192","heartbeat_front_addr":"172.21.15.72:6813/235374192","state":["exists","up"]},{"osd":3,"uuid":"b4f63eed-dc5b-4aba-bb50-de46eb41492b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6817","nonce":2806631742},{"type":"v1","addr":"172.21.15.72:6819","nonce":2806631742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":2806631742},{"type":"v1","addr":"172.21.15.72:6827","nonce":2806631742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":2806631742},{"type":"v1","addr":"172.21.15.72:6831","nonce":2806631742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":2806631742},{"type":"v1","addr":"172.21.15.72:6829","nonce":2806631742}]},"public_addr":"172.21.15.72:6819/2806631742","cluster_addr":"172.21.15.72:6827/2806631742","heartbeat_back_addr":"172.21.15.72:6831/2806631742","heartbeat_front_addr":"172.21.15.72:6829/2806631742","state":["exists","up"]},{"osd":4,"uuid":"9e985ef8-d711-4172-9286-c54e560895d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":4293536423},{"type":"v1","addr":"172.21.15.117:6825","nonce":4293536423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":4293536423},{"type":"v1","addr":"172.21.15.117:6827","nonce":4293536423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":4293536423},{"type":"v1","addr":"172.21.15.117:6831","nonce":4293536423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":4293536423},{"type":"v1","addr":"172.21.15.117:6829","nonce":4293536423}]},"public_addr":"172.21.15.117:6825/4293536423","cluster_addr":"172.21.15.117:6827/4293536423","heartbeat_back_addr":"172.21.15.117:6831/4293536423","heartbeat_front_addr":"172.21.15.117:6829/4293536423","state":["exists","up"]},{"osd":5,"uuid":"3e9f082b-8d7d-455f-8a96-66d0b4857125","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":684971679},{"type":"v1","addr":"172.21.15.117:6801","nonce":684971679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":684971679},{"type":"v1","addr":"172.21.15.117:6803","nonce":684971679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":684971679},{"type":"v1","addr":"172.21.15.117:6807","nonce":684971679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":684971679},{"type":"v1","addr":"172.21.15.117:6805","nonce":684971679}]},"public_addr":"172.21.15.117:6801/684971679","cluster_addr":"172.21.15.117:6803/684971679","heartbeat_back_addr":"172.21.15.117:6807/684971679","heartbeat_front_addr":"172.21.15.117:6805/684971679","state":["exists","up"]},{"osd":6,"uuid":"bcdafa9f-a870-4398-a38d-ab7697676473","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":2781186528},{"type":"v1","addr":"172.21.15.117:6809","nonce":2781186528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":2781186528},{"type":"v1","addr":"172.21.15.117:6811","nonce":2781186528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":2781186528},{"type":"v1","addr":"172.21.15.117:6815","nonce":2781186528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":2781186528},{"type":"v1","addr":"172.21.15.117:6813","nonce":2781186528}]},"public_addr":"172.21.15.117:6809/2781186528","cluster_addr":"172.21.15.117:6811/2781186528","heartbeat_back_addr":"172.21.15.117:6815/2781186528","heartbeat_front_addr":"172.21.15.117:6813/2781186528","state":["exists","up"]},{"osd":7,"uuid":"b68ec562-ff35-4d2d-a733-c896f8920cfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":617469882},{"type":"v1","addr":"172.21.15.117:6817","nonce":617469882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":617469882},{"type":"v1","addr":"172.21.15.117:6819","nonce":617469882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":617469882},{"type":"v1","addr":"172.21.15.117:6823","nonce":617469882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":617469882},{"type":"v1","addr":"172.21.15.117:6821","nonce":617469882}]},"public_addr":"172.21.15.117:6817/617469882","cluster_addr":"172.21.15.117:6819/617469882","heartbeat_back_addr":"172.21.15.117:6823/617469882","heartbeat_front_addr":"172.21.15.117:6821/617469882","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.347700+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.296619+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.361345+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.093323+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:12.857605+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:12.816090+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.083163+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.121639+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-04T16:33:36.851 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:36.853+0000 7f8ebb400640 1 -- 172.21.15.72:0/2446527703 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f8e9406c940 msgr2=0x7f8e9406ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:36.851 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:36.853+0000 7f8ebb400640 1 --2- 172.21.15.72:0/2446527703 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f8e9406c940 0x7f8e9406ee00 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f8ea8009560 tx=0x7f8ea8009190 comp rx=0 tx=0).stop 2024-04-04T16:33:36.851 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:36.853+0000 7f8ebb400640 1 -- 172.21.15.72:0/2446527703 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8eb4162850 msgr2=0x7f8eb41654b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:36.851 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:36.853+0000 7f8ebb400640 1 --2- 172.21.15.72:0/2446527703 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8eb4162850 0x7f8eb41654b0 secure :-1 s=READY pgs=2146 cs=0 l=1 rev1=1 crypto rx=0x7f8eb40b3250 tx=0x7f8ea00046c0 comp rx=0 tx=0).stop 2024-04-04T16:33:36.853 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:36.855+0000 7f8ebb400640 1 -- 172.21.15.72:0/2446527703 shutdown_connections 2024-04-04T16:33:36.853 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:36.855+0000 7f8ebb400640 1 --2- 172.21.15.72:0/2446527703 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f8e9406c940 0x7f8e9406ee00 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:36.853 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:36.855+0000 7f8ebb400640 1 --2- 172.21.15.72:0/2446527703 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8eb4166460 0x7f8eb40aea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:36.853 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:36.855+0000 7f8ebb400640 1 --2- 172.21.15.72:0/2446527703 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8eb4162850 0x7f8eb41654b0 unknown :-1 s=CLOSED pgs=2146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:36.853 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:36.855+0000 7f8ebb400640 1 --2- 172.21.15.72:0/2446527703 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8eb40ccad0 0x7f8eb41545f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:36.853 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:36.855+0000 7f8ebb400640 1 -- 172.21.15.72:0/2446527703 >> 172.21.15.72:0/2446527703 conn(0x7f8eb406b470 msgr2=0x7f8eb41618b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T16:33:36.855 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:36.858+0000 7f8ebb400640 1 -- 172.21.15.72:0/2446527703 shutdown_connections 2024-04-04T16:33:36.856 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:36.859+0000 7f8ebb400640 1 -- 172.21.15.72:0/2446527703 wait complete. 2024-04-04T16:33:36.882 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-04T06:56:17.421685+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-04T06:57:47.865021+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '32', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2024-04-04T06:57:48.981181+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '33', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-04T16:33:36.883 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-04T16:33:37.127 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:37.129+0000 7f72e6800640 1 Processor -- start 2024-04-04T16:33:37.129 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:37.130+0000 7f72e6800640 1 -- start start 2024-04-04T16:33:37.129 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:37.131+0000 7f72e6800640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f72e0151330 0x7f72e006d340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:37.130 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:37.131+0000 7f72e6800640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f72e006d880 0x7f72e0071b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:37.130 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:37.131+0000 7f72e6800640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f72e00b27c0 0x7f72e0072040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:37.130 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:37.131+0000 7f72e6800640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f72e006dce0 con 0x7f72e006d880 2024-04-04T16:33:37.131 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:37.131+0000 7f72e6800640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f72e0072580 con 0x7f72e00b27c0 2024-04-04T16:33:37.131 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:37.131+0000 7f72e6800640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f72e015e090 con 0x7f72e0151330 2024-04-04T16:33:37.131 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:37.132+0000 7f72dea00640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f72e006d880 0x7f72e0071b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:37.131 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:37.132+0000 7f72dea00640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f72e006d880 0x7f72e0071b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:39732/0 (socket says 172.21.15.72:39732) 2024-04-04T16:33:37.131 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:37.132+0000 7f72dea00640 1 -- 172.21.15.72:0/1216401202 learned_addr learned my addr 172.21.15.72:0/1216401202 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T16:33:37.131 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:37.132+0000 7f72df400640 1 --2- 172.21.15.72:0/1216401202 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f72e0151330 0x7f72e006d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:37.131 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:37.133+0000 7f72dfe00640 1 --2- 172.21.15.72:0/1216401202 >> v2:172.21.15.117:3300/0 conn(0x7f72e00b27c0 0x7f72e0072040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:37.131 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:37.133+0000 7f72df400640 1 -- 172.21.15.72:0/1216401202 >> v2:172.21.15.117:3300/0 conn(0x7f72e00b27c0 msgr2=0x7f72e0072040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T16:33:37.131 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:37.133+0000 7f72df400640 1 --2- 172.21.15.72:0/1216401202 >> v2:172.21.15.117:3300/0 conn(0x7f72e00b27c0 0x7f72e0072040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:37.131 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:37.133+0000 7f72df400640 1 -- 172.21.15.72:0/1216401202 >> v2:172.21.15.72:3300/0 conn(0x7f72e006d880 msgr2=0x7f72e0071b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T16:33:37.132 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:37.133+0000 7f72df400640 1 --2- 172.21.15.72:0/1216401202 >> v2:172.21.15.72:3300/0 conn(0x7f72e006d880 0x7f72e0071b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:37.132 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:37.133+0000 7f72df400640 1 -- 172.21.15.72:0/1216401202 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72e015e370 con 0x7f72e0151330 2024-04-04T16:33:37.132 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:37.135+0000 7f72df400640 1 --2- 172.21.15.72:0/1216401202 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f72e0151330 0x7f72e006d340 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f72e006e580 tx=0x7f72d802be30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7903a9e65b01d481 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T16:33:37.132 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:37.135+0000 7f72de000640 1 -- 172.21.15.72:0/1216401202 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72d8039070 con 0x7f72e0151330 2024-04-04T16:33:37.133 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:37.135+0000 7f72de000640 1 -- 172.21.15.72:0/1216401202 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72d802cbe0 con 0x7f72e0151330 2024-04-04T16:33:37.133 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:37.135+0000 7f72de000640 1 -- 172.21.15.72:0/1216401202 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72d8034440 con 0x7f72e0151330 2024-04-04T16:33:37.139 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:37.137+0000 7f72e6800640 1 -- 172.21.15.72:0/1216401202 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f72e0151330 msgr2=0x7f72e006d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:37.139 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:37.137+0000 7f72e6800640 1 --2- 172.21.15.72:0/1216401202 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f72e0151330 0x7f72e006d340 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f72e006e580 tx=0x7f72d802be30 comp rx=0 tx=0).stop 2024-04-04T16:33:37.139 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:37.141+0000 7f72e6800640 1 -- 172.21.15.72:0/1216401202 shutdown_connections 2024-04-04T16:33:37.139 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:37.141+0000 7f72e6800640 1 --2- 172.21.15.72:0/1216401202 >> v2:172.21.15.117:3300/0 conn(0x7f72e00b27c0 0x7f72e0072040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:37.139 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:37.141+0000 7f72e6800640 1 --2- 172.21.15.72:0/1216401202 >> v2:172.21.15.72:3300/0 conn(0x7f72e006d880 0x7f72e0071b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:37.139 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:37.141+0000 7f72e6800640 1 --2- 172.21.15.72:0/1216401202 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f72e0151330 0x7f72e006d340 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:37.139 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:37.141+0000 7f72e6800640 1 -- 172.21.15.72:0/1216401202 >> 172.21.15.72:0/1216401202 conn(0x7f72e00b1cd0 msgr2=0x7f72e00b20b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T16:33:37.139 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:37.141+0000 7f72e6800640 1 -- 172.21.15.72:0/1216401202 shutdown_connections 2024-04-04T16:33:37.139 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:37.141+0000 7f72e6800640 1 -- 172.21.15.72:0/1216401202 wait complete. 2024-04-04T16:33:37.141 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:37.144+0000 7f72e6800640 1 Processor -- start 2024-04-04T16:33:37.142 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:37.144+0000 7f72e6800640 1 -- start start 2024-04-04T16:33:37.143 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:37.145+0000 7f72e6800640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f72e006d880 0x7f72e01483a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:37.143 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:37.146+0000 7f72e6800640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f72e00b27c0 0x7f72e0147b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:37.143 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:37.146+0000 7f72e6800640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f72e0151330 0x7f72e00cd990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:37.144 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:37.147+0000 7f72e6800640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f72e015ec10 con 0x7f72e0151330 2024-04-04T16:33:37.144 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:37.147+0000 7f72e6800640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f72e015e930 con 0x7f72e00b27c0 2024-04-04T16:33:37.145 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:37.147+0000 7f72e6800640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f72e0151710 con 0x7f72e006d880 2024-04-04T16:33:37.145 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:37.147+0000 7f72dea00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f72e00b27c0 0x7f72e0147b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:37.145 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:37.147+0000 7f72dea00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f72e00b27c0 0x7f72e0147b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.72:56098/0 (socket says 172.21.15.72:56098) 2024-04-04T16:33:37.145 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:37.147+0000 7f72dea00640 1 -- 172.21.15.72:0/1239444217 learned_addr learned my addr 172.21.15.72:0/1239444217 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T16:33:37.145 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:37.147+0000 7f72dfe00640 1 --2- 172.21.15.72:0/1239444217 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f72e0151330 0x7f72e00cd990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:37.145 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:37.148+0000 7f72dea00640 1 -- 172.21.15.72:0/1239444217 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f72e006d880 msgr2=0x7f72e01483a0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-04T16:33:37.146 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:37.148+0000 7f72dea00640 1 --2- 172.21.15.72:0/1239444217 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f72e006d880 0x7f72e01483a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:37.146 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:37.148+0000 7f72dea00640 1 -- 172.21.15.72:0/1239444217 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f72e0151330 msgr2=0x7f72e00cd990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:37.146 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:37.148+0000 7f72dea00640 1 --2- 172.21.15.72:0/1239444217 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f72e0151330 0x7f72e00cd990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:37.146 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:37.148+0000 7f72dea00640 1 -- 172.21.15.72:0/1239444217 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72e0148ca0 con 0x7f72e00b27c0 2024-04-04T16:33:37.146 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:37.148+0000 7f72dfe00640 1 --2- 172.21.15.72:0/1239444217 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f72e0151330 0x7f72e00cd990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-04T16:33:37.147 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:37.149+0000 7f72dea00640 1 --2- 172.21.15.72:0/1239444217 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f72e00b27c0 0x7f72e0147b10 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f72c800e840 tx=0x7f72c800ed00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T16:33:37.147 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:37.150+0000 7f72d7400640 1 -- 172.21.15.72:0/1239444217 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72c8017070 con 0x7f72e00b27c0 2024-04-04T16:33:37.148 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:37.150+0000 7f72d7400640 1 -- 172.21.15.72:0/1239444217 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72c800c8e0 con 0x7f72e00b27c0 2024-04-04T16:33:37.148 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:37.150+0000 7f72d7400640 1 -- 172.21.15.72:0/1239444217 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72c800ccd0 con 0x7f72e00b27c0 2024-04-04T16:33:37.148 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:37.150+0000 7f72e6800640 1 -- 172.21.15.72:0/1239444217 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72e0148f80 con 0x7f72e00b27c0 2024-04-04T16:33:37.148 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:37.150+0000 7f72e6800640 1 -- 172.21.15.72:0/1239444217 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72e0149540 con 0x7f72e00b27c0 2024-04-04T16:33:37.150 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:37.152+0000 7f72e6800640 1 -- 172.21.15.72:0/1239444217 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72b8005290 con 0x7f72e00b27c0 2024-04-04T16:33:37.152 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:37.154+0000 7f72d7400640 1 -- 172.21.15.72:0/1239444217 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f72c801a070 con 0x7f72e00b27c0 2024-04-04T16:33:37.153 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:37.156+0000 7f72d7400640 1 --2- 172.21.15.72:0/1239444217 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f72bc06c9c0 0x7f72bc06ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:37.153 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:37.156+0000 7f72d7400640 1 -- 172.21.15.72:0/1239444217 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f72c808bcd0 con 0x7f72e00b27c0 2024-04-04T16:33:37.154 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:37.156+0000 7f72df400640 1 --2- 172.21.15.72:0/1239444217 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f72bc06c9c0 0x7f72bc06ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:37.155 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:37.157+0000 7f72df400640 1 --2- 172.21.15.72:0/1239444217 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f72bc06c9c0 0x7f72bc06ee80 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f72d8036000 tx=0x7f72d8030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T16:33:37.166 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:37.168+0000 7f72d7400640 1 -- 172.21.15.72:0/1239444217 <== mon.1 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f72c8091020 con 0x7f72e00b27c0 2024-04-04T16:33:37.490 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:37.493+0000 7f72e6800640 1 -- 172.21.15.72:0/1239444217 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f72b8005d90 con 0x7f72e00b27c0 2024-04-04T16:33:37.491 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:37.493+0000 7f72d7400640 1 -- 172.21.15.72:0/1239444217 <== mon.1 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v33) ==== 93+0+10 (secure 0 0 0) 0x7f72c805a170 con 0x7f72e00b27c0 2024-04-04T16:33:37.491 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 1 2024-04-04T16:33:37.494 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:37.496+0000 7f72e6800640 1 -- 172.21.15.72:0/1239444217 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f72bc06c9c0 msgr2=0x7f72bc06ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:37.494 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:37.496+0000 7f72e6800640 1 --2- 172.21.15.72:0/1239444217 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f72bc06c9c0 0x7f72bc06ee80 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f72d8036000 tx=0x7f72d8030000 comp rx=0 tx=0).stop 2024-04-04T16:33:37.494 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:37.496+0000 7f72e6800640 1 -- 172.21.15.72:0/1239444217 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f72e00b27c0 msgr2=0x7f72e0147b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:37.494 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:37.496+0000 7f72e6800640 1 --2- 172.21.15.72:0/1239444217 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f72e00b27c0 0x7f72e0147b10 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f72c800e840 tx=0x7f72c800ed00 comp rx=0 tx=0).stop 2024-04-04T16:33:37.494 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:37.496+0000 7f72e6800640 1 -- 172.21.15.72:0/1239444217 shutdown_connections 2024-04-04T16:33:37.494 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:37.496+0000 7f72e6800640 1 --2- 172.21.15.72:0/1239444217 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f72bc06c9c0 0x7f72bc06ee80 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:37.494 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:37.496+0000 7f72e6800640 1 --2- 172.21.15.72:0/1239444217 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f72e0151330 0x7f72e00cd990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:37.495 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:37.496+0000 7f72e6800640 1 --2- 172.21.15.72:0/1239444217 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f72e00b27c0 0x7f72e0147b10 secure :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f72c800e840 tx=0x7f72c800ed00 comp rx=0 tx=0).stop 2024-04-04T16:33:37.495 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:37.496+0000 7f72e6800640 1 --2- 172.21.15.72:0/1239444217 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f72e006d880 0x7f72e01483a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:37.495 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:37.496+0000 7f72e6800640 1 -- 172.21.15.72:0/1239444217 >> 172.21.15.72:0/1239444217 conn(0x7f72e00b1cd0 msgr2=0x7f72e00ccbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T16:33:37.495 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:37.497+0000 7f72e6800640 1 -- 172.21.15.72:0/1239444217 shutdown_connections 2024-04-04T16:33:37.495 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:37.497+0000 7f72e6800640 1 -- 172.21.15.72:0/1239444217 wait complete. 2024-04-04T16:33:37.517 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-04T16:33:37.784 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:37.786+0000 7f23c8c00640 1 Processor -- start 2024-04-04T16:33:37.787 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:37.787+0000 7f23c8c00640 1 -- start start 2024-04-04T16:33:37.787 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:37.788+0000 7f23c8c00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f23c40cf7e0 0x7f23c40b9ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:37.787 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:37.788+0000 7f23c8c00640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23c40d2e70 con 0x7f23c4161b70 2024-04-04T16:33:37.787 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:37.789+0000 7f23c8c00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23c40d3150 con 0x7f23c40d26d0 2024-04-04T16:33:37.788 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:37.789+0000 7f23c8c00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f23c40d3430 con 0x7f23c40cf7e0 2024-04-04T16:33:37.788 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:37.790+0000 7f23c1e00640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f23c4161b70 0x7f23c40cf0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:41086/0 (socket says 172.21.15.72:41086) 2024-04-04T16:33:37.788 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:37.790+0000 7f23c1e00640 1 -- 172.21.15.72:0/1083640677 learned_addr learned my addr 172.21.15.72:0/1083640677 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-04-04T16:33:37.788 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:37.790+0000 7f23c1400640 1 --2- 172.21.15.72:0/1083640677 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f23c40cf7e0 0x7f23c40b9ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:37.788 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:37.791+0000 7f23c0a00640 1 -- 172.21.15.72:0/1083640677 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4266143664 0 0) 0x7f23c40d3150 con 0x7f23c40d26d0 2024-04-04T16:33:37.788 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:37.791+0000 7f23c0a00640 1 -- 172.21.15.72:0/1083640677 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f23a8003520 con 0x7f23c40d26d0 2024-04-04T16:33:37.789 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:37.791+0000 7f23c0a00640 1 -- 172.21.15.72:0/1083640677 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2032583859 0 0) 0x7f23c40d2e70 con 0x7f23c4161b70 2024-04-04T16:33:37.789 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:37.791+0000 7f23c0a00640 1 -- 172.21.15.72:0/1083640677 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f23c40d3150 con 0x7f23c4161b70 2024-04-04T16:33:37.790 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:37.792+0000 7f23c0a00640 1 -- 172.21.15.72:0/1083640677 <== mon.1 v1:172.21.15.117:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3773690285 0 0) 0x7f23a8003520 con 0x7f23c40d26d0 2024-04-04T16:33:37.790 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:37.792+0000 7f23c0a00640 1 -- 172.21.15.72:0/1083640677 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f23c40cf7e0 msgr2=0x7f23c40b9ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T16:33:37.790 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:37.792+0000 7f23c0a00640 1 --2- 172.21.15.72:0/1083640677 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f23c40cf7e0 0x7f23c40b9ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:37.791 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:37.792+0000 7f23c0a00640 1 -- 172.21.15.72:0/1083640677 >> v1:172.21.15.72:6789/0 conn(0x7f23c4161b70 legacy=0x7f23c40cf0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:37.791 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:37.792+0000 7f23c0a00640 1 -- 172.21.15.72:0/1083640677 --> v1:172.21.15.117:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23c40d3710 con 0x7f23c40d26d0 2024-04-04T16:33:37.791 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:37.792+0000 7f23c0a00640 1 -- 172.21.15.72:0/1083640677 <== mon.1 v1:172.21.15.117:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2465650867 0 0) 0x7f23bc0019f0 con 0x7f23c40d26d0 2024-04-04T16:33:37.791 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:37.792+0000 7f23c0a00640 1 -- 172.21.15.72:0/1083640677 >> v1:172.21.15.117:6789/0 conn(0x7f23c40d26d0 legacy=0x7f23c40b7430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:37.791 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:37.792+0000 7f23c0a00640 1 --2- 172.21.15.72:0/1083640677 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f23c40cf7e0 0x7f23a8003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:37.791 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:37.792+0000 7f23c0a00640 1 --2- 172.21.15.72:0/1083640677 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f23a80040f0 0x7f23a8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:37.791 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:37.792+0000 7f23c0a00640 1 --2- 172.21.15.72:0/1083640677 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f23a8004d40 0x7f23a80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:37.791 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:37.792+0000 7f23c0a00640 1 -- 172.21.15.72:0/1083640677 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f23c40d3430 con 0x7f23a8004d40 2024-04-04T16:33:37.791 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:37.792+0000 7f23c0a00640 1 -- 172.21.15.72:0/1083640677 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f23a8014360 con 0x7f23a80040f0 2024-04-04T16:33:37.791 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:37.792+0000 7f23c0a00640 1 -- 172.21.15.72:0/1083640677 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f23a8014560 con 0x7f23c40cf7e0 2024-04-04T16:33:37.792 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:37.793+0000 7f23c1e00640 1 --2- 172.21.15.72:0/1083640677 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f23c40cf7e0 0x7f23a8003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:37.792 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:37.794+0000 7f23c1e00640 1 -- 172.21.15.72:0/1083640677 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f23a80040f0 msgr2=0x7f23a8004800 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-04T16:33:37.792 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:37.794+0000 7f23c1e00640 1 --2- 172.21.15.72:0/1083640677 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f23a80040f0 0x7f23a8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:37.792 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:37.794+0000 7f23c1e00640 1 -- 172.21.15.72:0/1083640677 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f23a8004d40 msgr2=0x7f23a80051c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-04T16:33:37.793 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:37.795+0000 7f23c2800640 1 --2- 172.21.15.72:0/1083640677 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f23a8004d40 0x7f23a80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:37.793 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:37.795+0000 7f23c1e00640 1 --2- 172.21.15.72:0/1083640677 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f23a8004d40 0x7f23a80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:37.793 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:37.795+0000 7f23c1e00640 1 -- 172.21.15.72:0/1083640677 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23a8003520 con 0x7f23c40cf7e0 2024-04-04T16:33:37.793 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:37.796+0000 7f23c2800640 1 --2- 172.21.15.72:0/1083640677 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f23a8004d40 0x7f23a80051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-04T16:33:37.794 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:37.797+0000 7f23c1e00640 1 --2- 172.21.15.72:0/1083640677 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f23c40cf7e0 0x7f23a8003b40 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f23ac0019f0 tx=0x7f23a8005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=92818b65a3c99da9 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T16:33:37.795 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:37.797+0000 7f23c0a00640 1 -- 172.21.15.72:0/1083640677 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23ac0015e0 con 0x7f23c40cf7e0 2024-04-04T16:33:37.795 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:37.797+0000 7f23c0a00640 1 -- 172.21.15.72:0/1083640677 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23ac0048a0 con 0x7f23c40cf7e0 2024-04-04T16:33:37.795 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:37.797+0000 7f23c0a00640 1 -- 172.21.15.72:0/1083640677 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23ac004c90 con 0x7f23c40cf7e0 2024-04-04T16:33:37.796 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:37.798+0000 7f23c8c00640 1 -- 172.21.15.72:0/1083640677 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f23c40cf7e0 msgr2=0x7f23a8003b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:37.796 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:37.798+0000 7f23c8c00640 1 --2- 172.21.15.72:0/1083640677 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f23c40cf7e0 0x7f23a8003b40 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f23ac0019f0 tx=0x7f23a8005830 comp rx=0 tx=0).stop 2024-04-04T16:33:37.796 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:37.798+0000 7f23c2800640 1 -- 172.21.15.72:0/1083640677 reap_dead start 2024-04-04T16:33:37.797 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:37.799+0000 7f23c8c00640 1 -- 172.21.15.72:0/1083640677 shutdown_connections 2024-04-04T16:33:37.797 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:37.799+0000 7f23c8c00640 1 -- 172.21.15.72:0/1083640677 >> 172.21.15.72:0/1083640677 conn(0x7f23c4071eb0 msgr2=0x7f23c40722c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T16:33:37.797 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:37.799+0000 7f23c8c00640 1 -- 172.21.15.72:0/1083640677 shutdown_connections 2024-04-04T16:33:37.797 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:37.800+0000 7f23c8c00640 1 -- 172.21.15.72:0/1083640677 wait complete. 2024-04-04T16:33:37.799 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:37.802+0000 7f23c8c00640 1 Processor -- start 2024-04-04T16:33:37.800 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:37.802+0000 7f23c8c00640 1 -- start start 2024-04-04T16:33:37.802 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:37.804+0000 7f23c8c00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f23c40cf7e0 0x7f23c41f01b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:37.802 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:37.804+0000 7f23c8c00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f23c41500e0 0x7f23c40cd5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:37.802 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:37.804+0000 7f23c8c00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f23c40cdae0 0x7f23c415f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:37.803 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:37.805+0000 7f23c8c00640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f23c40d3f10 con 0x7f23c40cf7e0 2024-04-04T16:33:37.803 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:37.805+0000 7f23c8c00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f23c40d2b40 con 0x7f23c40cdae0 2024-04-04T16:33:37.803 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:37.805+0000 7f23c8c00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f23c40d4090 con 0x7f23c41500e0 2024-04-04T16:33:37.803 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:37.805+0000 7f23c2800640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f23c40cdae0 0x7f23c415f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:37.803 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:37.805+0000 7f23c2800640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f23c40cdae0 0x7f23c415f3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.72:56116/0 (socket says 172.21.15.72:56116) 2024-04-04T16:33:37.803 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:37.805+0000 7f23c2800640 1 -- 172.21.15.72:0/809640613 learned_addr learned my addr 172.21.15.72:0/809640613 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T16:33:37.804 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:37.806+0000 7f23c1e00640 1 --2- 172.21.15.72:0/809640613 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f23c40cf7e0 0x7f23c41f01b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:37.804 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:37.806+0000 7f23c2800640 1 -- 172.21.15.72:0/809640613 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f23c41500e0 msgr2=0x7f23c40cd5a0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-04T16:33:37.804 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:37.806+0000 7f23c2800640 1 --2- 172.21.15.72:0/809640613 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f23c41500e0 0x7f23c40cd5a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:37.804 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:37.806+0000 7f23c2800640 1 -- 172.21.15.72:0/809640613 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f23c40cf7e0 msgr2=0x7f23c41f01b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:37.804 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:37.806+0000 7f23c2800640 1 --2- 172.21.15.72:0/809640613 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f23c40cf7e0 0x7f23c41f01b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:37.804 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:37.806+0000 7f23c2800640 1 -- 172.21.15.72:0/809640613 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23c4150560 con 0x7f23c40cdae0 2024-04-04T16:33:37.804 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:37.806+0000 7f23c1e00640 1 --2- 172.21.15.72:0/809640613 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f23c40cf7e0 0x7f23c41f01b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-04T16:33:37.805 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:37.807+0000 7f23c2800640 1 --2- 172.21.15.72:0/809640613 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f23c40cdae0 0x7f23c415f3c0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f23c40d1de0 tx=0x7f23bc00db40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T16:33:37.806 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:37.808+0000 7f23ba000640 1 -- 172.21.15.72:0/809640613 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23bc018070 con 0x7f23c40cdae0 2024-04-04T16:33:37.806 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:37.808+0000 7f23ba000640 1 -- 172.21.15.72:0/809640613 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23bc003b70 con 0x7f23c40cdae0 2024-04-04T16:33:37.806 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:37.808+0000 7f23ba000640 1 -- 172.21.15.72:0/809640613 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23bc005070 con 0x7f23c40cdae0 2024-04-04T16:33:37.806 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:37.809+0000 7f23c8c00640 1 -- 172.21.15.72:0/809640613 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23c4151350 con 0x7f23c40cdae0 2024-04-04T16:33:37.807 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:37.809+0000 7f23c8c00640 1 -- 172.21.15.72:0/809640613 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23c4151910 con 0x7f23c40cdae0 2024-04-04T16:33:37.808 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:37.811+0000 7f23c8c00640 1 -- 172.21.15.72:0/809640613 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23c4075730 con 0x7f23c40cdae0 2024-04-04T16:33:37.812 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:37.813+0000 7f23ba000640 1 -- 172.21.15.72:0/809640613 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f23bc01b070 con 0x7f23c40cdae0 2024-04-04T16:33:37.812 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:37.814+0000 7f23ba000640 1 --2- 172.21.15.72:0/809640613 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f23a006c940 0x7f23a006ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:37.812 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:37.814+0000 7f23ba000640 1 -- 172.21.15.72:0/809640613 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f23bc08b260 con 0x7f23c40cdae0 2024-04-04T16:33:37.812 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:37.815+0000 7f23c1e00640 1 --2- 172.21.15.72:0/809640613 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f23a006c940 0x7f23a006ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:37.813 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:37.816+0000 7f23c1e00640 1 --2- 172.21.15.72:0/809640613 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f23a006c940 0x7f23a006ee00 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f23ac034000 tx=0x7f23ac02f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T16:33:37.818 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:37.820+0000 7f23ba000640 1 -- 172.21.15.72:0/809640613 <== mon.1 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f23bc059770 con 0x7f23c40cdae0 2024-04-04T16:33:38.169 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:38.171+0000 7f23c8c00640 1 -- 172.21.15.72:0/809640613 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f23c4160380 con 0x7f23c40cdae0 2024-04-04T16:33:38.172 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:38.174+0000 7f23ba000640 1 -- 172.21.15.72:0/809640613 <== mon.1 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v33) ==== 104+0+11 (secure 0 0 0) 0x7f23bc059070 con 0x7f23c40cdae0 2024-04-04T16:33:38.175 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2024-04-04T16:33:38.177 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:38.179+0000 7f23c8c00640 1 -- 172.21.15.72:0/809640613 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f23a006c940 msgr2=0x7f23a006ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:38.177 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:38.179+0000 7f23c8c00640 1 --2- 172.21.15.72:0/809640613 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f23a006c940 0x7f23a006ee00 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f23ac034000 tx=0x7f23ac02f000 comp rx=0 tx=0).stop 2024-04-04T16:33:38.177 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:38.179+0000 7f23c8c00640 1 -- 172.21.15.72:0/809640613 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f23c40cdae0 msgr2=0x7f23c415f3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:38.177 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:38.179+0000 7f23c8c00640 1 --2- 172.21.15.72:0/809640613 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f23c40cdae0 0x7f23c415f3c0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f23c40d1de0 tx=0x7f23bc00db40 comp rx=0 tx=0).stop 2024-04-04T16:33:38.177 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:38.179+0000 7f23c8c00640 1 -- 172.21.15.72:0/809640613 shutdown_connections 2024-04-04T16:33:38.177 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:38.179+0000 7f23c8c00640 1 --2- 172.21.15.72:0/809640613 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f23a006c940 0x7f23a006ee00 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:38.177 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:38.179+0000 7f23c8c00640 1 --2- 172.21.15.72:0/809640613 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f23c40cdae0 0x7f23c415f3c0 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:38.178 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:38.179+0000 7f23c8c00640 1 --2- 172.21.15.72:0/809640613 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f23c41500e0 0x7f23c40cd5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:38.178 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:38.179+0000 7f23c8c00640 1 --2- 172.21.15.72:0/809640613 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f23c40cf7e0 0x7f23c41f01b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:38.178 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:38.179+0000 7f23c8c00640 1 -- 172.21.15.72:0/809640613 >> 172.21.15.72:0/809640613 conn(0x7f23c4071eb0 msgr2=0x7f23c40b4370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T16:33:38.179 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:38.181+0000 7f23c8c00640 1 -- 172.21.15.72:0/809640613 shutdown_connections 2024-04-04T16:33:38.179 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:38.181+0000 7f23c8c00640 1 -- 172.21.15.72:0/809640613 wait complete. 2024-04-04T16:33:38.203 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-04T16:33:38.456 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:38.458+0000 7f30ec000640 1 Processor -- start 2024-04-04T16:33:38.457 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:38.459+0000 7f30ec000640 1 -- start start 2024-04-04T16:33:38.458 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:38.461+0000 7f30ec000640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f30e415bb70 0x7f30e406b470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:38.460 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:38.461+0000 7f30ec000640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30e406bd90 con 0x7f30e40afd20 2024-04-04T16:33:38.460 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:38.461+0000 7f30ec000640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30e40b0100 con 0x7f30e406b9b0 2024-04-04T16:33:38.460 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:38.461+0000 7f30ec000640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f30e40727d0 con 0x7f30e415bb70 2024-04-04T16:33:38.460 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:38.462+0000 7f30e9600640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f30e40afd20 0x7f30e4071c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:41100/0 (socket says 172.21.15.72:41100) 2024-04-04T16:33:38.460 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:38.462+0000 7f30e9600640 1 -- 172.21.15.72:0/1422077359 learned_addr learned my addr 172.21.15.72:0/1422077359 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-04-04T16:33:38.460 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:38.462+0000 7f30e8c00640 1 --2- 172.21.15.72:0/1422077359 >> v2:172.21.15.117:3300/0 conn(0x7f30e415bb70 0x7f30e406b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:38.461 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:38.463+0000 7f30e3e00640 1 -- 172.21.15.72:0/1422077359 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2347482058 0 0) 0x7f30e406bd90 con 0x7f30e40afd20 2024-04-04T16:33:38.461 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:38.463+0000 7f30e3e00640 1 -- 172.21.15.72:0/1422077359 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f30cc003520 con 0x7f30e40afd20 2024-04-04T16:33:38.461 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:38.463+0000 7f30e3e00640 1 -- 172.21.15.72:0/1422077359 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2670980272 0 0) 0x7f30e40b0100 con 0x7f30e406b9b0 2024-04-04T16:33:38.461 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:38.463+0000 7f30e3e00640 1 -- 172.21.15.72:0/1422077359 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f30e406bd90 con 0x7f30e406b9b0 2024-04-04T16:33:38.461 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:38.463+0000 7f30e8c00640 1 -- 172.21.15.72:0/1422077359 >> v1:172.21.15.117:6789/0 conn(0x7f30e406b9b0 legacy=0x7f30e415e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:38.462 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:38.463+0000 7f30e8c00640 1 -- 172.21.15.72:0/1422077359 >> v1:172.21.15.72:6789/0 conn(0x7f30e40afd20 legacy=0x7f30e4071c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:38.462 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:38.463+0000 7f30e8c00640 1 -- 172.21.15.72:0/1422077359 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30e415b090 con 0x7f30e415bb70 2024-04-04T16:33:38.463 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:38.465+0000 7f30e8c00640 1 --2- 172.21.15.72:0/1422077359 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f30e415bb70 0x7f30e406b470 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f30d00097a0 tx=0x7f30d002fce0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b1541b92cc6ef494 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T16:33:38.464 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:38.466+0000 7f30e3e00640 1 -- 172.21.15.72:0/1422077359 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30d003d070 con 0x7f30e415bb70 2024-04-04T16:33:38.464 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:38.466+0000 7f30e3e00640 1 -- 172.21.15.72:0/1422077359 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30d0030a90 con 0x7f30e415bb70 2024-04-04T16:33:38.465 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:38.466+0000 7f30e3e00640 1 -- 172.21.15.72:0/1422077359 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30d0030e60 con 0x7f30e415bb70 2024-04-04T16:33:38.467 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:38.470+0000 7f30ec000640 1 -- 172.21.15.72:0/1422077359 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f30e415bb70 msgr2=0x7f30e406b470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:38.467 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:38.470+0000 7f30ec000640 1 --2- 172.21.15.72:0/1422077359 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f30e415bb70 0x7f30e406b470 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f30d00097a0 tx=0x7f30d002fce0 comp rx=0 tx=0).stop 2024-04-04T16:33:38.468 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:38.470+0000 7f30ec000640 1 -- 172.21.15.72:0/1422077359 shutdown_connections 2024-04-04T16:33:38.468 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:38.470+0000 7f30ec000640 1 --2- 172.21.15.72:0/1422077359 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f30e415bb70 0x7f30e406b470 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:38.468 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:38.470+0000 7f30ec000640 1 -- 172.21.15.72:0/1422077359 >> 172.21.15.72:0/1422077359 conn(0x7f30e4074b00 msgr2=0x7f30e40b23b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T16:33:38.468 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:38.470+0000 7f30ec000640 1 -- 172.21.15.72:0/1422077359 shutdown_connections 2024-04-04T16:33:38.469 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:38.471+0000 7f30ec000640 1 -- 172.21.15.72:0/1422077359 wait complete. 2024-04-04T16:33:38.471 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:38.473+0000 7f30ec000640 1 Processor -- start 2024-04-04T16:33:38.471 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:38.473+0000 7f30ec000640 1 -- start start 2024-04-04T16:33:38.473 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:38.475+0000 7f30ec000640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f30e406b9b0 0x7f30e4067280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:38.473 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:38.475+0000 7f30ec000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f30e40afd20 0x7f30e40677c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:38.473 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:38.475+0000 7f30ec000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f30e415bb70 0x7f30e4148ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:38.473 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:38.475+0000 7f30ec000640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f30e40b43a0 con 0x7f30e406b9b0 2024-04-04T16:33:38.473 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:38.475+0000 7f30ec000640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f30e415b650 con 0x7f30e415bb70 2024-04-04T16:33:38.474 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:38.475+0000 7f30ec000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f30e4072370 con 0x7f30e40afd20 2024-04-04T16:33:38.474 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:38.476+0000 7f30ea000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f30e415bb70 0x7f30e4148ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:38.474 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:38.476+0000 7f30ea000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f30e415bb70 0x7f30e4148ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.72:56142/0 (socket says 172.21.15.72:56142) 2024-04-04T16:33:38.474 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:38.476+0000 7f30ea000640 1 -- 172.21.15.72:0/1073366022 learned_addr learned my addr 172.21.15.72:0/1073366022 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T16:33:38.475 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:38.476+0000 7f30e8c00640 1 --2- 172.21.15.72:0/1073366022 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f30e40afd20 0x7f30e40677c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:38.475 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:38.476+0000 7f30ea000640 1 -- 172.21.15.72:0/1073366022 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f30e40afd20 msgr2=0x7f30e40677c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:38.475 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:38.476+0000 7f30ea000640 1 --2- 172.21.15.72:0/1073366022 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f30e40afd20 0x7f30e40677c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:38.475 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:38.476+0000 7f30ea000640 1 -- 172.21.15.72:0/1073366022 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f30e406b9b0 msgr2=0x7f30e4067280 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-04T16:33:38.475 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:38.476+0000 7f30e9600640 1 --2- 172.21.15.72:0/1073366022 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f30e406b9b0 0x7f30e4067280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:38.475 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:38.476+0000 7f30ea000640 1 --2- 172.21.15.72:0/1073366022 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f30e406b9b0 0x7f30e4067280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:38.476 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:38.476+0000 7f30ea000640 1 -- 172.21.15.72:0/1073366022 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30e41474e0 con 0x7f30e415bb70 2024-04-04T16:33:38.476 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:38.477+0000 7f30ea000640 1 --2- 172.21.15.72:0/1073366022 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f30e415bb70 0x7f30e4148ee0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f30dc00c7c0 tx=0x7f30dc00cc80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T16:33:38.476 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:38.478+0000 7f30e1600640 1 -- 172.21.15.72:0/1073366022 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30dc017070 con 0x7f30e415bb70 2024-04-04T16:33:38.476 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:38.478+0000 7f30e1600640 1 -- 172.21.15.72:0/1073366022 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30dc003da0 con 0x7f30e415bb70 2024-04-04T16:33:38.476 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:38.478+0000 7f30e1600640 1 -- 172.21.15.72:0/1073366022 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30dc005330 con 0x7f30e415bb70 2024-04-04T16:33:38.476 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:38.478+0000 7f30ec000640 1 -- 172.21.15.72:0/1073366022 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30e4149da0 con 0x7f30e415bb70 2024-04-04T16:33:38.476 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:38.478+0000 7f30ec000640 1 -- 172.21.15.72:0/1073366022 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30e414a360 con 0x7f30e415bb70 2024-04-04T16:33:38.477 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:38.479+0000 7f30ec000640 1 -- 172.21.15.72:0/1073366022 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30e4075730 con 0x7f30e415bb70 2024-04-04T16:33:38.479 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:38.481+0000 7f30e1600640 1 -- 172.21.15.72:0/1073366022 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f30dc01a070 con 0x7f30e415bb70 2024-04-04T16:33:38.480 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:38.482+0000 7f30e1600640 1 --2- 172.21.15.72:0/1073366022 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f30c406c940 0x7f30c406ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:38.480 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:38.483+0000 7f30e1600640 1 -- 172.21.15.72:0/1073366022 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f30dc08b270 con 0x7f30e415bb70 2024-04-04T16:33:38.480 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:38.483+0000 7f30e9600640 1 --2- 172.21.15.72:0/1073366022 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f30c406c940 0x7f30c406ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:38.481 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:38.484+0000 7f30e9600640 1 --2- 172.21.15.72:0/1073366022 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f30c406c940 0x7f30c406ee00 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f30d8000f60 tx=0x7f30d8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T16:33:38.488 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:38.489+0000 7f30e1600640 1 -- 172.21.15.72:0/1073366022 <== mon.1 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f30dc059710 con 0x7f30e415bb70 2024-04-04T16:33:38.847 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:38.849+0000 7f30ec000640 1 -- 172.21.15.72:0/1073366022 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f30e406cc40 con 0x7f30e415bb70 2024-04-04T16:33:38.850 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:38.853+0000 7f30e1600640 1 -- 172.21.15.72:0/1073366022 <== mon.1 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v33) ==== 100+0+11 (secure 0 0 0) 0x7f30dc059010 con 0x7f30e415bb70 2024-04-04T16:33:38.851 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 64 2024-04-04T16:33:38.854 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:38.857+0000 7f30ec000640 1 -- 172.21.15.72:0/1073366022 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f30c406c940 msgr2=0x7f30c406ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:38.854 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:38.857+0000 7f30ec000640 1 --2- 172.21.15.72:0/1073366022 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f30c406c940 0x7f30c406ee00 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f30d8000f60 tx=0x7f30d8009040 comp rx=0 tx=0).stop 2024-04-04T16:33:38.855 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:38.857+0000 7f30ec000640 1 -- 172.21.15.72:0/1073366022 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f30e415bb70 msgr2=0x7f30e4148ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:38.855 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:38.857+0000 7f30ec000640 1 --2- 172.21.15.72:0/1073366022 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f30e415bb70 0x7f30e4148ee0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f30dc00c7c0 tx=0x7f30dc00cc80 comp rx=0 tx=0).stop 2024-04-04T16:33:38.858 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:38.860+0000 7f30ec000640 1 -- 172.21.15.72:0/1073366022 shutdown_connections 2024-04-04T16:33:38.858 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:38.860+0000 7f30ec000640 1 --2- 172.21.15.72:0/1073366022 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f30c406c940 0x7f30c406ee00 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:38.858 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:38.860+0000 7f30ec000640 1 --2- 172.21.15.72:0/1073366022 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f30e415bb70 0x7f30e4148ee0 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:38.858 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:38.860+0000 7f30ec000640 1 --2- 172.21.15.72:0/1073366022 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f30e40afd20 0x7f30e40677c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:38.858 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:38.860+0000 7f30ec000640 1 --2- 172.21.15.72:0/1073366022 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f30e406b9b0 0x7f30e4067280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:38.858 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:38.860+0000 7f30ec000640 1 -- 172.21.15.72:0/1073366022 >> 172.21.15.72:0/1073366022 conn(0x7f30e4074b00 msgr2=0x7f30e406e860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T16:33:38.860 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:38.862+0000 7f30ec000640 1 -- 172.21.15.72:0/1073366022 shutdown_connections 2024-04-04T16:33:38.860 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:38.862+0000 7f30ec000640 1 -- 172.21.15.72:0/1073366022 wait complete. 2024-04-04T16:33:38.886 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-04T16:33:39.131 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:39.134+0000 7f71ad200640 1 Processor -- start 2024-04-04T16:33:39.132 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:39.134+0000 7f71ad200640 1 -- start start 2024-04-04T16:33:39.134 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:39.135+0000 7f71ad200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f71a814b490 0x7f71a8071fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:39.134 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:39.136+0000 7f71ad200640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f71a806d8f0 0x7f71a80b3620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:39.134 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:39.136+0000 7f71ad200640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f71a8072a40 con 0x7f71a80724e0 2024-04-04T16:33:39.134 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:39.136+0000 7f71ad200640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f71a80b3190 con 0x7f71a806d8f0 2024-04-04T16:33:39.134 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:39.136+0000 7f71ad200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f71a8072d20 con 0x7f71a814b490 2024-04-04T16:33:39.134 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:39.136+0000 7f71a7e00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f71a806d8f0 0x7f71a80b3620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:39.135 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:39.136+0000 7f71a7e00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f71a806d8f0 0x7f71a80b3620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.72:56146/0 (socket says 172.21.15.72:56146) 2024-04-04T16:33:39.135 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:39.136+0000 7f71a7e00640 1 -- 172.21.15.72:0/4174930402 learned_addr learned my addr 172.21.15.72:0/4174930402 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T16:33:39.135 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:39.137+0000 7f71a7400640 1 --2- 172.21.15.72:0/4174930402 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f71a814b490 0x7f71a8071fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:39.135 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:39.137+0000 7f71a7e00640 1 -- 172.21.15.72:0/4174930402 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f71a814b490 msgr2=0x7f71a8071fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T16:33:39.135 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:39.137+0000 7f71a7e00640 1 --2- 172.21.15.72:0/4174930402 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f71a814b490 0x7f71a8071fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:39.135 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:39.137+0000 7f71a7e00640 1 -- 172.21.15.72:0/4174930402 >> v1:172.21.15.72:6789/0 conn(0x7f71a80724e0 legacy=0x7f71a806d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:39.135 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:39.138+0000 7f71a7e00640 1 -- 172.21.15.72:0/4174930402 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71a80b2b40 con 0x7f71a806d8f0 2024-04-04T16:33:39.136 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:39.139+0000 7f71a7e00640 1 --2- 172.21.15.72:0/4174930402 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f71a806d8f0 0x7f71a80b3620 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f71a0009e80 tx=0x7f71a002bec0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=962809036431cb14 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T16:33:39.137 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:39.139+0000 7f71a6a00640 1 -- 172.21.15.72:0/4174930402 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71a002ca60 con 0x7f71a806d8f0 2024-04-04T16:33:39.137 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:39.139+0000 7f71a6a00640 1 -- 172.21.15.72:0/4174930402 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71a002cc00 con 0x7f71a806d8f0 2024-04-04T16:33:39.137 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:39.139+0000 7f71a6a00640 1 -- 172.21.15.72:0/4174930402 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71a00343f0 con 0x7f71a806d8f0 2024-04-04T16:33:39.138 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:39.140+0000 7f71ad200640 1 -- 172.21.15.72:0/4174930402 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f71a806d8f0 msgr2=0x7f71a80b3620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:39.138 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:39.140+0000 7f71ad200640 1 --2- 172.21.15.72:0/4174930402 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f71a806d8f0 0x7f71a80b3620 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f71a0009e80 tx=0x7f71a002bec0 comp rx=0 tx=0).stop 2024-04-04T16:33:39.139 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:39.141+0000 7f71ad200640 1 -- 172.21.15.72:0/4174930402 shutdown_connections 2024-04-04T16:33:39.139 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:39.141+0000 7f71ad200640 1 --2- 172.21.15.72:0/4174930402 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f71a806d8f0 0x7f71a80b3620 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:39.139 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:39.141+0000 7f71ad200640 1 --2- 172.21.15.72:0/4174930402 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f71a814b490 0x7f71a8071fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:39.139 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:39.141+0000 7f71ad200640 1 -- 172.21.15.72:0/4174930402 >> 172.21.15.72:0/4174930402 conn(0x7f71a80b1840 msgr2=0x7f71a80b1c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T16:33:39.139 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:39.142+0000 7f71ad200640 1 -- 172.21.15.72:0/4174930402 shutdown_connections 2024-04-04T16:33:39.140 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:39.142+0000 7f71ad200640 1 -- 172.21.15.72:0/4174930402 wait complete. 2024-04-04T16:33:39.143 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:39.146+0000 7f71ad200640 1 Processor -- start 2024-04-04T16:33:39.144 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:39.146+0000 7f71ad200640 1 -- start start 2024-04-04T16:33:39.146 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:39.148+0000 7f71ad200640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f71a806d8f0 0x7f71a8147560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:39.146 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:39.148+0000 7f71ad200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f71a80724e0 0x7f71a81427b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:39.146 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:39.148+0000 7f71ad200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f71a814b490 0x7f71a815ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:39.146 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:39.148+0000 7f71ad200640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f71a814b870 con 0x7f71a806d8f0 2024-04-04T16:33:39.146 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:39.148+0000 7f71ad200640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f71a814bd60 con 0x7f71a80724e0 2024-04-04T16:33:39.146 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:39.148+0000 7f71ad200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f71a814a250 con 0x7f71a814b490 2024-04-04T16:33:39.147 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:39.148+0000 7f71a7400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f71a806d8f0 0x7f71a8147560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:39.147 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:39.149+0000 7f71a7400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f71a806d8f0 0x7f71a8147560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:39768/0 (socket says 172.21.15.72:39768) 2024-04-04T16:33:39.147 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:39.149+0000 7f71a7400640 1 -- 172.21.15.72:0/3269819400 learned_addr learned my addr 172.21.15.72:0/3269819400 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T16:33:39.147 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:39.149+0000 7f719fe00640 1 --2- 172.21.15.72:0/3269819400 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f71a80724e0 0x7f71a81427b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:39.147 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:39.149+0000 7f71a7e00640 1 --2- 172.21.15.72:0/3269819400 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f71a814b490 0x7f71a815ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:39.147 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:39.149+0000 7f71a7400640 1 -- 172.21.15.72:0/3269819400 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f71a814b490 msgr2=0x7f71a815ffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:39.148 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:39.149+0000 7f71a7400640 1 --2- 172.21.15.72:0/3269819400 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f71a814b490 0x7f71a815ffa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:39.148 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:39.149+0000 7f71a7400640 1 -- 172.21.15.72:0/3269819400 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f71a80724e0 msgr2=0x7f71a81427b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:39.148 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:39.149+0000 7f71a7400640 1 --2- 172.21.15.72:0/3269819400 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f71a80724e0 0x7f71a81427b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:39.148 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:39.149+0000 7f71a7400640 1 -- 172.21.15.72:0/3269819400 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71a814a530 con 0x7f71a806d8f0 2024-04-04T16:33:39.148 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:39.150+0000 7f71a7400640 1 --2- 172.21.15.72:0/3269819400 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f71a806d8f0 0x7f71a8147560 secure :-1 s=READY pgs=2150 cs=0 l=1 rev1=1 crypto rx=0x7f719800e870 tx=0x7f719800ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T16:33:39.151 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:39.152+0000 7f719f400640 1 -- 172.21.15.72:0/3269819400 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7198017070 con 0x7f71a806d8f0 2024-04-04T16:33:39.151 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:39.153+0000 7f719f400640 1 -- 172.21.15.72:0/3269819400 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f719800c940 con 0x7f71a806d8f0 2024-04-04T16:33:39.151 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:39.153+0000 7f71ad200640 1 -- 172.21.15.72:0/3269819400 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71a814a870 con 0x7f71a806d8f0 2024-04-04T16:33:39.154 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:39.153+0000 7f719f400640 1 -- 172.21.15.72:0/3269819400 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f719800cd10 con 0x7f71a806d8f0 2024-04-04T16:33:39.154 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:39.155+0000 7f71ad200640 1 -- 172.21.15.72:0/3269819400 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71a8142cf0 con 0x7f71a806d8f0 2024-04-04T16:33:39.157 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:39.160+0000 7f719f400640 1 -- 172.21.15.72:0/3269819400 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f719801a070 con 0x7f71a806d8f0 2024-04-04T16:33:39.158 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:39.161+0000 7f71ad200640 1 -- 172.21.15.72:0/3269819400 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71a80756c0 con 0x7f71a806d8f0 2024-04-04T16:33:39.160 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:39.162+0000 7f719f400640 1 --2- 172.21.15.72:0/3269819400 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f718406c940 0x7f718406ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:39.160 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:39.162+0000 7f719f400640 1 -- 172.21.15.72:0/3269819400 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f719808b140 con 0x7f71a806d8f0 2024-04-04T16:33:39.161 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:39.163+0000 7f719fe00640 1 --2- 172.21.15.72:0/3269819400 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f718406c940 0x7f718406ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:39.162 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:39.165+0000 7f719fe00640 1 --2- 172.21.15.72:0/3269819400 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f718406c940 0x7f718406ee00 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f71a8145b40 tx=0x7f7190009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T16:33:39.186 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:39.188+0000 7f719f400640 1 -- 172.21.15.72:0/3269819400 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f71a814a870 con 0x7f71a806d8f0 2024-04-04T16:33:39.593 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:39.595+0000 7f71ad200640 1 -- 172.21.15.72:0/3269819400 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f71a8165320 con 0x7f71a806d8f0 2024-04-04T16:33:39.594 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:39.596+0000 7f719f400640 1 -- 172.21.15.72:0/3269819400 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+5184 (secure 0 0 0) 0x7f7198058f10 con 0x7f71a806d8f0 2024-04-04T16:33:39.595 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T16:33:39.595 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4619,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/2380537280","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6833","nonce":2380537280},{"type":"v1","addr":"172.21.15.117:6835","nonce":2380537280}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4840,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6834/108808341","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":108808341},{"type":"v1","addr":"172.21.15.117:6834","nonce":108808341}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":5253,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6836/3494332623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":3494332623},{"type":"v1","addr":"172.21.15.72:6836","nonce":3494332623}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-04T06:57:50.020152+0000","modified":"2024-04-04T06:57:53.165429+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5256},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5256":{"gid":5256,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.72:6837/2509618069","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6835","nonce":2509618069},{"type":"v1","addr":"172.21.15.72:6837","nonce":2509618069}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5256,"qdb_cluster":[5256]},"id":2}]} 2024-04-04T16:33:39.595 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 17 2024-04-04T16:33:39.598 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:39.600+0000 7f71ad200640 1 -- 172.21.15.72:0/3269819400 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f718406c940 msgr2=0x7f718406ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:39.598 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:39.600+0000 7f71ad200640 1 --2- 172.21.15.72:0/3269819400 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f718406c940 0x7f718406ee00 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f71a8145b40 tx=0x7f7190009040 comp rx=0 tx=0).stop 2024-04-04T16:33:39.598 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:39.600+0000 7f71ad200640 1 -- 172.21.15.72:0/3269819400 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f71a806d8f0 msgr2=0x7f71a8147560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:39.598 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:39.600+0000 7f71ad200640 1 --2- 172.21.15.72:0/3269819400 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f71a806d8f0 0x7f71a8147560 secure :-1 s=READY pgs=2150 cs=0 l=1 rev1=1 crypto rx=0x7f719800e870 tx=0x7f719800ed30 comp rx=0 tx=0).stop 2024-04-04T16:33:39.599 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:39.601+0000 7f71ad200640 1 -- 172.21.15.72:0/3269819400 shutdown_connections 2024-04-04T16:33:39.599 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:39.601+0000 7f71ad200640 1 --2- 172.21.15.72:0/3269819400 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f718406c940 0x7f718406ee00 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:39.599 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:39.601+0000 7f71ad200640 1 --2- 172.21.15.72:0/3269819400 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f71a814b490 0x7f71a815ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:39.599 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:39.601+0000 7f71ad200640 1 --2- 172.21.15.72:0/3269819400 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f71a80724e0 0x7f71a81427b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:39.599 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:39.601+0000 7f71ad200640 1 --2- 172.21.15.72:0/3269819400 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f71a806d8f0 0x7f71a8147560 unknown :-1 s=CLOSED pgs=2150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:39.599 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:39.601+0000 7f71ad200640 1 -- 172.21.15.72:0/3269819400 >> 172.21.15.72:0/3269819400 conn(0x7f71a80b1840 msgr2=0x7f71a8146490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T16:33:39.600 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:39.601+0000 7f71ad200640 1 -- 172.21.15.72:0/3269819400 shutdown_connections 2024-04-04T16:33:39.600 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:39.601+0000 7f71ad200640 1 -- 172.21.15.72:0/3269819400 wait complete. 2024-04-04T16:33:39.627 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-04T16:33:39.874 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:39.876+0000 7f4b9d400640 1 Processor -- start 2024-04-04T16:33:39.875 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:39.877+0000 7f4b9d400640 1 -- start start 2024-04-04T16:33:39.876 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:39.879+0000 7f4b9d400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4b98072350 0x7f4b9806ed70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:39.877 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:39.879+0000 7f4b9d400640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b980ce7e0 con 0x7f4b9815ea20 2024-04-04T16:33:39.877 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:39.879+0000 7f4b9d400640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b980ceac0 con 0x7f4b9806f2b0 2024-04-04T16:33:39.877 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:39.879+0000 7f4b9d400640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f4b980cf110 con 0x7f4b98072350 2024-04-04T16:33:39.877 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:39.879+0000 7f4b96800640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f4b9815ea20 0x7f4b98071c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:60036/0 (socket says 172.21.15.72:60036) 2024-04-04T16:33:39.877 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:39.879+0000 7f4b96800640 1 -- 172.21.15.72:0/2058781868 learned_addr learned my addr 172.21.15.72:0/2058781868 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-04-04T16:33:39.878 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:39.880+0000 7f4b95e00640 1 --2- 172.21.15.72:0/2058781868 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4b98072350 0x7f4b9806ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:39.878 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:39.880+0000 7f4b95400640 1 -- 172.21.15.72:0/2058781868 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1819614835 0 0) 0x7f4b980ce7e0 con 0x7f4b9815ea20 2024-04-04T16:33:39.878 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:39.880+0000 7f4b95400640 1 -- 172.21.15.72:0/2058781868 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4b7c003520 con 0x7f4b9815ea20 2024-04-04T16:33:39.878 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:39.880+0000 7f4b95e00640 1 -- 172.21.15.72:0/2058781868 >> v1:172.21.15.117:6789/0 conn(0x7f4b9806f2b0 legacy=0x7f4b980cf5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:39.878 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:39.880+0000 7f4b95e00640 1 -- 172.21.15.72:0/2058781868 >> v1:172.21.15.72:6789/0 conn(0x7f4b9815ea20 legacy=0x7f4b98071c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:39.878 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:39.880+0000 7f4b95e00640 1 -- 172.21.15.72:0/2058781868 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b980ceda0 con 0x7f4b98072350 2024-04-04T16:33:39.879 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:39.882+0000 7f4b95e00640 1 --2- 172.21.15.72:0/2058781868 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4b98072350 0x7f4b9806ed70 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f4b880097d0 tx=0x7f4b8802b940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=32724acf115243f server_cookie=0 in_seq=0 out_seq=0 2024-04-04T16:33:39.881 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:39.884+0000 7f4b95400640 1 -- 172.21.15.72:0/2058781868 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b88034070 con 0x7f4b98072350 2024-04-04T16:33:39.881 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:39.884+0000 7f4b95400640 1 -- 172.21.15.72:0/2058781868 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b88030800 con 0x7f4b98072350 2024-04-04T16:33:39.881 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:39.884+0000 7f4b95400640 1 -- 172.21.15.72:0/2058781868 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b88030bd0 con 0x7f4b98072350 2024-04-04T16:33:39.882 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:39.885+0000 7f4b9d400640 1 -- 172.21.15.72:0/2058781868 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4b98072350 msgr2=0x7f4b9806ed70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:39.882 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:39.885+0000 7f4b9d400640 1 --2- 172.21.15.72:0/2058781868 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4b98072350 0x7f4b9806ed70 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f4b880097d0 tx=0x7f4b8802b940 comp rx=0 tx=0).stop 2024-04-04T16:33:39.883 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:39.885+0000 7f4b9d400640 1 -- 172.21.15.72:0/2058781868 shutdown_connections 2024-04-04T16:33:39.883 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:39.885+0000 7f4b9d400640 1 --2- 172.21.15.72:0/2058781868 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4b98072350 0x7f4b9806ed70 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:39.883 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:39.885+0000 7f4b9d400640 1 -- 172.21.15.72:0/2058781868 >> 172.21.15.72:0/2058781868 conn(0x7f4b980d0740 msgr2=0x7f4b980d0b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T16:33:39.883 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:39.886+0000 7f4b9d400640 1 -- 172.21.15.72:0/2058781868 shutdown_connections 2024-04-04T16:33:39.884 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:39.886+0000 7f4b9d400640 1 -- 172.21.15.72:0/2058781868 wait complete. 2024-04-04T16:33:39.887 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:39.889+0000 7f4b9d400640 1 Processor -- start 2024-04-04T16:33:39.887 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:39.890+0000 7f4b9d400640 1 -- start start 2024-04-04T16:33:39.888 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:39.891+0000 7f4b9d400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4b9806f2b0 0x7f4b9815be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:39.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:39.891+0000 7f4b9d400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4b98072350 0x7f4b9815c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:39.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:39.891+0000 7f4b9d400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4b9815ea20 0x7f4b982010a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:39.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:39.891+0000 7f4b9d400640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f4b980b3930 con 0x7f4b9806f2b0 2024-04-04T16:33:39.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:39.891+0000 7f4b9d400640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f4b980b37b0 con 0x7f4b9815ea20 2024-04-04T16:33:39.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:39.891+0000 7f4b9d400640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f4b980cfcb0 con 0x7f4b98072350 2024-04-04T16:33:39.892 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:39.894+0000 7f4b96800640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4b9806f2b0 0x7f4b9815be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:39.892 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:39.894+0000 7f4b96800640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4b9806f2b0 0x7f4b9815be90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:55758/0 (socket says 172.21.15.72:55758) 2024-04-04T16:33:39.892 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:39.894+0000 7f4b96800640 1 -- 172.21.15.72:0/2551686734 learned_addr learned my addr 172.21.15.72:0/2551686734 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T16:33:39.893 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:39.895+0000 7f4b95e00640 1 --2- 172.21.15.72:0/2551686734 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4b98072350 0x7f4b9815c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:39.893 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:39.895+0000 7f4b97200640 1 --2- 172.21.15.72:0/2551686734 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4b9815ea20 0x7f4b982010a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:39.893 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:39.895+0000 7f4b96800640 1 -- 172.21.15.72:0/2551686734 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4b98072350 msgr2=0x7f4b9815c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:39.893 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:39.895+0000 7f4b96800640 1 --2- 172.21.15.72:0/2551686734 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4b98072350 0x7f4b9815c3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:39.893 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:39.895+0000 7f4b96800640 1 -- 172.21.15.72:0/2551686734 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4b9815ea20 msgr2=0x7f4b982010a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:39.893 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:39.895+0000 7f4b96800640 1 --2- 172.21.15.72:0/2551686734 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4b9815ea20 0x7f4b982010a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:39.893 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:39.895+0000 7f4b96800640 1 -- 172.21.15.72:0/2551686734 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b9815acd0 con 0x7f4b9806f2b0 2024-04-04T16:33:39.893 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:39.895+0000 7f4b97200640 1 --2- 172.21.15.72:0/2551686734 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4b9815ea20 0x7f4b982010a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-04T16:33:39.894 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:39.896+0000 7f4b96800640 1 --2- 172.21.15.72:0/2551686734 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4b9806f2b0 0x7f4b9815be90 secure :-1 s=READY pgs=2152 cs=0 l=1 rev1=1 crypto rx=0x7f4b9000ce50 tx=0x7f4b9000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T16:33:39.894 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:39.896+0000 7f4b8ea00640 1 -- 172.21.15.72:0/2551686734 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b90017070 con 0x7f4b9806f2b0 2024-04-04T16:33:39.894 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:39.896+0000 7f4b8ea00640 1 -- 172.21.15.72:0/2551686734 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b9000ac80 con 0x7f4b9806f2b0 2024-04-04T16:33:39.894 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:39.896+0000 7f4b8ea00640 1 -- 172.21.15.72:0/2551686734 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b90012600 con 0x7f4b9806f2b0 2024-04-04T16:33:39.894 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:39.896+0000 7f4b9d400640 1 -- 172.21.15.72:0/2551686734 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b9815afb0 con 0x7f4b9806f2b0 2024-04-04T16:33:39.894 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:39.897+0000 7f4b9d400640 1 -- 172.21.15.72:0/2551686734 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b9815b570 con 0x7f4b9806f2b0 2024-04-04T16:33:39.896 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:39.898+0000 7f4b9d400640 1 -- 172.21.15.72:0/2551686734 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b70005290 con 0x7f4b9806f2b0 2024-04-04T16:33:39.899 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:39.901+0000 7f4b8ea00640 1 -- 172.21.15.72:0/2551686734 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4b9001a070 con 0x7f4b9806f2b0 2024-04-04T16:33:39.900 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:39.903+0000 7f4b8ea00640 1 --2- 172.21.15.72:0/2551686734 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f4b7806c8f0 0x7f4b7806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:39.902 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:39.904+0000 7f4b8ea00640 1 -- 172.21.15.72:0/2551686734 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f4b9008bc90 con 0x7f4b9806f2b0 2024-04-04T16:33:39.902 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:39.904+0000 7f4b95e00640 1 --2- 172.21.15.72:0/2551686734 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f4b7806c8f0 0x7f4b7806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:39.903 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:39.906+0000 7f4b95e00640 1 --2- 172.21.15.72:0/2551686734 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f4b7806c8f0 0x7f4b7806edb0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f4b88036000 tx=0x7f4b8803b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T16:33:39.906 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:39.909+0000 7f4b8ea00640 1 -- 172.21.15.72:0/2551686734 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f4b90059ae0 con 0x7f4b9806f2b0 2024-04-04T16:33:40.272 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:40.275+0000 7f4b9d400640 1 -- 172.21.15.72:0/2551686734 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4b70005850 con 0x7f4b9806f2b0 2024-04-04T16:33:40.278 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:40.281+0000 7f4b8ea00640 1 -- 172.21.15.72:0/2551686734 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) ==== 74+0+16645 (secure 0 0 0) 0x7f4b9005dde0 con 0x7f4b9806f2b0 2024-04-04T16:33:40.282 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T16:33:40.282 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":33,"fsid":"6708bac2-4f50-49b5-87a9-c390fd333eb3","created":"2024-04-04T06:56:04.282498+0000","modified":"2024-04-04T06:57:51.552734+0000","last_up_change":"2024-04-04T06:56:16.716089+0000","last_in_change":"2024-04-04T06:56:07.768593+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-04T06:56:17.421685+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-04-04T06:57:47.865021+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-04-04T06:57:48.981181+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7c345991-5af8-4dc6-a481-28610c40e128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":3889813953},{"type":"v1","addr":"172.21.15.72:6818","nonce":3889813953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":3889813953},{"type":"v1","addr":"172.21.15.72:6821","nonce":3889813953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":3889813953},{"type":"v1","addr":"172.21.15.72:6826","nonce":3889813953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":3889813953},{"type":"v1","addr":"172.21.15.72:6823","nonce":3889813953}]},"public_addr":"172.21.15.72:6818/3889813953","cluster_addr":"172.21.15.72:6821/3889813953","heartbeat_back_addr":"172.21.15.72:6826/3889813953","heartbeat_front_addr":"172.21.15.72:6823/3889813953","state":["exists","up"]},{"osd":1,"uuid":"1b3f7ab2-a56c-488d-a89a-1f3572361c95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":3101663154},{"type":"v1","addr":"172.21.15.72:6801","nonce":3101663154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":3101663154},{"type":"v1","addr":"172.21.15.72:6803","nonce":3101663154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":3101663154},{"type":"v1","addr":"172.21.15.72:6807","nonce":3101663154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":3101663154},{"type":"v1","addr":"172.21.15.72:6805","nonce":3101663154}]},"public_addr":"172.21.15.72:6801/3101663154","cluster_addr":"172.21.15.72:6803/3101663154","heartbeat_back_addr":"172.21.15.72:6807/3101663154","heartbeat_front_addr":"172.21.15.72:6805/3101663154","state":["exists","up"]},{"osd":2,"uuid":"fc9aa512-53df-40d7-ba04-3e6b7dcd1e34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":235374192},{"type":"v1","addr":"172.21.15.72:6809","nonce":235374192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":235374192},{"type":"v1","addr":"172.21.15.72:6811","nonce":235374192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":235374192},{"type":"v1","addr":"172.21.15.72:6815","nonce":235374192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":235374192},{"type":"v1","addr":"172.21.15.72:6813","nonce":235374192}]},"public_addr":"172.21.15.72:6809/235374192","cluster_addr":"172.21.15.72:6811/235374192","heartbeat_back_addr":"172.21.15.72:6815/235374192","heartbeat_front_addr":"172.21.15.72:6813/235374192","state":["exists","up"]},{"osd":3,"uuid":"b4f63eed-dc5b-4aba-bb50-de46eb41492b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6817","nonce":2806631742},{"type":"v1","addr":"172.21.15.72:6819","nonce":2806631742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":2806631742},{"type":"v1","addr":"172.21.15.72:6827","nonce":2806631742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":2806631742},{"type":"v1","addr":"172.21.15.72:6831","nonce":2806631742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":2806631742},{"type":"v1","addr":"172.21.15.72:6829","nonce":2806631742}]},"public_addr":"172.21.15.72:6819/2806631742","cluster_addr":"172.21.15.72:6827/2806631742","heartbeat_back_addr":"172.21.15.72:6831/2806631742","heartbeat_front_addr":"172.21.15.72:6829/2806631742","state":["exists","up"]},{"osd":4,"uuid":"9e985ef8-d711-4172-9286-c54e560895d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":4293536423},{"type":"v1","addr":"172.21.15.117:6825","nonce":4293536423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":4293536423},{"type":"v1","addr":"172.21.15.117:6827","nonce":4293536423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":4293536423},{"type":"v1","addr":"172.21.15.117:6831","nonce":4293536423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":4293536423},{"type":"v1","addr":"172.21.15.117:6829","nonce":4293536423}]},"public_addr":"172.21.15.117:6825/4293536423","cluster_addr":"172.21.15.117:6827/4293536423","heartbeat_back_addr":"172.21.15.117:6831/4293536423","heartbeat_front_addr":"172.21.15.117:6829/4293536423","state":["exists","up"]},{"osd":5,"uuid":"3e9f082b-8d7d-455f-8a96-66d0b4857125","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":684971679},{"type":"v1","addr":"172.21.15.117:6801","nonce":684971679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":684971679},{"type":"v1","addr":"172.21.15.117:6803","nonce":684971679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":684971679},{"type":"v1","addr":"172.21.15.117:6807","nonce":684971679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":684971679},{"type":"v1","addr":"172.21.15.117:6805","nonce":684971679}]},"public_addr":"172.21.15.117:6801/684971679","cluster_addr":"172.21.15.117:6803/684971679","heartbeat_back_addr":"172.21.15.117:6807/684971679","heartbeat_front_addr":"172.21.15.117:6805/684971679","state":["exists","up"]},{"osd":6,"uuid":"bcdafa9f-a870-4398-a38d-ab7697676473","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":2781186528},{"type":"v1","addr":"172.21.15.117:6809","nonce":2781186528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":2781186528},{"type":"v1","addr":"172.21.15.117:6811","nonce":2781186528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":2781186528},{"type":"v1","addr":"172.21.15.117:6815","nonce":2781186528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":2781186528},{"type":"v1","addr":"172.21.15.117:6813","nonce":2781186528}]},"public_addr":"172.21.15.117:6809/2781186528","cluster_addr":"172.21.15.117:6811/2781186528","heartbeat_back_addr":"172.21.15.117:6815/2781186528","heartbeat_front_addr":"172.21.15.117:6813/2781186528","state":["exists","up"]},{"osd":7,"uuid":"b68ec562-ff35-4d2d-a733-c896f8920cfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":617469882},{"type":"v1","addr":"172.21.15.117:6817","nonce":617469882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":617469882},{"type":"v1","addr":"172.21.15.117:6819","nonce":617469882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":617469882},{"type":"v1","addr":"172.21.15.117:6823","nonce":617469882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":617469882},{"type":"v1","addr":"172.21.15.117:6821","nonce":617469882}]},"public_addr":"172.21.15.117:6817/617469882","cluster_addr":"172.21.15.117:6819/617469882","heartbeat_back_addr":"172.21.15.117:6823/617469882","heartbeat_front_addr":"172.21.15.117:6821/617469882","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.347700+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.296619+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.361345+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.093323+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:12.857605+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:12.816090+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.083163+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.121639+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-04T16:33:40.284 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:40.286+0000 7f4b9d400640 1 -- 172.21.15.72:0/2551686734 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f4b7806c8f0 msgr2=0x7f4b7806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:40.284 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:40.286+0000 7f4b9d400640 1 --2- 172.21.15.72:0/2551686734 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f4b7806c8f0 0x7f4b7806edb0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f4b88036000 tx=0x7f4b8803b040 comp rx=0 tx=0).stop 2024-04-04T16:33:40.284 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:40.286+0000 7f4b9d400640 1 -- 172.21.15.72:0/2551686734 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4b9806f2b0 msgr2=0x7f4b9815be90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:40.284 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:40.286+0000 7f4b9d400640 1 --2- 172.21.15.72:0/2551686734 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4b9806f2b0 0x7f4b9815be90 secure :-1 s=READY pgs=2152 cs=0 l=1 rev1=1 crypto rx=0x7f4b9000ce50 tx=0x7f4b9000a430 comp rx=0 tx=0).stop 2024-04-04T16:33:40.284 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:40.287+0000 7f4b9d400640 1 -- 172.21.15.72:0/2551686734 shutdown_connections 2024-04-04T16:33:40.285 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:40.287+0000 7f4b9d400640 1 --2- 172.21.15.72:0/2551686734 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f4b7806c8f0 0x7f4b7806edb0 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:40.285 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:40.287+0000 7f4b9d400640 1 --2- 172.21.15.72:0/2551686734 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4b9815ea20 0x7f4b982010a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:40.285 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:40.287+0000 7f4b9d400640 1 --2- 172.21.15.72:0/2551686734 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4b98072350 0x7f4b9815c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:40.285 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:40.287+0000 7f4b9d400640 1 --2- 172.21.15.72:0/2551686734 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4b9806f2b0 0x7f4b9815be90 unknown :-1 s=CLOSED pgs=2152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:40.285 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:40.287+0000 7f4b9d400640 1 -- 172.21.15.72:0/2551686734 >> 172.21.15.72:0/2551686734 conn(0x7f4b980d0740 msgr2=0x7f4b981591f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T16:33:40.286 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:40.288+0000 7f4b9d400640 1 -- 172.21.15.72:0/2551686734 shutdown_connections 2024-04-04T16:33:40.286 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:40.288+0000 7f4b9d400640 1 -- 172.21.15.72:0/2551686734 wait complete. 2024-04-04T16:33:40.314 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-04T16:33:40.314 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-04T16:33:40.605 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:40.607+0000 7f9f32e00640 1 Processor -- start 2024-04-04T16:33:40.607 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:40.609+0000 7f9f32e00640 1 -- start start 2024-04-04T16:33:40.608 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:40.610+0000 7f9f32e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9f2c0ccf60 0x7f9f2c0d0470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:40.608 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:40.611+0000 7f9f32e00640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9f2c0b3080 con 0x7f9f2c0ccad0 2024-04-04T16:33:40.608 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:40.611+0000 7f9f32e00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9f2c0cf5a0 con 0x7f9f2c162850 2024-04-04T16:33:40.608 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:40.611+0000 7f9f32e00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f9f2c0b38e0 con 0x7f9f2c0ccf60 2024-04-04T16:33:40.609 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:40.611+0000 7f9f30e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9f2c0ccf60 0x7f9f2c0d0470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:40.609 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:40.611+0000 7f9f30e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9f2c0ccf60 0x7f9f2c0d0470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.72:53972/0 (socket says 172.21.15.72:53972) 2024-04-04T16:33:40.609 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:40.611+0000 7f9f30e00640 1 -- 172.21.15.72:0/3820191942 learned_addr learned my addr 172.21.15.72:0/3820191942 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T16:33:40.610 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:40.612+0000 7f9f30e00640 1 -- 172.21.15.72:0/3820191942 >> v1:172.21.15.117:6789/0 conn(0x7f9f2c162850 legacy=0x7f9f2c0cea40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-04T16:33:40.610 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:40.612+0000 7f9f30e00640 1 -- 172.21.15.72:0/3820191942 >> v1:172.21.15.72:6789/0 conn(0x7f9f2c0ccad0 legacy=0x7f9f2c0cfd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T16:33:40.610 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:40.612+0000 7f9f30e00640 1 -- 172.21.15.72:0/3820191942 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f2c0cd3d0 con 0x7f9f2c0ccf60 2024-04-04T16:33:40.611 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:40.613+0000 7f9f30e00640 1 --2- 172.21.15.72:0/3820191942 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9f2c0ccf60 0x7f9f2c0d0470 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f9f24009e50 tx=0x7f9f2402beb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3b5d4e9fe8355a71 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T16:33:40.612 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:40.614+0000 7f9f2aa00640 1 -- 172.21.15.72:0/3820191942 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f2402ca50 con 0x7f9f2c0ccf60 2024-04-04T16:33:40.612 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:40.614+0000 7f9f2aa00640 1 -- 172.21.15.72:0/3820191942 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f2402cbf0 con 0x7f9f2c0ccf60 2024-04-04T16:33:40.612 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:40.614+0000 7f9f2aa00640 1 -- 172.21.15.72:0/3820191942 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f240343f0 con 0x7f9f2c0ccf60 2024-04-04T16:33:40.616 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:40.619+0000 7f9f32e00640 1 -- 172.21.15.72:0/3820191942 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9f2c0ccf60 msgr2=0x7f9f2c0d0470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:40.617 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:40.619+0000 7f9f32e00640 1 --2- 172.21.15.72:0/3820191942 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9f2c0ccf60 0x7f9f2c0d0470 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f9f24009e50 tx=0x7f9f2402beb0 comp rx=0 tx=0).stop 2024-04-04T16:33:40.617 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:40.619+0000 7f9f32e00640 1 -- 172.21.15.72:0/3820191942 shutdown_connections 2024-04-04T16:33:40.617 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:40.619+0000 7f9f32e00640 1 --2- 172.21.15.72:0/3820191942 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9f2c0ccf60 0x7f9f2c0d0470 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:40.617 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:40.619+0000 7f9f32e00640 1 -- 172.21.15.72:0/3820191942 >> 172.21.15.72:0/3820191942 conn(0x7f9f2c06b470 msgr2=0x7f9f2c06b880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T16:33:40.619 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:40.620+0000 7f9f32e00640 1 -- 172.21.15.72:0/3820191942 shutdown_connections 2024-04-04T16:33:40.619 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:40.620+0000 7f9f32e00640 1 -- 172.21.15.72:0/3820191942 wait complete. 2024-04-04T16:33:40.621 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:40.624+0000 7f9f32e00640 1 Processor -- start 2024-04-04T16:33:40.621 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:40.624+0000 7f9f32e00640 1 -- start start 2024-04-04T16:33:40.623 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:40.625+0000 7f9f32e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9f2c0ccad0 0x7f9f2c0c6920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:40.623 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:40.626+0000 7f9f32e00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9f2c0ccf60 0x7f9f2c06f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:40.623 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:40.626+0000 7f9f32e00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9f2c162850 0x7f9f2c1fc6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:40.623 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:40.626+0000 7f9f32e00640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f9f2c0cf840 con 0x7f9f2c0ccf60 2024-04-04T16:33:40.623 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:40.626+0000 7f9f32e00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f9f2c0b3600 con 0x7f9f2c162850 2024-04-04T16:33:40.624 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:40.626+0000 7f9f32e00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f9f2c162c30 con 0x7f9f2c0ccad0 2024-04-04T16:33:40.624 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:40.626+0000 7f9f2b400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9f2c0ccf60 0x7f9f2c06f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:40.625 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:40.626+0000 7f9f2be00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9f2c0ccad0 0x7f9f2c0c6920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:40.625 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:40.626+0000 7f9f2be00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9f2c0ccad0 0x7f9f2c0c6920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.72:53984/0 (socket says 172.21.15.72:53984) 2024-04-04T16:33:40.625 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:40.626+0000 7f9f2be00640 1 -- 172.21.15.72:0/1820421577 learned_addr learned my addr 172.21.15.72:0/1820421577 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T16:33:40.625 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:40.626+0000 7f9f2b400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9f2c0ccf60 0x7f9f2c06f3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:55770/0 (socket says 172.21.15.72:55770) 2024-04-04T16:33:40.625 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:40.626+0000 7f9f30e00640 1 --2- 172.21.15.72:0/1820421577 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9f2c162850 0x7f9f2c1fc6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:40.627 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:40.629+0000 7f9f2be00640 1 -- 172.21.15.72:0/1820421577 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9f2c162850 msgr2=0x7f9f2c1fc6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:40.627 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:40.629+0000 7f9f2be00640 1 --2- 172.21.15.72:0/1820421577 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9f2c162850 0x7f9f2c1fc6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:40.627 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:40.629+0000 7f9f2be00640 1 -- 172.21.15.72:0/1820421577 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9f2c0ccf60 msgr2=0x7f9f2c06f3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:40.627 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:40.629+0000 7f9f2be00640 1 --2- 172.21.15.72:0/1820421577 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9f2c0ccf60 0x7f9f2c06f3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:40.627 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:40.629+0000 7f9f2be00640 1 -- 172.21.15.72:0/1820421577 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f2c1fd2d0 con 0x7f9f2c0ccad0 2024-04-04T16:33:40.627 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:40.629+0000 7f9f2b400640 1 --2- 172.21.15.72:0/1820421577 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9f2c0ccf60 0x7f9f2c06f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-04T16:33:40.628 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:40.630+0000 7f9f2be00640 1 --2- 172.21.15.72:0/1820421577 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9f2c0ccad0 0x7f9f2c0c6920 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f9f1c00b3e0 tx=0x7f9f1c00b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T16:33:40.628 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:40.631+0000 7f9f23e00640 1 -- 172.21.15.72:0/1820421577 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f1c015020 con 0x7f9f2c0ccad0 2024-04-04T16:33:40.628 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:40.631+0000 7f9f23e00640 1 -- 172.21.15.72:0/1820421577 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f1c011850 con 0x7f9f2c0ccad0 2024-04-04T16:33:40.629 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:40.631+0000 7f9f23e00640 1 -- 172.21.15.72:0/1820421577 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f1c011c40 con 0x7f9f2c0ccad0 2024-04-04T16:33:40.629 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:40.631+0000 7f9f32e00640 1 -- 172.21.15.72:0/1820421577 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f2c06ea10 con 0x7f9f2c0ccad0 2024-04-04T16:33:40.629 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:40.631+0000 7f9f32e00640 1 -- 172.21.15.72:0/1820421577 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f2c0c6120 con 0x7f9f2c0ccad0 2024-04-04T16:33:40.630 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:40.633+0000 7f9f32e00640 1 -- 172.21.15.72:0/1820421577 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f2c075840 con 0x7f9f2c0ccad0 2024-04-04T16:33:40.633 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:40.635+0000 7f9f23e00640 1 -- 172.21.15.72:0/1820421577 <== mon.2 v2:172.21.15.117:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9f1c018020 con 0x7f9f2c0ccad0 2024-04-04T16:33:40.634 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:40.637+0000 7f9f23e00640 1 --2- 172.21.15.72:0/1820421577 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f9f0c06c9f0 0x7f9f0c06eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:40.637 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:40.637+0000 7f9f23e00640 1 -- 172.21.15.72:0/1820421577 <== mon.2 v2:172.21.15.117:3301/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f9f1c08bc30 con 0x7f9f2c0ccad0 2024-04-04T16:33:40.642 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:40.638+0000 7f9f2b400640 1 --2- 172.21.15.72:0/1820421577 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f9f0c06c9f0 0x7f9f0c06eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:40.643 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:40.639+0000 7f9f2b400640 1 --2- 172.21.15.72:0/1820421577 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f9f0c06c9f0 0x7f9f0c06eeb0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f9f2c1fc3e0 tx=0x7f9f18009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T16:33:40.643 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:40.644+0000 7f9f23e00640 1 -- 172.21.15.72:0/1820421577 <== mon.2 v2:172.21.15.117:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f9f1c01f020 con 0x7f9f2c0ccad0 2024-04-04T16:33:41.070 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:41.072+0000 7f9f32e00640 1 -- 172.21.15.72:0/1820421577 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9f2c0cc6a0 con 0x7f9f2c0ccad0 2024-04-04T16:33:41.075 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T16:33:41.075 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4619,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/2380537280","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6833","nonce":2380537280},{"type":"v1","addr":"172.21.15.117:6835","nonce":2380537280}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4840,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6834/108808341","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":108808341},{"type":"v1","addr":"172.21.15.117:6834","nonce":108808341}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":5253,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6836/3494332623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":3494332623},{"type":"v1","addr":"172.21.15.72:6836","nonce":3494332623}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-04T06:57:50.020152+0000","modified":"2024-04-04T06:57:53.165429+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5256},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5256":{"gid":5256,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.72:6837/2509618069","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6835","nonce":2509618069},{"type":"v1","addr":"172.21.15.72:6837","nonce":2509618069}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5256,"qdb_cluster":[5256]},"id":2}]} 2024-04-04T16:33:41.076 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 17 2024-04-04T16:33:41.076 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:41.076+0000 7f9f23e00640 1 -- 172.21.15.72:0/1820421577 <== mon.2 v2:172.21.15.117:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+5184 (secure 0 0 0) 0x7f9f1c0599f0 con 0x7f9f2c0ccad0 2024-04-04T16:33:41.078 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:41.080+0000 7f9f32e00640 1 -- 172.21.15.72:0/1820421577 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f9f0c06c9f0 msgr2=0x7f9f0c06eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:41.078 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:41.080+0000 7f9f32e00640 1 --2- 172.21.15.72:0/1820421577 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f9f0c06c9f0 0x7f9f0c06eeb0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f9f2c1fc3e0 tx=0x7f9f18009040 comp rx=0 tx=0).stop 2024-04-04T16:33:41.078 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:41.080+0000 7f9f32e00640 1 -- 172.21.15.72:0/1820421577 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9f2c0ccad0 msgr2=0x7f9f2c0c6920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:41.078 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:41.080+0000 7f9f32e00640 1 --2- 172.21.15.72:0/1820421577 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9f2c0ccad0 0x7f9f2c0c6920 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f9f1c00b3e0 tx=0x7f9f1c00b8a0 comp rx=0 tx=0).stop 2024-04-04T16:33:41.078 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:41.080+0000 7f9f32e00640 1 -- 172.21.15.72:0/1820421577 shutdown_connections 2024-04-04T16:33:41.078 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:41.080+0000 7f9f32e00640 1 --2- 172.21.15.72:0/1820421577 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f9f0c06c9f0 0x7f9f0c06eeb0 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:41.078 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:41.080+0000 7f9f32e00640 1 --2- 172.21.15.72:0/1820421577 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9f2c162850 0x7f9f2c1fc6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:41.078 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:41.080+0000 7f9f32e00640 1 --2- 172.21.15.72:0/1820421577 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9f2c0ccf60 0x7f9f2c06f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:41.079 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:41.080+0000 7f9f32e00640 1 --2- 172.21.15.72:0/1820421577 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9f2c0ccad0 0x7f9f2c0c6920 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:41.079 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:41.080+0000 7f9f32e00640 1 -- 172.21.15.72:0/1820421577 >> 172.21.15.72:0/1820421577 conn(0x7f9f2c06b470 msgr2=0x7f9f2c166c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T16:33:41.079 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:41.080+0000 7f9f32e00640 1 -- 172.21.15.72:0/1820421577 shutdown_connections 2024-04-04T16:33:41.079 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:41.080+0000 7f9f32e00640 1 -- 172.21.15.72:0/1820421577 wait complete. 2024-04-04T16:33:41.103 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-04T16:33:41.371 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:41.373+0000 7f241be00640 1 Processor -- start 2024-04-04T16:33:41.371 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:41.373+0000 7f241be00640 1 -- start start 2024-04-04T16:33:41.373 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:41.375+0000 7f241be00640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f241415c2d0 0x7f2414071610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:41.373 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:41.375+0000 7f241be00640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24140c6710 con 0x7f24140ccb20 2024-04-04T16:33:41.373 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:41.375+0000 7f241be00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24140c69f0 con 0x7f241415c6b0 2024-04-04T16:33:41.373 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:41.375+0000 7f241be00640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f24140c6fb0 con 0x7f241415c2d0 2024-04-04T16:33:41.373 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:41.375+0000 7f2419400640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f241415c2d0 0x7f2414071610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:41.373 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:41.376+0000 7f2419e00640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f24140ccb20 0x7f24140b3ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:60052/0 (socket says 172.21.15.72:60052) 2024-04-04T16:33:41.373 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:41.376+0000 7f2419e00640 1 -- 172.21.15.72:0/3797746033 learned_addr learned my addr 172.21.15.72:0/3797746033 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-04-04T16:33:41.374 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:41.376+0000 7f2419400640 1 -- 172.21.15.72:0/3797746033 >> v1:172.21.15.117:6789/0 conn(0x7f241415c6b0 legacy=0x7f24140c5e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T16:33:41.374 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:41.376+0000 7f2419400640 1 -- 172.21.15.72:0/3797746033 >> v1:172.21.15.72:6789/0 conn(0x7f24140ccb20 legacy=0x7f24140b3ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:41.374 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:41.377+0000 7f2419400640 1 -- 172.21.15.72:0/3797746033 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24140c6cd0 con 0x7f241415c2d0 2024-04-04T16:33:41.377 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:41.379+0000 7f2419400640 1 --2- 172.21.15.72:0/3797746033 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f241415c2d0 0x7f2414071610 secure :-1 s=READY pgs=2154 cs=0 l=1 rev1=1 crypto rx=0x7f24140c7130 tx=0x7f240802b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5eae63fa9bbc43c server_cookie=0 in_seq=0 out_seq=0 2024-04-04T16:33:41.380 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:41.383+0000 7f2413e00640 1 -- 172.21.15.72:0/3797746033 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2408035020 con 0x7f241415c2d0 2024-04-04T16:33:41.381 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:41.383+0000 7f2413e00640 1 -- 172.21.15.72:0/3797746033 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2408031810 con 0x7f241415c2d0 2024-04-04T16:33:41.381 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:41.383+0000 7f2413e00640 1 -- 172.21.15.72:0/3797746033 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2408035020 con 0x7f241415c2d0 2024-04-04T16:33:41.384 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:41.386+0000 7f241be00640 1 -- 172.21.15.72:0/3797746033 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f241415c2d0 msgr2=0x7f2414071610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:41.384 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:41.386+0000 7f241be00640 1 --2- 172.21.15.72:0/3797746033 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f241415c2d0 0x7f2414071610 secure :-1 s=READY pgs=2154 cs=0 l=1 rev1=1 crypto rx=0x7f24140c7130 tx=0x7f240802b8b0 comp rx=0 tx=0).stop 2024-04-04T16:33:41.386 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:41.387+0000 7f241be00640 1 -- 172.21.15.72:0/3797746033 shutdown_connections 2024-04-04T16:33:41.386 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:41.387+0000 7f241be00640 1 --2- 172.21.15.72:0/3797746033 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f241415c2d0 0x7f2414071610 unknown :-1 s=CLOSED pgs=2154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:41.386 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:41.387+0000 7f241be00640 1 -- 172.21.15.72:0/3797746033 >> 172.21.15.72:0/3797746033 conn(0x7f241406b470 msgr2=0x7f241406b880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T16:33:41.386 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:41.388+0000 7f241be00640 1 -- 172.21.15.72:0/3797746033 shutdown_connections 2024-04-04T16:33:41.386 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:41.388+0000 7f241be00640 1 -- 172.21.15.72:0/3797746033 wait complete. 2024-04-04T16:33:41.389 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:41.390+0000 7f241be00640 1 Processor -- start 2024-04-04T16:33:41.390 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:41.392+0000 7f241be00640 1 -- start start 2024-04-04T16:33:41.393 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:41.393+0000 7f241be00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f24140ccb20 0x7f241409d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:41.394 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:41.394+0000 7f241be00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f241415c2d0 0x7f24140ca780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:41.394 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:41.394+0000 7f241be00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f241415c6b0 0x7f24140c7da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:41.394 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:41.394+0000 7f241be00640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f24140cd0e0 con 0x7f24140ccb20 2024-04-04T16:33:41.394 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:41.394+0000 7f241be00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f24140ccf60 con 0x7f241415c2d0 2024-04-04T16:33:41.394 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:41.394+0000 7f241be00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f24140cd260 con 0x7f241415c6b0 2024-04-04T16:33:41.394 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:41.395+0000 7f2419e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f241415c6b0 0x7f24140c7da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:41.394 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:41.395+0000 7f2419e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f241415c6b0 0x7f24140c7da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.72:53986/0 (socket says 172.21.15.72:53986) 2024-04-04T16:33:41.394 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:41.395+0000 7f2419e00640 1 -- 172.21.15.72:0/3988849963 learned_addr learned my addr 172.21.15.72:0/3988849963 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T16:33:41.394 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:41.396+0000 7f2418a00640 1 --2- 172.21.15.72:0/3988849963 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f241415c2d0 0x7f24140ca780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:41.394 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:41.396+0000 7f2419400640 1 --2- 172.21.15.72:0/3988849963 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f24140ccb20 0x7f241409d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:41.395 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:41.397+0000 7f2419400640 1 -- 172.21.15.72:0/3988849963 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f241415c6b0 msgr2=0x7f24140c7da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:41.395 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:41.397+0000 7f2419400640 1 --2- 172.21.15.72:0/3988849963 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f241415c6b0 0x7f24140c7da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:41.395 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:41.397+0000 7f2419400640 1 -- 172.21.15.72:0/3988849963 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f241415c2d0 msgr2=0x7f24140ca780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:41.395 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:41.397+0000 7f2419400640 1 --2- 172.21.15.72:0/3988849963 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f241415c2d0 0x7f24140ca780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:41.395 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:41.397+0000 7f2419400640 1 -- 172.21.15.72:0/3988849963 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f241409dd10 con 0x7f24140ccb20 2024-04-04T16:33:41.395 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:41.397+0000 7f2419400640 1 --2- 172.21.15.72:0/3988849963 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f24140ccb20 0x7f241409d7d0 secure :-1 s=READY pgs=2155 cs=0 l=1 rev1=1 crypto rx=0x7f2408033000 tx=0x7f24080046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T16:33:41.396 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:41.398+0000 7f2411600640 1 -- 172.21.15.72:0/3988849963 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2408035040 con 0x7f24140ccb20 2024-04-04T16:33:41.396 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:41.398+0000 7f2411600640 1 -- 172.21.15.72:0/3988849963 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2408003c50 con 0x7f24140ccb20 2024-04-04T16:33:41.396 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:41.398+0000 7f2411600640 1 -- 172.21.15.72:0/3988849963 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2408046480 con 0x7f24140ccb20 2024-04-04T16:33:41.396 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:41.398+0000 7f241be00640 1 -- 172.21.15.72:0/3988849963 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24141fc4d0 con 0x7f24140ccb20 2024-04-04T16:33:41.396 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:41.398+0000 7f241be00640 1 -- 172.21.15.72:0/3988849963 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24141fca90 con 0x7f24140ccb20 2024-04-04T16:33:41.398 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:41.400+0000 7f2411600640 1 -- 172.21.15.72:0/3988849963 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2408038020 con 0x7f24140ccb20 2024-04-04T16:33:41.399 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:41.401+0000 7f241be00640 1 -- 172.21.15.72:0/3988849963 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2414075840 con 0x7f24140ccb20 2024-04-04T16:33:41.399 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:41.401+0000 7f2411600640 1 --2- 172.21.15.72:0/3988849963 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f23f406c920 0x7f23f406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:41.399 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:41.401+0000 7f2411600640 1 -- 172.21.15.72:0/3988849963 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f24080ae1c0 con 0x7f24140ccb20 2024-04-04T16:33:41.399 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:41.402+0000 7f2418a00640 1 --2- 172.21.15.72:0/3988849963 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f23f406c920 0x7f23f406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:41.400 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:41.403+0000 7f2418a00640 1 --2- 172.21.15.72:0/3988849963 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f23f406c920 0x7f23f406ede0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f2414072c90 tx=0x7f2400009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T16:33:41.409 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:41.411+0000 7f2411600640 1 -- 172.21.15.72:0/3988849963 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f240807bf90 con 0x7f24140ccb20 2024-04-04T16:33:41.832 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:41.834+0000 7f241be00640 1 -- 172.21.15.72:0/3988849963 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f241409e1c0 con 0x7f24140ccb20 2024-04-04T16:33:41.834 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:41.837+0000 7f2411600640 1 -- 172.21.15.72:0/3988849963 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+5184 (secure 0 0 0) 0x7f2408080290 con 0x7f24140ccb20 2024-04-04T16:33:41.835 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T16:33:41.835 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4619,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/2380537280","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6833","nonce":2380537280},{"type":"v1","addr":"172.21.15.117:6835","nonce":2380537280}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4840,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6834/108808341","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":108808341},{"type":"v1","addr":"172.21.15.117:6834","nonce":108808341}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":5253,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6836/3494332623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":3494332623},{"type":"v1","addr":"172.21.15.72:6836","nonce":3494332623}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-04T06:57:50.020152+0000","modified":"2024-04-04T06:57:53.165429+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5256},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5256":{"gid":5256,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.72:6837/2509618069","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6835","nonce":2509618069},{"type":"v1","addr":"172.21.15.72:6837","nonce":2509618069}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5256,"qdb_cluster":[5256]},"id":2}]} 2024-04-04T16:33:41.835 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 17 2024-04-04T16:33:41.839 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:41.841+0000 7f241be00640 1 -- 172.21.15.72:0/3988849963 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f23f406c920 msgr2=0x7f23f406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:41.840 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:41.841+0000 7f241be00640 1 --2- 172.21.15.72:0/3988849963 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f23f406c920 0x7f23f406ede0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f2414072c90 tx=0x7f2400009040 comp rx=0 tx=0).stop 2024-04-04T16:33:41.840 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:41.841+0000 7f241be00640 1 -- 172.21.15.72:0/3988849963 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f24140ccb20 msgr2=0x7f241409d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:41.840 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:41.841+0000 7f241be00640 1 --2- 172.21.15.72:0/3988849963 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f24140ccb20 0x7f241409d7d0 secure :-1 s=READY pgs=2155 cs=0 l=1 rev1=1 crypto rx=0x7f2408033000 tx=0x7f24080046c0 comp rx=0 tx=0).stop 2024-04-04T16:33:41.840 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:41.841+0000 7f241be00640 1 -- 172.21.15.72:0/3988849963 shutdown_connections 2024-04-04T16:33:41.840 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:41.841+0000 7f241be00640 1 --2- 172.21.15.72:0/3988849963 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f23f406c920 0x7f23f406ede0 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:41.840 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:41.841+0000 7f241be00640 1 --2- 172.21.15.72:0/3988849963 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f241415c6b0 0x7f24140c7da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:41.840 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:41.841+0000 7f241be00640 1 --2- 172.21.15.72:0/3988849963 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f241415c2d0 0x7f24140ca780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:41.840 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:41.841+0000 7f241be00640 1 --2- 172.21.15.72:0/3988849963 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f24140ccb20 0x7f241409d7d0 unknown :-1 s=CLOSED pgs=2155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:41.840 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:41.841+0000 7f241be00640 1 -- 172.21.15.72:0/3988849963 >> 172.21.15.72:0/3988849963 conn(0x7f241406b470 msgr2=0x7f241415de30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T16:33:41.840 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:41.842+0000 7f241be00640 1 -- 172.21.15.72:0/3988849963 shutdown_connections 2024-04-04T16:33:41.840 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:41.842+0000 7f241be00640 1 -- 172.21.15.72:0/3988849963 wait complete. 2024-04-04T16:33:41.868 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-04T16:33:42.138 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:42.140+0000 7fda82800640 1 Processor -- start 2024-04-04T16:33:42.139 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:42.141+0000 7fda82800640 1 -- start start 2024-04-04T16:33:42.140 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:42.142+0000 7fda82800640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fda7c0af3b0 0x7fda7c15e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:42.140 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:42.142+0000 7fda82800640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fda7c0af790 0x7fda7c0ca780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:42.141 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:42.142+0000 7fda82800640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fda7c15b750 0x7fda7c0c4ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:42.141 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:42.142+0000 7fda82800640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7fda7c06d7e0 con 0x7fda7c15b750 2024-04-04T16:33:42.141 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:42.142+0000 7fda82800640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fda7c15e8a0 con 0x7fda7c0af3b0 2024-04-04T16:33:42.141 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:42.142+0000 7fda82800640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fda7c15eb80 con 0x7fda7c0af790 2024-04-04T16:33:42.141 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:42.143+0000 7fda73e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fda7c0af790 0x7fda7c0ca780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:42.141 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:42.143+0000 7fda7b400640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fda7c0af3b0 0x7fda7c15e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:42.141 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:42.143+0000 7fda7b400640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fda7c0af3b0 0x7fda7c15e2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.72:60022/0 (socket says 172.21.15.72:60022) 2024-04-04T16:33:42.141 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:42.143+0000 7fda7be00640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fda7c15b750 0x7fda7c0c4ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:42.141 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:42.143+0000 7fda7b400640 1 -- 172.21.15.72:0/3038405597 learned_addr learned my addr 172.21.15.72:0/3038405597 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T16:33:42.141 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:42.143+0000 7fda7b400640 1 -- 172.21.15.72:0/3038405597 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fda7c0af790 msgr2=0x7fda7c0ca780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T16:33:42.142 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:42.143+0000 7fda7b400640 1 --2- 172.21.15.72:0/3038405597 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fda7c0af790 0x7fda7c0ca780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:42.142 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:42.143+0000 7fda7b400640 1 -- 172.21.15.72:0/3038405597 >> v2:172.21.15.72:3300/0 conn(0x7fda7c15b750 msgr2=0x7fda7c0c4ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T16:33:42.142 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:42.143+0000 7fda7b400640 1 --2- 172.21.15.72:0/3038405597 >> v2:172.21.15.72:3300/0 conn(0x7fda7c15b750 0x7fda7c0c4ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:42.142 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:42.143+0000 7fda7b400640 1 -- 172.21.15.72:0/3038405597 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda7c15ee60 con 0x7fda7c0af3b0 2024-04-04T16:33:42.142 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:42.145+0000 7fda7b400640 1 --2- 172.21.15.72:0/3038405597 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fda7c0af3b0 0x7fda7c15e2c0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7fda7c0b6340 tx=0x7fda6c02dd80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=911c30375ed4b6ef server_cookie=0 in_seq=0 out_seq=0 2024-04-04T16:33:42.143 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:42.145+0000 7fda7aa00640 1 -- 172.21.15.72:0/3038405597 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda6c034070 con 0x7fda7c0af3b0 2024-04-04T16:33:42.143 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:42.145+0000 7fda7aa00640 1 -- 172.21.15.72:0/3038405597 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda6c02eb30 con 0x7fda7c0af3b0 2024-04-04T16:33:42.143 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:42.145+0000 7fda7aa00640 1 -- 172.21.15.72:0/3038405597 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda6c038400 con 0x7fda7c0af3b0 2024-04-04T16:33:42.144 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:42.146+0000 7fda82800640 1 -- 172.21.15.72:0/3038405597 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fda7c0af3b0 msgr2=0x7fda7c15e2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:42.144 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:42.146+0000 7fda82800640 1 --2- 172.21.15.72:0/3038405597 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fda7c0af3b0 0x7fda7c15e2c0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7fda7c0b6340 tx=0x7fda6c02dd80 comp rx=0 tx=0).stop 2024-04-04T16:33:42.144 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:42.147+0000 7fda82800640 1 -- 172.21.15.72:0/3038405597 shutdown_connections 2024-04-04T16:33:42.144 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:42.147+0000 7fda82800640 1 --2- 172.21.15.72:0/3038405597 >> v2:172.21.15.72:3300/0 conn(0x7fda7c15b750 0x7fda7c0c4ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:42.145 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:42.147+0000 7fda82800640 1 --2- 172.21.15.72:0/3038405597 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fda7c0af790 0x7fda7c0ca780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:42.145 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:42.147+0000 7fda82800640 1 --2- 172.21.15.72:0/3038405597 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fda7c0af3b0 0x7fda7c15e2c0 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:42.145 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:42.147+0000 7fda82800640 1 -- 172.21.15.72:0/3038405597 >> 172.21.15.72:0/3038405597 conn(0x7fda7c071b50 msgr2=0x7fda7c072a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T16:33:42.145 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:42.147+0000 7fda82800640 1 -- 172.21.15.72:0/3038405597 shutdown_connections 2024-04-04T16:33:42.146 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:42.147+0000 7fda82800640 1 -- 172.21.15.72:0/3038405597 wait complete. 2024-04-04T16:33:42.148 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:42.151+0000 7fda82800640 1 Processor -- start 2024-04-04T16:33:42.148 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:42.151+0000 7fda82800640 1 -- start start 2024-04-04T16:33:42.150 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:42.152+0000 7fda82800640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fda7c0af3b0 0x7fda7c0cd190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:42.150 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:42.153+0000 7fda82800640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fda7c0af790 0x7fda7c0b5120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:42.150 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:42.153+0000 7fda82800640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fda7c15b750 0x7fda7c0b3e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:42.150 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:42.153+0000 7fda82800640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fda7c073110 con 0x7fda7c15b750 2024-04-04T16:33:42.150 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:42.153+0000 7fda82800640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fda7c15f140 con 0x7fda7c0af3b0 2024-04-04T16:33:42.151 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:42.153+0000 7fda82800640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fda7c073290 con 0x7fda7c0af790 2024-04-04T16:33:42.151 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:42.153+0000 7fda7b400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fda7c0af3b0 0x7fda7c0cd190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:42.151 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:42.153+0000 7fda7b400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fda7c0af3b0 0x7fda7c0cd190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.72:60038/0 (socket says 172.21.15.72:60038) 2024-04-04T16:33:42.151 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:42.153+0000 7fda7b400640 1 -- 172.21.15.72:0/3846443933 learned_addr learned my addr 172.21.15.72:0/3846443933 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T16:33:42.151 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:42.153+0000 7fda73e00640 1 --2- 172.21.15.72:0/3846443933 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fda7c0af790 0x7fda7c0b5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:42.151 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:42.153+0000 7fda7be00640 1 --2- 172.21.15.72:0/3846443933 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fda7c15b750 0x7fda7c0b3e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:42.152 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:42.154+0000 7fda73e00640 1 -- 172.21.15.72:0/3846443933 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fda7c0af3b0 msgr2=0x7fda7c0cd190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:42.152 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:42.154+0000 7fda73e00640 1 --2- 172.21.15.72:0/3846443933 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fda7c0af3b0 0x7fda7c0cd190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:42.152 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:42.154+0000 7fda73e00640 1 -- 172.21.15.72:0/3846443933 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fda7c15b750 msgr2=0x7fda7c0b3e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:42.152 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:42.154+0000 7fda73e00640 1 --2- 172.21.15.72:0/3846443933 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fda7c15b750 0x7fda7c0b3e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:42.152 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:42.154+0000 7fda73e00640 1 -- 172.21.15.72:0/3846443933 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda7c0b5be0 con 0x7fda7c0af790 2024-04-04T16:33:42.152 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:42.154+0000 7fda7be00640 1 --2- 172.21.15.72:0/3846443933 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fda7c15b750 0x7fda7c0b3e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-04T16:33:42.160 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:42.155+0000 7fda73e00640 1 --2- 172.21.15.72:0/3846443933 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fda7c0af790 0x7fda7c0b5120 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fda640107b0 tx=0x7fda64010c70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T16:33:42.160 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:42.158+0000 7fda73400640 1 -- 172.21.15.72:0/3846443933 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda6401b020 con 0x7fda7c0af790 2024-04-04T16:33:42.160 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:42.158+0000 7fda73400640 1 -- 172.21.15.72:0/3846443933 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda6400e2e0 con 0x7fda7c0af790 2024-04-04T16:33:42.160 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:42.158+0000 7fda73400640 1 -- 172.21.15.72:0/3846443933 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda64004260 con 0x7fda7c0af790 2024-04-04T16:33:42.160 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:42.159+0000 7fda82800640 1 -- 172.21.15.72:0/3846443933 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda7c0afcb0 con 0x7fda7c0af790 2024-04-04T16:33:42.160 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:42.160+0000 7fda82800640 1 -- 172.21.15.72:0/3846443933 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fda7c0b0270 con 0x7fda7c0af790 2024-04-04T16:33:42.160 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:42.161+0000 7fda82800640 1 -- 172.21.15.72:0/3846443933 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda7c075840 con 0x7fda7c0af790 2024-04-04T16:33:42.163 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:42.166+0000 7fda73400640 1 -- 172.21.15.72:0/3846443933 <== mon.2 v2:172.21.15.117:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fda6403c640 con 0x7fda7c0af790 2024-04-04T16:33:42.164 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:42.167+0000 7fda73400640 1 --2- 172.21.15.72:0/3846443933 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fda5806c940 0x7fda5806ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:42.165 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:42.167+0000 7fda73400640 1 -- 172.21.15.72:0/3846443933 <== mon.2 v2:172.21.15.117:3301/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7fda6408f7a0 con 0x7fda7c0af790 2024-04-04T16:33:42.165 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:42.168+0000 7fda7b400640 1 --2- 172.21.15.72:0/3846443933 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fda5806c940 0x7fda5806ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:42.166 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:42.169+0000 7fda7b400640 1 --2- 172.21.15.72:0/3846443933 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fda5806c940 0x7fda5806ee00 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7fda6c00b340 tx=0x7fda6c034000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T16:33:42.170 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:42.172+0000 7fda73400640 1 -- 172.21.15.72:0/3846443933 <== mon.2 v2:172.21.15.117:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fda64025020 con 0x7fda7c0af790 2024-04-04T16:33:42.554 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:42.556+0000 7fda82800640 1 -- 172.21.15.72:0/3846443933 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fda7c0aef70 con 0x7fda7c0af790 2024-04-04T16:33:42.558 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:42.561+0000 7fda73400640 1 -- 172.21.15.72:0/3846443933 <== mon.2 v2:172.21.15.117:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) ==== 74+0+16645 (secure 0 0 0) 0x7fda6405d5f0 con 0x7fda7c0af790 2024-04-04T16:33:42.562 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T16:33:42.562 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":33,"fsid":"6708bac2-4f50-49b5-87a9-c390fd333eb3","created":"2024-04-04T06:56:04.282498+0000","modified":"2024-04-04T06:57:51.552734+0000","last_up_change":"2024-04-04T06:56:16.716089+0000","last_in_change":"2024-04-04T06:56:07.768593+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-04T06:56:17.421685+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-04-04T06:57:47.865021+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-04-04T06:57:48.981181+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7c345991-5af8-4dc6-a481-28610c40e128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":3889813953},{"type":"v1","addr":"172.21.15.72:6818","nonce":3889813953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":3889813953},{"type":"v1","addr":"172.21.15.72:6821","nonce":3889813953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":3889813953},{"type":"v1","addr":"172.21.15.72:6826","nonce":3889813953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":3889813953},{"type":"v1","addr":"172.21.15.72:6823","nonce":3889813953}]},"public_addr":"172.21.15.72:6818/3889813953","cluster_addr":"172.21.15.72:6821/3889813953","heartbeat_back_addr":"172.21.15.72:6826/3889813953","heartbeat_front_addr":"172.21.15.72:6823/3889813953","state":["exists","up"]},{"osd":1,"uuid":"1b3f7ab2-a56c-488d-a89a-1f3572361c95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":3101663154},{"type":"v1","addr":"172.21.15.72:6801","nonce":3101663154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":3101663154},{"type":"v1","addr":"172.21.15.72:6803","nonce":3101663154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":3101663154},{"type":"v1","addr":"172.21.15.72:6807","nonce":3101663154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":3101663154},{"type":"v1","addr":"172.21.15.72:6805","nonce":3101663154}]},"public_addr":"172.21.15.72:6801/3101663154","cluster_addr":"172.21.15.72:6803/3101663154","heartbeat_back_addr":"172.21.15.72:6807/3101663154","heartbeat_front_addr":"172.21.15.72:6805/3101663154","state":["exists","up"]},{"osd":2,"uuid":"fc9aa512-53df-40d7-ba04-3e6b7dcd1e34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":235374192},{"type":"v1","addr":"172.21.15.72:6809","nonce":235374192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":235374192},{"type":"v1","addr":"172.21.15.72:6811","nonce":235374192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":235374192},{"type":"v1","addr":"172.21.15.72:6815","nonce":235374192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":235374192},{"type":"v1","addr":"172.21.15.72:6813","nonce":235374192}]},"public_addr":"172.21.15.72:6809/235374192","cluster_addr":"172.21.15.72:6811/235374192","heartbeat_back_addr":"172.21.15.72:6815/235374192","heartbeat_front_addr":"172.21.15.72:6813/235374192","state":["exists","up"]},{"osd":3,"uuid":"b4f63eed-dc5b-4aba-bb50-de46eb41492b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6817","nonce":2806631742},{"type":"v1","addr":"172.21.15.72:6819","nonce":2806631742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":2806631742},{"type":"v1","addr":"172.21.15.72:6827","nonce":2806631742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":2806631742},{"type":"v1","addr":"172.21.15.72:6831","nonce":2806631742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":2806631742},{"type":"v1","addr":"172.21.15.72:6829","nonce":2806631742}]},"public_addr":"172.21.15.72:6819/2806631742","cluster_addr":"172.21.15.72:6827/2806631742","heartbeat_back_addr":"172.21.15.72:6831/2806631742","heartbeat_front_addr":"172.21.15.72:6829/2806631742","state":["exists","up"]},{"osd":4,"uuid":"9e985ef8-d711-4172-9286-c54e560895d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":4293536423},{"type":"v1","addr":"172.21.15.117:6825","nonce":4293536423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":4293536423},{"type":"v1","addr":"172.21.15.117:6827","nonce":4293536423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":4293536423},{"type":"v1","addr":"172.21.15.117:6831","nonce":4293536423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":4293536423},{"type":"v1","addr":"172.21.15.117:6829","nonce":4293536423}]},"public_addr":"172.21.15.117:6825/4293536423","cluster_addr":"172.21.15.117:6827/4293536423","heartbeat_back_addr":"172.21.15.117:6831/4293536423","heartbeat_front_addr":"172.21.15.117:6829/4293536423","state":["exists","up"]},{"osd":5,"uuid":"3e9f082b-8d7d-455f-8a96-66d0b4857125","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":684971679},{"type":"v1","addr":"172.21.15.117:6801","nonce":684971679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":684971679},{"type":"v1","addr":"172.21.15.117:6803","nonce":684971679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":684971679},{"type":"v1","addr":"172.21.15.117:6807","nonce":684971679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":684971679},{"type":"v1","addr":"172.21.15.117:6805","nonce":684971679}]},"public_addr":"172.21.15.117:6801/684971679","cluster_addr":"172.21.15.117:6803/684971679","heartbeat_back_addr":"172.21.15.117:6807/684971679","heartbeat_front_addr":"172.21.15.117:6805/684971679","state":["exists","up"]},{"osd":6,"uuid":"bcdafa9f-a870-4398-a38d-ab7697676473","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":2781186528},{"type":"v1","addr":"172.21.15.117:6809","nonce":2781186528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":2781186528},{"type":"v1","addr":"172.21.15.117:6811","nonce":2781186528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":2781186528},{"type":"v1","addr":"172.21.15.117:6815","nonce":2781186528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":2781186528},{"type":"v1","addr":"172.21.15.117:6813","nonce":2781186528}]},"public_addr":"172.21.15.117:6809/2781186528","cluster_addr":"172.21.15.117:6811/2781186528","heartbeat_back_addr":"172.21.15.117:6815/2781186528","heartbeat_front_addr":"172.21.15.117:6813/2781186528","state":["exists","up"]},{"osd":7,"uuid":"b68ec562-ff35-4d2d-a733-c896f8920cfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":617469882},{"type":"v1","addr":"172.21.15.117:6817","nonce":617469882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":617469882},{"type":"v1","addr":"172.21.15.117:6819","nonce":617469882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":617469882},{"type":"v1","addr":"172.21.15.117:6823","nonce":617469882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":617469882},{"type":"v1","addr":"172.21.15.117:6821","nonce":617469882}]},"public_addr":"172.21.15.117:6817/617469882","cluster_addr":"172.21.15.117:6819/617469882","heartbeat_back_addr":"172.21.15.117:6823/617469882","heartbeat_front_addr":"172.21.15.117:6821/617469882","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.347700+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.296619+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.361345+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.093323+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:12.857605+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:12.816090+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.083163+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.121639+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-04T16:33:42.565 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:42.566+0000 7fda82800640 1 -- 172.21.15.72:0/3846443933 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fda5806c940 msgr2=0x7fda5806ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:42.565 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:42.566+0000 7fda82800640 1 --2- 172.21.15.72:0/3846443933 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fda5806c940 0x7fda5806ee00 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7fda6c00b340 tx=0x7fda6c034000 comp rx=0 tx=0).stop 2024-04-04T16:33:42.565 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:42.566+0000 7fda82800640 1 -- 172.21.15.72:0/3846443933 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fda7c0af790 msgr2=0x7fda7c0b5120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:42.566 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:42.566+0000 7fda82800640 1 --2- 172.21.15.72:0/3846443933 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fda7c0af790 0x7fda7c0b5120 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fda640107b0 tx=0x7fda64010c70 comp rx=0 tx=0).stop 2024-04-04T16:33:42.566 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:42.567+0000 7fda82800640 1 -- 172.21.15.72:0/3846443933 shutdown_connections 2024-04-04T16:33:42.566 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:42.567+0000 7fda82800640 1 --2- 172.21.15.72:0/3846443933 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fda5806c940 0x7fda5806ee00 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:42.566 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:42.567+0000 7fda82800640 1 --2- 172.21.15.72:0/3846443933 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fda7c15b750 0x7fda7c0b3e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:42.566 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:42.567+0000 7fda82800640 1 --2- 172.21.15.72:0/3846443933 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fda7c0af790 0x7fda7c0b5120 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:42.566 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:42.567+0000 7fda82800640 1 --2- 172.21.15.72:0/3846443933 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fda7c0af3b0 0x7fda7c0cd190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:42.566 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:42.567+0000 7fda82800640 1 -- 172.21.15.72:0/3846443933 >> 172.21.15.72:0/3846443933 conn(0x7fda7c071b50 msgr2=0x7fda7c0d0040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T16:33:42.566 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:42.568+0000 7fda82800640 1 -- 172.21.15.72:0/3846443933 shutdown_connections 2024-04-04T16:33:42.566 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:42.568+0000 7fda82800640 1 -- 172.21.15.72:0/3846443933 wait complete. 2024-04-04T16:33:42.594 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-04T16:33:42.879 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:42.881+0000 7f8a57000640 1 Processor -- start 2024-04-04T16:33:42.879 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:42.881+0000 7f8a57000640 1 -- start start 2024-04-04T16:33:42.880 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:42.882+0000 7f8a57000640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f8a5015bfd0 0x7f8a500c4ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:42.880 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:42.883+0000 7f8a57000640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8a5015f9d0 0x7f8a500cf7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:42.880 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:42.883+0000 7f8a57000640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a500af4a0 con 0x7f8a5015c3b0 2024-04-04T16:33:42.881 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:42.883+0000 7f8a57000640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f8a500af780 con 0x7f8a5015f9d0 2024-04-04T16:33:42.881 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:42.883+0000 7f8a57000640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f8a500732b0 con 0x7f8a5015bfd0 2024-04-04T16:33:42.881 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:42.883+0000 7f8a4f400640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8a5015f9d0 0x7f8a500cf7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:42.881 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:42.883+0000 7f8a4fe00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f8a5015bfd0 0x7f8a500c4ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:42.881 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:42.883+0000 7f8a4fe00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f8a5015bfd0 0x7f8a500c4ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.72:60050/0 (socket says 172.21.15.72:60050) 2024-04-04T16:33:42.881 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:42.883+0000 7f8a4fe00640 1 -- 172.21.15.72:0/1817444171 learned_addr learned my addr 172.21.15.72:0/1817444171 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T16:33:42.881 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:42.883+0000 7f8a4f400640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8a5015f9d0 0x7f8a500cf7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:55798/0 (socket says 172.21.15.72:55798) 2024-04-04T16:33:42.882 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:42.884+0000 7f8a4fe00640 1 -- 172.21.15.72:0/1817444171 >> v2:172.21.15.72:3300/0 conn(0x7f8a5015f9d0 msgr2=0x7f8a500cf7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T16:33:42.882 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:42.884+0000 7f8a4fe00640 1 --2- 172.21.15.72:0/1817444171 >> v2:172.21.15.72:3300/0 conn(0x7f8a5015f9d0 0x7f8a500cf7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:42.882 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:42.884+0000 7f8a4fe00640 1 -- 172.21.15.72:0/1817444171 >> v1:172.21.15.117:6789/0 conn(0x7f8a5015c3b0 legacy=0x7f8a500ccb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T16:33:42.882 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:42.884+0000 7f8a4fe00640 1 -- 172.21.15.72:0/1817444171 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a50073590 con 0x7f8a5015bfd0 2024-04-04T16:33:42.882 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:42.884+0000 7f8a4f400640 1 --2- 172.21.15.72:0/1817444171 >> v2:172.21.15.72:3300/0 conn(0x7f8a5015f9d0 0x7f8a500cf7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-04T16:33:42.883 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:42.886+0000 7f8a4fe00640 1 --2- 172.21.15.72:0/1817444171 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8a5015bfd0 0x7f8a500c4ff0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f8a500718f0 tx=0x7f8a4002b7f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e91dfa08b9a06136 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T16:33:42.884 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:42.887+0000 7f8a4ea00640 1 -- 172.21.15.72:0/1817444171 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a40038070 con 0x7f8a5015bfd0 2024-04-04T16:33:42.884 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:42.887+0000 7f8a4ea00640 1 -- 172.21.15.72:0/1817444171 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a4002f050 con 0x7f8a5015bfd0 2024-04-04T16:33:42.884 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:42.887+0000 7f8a4ea00640 1 -- 172.21.15.72:0/1817444171 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a40031970 con 0x7f8a5015bfd0 2024-04-04T16:33:42.885 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:42.888+0000 7f8a57000640 1 -- 172.21.15.72:0/1817444171 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8a5015bfd0 msgr2=0x7f8a500c4ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:42.885 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:42.888+0000 7f8a57000640 1 --2- 172.21.15.72:0/1817444171 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8a5015bfd0 0x7f8a500c4ff0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f8a500718f0 tx=0x7f8a4002b7f0 comp rx=0 tx=0).stop 2024-04-04T16:33:42.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:42.891+0000 7f8a57000640 1 -- 172.21.15.72:0/1817444171 shutdown_connections 2024-04-04T16:33:42.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:42.891+0000 7f8a57000640 1 --2- 172.21.15.72:0/1817444171 >> v2:172.21.15.72:3300/0 conn(0x7f8a5015f9d0 0x7f8a500cf7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:42.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:42.891+0000 7f8a57000640 1 --2- 172.21.15.72:0/1817444171 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8a5015bfd0 0x7f8a500c4ff0 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:42.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:42.891+0000 7f8a57000640 1 -- 172.21.15.72:0/1817444171 >> 172.21.15.72:0/1817444171 conn(0x7f8a50071b50 msgr2=0x7f8a50072a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T16:33:42.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:42.892+0000 7f8a57000640 1 -- 172.21.15.72:0/1817444171 shutdown_connections 2024-04-04T16:33:42.893 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:42.892+0000 7f8a57000640 1 -- 172.21.15.72:0/1817444171 wait complete. 2024-04-04T16:33:42.893 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:42.894+0000 7f8a57000640 1 Processor -- start 2024-04-04T16:33:42.893 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:42.894+0000 7f8a57000640 1 -- start start 2024-04-04T16:33:42.894 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:42.896+0000 7f8a57000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8a5015bfd0 0x7f8a5006f370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:42.896 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:42.896+0000 7f8a57000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8a5015c3b0 0x7f8a5014f970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:42.896 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:42.896+0000 7f8a57000640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8a5015f9d0 0x7f8a5015db20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:42.896 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:42.896+0000 7f8a57000640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f8a500cfe80 con 0x7f8a5015f9d0 2024-04-04T16:33:42.897 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:42.896+0000 7f8a57000640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f8a500cfd00 con 0x7f8a5015c3b0 2024-04-04T16:33:42.897 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:42.896+0000 7f8a57000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f8a500cd220 con 0x7f8a5015bfd0 2024-04-04T16:33:42.897 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:42.898+0000 7f8a4fe00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8a5015bfd0 0x7f8a5006f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:42.897 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:42.898+0000 7f8a4fe00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8a5015bfd0 0x7f8a5006f370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.72:54024/0 (socket says 172.21.15.72:54024) 2024-04-04T16:33:42.897 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:42.898+0000 7f8a4fe00640 1 -- 172.21.15.72:0/189583121 learned_addr learned my addr 172.21.15.72:0/189583121 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T16:33:42.897 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:42.898+0000 7f8a55000640 1 --2- 172.21.15.72:0/189583121 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8a5015f9d0 0x7f8a5015db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:42.897 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:42.899+0000 7f8a4f400640 1 --2- 172.21.15.72:0/189583121 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8a5015c3b0 0x7f8a5014f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:42.897 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:42.899+0000 7f8a55000640 1 -- 172.21.15.72:0/189583121 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8a5015bfd0 msgr2=0x7f8a5006f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:42.898 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:42.899+0000 7f8a55000640 1 --2- 172.21.15.72:0/189583121 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8a5015bfd0 0x7f8a5006f370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:42.898 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:42.899+0000 7f8a55000640 1 -- 172.21.15.72:0/189583121 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8a5015c3b0 msgr2=0x7f8a5014f970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:42.898 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:42.899+0000 7f8a55000640 1 --2- 172.21.15.72:0/189583121 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8a5015c3b0 0x7f8a5014f970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:42.898 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:42.899+0000 7f8a55000640 1 -- 172.21.15.72:0/189583121 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a5014c570 con 0x7f8a5015f9d0 2024-04-04T16:33:42.898 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:42.900+0000 7f8a55000640 1 --2- 172.21.15.72:0/189583121 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8a5015f9d0 0x7f8a5015db20 secure :-1 s=READY pgs=2156 cs=0 l=1 rev1=1 crypto rx=0x7f8a3c00c410 tx=0x7f8a3c00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T16:33:42.898 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:42.901+0000 7f8a47e00640 1 -- 172.21.15.72:0/189583121 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a3c011790 con 0x7f8a5015f9d0 2024-04-04T16:33:42.899 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:42.901+0000 7f8a47e00640 1 -- 172.21.15.72:0/189583121 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a3c017070 con 0x7f8a5015f9d0 2024-04-04T16:33:42.899 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:42.901+0000 7f8a47e00640 1 -- 172.21.15.72:0/189583121 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a3c011bb0 con 0x7f8a5015f9d0 2024-04-04T16:33:42.899 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:42.901+0000 7f8a57000640 1 -- 172.21.15.72:0/189583121 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a500ca120 con 0x7f8a5015f9d0 2024-04-04T16:33:42.901 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:42.902+0000 7f8a57000640 1 -- 172.21.15.72:0/189583121 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a501503a0 con 0x7f8a5015f9d0 2024-04-04T16:33:42.902 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:42.904+0000 7f8a57000640 1 -- 172.21.15.72:0/189583121 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a5014c380 con 0x7f8a5015f9d0 2024-04-04T16:33:42.902 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:42.905+0000 7f8a47e00640 1 -- 172.21.15.72:0/189583121 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8a3c01c460 con 0x7f8a5015f9d0 2024-04-04T16:33:42.905 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:42.907+0000 7f8a47e00640 1 --2- 172.21.15.72:0/189583121 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f8a3006c8f0 0x7f8a3006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:42.905 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:42.907+0000 7f8a47e00640 1 -- 172.21.15.72:0/189583121 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f8a3c08af00 con 0x7f8a5015f9d0 2024-04-04T16:33:42.905 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:42.908+0000 7f8a4fe00640 1 --2- 172.21.15.72:0/189583121 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f8a3006c8f0 0x7f8a3006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:42.906 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:42.908+0000 7f8a4fe00640 1 --2- 172.21.15.72:0/189583121 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f8a3006c8f0 0x7f8a3006edb0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f8a40009630 tx=0x7f8a40008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T16:33:42.919 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:42.922+0000 7f8a47e00640 1 -- 172.21.15.72:0/189583121 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f8a3c059480 con 0x7f8a5015f9d0 2024-04-04T16:33:43.356 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:43.358+0000 7f8a57000640 1 -- 172.21.15.72:0/189583121 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f8a5014c740 con 0x7f8a5015f9d0 2024-04-04T16:33:43.444 INFO:tasks.ceph.mon.a.smithi072.stderr:2024-04-04T16:33:43.446+0000 7fd332800640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-04T16:33:43.477 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:43.476+0000 7f8a47e00640 1 -- 172.21.15.72:0/189583121 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v18) ==== 161+0+0 (secure 0 0 0) 0x7f8a3c058d80 con 0x7f8a5015f9d0 2024-04-04T16:33:43.477 INFO:teuthology.orchestra.run.smithi072.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-04T16:33:43.481 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:43.483+0000 7f8a57000640 1 -- 172.21.15.72:0/189583121 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f8a3006c8f0 msgr2=0x7f8a3006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:43.482 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:43.483+0000 7f8a57000640 1 --2- 172.21.15.72:0/189583121 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f8a3006c8f0 0x7f8a3006edb0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f8a40009630 tx=0x7f8a40008030 comp rx=0 tx=0).stop 2024-04-04T16:33:43.482 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:43.483+0000 7f8a57000640 1 -- 172.21.15.72:0/189583121 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8a5015f9d0 msgr2=0x7f8a5015db20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:43.482 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:43.483+0000 7f8a57000640 1 --2- 172.21.15.72:0/189583121 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8a5015f9d0 0x7f8a5015db20 secure :-1 s=READY pgs=2156 cs=0 l=1 rev1=1 crypto rx=0x7f8a3c00c410 tx=0x7f8a3c00c8d0 comp rx=0 tx=0).stop 2024-04-04T16:33:43.482 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:43.484+0000 7f8a57000640 1 -- 172.21.15.72:0/189583121 shutdown_connections 2024-04-04T16:33:43.482 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:43.484+0000 7f8a57000640 1 --2- 172.21.15.72:0/189583121 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f8a3006c8f0 0x7f8a3006edb0 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:43.482 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:43.484+0000 7f8a57000640 1 --2- 172.21.15.72:0/189583121 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8a5015f9d0 0x7f8a5015db20 unknown :-1 s=CLOSED pgs=2156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:43.483 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:43.484+0000 7f8a57000640 1 --2- 172.21.15.72:0/189583121 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8a5015c3b0 0x7f8a5014f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:43.483 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:43.484+0000 7f8a57000640 1 --2- 172.21.15.72:0/189583121 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8a5015bfd0 0x7f8a5006f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:43.483 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:43.484+0000 7f8a57000640 1 -- 172.21.15.72:0/189583121 >> 172.21.15.72:0/189583121 conn(0x7f8a50071b50 msgr2=0x7f8a500ce030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T16:33:43.487 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:43.489+0000 7f8a57000640 1 -- 172.21.15.72:0/189583121 shutdown_connections 2024-04-04T16:33:43.487 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:43.489+0000 7f8a57000640 1 -- 172.21.15.72:0/189583121 wait complete. 2024-04-04T16:33:43.508 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-04T16:33:43.681 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:43.683+0000 7f7e1a000640 1 Processor -- start 2024-04-04T16:33:43.681 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:43.683+0000 7f7e1a000640 1 -- start start 2024-04-04T16:33:43.684 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:43.684+0000 7f7e1a000640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f7e1415afb0 0x7f7e14071e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:43.685 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:43.684+0000 7f7e1a000640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f7e1415b390 0x7f7e140cdd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:43.685 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:43.685+0000 7f7e1a000640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7e1415ece0 con 0x7f7e140cf360 2024-04-04T16:33:43.685 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:43.685+0000 7f7e1a000640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f7e14072350 con 0x7f7e1415afb0 2024-04-04T16:33:43.685 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:43.685+0000 7f7e1a000640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f7e1415efa0 con 0x7f7e1415b390 2024-04-04T16:33:43.685 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:43.685+0000 7f7e12a00640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f7e140cf360 0x7f7e140726e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:60064/0 (socket says 172.21.15.72:60064) 2024-04-04T16:33:43.685 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:43.685+0000 7f7e13400640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f7e1415afb0 0x7f7e14071e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:43.685 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:43.685+0000 7f7e12a00640 1 -- 172.21.15.72:0/3154699202 learned_addr learned my addr 172.21.15.72:0/3154699202 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-04-04T16:33:43.686 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:43.685+0000 7f7e13e00640 1 --2- 172.21.15.72:0/3154699202 >> v2:172.21.15.117:3300/0 conn(0x7f7e1415b390 0x7f7e140cdd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:43.686 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:43.685+0000 7f7e13400640 1 -- 172.21.15.72:0/3154699202 >> v2:172.21.15.117:3300/0 conn(0x7f7e1415b390 msgr2=0x7f7e140cdd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T16:33:43.686 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:43.685+0000 7f7e13400640 1 --2- 172.21.15.72:0/3154699202 >> v2:172.21.15.117:3300/0 conn(0x7f7e1415b390 0x7f7e140cdd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:43.686 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:43.685+0000 7f7e13400640 1 -- 172.21.15.72:0/3154699202 >> v1:172.21.15.72:6789/0 conn(0x7f7e140cf360 legacy=0x7f7e140726e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:43.686 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:43.685+0000 7f7e13400640 1 -- 172.21.15.72:0/3154699202 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e1415f280 con 0x7f7e1415afb0 2024-04-04T16:33:43.686 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:43.685+0000 7f7e12000640 1 -- 172.21.15.72:0/3154699202 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4264090529 0 0) 0x7f7e1415ece0 con 0x7f7e140cf360 2024-04-04T16:33:43.687 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:43.686+0000 7f7e13400640 1 --2- 172.21.15.72:0/3154699202 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7e1415afb0 0x7f7e14071e10 secure :-1 s=READY pgs=2158 cs=0 l=1 rev1=1 crypto rx=0x7f7e14073870 tx=0x7f7e0402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be4980931e0d7584 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T16:33:43.687 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:43.687+0000 7f7e12000640 1 -- 172.21.15.72:0/3154699202 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e040315a0 con 0x7f7e1415afb0 2024-04-04T16:33:43.687 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:43.687+0000 7f7e12000640 1 -- 172.21.15.72:0/3154699202 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e04037070 con 0x7f7e1415afb0 2024-04-04T16:33:43.687 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:43.687+0000 7f7e12000640 1 -- 172.21.15.72:0/3154699202 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e04031960 con 0x7f7e1415afb0 2024-04-04T16:33:43.693 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:43.687+0000 7f7e1a000640 1 -- 172.21.15.72:0/3154699202 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7e1415afb0 msgr2=0x7f7e14071e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:43.693 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:43.687+0000 7f7e1a000640 1 --2- 172.21.15.72:0/3154699202 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7e1415afb0 0x7f7e14071e10 secure :-1 s=READY pgs=2158 cs=0 l=1 rev1=1 crypto rx=0x7f7e14073870 tx=0x7f7e0402b840 comp rx=0 tx=0).stop 2024-04-04T16:33:43.693 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:43.687+0000 7f7e1a000640 1 -- 172.21.15.72:0/3154699202 shutdown_connections 2024-04-04T16:33:43.693 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:43.687+0000 7f7e1a000640 1 --2- 172.21.15.72:0/3154699202 >> v2:172.21.15.117:3300/0 conn(0x7f7e1415b390 0x7f7e140cdd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:43.694 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:43.687+0000 7f7e1a000640 1 --2- 172.21.15.72:0/3154699202 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7e1415afb0 0x7f7e14071e10 unknown :-1 s=CLOSED pgs=2158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:43.694 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:43.687+0000 7f7e1a000640 1 -- 172.21.15.72:0/3154699202 >> 172.21.15.72:0/3154699202 conn(0x7f7e1406b470 msgr2=0x7f7e1406b850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T16:33:43.694 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:43.687+0000 7f7e1a000640 1 -- 172.21.15.72:0/3154699202 shutdown_connections 2024-04-04T16:33:43.694 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:43.687+0000 7f7e1a000640 1 -- 172.21.15.72:0/3154699202 wait complete. 2024-04-04T16:33:43.694 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:43.689+0000 7f7e1a000640 1 Processor -- start 2024-04-04T16:33:43.694 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:43.689+0000 7f7e1a000640 1 -- start start 2024-04-04T16:33:43.695 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:43.690+0000 7f7e1a000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7e140cf360 0x7f7e140ce170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:43.695 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:43.690+0000 7f7e1a000640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7e1415afb0 0x7f7e140ce6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:43.695 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:43.690+0000 7f7e1a000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7e1415b390 0x7f7e14154520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:43.695 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:43.690+0000 7f7e1a000640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f7e1415fb20 con 0x7f7e1415afb0 2024-04-04T16:33:43.695 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:43.690+0000 7f7e1a000640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f7e1415f840 con 0x7f7e1415b390 2024-04-04T16:33:43.695 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:43.690+0000 7f7e1a000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f7e140b2fd0 con 0x7f7e140cf360 2024-04-04T16:33:43.696 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:43.690+0000 7f7e12a00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7e1415afb0 0x7f7e140ce6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:43.696 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:43.690+0000 7f7e12a00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7e1415afb0 0x7f7e140ce6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:55812/0 (socket says 172.21.15.72:55812) 2024-04-04T16:33:43.696 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:43.690+0000 7f7e12a00640 1 -- 172.21.15.72:0/1115212657 learned_addr learned my addr 172.21.15.72:0/1115212657 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T16:33:43.696 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:43.690+0000 7f7e13400640 1 --2- 172.21.15.72:0/1115212657 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7e140cf360 0x7f7e140ce170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:43.696 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:43.691+0000 7f7e13e00640 1 --2- 172.21.15.72:0/1115212657 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7e1415b390 0x7f7e14154520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:43.696 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:43.691+0000 7f7e12a00640 1 -- 172.21.15.72:0/1115212657 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7e140cf360 msgr2=0x7f7e140ce170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:43.697 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:43.691+0000 7f7e12a00640 1 --2- 172.21.15.72:0/1115212657 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7e140cf360 0x7f7e140ce170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:43.697 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:43.691+0000 7f7e12a00640 1 -- 172.21.15.72:0/1115212657 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7e1415b390 msgr2=0x7f7e14154520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:43.697 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:43.691+0000 7f7e12a00640 1 --2- 172.21.15.72:0/1115212657 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7e1415b390 0x7f7e14154520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:43.697 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:43.691+0000 7f7e12a00640 1 -- 172.21.15.72:0/1115212657 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e14155120 con 0x7f7e1415afb0 2024-04-04T16:33:43.697 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:43.691+0000 7f7e13e00640 1 --2- 172.21.15.72:0/1115212657 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7e1415b390 0x7f7e14154520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-04T16:33:43.697 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:43.691+0000 7f7e12a00640 1 --2- 172.21.15.72:0/1115212657 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7e1415afb0 0x7f7e140ce6b0 secure :-1 s=READY pgs=2159 cs=0 l=1 rev1=1 crypto rx=0x7f7e0000c4a0 tx=0x7f7e0000c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T16:33:43.698 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:43.691+0000 7f7e0b400640 1 -- 172.21.15.72:0/1115212657 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e00018070 con 0x7f7e1415afb0 2024-04-04T16:33:43.698 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:43.691+0000 7f7e0b400640 1 -- 172.21.15.72:0/1115212657 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e000074e0 con 0x7f7e1415afb0 2024-04-04T16:33:43.698 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:43.691+0000 7f7e0b400640 1 -- 172.21.15.72:0/1115212657 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e00004a20 con 0x7f7e1415afb0 2024-04-04T16:33:43.698 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:43.691+0000 7f7e1a000640 1 -- 172.21.15.72:0/1115212657 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e14155400 con 0x7f7e1415afb0 2024-04-04T16:33:43.698 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:43.692+0000 7f7e1a000640 1 -- 172.21.15.72:0/1115212657 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e141559c0 con 0x7f7e1415afb0 2024-04-04T16:33:43.698 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:43.693+0000 7f7e1a000640 1 -- 172.21.15.72:0/1115212657 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e14075730 con 0x7f7e1415afb0 2024-04-04T16:33:43.699 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:43.694+0000 7f7e0b400640 1 -- 172.21.15.72:0/1115212657 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7e00004bc0 con 0x7f7e1415afb0 2024-04-04T16:33:43.699 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:43.694+0000 7f7e0b400640 1 --2- 172.21.15.72:0/1115212657 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f7df406c8f0 0x7f7df406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:43.699 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:43.695+0000 7f7e0b400640 1 -- 172.21.15.72:0/1115212657 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5795+0+0 (secure 0 0 0) 0x7f7e0008aeb0 con 0x7f7e1415afb0 2024-04-04T16:33:43.699 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:43.695+0000 7f7e13400640 1 --2- 172.21.15.72:0/1115212657 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f7df406c8f0 0x7f7df406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:43.699 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:43.695+0000 7f7e13400640 1 --2- 172.21.15.72:0/1115212657 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f7df406c8f0 0x7f7df406edb0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f7e04036000 tx=0x7f7e0403d040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T16:33:43.700 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:43.699+0000 7f7e0b400640 1 -- 172.21.15.72:0/1115212657 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f7e00058b00 con 0x7f7e1415afb0 2024-04-04T16:33:43.923 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:43.925+0000 7f7e1a000640 1 -- 172.21.15.72:0/1115212657 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f7e1415ece0 con 0x7f7e1415afb0 2024-04-04T16:33:43.956 INFO:tasks.ceph.mds.a.smithi072.stdout:starting mds.a at 2024-04-04T16:33:44.534 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:44.536+0000 7f7e0b400640 1 -- 172.21.15.72:0/1115212657 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v19) ==== 104+0+0 (secure 0 0 0) 0x7f7e0005ce00 con 0x7f7e1415afb0 2024-04-04T16:33:44.537 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:44.539+0000 7f7e1a000640 1 -- 172.21.15.72:0/1115212657 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f7df406c8f0 msgr2=0x7f7df406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:44.537 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:44.539+0000 7f7e1a000640 1 --2- 172.21.15.72:0/1115212657 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f7df406c8f0 0x7f7df406edb0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f7e04036000 tx=0x7f7e0403d040 comp rx=0 tx=0).stop 2024-04-04T16:33:44.537 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:44.539+0000 7f7e1a000640 1 -- 172.21.15.72:0/1115212657 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7e1415afb0 msgr2=0x7f7e140ce6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:44.537 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:44.539+0000 7f7e1a000640 1 --2- 172.21.15.72:0/1115212657 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7e1415afb0 0x7f7e140ce6b0 secure :-1 s=READY pgs=2159 cs=0 l=1 rev1=1 crypto rx=0x7f7e0000c4a0 tx=0x7f7e0000c960 comp rx=0 tx=0).stop 2024-04-04T16:33:44.537 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:44.539+0000 7f7e1a000640 1 -- 172.21.15.72:0/1115212657 shutdown_connections 2024-04-04T16:33:44.537 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:44.539+0000 7f7e1a000640 1 --2- 172.21.15.72:0/1115212657 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f7df406c8f0 0x7f7df406edb0 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:44.537 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:44.539+0000 7f7e1a000640 1 --2- 172.21.15.72:0/1115212657 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7e1415b390 0x7f7e14154520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:44.537 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:44.539+0000 7f7e1a000640 1 --2- 172.21.15.72:0/1115212657 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7e1415afb0 0x7f7e140ce6b0 unknown :-1 s=CLOSED pgs=2159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:44.537 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:44.539+0000 7f7e1a000640 1 --2- 172.21.15.72:0/1115212657 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7e140cf360 0x7f7e140ce170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:44.537 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:44.539+0000 7f7e1a000640 1 -- 172.21.15.72:0/1115212657 >> 172.21.15.72:0/1115212657 conn(0x7f7e1406b470 msgr2=0x7f7e140cf760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T16:33:44.537 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:44.539+0000 7f7e1a000640 1 -- 172.21.15.72:0/1115212657 shutdown_connections 2024-04-04T16:33:44.537 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:44.539+0000 7f7e1a000640 1 -- 172.21.15.72:0/1115212657 wait complete. 2024-04-04T16:33:44.556 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-04T16:33:44.758 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:44.760+0000 7eff89600640 1 Processor -- start 2024-04-04T16:33:44.758 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:44.760+0000 7eff89600640 1 -- start start 2024-04-04T16:33:44.759 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:44.761+0000 7eff89600640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7eff840cf280 0x7eff840cec30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:44.759 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:44.761+0000 7eff89600640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff840d2d10 con 0x7eff840cf660 2024-04-04T16:33:44.759 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:44.761+0000 7eff89600640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff840d2ff0 con 0x7eff8415e860 2024-04-04T16:33:44.759 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:44.761+0000 7eff89600640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7eff840d3920 con 0x7eff840cf280 2024-04-04T16:33:44.760 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:44.762+0000 7eff88c00640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7eff840cf660 0x7eff840b7a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:60066/0 (socket says 172.21.15.72:60066) 2024-04-04T16:33:44.760 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:44.762+0000 7eff83e00640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7eff840cf280 0x7eff840cec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:44.760 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:44.762+0000 7eff88c00640 1 -- 172.21.15.72:0/1981406487 learned_addr learned my addr 172.21.15.72:0/1981406487 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-04-04T16:33:44.760 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:44.762+0000 7eff83e00640 1 -- 172.21.15.72:0/1981406487 >> v1:172.21.15.117:6789/0 conn(0x7eff8415e860 legacy=0x7eff840d2550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:44.761 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:44.762+0000 7eff83e00640 1 -- 172.21.15.72:0/1981406487 >> v1:172.21.15.72:6789/0 conn(0x7eff840cf660 legacy=0x7eff840b7a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:44.761 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:44.762+0000 7eff83e00640 1 -- 172.21.15.72:0/1981406487 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff840d32d0 con 0x7eff840cf280 2024-04-04T16:33:44.761 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:44.763+0000 7eff83e00640 1 --2- 172.21.15.72:0/1981406487 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7eff840cf280 0x7eff840cec30 secure :-1 s=READY pgs=2162 cs=0 l=1 rev1=1 crypto rx=0x7eff740097a0 tx=0x7eff7402b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b2e11abce5d31c9 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T16:33:44.761 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:44.764+0000 7eff82a00640 1 -- 172.21.15.72:0/1981406487 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff74034070 con 0x7eff840cf280 2024-04-04T16:33:44.762 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:44.764+0000 7eff82a00640 1 -- 172.21.15.72:0/1981406487 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff74030610 con 0x7eff840cf280 2024-04-04T16:33:44.762 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:44.764+0000 7eff82a00640 1 -- 172.21.15.72:0/1981406487 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff740309e0 con 0x7eff840cf280 2024-04-04T16:33:44.762 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:44.764+0000 7eff89600640 1 -- 172.21.15.72:0/1981406487 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7eff840cf280 msgr2=0x7eff840cec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:44.763 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:44.764+0000 7eff89600640 1 --2- 172.21.15.72:0/1981406487 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7eff840cf280 0x7eff840cec30 secure :-1 s=READY pgs=2162 cs=0 l=1 rev1=1 crypto rx=0x7eff740097a0 tx=0x7eff7402b960 comp rx=0 tx=0).stop 2024-04-04T16:33:44.763 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:44.764+0000 7eff89600640 1 -- 172.21.15.72:0/1981406487 shutdown_connections 2024-04-04T16:33:44.763 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:44.764+0000 7eff89600640 1 --2- 172.21.15.72:0/1981406487 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7eff840cf280 0x7eff840cec30 unknown :-1 s=CLOSED pgs=2162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:44.763 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:44.764+0000 7eff89600640 1 -- 172.21.15.72:0/1981406487 >> 172.21.15.72:0/1981406487 conn(0x7eff8406b860 msgr2=0x7eff8406bc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T16:33:44.763 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:44.765+0000 7eff89600640 1 -- 172.21.15.72:0/1981406487 shutdown_connections 2024-04-04T16:33:44.763 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:44.765+0000 7eff89600640 1 -- 172.21.15.72:0/1981406487 wait complete. 2024-04-04T16:33:44.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:44.766+0000 7eff89600640 1 Processor -- start 2024-04-04T16:33:44.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:44.766+0000 7eff89600640 1 -- start start 2024-04-04T16:33:44.766 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:44.767+0000 7eff89600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7eff840cf280 0x7eff8415ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:44.766 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:44.767+0000 7eff89600640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7eff840cf660 0x7eff8414d750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:44.767 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:44.767+0000 7eff89600640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7eff8415e860 0x7eff84158d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:44.767 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:44.767+0000 7eff89600640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7eff840b8190 con 0x7eff840cf660 2024-04-04T16:33:44.767 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:44.767+0000 7eff89600640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7eff840cfaf0 con 0x7eff8415e860 2024-04-04T16:33:44.767 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:44.767+0000 7eff89600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7eff840b8310 con 0x7eff840cf280 2024-04-04T16:33:44.767 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:44.767+0000 7eff83400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7eff840cf660 0x7eff8414d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:44.767 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:44.767+0000 7eff83400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7eff840cf660 0x7eff8414d750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:55828/0 (socket says 172.21.15.72:55828) 2024-04-04T16:33:44.767 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:44.767+0000 7eff83400640 1 -- 172.21.15.72:0/3071952616 learned_addr learned my addr 172.21.15.72:0/3071952616 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T16:33:44.767 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:44.768+0000 7eff83e00640 1 --2- 172.21.15.72:0/3071952616 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7eff840cf280 0x7eff8415ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:44.767 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:44.768+0000 7eff88c00640 1 --2- 172.21.15.72:0/3071952616 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7eff8415e860 0x7eff84158d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:44.767 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:44.768+0000 7eff83400640 1 -- 172.21.15.72:0/3071952616 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7eff840cf280 msgr2=0x7eff8415ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:44.767 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:44.768+0000 7eff83400640 1 --2- 172.21.15.72:0/3071952616 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7eff840cf280 0x7eff8415ae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:44.767 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:44.768+0000 7eff83400640 1 -- 172.21.15.72:0/3071952616 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7eff8415e860 msgr2=0x7eff84158d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:44.768 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:44.768+0000 7eff83400640 1 --2- 172.21.15.72:0/3071952616 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7eff8415e860 0x7eff84158d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:44.768 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:44.768+0000 7eff83400640 1 -- 172.21.15.72:0/3071952616 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff8414dc90 con 0x7eff840cf660 2024-04-04T16:33:44.768 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:44.768+0000 7eff88c00640 1 --2- 172.21.15.72:0/3071952616 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7eff8415e860 0x7eff84158d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-04T16:33:44.768 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:44.768+0000 7eff83400640 1 --2- 172.21.15.72:0/3071952616 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7eff840cf660 0x7eff8414d750 secure :-1 s=READY pgs=2163 cs=0 l=1 rev1=1 crypto rx=0x7eff7000c440 tx=0x7eff7000c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T16:33:44.768 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:44.768+0000 7eff7be00640 1 -- 172.21.15.72:0/3071952616 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff700052d0 con 0x7eff840cf660 2024-04-04T16:33:44.768 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:44.768+0000 7eff7be00640 1 -- 172.21.15.72:0/3071952616 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff70005470 con 0x7eff840cf660 2024-04-04T16:33:44.768 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:44.768+0000 7eff89600640 1 -- 172.21.15.72:0/3071952616 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff84158510 con 0x7eff840cf660 2024-04-04T16:33:44.768 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:44.768+0000 7eff7be00640 1 -- 172.21.15.72:0/3071952616 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff70007260 con 0x7eff840cf660 2024-04-04T16:33:44.768 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:44.769+0000 7eff89600640 1 -- 172.21.15.72:0/3071952616 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff8415fa00 con 0x7eff840cf660 2024-04-04T16:33:44.769 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:44.770+0000 7eff89600640 1 -- 172.21.15.72:0/3071952616 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff840756c0 con 0x7eff840cf660 2024-04-04T16:33:44.769 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:44.770+0000 7eff7be00640 1 -- 172.21.15.72:0/3071952616 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7eff70007400 con 0x7eff840cf660 2024-04-04T16:33:44.769 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:44.771+0000 7eff7be00640 1 --2- 172.21.15.72:0/3071952616 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7eff6406c8f0 0x7eff6406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:44.769 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:44.771+0000 7eff7be00640 1 -- 172.21.15.72:0/3071952616 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5795+0+0 (secure 0 0 0) 0x7eff7008b0b0 con 0x7eff840cf660 2024-04-04T16:33:44.769 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:44.772+0000 7eff83e00640 1 --2- 172.21.15.72:0/3071952616 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7eff6406c8f0 0x7eff6406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:44.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:44.772+0000 7eff83e00640 1 --2- 172.21.15.72:0/3071952616 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7eff6406c8f0 0x7eff6406edb0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7eff74036000 tx=0x7eff7403b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T16:33:44.773 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:44.776+0000 7eff7be00640 1 -- 172.21.15.72:0/3071952616 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7eff700593e0 con 0x7eff840cf660 2024-04-04T16:33:44.962 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:44.964+0000 7eff89600640 1 -- 172.21.15.72:0/3071952616 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7eff840d4910 con 0x7eff840cf660 2024-04-04T16:33:45.538 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:45.540+0000 7eff7be00640 1 -- 172.21.15.72:0/3071952616 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v35) ==== 181+0+0 (secure 0 0 0) 0x7eff70058ce0 con 0x7eff840cf660 2024-04-04T16:33:45.538 INFO:teuthology.orchestra.run.smithi072.stderr:pool 'cephfs_metadata' removed 2024-04-04T16:33:45.541 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:45.542+0000 7eff89600640 1 -- 172.21.15.72:0/3071952616 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7eff6406c8f0 msgr2=0x7eff6406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:45.541 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:45.542+0000 7eff89600640 1 --2- 172.21.15.72:0/3071952616 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7eff6406c8f0 0x7eff6406edb0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7eff74036000 tx=0x7eff7403b040 comp rx=0 tx=0).stop 2024-04-04T16:33:45.541 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:45.542+0000 7eff89600640 1 -- 172.21.15.72:0/3071952616 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7eff840cf660 msgr2=0x7eff8414d750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:45.541 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:45.542+0000 7eff89600640 1 --2- 172.21.15.72:0/3071952616 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7eff840cf660 0x7eff8414d750 secure :-1 s=READY pgs=2163 cs=0 l=1 rev1=1 crypto rx=0x7eff7000c440 tx=0x7eff7000c900 comp rx=0 tx=0).stop 2024-04-04T16:33:45.541 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:45.543+0000 7eff89600640 1 -- 172.21.15.72:0/3071952616 shutdown_connections 2024-04-04T16:33:45.541 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:45.543+0000 7eff89600640 1 --2- 172.21.15.72:0/3071952616 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7eff6406c8f0 0x7eff6406edb0 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:45.541 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:45.543+0000 7eff89600640 1 --2- 172.21.15.72:0/3071952616 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7eff8415e860 0x7eff84158d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:45.541 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:45.543+0000 7eff89600640 1 --2- 172.21.15.72:0/3071952616 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7eff840cf660 0x7eff8414d750 unknown :-1 s=CLOSED pgs=2163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:45.541 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:45.543+0000 7eff89600640 1 --2- 172.21.15.72:0/3071952616 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7eff840cf280 0x7eff8415ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:45.541 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:45.543+0000 7eff89600640 1 -- 172.21.15.72:0/3071952616 >> 172.21.15.72:0/3071952616 conn(0x7eff8406b860 msgr2=0x7eff840b5d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T16:33:45.541 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:45.543+0000 7eff89600640 1 -- 172.21.15.72:0/3071952616 shutdown_connections 2024-04-04T16:33:45.541 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:45.543+0000 7eff89600640 1 -- 172.21.15.72:0/3071952616 wait complete. 2024-04-04T16:33:45.559 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-04T16:33:45.756 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:45.758+0000 7f20d7e00640 1 Processor -- start 2024-04-04T16:33:45.756 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:45.758+0000 7f20d7e00640 1 -- start start 2024-04-04T16:33:45.757 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:45.759+0000 7f20d7e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f20d815e860 0x7f20d80cec30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:45.758 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:45.759+0000 7f20d7e00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f20d80cf660 0x7f20d80b7a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:45.758 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:45.759+0000 7f20d7e00640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20d80d2d10 con 0x7f20d80cf280 2024-04-04T16:33:45.758 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:45.759+0000 7f20d7e00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f20d80d3920 con 0x7f20d80cf660 2024-04-04T16:33:45.758 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:45.759+0000 7f20d7e00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f20d80d2ff0 con 0x7f20d815e860 2024-04-04T16:33:45.758 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:45.760+0000 7f20d6a00640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f20d80cf280 0x7f20d80d2550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:60076/0 (socket says 172.21.15.72:60076) 2024-04-04T16:33:45.758 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:45.760+0000 7f20d6a00640 1 -- 172.21.15.72:0/1431442234 learned_addr learned my addr 172.21.15.72:0/1431442234 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-04-04T16:33:45.758 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:45.760+0000 7f20d7400640 1 --2- 172.21.15.72:0/1431442234 >> v2:172.21.15.117:3300/0 conn(0x7f20d80cf660 0x7f20d80b7a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:45.760 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:45.760+0000 7f20d5600640 1 -- 172.21.15.72:0/1431442234 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 725429973 0 0) 0x7f20d80d2d10 con 0x7f20d80cf280 2024-04-04T16:33:45.760 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:45.760+0000 7f20d5600640 1 -- 172.21.15.72:0/1431442234 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f20bc003520 con 0x7f20d80cf280 2024-04-04T16:33:45.760 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:45.761+0000 7f20d5600640 1 -- 172.21.15.72:0/1431442234 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3591643196 0 0) 0x7f20bc003520 con 0x7f20d80cf280 2024-04-04T16:33:45.760 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:45.761+0000 7f20d5600640 1 -- 172.21.15.72:0/1431442234 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f20d815e860 msgr2=0x7f20d80cec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T16:33:45.760 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:45.761+0000 7f20d5600640 1 --2- 172.21.15.72:0/1431442234 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f20d815e860 0x7f20d80cec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:45.760 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:45.761+0000 7f20d5600640 1 -- 172.21.15.72:0/1431442234 >> v2:172.21.15.117:3300/0 conn(0x7f20d80cf660 msgr2=0x7f20d80b7a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T16:33:45.760 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:45.761+0000 7f20d5600640 1 --2- 172.21.15.72:0/1431442234 >> v2:172.21.15.117:3300/0 conn(0x7f20d80cf660 0x7f20d80b7a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:45.760 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:45.761+0000 7f20d5600640 1 -- 172.21.15.72:0/1431442234 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20d80d32d0 con 0x7f20d80cf280 2024-04-04T16:33:45.760 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:45.761+0000 7f20d5600640 1 -- 172.21.15.72:0/1431442234 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2465650867 0 0) 0x7f20c8001670 con 0x7f20d80cf280 2024-04-04T16:33:45.760 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:45.761+0000 7f20d5600640 1 -- 172.21.15.72:0/1431442234 >> v1:172.21.15.72:6789/0 conn(0x7f20d80cf280 legacy=0x7f20d80d2550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:45.760 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:45.761+0000 7f20d5600640 1 --2- 172.21.15.72:0/1431442234 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f20d815e860 0x7f20bc0039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:45.761 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:45.761+0000 7f20d5600640 1 --2- 172.21.15.72:0/1431442234 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f20bc003f30 0x7f20bc004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:45.761 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:45.761+0000 7f20d5600640 1 --2- 172.21.15.72:0/1431442234 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f20bc004d40 0x7f20bc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:45.761 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:45.761+0000 7f20d5600640 1 -- 172.21.15.72:0/1431442234 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f20d80d2ff0 con 0x7f20bc004d40 2024-04-04T16:33:45.761 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:45.761+0000 7f20d5600640 1 -- 172.21.15.72:0/1431442234 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f20bc00ba70 con 0x7f20bc003f30 2024-04-04T16:33:45.761 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:45.761+0000 7f20d5600640 1 -- 172.21.15.72:0/1431442234 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f20bc00bc70 con 0x7f20d815e860 2024-04-04T16:33:45.761 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:45.761+0000 7f20d7400640 1 --2- 172.21.15.72:0/1431442234 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f20bc004d40 0x7f20bc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:45.761 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:45.761+0000 7f20d6a00640 1 --2- 172.21.15.72:0/1431442234 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f20d815e860 0x7f20bc0039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:45.761 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:45.761+0000 7f20d6000640 1 --2- 172.21.15.72:0/1431442234 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f20bc003f30 0x7f20bc004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:45.761 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:45.762+0000 7f20d7400640 1 -- 172.21.15.72:0/1431442234 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f20d815e860 msgr2=0x7f20bc0039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T16:33:45.761 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:45.762+0000 7f20d7400640 1 --2- 172.21.15.72:0/1431442234 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f20d815e860 0x7f20bc0039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:45.761 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:45.762+0000 7f20d7400640 1 -- 172.21.15.72:0/1431442234 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f20bc003f30 msgr2=0x7f20bc004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T16:33:45.761 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:45.762+0000 7f20d7400640 1 --2- 172.21.15.72:0/1431442234 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f20bc003f30 0x7f20bc004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:45.761 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:45.762+0000 7f20d7400640 1 -- 172.21.15.72:0/1431442234 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20bc003520 con 0x7f20bc004d40 2024-04-04T16:33:45.762 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:45.763+0000 7f20d7400640 1 --2- 172.21.15.72:0/1431442234 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f20bc004d40 0x7f20bc0051c0 secure :-1 s=READY pgs=2165 cs=0 l=1 rev1=1 crypto rx=0x7f20d0009fc0 tx=0x7f20bc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fdfe356880e00f8 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T16:33:45.763 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:45.763+0000 7f20d5600640 1 -- 172.21.15.72:0/1431442234 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20d0039070 con 0x7f20bc004d40 2024-04-04T16:33:45.763 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:45.763+0000 7f20d5600640 1 -- 172.21.15.72:0/1431442234 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20d002cc60 con 0x7f20bc004d40 2024-04-04T16:33:45.763 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:45.763+0000 7f20d5600640 1 -- 172.21.15.72:0/1431442234 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20d0009c10 con 0x7f20bc004d40 2024-04-04T16:33:45.763 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:45.764+0000 7f20d7e00640 1 -- 172.21.15.72:0/1431442234 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f20bc004d40 msgr2=0x7f20bc0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:45.763 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:45.764+0000 7f20d7e00640 1 --2- 172.21.15.72:0/1431442234 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f20bc004d40 0x7f20bc0051c0 secure :-1 s=READY pgs=2165 cs=0 l=1 rev1=1 crypto rx=0x7f20d0009fc0 tx=0x7f20bc005830 comp rx=0 tx=0).stop 2024-04-04T16:33:45.763 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:45.764+0000 7f20d7400640 1 -- 172.21.15.72:0/1431442234 reap_dead start 2024-04-04T16:33:45.763 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:45.764+0000 7f20d7e00640 1 -- 172.21.15.72:0/1431442234 shutdown_connections 2024-04-04T16:33:45.763 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:45.764+0000 7f20d7e00640 1 -- 172.21.15.72:0/1431442234 >> 172.21.15.72:0/1431442234 conn(0x7f20d806b860 msgr2=0x7f20d806bc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T16:33:45.763 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:45.764+0000 7f20d7e00640 1 -- 172.21.15.72:0/1431442234 shutdown_connections 2024-04-04T16:33:45.763 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:45.764+0000 7f20d7e00640 1 -- 172.21.15.72:0/1431442234 wait complete. 2024-04-04T16:33:45.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:45.766+0000 7f20d7e00640 1 Processor -- start 2024-04-04T16:33:45.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:45.766+0000 7f20d7e00640 1 -- start start 2024-04-04T16:33:45.766 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:45.767+0000 7f20d7e00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f20d80b3070 0x7f20d80ab730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:45.766 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:45.767+0000 7f20d7e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f20d80cd7b0 0x7f20d80ad660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:45.766 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:45.767+0000 7f20d7e00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f20d80adba0 0x7f20d8152dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:45.767 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:45.767+0000 7f20d7e00640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f20d80cec30 con 0x7f20d80adba0 2024-04-04T16:33:45.767 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:45.767+0000 7f20d7e00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f20d80cfb10 con 0x7f20d80b3070 2024-04-04T16:33:45.767 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:45.767+0000 7f20d7e00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f20d80cedb0 con 0x7f20d80cd7b0 2024-04-04T16:33:45.767 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:45.767+0000 7f20d7400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f20d80adba0 0x7f20d8152dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:45.767 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:45.767+0000 7f20d7400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f20d80adba0 0x7f20d8152dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:55834/0 (socket says 172.21.15.72:55834) 2024-04-04T16:33:45.767 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:45.767+0000 7f20d7400640 1 -- 172.21.15.72:0/1962665851 learned_addr learned my addr 172.21.15.72:0/1962665851 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T16:33:45.767 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:45.767+0000 7f20d6a00640 1 --2- 172.21.15.72:0/1962665851 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f20d80b3070 0x7f20d80ab730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:45.767 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:45.768+0000 7f20d6000640 1 --2- 172.21.15.72:0/1962665851 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f20d80cd7b0 0x7f20d80ad660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:45.767 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:45.768+0000 7f20d7400640 1 -- 172.21.15.72:0/1962665851 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f20d80cd7b0 msgr2=0x7f20d80ad660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:45.767 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:45.768+0000 7f20d7400640 1 --2- 172.21.15.72:0/1962665851 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f20d80cd7b0 0x7f20d80ad660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:45.767 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:45.768+0000 7f20d7400640 1 -- 172.21.15.72:0/1962665851 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f20d80b3070 msgr2=0x7f20d80ab730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:45.767 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:45.768+0000 7f20d7400640 1 --2- 172.21.15.72:0/1962665851 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f20d80b3070 0x7f20d80ab730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:45.767 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:45.768+0000 7f20d7400640 1 -- 172.21.15.72:0/1962665851 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20d80cdc30 con 0x7f20d80adba0 2024-04-04T16:33:45.767 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:45.768+0000 7f20d7400640 1 --2- 172.21.15.72:0/1962665851 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f20d80adba0 0x7f20d8152dc0 secure :-1 s=READY pgs=2166 cs=0 l=1 rev1=1 crypto rx=0x7f20d002c6d0 tx=0x7f20d0009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T16:33:45.768 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:45.768+0000 7f20cf400640 1 -- 172.21.15.72:0/1962665851 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20d0039040 con 0x7f20d80adba0 2024-04-04T16:33:45.768 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:45.768+0000 7f20cf400640 1 -- 172.21.15.72:0/1962665851 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20d002ca60 con 0x7f20d80adba0 2024-04-04T16:33:45.768 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:45.768+0000 7f20cf400640 1 -- 172.21.15.72:0/1962665851 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20d0009c10 con 0x7f20d80adba0 2024-04-04T16:33:45.768 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:45.768+0000 7f20d7e00640 1 -- 172.21.15.72:0/1962665851 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20d80abe30 con 0x7f20d80adba0 2024-04-04T16:33:45.768 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:45.769+0000 7f20d7e00640 1 -- 172.21.15.72:0/1962665851 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20d80ac3f0 con 0x7f20d80adba0 2024-04-04T16:33:45.768 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:45.770+0000 7f20d7e00640 1 -- 172.21.15.72:0/1962665851 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20d80756c0 con 0x7f20d80adba0 2024-04-04T16:33:45.769 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:45.770+0000 7f20cf400640 1 -- 172.21.15.72:0/1962665851 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f20d0047020 con 0x7f20d80adba0 2024-04-04T16:33:45.769 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:45.772+0000 7f20cf400640 1 --2- 172.21.15.72:0/1962665851 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f20b806c8f0 0x7f20b806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:45.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:45.772+0000 7f20cf400640 1 -- 172.21.15.72:0/1962665851 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5357+0+0 (secure 0 0 0) 0x7f20d00ad7a0 con 0x7f20d80adba0 2024-04-04T16:33:45.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:45.772+0000 7f20d6a00640 1 --2- 172.21.15.72:0/1962665851 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f20b806c8f0 0x7f20b806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:45.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:45.773+0000 7f20d6a00640 1 --2- 172.21.15.72:0/1962665851 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f20b806c8f0 0x7f20b806edb0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f20c8004840 tx=0x7f20c8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T16:33:45.774 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:45.777+0000 7f20cf400640 1 -- 172.21.15.72:0/1962665851 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f20d004e020 con 0x7f20d80adba0 2024-04-04T16:33:45.975 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:45.978+0000 7f20d7e00640 1 -- 172.21.15.72:0/1962665851 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f20d815df50 con 0x7f20d80adba0 2024-04-04T16:33:46.559 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:46.560+0000 7f20cf400640 1 -- 172.21.15.72:0/1962665851 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v36) ==== 169+0+0 (secure 0 0 0) 0x7f20d00ad0d0 con 0x7f20d80adba0 2024-04-04T16:33:46.559 INFO:teuthology.orchestra.run.smithi072.stderr:pool 'cephfs_data' removed 2024-04-04T16:33:46.570 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:46.570+0000 7f20d7e00640 1 -- 172.21.15.72:0/1962665851 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f20b806c8f0 msgr2=0x7f20b806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:46.570 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:46.570+0000 7f20d7e00640 1 --2- 172.21.15.72:0/1962665851 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f20b806c8f0 0x7f20b806edb0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f20c8004840 tx=0x7f20c8009040 comp rx=0 tx=0).stop 2024-04-04T16:33:46.570 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:46.570+0000 7f20d7e00640 1 -- 172.21.15.72:0/1962665851 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f20d80adba0 msgr2=0x7f20d8152dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:46.570 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:46.570+0000 7f20d7e00640 1 --2- 172.21.15.72:0/1962665851 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f20d80adba0 0x7f20d8152dc0 secure :-1 s=READY pgs=2166 cs=0 l=1 rev1=1 crypto rx=0x7f20d002c6d0 tx=0x7f20d0009750 comp rx=0 tx=0).stop 2024-04-04T16:33:46.570 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:46.573+0000 7f20d7e00640 1 -- 172.21.15.72:0/1962665851 shutdown_connections 2024-04-04T16:33:46.570 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:46.573+0000 7f20d7e00640 1 --2- 172.21.15.72:0/1962665851 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f20b806c8f0 0x7f20b806edb0 secure :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f20c8004840 tx=0x7f20c8009040 comp rx=0 tx=0).stop 2024-04-04T16:33:46.571 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:46.573+0000 7f20d7e00640 1 --2- 172.21.15.72:0/1962665851 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f20d80adba0 0x7f20d8152dc0 unknown :-1 s=CLOSED pgs=2166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:46.571 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:46.573+0000 7f20d7e00640 1 --2- 172.21.15.72:0/1962665851 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f20d80cd7b0 0x7f20d80ad660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:46.571 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:46.573+0000 7f20d7e00640 1 --2- 172.21.15.72:0/1962665851 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f20d80b3070 0x7f20d80ab730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:46.571 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:46.573+0000 7f20d7e00640 1 -- 172.21.15.72:0/1962665851 >> 172.21.15.72:0/1962665851 conn(0x7f20d806b860 msgr2=0x7f20d80d4a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T16:33:46.572 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:46.575+0000 7f20d7e00640 1 -- 172.21.15.72:0/1962665851 shutdown_connections 2024-04-04T16:33:46.572 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:46.575+0000 7f20d7e00640 1 -- 172.21.15.72:0/1962665851 wait complete. 2024-04-04T16:33:46.608 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-04-04T16:33:46.935 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:46.937+0000 7fe5c6800640 1 Processor -- start 2024-04-04T16:33:46.936 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:46.938+0000 7fe5c6800640 1 -- start start 2024-04-04T16:33:46.939 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:46.940+0000 7fe5c6800640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe5b80e7740 0x7fe5b8039b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:46.939 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:46.940+0000 7fe5c6800640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe5b80e7bd0 0x7fe5b80548a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:46.939 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:46.940+0000 7fe5c6800640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe5b803b870 con 0x7fe5b80e3650 2024-04-04T16:33:46.939 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:46.940+0000 7fe5c6800640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7fe5b803bb50 con 0x7fe5b80e7bd0 2024-04-04T16:33:46.939 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:46.940+0000 7fe5c6800640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fe5b803be30 con 0x7fe5b80e7740 2024-04-04T16:33:46.939 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:46.941+0000 7fe5c4a00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe5b80e7740 0x7fe5b8039b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:46.941 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:46.941+0000 7fe5c5400640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7fe5b80e3650 0x7fe5b80e7030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.72:36782/0 (socket says 172.21.15.72:36782) 2024-04-04T16:33:46.941 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:46.941+0000 7fe5c4a00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe5b80e7740 0x7fe5b8039b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.72:54088/0 (socket says 172.21.15.72:54088) 2024-04-04T16:33:46.941 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:46.941+0000 7fe5c5400640 1 -- 172.21.15.72:0/1516063498 learned_addr learned my addr 172.21.15.72:0/1516063498 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-04-04T16:33:46.942 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:46.942+0000 7fe5c5e00640 1 --2- 172.21.15.72:0/1516063498 >> v2:172.21.15.72:3300/0 conn(0x7fe5b80e7bd0 0x7fe5b80548a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:46.942 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:46.942+0000 7fe5c5e00640 1 -- 172.21.15.72:0/1516063498 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe5b80e7740 msgr2=0x7fe5b8039b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T16:33:46.942 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:46.942+0000 7fe5c5e00640 1 --2- 172.21.15.72:0/1516063498 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe5b80e7740 0x7fe5b8039b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:46.942 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:46.942+0000 7fe5c5e00640 1 -- 172.21.15.72:0/1516063498 >> v1:172.21.15.117:6789/0 conn(0x7fe5b80e3650 legacy=0x7fe5b80e7030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:46.942 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:46.942+0000 7fe5c5e00640 1 -- 172.21.15.72:0/1516063498 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5b803c110 con 0x7fe5b80e7bd0 2024-04-04T16:33:46.942 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:46.943+0000 7fe5c4a00640 1 --2- 172.21.15.72:0/1516063498 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe5b80e7740 0x7fe5b8039b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello state changed while learned_addr, mark_down or replacing must be happened just now 2024-04-04T16:33:46.942 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:46.944+0000 7fe5c5e00640 1 --2- 172.21.15.72:0/1516063498 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe5b80e7bd0 0x7fe5b80548a0 secure :-1 s=READY pgs=2167 cs=0 l=1 rev1=1 crypto rx=0x7fe5c0065040 tx=0x7fe5c006ae30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a02d58728160da17 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T16:33:46.942 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:46.944+0000 7fe5bfe00640 1 -- 172.21.15.72:0/1516063498 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5c00b4070 con 0x7fe5b80e7bd0 2024-04-04T16:33:46.943 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:46.944+0000 7fe5bfe00640 1 -- 172.21.15.72:0/1516063498 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5c00a7dd0 con 0x7fe5b80e7bd0 2024-04-04T16:33:46.943 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:46.945+0000 7fe5bfe00640 1 -- 172.21.15.72:0/1516063498 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5c00b4070 con 0x7fe5b80e7bd0 2024-04-04T16:33:46.946 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:46.948+0000 7fe5c6800640 1 -- 172.21.15.72:0/1516063498 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe5b80e7bd0 msgr2=0x7fe5b80548a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:46.946 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:46.948+0000 7fe5c6800640 1 --2- 172.21.15.72:0/1516063498 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe5b80e7bd0 0x7fe5b80548a0 secure :-1 s=READY pgs=2167 cs=0 l=1 rev1=1 crypto rx=0x7fe5c0065040 tx=0x7fe5c006ae30 comp rx=0 tx=0).stop 2024-04-04T16:33:46.946 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:46.949+0000 7fe5c6800640 1 -- 172.21.15.72:0/1516063498 shutdown_connections 2024-04-04T16:33:46.947 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:46.949+0000 7fe5c6800640 1 --2- 172.21.15.72:0/1516063498 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe5b80e7bd0 0x7fe5b80548a0 unknown :-1 s=CLOSED pgs=2167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:46.947 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:46.949+0000 7fe5c6800640 1 --2- 172.21.15.72:0/1516063498 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe5b80e7740 0x7fe5b8039b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:46.947 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:46.950+0000 7fe5c6800640 1 -- 172.21.15.72:0/1516063498 >> 172.21.15.72:0/1516063498 conn(0x7fe5b8056cd0 msgr2=0x7fe5b80570e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T16:33:46.947 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:46.950+0000 7fe5c6800640 1 -- 172.21.15.72:0/1516063498 shutdown_connections 2024-04-04T16:33:46.948 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:46.950+0000 7fe5c6800640 1 -- 172.21.15.72:0/1516063498 wait complete. 2024-04-04T16:33:46.951 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:46.953+0000 7fe5c6800640 1 Processor -- start 2024-04-04T16:33:46.951 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:46.954+0000 7fe5c6800640 1 -- start start 2024-04-04T16:33:46.953 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:46.956+0000 7fe5c6800640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe5b80e3650 0x7fe5b80507d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:46.954 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:46.956+0000 7fe5c6800640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe5b80e7740 0x7fe5b8185db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:46.954 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:46.956+0000 7fe5c6800640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe5b80e7bd0 0x7fe5b8054880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:46.955 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:46.957+0000 7fe5c6800640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fe5b803ca90 con 0x7fe5b80e3650 2024-04-04T16:33:46.955 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:46.957+0000 7fe5c6800640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fe5b803c910 con 0x7fe5b80e7740 2024-04-04T16:33:46.955 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:46.957+0000 7fe5c5e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe5b80e7bd0 0x7fe5b8054880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:46.955 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:46.957+0000 7fe5c5e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe5b80e7bd0 0x7fe5b8054880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.72:54104/0 (socket says 172.21.15.72:54104) 2024-04-04T16:33:46.955 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:46.957+0000 7fe5c5e00640 1 -- 172.21.15.72:0/1160369769 learned_addr learned my addr 172.21.15.72:0/1160369769 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T16:33:46.955 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:46.957+0000 7fe5c6800640 1 -- 172.21.15.72:0/1160369769 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fe5b803b400 con 0x7fe5b80e7bd0 2024-04-04T16:33:46.956 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:46.958+0000 7fe5c5400640 1 --2- 172.21.15.72:0/1160369769 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe5b80e3650 0x7fe5b80507d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:46.956 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:46.958+0000 7fe5c4a00640 1 --2- 172.21.15.72:0/1160369769 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe5b80e7740 0x7fe5b8185db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:46.956 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:46.959+0000 7fe5c5e00640 1 -- 172.21.15.72:0/1160369769 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe5b80e7740 msgr2=0x7fe5b8185db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:46.956 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:46.959+0000 7fe5c5e00640 1 --2- 172.21.15.72:0/1160369769 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe5b80e7740 0x7fe5b8185db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:46.957 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:46.959+0000 7fe5c5e00640 1 -- 172.21.15.72:0/1160369769 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe5b80e3650 msgr2=0x7fe5b80507d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:46.957 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:46.959+0000 7fe5c5e00640 1 --2- 172.21.15.72:0/1160369769 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe5b80e3650 0x7fe5b80507d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:46.957 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:46.959+0000 7fe5c5e00640 1 -- 172.21.15.72:0/1160369769 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5b81899d0 con 0x7fe5b80e7bd0 2024-04-04T16:33:46.957 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:46.959+0000 7fe5c5400640 1 --2- 172.21.15.72:0/1160369769 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe5b80e3650 0x7fe5b80507d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-04T16:33:46.957 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:46.959+0000 7fe5c5e00640 1 --2- 172.21.15.72:0/1160369769 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe5b80e7bd0 0x7fe5b8054880 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fe5c006a430 tx=0x7fe5c00695e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T16:33:46.959 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:46.960+0000 7fe5bd600640 1 -- 172.21.15.72:0/1160369769 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5c00b4050 con 0x7fe5b80e7bd0 2024-04-04T16:33:46.959 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:46.960+0000 7fe5bd600640 1 -- 172.21.15.72:0/1160369769 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5c00b5040 con 0x7fe5b80e7bd0 2024-04-04T16:33:46.959 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:46.960+0000 7fe5bd600640 1 -- 172.21.15.72:0/1160369769 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5c00b9810 con 0x7fe5b80e7bd0 2024-04-04T16:33:46.959 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:46.960+0000 7fe5c6800640 1 -- 172.21.15.72:0/1160369769 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5b8189c70 con 0x7fe5b80e7bd0 2024-04-04T16:33:46.959 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:46.960+0000 7fe5c6800640 1 -- 172.21.15.72:0/1160369769 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5b818a230 con 0x7fe5b80e7bd0 2024-04-04T16:33:46.959 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:46.961+0000 7fe5c6800640 1 -- 172.21.15.72:0/1160369769 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe59c005290 con 0x7fe5b80e7bd0 2024-04-04T16:33:46.962 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:46.964+0000 7fe5bd600640 1 -- 172.21.15.72:0/1160369769 <== mon.2 v2:172.21.15.117:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe5c00c2030 con 0x7fe5b80e7bd0 2024-04-04T16:33:46.964 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:46.966+0000 7fe5bd600640 1 --2- 172.21.15.72:0/1160369769 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fe5a006c9f0 0x7fe5a006eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:46.964 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:46.966+0000 7fe5bd600640 1 -- 172.21.15.72:0/1160369769 <== mon.2 v2:172.21.15.117:3301/0 5 ==== osd_map(36..36 src has 1..36) ==== 4943+0+0 (secure 0 0 0) 0x7fe5c01290c0 con 0x7fe5b80e7bd0 2024-04-04T16:33:46.964 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:46.967+0000 7fe5c5400640 1 --2- 172.21.15.72:0/1160369769 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fe5a006c9f0 0x7fe5a006eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:46.965 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:46.968+0000 7fe5c5400640 1 --2- 172.21.15.72:0/1160369769 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fe5a006c9f0 0x7fe5a006eeb0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7fe5b4007fd0 tx=0x7fe5b4007e80 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T16:33:46.971 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:46.973+0000 7fe5bd600640 1 -- 172.21.15.72:0/1160369769 <== mon.2 v2:172.21.15.117:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fe5c00c9060 con 0x7fe5b80e7bd0 2024-04-04T16:33:47.359 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:47.361+0000 7fe5c6800640 1 -- 172.21.15.72:0/1160369769 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7fe59c005850 con 0x7fe5b80e7bd0 2024-04-04T16:33:47.408 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:47.407+0000 7fe5bd600640 1 -- 172.21.15.72:0/1160369769 <== mon.2 v2:172.21.15.117:3301/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) ==== 104+0+0 (secure 0 0 0) 0x7fe5c00f78f0 con 0x7fe5b80e7bd0 2024-04-04T16:33:47.409 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:47.411+0000 7fe5b2a00640 1 -- 172.21.15.72:0/1160369769 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fe5a006c9f0 msgr2=0x7fe5a006eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:47.409 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:47.411+0000 7fe5b2a00640 1 --2- 172.21.15.72:0/1160369769 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fe5a006c9f0 0x7fe5a006eeb0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7fe5b4007fd0 tx=0x7fe5b4007e80 comp rx=0 tx=0).stop 2024-04-04T16:33:47.409 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:47.411+0000 7fe5b2a00640 1 -- 172.21.15.72:0/1160369769 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe5b80e7bd0 msgr2=0x7fe5b8054880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:47.409 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:47.411+0000 7fe5b2a00640 1 --2- 172.21.15.72:0/1160369769 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe5b80e7bd0 0x7fe5b8054880 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fe5c006a430 tx=0x7fe5c00695e0 comp rx=0 tx=0).stop 2024-04-04T16:33:47.410 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:47.412+0000 7fe5b2a00640 1 -- 172.21.15.72:0/1160369769 shutdown_connections 2024-04-04T16:33:47.410 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:47.412+0000 7fe5b2a00640 1 --2- 172.21.15.72:0/1160369769 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fe5a006c9f0 0x7fe5a006eeb0 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:47.410 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:47.412+0000 7fe5b2a00640 1 --2- 172.21.15.72:0/1160369769 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe5b80e7bd0 0x7fe5b8054880 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:47.410 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:47.412+0000 7fe5b2a00640 1 --2- 172.21.15.72:0/1160369769 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe5b80e7740 0x7fe5b8185db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:47.410 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:47.412+0000 7fe5b2a00640 1 --2- 172.21.15.72:0/1160369769 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe5b80e3650 0x7fe5b80507d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:47.410 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:47.412+0000 7fe5b2a00640 1 -- 172.21.15.72:0/1160369769 >> 172.21.15.72:0/1160369769 conn(0x7fe5b8056cd0 msgr2=0x7fe5b8055ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T16:33:47.411 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:47.414+0000 7fe5b2a00640 1 -- 172.21.15.72:0/1160369769 shutdown_connections 2024-04-04T16:33:47.413 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:47.415+0000 7fe5b2a00640 1 -- 172.21.15.72:0/1160369769 wait complete. 2024-04-04T16:33:47.443 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic' 2024-04-04T16:33:48.090 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:48.092+0000 7fdba4e00640 1 Processor -- start 2024-04-04T16:33:48.090 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:48.092+0000 7fdba4e00640 1 -- start start 2024-04-04T16:33:48.092 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:48.094+0000 7fdba4e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdba015e4c0 0x7fdba00d1040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:48.092 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:48.094+0000 7fdba4e00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fdba00b3670 0x7fdba00d1580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:48.092 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:48.094+0000 7fdba4e00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdba00b74c0 con 0x7fdba01620e0 2024-04-04T16:33:48.092 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:48.094+0000 7fdba4e00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fdba00cee30 con 0x7fdba00b3670 2024-04-04T16:33:48.092 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:48.094+0000 7fdba4e00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fdba00cf110 con 0x7fdba015e4c0 2024-04-04T16:33:48.093 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:48.095+0000 7fdb9f400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdba015e4c0 0x7fdba00d1040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:48.093 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:48.096+0000 7fdb9f400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdba015e4c0 0x7fdba00d1040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.72:54112/0 (socket says 172.21.15.72:54112) 2024-04-04T16:33:48.093 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:48.096+0000 7fdb9f400640 1 -- 172.21.15.72:0/3973127494 learned_addr learned my addr 172.21.15.72:0/3973127494 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T16:33:48.094 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:48.096+0000 7fdb9ea00640 1 --2- 172.21.15.72:0/3973127494 >> v2:172.21.15.117:3300/0 conn(0x7fdba00b3670 0x7fdba00d1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:48.094 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:48.097+0000 7fdb9ea00640 1 -- 172.21.15.72:0/3973127494 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdba015e4c0 msgr2=0x7fdba00d1040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T16:33:48.096 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:48.097+0000 7fdb9ea00640 1 --2- 172.21.15.72:0/3973127494 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdba015e4c0 0x7fdba00d1040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:48.096 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:48.097+0000 7fdb9ea00640 1 -- 172.21.15.72:0/3973127494 >> v1:172.21.15.117:6789/0 conn(0x7fdba01620e0 legacy=0x7fdba00d4040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T16:33:48.096 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:48.097+0000 7fdb9ea00640 1 -- 172.21.15.72:0/3973127494 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdba00cf3f0 con 0x7fdba00b3670 2024-04-04T16:33:48.098 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:48.101+0000 7fdb9ea00640 1 --2- 172.21.15.72:0/3973127494 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdba00b3670 0x7fdba00d1580 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7fdb8c0097a0 tx=0x7fdb8c02b8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=688d95a0ac801562 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T16:33:48.099 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:48.102+0000 7fdb9e000640 1 -- 172.21.15.72:0/3973127494 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb8c035020 con 0x7fdba00b3670 2024-04-04T16:33:48.099 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:48.102+0000 7fdb9e000640 1 -- 172.21.15.72:0/3973127494 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb8c031810 con 0x7fdba00b3670 2024-04-04T16:33:48.100 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:48.102+0000 7fdb9e000640 1 -- 172.21.15.72:0/3973127494 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb8c031be0 con 0x7fdba00b3670 2024-04-04T16:33:48.100 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:48.103+0000 7fdba4e00640 1 -- 172.21.15.72:0/3973127494 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdba00b3670 msgr2=0x7fdba00d1580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:48.100 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:48.103+0000 7fdba4e00640 1 --2- 172.21.15.72:0/3973127494 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdba00b3670 0x7fdba00d1580 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7fdb8c0097a0 tx=0x7fdb8c02b8b0 comp rx=0 tx=0).stop 2024-04-04T16:33:48.108 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:48.109+0000 7fdba4e00640 1 -- 172.21.15.72:0/3973127494 shutdown_connections 2024-04-04T16:33:48.108 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:48.109+0000 7fdba4e00640 1 --2- 172.21.15.72:0/3973127494 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdba00b3670 0x7fdba00d1580 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:48.108 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:48.109+0000 7fdba4e00640 1 --2- 172.21.15.72:0/3973127494 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdba015e4c0 0x7fdba00d1040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:48.108 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:48.109+0000 7fdba4e00640 1 -- 172.21.15.72:0/3973127494 >> 172.21.15.72:0/3973127494 conn(0x7fdba006b890 msgr2=0x7fdba006bca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T16:33:48.109 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:48.111+0000 7fdba4e00640 1 -- 172.21.15.72:0/3973127494 shutdown_connections 2024-04-04T16:33:48.114 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:48.111+0000 7fdba4e00640 1 -- 172.21.15.72:0/3973127494 wait complete. 2024-04-04T16:33:48.114 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:48.114+0000 7fdba4e00640 1 Processor -- start 2024-04-04T16:33:48.114 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:48.116+0000 7fdba4e00640 1 -- start start 2024-04-04T16:33:48.120 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:48.121+0000 7fdba4e00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdba00b3670 0x7fdba00cdb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:48.120 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:48.122+0000 7fdba4e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdba015e4c0 0x7fdba0161050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:48.120 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:48.122+0000 7fdba4e00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdba01620e0 0x7fdba015ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:48.120 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:48.122+0000 7fdb9f400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdba00b3670 0x7fdba00cdb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:48.121 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:48.122+0000 7fdb9f400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdba00b3670 0x7fdba00cdb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:55852/0 (socket says 172.21.15.72:55852) 2024-04-04T16:33:48.121 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:48.122+0000 7fdb9f400640 1 -- 172.21.15.72:0/2059434631 learned_addr learned my addr 172.21.15.72:0/2059434631 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T16:33:48.121 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:48.122+0000 7fdb9fe00640 1 --2- 172.21.15.72:0/2059434631 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdba01620e0 0x7fdba015ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:48.121 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:48.122+0000 7fdb9ea00640 1 --2- 172.21.15.72:0/2059434631 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdba015e4c0 0x7fdba0161050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:48.121 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:48.123+0000 7fdba4e00640 1 -- 172.21.15.72:0/2059434631 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fdba00ceac0 con 0x7fdba00b3670 2024-04-04T16:33:48.121 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:48.123+0000 7fdba4e00640 1 -- 172.21.15.72:0/2059434631 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fdba00cf9b0 con 0x7fdba01620e0 2024-04-04T16:33:48.121 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:48.123+0000 7fdba4e00640 1 -- 172.21.15.72:0/2059434631 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fdba015e8a0 con 0x7fdba015e4c0 2024-04-04T16:33:48.122 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:48.124+0000 7fdb9fe00640 1 -- 172.21.15.72:0/2059434631 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdba015e4c0 msgr2=0x7fdba0161050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:48.122 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:48.124+0000 7fdb9fe00640 1 --2- 172.21.15.72:0/2059434631 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdba015e4c0 0x7fdba0161050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:48.122 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:48.124+0000 7fdb9fe00640 1 -- 172.21.15.72:0/2059434631 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdba00b3670 msgr2=0x7fdba00cdb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:48.122 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:48.124+0000 7fdb9fe00640 1 --2- 172.21.15.72:0/2059434631 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdba00b3670 0x7fdba00cdb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:48.122 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:48.124+0000 7fdb9fe00640 1 -- 172.21.15.72:0/2059434631 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdba0161750 con 0x7fdba01620e0 2024-04-04T16:33:48.122 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:48.124+0000 7fdb9f400640 1 --2- 172.21.15.72:0/2059434631 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdba00b3670 0x7fdba00cdb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-04T16:33:48.123 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:48.124+0000 7fdb9fe00640 1 --2- 172.21.15.72:0/2059434631 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdba01620e0 0x7fdba015ebe0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7fdb9000b410 tx=0x7fdb9000b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T16:33:48.123 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:48.125+0000 7fdb97400640 1 -- 172.21.15.72:0/2059434631 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb90015020 con 0x7fdba01620e0 2024-04-04T16:33:48.123 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:48.125+0000 7fdba4e00640 1 -- 172.21.15.72:0/2059434631 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdba00d24d0 con 0x7fdba01620e0 2024-04-04T16:33:48.123 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:48.125+0000 7fdb97400640 1 -- 172.21.15.72:0/2059434631 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb90011850 con 0x7fdba01620e0 2024-04-04T16:33:48.124 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:48.126+0000 7fdb97400640 1 -- 172.21.15.72:0/2059434631 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb90011c40 con 0x7fdba01620e0 2024-04-04T16:33:48.124 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:48.126+0000 7fdba4e00640 1 -- 172.21.15.72:0/2059434631 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdba00d2a90 con 0x7fdba01620e0 2024-04-04T16:33:48.131 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:48.130+0000 7fdb97400640 1 -- 172.21.15.72:0/2059434631 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fdb90018020 con 0x7fdba01620e0 2024-04-04T16:33:48.131 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:48.130+0000 7fdba4e00640 1 -- 172.21.15.72:0/2059434631 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdba00756c0 con 0x7fdba01620e0 2024-04-04T16:33:48.131 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:48.131+0000 7fdb97400640 1 --2- 172.21.15.72:0/2059434631 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fdb8006c8f0 0x7fdb8006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:48.132 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:48.134+0000 7fdb97400640 1 -- 172.21.15.72:0/2059434631 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 4943+0+0 (secure 0 0 0) 0x7fdb9008ca40 con 0x7fdba01620e0 2024-04-04T16:33:48.138 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:48.140+0000 7fdb9f400640 1 --2- 172.21.15.72:0/2059434631 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fdb8006c8f0 0x7fdb8006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:48.143 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:48.145+0000 7fdb9f400640 1 --2- 172.21.15.72:0/2059434631 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fdb8006c8f0 0x7fdb8006edb0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7fdb98009360 tx=0x7fdb9800b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T16:33:48.145 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:48.147+0000 7fdb97400640 1 -- 172.21.15.72:0/2059434631 <== mon.1 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fdb90058870 con 0x7fdba01620e0 2024-04-04T16:33:48.714 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:48.716+0000 7fdba4e00640 1 -- 172.21.15.72:0/2059434631 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]} v 0) -- 0x7fdba006bea0 con 0x7fdba01620e0 2024-04-04T16:33:48.786 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:48.788+0000 7fdb97400640 1 -- 172.21.15.72:0/2059434631 <== mon.1 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]}]=0 v17416) ==== 144+0+0 (secure 0 0 0) 0x7fdb9005cb70 con 0x7fdba01620e0 2024-04-04T16:33:48.789 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:48.791+0000 7fdba4e00640 1 -- 172.21.15.72:0/2059434631 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fdb8006c8f0 msgr2=0x7fdb8006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:48.789 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:48.792+0000 7fdba4e00640 1 --2- 172.21.15.72:0/2059434631 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fdb8006c8f0 0x7fdb8006edb0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7fdb98009360 tx=0x7fdb9800b040 comp rx=0 tx=0).stop 2024-04-04T16:33:48.789 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:48.792+0000 7fdba4e00640 1 -- 172.21.15.72:0/2059434631 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdba01620e0 msgr2=0x7fdba015ebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:48.789 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:48.792+0000 7fdba4e00640 1 --2- 172.21.15.72:0/2059434631 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdba01620e0 0x7fdba015ebe0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7fdb9000b410 tx=0x7fdb9000b8d0 comp rx=0 tx=0).stop 2024-04-04T16:33:48.790 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:48.792+0000 7fdba4e00640 1 -- 172.21.15.72:0/2059434631 shutdown_connections 2024-04-04T16:33:48.790 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:48.792+0000 7fdba4e00640 1 --2- 172.21.15.72:0/2059434631 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fdb8006c8f0 0x7fdb8006edb0 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:48.790 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:48.792+0000 7fdba4e00640 1 --2- 172.21.15.72:0/2059434631 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdba01620e0 0x7fdba015ebe0 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:48.790 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:48.792+0000 7fdba4e00640 1 --2- 172.21.15.72:0/2059434631 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdba015e4c0 0x7fdba0161050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:48.790 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:48.792+0000 7fdba4e00640 1 --2- 172.21.15.72:0/2059434631 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdba00b3670 0x7fdba00cdb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:48.790 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:48.792+0000 7fdba4e00640 1 -- 172.21.15.72:0/2059434631 >> 172.21.15.72:0/2059434631 conn(0x7fdba006b890 msgr2=0x7fdba00b7760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T16:33:48.796 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:48.799+0000 7fdba4e00640 1 -- 172.21.15.72:0/2059434631 shutdown_connections 2024-04-04T16:33:48.796 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:48.799+0000 7fdba4e00640 1 -- 172.21.15.72:0/2059434631 wait complete. 2024-04-04T16:33:48.863 INFO:tasks.cephfs_test_runner:test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) ... FAIL 2024-04-04T16:33:48.863 INFO:tasks.cephfs_test_runner: 2024-04-04T16:33:48.863 INFO:tasks.cephfs_test_runner:====================================================================== 2024-04-04T16:33:48.864 INFO:tasks.cephfs_test_runner:FAIL: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2024-04-04T16:33:48.864 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-04-04T16:33:48.864 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-04-04T16:33:48.864 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_addbc488dc763e752c640619b677f10e0da02c9f/qa/tasks/cephfs/tests_from_xfstests_dev.py", line 12, in test_generic 2024-04-04T16:33:48.864 INFO:tasks.cephfs_test_runner: self.run_generic_tests() 2024-04-04T16:33:48.864 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_addbc488dc763e752c640619b677f10e0da02c9f/qa/tasks/cephfs/xfstests_dev.py", line 407, in run_generic_tests 2024-04-04T16:33:48.865 INFO:tasks.cephfs_test_runner: return self.run_testdir('generic') 2024-04-04T16:33:48.865 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_addbc488dc763e752c640619b677f10e0da02c9f/qa/tasks/cephfs/xfstests_dev.py", line 399, in run_testdir 2024-04-04T16:33:48.865 INFO:tasks.cephfs_test_runner: self.assertEqual(self.total_tests_failed, 0) 2024-04-04T16:33:48.865 INFO:tasks.cephfs_test_runner:AssertionError: 15 != 0 2024-04-04T16:33:48.866 INFO:tasks.cephfs_test_runner: 2024-04-04T16:33:48.866 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-04-04T16:33:48.866 INFO:tasks.cephfs_test_runner:Ran 1 test in 34599.494s 2024-04-04T16:33:48.866 INFO:tasks.cephfs_test_runner: 2024-04-04T16:33:48.866 INFO:tasks.cephfs_test_runner:FAILED (failures=1) 2024-04-04T16:33:48.866 INFO:tasks.cephfs_test_runner: 2024-04-04T16:33:48.867 INFO:tasks.cephfs_test_runner:====================================================================== 2024-04-04T16:33:48.867 INFO:tasks.cephfs_test_runner:FAIL: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2024-04-04T16:33:48.867 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-04-04T16:33:48.867 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-04-04T16:33:48.867 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_addbc488dc763e752c640619b677f10e0da02c9f/qa/tasks/cephfs/tests_from_xfstests_dev.py", line 12, in test_generic 2024-04-04T16:33:48.867 INFO:tasks.cephfs_test_runner: self.run_generic_tests() 2024-04-04T16:33:48.868 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_addbc488dc763e752c640619b677f10e0da02c9f/qa/tasks/cephfs/xfstests_dev.py", line 407, in run_generic_tests 2024-04-04T16:33:48.868 INFO:tasks.cephfs_test_runner: return self.run_testdir('generic') 2024-04-04T16:33:48.868 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_addbc488dc763e752c640619b677f10e0da02c9f/qa/tasks/cephfs/xfstests_dev.py", line 399, in run_testdir 2024-04-04T16:33:48.868 INFO:tasks.cephfs_test_runner: self.assertEqual(self.total_tests_failed, 0) 2024-04-04T16:33:48.868 INFO:tasks.cephfs_test_runner:AssertionError: 15 != 0 2024-04-04T16:33:48.868 INFO:tasks.cephfs_test_runner: 2024-04-04T16:33:48.869 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_d7d6e60867cadf19fbfd7655a551ae7d58060757/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_addbc488dc763e752c640619b677f10e0da02c9f/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2024-04-04T16:33:49.158 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=4b77bf1e86c3402caad1db880e11155f Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_d7d6e60867cadf19fbfd7655a551ae7d58060757/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_addbc488dc763e752c640619b677f10e0da02c9f/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2024-04-04T16:33:49.159 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2024-04-04T16:33:49.171 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-04-04T16:33:49.215 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-04-04T16:33:49.216 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-04-04T16:33:49.216 DEBUG:teuthology.orchestra.run.smithi072:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-04T16:33:49.291 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053387,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498296k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249148k,nr_inodes=812287,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498296k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-04T16:33:49.292 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-04-04T16:33:49.292 DEBUG:teuthology.orchestra.run.smithi072:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-04T16:33:49.364 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053387,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498296k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249148k,nr_inodes=812287,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498296k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-04T16:33:49.364 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-04-04T16:33:49.364 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-04T16:33:49.401 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053428,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498364k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249180k,nr_inodes=812295,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498364k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-04T16:33:49.401 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-04-04T16:33:49.401 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-04T16:33:49.480 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053428,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498364k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249180k,nr_inodes=812295,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498364k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-04T16:33:49.481 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-04T16:33:49.481 DEBUG:teuthology.orchestra.run.smithi072:> ip netns list 2024-04-04T16:33:49.715 INFO:teuthology.orchestra.run.smithi072.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-04T16:33:49.715 INFO:teuthology.orchestra.run.smithi072.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-04T16:33:49.716 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-04T16:33:49.717 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-04T16:33:49.825 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-04T16:33:49.826 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-04T16:33:49.915 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-04T16:33:49.916 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip link delete ceph-brx 2024-04-04T16:33:50.037 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-04T16:33:50.037 DEBUG:teuthology.orchestra.run.smithi117:> ip netns list 2024-04-04T16:33:50.230 INFO:teuthology.orchestra.run.smithi117.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-04-04T16:33:50.230 INFO:teuthology.orchestra.run.smithi117.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-04-04T16:33:50.231 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-04T16:33:50.231 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-04T16:33:50.325 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-04T16:33:50.325 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2024-04-04T16:33:50.402 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-04T16:33:50.402 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip link delete ceph-brx 2024-04-04T16:33:50.519 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-04-04T16:33:50.529 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-04T16:33:50.529 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-04T16:33:51.204 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:51.206+0000 7f7e33e00640 1 Processor -- start 2024-04-04T16:33:51.204 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:51.206+0000 7f7e33e00640 1 -- start start 2024-04-04T16:33:51.206 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:51.207+0000 7f7e33e00640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f7e2c0b9e00 0x7f7e2c0d12d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:51.206 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:51.207+0000 7f7e33e00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f7e2c0d3ea0 0x7f7e2c0d1810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:51.207 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:51.207+0000 7f7e33e00640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7e2c15e940 con 0x7f7e2c15e560 2024-04-04T16:33:51.207 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:51.207+0000 7f7e33e00640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f7e2c0b8520 con 0x7f7e2c0b9e00 2024-04-04T16:33:51.207 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:51.207+0000 7f7e33e00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f7e2c0d2b30 con 0x7f7e2c0d3ea0 2024-04-04T16:33:51.207 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:51.208+0000 7f7e30a00640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f7e2c0b9e00 0x7f7e2c0d12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:51.207 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:51.208+0000 7f7e31400640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f7e2c15e560 0x7f7e2c0d2420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:39472/0 (socket says 172.21.15.72:39472) 2024-04-04T16:33:51.207 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:51.208+0000 7f7e31400640 1 -- 172.21.15.72:0/2646353222 learned_addr learned my addr 172.21.15.72:0/2646353222 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-04-04T16:33:51.207 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:51.208+0000 7f7e31e00640 1 --2- 172.21.15.72:0/2646353222 >> v2:172.21.15.117:3300/0 conn(0x7f7e2c0d3ea0 0x7f7e2c0d1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:51.207 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:51.208+0000 7f7e30a00640 1 -- 172.21.15.72:0/2646353222 >> v2:172.21.15.117:3300/0 conn(0x7f7e2c0d3ea0 msgr2=0x7f7e2c0d1810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T16:33:51.208 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:51.208+0000 7f7e30a00640 1 --2- 172.21.15.72:0/2646353222 >> v2:172.21.15.117:3300/0 conn(0x7f7e2c0d3ea0 0x7f7e2c0d1810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:51.208 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:51.209+0000 7f7e30a00640 1 -- 172.21.15.72:0/2646353222 >> v1:172.21.15.72:6789/0 conn(0x7f7e2c15e560 legacy=0x7f7e2c0d2420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:51.208 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:51.209+0000 7f7e2be00640 1 -- 172.21.15.72:0/2646353222 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2342736828 0 0) 0x7f7e2c15e940 con 0x7f7e2c15e560 2024-04-04T16:33:51.208 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:51.209+0000 7f7e30a00640 1 -- 172.21.15.72:0/2646353222 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e2c0d2e00 con 0x7f7e2c0b9e00 2024-04-04T16:33:51.209 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:51.210+0000 7f7e30a00640 1 --2- 172.21.15.72:0/2646353222 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7e2c0b9e00 0x7f7e2c0d12d0 secure :-1 s=READY pgs=2169 cs=0 l=1 rev1=1 crypto rx=0x7f7e2c0d0550 tx=0x7f7e2002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=181cf6fe4ac3fb74 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T16:33:51.210 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:51.211+0000 7f7e2be00640 1 -- 172.21.15.72:0/2646353222 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e20035020 con 0x7f7e2c0b9e00 2024-04-04T16:33:51.210 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:51.211+0000 7f7e2be00640 1 -- 172.21.15.72:0/2646353222 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e20031830 con 0x7f7e2c0b9e00 2024-04-04T16:33:51.210 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:51.211+0000 7f7e2be00640 1 -- 172.21.15.72:0/2646353222 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e20031c00 con 0x7f7e2c0b9e00 2024-04-04T16:33:51.210 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:51.211+0000 7f7e33e00640 1 -- 172.21.15.72:0/2646353222 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7e2c0b9e00 msgr2=0x7f7e2c0d12d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:51.210 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:51.211+0000 7f7e33e00640 1 --2- 172.21.15.72:0/2646353222 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7e2c0b9e00 0x7f7e2c0d12d0 secure :-1 s=READY pgs=2169 cs=0 l=1 rev1=1 crypto rx=0x7f7e2c0d0550 tx=0x7f7e2002b8d0 comp rx=0 tx=0).stop 2024-04-04T16:33:51.210 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:51.211+0000 7f7e33e00640 1 -- 172.21.15.72:0/2646353222 shutdown_connections 2024-04-04T16:33:51.210 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:51.211+0000 7f7e33e00640 1 --2- 172.21.15.72:0/2646353222 >> v2:172.21.15.117:3300/0 conn(0x7f7e2c0d3ea0 0x7f7e2c0d1810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:51.211 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:51.211+0000 7f7e33e00640 1 --2- 172.21.15.72:0/2646353222 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7e2c0b9e00 0x7f7e2c0d12d0 unknown :-1 s=CLOSED pgs=2169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:51.211 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:51.211+0000 7f7e33e00640 1 -- 172.21.15.72:0/2646353222 >> 172.21.15.72:0/2646353222 conn(0x7f7e2c071e80 msgr2=0x7f7e2c072290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T16:33:51.211 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:51.212+0000 7f7e33e00640 1 -- 172.21.15.72:0/2646353222 shutdown_connections 2024-04-04T16:33:51.211 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:51.212+0000 7f7e33e00640 1 -- 172.21.15.72:0/2646353222 wait complete. 2024-04-04T16:33:51.212 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:51.214+0000 7f7e33e00640 1 Processor -- start 2024-04-04T16:33:51.212 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:51.214+0000 7f7e33e00640 1 -- start start 2024-04-04T16:33:51.214 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:51.215+0000 7f7e33e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7e2c0b9e00 0x7f7e2c154780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:51.214 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:51.215+0000 7f7e33e00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7e2c0d3ea0 0x7f7e2c15f890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:51.215 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:51.215+0000 7f7e33e00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7e2c15e560 0x7f7e2c0c7e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:51.215 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:51.215+0000 7f7e33e00640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f7e2c0d36a0 con 0x7f7e2c15e560 2024-04-04T16:33:51.215 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:51.215+0000 7f7e33e00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f7e2c0d33c0 con 0x7f7e2c0d3ea0 2024-04-04T16:33:51.215 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:51.215+0000 7f7e33e00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f7e2c0d3980 con 0x7f7e2c0b9e00 2024-04-04T16:33:51.215 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:51.215+0000 7f7e31e00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7e2c15e560 0x7f7e2c0c7e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:51.215 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:51.215+0000 7f7e31e00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7e2c15e560 0x7f7e2c0c7e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51542/0 (socket says 172.21.15.72:51542) 2024-04-04T16:33:51.215 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:51.215+0000 7f7e31e00640 1 -- 172.21.15.72:0/896665392 learned_addr learned my addr 172.21.15.72:0/896665392 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T16:33:51.216 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:51.215+0000 7f7e31400640 1 --2- 172.21.15.72:0/896665392 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7e2c0b9e00 0x7f7e2c154780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:51.216 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:51.216+0000 7f7e30a00640 1 --2- 172.21.15.72:0/896665392 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7e2c0d3ea0 0x7f7e2c15f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:51.216 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:51.216+0000 7f7e31e00640 1 -- 172.21.15.72:0/896665392 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7e2c0b9e00 msgr2=0x7f7e2c154780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:51.216 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:51.216+0000 7f7e31e00640 1 --2- 172.21.15.72:0/896665392 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7e2c0b9e00 0x7f7e2c154780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:51.216 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:51.216+0000 7f7e31e00640 1 -- 172.21.15.72:0/896665392 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7e2c0d3ea0 msgr2=0x7f7e2c15f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:51.216 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:51.216+0000 7f7e31e00640 1 --2- 172.21.15.72:0/896665392 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7e2c0d3ea0 0x7f7e2c15f890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:51.216 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:51.216+0000 7f7e31e00640 1 -- 172.21.15.72:0/896665392 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e2c0c85b0 con 0x7f7e2c15e560 2024-04-04T16:33:51.217 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:51.216+0000 7f7e30a00640 1 --2- 172.21.15.72:0/896665392 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7e2c0d3ea0 0x7f7e2c15f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-04T16:33:51.217 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:51.216+0000 7f7e31e00640 1 --2- 172.21.15.72:0/896665392 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7e2c15e560 0x7f7e2c0c7e80 secure :-1 s=READY pgs=2170 cs=0 l=1 rev1=1 crypto rx=0x7f7e24007e40 tx=0x7f7e2400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T16:33:51.217 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:51.216+0000 7f7e29600640 1 -- 172.21.15.72:0/896665392 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e24014620 con 0x7f7e2c15e560 2024-04-04T16:33:51.217 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:51.216+0000 7f7e29600640 1 -- 172.21.15.72:0/896665392 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e24019070 con 0x7f7e2c15e560 2024-04-04T16:33:51.217 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:51.216+0000 7f7e29600640 1 -- 172.21.15.72:0/896665392 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e24014a20 con 0x7f7e2c15e560 2024-04-04T16:33:51.217 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:51.216+0000 7f7e33e00640 1 -- 172.21.15.72:0/896665392 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e2c0c8890 con 0x7f7e2c15e560 2024-04-04T16:33:51.217 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:51.217+0000 7f7e33e00640 1 -- 172.21.15.72:0/896665392 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e2c0c8e50 con 0x7f7e2c15e560 2024-04-04T16:33:51.218 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:51.218+0000 7f7e33e00640 1 -- 172.21.15.72:0/896665392 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e2c075840 con 0x7f7e2c15e560 2024-04-04T16:33:51.219 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:51.219+0000 7f7e29600640 1 -- 172.21.15.72:0/896665392 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7e24014bc0 con 0x7f7e2c15e560 2024-04-04T16:33:51.219 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:51.220+0000 7f7e29600640 1 --2- 172.21.15.72:0/896665392 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f7e1006c920 0x7f7e1006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:51.219 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:51.220+0000 7f7e29600640 1 -- 172.21.15.72:0/896665392 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 4943+0+0 (secure 0 0 0) 0x7f7e2408c120 con 0x7f7e2c15e560 2024-04-04T16:33:51.219 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:51.220+0000 7f7e31400640 1 --2- 172.21.15.72:0/896665392 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f7e1006c920 0x7f7e1006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:51.219 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:51.221+0000 7f7e31400640 1 --2- 172.21.15.72:0/896665392 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f7e1006c920 0x7f7e1006ede0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f7e1c000f60 tx=0x7f7e1c007c00 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T16:33:51.223 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:51.224+0000 7f7e29600640 1 -- 172.21.15.72:0/896665392 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f7e2405a840 con 0x7f7e2c15e560 2024-04-04T16:33:51.447 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:51.449+0000 7f7e33e00640 1 -- 172.21.15.72:0/896665392 --> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f7e2c155b70 con 0x7f7e1006c920 2024-04-04T16:33:51.465 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:51.467+0000 7f7e29600640 1 -- 172.21.15.72:0/896665392 <== mgr.4101 v2:172.21.15.72:6832/2205173820 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13699 (secure 0 0 0) 0x7f7e2c155b70 con 0x7f7e1006c920 2024-04-04T16:33:51.466 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T16:33:51.466 INFO:teuthology.orchestra.run.smithi072.stderr:dumped all 2024-04-04T16:33:51.468 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:51.470+0000 7f7e33e00640 1 -- 172.21.15.72:0/896665392 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f7e1006c920 msgr2=0x7f7e1006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:51.469 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:51.470+0000 7f7e33e00640 1 --2- 172.21.15.72:0/896665392 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f7e1006c920 0x7f7e1006ede0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f7e1c000f60 tx=0x7f7e1c007c00 comp rx=0 tx=0).stop 2024-04-04T16:33:51.469 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:51.470+0000 7f7e33e00640 1 -- 172.21.15.72:0/896665392 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7e2c15e560 msgr2=0x7f7e2c0c7e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:51.469 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:51.470+0000 7f7e33e00640 1 --2- 172.21.15.72:0/896665392 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7e2c15e560 0x7f7e2c0c7e80 secure :-1 s=READY pgs=2170 cs=0 l=1 rev1=1 crypto rx=0x7f7e24007e40 tx=0x7f7e2400e4b0 comp rx=0 tx=0).stop 2024-04-04T16:33:51.469 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:51.470+0000 7f7e33e00640 1 -- 172.21.15.72:0/896665392 shutdown_connections 2024-04-04T16:33:51.469 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:51.470+0000 7f7e33e00640 1 --2- 172.21.15.72:0/896665392 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f7e1006c920 0x7f7e1006ede0 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:51.469 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:51.470+0000 7f7e33e00640 1 --2- 172.21.15.72:0/896665392 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7e2c15e560 0x7f7e2c0c7e80 unknown :-1 s=CLOSED pgs=2170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:51.469 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:51.470+0000 7f7e33e00640 1 --2- 172.21.15.72:0/896665392 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7e2c0d3ea0 0x7f7e2c15f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:51.470 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:51.470+0000 7f7e33e00640 1 --2- 172.21.15.72:0/896665392 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7e2c0b9e00 0x7f7e2c154780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:51.470 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:51.470+0000 7f7e33e00640 1 -- 172.21.15.72:0/896665392 >> 172.21.15.72:0/896665392 conn(0x7f7e2c071e80 msgr2=0x7f7e2c15b700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T16:33:51.470 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:51.470+0000 7f7e33e00640 1 -- 172.21.15.72:0/896665392 shutdown_connections 2024-04-04T16:33:51.470 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:51.470+0000 7f7e33e00640 1 -- 172.21.15.72:0/896665392 wait complete. 2024-04-04T16:33:51.487 INFO:teuthology.orchestra.run.smithi072.stdout:{"pg_ready":true,"pg_map":{"version":17349,"stamp":"2024-04-04T16:33:51.109278+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":96,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":4,"kb":754974720,"kb_used":15238104,"kb_used_data":3278616,"kb_used_omap":3345,"kb_used_meta":11881326,"kb_avail":739736616,"statfs":{"total":773094113280,"available":757490294784,"internally_reserved":0,"allocated":3357302784,"data_stored":3349023133,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3426126,"internal_metadata":12166478002},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":359,"apply_latency_ms":359,"commit_latency_ns":359000000,"apply_latency_ns":359000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-36136723971,"num_objects":-30513,"num_object_clones":0,"num_object_copies":-61026,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-30513,"num_whiteouts":0,"num_read":-1734726,"num_read_kb":-123792727,"num_write":-7439100,"num_write_kb":-160018677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-2144,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.582932"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":489,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-04T16:33:46.576255+0000","last_change":"2024-04-04T06:56:19.364611+0000","last_active":"2024-04-04T16:33:46.576255+0000","last_peered":"2024-04-04T16:33:46.576255+0000","last_clean":"2024-04-04T16:33:46.576255+0000","last_became_active":"2024-04-04T06:56:19.362232+0000","last_became_peered":"2024-04-04T06:56:19.362232+0000","last_unstale":"2024-04-04T16:33:46.576255+0000","last_undegraded":"2024-04-04T16:33:46.576255+0000","last_fullsized":"2024-04-04T16:33:46.576255+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:17.744258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:17.744258+0000","last_clean_scrub_stamp":"2024-04-04T06:56:17.744258+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T17:25:16.494215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834581781,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1733604,"kb_used_data":988,"kb_used_omap":25,"kb_used_meta":1732582,"kb_avail":92638236,"statfs":{"total":96636764160,"available":94861553664,"internally_reserved":0,"allocated":1011712,"data_stored":754625,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":26454,"internal_metadata":1774164138},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":35,"apply_latency_ms":35,"commit_latency_ns":35000000,"apply_latency_ns":35000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834581781,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1417892,"kb_used_data":408,"kb_used_omap":568,"kb_used_meta":1416903,"kb_avail":92953948,"statfs":{"total":96636764160,"available":95184842752,"internally_reserved":0,"allocated":417792,"data_stored":164257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":581652,"internal_metadata":1450909676},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834581780,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1661552,"kb_used_data":10408,"kb_used_omap":393,"kb_used_meta":1650742,"kb_avail":92710288,"statfs":{"total":96636764160,"available":94935334912,"internally_reserved":0,"allocated":10657792,"data_stored":10371296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":403353,"internal_metadata":1690359911},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":54,"apply_latency_ms":54,"commit_latency_ns":54000000,"apply_latency_ns":54000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834581780,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2307100,"kb_used_data":604380,"kb_used_omap":496,"kb_used_meta":1688399,"kb_avail":92064740,"statfs":{"total":96636764160,"available":94274293760,"internally_reserved":0,"allocated":618885120,"data_stored":617428492,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":508871,"internal_metadata":1728920633},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":50,"apply_latency_ms":50,"commit_latency_ns":50000000,"apply_latency_ns":50000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834581743,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1712992,"kb_used_data":408,"kb_used_omap":141,"kb_used_meta":1712434,"kb_avail":92658848,"statfs":{"total":96636764160,"available":94882660352,"internally_reserved":0,"allocated":417792,"data_stored":164257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":145232,"internal_metadata":1753532592},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":57,"apply_latency_ms":57,"commit_latency_ns":57000000,"apply_latency_ns":57000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834581763,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1202272,"kb_used_data":408,"kb_used_omap":450,"kb_used_meta":1201405,"kb_avail":93169568,"statfs":{"total":96636764160,"available":95405637632,"internally_reserved":0,"allocated":417792,"data_stored":164257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":461359,"internal_metadata":1230239185},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":50,"apply_latency_ms":50,"commit_latency_ns":50000000,"apply_latency_ns":50000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834581751,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3422284,"kb_used_data":1695940,"kb_used_omap":803,"kb_used_meta":1664604,"kb_avail":90949556,"statfs":{"total":96636764160,"available":93132345344,"internally_reserved":0,"allocated":1736642560,"data_stored":1733095623,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":823151,"internal_metadata":1704554641},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":62,"apply_latency_ms":62,"commit_latency_ns":62000000,"apply_latency_ns":62000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834581772,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1780408,"kb_used_data":965676,"kb_used_omap":464,"kb_used_meta":814255,"kb_avail":92591432,"statfs":{"total":96636764160,"available":94813626368,"internally_reserved":0,"allocated":988852224,"data_stored":986880326,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":476054,"internal_metadata":833797226},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":33,"apply_latency_ms":33,"commit_latency_ns":33000000,"apply_latency_ns":33000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-04T16:33:51.488 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-04T16:33:51.685 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:51.687+0000 7ff21c000640 1 Processor -- start 2024-04-04T16:33:51.694 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:51.687+0000 7ff21c000640 1 -- start start 2024-04-04T16:33:51.698 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:51.688+0000 7ff21c000640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff21415c2d0 0x7ff214071610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:51.698 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:51.688+0000 7ff21c000640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7ff2140ccb20 0x7ff2140ccf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:51.698 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:51.688+0000 7ff21c000640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2140c6710 con 0x7ff21415c6b0 2024-04-04T16:33:51.698 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:51.688+0000 7ff21c000640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7ff2140c6fb0 con 0x7ff21415c2d0 2024-04-04T16:33:51.699 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:51.688+0000 7ff21c000640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7ff2140cd4a0 con 0x7ff2140ccb20 2024-04-04T16:33:51.699 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:51.689+0000 7ff219600640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff21415c2d0 0x7ff214071610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:51.699 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:51.689+0000 7ff218c00640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7ff21415c6b0 0x7ff2140c5e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:39474/0 (socket says 172.21.15.72:39474) 2024-04-04T16:33:51.699 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:51.689+0000 7ff218c00640 1 -- 172.21.15.72:0/1385948338 learned_addr learned my addr 172.21.15.72:0/1385948338 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-04-04T16:33:51.699 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:51.689+0000 7ff21a000640 1 --2- 172.21.15.72:0/1385948338 >> v2:172.21.15.117:3300/0 conn(0x7ff2140ccb20 0x7ff2140ccf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:51.699 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:51.689+0000 7ff219600640 1 -- 172.21.15.72:0/1385948338 >> v2:172.21.15.117:3300/0 conn(0x7ff2140ccb20 msgr2=0x7ff2140ccf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T16:33:51.699 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:51.689+0000 7ff219600640 1 --2- 172.21.15.72:0/1385948338 >> v2:172.21.15.117:3300/0 conn(0x7ff2140ccb20 0x7ff2140ccf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:51.699 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:51.689+0000 7ff219600640 1 -- 172.21.15.72:0/1385948338 >> v1:172.21.15.72:6789/0 conn(0x7ff21415c6b0 legacy=0x7ff2140c5e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:51.700 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:51.689+0000 7ff219600640 1 -- 172.21.15.72:0/1385948338 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2140c69f0 con 0x7ff21415c2d0 2024-04-04T16:33:51.700 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:51.690+0000 7ff219600640 1 --2- 172.21.15.72:0/1385948338 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff21415c2d0 0x7ff214071610 secure :-1 s=READY pgs=2172 cs=0 l=1 rev1=1 crypto rx=0x7ff21406c420 tx=0x7ff20802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=158c9f94304f762f server_cookie=0 in_seq=0 out_seq=0 2024-04-04T16:33:51.700 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:51.691+0000 7ff213e00640 1 -- 172.21.15.72:0/1385948338 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2080315a0 con 0x7ff21415c2d0 2024-04-04T16:33:51.700 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:51.691+0000 7ff213e00640 1 -- 172.21.15.72:0/1385948338 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff208037070 con 0x7ff21415c2d0 2024-04-04T16:33:51.700 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:51.691+0000 7ff213e00640 1 -- 172.21.15.72:0/1385948338 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff208031960 con 0x7ff21415c2d0 2024-04-04T16:33:51.700 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:51.691+0000 7ff21c000640 1 -- 172.21.15.72:0/1385948338 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff21415c2d0 msgr2=0x7ff214071610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:51.700 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:51.691+0000 7ff21c000640 1 --2- 172.21.15.72:0/1385948338 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff21415c2d0 0x7ff214071610 secure :-1 s=READY pgs=2172 cs=0 l=1 rev1=1 crypto rx=0x7ff21406c420 tx=0x7ff20802b840 comp rx=0 tx=0).stop 2024-04-04T16:33:51.700 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:51.691+0000 7ff21c000640 1 -- 172.21.15.72:0/1385948338 shutdown_connections 2024-04-04T16:33:51.701 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:51.692+0000 7ff21c000640 1 --2- 172.21.15.72:0/1385948338 >> v2:172.21.15.117:3300/0 conn(0x7ff2140ccb20 0x7ff2140ccf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:51.701 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:51.692+0000 7ff21c000640 1 --2- 172.21.15.72:0/1385948338 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff21415c2d0 0x7ff214071610 unknown :-1 s=CLOSED pgs=2172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:51.701 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:51.692+0000 7ff21c000640 1 -- 172.21.15.72:0/1385948338 >> 172.21.15.72:0/1385948338 conn(0x7ff21406b470 msgr2=0x7ff21406b880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T16:33:51.701 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:51.692+0000 7ff21c000640 1 -- 172.21.15.72:0/1385948338 shutdown_connections 2024-04-04T16:33:51.701 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:51.692+0000 7ff21c000640 1 -- 172.21.15.72:0/1385948338 wait complete. 2024-04-04T16:33:51.701 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:51.693+0000 7ff21c000640 1 Processor -- start 2024-04-04T16:33:51.701 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:51.693+0000 7ff21c000640 1 -- start start 2024-04-04T16:33:51.701 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:51.694+0000 7ff21c000640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff2140ccb20 0x7ff214152ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:51.701 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:51.694+0000 7ff21c000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff21415c2d0 0x7ff2140d07c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:51.702 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:51.694+0000 7ff21c000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff21415c6b0 0x7ff214158120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:51.702 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:51.694+0000 7ff21c000640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7ff2140b3ea0 con 0x7ff2140ccb20 2024-04-04T16:33:51.702 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:51.694+0000 7ff21c000640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7ff21415cb30 con 0x7ff21415c6b0 2024-04-04T16:33:51.702 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:51.694+0000 7ff21c000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7ff2140b4020 con 0x7ff21415c2d0 2024-04-04T16:33:51.702 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:51.694+0000 7ff219600640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff2140ccb20 0x7ff214152ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:51.702 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:51.694+0000 7ff219600640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff2140ccb20 0x7ff214152ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51556/0 (socket says 172.21.15.72:51556) 2024-04-04T16:33:51.702 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:51.694+0000 7ff219600640 1 -- 172.21.15.72:0/2032655293 learned_addr learned my addr 172.21.15.72:0/2032655293 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T16:33:51.702 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:51.695+0000 7ff219600640 1 -- 172.21.15.72:0/2032655293 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff21415c2d0 msgr2=0x7ff2140d07c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:51.703 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:51.695+0000 7ff219600640 1 --2- 172.21.15.72:0/2032655293 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff21415c2d0 0x7ff2140d07c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:51.703 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:51.695+0000 7ff219600640 1 -- 172.21.15.72:0/2032655293 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff21415c6b0 msgr2=0x7ff214158120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:51.703 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:51.695+0000 7ff219600640 1 --2- 172.21.15.72:0/2032655293 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff21415c6b0 0x7ff214158120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:51.703 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:51.695+0000 7ff219600640 1 -- 172.21.15.72:0/2032655293 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2140cf720 con 0x7ff2140ccb20 2024-04-04T16:33:51.703 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:51.695+0000 7ff219600640 1 --2- 172.21.15.72:0/2032655293 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff2140ccb20 0x7ff214152ff0 secure :-1 s=READY pgs=2173 cs=0 l=1 rev1=1 crypto rx=0x7ff208009890 tx=0x7ff2080046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T16:33:51.703 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:51.695+0000 7ff211600640 1 -- 172.21.15.72:0/2032655293 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff208032840 con 0x7ff2140ccb20 2024-04-04T16:33:51.704 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:51.695+0000 7ff211600640 1 -- 172.21.15.72:0/2032655293 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2080329e0 con 0x7ff2140ccb20 2024-04-04T16:33:51.704 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:51.695+0000 7ff211600640 1 -- 172.21.15.72:0/2032655293 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff208032dd0 con 0x7ff2140ccb20 2024-04-04T16:33:51.704 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:51.695+0000 7ff21c000640 1 -- 172.21.15.72:0/2032655293 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2140cfa00 con 0x7ff2140ccb20 2024-04-04T16:33:51.704 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:51.696+0000 7ff21c000640 1 -- 172.21.15.72:0/2032655293 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2140cffc0 con 0x7ff2140ccb20 2024-04-04T16:33:51.704 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:51.697+0000 7ff21c000640 1 -- 172.21.15.72:0/2032655293 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff214075840 con 0x7ff2140ccb20 2024-04-04T16:33:51.704 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:51.698+0000 7ff211600640 1 -- 172.21.15.72:0/2032655293 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff20804c020 con 0x7ff2140ccb20 2024-04-04T16:33:51.704 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:51.699+0000 7ff211600640 1 --2- 172.21.15.72:0/2032655293 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7ff1f406c920 0x7ff1f406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:51.704 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:51.699+0000 7ff211600640 1 -- 172.21.15.72:0/2032655293 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 4943+0+0 (secure 0 0 0) 0x7ff20802f020 con 0x7ff2140ccb20 2024-04-04T16:33:51.705 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:51.704+0000 7ff211600640 1 -- 172.21.15.72:0/2032655293 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7ff208040070 con 0x7ff2140ccb20 2024-04-04T16:33:51.749 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:51.751+0000 7ff218c00640 1 --2- 172.21.15.72:0/2032655293 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7ff1f406c920 0x7ff1f406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:51.750 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:51.752+0000 7ff218c00640 1 --2- 172.21.15.72:0/2032655293 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7ff1f406c920 0x7ff1f406ede0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7ff200000f60 tx=0x7ff200007a80 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T16:33:51.900 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:51.902+0000 7ff21c000640 1 -- 172.21.15.72:0/2032655293 --> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff2140cf4d0 con 0x7ff1f406c920 2024-04-04T16:33:51.901 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:51.903+0000 7ff211600640 1 -- 172.21.15.72:0/2032655293 <== mgr.4101 v2:172.21.15.72:6832/2205173820 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13699 (secure 0 0 0) 0x7ff2140cf4d0 con 0x7ff1f406c920 2024-04-04T16:33:51.901 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T16:33:51.902 INFO:teuthology.orchestra.run.smithi072.stderr:dumped all 2024-04-04T16:33:51.904 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:51.906+0000 7ff21c000640 1 -- 172.21.15.72:0/2032655293 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7ff1f406c920 msgr2=0x7ff1f406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:51.904 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:51.906+0000 7ff21c000640 1 --2- 172.21.15.72:0/2032655293 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7ff1f406c920 0x7ff1f406ede0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7ff200000f60 tx=0x7ff200007a80 comp rx=0 tx=0).stop 2024-04-04T16:33:51.904 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:51.906+0000 7ff21c000640 1 -- 172.21.15.72:0/2032655293 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff2140ccb20 msgr2=0x7ff214152ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:51.904 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:51.906+0000 7ff21c000640 1 --2- 172.21.15.72:0/2032655293 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff2140ccb20 0x7ff214152ff0 secure :-1 s=READY pgs=2173 cs=0 l=1 rev1=1 crypto rx=0x7ff208009890 tx=0x7ff2080046c0 comp rx=0 tx=0).stop 2024-04-04T16:33:51.904 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:51.906+0000 7ff21c000640 1 -- 172.21.15.72:0/2032655293 shutdown_connections 2024-04-04T16:33:51.904 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:51.906+0000 7ff21c000640 1 --2- 172.21.15.72:0/2032655293 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7ff1f406c920 0x7ff1f406ede0 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:51.905 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:51.906+0000 7ff21c000640 1 --2- 172.21.15.72:0/2032655293 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff21415c6b0 0x7ff214158120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:51.905 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:51.906+0000 7ff21c000640 1 --2- 172.21.15.72:0/2032655293 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff21415c2d0 0x7ff2140d07c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:51.905 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:51.906+0000 7ff21c000640 1 --2- 172.21.15.72:0/2032655293 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff2140ccb20 0x7ff214152ff0 unknown :-1 s=CLOSED pgs=2173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:51.905 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:51.906+0000 7ff21c000640 1 -- 172.21.15.72:0/2032655293 >> 172.21.15.72:0/2032655293 conn(0x7ff21406b470 msgr2=0x7ff21415ccb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T16:33:51.905 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:51.906+0000 7ff21c000640 1 -- 172.21.15.72:0/2032655293 shutdown_connections 2024-04-04T16:33:51.905 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:51.906+0000 7ff21c000640 1 -- 172.21.15.72:0/2032655293 wait complete. 2024-04-04T16:33:51.922 INFO:teuthology.orchestra.run.smithi072.stdout:{"pg_ready":true,"pg_map":{"version":17349,"stamp":"2024-04-04T16:33:51.109278+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":96,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":4,"kb":754974720,"kb_used":15238104,"kb_used_data":3278616,"kb_used_omap":3345,"kb_used_meta":11881326,"kb_avail":739736616,"statfs":{"total":773094113280,"available":757490294784,"internally_reserved":0,"allocated":3357302784,"data_stored":3349023133,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3426126,"internal_metadata":12166478002},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":359,"apply_latency_ms":359,"commit_latency_ns":359000000,"apply_latency_ns":359000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-36136723971,"num_objects":-30513,"num_object_clones":0,"num_object_copies":-61026,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-30513,"num_whiteouts":0,"num_read":-1734726,"num_read_kb":-123792727,"num_write":-7439100,"num_write_kb":-160018677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-2144,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.582932"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":489,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-04T16:33:46.576255+0000","last_change":"2024-04-04T06:56:19.364611+0000","last_active":"2024-04-04T16:33:46.576255+0000","last_peered":"2024-04-04T16:33:46.576255+0000","last_clean":"2024-04-04T16:33:46.576255+0000","last_became_active":"2024-04-04T06:56:19.362232+0000","last_became_peered":"2024-04-04T06:56:19.362232+0000","last_unstale":"2024-04-04T16:33:46.576255+0000","last_undegraded":"2024-04-04T16:33:46.576255+0000","last_fullsized":"2024-04-04T16:33:46.576255+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:17.744258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:17.744258+0000","last_clean_scrub_stamp":"2024-04-04T06:56:17.744258+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T17:25:16.494215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834581781,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1733604,"kb_used_data":988,"kb_used_omap":25,"kb_used_meta":1732582,"kb_avail":92638236,"statfs":{"total":96636764160,"available":94861553664,"internally_reserved":0,"allocated":1011712,"data_stored":754625,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":26454,"internal_metadata":1774164138},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":35,"apply_latency_ms":35,"commit_latency_ns":35000000,"apply_latency_ns":35000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834581781,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1417892,"kb_used_data":408,"kb_used_omap":568,"kb_used_meta":1416903,"kb_avail":92953948,"statfs":{"total":96636764160,"available":95184842752,"internally_reserved":0,"allocated":417792,"data_stored":164257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":581652,"internal_metadata":1450909676},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834581780,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1661552,"kb_used_data":10408,"kb_used_omap":393,"kb_used_meta":1650742,"kb_avail":92710288,"statfs":{"total":96636764160,"available":94935334912,"internally_reserved":0,"allocated":10657792,"data_stored":10371296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":403353,"internal_metadata":1690359911},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":54,"apply_latency_ms":54,"commit_latency_ns":54000000,"apply_latency_ns":54000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834581780,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2307100,"kb_used_data":604380,"kb_used_omap":496,"kb_used_meta":1688399,"kb_avail":92064740,"statfs":{"total":96636764160,"available":94274293760,"internally_reserved":0,"allocated":618885120,"data_stored":617428492,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":508871,"internal_metadata":1728920633},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":50,"apply_latency_ms":50,"commit_latency_ns":50000000,"apply_latency_ns":50000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834581743,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1712992,"kb_used_data":408,"kb_used_omap":141,"kb_used_meta":1712434,"kb_avail":92658848,"statfs":{"total":96636764160,"available":94882660352,"internally_reserved":0,"allocated":417792,"data_stored":164257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":145232,"internal_metadata":1753532592},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":57,"apply_latency_ms":57,"commit_latency_ns":57000000,"apply_latency_ns":57000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834581763,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1202272,"kb_used_data":408,"kb_used_omap":450,"kb_used_meta":1201405,"kb_avail":93169568,"statfs":{"total":96636764160,"available":95405637632,"internally_reserved":0,"allocated":417792,"data_stored":164257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":461359,"internal_metadata":1230239185},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":50,"apply_latency_ms":50,"commit_latency_ns":50000000,"apply_latency_ns":50000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834581751,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3422284,"kb_used_data":1695940,"kb_used_omap":803,"kb_used_meta":1664604,"kb_avail":90949556,"statfs":{"total":96636764160,"available":93132345344,"internally_reserved":0,"allocated":1736642560,"data_stored":1733095623,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":823151,"internal_metadata":1704554641},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":62,"apply_latency_ms":62,"commit_latency_ns":62000000,"apply_latency_ns":62000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834581772,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1780408,"kb_used_data":965676,"kb_used_omap":464,"kb_used_meta":814255,"kb_avail":92591432,"statfs":{"total":96636764160,"available":94813626368,"internally_reserved":0,"allocated":988852224,"data_stored":986880326,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":476054,"internal_metadata":833797226},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":33,"apply_latency_ms":33,"commit_latency_ns":33000000,"apply_latency_ns":33000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-04T16:33:51.922 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-04T16:33:51.922 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-04T16:33:52.117 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:52.119+0000 7f7577400640 1 Processor -- start 2024-04-04T16:33:52.117 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:52.119+0000 7f7577400640 1 -- start start 2024-04-04T16:33:52.119 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:52.120+0000 7f7577400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f757015c2d0 0x7f7570071610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:52.119 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:52.120+0000 7f7577400640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f757015c6b0 0x7f75700c5e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:52.119 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:52.120+0000 7f7577400640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f75700c6710 con 0x7f75700ccb20 2024-04-04T16:33:52.119 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:52.121+0000 7f7577400640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f75700c6fb0 con 0x7f757015c6b0 2024-04-04T16:33:52.119 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:52.121+0000 7f7577400640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f75700c69f0 con 0x7f757015c2d0 2024-04-04T16:33:52.120 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:52.121+0000 7f756fe00640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f757015c6b0 0x7f75700c5e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:52.120 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:52.121+0000 7f756fe00640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f757015c6b0 0x7f75700c5e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51558/0 (socket says 172.21.15.72:51558) 2024-04-04T16:33:52.120 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:52.121+0000 7f756fe00640 1 -- 172.21.15.72:0/2462890917 learned_addr learned my addr 172.21.15.72:0/2462890917 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T16:33:52.120 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:52.121+0000 7f7574a00640 1 --2- 172.21.15.72:0/2462890917 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f757015c2d0 0x7f7570071610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:52.120 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:52.121+0000 7f756fe00640 1 -- 172.21.15.72:0/2462890917 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f757015c2d0 msgr2=0x7f7570071610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T16:33:52.120 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:52.121+0000 7f756fe00640 1 --2- 172.21.15.72:0/2462890917 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f757015c2d0 0x7f7570071610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:52.120 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:52.121+0000 7f756fe00640 1 -- 172.21.15.72:0/2462890917 >> v1:172.21.15.117:6789/0 conn(0x7f75700ccb20 legacy=0x7f75700b3ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T16:33:52.120 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:52.121+0000 7f756fe00640 1 -- 172.21.15.72:0/2462890917 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75700c6cd0 con 0x7f757015c6b0 2024-04-04T16:33:52.122 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:52.122+0000 7f756fe00640 1 --2- 172.21.15.72:0/2462890917 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f757015c6b0 0x7f75700c5e50 secure :-1 s=READY pgs=2174 cs=0 l=1 rev1=1 crypto rx=0x7f755c009870 tx=0x7f755c02b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2986269da68a6feb server_cookie=0 in_seq=0 out_seq=0 2024-04-04T16:33:52.122 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:52.123+0000 7f756f400640 1 -- 172.21.15.72:0/2462890917 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f755c0317c0 con 0x7f757015c6b0 2024-04-04T16:33:52.122 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:52.123+0000 7f756f400640 1 -- 172.21.15.72:0/2462890917 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f755c037070 con 0x7f757015c6b0 2024-04-04T16:33:52.122 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:52.123+0000 7f756f400640 1 -- 172.21.15.72:0/2462890917 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f755c031b80 con 0x7f757015c6b0 2024-04-04T16:33:52.122 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:52.123+0000 7f7577400640 1 -- 172.21.15.72:0/2462890917 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f757015c6b0 msgr2=0x7f75700c5e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:52.122 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:52.123+0000 7f7577400640 1 --2- 172.21.15.72:0/2462890917 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f757015c6b0 0x7f75700c5e50 secure :-1 s=READY pgs=2174 cs=0 l=1 rev1=1 crypto rx=0x7f755c009870 tx=0x7f755c02b860 comp rx=0 tx=0).stop 2024-04-04T16:33:52.123 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:52.123+0000 7f7577400640 1 -- 172.21.15.72:0/2462890917 shutdown_connections 2024-04-04T16:33:52.123 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:52.123+0000 7f7577400640 1 --2- 172.21.15.72:0/2462890917 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f757015c6b0 0x7f75700c5e50 unknown :-1 s=CLOSED pgs=2174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:52.123 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:52.123+0000 7f7577400640 1 --2- 172.21.15.72:0/2462890917 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f757015c2d0 0x7f7570071610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:52.123 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:52.123+0000 7f7577400640 1 -- 172.21.15.72:0/2462890917 >> 172.21.15.72:0/2462890917 conn(0x7f757006b470 msgr2=0x7f757006b880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T16:33:52.123 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:52.124+0000 7f7577400640 1 -- 172.21.15.72:0/2462890917 shutdown_connections 2024-04-04T16:33:52.124 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:52.124+0000 7f7577400640 1 -- 172.21.15.72:0/2462890917 wait complete. 2024-04-04T16:33:52.126 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:52.125+0000 7f7577400640 1 Processor -- start 2024-04-04T16:33:52.126 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:52.125+0000 7f7577400640 1 -- start start 2024-04-04T16:33:52.126 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:52.126+0000 7f7577400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f75700ccb20 0x7f75700ae380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:52.126 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:52.126+0000 7f7577400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f757015c2d0 0x7f7570159160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:52.126 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:52.126+0000 7f7577400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f757015c6b0 0x7f7570154070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:52.126 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:52.126+0000 7f7577400640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f75700ccfb0 con 0x7f75700ccb20 2024-04-04T16:33:52.126 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:52.126+0000 7f7577400640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f75700c6390 con 0x7f757015c2d0 2024-04-04T16:33:52.127 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:52.126+0000 7f7577400640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f75700cd130 con 0x7f757015c6b0 2024-04-04T16:33:52.127 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:52.126+0000 7f7574a00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f75700ccb20 0x7f75700ae380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:52.127 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:52.126+0000 7f7574a00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f75700ccb20 0x7f75700ae380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51566/0 (socket says 172.21.15.72:51566) 2024-04-04T16:33:52.127 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:52.126+0000 7f7574a00640 1 -- 172.21.15.72:0/772654296 learned_addr learned my addr 172.21.15.72:0/772654296 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T16:33:52.127 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:52.127+0000 7f7575400640 1 --2- 172.21.15.72:0/772654296 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f757015c6b0 0x7f7570154070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:52.127 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:52.127+0000 7f756fe00640 1 --2- 172.21.15.72:0/772654296 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f757015c2d0 0x7f7570159160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:52.128 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:52.127+0000 7f7574a00640 1 -- 172.21.15.72:0/772654296 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f757015c6b0 msgr2=0x7f7570154070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:52.128 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:52.127+0000 7f7574a00640 1 --2- 172.21.15.72:0/772654296 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f757015c6b0 0x7f7570154070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:52.128 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:52.127+0000 7f7574a00640 1 -- 172.21.15.72:0/772654296 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f757015c2d0 msgr2=0x7f7570159160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:52.128 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:52.127+0000 7f7574a00640 1 --2- 172.21.15.72:0/772654296 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f757015c2d0 0x7f7570159160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:52.128 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:52.127+0000 7f7574a00640 1 -- 172.21.15.72:0/772654296 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f757015a5c0 con 0x7f75700ccb20 2024-04-04T16:33:52.128 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:52.127+0000 7f7575400640 1 --2- 172.21.15.72:0/772654296 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f757015c6b0 0x7f7570154070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-04T16:33:52.128 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:52.127+0000 7f756fe00640 1 --2- 172.21.15.72:0/772654296 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f757015c2d0 0x7f7570159160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-04T16:33:52.128 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:52.127+0000 7f7574a00640 1 --2- 172.21.15.72:0/772654296 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f75700ccb20 0x7f75700ae380 secure :-1 s=READY pgs=2175 cs=0 l=1 rev1=1 crypto rx=0x7f756400d830 tx=0x7f756400dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T16:33:52.129 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:52.127+0000 7f756cc00640 1 -- 172.21.15.72:0/772654296 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f756400b6c0 con 0x7f75700ccb20 2024-04-04T16:33:52.129 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:52.127+0000 7f756cc00640 1 -- 172.21.15.72:0/772654296 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7564019070 con 0x7f75700ccb20 2024-04-04T16:33:52.129 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:52.127+0000 7f7577400640 1 -- 172.21.15.72:0/772654296 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75700cfae0 con 0x7f75700ccb20 2024-04-04T16:33:52.129 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:52.127+0000 7f756cc00640 1 -- 172.21.15.72:0/772654296 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f756400ba80 con 0x7f75700ccb20 2024-04-04T16:33:52.129 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:52.128+0000 7f7577400640 1 -- 172.21.15.72:0/772654296 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75700d00a0 con 0x7f75700ccb20 2024-04-04T16:33:52.130 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:52.129+0000 7f7577400640 1 -- 172.21.15.72:0/772654296 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7570075840 con 0x7f75700ccb20 2024-04-04T16:33:52.130 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:52.129+0000 7f756cc00640 1 -- 172.21.15.72:0/772654296 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f756401e460 con 0x7f75700ccb20 2024-04-04T16:33:52.130 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:52.130+0000 7f756cc00640 1 --2- 172.21.15.72:0/772654296 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f755006c8f0 0x7f755006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:52.130 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:52.130+0000 7f756cc00640 1 -- 172.21.15.72:0/772654296 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 4943+0+0 (secure 0 0 0) 0x7f756408bfd0 con 0x7f75700ccb20 2024-04-04T16:33:52.130 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:52.131+0000 7f756fe00640 1 --2- 172.21.15.72:0/772654296 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f755006c8f0 0x7f755006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:52.130 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:52.131+0000 7f756fe00640 1 --2- 172.21.15.72:0/772654296 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f755006c8f0 0x7f755006edb0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f755c036000 tx=0x7f755c008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T16:33:52.136 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:52.138+0000 7f756cc00640 1 -- 172.21.15.72:0/772654296 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f757015a5c0 con 0x7f75700ccb20 2024-04-04T16:33:52.332 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:52.334+0000 7f7577400640 1 -- 172.21.15.72:0/772654296 --> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f75700ce760 con 0x7f755006c8f0 2024-04-04T16:33:52.333 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:52.336+0000 7f756cc00640 1 -- 172.21.15.72:0/772654296 <== mgr.4101 v2:172.21.15.72:6832/2205173820 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13699 (secure 0 0 0) 0x7f75700ce760 con 0x7f755006c8f0 2024-04-04T16:33:52.334 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T16:33:52.334 INFO:teuthology.orchestra.run.smithi072.stderr:dumped all 2024-04-04T16:33:52.336 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:52.338+0000 7f7577400640 1 -- 172.21.15.72:0/772654296 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f755006c8f0 msgr2=0x7f755006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:52.337 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:52.338+0000 7f7577400640 1 --2- 172.21.15.72:0/772654296 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f755006c8f0 0x7f755006edb0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f755c036000 tx=0x7f755c008030 comp rx=0 tx=0).stop 2024-04-04T16:33:52.337 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:52.338+0000 7f7577400640 1 -- 172.21.15.72:0/772654296 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f75700ccb20 msgr2=0x7f75700ae380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:52.337 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:52.338+0000 7f7577400640 1 --2- 172.21.15.72:0/772654296 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f75700ccb20 0x7f75700ae380 secure :-1 s=READY pgs=2175 cs=0 l=1 rev1=1 crypto rx=0x7f756400d830 tx=0x7f756400dcf0 comp rx=0 tx=0).stop 2024-04-04T16:33:52.337 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:52.339+0000 7f7577400640 1 -- 172.21.15.72:0/772654296 shutdown_connections 2024-04-04T16:33:52.337 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:52.339+0000 7f7577400640 1 --2- 172.21.15.72:0/772654296 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f755006c8f0 0x7f755006edb0 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:52.337 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:52.339+0000 7f7577400640 1 --2- 172.21.15.72:0/772654296 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f757015c6b0 0x7f7570154070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:52.337 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:52.339+0000 7f7577400640 1 --2- 172.21.15.72:0/772654296 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f757015c2d0 0x7f7570159160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:52.338 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:52.339+0000 7f7577400640 1 --2- 172.21.15.72:0/772654296 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f75700ccb20 0x7f75700ae380 unknown :-1 s=CLOSED pgs=2175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:52.338 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:52.339+0000 7f7577400640 1 -- 172.21.15.72:0/772654296 >> 172.21.15.72:0/772654296 conn(0x7f757006b470 msgr2=0x7f75700b0210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T16:33:52.338 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:52.339+0000 7f7577400640 1 -- 172.21.15.72:0/772654296 shutdown_connections 2024-04-04T16:33:52.338 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:52.339+0000 7f7577400640 1 -- 172.21.15.72:0/772654296 wait complete. 2024-04-04T16:33:52.355 INFO:teuthology.orchestra.run.smithi072.stdout:{"pg_ready":true,"pg_map":{"version":17349,"stamp":"2024-04-04T16:33:51.109278+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":96,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":4,"kb":754974720,"kb_used":15238104,"kb_used_data":3278616,"kb_used_omap":3345,"kb_used_meta":11881326,"kb_avail":739736616,"statfs":{"total":773094113280,"available":757490294784,"internally_reserved":0,"allocated":3357302784,"data_stored":3349023133,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3426126,"internal_metadata":12166478002},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":359,"apply_latency_ms":359,"commit_latency_ns":359000000,"apply_latency_ns":359000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-36136723971,"num_objects":-30513,"num_object_clones":0,"num_object_copies":-61026,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-30513,"num_whiteouts":0,"num_read":-1734726,"num_read_kb":-123792727,"num_write":-7439100,"num_write_kb":-160018677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-2144,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.582932"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":489,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-04T16:33:46.576255+0000","last_change":"2024-04-04T06:56:19.364611+0000","last_active":"2024-04-04T16:33:46.576255+0000","last_peered":"2024-04-04T16:33:46.576255+0000","last_clean":"2024-04-04T16:33:46.576255+0000","last_became_active":"2024-04-04T06:56:19.362232+0000","last_became_peered":"2024-04-04T06:56:19.362232+0000","last_unstale":"2024-04-04T16:33:46.576255+0000","last_undegraded":"2024-04-04T16:33:46.576255+0000","last_fullsized":"2024-04-04T16:33:46.576255+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:17.744258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:17.744258+0000","last_clean_scrub_stamp":"2024-04-04T06:56:17.744258+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T17:25:16.494215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834581781,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1733604,"kb_used_data":988,"kb_used_omap":25,"kb_used_meta":1732582,"kb_avail":92638236,"statfs":{"total":96636764160,"available":94861553664,"internally_reserved":0,"allocated":1011712,"data_stored":754625,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":26454,"internal_metadata":1774164138},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":35,"apply_latency_ms":35,"commit_latency_ns":35000000,"apply_latency_ns":35000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834581781,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1417892,"kb_used_data":408,"kb_used_omap":568,"kb_used_meta":1416903,"kb_avail":92953948,"statfs":{"total":96636764160,"available":95184842752,"internally_reserved":0,"allocated":417792,"data_stored":164257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":581652,"internal_metadata":1450909676},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834581780,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1661552,"kb_used_data":10408,"kb_used_omap":393,"kb_used_meta":1650742,"kb_avail":92710288,"statfs":{"total":96636764160,"available":94935334912,"internally_reserved":0,"allocated":10657792,"data_stored":10371296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":403353,"internal_metadata":1690359911},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":54,"apply_latency_ms":54,"commit_latency_ns":54000000,"apply_latency_ns":54000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834581780,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2307100,"kb_used_data":604380,"kb_used_omap":496,"kb_used_meta":1688399,"kb_avail":92064740,"statfs":{"total":96636764160,"available":94274293760,"internally_reserved":0,"allocated":618885120,"data_stored":617428492,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":508871,"internal_metadata":1728920633},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":50,"apply_latency_ms":50,"commit_latency_ns":50000000,"apply_latency_ns":50000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834581743,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1712992,"kb_used_data":408,"kb_used_omap":141,"kb_used_meta":1712434,"kb_avail":92658848,"statfs":{"total":96636764160,"available":94882660352,"internally_reserved":0,"allocated":417792,"data_stored":164257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":145232,"internal_metadata":1753532592},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":57,"apply_latency_ms":57,"commit_latency_ns":57000000,"apply_latency_ns":57000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834581763,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1202272,"kb_used_data":408,"kb_used_omap":450,"kb_used_meta":1201405,"kb_avail":93169568,"statfs":{"total":96636764160,"available":95405637632,"internally_reserved":0,"allocated":417792,"data_stored":164257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":461359,"internal_metadata":1230239185},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":50,"apply_latency_ms":50,"commit_latency_ns":50000000,"apply_latency_ns":50000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834581751,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3422284,"kb_used_data":1695940,"kb_used_omap":803,"kb_used_meta":1664604,"kb_avail":90949556,"statfs":{"total":96636764160,"available":93132345344,"internally_reserved":0,"allocated":1736642560,"data_stored":1733095623,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":823151,"internal_metadata":1704554641},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":62,"apply_latency_ms":62,"commit_latency_ns":62000000,"apply_latency_ns":62000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834581772,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1780408,"kb_used_data":965676,"kb_used_omap":464,"kb_used_meta":814255,"kb_avail":92591432,"statfs":{"total":96636764160,"available":94813626368,"internally_reserved":0,"allocated":988852224,"data_stored":986880326,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":476054,"internal_metadata":833797226},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":33,"apply_latency_ms":33,"commit_latency_ns":33000000,"apply_latency_ns":33000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-04T16:33:52.357 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-04T16:33:52.560 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:52.562+0000 7f23dd800640 1 Processor -- start 2024-04-04T16:33:52.560 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:52.562+0000 7f23dd800640 1 -- start start 2024-04-04T16:33:52.561 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:52.563+0000 7f23dd800640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f23d815e5a0 0x7f23d80b75c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:52.561 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:52.563+0000 7f23dd800640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f23d80d3540 0x7f23d80d08e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:52.561 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:52.564+0000 7f23dd800640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23d80cf7f0 con 0x7f23d80b7b00 2024-04-04T16:33:52.562 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:52.564+0000 7f23dd800640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f23d80cfad0 con 0x7f23d80d3540 2024-04-04T16:33:52.562 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:52.564+0000 7f23dd800640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f23d80d2350 con 0x7f23d815e5a0 2024-04-04T16:33:52.563 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:52.564+0000 7f23d7400640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f23d80b7b00 0x7f23d80d2e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:39486/0 (socket says 172.21.15.72:39486) 2024-04-04T16:33:52.563 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:52.564+0000 7f23d7400640 1 -- 172.21.15.72:0/3110176676 learned_addr learned my addr 172.21.15.72:0/3110176676 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-04-04T16:33:52.563 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:52.564+0000 7f23dce00640 1 --2- 172.21.15.72:0/3110176676 >> v2:172.21.15.72:3300/0 conn(0x7f23d80d3540 0x7f23d80d08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:52.563 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:52.564+0000 7f23d7e00640 1 --2- 172.21.15.72:0/3110176676 >> v2:172.21.15.117:3300/0 conn(0x7f23d815e5a0 0x7f23d80b75c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:52.563 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:52.564+0000 7f23dce00640 1 -- 172.21.15.72:0/3110176676 >> v2:172.21.15.117:3300/0 conn(0x7f23d815e5a0 msgr2=0x7f23d80b75c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T16:33:52.563 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:52.564+0000 7f23dce00640 1 --2- 172.21.15.72:0/3110176676 >> v2:172.21.15.117:3300/0 conn(0x7f23d815e5a0 0x7f23d80b75c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:52.563 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:52.564+0000 7f23dce00640 1 -- 172.21.15.72:0/3110176676 >> v1:172.21.15.72:6789/0 conn(0x7f23d80b7b00 legacy=0x7f23d80d2e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:52.564 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:52.565+0000 7f23dce00640 1 -- 172.21.15.72:0/3110176676 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23d80d2630 con 0x7f23d80d3540 2024-04-04T16:33:52.564 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:52.565+0000 7f23d6a00640 1 -- 172.21.15.72:0/3110176676 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3448891153 0 0) 0x7f23d80cf7f0 con 0x7f23d80b7b00 2024-04-04T16:33:52.565 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:52.566+0000 7f23dce00640 1 --2- 172.21.15.72:0/3110176676 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f23d80d3540 0x7f23d80d08e0 secure :-1 s=READY pgs=2177 cs=0 l=1 rev1=1 crypto rx=0x7f23d80d1820 tx=0x7f23d002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6468dafdae60b504 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T16:33:52.565 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:52.566+0000 7f23d6a00640 1 -- 172.21.15.72:0/3110176676 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23d0039070 con 0x7f23d80d3540 2024-04-04T16:33:52.565 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:52.566+0000 7f23d6a00640 1 -- 172.21.15.72:0/3110176676 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23d002cc80 con 0x7f23d80d3540 2024-04-04T16:33:52.565 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:52.566+0000 7f23d6a00640 1 -- 172.21.15.72:0/3110176676 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23d0034660 con 0x7f23d80d3540 2024-04-04T16:33:52.565 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:52.567+0000 7f23dd800640 1 -- 172.21.15.72:0/3110176676 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f23d80d3540 msgr2=0x7f23d80d08e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:52.565 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:52.567+0000 7f23dd800640 1 --2- 172.21.15.72:0/3110176676 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f23d80d3540 0x7f23d80d08e0 secure :-1 s=READY pgs=2177 cs=0 l=1 rev1=1 crypto rx=0x7f23d80d1820 tx=0x7f23d002bed0 comp rx=0 tx=0).stop 2024-04-04T16:33:52.565 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:52.567+0000 7f23dd800640 1 -- 172.21.15.72:0/3110176676 shutdown_connections 2024-04-04T16:33:52.566 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:52.567+0000 7f23dd800640 1 --2- 172.21.15.72:0/3110176676 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f23d80d3540 0x7f23d80d08e0 unknown :-1 s=CLOSED pgs=2177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:52.566 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:52.567+0000 7f23dd800640 1 --2- 172.21.15.72:0/3110176676 >> v2:172.21.15.117:3300/0 conn(0x7f23d815e5a0 0x7f23d80b75c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:52.566 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:52.567+0000 7f23dd800640 1 -- 172.21.15.72:0/3110176676 >> 172.21.15.72:0/3110176676 conn(0x7f23d806b890 msgr2=0x7f23d806bca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T16:33:52.566 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:52.567+0000 7f23dd800640 1 -- 172.21.15.72:0/3110176676 shutdown_connections 2024-04-04T16:33:52.566 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:52.567+0000 7f23dd800640 1 -- 172.21.15.72:0/3110176676 wait complete. 2024-04-04T16:33:52.567 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:52.568+0000 7f23dd800640 1 Processor -- start 2024-04-04T16:33:52.567 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:52.569+0000 7f23dd800640 1 -- start start 2024-04-04T16:33:52.569 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:52.569+0000 7f23dd800640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f23d80b7b00 0x7f23d8151fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:52.569 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:52.570+0000 7f23dd800640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f23d80d3540 0x7f23d80b45b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:52.569 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:52.570+0000 7f23dd800640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f23d815e5a0 0x7f23d80b4af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:52.569 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:52.570+0000 7f23dd800640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f23d80d0e20 con 0x7f23d815e5a0 2024-04-04T16:33:52.569 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:52.570+0000 7f23dd800640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f23d815e980 con 0x7f23d80d3540 2024-04-04T16:33:52.569 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:52.570+0000 7f23dd800640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f23d80d0fa0 con 0x7f23d80b7b00 2024-04-04T16:33:52.569 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:52.570+0000 7f23dce00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f23d815e5a0 0x7f23d80b4af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:52.569 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:52.570+0000 7f23dce00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f23d815e5a0 0x7f23d80b4af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51578/0 (socket says 172.21.15.72:51578) 2024-04-04T16:33:52.570 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:52.570+0000 7f23dce00640 1 -- 172.21.15.72:0/2856230943 learned_addr learned my addr 172.21.15.72:0/2856230943 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T16:33:52.570 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:52.570+0000 7f23dce00640 1 -- 172.21.15.72:0/2856230943 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f23d80b7b00 msgr2=0x7f23d8151fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:52.570 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:52.570+0000 7f23dce00640 1 --2- 172.21.15.72:0/2856230943 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f23d80b7b00 0x7f23d8151fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:52.570 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:52.570+0000 7f23dce00640 1 -- 172.21.15.72:0/2856230943 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f23d80d3540 msgr2=0x7f23d80b45b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:52.570 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:52.570+0000 7f23dce00640 1 --2- 172.21.15.72:0/2856230943 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f23d80d3540 0x7f23d80b45b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:52.570 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:52.570+0000 7f23dce00640 1 -- 172.21.15.72:0/2856230943 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23d81f4e80 con 0x7f23d815e5a0 2024-04-04T16:33:52.570 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:52.570+0000 7f23dce00640 1 --2- 172.21.15.72:0/2856230943 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f23d815e5a0 0x7f23d80b4af0 secure :-1 s=READY pgs=2178 cs=0 l=1 rev1=1 crypto rx=0x7f23d0009e80 tx=0x7f23d0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T16:33:52.570 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:52.571+0000 7f23cfe00640 1 -- 172.21.15.72:0/2856230943 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23d0044020 con 0x7f23d815e5a0 2024-04-04T16:33:52.571 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:52.571+0000 7f23cfe00640 1 -- 172.21.15.72:0/2856230943 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23d003a040 con 0x7f23d815e5a0 2024-04-04T16:33:52.571 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:52.571+0000 7f23cfe00640 1 -- 172.21.15.72:0/2856230943 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23d0039050 con 0x7f23d815e5a0 2024-04-04T16:33:52.571 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:52.571+0000 7f23dd800640 1 -- 172.21.15.72:0/2856230943 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23d80b50e0 con 0x7f23d815e5a0 2024-04-04T16:33:52.571 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:52.571+0000 7f23dd800640 1 -- 172.21.15.72:0/2856230943 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23d81f77d0 con 0x7f23d815e5a0 2024-04-04T16:33:52.572 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:52.572+0000 7f23dd800640 1 -- 172.21.15.72:0/2856230943 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23d80756c0 con 0x7f23d815e5a0 2024-04-04T16:33:52.572 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:52.573+0000 7f23cfe00640 1 -- 172.21.15.72:0/2856230943 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f23d0003b90 con 0x7f23d815e5a0 2024-04-04T16:33:52.572 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:52.574+0000 7f23cfe00640 1 --2- 172.21.15.72:0/2856230943 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f23b806c8f0 0x7f23b806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:52.572 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:52.574+0000 7f23cfe00640 1 -- 172.21.15.72:0/2856230943 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 4943+0+0 (secure 0 0 0) 0x7f23d00adf70 con 0x7f23d815e5a0 2024-04-04T16:33:52.572 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:52.574+0000 7f23d7e00640 1 --2- 172.21.15.72:0/2856230943 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f23b806c8f0 0x7f23b806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:52.573 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:52.575+0000 7f23d7e00640 1 --2- 172.21.15.72:0/2856230943 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f23b806c8f0 0x7f23b806edb0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f23c8006fd0 tx=0x7f23c8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T16:33:52.576 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:52.578+0000 7f23cfe00640 1 -- 172.21.15.72:0/2856230943 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f23d004e020 con 0x7f23d815e5a0 2024-04-04T16:33:52.795 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:52.797+0000 7f23dd800640 1 -- 172.21.15.72:0/2856230943 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f23d80d2090 con 0x7f23d815e5a0 2024-04-04T16:33:52.797 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:52.799+0000 7f23cfe00640 1 -- 172.21.15.72:0/2856230943 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) ==== 74+0+12996 (secure 0 0 0) 0x7f23d007c730 con 0x7f23d815e5a0 2024-04-04T16:33:52.798 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T16:33:52.798 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":36,"fsid":"6708bac2-4f50-49b5-87a9-c390fd333eb3","created":"2024-04-04T06:56:04.282498+0000","modified":"2024-04-04T16:33:46.556061+0000","last_up_change":"2024-04-04T06:56:16.716089+0000","last_in_change":"2024-04-04T06:56:07.768593+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-04T06:56:17.421685+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7c345991-5af8-4dc6-a481-28610c40e128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":3889813953},{"type":"v1","addr":"172.21.15.72:6818","nonce":3889813953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":3889813953},{"type":"v1","addr":"172.21.15.72:6821","nonce":3889813953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":3889813953},{"type":"v1","addr":"172.21.15.72:6826","nonce":3889813953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":3889813953},{"type":"v1","addr":"172.21.15.72:6823","nonce":3889813953}]},"public_addr":"172.21.15.72:6818/3889813953","cluster_addr":"172.21.15.72:6821/3889813953","heartbeat_back_addr":"172.21.15.72:6826/3889813953","heartbeat_front_addr":"172.21.15.72:6823/3889813953","state":["exists","up"]},{"osd":1,"uuid":"1b3f7ab2-a56c-488d-a89a-1f3572361c95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":3101663154},{"type":"v1","addr":"172.21.15.72:6801","nonce":3101663154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":3101663154},{"type":"v1","addr":"172.21.15.72:6803","nonce":3101663154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":3101663154},{"type":"v1","addr":"172.21.15.72:6807","nonce":3101663154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":3101663154},{"type":"v1","addr":"172.21.15.72:6805","nonce":3101663154}]},"public_addr":"172.21.15.72:6801/3101663154","cluster_addr":"172.21.15.72:6803/3101663154","heartbeat_back_addr":"172.21.15.72:6807/3101663154","heartbeat_front_addr":"172.21.15.72:6805/3101663154","state":["exists","up"]},{"osd":2,"uuid":"fc9aa512-53df-40d7-ba04-3e6b7dcd1e34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":235374192},{"type":"v1","addr":"172.21.15.72:6809","nonce":235374192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":235374192},{"type":"v1","addr":"172.21.15.72:6811","nonce":235374192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":235374192},{"type":"v1","addr":"172.21.15.72:6815","nonce":235374192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":235374192},{"type":"v1","addr":"172.21.15.72:6813","nonce":235374192}]},"public_addr":"172.21.15.72:6809/235374192","cluster_addr":"172.21.15.72:6811/235374192","heartbeat_back_addr":"172.21.15.72:6815/235374192","heartbeat_front_addr":"172.21.15.72:6813/235374192","state":["exists","up"]},{"osd":3,"uuid":"b4f63eed-dc5b-4aba-bb50-de46eb41492b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6817","nonce":2806631742},{"type":"v1","addr":"172.21.15.72:6819","nonce":2806631742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":2806631742},{"type":"v1","addr":"172.21.15.72:6827","nonce":2806631742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":2806631742},{"type":"v1","addr":"172.21.15.72:6831","nonce":2806631742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":2806631742},{"type":"v1","addr":"172.21.15.72:6829","nonce":2806631742}]},"public_addr":"172.21.15.72:6819/2806631742","cluster_addr":"172.21.15.72:6827/2806631742","heartbeat_back_addr":"172.21.15.72:6831/2806631742","heartbeat_front_addr":"172.21.15.72:6829/2806631742","state":["exists","up"]},{"osd":4,"uuid":"9e985ef8-d711-4172-9286-c54e560895d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":4293536423},{"type":"v1","addr":"172.21.15.117:6825","nonce":4293536423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":4293536423},{"type":"v1","addr":"172.21.15.117:6827","nonce":4293536423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":4293536423},{"type":"v1","addr":"172.21.15.117:6831","nonce":4293536423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":4293536423},{"type":"v1","addr":"172.21.15.117:6829","nonce":4293536423}]},"public_addr":"172.21.15.117:6825/4293536423","cluster_addr":"172.21.15.117:6827/4293536423","heartbeat_back_addr":"172.21.15.117:6831/4293536423","heartbeat_front_addr":"172.21.15.117:6829/4293536423","state":["exists","up"]},{"osd":5,"uuid":"3e9f082b-8d7d-455f-8a96-66d0b4857125","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":684971679},{"type":"v1","addr":"172.21.15.117:6801","nonce":684971679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":684971679},{"type":"v1","addr":"172.21.15.117:6803","nonce":684971679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":684971679},{"type":"v1","addr":"172.21.15.117:6807","nonce":684971679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":684971679},{"type":"v1","addr":"172.21.15.117:6805","nonce":684971679}]},"public_addr":"172.21.15.117:6801/684971679","cluster_addr":"172.21.15.117:6803/684971679","heartbeat_back_addr":"172.21.15.117:6807/684971679","heartbeat_front_addr":"172.21.15.117:6805/684971679","state":["exists","up"]},{"osd":6,"uuid":"bcdafa9f-a870-4398-a38d-ab7697676473","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":2781186528},{"type":"v1","addr":"172.21.15.117:6809","nonce":2781186528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":2781186528},{"type":"v1","addr":"172.21.15.117:6811","nonce":2781186528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":2781186528},{"type":"v1","addr":"172.21.15.117:6815","nonce":2781186528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":2781186528},{"type":"v1","addr":"172.21.15.117:6813","nonce":2781186528}]},"public_addr":"172.21.15.117:6809/2781186528","cluster_addr":"172.21.15.117:6811/2781186528","heartbeat_back_addr":"172.21.15.117:6815/2781186528","heartbeat_front_addr":"172.21.15.117:6813/2781186528","state":["exists","up"]},{"osd":7,"uuid":"b68ec562-ff35-4d2d-a733-c896f8920cfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":617469882},{"type":"v1","addr":"172.21.15.117:6817","nonce":617469882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":617469882},{"type":"v1","addr":"172.21.15.117:6819","nonce":617469882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":617469882},{"type":"v1","addr":"172.21.15.117:6823","nonce":617469882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":617469882},{"type":"v1","addr":"172.21.15.117:6821","nonce":617469882}]},"public_addr":"172.21.15.117:6817/617469882","cluster_addr":"172.21.15.117:6819/617469882","heartbeat_back_addr":"172.21.15.117:6823/617469882","heartbeat_front_addr":"172.21.15.117:6821/617469882","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.347700+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.296619+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.361345+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.093323+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:12.857605+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:12.816090+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.083163+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-04T06:56:13.121639+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.72:6837/2509618069":"2024-04-05T16:33:43.376918+0000","172.21.15.72:6835/2509618069":"2024-04-05T16:33:43.376918+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-04T16:33:52.800 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:52.802+0000 7f23dd800640 1 -- 172.21.15.72:0/2856230943 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f23b806c8f0 msgr2=0x7f23b806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:52.800 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:52.802+0000 7f23dd800640 1 --2- 172.21.15.72:0/2856230943 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f23b806c8f0 0x7f23b806edb0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f23c8006fd0 tx=0x7f23c8008040 comp rx=0 tx=0).stop 2024-04-04T16:33:52.800 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:52.802+0000 7f23dd800640 1 -- 172.21.15.72:0/2856230943 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f23d815e5a0 msgr2=0x7f23d80b4af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:52.800 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:52.802+0000 7f23dd800640 1 --2- 172.21.15.72:0/2856230943 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f23d815e5a0 0x7f23d80b4af0 secure :-1 s=READY pgs=2178 cs=0 l=1 rev1=1 crypto rx=0x7f23d0009e80 tx=0x7f23d0004a40 comp rx=0 tx=0).stop 2024-04-04T16:33:52.801 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:52.802+0000 7f23dd800640 1 -- 172.21.15.72:0/2856230943 shutdown_connections 2024-04-04T16:33:52.801 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:52.802+0000 7f23dd800640 1 --2- 172.21.15.72:0/2856230943 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f23b806c8f0 0x7f23b806edb0 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:52.801 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:52.802+0000 7f23dd800640 1 --2- 172.21.15.72:0/2856230943 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f23d815e5a0 0x7f23d80b4af0 unknown :-1 s=CLOSED pgs=2178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:52.801 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:52.802+0000 7f23dd800640 1 --2- 172.21.15.72:0/2856230943 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f23d80d3540 0x7f23d80b45b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:52.801 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:52.802+0000 7f23dd800640 1 --2- 172.21.15.72:0/2856230943 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f23d80b7b00 0x7f23d8151fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:52.801 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:52.802+0000 7f23dd800640 1 -- 172.21.15.72:0/2856230943 >> 172.21.15.72:0/2856230943 conn(0x7f23d806b890 msgr2=0x7f23d80ce920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T16:33:52.801 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:52.802+0000 7f23dd800640 1 -- 172.21.15.72:0/2856230943 shutdown_connections 2024-04-04T16:33:52.802 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:52.802+0000 7f23dd800640 1 -- 172.21.15.72:0/2856230943 wait complete. 2024-04-04T16:33:53.820 INFO:tasks.ceph:Scrubbing osd.0 2024-04-04T16:33:53.821 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-04-04T16:33:54.033 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.035+0000 7f9cf2600640 1 Processor -- start 2024-04-04T16:33:54.033 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.035+0000 7f9cf2600640 1 -- start start 2024-04-04T16:33:54.035 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.037+0000 7f9cf2600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9cec15f4f0 0x7f9cec155920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:54.035 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.037+0000 7f9cf2600640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f9cec0cf0a0 0x7f9cec06b500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:54.036 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.037+0000 7f9cf2600640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9cec0cf5a0 con 0x7f9cec155540 2024-04-04T16:33:54.036 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.037+0000 7f9cf2600640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f9cec0cf880 con 0x7f9cec0cf0a0 2024-04-04T16:33:54.036 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.037+0000 7f9cf2600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f9cec0cfb60 con 0x7f9cec15f4f0 2024-04-04T16:33:54.036 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.037+0000 7f9cebe00640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f9cec0cf0a0 0x7f9cec06b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:54.036 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.037+0000 7f9cebe00640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f9cec0cf0a0 0x7f9cec06b500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51584/0 (socket says 172.21.15.72:51584) 2024-04-04T16:33:54.036 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.037+0000 7f9cebe00640 1 -- 172.21.15.72:0/3114005201 learned_addr learned my addr 172.21.15.72:0/3114005201 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T16:33:54.036 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.037+0000 7f9ce2a00640 1 --2- 172.21.15.72:0/3114005201 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9cec15f4f0 0x7f9cec155920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:54.037 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.038+0000 7f9cebe00640 1 -- 172.21.15.72:0/3114005201 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9cec15f4f0 msgr2=0x7f9cec155920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T16:33:54.037 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.038+0000 7f9cebe00640 1 --2- 172.21.15.72:0/3114005201 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9cec15f4f0 0x7f9cec155920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:54.037 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.038+0000 7f9cebe00640 1 -- 172.21.15.72:0/3114005201 >> v1:172.21.15.117:6789/0 conn(0x7f9cec155540 legacy=0x7f9cec15ede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:54.037 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.038+0000 7f9cebe00640 1 -- 172.21.15.72:0/3114005201 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cec0cfe40 con 0x7f9cec0cf0a0 2024-04-04T16:33:54.038 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.039+0000 7f9cebe00640 1 --2- 172.21.15.72:0/3114005201 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9cec0cf0a0 0x7f9cec06b500 secure :-1 s=READY pgs=2179 cs=0 l=1 rev1=1 crypto rx=0x7f9ce4009e50 tx=0x7f9ce402bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a81e135afc9be2f1 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T16:33:54.038 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.039+0000 7f9ceaa00640 1 -- 172.21.15.72:0/3114005201 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ce402cb00 con 0x7f9cec0cf0a0 2024-04-04T16:33:54.039 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.039+0000 7f9ceaa00640 1 -- 172.21.15.72:0/3114005201 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ce402cca0 con 0x7f9cec0cf0a0 2024-04-04T16:33:54.039 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.039+0000 7f9ceaa00640 1 -- 172.21.15.72:0/3114005201 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ce4034610 con 0x7f9cec0cf0a0 2024-04-04T16:33:54.039 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.040+0000 7f9cf2600640 1 -- 172.21.15.72:0/3114005201 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9cec0cf0a0 msgr2=0x7f9cec06b500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:54.039 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.040+0000 7f9cf2600640 1 --2- 172.21.15.72:0/3114005201 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9cec0cf0a0 0x7f9cec06b500 secure :-1 s=READY pgs=2179 cs=0 l=1 rev1=1 crypto rx=0x7f9ce4009e50 tx=0x7f9ce402bf60 comp rx=0 tx=0).stop 2024-04-04T16:33:54.039 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.040+0000 7f9cf2600640 1 -- 172.21.15.72:0/3114005201 shutdown_connections 2024-04-04T16:33:54.039 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.040+0000 7f9cf2600640 1 --2- 172.21.15.72:0/3114005201 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9cec0cf0a0 0x7f9cec06b500 unknown :-1 s=CLOSED pgs=2179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:54.039 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.040+0000 7f9cf2600640 1 --2- 172.21.15.72:0/3114005201 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9cec15f4f0 0x7f9cec155920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:54.040 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.040+0000 7f9cf2600640 1 -- 172.21.15.72:0/3114005201 >> 172.21.15.72:0/3114005201 conn(0x7f9cec0cda40 msgr2=0x7f9cec0cde20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T16:33:54.040 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.040+0000 7f9cf2600640 1 -- 172.21.15.72:0/3114005201 shutdown_connections 2024-04-04T16:33:54.040 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.040+0000 7f9cf2600640 1 -- 172.21.15.72:0/3114005201 wait complete. 2024-04-04T16:33:54.042 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.041+0000 7f9cf2600640 1 Processor -- start 2024-04-04T16:33:54.042 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.042+0000 7f9cf2600640 1 -- start start 2024-04-04T16:33:54.042 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.042+0000 7f9cf2600640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9cec0cf0a0 0x7f9cec0a19d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:54.042 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.043+0000 7f9cf2600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9cec155540 0x7f9cec0c6840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:54.043 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.043+0000 7f9cf2600640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9cec15f4f0 0x7f9cec1f1be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:54.043 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.043+0000 7f9cf2600640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f9cec06bbc0 con 0x7f9cec0cf0a0 2024-04-04T16:33:54.043 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.043+0000 7f9cf2600640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f9cec06ba40 con 0x7f9cec15f4f0 2024-04-04T16:33:54.043 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.043+0000 7f9cf2600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f9cec06bd40 con 0x7f9cec155540 2024-04-04T16:33:54.043 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.043+0000 7f9ceb400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9cec0cf0a0 0x7f9cec0a19d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:54.043 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.043+0000 7f9ceb400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9cec0cf0a0 0x7f9cec0a19d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51594/0 (socket says 172.21.15.72:51594) 2024-04-04T16:33:54.043 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.043+0000 7f9ceb400640 1 -- 172.21.15.72:0/1422838884 learned_addr learned my addr 172.21.15.72:0/1422838884 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T16:33:54.043 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.043+0000 7f9ceb400640 1 -- 172.21.15.72:0/1422838884 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9cec155540 msgr2=0x7f9cec0c6840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:54.044 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.043+0000 7f9ceb400640 1 --2- 172.21.15.72:0/1422838884 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9cec155540 0x7f9cec0c6840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:54.044 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.043+0000 7f9ceb400640 1 -- 172.21.15.72:0/1422838884 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9cec15f4f0 msgr2=0x7f9cec1f1be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:54.044 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.043+0000 7f9cebe00640 1 --2- 172.21.15.72:0/1422838884 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9cec15f4f0 0x7f9cec1f1be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:54.044 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.043+0000 7f9ceb400640 1 --2- 172.21.15.72:0/1422838884 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9cec15f4f0 0x7f9cec1f1be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:54.044 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.043+0000 7f9ceb400640 1 -- 172.21.15.72:0/1422838884 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cec0a0930 con 0x7f9cec0cf0a0 2024-04-04T16:33:54.044 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.044+0000 7f9ceb400640 1 --2- 172.21.15.72:0/1422838884 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9cec0cf0a0 0x7f9cec0a19d0 secure :-1 s=READY pgs=2180 cs=0 l=1 rev1=1 crypto rx=0x7f9cdc00c480 tx=0x7f9cdc00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T16:33:54.044 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.044+0000 7f9ce3e00640 1 -- 172.21.15.72:0/1422838884 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cdc0052d0 con 0x7f9cec0cf0a0 2024-04-04T16:33:54.044 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.044+0000 7f9ce3e00640 1 -- 172.21.15.72:0/1422838884 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9cdc005470 con 0x7f9cec0cf0a0 2024-04-04T16:33:54.044 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.044+0000 7f9ce3e00640 1 -- 172.21.15.72:0/1422838884 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cdc012870 con 0x7f9cec0cf0a0 2024-04-04T16:33:54.045 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.044+0000 7f9cf2600640 1 -- 172.21.15.72:0/1422838884 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9cec0a0c10 con 0x7f9cec0cf0a0 2024-04-04T16:33:54.045 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.044+0000 7f9cf2600640 1 -- 172.21.15.72:0/1422838884 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9cec0a11d0 con 0x7f9cec0cf0a0 2024-04-04T16:33:54.047 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.045+0000 7f9cf2600640 1 -- 172.21.15.72:0/1422838884 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9cec075840 con 0x7f9cec0cf0a0 2024-04-04T16:33:54.047 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.046+0000 7f9ce3e00640 1 -- 172.21.15.72:0/1422838884 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9cdc012a10 con 0x7f9cec0cf0a0 2024-04-04T16:33:54.047 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.047+0000 7f9ce3e00640 1 --2- 172.21.15.72:0/1422838884 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f9cc806c920 0x7f9cc806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:54.047 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.047+0000 7f9ce3e00640 1 -- 172.21.15.72:0/1422838884 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 4943+0+0 (secure 0 0 0) 0x7f9cdc08bf30 con 0x7f9cec0cf0a0 2024-04-04T16:33:54.047 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.047+0000 7f9ce2a00640 1 --2- 172.21.15.72:0/1422838884 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f9cc806c920 0x7f9cc806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:54.047 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.047+0000 7f9ce3e00640 1 --2- 172.21.15.72:0/1422838884 >> [v2:172.21.15.72:6816/3889813953,v1:172.21.15.72:6818/3889813953] conn(0x7f9cc80727e0 0x7f9cc8074c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:54.047 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.047+0000 7f9ce3e00640 1 -- 172.21.15.72:0/1422838884 --> [v2:172.21.15.72:6816/3889813953,v1:172.21.15.72:6818/3889813953] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9cdc015ec0 con 0x7f9cc80727e0 2024-04-04T16:33:54.048 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.048+0000 7f9ce3e00640 1 -- 172.21.15.72:0/1422838884 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f9cdc08c2e0 con 0x7f9cec0cf0a0 2024-04-04T16:33:54.048 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.048+0000 7f9cebe00640 1 --2- 172.21.15.72:0/1422838884 >> [v2:172.21.15.72:6816/3889813953,v1:172.21.15.72:6818/3889813953] conn(0x7f9cc80727e0 0x7f9cc8074c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:54.048 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.048+0000 7f9ce2a00640 1 --2- 172.21.15.72:0/1422838884 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f9cc806c920 0x7f9cc806ede0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f9cd4006fd0 tx=0x7f9cd4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T16:33:54.048 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.048+0000 7f9cebe00640 1 --2- 172.21.15.72:0/1422838884 >> [v2:172.21.15.72:6816/3889813953,v1:172.21.15.72:6818/3889813953] conn(0x7f9cc80727e0 0x7f9cc8074c00 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T16:33:54.048 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.049+0000 7f9ce3e00640 1 -- 172.21.15.72:0/1422838884 <== osd.0 v2:172.21.15.72:6816/3889813953 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9cdc015ec0 con 0x7f9cc80727e0 2024-04-04T16:33:54.061 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.063+0000 7f9cf2600640 1 -- 172.21.15.72:0/1422838884 --> [v2:172.21.15.72:6816/3889813953,v1:172.21.15.72:6818/3889813953] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f9cec070740 con 0x7f9cc80727e0 2024-04-04T16:33:54.061 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.064+0000 7f9ce3e00640 1 -- 172.21.15.72:0/1422838884 <== osd.0 v2:172.21.15.72:6816/3889813953 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f9cec070740 con 0x7f9cc80727e0 2024-04-04T16:33:54.062 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-04T16:33:54.062 INFO:teuthology.orchestra.run.smithi072.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-04T16:33:54.062 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-04T16:33:54.063 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.064+0000 7f9cf2600640 1 -- 172.21.15.72:0/1422838884 >> [v2:172.21.15.72:6816/3889813953,v1:172.21.15.72:6818/3889813953] conn(0x7f9cc80727e0 msgr2=0x7f9cc8074c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:54.063 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.064+0000 7f9cf2600640 1 --2- 172.21.15.72:0/1422838884 >> [v2:172.21.15.72:6816/3889813953,v1:172.21.15.72:6818/3889813953] conn(0x7f9cc80727e0 0x7f9cc8074c00 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:54.064 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.064+0000 7f9cf2600640 1 -- 172.21.15.72:0/1422838884 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f9cc806c920 msgr2=0x7f9cc806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:54.064 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.064+0000 7f9cf2600640 1 --2- 172.21.15.72:0/1422838884 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f9cc806c920 0x7f9cc806ede0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f9cd4006fd0 tx=0x7f9cd4008040 comp rx=0 tx=0).stop 2024-04-04T16:33:54.064 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.064+0000 7f9cf2600640 1 -- 172.21.15.72:0/1422838884 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9cec0cf0a0 msgr2=0x7f9cec0a19d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:54.064 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.064+0000 7f9cf2600640 1 --2- 172.21.15.72:0/1422838884 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9cec0cf0a0 0x7f9cec0a19d0 secure :-1 s=READY pgs=2180 cs=0 l=1 rev1=1 crypto rx=0x7f9cdc00c480 tx=0x7f9cdc00c940 comp rx=0 tx=0).stop 2024-04-04T16:33:54.064 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.064+0000 7f9cebe00640 1 -- 172.21.15.72:0/1422838884 reap_dead start 2024-04-04T16:33:54.064 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.064+0000 7f9cf2600640 1 -- 172.21.15.72:0/1422838884 shutdown_connections 2024-04-04T16:33:54.064 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.064+0000 7f9cf2600640 1 -- 172.21.15.72:0/1422838884 >> 172.21.15.72:0/1422838884 conn(0x7f9cec0cda40 msgr2=0x7f9cec15d290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T16:33:54.064 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.065+0000 7f9cf2600640 1 -- 172.21.15.72:0/1422838884 shutdown_connections 2024-04-04T16:33:54.065 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.065+0000 7f9cf2600640 1 -- 172.21.15.72:0/1422838884 wait complete. 2024-04-04T16:33:54.080 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-04-04T16:33:54.279 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.281+0000 7fbfc9a00640 1 Processor -- start 2024-04-04T16:33:54.280 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.281+0000 7fbfc9a00640 1 -- start start 2024-04-04T16:33:54.281 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.283+0000 7fbfc9a00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbfc40cf5f0 0x7fbfc4169340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:54.281 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.283+0000 7fbfc9a00640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbfc40b73b0 con 0x7fbfc415e520 2024-04-04T16:33:54.281 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.283+0000 7fbfc9a00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbfc415e900 con 0x7fbfc40b9ba0 2024-04-04T16:33:54.281 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.283+0000 7fbfc9a00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fbfc41627b0 con 0x7fbfc40cf5f0 2024-04-04T16:33:54.281 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.283+0000 7fbfc2a00640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fbfc415e520 0x7fbfc4161ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:39490/0 (socket says 172.21.15.72:39490) 2024-04-04T16:33:54.281 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.283+0000 7fbfc2a00640 1 -- 172.21.15.72:0/2784649883 learned_addr learned my addr 172.21.15.72:0/2784649883 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-04-04T16:33:54.284 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.284+0000 7fbfc3400640 1 --2- 172.21.15.72:0/2784649883 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbfc40cf5f0 0x7fbfc4169340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:54.284 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.284+0000 7fbfc2000640 1 -- 172.21.15.72:0/2784649883 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2282924422 0 0) 0x7fbfac001110 con 0x7fbfc415e520 2024-04-04T16:33:54.284 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.284+0000 7fbfc2000640 1 -- 172.21.15.72:0/2784649883 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbfa8003520 con 0x7fbfc415e520 2024-04-04T16:33:54.284 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.284+0000 7fbfc2000640 1 -- 172.21.15.72:0/2784649883 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 694712878 0 0) 0x7fbfa8003520 con 0x7fbfc415e520 2024-04-04T16:33:54.284 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.284+0000 7fbfc2000640 1 -- 172.21.15.72:0/2784649883 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbfc40cf5f0 msgr2=0x7fbfc4169340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T16:33:54.284 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.284+0000 7fbfc2000640 1 --2- 172.21.15.72:0/2784649883 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbfc40cf5f0 0x7fbfc4169340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:54.284 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.284+0000 7fbfc2000640 1 -- 172.21.15.72:0/2784649883 >> v1:172.21.15.117:6789/0 conn(0x7fbfc40b9ba0 legacy=0x7fbfc40ceee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:54.285 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.284+0000 7fbfc2000640 1 -- 172.21.15.72:0/2784649883 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfc4162a90 con 0x7fbfc415e520 2024-04-04T16:33:54.285 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.284+0000 7fbfc2000640 1 -- 172.21.15.72:0/2784649883 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2465650867 0 0) 0x7fbfac001840 con 0x7fbfc415e520 2024-04-04T16:33:54.285 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.284+0000 7fbfc2000640 1 -- 172.21.15.72:0/2784649883 >> v1:172.21.15.72:6789/0 conn(0x7fbfc415e520 legacy=0x7fbfc4161ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:54.285 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.284+0000 7fbfc2000640 1 --2- 172.21.15.72:0/2784649883 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbfc40cf5f0 0x7fbfa80039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:54.285 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.284+0000 7fbfc2000640 1 --2- 172.21.15.72:0/2784649883 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbfa8003f60 0x7fbfa8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:54.286 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.284+0000 7fbfc2000640 1 --2- 172.21.15.72:0/2784649883 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbfa8004d40 0x7fbfa80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:54.286 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.284+0000 7fbfc2000640 1 -- 172.21.15.72:0/2784649883 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fbfc41627b0 con 0x7fbfa8004d40 2024-04-04T16:33:54.286 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.284+0000 7fbfc2000640 1 -- 172.21.15.72:0/2784649883 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fbfa800baa0 con 0x7fbfa8003f60 2024-04-04T16:33:54.286 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.284+0000 7fbfc2000640 1 -- 172.21.15.72:0/2784649883 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fbfa800bca0 con 0x7fbfc40cf5f0 2024-04-04T16:33:54.286 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.284+0000 7fbfc3400640 1 --2- 172.21.15.72:0/2784649883 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbfa8004d40 0x7fbfa80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:54.286 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.285+0000 7fbfc2a00640 1 --2- 172.21.15.72:0/2784649883 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbfc40cf5f0 0x7fbfa80039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:54.286 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.285+0000 7fbfc3400640 1 -- 172.21.15.72:0/2784649883 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbfc40cf5f0 msgr2=0x7fbfa80039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T16:33:54.286 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.285+0000 7fbfc3400640 1 --2- 172.21.15.72:0/2784649883 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbfc40cf5f0 0x7fbfa80039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:54.287 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.285+0000 7fbfba000640 1 --2- 172.21.15.72:0/2784649883 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbfa8003f60 0x7fbfa8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:54.287 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.285+0000 7fbfc3400640 1 -- 172.21.15.72:0/2784649883 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbfa8003f60 msgr2=0x7fbfa8004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T16:33:54.287 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.285+0000 7fbfc3400640 1 --2- 172.21.15.72:0/2784649883 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbfa8003f60 0x7fbfa8004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:54.287 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.285+0000 7fbfc3400640 1 -- 172.21.15.72:0/2784649883 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfa8003520 con 0x7fbfa8004d40 2024-04-04T16:33:54.287 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.285+0000 7fbfc2a00640 1 --2- 172.21.15.72:0/2784649883 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbfc40cf5f0 0x7fbfa80039e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-04T16:33:54.287 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.285+0000 7fbfba000640 1 --2- 172.21.15.72:0/2784649883 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbfa8003f60 0x7fbfa8004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-04T16:33:54.287 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.286+0000 7fbfc3400640 1 --2- 172.21.15.72:0/2784649883 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbfa8004d40 0x7fbfa80051c0 secure :-1 s=READY pgs=2182 cs=0 l=1 rev1=1 crypto rx=0x7fbfc40b6c00 tx=0x7fbfa8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bdaf36897d97594 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T16:33:54.287 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.286+0000 7fbfc2000640 1 -- 172.21.15.72:0/2784649883 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfbc039070 con 0x7fbfa8004d40 2024-04-04T16:33:54.287 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.286+0000 7fbfc2000640 1 -- 172.21.15.72:0/2784649883 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbfbc02cb90 con 0x7fbfa8004d40 2024-04-04T16:33:54.288 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.286+0000 7fbfc2000640 1 -- 172.21.15.72:0/2784649883 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfbc009c10 con 0x7fbfa8004d40 2024-04-04T16:33:54.290 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.287+0000 7fbfc9a00640 1 -- 172.21.15.72:0/2784649883 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbfa8004d40 msgr2=0x7fbfa80051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:54.290 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.287+0000 7fbfc9a00640 1 --2- 172.21.15.72:0/2784649883 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbfa8004d40 0x7fbfa80051c0 secure :-1 s=READY pgs=2182 cs=0 l=1 rev1=1 crypto rx=0x7fbfc40b6c00 tx=0x7fbfa8005830 comp rx=0 tx=0).stop 2024-04-04T16:33:54.290 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.287+0000 7fbfc3400640 1 -- 172.21.15.72:0/2784649883 reap_dead start 2024-04-04T16:33:54.290 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.287+0000 7fbfc9a00640 1 -- 172.21.15.72:0/2784649883 shutdown_connections 2024-04-04T16:33:54.290 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.287+0000 7fbfc9a00640 1 -- 172.21.15.72:0/2784649883 >> 172.21.15.72:0/2784649883 conn(0x7fbfc40d0c90 msgr2=0x7fbfc40d1070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T16:33:54.290 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.287+0000 7fbfc9a00640 1 -- 172.21.15.72:0/2784649883 shutdown_connections 2024-04-04T16:33:54.291 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.287+0000 7fbfc9a00640 1 -- 172.21.15.72:0/2784649883 wait complete. 2024-04-04T16:33:54.291 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.289+0000 7fbfc9a00640 1 Processor -- start 2024-04-04T16:33:54.291 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.289+0000 7fbfc9a00640 1 -- start start 2024-04-04T16:33:54.291 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.290+0000 7fbfc9a00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbfc40cbf60 0x7fbfc40cb2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:54.291 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.290+0000 7fbfc9a00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbfc40cc340 0x7fbfc41543b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:54.291 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.290+0000 7fbfc9a00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbfc41548f0 0x7fbfc41e7df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:54.291 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.290+0000 7fbfc9a00640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fbfc40d3d20 con 0x7fbfc41548f0 2024-04-04T16:33:54.291 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.290+0000 7fbfc9a00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fbfc40d27f0 con 0x7fbfc40cbf60 2024-04-04T16:33:54.292 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.290+0000 7fbfc9a00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fbfc40d3ea0 con 0x7fbfc40cc340 2024-04-04T16:33:54.292 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.290+0000 7fbfc3400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbfc41548f0 0x7fbfc41e7df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:54.292 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.290+0000 7fbfc3400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbfc41548f0 0x7fbfc41e7df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51616/0 (socket says 172.21.15.72:51616) 2024-04-04T16:33:54.292 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.290+0000 7fbfc3400640 1 -- 172.21.15.72:0/3244728930 learned_addr learned my addr 172.21.15.72:0/3244728930 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T16:33:54.292 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.290+0000 7fbfc3400640 1 -- 172.21.15.72:0/3244728930 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbfc40cc340 msgr2=0x7fbfc41543b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:54.292 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.290+0000 7fbfc3400640 1 --2- 172.21.15.72:0/3244728930 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbfc40cc340 0x7fbfc41543b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:54.292 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.290+0000 7fbfc3400640 1 -- 172.21.15.72:0/3244728930 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbfc40cbf60 msgr2=0x7fbfc40cb2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:54.292 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.290+0000 7fbfc3400640 1 --2- 172.21.15.72:0/3244728930 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbfc40cbf60 0x7fbfc40cb2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:54.293 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.290+0000 7fbfc3400640 1 -- 172.21.15.72:0/3244728930 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfc4154d70 con 0x7fbfc41548f0 2024-04-04T16:33:54.293 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.291+0000 7fbfc3400640 1 --2- 172.21.15.72:0/3244728930 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbfc41548f0 0x7fbfc41e7df0 secure :-1 s=READY pgs=2183 cs=0 l=1 rev1=1 crypto rx=0x7fbfbc037040 tx=0x7fbfbc009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T16:33:54.293 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.291+0000 7fbfbb400640 1 -- 172.21.15.72:0/3244728930 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfbc039030 con 0x7fbfc41548f0 2024-04-04T16:33:54.293 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.291+0000 7fbfbb400640 1 -- 172.21.15.72:0/3244728930 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbfbc043070 con 0x7fbfc41548f0 2024-04-04T16:33:54.293 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.291+0000 7fbfc9a00640 1 -- 172.21.15.72:0/3244728930 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbfc41608f0 con 0x7fbfc41548f0 2024-04-04T16:33:54.293 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.291+0000 7fbfbb400640 1 -- 172.21.15.72:0/3244728930 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfbc009c10 con 0x7fbfc41548f0 2024-04-04T16:33:54.293 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.291+0000 7fbfc9a00640 1 -- 172.21.15.72:0/3244728930 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbfc41585a0 con 0x7fbfc41548f0 2024-04-04T16:33:54.293 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.292+0000 7fbfc9a00640 1 -- 172.21.15.72:0/3244728930 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbfc40686c0 con 0x7fbfc41548f0 2024-04-04T16:33:54.294 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.293+0000 7fbfbb400640 1 -- 172.21.15.72:0/3244728930 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fbfbc03d7f0 con 0x7fbfc41548f0 2024-04-04T16:33:54.295 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.294+0000 7fbfbb400640 1 --2- 172.21.15.72:0/3244728930 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fbfa006c920 0x7fbfa006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:54.298 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.294+0000 7fbfbb400640 1 -- 172.21.15.72:0/3244728930 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 4943+0+0 (secure 0 0 0) 0x7fbfbc0adcb0 con 0x7fbfc41548f0 2024-04-04T16:33:54.299 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.295+0000 7fbfc2a00640 1 --2- 172.21.15.72:0/3244728930 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fbfa006c920 0x7fbfa006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:54.299 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.295+0000 7fbfc2a00640 1 --2- 172.21.15.72:0/3244728930 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fbfa006c920 0x7fbfa006ede0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7fbfac000f60 tx=0x7fbfac009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T16:33:54.299 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.299+0000 7fbfbb400640 1 -- 172.21.15.72:0/3244728930 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fbfc40686c0 con 0x7fbfc41548f0 2024-04-04T16:33:54.497 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.499+0000 7fbfc9a00640 1 -- 172.21.15.72:0/3244728930 --> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7fbfc40b62c0 con 0x7fbfa006c920 2024-04-04T16:33:54.498 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.500+0000 7fbfbb400640 1 -- 172.21.15.72:0/3244728930 <== mgr.4101 v2:172.21.15.72:6832/2205173820 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fbfc40b62c0 con 0x7fbfa006c920 2024-04-04T16:33:54.502 INFO:teuthology.orchestra.run.smithi072.stderr:instructed osd(s) 0 to deep-scrub 2024-04-04T16:33:54.503 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.503+0000 7fbfc9a00640 1 -- 172.21.15.72:0/3244728930 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fbfa006c920 msgr2=0x7fbfa006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:54.503 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.503+0000 7fbfc9a00640 1 --2- 172.21.15.72:0/3244728930 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fbfa006c920 0x7fbfa006ede0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7fbfac000f60 tx=0x7fbfac009040 comp rx=0 tx=0).stop 2024-04-04T16:33:54.503 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.503+0000 7fbfc9a00640 1 -- 172.21.15.72:0/3244728930 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbfc41548f0 msgr2=0x7fbfc41e7df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:54.503 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.503+0000 7fbfc9a00640 1 --2- 172.21.15.72:0/3244728930 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbfc41548f0 0x7fbfc41e7df0 secure :-1 s=READY pgs=2183 cs=0 l=1 rev1=1 crypto rx=0x7fbfbc037040 tx=0x7fbfbc009750 comp rx=0 tx=0).stop 2024-04-04T16:33:54.503 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.503+0000 7fbfc9a00640 1 -- 172.21.15.72:0/3244728930 shutdown_connections 2024-04-04T16:33:54.504 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.503+0000 7fbfc9a00640 1 --2- 172.21.15.72:0/3244728930 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fbfa006c920 0x7fbfa006ede0 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:54.504 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.503+0000 7fbfc9a00640 1 --2- 172.21.15.72:0/3244728930 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbfc41548f0 0x7fbfc41e7df0 unknown :-1 s=CLOSED pgs=2183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:54.504 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.503+0000 7fbfc9a00640 1 --2- 172.21.15.72:0/3244728930 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbfc40cc340 0x7fbfc41543b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:54.504 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.503+0000 7fbfc9a00640 1 --2- 172.21.15.72:0/3244728930 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbfc40cbf60 0x7fbfc40cb2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:54.504 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.503+0000 7fbfc9a00640 1 -- 172.21.15.72:0/3244728930 >> 172.21.15.72:0/3244728930 conn(0x7fbfc40d0c90 msgr2=0x7fbfc40b8de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T16:33:54.504 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.503+0000 7fbfc9a00640 1 -- 172.21.15.72:0/3244728930 shutdown_connections 2024-04-04T16:33:54.504 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.503+0000 7fbfc9a00640 1 -- 172.21.15.72:0/3244728930 wait complete. 2024-04-04T16:33:54.522 INFO:tasks.ceph:Scrubbing osd.1 2024-04-04T16:33:54.522 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-04-04T16:33:54.719 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.721+0000 7fd0d0e00640 1 Processor -- start 2024-04-04T16:33:54.720 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.721+0000 7fd0d0e00640 1 -- start start 2024-04-04T16:33:54.721 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.722+0000 7fd0d0e00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fd0cc15e860 0x7fd0cc0cec30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:54.721 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.722+0000 7fd0d0e00640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd0cc0cf660 0x7fd0cc0b7a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:54.721 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.722+0000 7fd0d0e00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0cc0d2d10 con 0x7fd0cc0cf280 2024-04-04T16:33:54.721 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.722+0000 7fd0d0e00640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7fd0cc0d3920 con 0x7fd0cc0cf660 2024-04-04T16:33:54.721 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.722+0000 7fd0d0e00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fd0cc0d2ff0 con 0x7fd0cc15e860 2024-04-04T16:33:54.721 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.722+0000 7fd0cbe00640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd0cc0cf660 0x7fd0cc0b7a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:54.722 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.723+0000 7fd0cbe00640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd0cc0cf660 0x7fd0cc0b7a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51620/0 (socket says 172.21.15.72:51620) 2024-04-04T16:33:54.722 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.723+0000 7fd0cbe00640 1 -- 172.21.15.72:0/2529175492 learned_addr learned my addr 172.21.15.72:0/2529175492 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T16:33:54.722 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.723+0000 7fd0cbe00640 1 -- 172.21.15.72:0/2529175492 >> v2:172.21.15.117:3300/0 conn(0x7fd0cc15e860 msgr2=0x7fd0cc0cec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T16:33:54.722 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.723+0000 7fd0cbe00640 1 --2- 172.21.15.72:0/2529175492 >> v2:172.21.15.117:3300/0 conn(0x7fd0cc15e860 0x7fd0cc0cec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:54.722 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.723+0000 7fd0cbe00640 1 -- 172.21.15.72:0/2529175492 >> v1:172.21.15.117:6789/0 conn(0x7fd0cc0cf280 legacy=0x7fd0cc0d2550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T16:33:54.722 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.723+0000 7fd0cbe00640 1 -- 172.21.15.72:0/2529175492 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0cc0d32d0 con 0x7fd0cc0cf660 2024-04-04T16:33:54.723 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.725+0000 7fd0cbe00640 1 --2- 172.21.15.72:0/2529175492 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd0cc0cf660 0x7fd0cc0b7a80 secure :-1 s=READY pgs=2184 cs=0 l=1 rev1=1 crypto rx=0x7fd0cc0ce920 tx=0x7fd0c402bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf5e0b0510d623a4 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T16:33:54.724 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.725+0000 7fd0ca000640 1 -- 172.21.15.72:0/2529175492 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0c402ca80 con 0x7fd0cc0cf660 2024-04-04T16:33:54.724 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.725+0000 7fd0ca000640 1 -- 172.21.15.72:0/2529175492 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0c402cc20 con 0x7fd0cc0cf660 2024-04-04T16:33:54.724 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.725+0000 7fd0ca000640 1 -- 172.21.15.72:0/2529175492 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0c40343f0 con 0x7fd0cc0cf660 2024-04-04T16:33:54.724 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.725+0000 7fd0d0e00640 1 -- 172.21.15.72:0/2529175492 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd0cc0cf660 msgr2=0x7fd0cc0b7a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:54.724 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.725+0000 7fd0d0e00640 1 --2- 172.21.15.72:0/2529175492 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd0cc0cf660 0x7fd0cc0b7a80 secure :-1 s=READY pgs=2184 cs=0 l=1 rev1=1 crypto rx=0x7fd0cc0ce920 tx=0x7fd0c402bee0 comp rx=0 tx=0).stop 2024-04-04T16:33:54.724 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.726+0000 7fd0d0e00640 1 -- 172.21.15.72:0/2529175492 shutdown_connections 2024-04-04T16:33:54.724 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.726+0000 7fd0d0e00640 1 --2- 172.21.15.72:0/2529175492 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd0cc0cf660 0x7fd0cc0b7a80 unknown :-1 s=CLOSED pgs=2184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:54.724 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.726+0000 7fd0d0e00640 1 --2- 172.21.15.72:0/2529175492 >> v2:172.21.15.117:3300/0 conn(0x7fd0cc15e860 0x7fd0cc0cec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:54.725 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.726+0000 7fd0d0e00640 1 -- 172.21.15.72:0/2529175492 >> 172.21.15.72:0/2529175492 conn(0x7fd0cc06b860 msgr2=0x7fd0cc06bc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T16:33:54.725 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.726+0000 7fd0d0e00640 1 -- 172.21.15.72:0/2529175492 shutdown_connections 2024-04-04T16:33:54.725 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.726+0000 7fd0d0e00640 1 -- 172.21.15.72:0/2529175492 wait complete. 2024-04-04T16:33:54.725 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.727+0000 7fd0d0e00640 1 Processor -- start 2024-04-04T16:33:54.725 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.727+0000 7fd0d0e00640 1 -- start start 2024-04-04T16:33:54.727 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.728+0000 7fd0d0e00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd0cc0cf280 0x7fd0cc157fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:54.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.728+0000 7fd0d0e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd0cc0cf660 0x7fd0cc0b8b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:54.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.728+0000 7fd0d0e00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd0cc15e860 0x7fd0cc14d240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:54.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.728+0000 7fd0d0e00640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fd0cc0b7fc0 con 0x7fd0cc15e860 2024-04-04T16:33:54.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.728+0000 7fd0d0e00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fd0cc0cfaf0 con 0x7fd0cc0cf280 2024-04-04T16:33:54.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.728+0000 7fd0d0e00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fd0cc0b8140 con 0x7fd0cc0cf660 2024-04-04T16:33:54.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.729+0000 7fd0cbe00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd0cc15e860 0x7fd0cc14d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:54.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.729+0000 7fd0cbe00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd0cc15e860 0x7fd0cc14d240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51626/0 (socket says 172.21.15.72:51626) 2024-04-04T16:33:54.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.729+0000 7fd0cbe00640 1 -- 172.21.15.72:0/1021625664 learned_addr learned my addr 172.21.15.72:0/1021625664 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T16:33:54.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.729+0000 7fd0caa00640 1 --2- 172.21.15.72:0/1021625664 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd0cc0cf660 0x7fd0cc0b8b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:54.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.729+0000 7fd0cb400640 1 --2- 172.21.15.72:0/1021625664 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd0cc0cf280 0x7fd0cc157fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:54.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.729+0000 7fd0cbe00640 1 -- 172.21.15.72:0/1021625664 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd0cc0cf660 msgr2=0x7fd0cc0b8b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:54.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.729+0000 7fd0cbe00640 1 --2- 172.21.15.72:0/1021625664 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd0cc0cf660 0x7fd0cc0b8b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:54.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.729+0000 7fd0cbe00640 1 -- 172.21.15.72:0/1021625664 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd0cc0cf280 msgr2=0x7fd0cc157fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:54.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.729+0000 7fd0cbe00640 1 --2- 172.21.15.72:0/1021625664 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd0cc0cf280 0x7fd0cc157fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:54.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.729+0000 7fd0cbe00640 1 -- 172.21.15.72:0/1021625664 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0cc1584e0 con 0x7fd0cc15e860 2024-04-04T16:33:54.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.729+0000 7fd0cbe00640 1 --2- 172.21.15.72:0/1021625664 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd0cc15e860 0x7fd0cc14d240 secure :-1 s=READY pgs=2185 cs=0 l=1 rev1=1 crypto rx=0x7fd0c4009f40 tx=0x7fd0c4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T16:33:54.730 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.730+0000 7fd0c3400640 1 -- 172.21.15.72:0/1021625664 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0c4043020 con 0x7fd0cc15e860 2024-04-04T16:33:54.730 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.730+0000 7fd0c3400640 1 -- 172.21.15.72:0/1021625664 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0c403e450 con 0x7fd0cc15e860 2024-04-04T16:33:54.730 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.730+0000 7fd0c3400640 1 -- 172.21.15.72:0/1021625664 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0c403e820 con 0x7fd0cc15e860 2024-04-04T16:33:54.730 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.730+0000 7fd0d0e00640 1 -- 172.21.15.72:0/1021625664 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0cc15eec0 con 0x7fd0cc15e860 2024-04-04T16:33:54.730 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.730+0000 7fd0d0e00640 1 -- 172.21.15.72:0/1021625664 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0cc15f480 con 0x7fd0cc15e860 2024-04-04T16:33:54.732 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.731+0000 7fd0d0e00640 1 -- 172.21.15.72:0/1021625664 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd0cc0756c0 con 0x7fd0cc15e860 2024-04-04T16:33:54.732 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.732+0000 7fd0c3400640 1 -- 172.21.15.72:0/1021625664 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd0c4046020 con 0x7fd0cc15e860 2024-04-04T16:33:54.732 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.733+0000 7fd0c3400640 1 --2- 172.21.15.72:0/1021625664 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fd0ac06c8f0 0x7fd0ac06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:54.732 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.733+0000 7fd0c3400640 1 -- 172.21.15.72:0/1021625664 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 4943+0+0 (secure 0 0 0) 0x7fd0c40ae230 con 0x7fd0cc15e860 2024-04-04T16:33:54.732 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.733+0000 7fd0cb400640 1 --2- 172.21.15.72:0/1021625664 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fd0ac06c8f0 0x7fd0ac06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:54.732 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.733+0000 7fd0c3400640 1 --2- 172.21.15.72:0/1021625664 >> [v2:172.21.15.72:6800/3101663154,v1:172.21.15.72:6801/3101663154] conn(0x7fd0ac0727b0 0x7fd0ac074bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:54.733 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.733+0000 7fd0c3400640 1 -- 172.21.15.72:0/1021625664 --> [v2:172.21.15.72:6800/3101663154,v1:172.21.15.72:6801/3101663154] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd0c403ae50 con 0x7fd0ac0727b0 2024-04-04T16:33:54.733 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.733+0000 7fd0c3400640 1 -- 172.21.15.72:0/1021625664 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7fd0c40b5050 con 0x7fd0cc15e860 2024-04-04T16:33:54.733 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.733+0000 7fd0caa00640 1 --2- 172.21.15.72:0/1021625664 >> [v2:172.21.15.72:6800/3101663154,v1:172.21.15.72:6801/3101663154] conn(0x7fd0ac0727b0 0x7fd0ac074bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:54.733 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.734+0000 7fd0cb400640 1 --2- 172.21.15.72:0/1021625664 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fd0ac06c8f0 0x7fd0ac06edb0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7fd0cc0b9d40 tx=0x7fd0bc009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T16:33:54.733 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.734+0000 7fd0caa00640 1 --2- 172.21.15.72:0/1021625664 >> [v2:172.21.15.72:6800/3101663154,v1:172.21.15.72:6801/3101663154] conn(0x7fd0ac0727b0 0x7fd0ac074bd0 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T16:33:54.733 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.735+0000 7fd0c3400640 1 -- 172.21.15.72:0/1021625664 <== osd.1 v2:172.21.15.72:6800/3101663154 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd0c403ae50 con 0x7fd0ac0727b0 2024-04-04T16:33:54.747 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.749+0000 7fd0d0e00640 1 -- 172.21.15.72:0/1021625664 --> [v2:172.21.15.72:6800/3101663154,v1:172.21.15.72:6801/3101663154] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fd0cc0cecd0 con 0x7fd0ac0727b0 2024-04-04T16:33:54.747 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.749+0000 7fd0c3400640 1 -- 172.21.15.72:0/1021625664 <== osd.1 v2:172.21.15.72:6800/3101663154 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fd0cc0cecd0 con 0x7fd0ac0727b0 2024-04-04T16:33:54.747 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-04T16:33:54.748 INFO:teuthology.orchestra.run.smithi072.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-04T16:33:54.748 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-04T16:33:54.749 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.750+0000 7fd0d0e00640 1 -- 172.21.15.72:0/1021625664 >> [v2:172.21.15.72:6800/3101663154,v1:172.21.15.72:6801/3101663154] conn(0x7fd0ac0727b0 msgr2=0x7fd0ac074bd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:54.749 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.750+0000 7fd0d0e00640 1 --2- 172.21.15.72:0/1021625664 >> [v2:172.21.15.72:6800/3101663154,v1:172.21.15.72:6801/3101663154] conn(0x7fd0ac0727b0 0x7fd0ac074bd0 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:54.750 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.750+0000 7fd0d0e00640 1 -- 172.21.15.72:0/1021625664 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fd0ac06c8f0 msgr2=0x7fd0ac06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:54.750 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.750+0000 7fd0d0e00640 1 --2- 172.21.15.72:0/1021625664 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fd0ac06c8f0 0x7fd0ac06edb0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7fd0cc0b9d40 tx=0x7fd0bc009040 comp rx=0 tx=0).stop 2024-04-04T16:33:54.750 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.750+0000 7fd0d0e00640 1 -- 172.21.15.72:0/1021625664 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd0cc15e860 msgr2=0x7fd0cc14d240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:54.750 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.750+0000 7fd0d0e00640 1 --2- 172.21.15.72:0/1021625664 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd0cc15e860 0x7fd0cc14d240 secure :-1 s=READY pgs=2185 cs=0 l=1 rev1=1 crypto rx=0x7fd0c4009f40 tx=0x7fd0c4004a40 comp rx=0 tx=0).stop 2024-04-04T16:33:54.750 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.750+0000 7fd0cbe00640 1 -- 172.21.15.72:0/1021625664 reap_dead start 2024-04-04T16:33:54.750 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.750+0000 7fd0d0e00640 1 -- 172.21.15.72:0/1021625664 shutdown_connections 2024-04-04T16:33:54.750 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.750+0000 7fd0d0e00640 1 -- 172.21.15.72:0/1021625664 >> 172.21.15.72:0/1021625664 conn(0x7fd0cc06b860 msgr2=0x7fd0cc15d190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T16:33:54.750 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.750+0000 7fd0d0e00640 1 -- 172.21.15.72:0/1021625664 shutdown_connections 2024-04-04T16:33:54.751 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.750+0000 7fd0d0e00640 1 -- 172.21.15.72:0/1021625664 wait complete. 2024-04-04T16:33:54.764 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-04-04T16:33:54.966 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.968+0000 7f22b3200640 1 Processor -- start 2024-04-04T16:33:54.967 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.968+0000 7f22b3200640 1 -- start start 2024-04-04T16:33:54.968 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.970+0000 7f22b3200640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f22b415e560 0x7f22b40b75d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:54.968 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.970+0000 7f22b3200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f22b40cf370 0x7f22b40d3030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:54.968 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.970+0000 7f22b3200640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22b40d2590 con 0x7f22b40b7b10 2024-04-04T16:33:54.968 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.970+0000 7f22b3200640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f22b4162540 con 0x7f22b415e560 2024-04-04T16:33:54.968 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.970+0000 7f22b3200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f22b40d2ba0 con 0x7f22b40cf370 2024-04-04T16:33:54.969 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.970+0000 7f22a9400640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f22b40b7b10 0x7f22b40cec60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:39502/0 (socket says 172.21.15.72:39502) 2024-04-04T16:33:54.969 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.970+0000 7f22a9400640 1 -- 172.21.15.72:0/218077097 learned_addr learned my addr 172.21.15.72:0/218077097 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-04-04T16:33:54.969 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.970+0000 7f22b1e00640 1 --2- 172.21.15.72:0/218077097 >> v2:172.21.15.72:3300/0 conn(0x7f22b415e560 0x7f22b40b75d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:54.969 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.971+0000 7f22b2800640 1 --2- 172.21.15.72:0/218077097 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f22b40cf370 0x7f22b40d3030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:54.970 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.971+0000 7f22b1e00640 1 -- 172.21.15.72:0/218077097 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f22b40cf370 msgr2=0x7f22b40d3030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T16:33:54.970 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.971+0000 7f22b1e00640 1 --2- 172.21.15.72:0/218077097 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f22b40cf370 0x7f22b40d3030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:54.970 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.971+0000 7f22b1e00640 1 -- 172.21.15.72:0/218077097 >> v1:172.21.15.72:6789/0 conn(0x7f22b40b7b10 legacy=0x7f22b40cec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:54.970 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.971+0000 7f22b1e00640 1 -- 172.21.15.72:0/218077097 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22b40cf840 con 0x7f22b415e560 2024-04-04T16:33:54.970 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.971+0000 7f22b1400640 1 -- 172.21.15.72:0/218077097 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3334753668 0 0) 0x7f22b40d2590 con 0x7f22b40b7b10 2024-04-04T16:33:54.971 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.972+0000 7f22b1e00640 1 --2- 172.21.15.72:0/218077097 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f22b415e560 0x7f22b40b75d0 secure :-1 s=READY pgs=2187 cs=0 l=1 rev1=1 crypto rx=0x7f22b40d2d20 tx=0x7f22a402b810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fb6a451c0e2eee4 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T16:33:54.971 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.972+0000 7f22b1400640 1 -- 172.21.15.72:0/218077097 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22a4031770 con 0x7f22b415e560 2024-04-04T16:33:54.971 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.972+0000 7f22b1400640 1 -- 172.21.15.72:0/218077097 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22a4037070 con 0x7f22b415e560 2024-04-04T16:33:54.972 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.972+0000 7f22b1400640 1 -- 172.21.15.72:0/218077097 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22a4031b30 con 0x7f22b415e560 2024-04-04T16:33:54.972 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.973+0000 7f22b3200640 1 -- 172.21.15.72:0/218077097 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f22b415e560 msgr2=0x7f22b40b75d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:54.972 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.973+0000 7f22b3200640 1 --2- 172.21.15.72:0/218077097 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f22b415e560 0x7f22b40b75d0 secure :-1 s=READY pgs=2187 cs=0 l=1 rev1=1 crypto rx=0x7f22b40d2d20 tx=0x7f22a402b810 comp rx=0 tx=0).stop 2024-04-04T16:33:54.972 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.973+0000 7f22b3200640 1 -- 172.21.15.72:0/218077097 shutdown_connections 2024-04-04T16:33:54.972 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.973+0000 7f22b3200640 1 --2- 172.21.15.72:0/218077097 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f22b40cf370 0x7f22b40d3030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:54.972 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.973+0000 7f22b3200640 1 --2- 172.21.15.72:0/218077097 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f22b415e560 0x7f22b40b75d0 unknown :-1 s=CLOSED pgs=2187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:54.972 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.973+0000 7f22b3200640 1 -- 172.21.15.72:0/218077097 >> 172.21.15.72:0/218077097 conn(0x7f22b40b5c40 msgr2=0x7f22b40b6050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T16:33:54.972 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.973+0000 7f22b3200640 1 -- 172.21.15.72:0/218077097 shutdown_connections 2024-04-04T16:33:54.973 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.973+0000 7f22b3200640 1 -- 172.21.15.72:0/218077097 wait complete. 2024-04-04T16:33:54.974 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.975+0000 7f22b3200640 1 Processor -- start 2024-04-04T16:33:54.975 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.975+0000 7f22b3200640 1 -- start start 2024-04-04T16:33:54.975 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.975+0000 7f22b3200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f22b40b7b10 0x7f22b4158250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:54.975 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.976+0000 7f22b3200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f22b40cf370 0x7f22b41f43e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:54.975 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.976+0000 7f22b3200640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f22b415e560 0x7f22b4160900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:54.975 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.976+0000 7f22b3200640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f22b40cfca0 con 0x7f22b415e560 2024-04-04T16:33:54.975 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.976+0000 7f22b3200640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f22b40cfb20 con 0x7f22b40cf370 2024-04-04T16:33:54.975 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.976+0000 7f22b3200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f22b415e940 con 0x7f22b40b7b10 2024-04-04T16:33:54.976 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.976+0000 7f22b2800640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f22b415e560 0x7f22b4160900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:54.976 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.976+0000 7f22b2800640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f22b415e560 0x7f22b4160900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51658/0 (socket says 172.21.15.72:51658) 2024-04-04T16:33:54.976 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.976+0000 7f22b2800640 1 -- 172.21.15.72:0/1210253073 learned_addr learned my addr 172.21.15.72:0/1210253073 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T16:33:54.976 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.976+0000 7f22a9400640 1 --2- 172.21.15.72:0/1210253073 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f22b40cf370 0x7f22b41f43e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:54.976 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.976+0000 7f22b2800640 1 -- 172.21.15.72:0/1210253073 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f22b40b7b10 msgr2=0x7f22b4158250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:54.976 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.976+0000 7f22b2800640 1 --2- 172.21.15.72:0/1210253073 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f22b40b7b10 0x7f22b4158250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:54.976 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.976+0000 7f22b2800640 1 -- 172.21.15.72:0/1210253073 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f22b40cf370 msgr2=0x7f22b41f43e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:54.976 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.976+0000 7f22b2800640 1 --2- 172.21.15.72:0/1210253073 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f22b40cf370 0x7f22b41f43e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:54.976 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.976+0000 7f22b2800640 1 -- 172.21.15.72:0/1210253073 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22b40cb220 con 0x7f22b415e560 2024-04-04T16:33:54.977 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.976+0000 7f22a9400640 1 --2- 172.21.15.72:0/1210253073 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f22b40cf370 0x7f22b41f43e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-04T16:33:54.977 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.977+0000 7f22b2800640 1 --2- 172.21.15.72:0/1210253073 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f22b415e560 0x7f22b4160900 secure :-1 s=READY pgs=2188 cs=0 l=1 rev1=1 crypto rx=0x7f22ac007e30 tx=0x7f22ac00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T16:33:54.977 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.977+0000 7f22aaa00640 1 -- 172.21.15.72:0/1210253073 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22ac014620 con 0x7f22b415e560 2024-04-04T16:33:54.977 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.977+0000 7f22aaa00640 1 -- 172.21.15.72:0/1210253073 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22ac019070 con 0x7f22b415e560 2024-04-04T16:33:54.977 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.977+0000 7f22b3200640 1 -- 172.21.15.72:0/1210253073 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22b40cb500 con 0x7f22b415e560 2024-04-04T16:33:54.977 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.977+0000 7f22aaa00640 1 -- 172.21.15.72:0/1210253073 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22ac014a00 con 0x7f22b415e560 2024-04-04T16:33:54.977 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.977+0000 7f22b3200640 1 -- 172.21.15.72:0/1210253073 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22b40cbac0 con 0x7f22b415e560 2024-04-04T16:33:54.978 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.978+0000 7f22b3200640 1 -- 172.21.15.72:0/1210253073 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22b40685a0 con 0x7f22b415e560 2024-04-04T16:33:54.978 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.980+0000 7f22aaa00640 1 -- 172.21.15.72:0/1210253073 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f22ac014ba0 con 0x7f22b415e560 2024-04-04T16:33:54.979 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.981+0000 7f22aaa00640 1 --2- 172.21.15.72:0/1210253073 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f229006c8f0 0x7f229006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:54.979 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.981+0000 7f22aaa00640 1 -- 172.21.15.72:0/1210253073 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 4943+0+0 (secure 0 0 0) 0x7f22ac08c170 con 0x7f22b415e560 2024-04-04T16:33:54.979 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.981+0000 7f22b1e00640 1 --2- 172.21.15.72:0/1210253073 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f229006c8f0 0x7f229006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:54.979 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.982+0000 7f22b1e00640 1 --2- 172.21.15.72:0/1210253073 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f229006c8f0 0x7f229006edb0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f22a4036000 tx=0x7f22a4030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T16:33:54.983 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:54.986+0000 7f22aaa00640 1 -- 172.21.15.72:0/1210253073 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f22ac05a890 con 0x7f22b415e560 2024-04-04T16:33:55.181 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:55.184+0000 7f22b3200640 1 -- 172.21.15.72:0/1210253073 --> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7f22b40d20a0 con 0x7f229006c8f0 2024-04-04T16:33:55.182 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:55.185+0000 7f22aaa00640 1 -- 172.21.15.72:0/1210253073 <== mgr.4101 v2:172.21.15.72:6832/2205173820 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f22b40d20a0 con 0x7f229006c8f0 2024-04-04T16:33:55.182 INFO:teuthology.orchestra.run.smithi072.stderr:instructed osd(s) 1 to deep-scrub 2024-04-04T16:33:55.185 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:55.187+0000 7f22b3200640 1 -- 172.21.15.72:0/1210253073 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f229006c8f0 msgr2=0x7f229006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:55.185 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:55.187+0000 7f22b3200640 1 --2- 172.21.15.72:0/1210253073 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f229006c8f0 0x7f229006edb0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f22a4036000 tx=0x7f22a4030000 comp rx=0 tx=0).stop 2024-04-04T16:33:55.185 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:55.187+0000 7f22b3200640 1 -- 172.21.15.72:0/1210253073 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f22b415e560 msgr2=0x7f22b4160900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:55.186 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:55.187+0000 7f22b3200640 1 --2- 172.21.15.72:0/1210253073 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f22b415e560 0x7f22b4160900 secure :-1 s=READY pgs=2188 cs=0 l=1 rev1=1 crypto rx=0x7f22ac007e30 tx=0x7f22ac00e4b0 comp rx=0 tx=0).stop 2024-04-04T16:33:55.186 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:55.187+0000 7f22b3200640 1 -- 172.21.15.72:0/1210253073 shutdown_connections 2024-04-04T16:33:55.186 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:55.187+0000 7f22b3200640 1 --2- 172.21.15.72:0/1210253073 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f229006c8f0 0x7f229006edb0 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:55.186 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:55.187+0000 7f22b3200640 1 --2- 172.21.15.72:0/1210253073 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f22b415e560 0x7f22b4160900 unknown :-1 s=CLOSED pgs=2188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:55.186 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:55.187+0000 7f22b3200640 1 --2- 172.21.15.72:0/1210253073 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f22b40cf370 0x7f22b41f43e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:55.186 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:55.187+0000 7f22b3200640 1 --2- 172.21.15.72:0/1210253073 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f22b40b7b10 0x7f22b4158250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:55.186 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:55.187+0000 7f22b3200640 1 -- 172.21.15.72:0/1210253073 >> 172.21.15.72:0/1210253073 conn(0x7f22b40b5c40 msgr2=0x7f22b40d35c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T16:33:55.186 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:55.187+0000 7f22b3200640 1 -- 172.21.15.72:0/1210253073 shutdown_connections 2024-04-04T16:33:55.187 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:55.187+0000 7f22b3200640 1 -- 172.21.15.72:0/1210253073 wait complete. 2024-04-04T16:33:55.204 INFO:tasks.ceph:Scrubbing osd.2 2024-04-04T16:33:55.205 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-04-04T16:33:55.410 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:55.412+0000 7fd711200640 1 Processor -- start 2024-04-04T16:33:55.410 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:55.412+0000 7fd711200640 1 -- start start 2024-04-04T16:33:55.412 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:55.414+0000 7fd711200640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fd70c15e860 0x7fd70c0cec30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:55.412 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:55.414+0000 7fd711200640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd70c0d2d10 con 0x7fd70c0cf280 2024-04-04T16:33:55.412 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:55.414+0000 7fd711200640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd70c0d2ff0 con 0x7fd70c0cf660 2024-04-04T16:33:55.412 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:55.414+0000 7fd711200640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fd70c0d3920 con 0x7fd70c15e860 2024-04-04T16:33:55.412 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:55.414+0000 7fd70b400640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fd70c0cf280 0x7fd70c0d2550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:39518/0 (socket says 172.21.15.72:39518) 2024-04-04T16:33:55.412 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:55.414+0000 7fd70b400640 1 -- 172.21.15.72:0/3028988829 learned_addr learned my addr 172.21.15.72:0/3028988829 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-04-04T16:33:55.412 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:55.414+0000 7fd70aa00640 1 --2- 172.21.15.72:0/3028988829 >> v2:172.21.15.117:3300/0 conn(0x7fd70c15e860 0x7fd70c0cec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:55.416 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:55.414+0000 7fd70a000640 1 -- 172.21.15.72:0/3028988829 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3487956027 0 0) 0x7fd70c0d2d10 con 0x7fd70c0cf280 2024-04-04T16:33:55.416 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:55.414+0000 7fd70a000640 1 -- 172.21.15.72:0/3028988829 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd6f0003520 con 0x7fd70c0cf280 2024-04-04T16:33:55.416 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:55.415+0000 7fd70a000640 1 -- 172.21.15.72:0/3028988829 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4076806256 0 0) 0x7fd70c0d2ff0 con 0x7fd70c0cf660 2024-04-04T16:33:55.416 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:55.415+0000 7fd70a000640 1 -- 172.21.15.72:0/3028988829 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd70c0d2d10 con 0x7fd70c0cf660 2024-04-04T16:33:55.416 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:55.415+0000 7fd70a000640 1 -- 172.21.15.72:0/3028988829 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2619045102 0 0) 0x7fd6f0003520 con 0x7fd70c0cf280 2024-04-04T16:33:55.416 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:55.415+0000 7fd70a000640 1 -- 172.21.15.72:0/3028988829 >> v2:172.21.15.117:3300/0 conn(0x7fd70c15e860 msgr2=0x7fd70c0cec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T16:33:55.417 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:55.415+0000 7fd70a000640 1 --2- 172.21.15.72:0/3028988829 >> v2:172.21.15.117:3300/0 conn(0x7fd70c15e860 0x7fd70c0cec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:55.417 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:55.415+0000 7fd70a000640 1 -- 172.21.15.72:0/3028988829 >> v1:172.21.15.117:6789/0 conn(0x7fd70c0cf660 legacy=0x7fd70c0b7a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:55.417 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:55.415+0000 7fd70a000640 1 -- 172.21.15.72:0/3028988829 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd70c0d32d0 con 0x7fd70c0cf280 2024-04-04T16:33:55.417 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:55.415+0000 7fd70a000640 1 -- 172.21.15.72:0/3028988829 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2465650867 0 0) 0x7fd6fc001670 con 0x7fd70c0cf280 2024-04-04T16:33:55.417 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:55.415+0000 7fd70a000640 1 -- 172.21.15.72:0/3028988829 >> v1:172.21.15.72:6789/0 conn(0x7fd70c0cf280 legacy=0x7fd70c0d2550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:55.417 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:55.415+0000 7fd70a000640 1 --2- 172.21.15.72:0/3028988829 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd6f0003b90 0x7fd6f0003f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:55.417 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:55.415+0000 7fd70a000640 1 --2- 172.21.15.72:0/3028988829 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd6f0004800 0x7fd6f0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:55.417 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:55.415+0000 7fd70a000640 1 --2- 172.21.15.72:0/3028988829 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd6f00051c0 0x7fd6f000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:55.417 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:55.415+0000 7fd70a000640 1 -- 172.21.15.72:0/3028988829 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fd6f000c090 con 0x7fd6f0003b90 2024-04-04T16:33:55.418 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:55.415+0000 7fd70a000640 1 -- 172.21.15.72:0/3028988829 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fd6f000c210 con 0x7fd6f0004800 2024-04-04T16:33:55.418 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:55.415+0000 7fd70a000640 1 -- 172.21.15.72:0/3028988829 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fd6f000c410 con 0x7fd6f00051c0 2024-04-04T16:33:55.418 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:55.415+0000 7fd70b400640 1 --2- 172.21.15.72:0/3028988829 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd6f0003b90 0x7fd6f0003f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:55.418 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:55.415+0000 7fd70aa00640 1 --2- 172.21.15.72:0/3028988829 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd6f0004800 0x7fd6f0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:55.418 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:55.416+0000 7fd70be00640 1 --2- 172.21.15.72:0/3028988829 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd6f00051c0 0x7fd6f000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:55.418 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:55.416+0000 7fd70b400640 1 -- 172.21.15.72:0/3028988829 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd6f00051c0 msgr2=0x7fd6f000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T16:33:55.418 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:55.416+0000 7fd70b400640 1 --2- 172.21.15.72:0/3028988829 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd6f00051c0 0x7fd6f000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:55.418 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:55.416+0000 7fd70b400640 1 -- 172.21.15.72:0/3028988829 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd6f0004800 msgr2=0x7fd6f0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T16:33:55.419 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:55.416+0000 7fd70b400640 1 --2- 172.21.15.72:0/3028988829 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd6f0004800 0x7fd6f0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:55.419 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:55.416+0000 7fd70b400640 1 -- 172.21.15.72:0/3028988829 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6f0003520 con 0x7fd6f0003b90 2024-04-04T16:33:55.419 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:55.416+0000 7fd70aa00640 1 --2- 172.21.15.72:0/3028988829 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd6f0004800 0x7fd6f0004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-04T16:33:55.419 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:55.416+0000 7fd70be00640 1 --2- 172.21.15.72:0/3028988829 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd6f00051c0 0x7fd6f000b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-04T16:33:55.419 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:55.416+0000 7fd70be00640 1 -- 172.21.15.72:0/3028988829 reap_dead start 2024-04-04T16:33:55.419 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:55.417+0000 7fd70b400640 1 --2- 172.21.15.72:0/3028988829 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd6f0003b90 0x7fd6f0003f90 secure :-1 s=READY pgs=2190 cs=0 l=1 rev1=1 crypto rx=0x7fd6fc00c0e0 tx=0x7fd6f0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7422e20aebc2b78d server_cookie=0 in_seq=0 out_seq=0 2024-04-04T16:33:55.419 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:55.417+0000 7fd70a000640 1 -- 172.21.15.72:0/3028988829 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6fc007c40 con 0x7fd6f0003b90 2024-04-04T16:33:55.419 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:55.417+0000 7fd70a000640 1 -- 172.21.15.72:0/3028988829 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6fc030070 con 0x7fd6f0003b90 2024-04-04T16:33:55.419 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:55.417+0000 7fd70a000640 1 -- 172.21.15.72:0/3028988829 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6fc005d90 con 0x7fd6f0003b90 2024-04-04T16:33:55.420 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:55.418+0000 7fd711200640 1 -- 172.21.15.72:0/3028988829 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd6f0003b90 msgr2=0x7fd6f0003f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:55.420 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:55.418+0000 7fd711200640 1 --2- 172.21.15.72:0/3028988829 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd6f0003b90 0x7fd6f0003f90 secure :-1 s=READY pgs=2190 cs=0 l=1 rev1=1 crypto rx=0x7fd6fc00c0e0 tx=0x7fd6f0005830 comp rx=0 tx=0).stop 2024-04-04T16:33:55.420 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:55.418+0000 7fd711200640 1 -- 172.21.15.72:0/3028988829 shutdown_connections 2024-04-04T16:33:55.420 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:55.418+0000 7fd711200640 1 --2- 172.21.15.72:0/3028988829 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd6f0003b90 0x7fd6f0003f90 unknown :-1 s=CLOSED pgs=2190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:55.420 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:55.418+0000 7fd711200640 1 -- 172.21.15.72:0/3028988829 >> 172.21.15.72:0/3028988829 conn(0x7fd70c06b860 msgr2=0x7fd70c06bc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T16:33:55.420 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:55.418+0000 7fd711200640 1 -- 172.21.15.72:0/3028988829 shutdown_connections 2024-04-04T16:33:55.420 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:55.418+0000 7fd711200640 1 -- 172.21.15.72:0/3028988829 wait complete. 2024-04-04T16:33:55.423 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:55.419+0000 7fd711200640 1 Processor -- start 2024-04-04T16:33:55.423 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:55.420+0000 7fd711200640 1 -- start start 2024-04-04T16:33:55.424 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:55.420+0000 7fd711200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd6f0003b90 0x7fd70c0c8c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:55.424 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:55.420+0000 7fd711200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd70c15ff90 0x7fd70c0b5180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:55.424 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:55.420+0000 7fd711200640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd70c1603f0 0x7fd70c0b56c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:55.424 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:55.420+0000 7fd711200640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fd70c0cec30 con 0x7fd70c1603f0 2024-04-04T16:33:55.424 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:55.420+0000 7fd711200640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fd70c0cfaf0 con 0x7fd6f0003b90 2024-04-04T16:33:55.424 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:55.420+0000 7fd711200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fd70c0cedb0 con 0x7fd70c15ff90 2024-04-04T16:33:55.424 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:55.421+0000 7fd70be00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd70c1603f0 0x7fd70c0b56c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:55.424 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:55.421+0000 7fd70be00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd70c1603f0 0x7fd70c0b56c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51666/0 (socket says 172.21.15.72:51666) 2024-04-04T16:33:55.424 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:55.421+0000 7fd70be00640 1 -- 172.21.15.72:0/2289184552 learned_addr learned my addr 172.21.15.72:0/2289184552 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T16:33:55.425 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:55.421+0000 7fd70b400640 1 --2- 172.21.15.72:0/2289184552 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd6f0003b90 0x7fd70c0c8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:55.425 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:55.421+0000 7fd70aa00640 1 --2- 172.21.15.72:0/2289184552 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd70c15ff90 0x7fd70c0b5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:55.425 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:55.421+0000 7fd70be00640 1 -- 172.21.15.72:0/2289184552 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd70c15ff90 msgr2=0x7fd70c0b5180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:55.425 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:55.421+0000 7fd70be00640 1 --2- 172.21.15.72:0/2289184552 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd70c15ff90 0x7fd70c0b5180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:55.425 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:55.421+0000 7fd70be00640 1 -- 172.21.15.72:0/2289184552 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd6f0003b90 msgr2=0x7fd70c0c8c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:55.426 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:55.421+0000 7fd70be00640 1 --2- 172.21.15.72:0/2289184552 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd6f0003b90 0x7fd70c0c8c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:55.426 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:55.421+0000 7fd70be00640 1 -- 172.21.15.72:0/2289184552 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd70c0c9180 con 0x7fd70c1603f0 2024-04-04T16:33:55.426 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:55.421+0000 7fd70be00640 1 --2- 172.21.15.72:0/2289184552 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd70c1603f0 0x7fd70c0b56c0 secure :-1 s=READY pgs=2191 cs=0 l=1 rev1=1 crypto rx=0x7fd70c0d0c80 tx=0x7fd70400dbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T16:33:55.426 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:55.422+0000 7fd703400640 1 -- 172.21.15.72:0/2289184552 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd704018070 con 0x7fd70c1603f0 2024-04-04T16:33:55.426 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:55.422+0000 7fd703400640 1 -- 172.21.15.72:0/2289184552 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd704003b80 con 0x7fd70c1603f0 2024-04-04T16:33:55.426 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:55.422+0000 7fd703400640 1 -- 172.21.15.72:0/2289184552 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd704005070 con 0x7fd70c1603f0 2024-04-04T16:33:55.426 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:55.422+0000 7fd711200640 1 -- 172.21.15.72:0/2289184552 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd70c1609c0 con 0x7fd70c1603f0 2024-04-04T16:33:55.426 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:55.422+0000 7fd711200640 1 -- 172.21.15.72:0/2289184552 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd70c160f80 con 0x7fd70c1603f0 2024-04-04T16:33:55.427 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:55.423+0000 7fd711200640 1 -- 172.21.15.72:0/2289184552 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd70c0756c0 con 0x7fd70c1603f0 2024-04-04T16:33:55.427 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:55.424+0000 7fd703400640 1 -- 172.21.15.72:0/2289184552 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd704005210 con 0x7fd70c1603f0 2024-04-04T16:33:55.427 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:55.425+0000 7fd703400640 1 --2- 172.21.15.72:0/2289184552 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fd6ec06c920 0x7fd6ec06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:55.427 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:55.425+0000 7fd703400640 1 -- 172.21.15.72:0/2289184552 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 4943+0+0 (secure 0 0 0) 0x7fd70408ac90 con 0x7fd70c1603f0 2024-04-04T16:33:55.427 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:55.425+0000 7fd703400640 1 --2- 172.21.15.72:0/2289184552 >> [v2:172.21.15.72:6808/235374192,v1:172.21.15.72:6809/235374192] conn(0x7fd6ec0727e0 0x7fd6ec074c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:55.427 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:55.425+0000 7fd703400640 1 -- 172.21.15.72:0/2289184552 --> [v2:172.21.15.72:6808/235374192,v1:172.21.15.72:6809/235374192] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd6ec0752b0 con 0x7fd6ec0727e0 2024-04-04T16:33:55.427 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:55.425+0000 7fd703400640 1 -- 172.21.15.72:0/2289184552 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7fd70408d390 con 0x7fd70c1603f0 2024-04-04T16:33:55.427 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:55.425+0000 7fd70b400640 1 --2- 172.21.15.72:0/2289184552 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fd6ec06c920 0x7fd6ec06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:55.427 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:55.425+0000 7fd70aa00640 1 --2- 172.21.15.72:0/2289184552 >> [v2:172.21.15.72:6808/235374192,v1:172.21.15.72:6809/235374192] conn(0x7fd6ec0727e0 0x7fd6ec074c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:55.428 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:55.426+0000 7fd70b400640 1 --2- 172.21.15.72:0/2289184552 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fd6ec06c920 0x7fd6ec06ede0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7fd6fc034000 tx=0x7fd6fc009030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T16:33:55.428 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:55.426+0000 7fd70aa00640 1 --2- 172.21.15.72:0/2289184552 >> [v2:172.21.15.72:6808/235374192,v1:172.21.15.72:6809/235374192] conn(0x7fd6ec0727e0 0x7fd6ec074c00 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T16:33:55.429 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:55.427+0000 7fd703400640 1 -- 172.21.15.72:0/2289184552 <== osd.2 v2:172.21.15.72:6808/235374192 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd6ec0752b0 con 0x7fd6ec0727e0 2024-04-04T16:33:55.439 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:55.441+0000 7fd711200640 1 -- 172.21.15.72:0/2289184552 --> [v2:172.21.15.72:6808/235374192,v1:172.21.15.72:6809/235374192] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fd70c161a60 con 0x7fd6ec0727e0 2024-04-04T16:33:55.440 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:55.442+0000 7fd703400640 1 -- 172.21.15.72:0/2289184552 <== osd.2 v2:172.21.15.72:6808/235374192 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fd70c161a60 con 0x7fd6ec0727e0 2024-04-04T16:33:55.440 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-04T16:33:55.440 INFO:teuthology.orchestra.run.smithi072.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-04T16:33:55.440 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-04T16:33:55.441 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:55.442+0000 7fd711200640 1 -- 172.21.15.72:0/2289184552 >> [v2:172.21.15.72:6808/235374192,v1:172.21.15.72:6809/235374192] conn(0x7fd6ec0727e0 msgr2=0x7fd6ec074c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:55.441 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:55.442+0000 7fd711200640 1 --2- 172.21.15.72:0/2289184552 >> [v2:172.21.15.72:6808/235374192,v1:172.21.15.72:6809/235374192] conn(0x7fd6ec0727e0 0x7fd6ec074c00 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:55.442 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:55.442+0000 7fd711200640 1 -- 172.21.15.72:0/2289184552 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fd6ec06c920 msgr2=0x7fd6ec06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:55.442 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:55.442+0000 7fd711200640 1 --2- 172.21.15.72:0/2289184552 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fd6ec06c920 0x7fd6ec06ede0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7fd6fc034000 tx=0x7fd6fc009030 comp rx=0 tx=0).stop 2024-04-04T16:33:55.442 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:55.442+0000 7fd711200640 1 -- 172.21.15.72:0/2289184552 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd70c1603f0 msgr2=0x7fd70c0b56c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:55.442 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:55.442+0000 7fd711200640 1 --2- 172.21.15.72:0/2289184552 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd70c1603f0 0x7fd70c0b56c0 secure :-1 s=READY pgs=2191 cs=0 l=1 rev1=1 crypto rx=0x7fd70c0d0c80 tx=0x7fd70400dbf0 comp rx=0 tx=0).stop 2024-04-04T16:33:55.442 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:55.442+0000 7fd70be00640 1 -- 172.21.15.72:0/2289184552 reap_dead start 2024-04-04T16:33:55.442 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:55.442+0000 7fd711200640 1 -- 172.21.15.72:0/2289184552 shutdown_connections 2024-04-04T16:33:55.442 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:55.442+0000 7fd711200640 1 -- 172.21.15.72:0/2289184552 >> 172.21.15.72:0/2289184552 conn(0x7fd70c06b860 msgr2=0x7fd70c0d49e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T16:33:55.443 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:55.442+0000 7fd711200640 1 -- 172.21.15.72:0/2289184552 shutdown_connections 2024-04-04T16:33:55.443 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:55.442+0000 7fd711200640 1 -- 172.21.15.72:0/2289184552 wait complete. 2024-04-04T16:33:55.459 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-04-04T16:33:55.659 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:55.661+0000 7f4b28e00640 1 Processor -- start 2024-04-04T16:33:55.659 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:55.661+0000 7f4b28e00640 1 -- start start 2024-04-04T16:33:55.661 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:55.663+0000 7f4b28e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4b2415e5a0 0x7f4b240b75c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:55.661 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:55.663+0000 7f4b28e00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f4b240b7b00 0x7f4b240d2e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:55.661 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:55.663+0000 7f4b28e00640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b240d3820 con 0x7f4b240d3370 2024-04-04T16:33:55.661 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:55.663+0000 7f4b28e00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f4b240cf7f0 con 0x7f4b240b7b00 2024-04-04T16:33:55.661 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:55.663+0000 7f4b28e00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f4b240cfad0 con 0x7f4b2415e5a0 2024-04-04T16:33:55.661 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:55.663+0000 7f4b23e00640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f4b240d3370 0x7f4b240d08e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:39522/0 (socket says 172.21.15.72:39522) 2024-04-04T16:33:55.661 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:55.663+0000 7f4b23e00640 1 -- 172.21.15.72:0/121571998 learned_addr learned my addr 172.21.15.72:0/121571998 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-04-04T16:33:55.664 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:55.663+0000 7f4b23400640 1 --2- 172.21.15.72:0/121571998 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4b2415e5a0 0x7f4b240b75c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:55.665 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:55.663+0000 7f4b22000640 1 -- 172.21.15.72:0/121571998 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1013989354 0 0) 0x7f4b1c001490 con 0x7f4b240d3370 2024-04-04T16:33:55.665 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:55.663+0000 7f4b22000640 1 -- 172.21.15.72:0/121571998 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4b08003520 con 0x7f4b240d3370 2024-04-04T16:33:55.665 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:55.663+0000 7f4b22a00640 1 --2- 172.21.15.72:0/121571998 >> v2:172.21.15.117:3300/0 conn(0x7f4b240b7b00 0x7f4b240d2e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:55.665 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:55.664+0000 7f4b22000640 1 -- 172.21.15.72:0/121571998 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2403072425 0 0) 0x7f4b08003520 con 0x7f4b240d3370 2024-04-04T16:33:55.665 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:55.664+0000 7f4b22000640 1 -- 172.21.15.72:0/121571998 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4b2415e5a0 msgr2=0x7f4b240b75c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T16:33:55.665 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:55.664+0000 7f4b22000640 1 --2- 172.21.15.72:0/121571998 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4b2415e5a0 0x7f4b240b75c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:55.665 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:55.664+0000 7f4b22000640 1 -- 172.21.15.72:0/121571998 >> v2:172.21.15.117:3300/0 conn(0x7f4b240b7b00 msgr2=0x7f4b240d2e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T16:33:55.666 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:55.664+0000 7f4b22000640 1 --2- 172.21.15.72:0/121571998 >> v2:172.21.15.117:3300/0 conn(0x7f4b240b7b00 0x7f4b240d2e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:55.666 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:55.664+0000 7f4b22000640 1 -- 172.21.15.72:0/121571998 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b240d2350 con 0x7f4b240d3370 2024-04-04T16:33:55.666 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:55.664+0000 7f4b22000640 1 -- 172.21.15.72:0/121571998 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2465650867 0 0) 0x7f4b1c001bc0 con 0x7f4b240d3370 2024-04-04T16:33:55.666 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:55.664+0000 7f4b22000640 1 -- 172.21.15.72:0/121571998 >> v1:172.21.15.72:6789/0 conn(0x7f4b240d3370 legacy=0x7f4b240d08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:55.666 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:55.664+0000 7f4b22000640 1 --2- 172.21.15.72:0/121571998 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4b080039b0 0x7f4b08003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:55.666 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:55.664+0000 7f4b22000640 1 --2- 172.21.15.72:0/121571998 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4b08004800 0x7f4b08004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:55.666 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:55.664+0000 7f4b22000640 1 --2- 172.21.15.72:0/121571998 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4b080051c0 0x7f4b0800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:55.667 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:55.664+0000 7f4b22000640 1 -- 172.21.15.72:0/121571998 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f4b240cf7f0 con 0x7f4b080051c0 2024-04-04T16:33:55.667 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:55.664+0000 7f4b22000640 1 -- 172.21.15.72:0/121571998 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f4b240cfad0 con 0x7f4b08004800 2024-04-04T16:33:55.667 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:55.664+0000 7f4b22000640 1 -- 172.21.15.72:0/121571998 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f4b0800c000 con 0x7f4b080039b0 2024-04-04T16:33:55.667 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:55.664+0000 7f4b23400640 1 --2- 172.21.15.72:0/121571998 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4b2415e5a0 0x7f4b240b75c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-04T16:33:55.667 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:55.664+0000 7f4b23e00640 1 --2- 172.21.15.72:0/121571998 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4b080051c0 0x7f4b0800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:55.667 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:55.665+0000 7f4b23e00640 1 -- 172.21.15.72:0/121571998 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4b080039b0 msgr2=0x7f4b08003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T16:33:55.667 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:55.665+0000 7f4b23e00640 1 --2- 172.21.15.72:0/121571998 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4b080039b0 0x7f4b08003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:55.668 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:55.665+0000 7f4b23e00640 1 -- 172.21.15.72:0/121571998 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4b08004800 msgr2=0x7f4b08004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T16:33:55.668 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:55.665+0000 7f4b22a00640 1 --2- 172.21.15.72:0/121571998 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4b08004800 0x7f4b08004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:55.668 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:55.665+0000 7f4b23e00640 1 --2- 172.21.15.72:0/121571998 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4b08004800 0x7f4b08004c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:55.668 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:55.665+0000 7f4b23e00640 1 -- 172.21.15.72:0/121571998 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b08003520 con 0x7f4b080051c0 2024-04-04T16:33:55.668 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:55.666+0000 7f4b23e00640 1 --2- 172.21.15.72:0/121571998 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4b080051c0 0x7f4b0800b9c0 secure :-1 s=READY pgs=2193 cs=0 l=1 rev1=1 crypto rx=0x7f4b1c00aaa0 tx=0x7f4b08005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fabe61ede742d2a server_cookie=0 in_seq=0 out_seq=0 2024-04-04T16:33:55.668 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:55.666+0000 7f4b22000640 1 -- 172.21.15.72:0/121571998 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b1c038070 con 0x7f4b080051c0 2024-04-04T16:33:55.668 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:55.666+0000 7f4b22000640 1 -- 172.21.15.72:0/121571998 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b1c0072f0 con 0x7f4b080051c0 2024-04-04T16:33:55.669 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:55.666+0000 7f4b22000640 1 -- 172.21.15.72:0/121571998 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b1c00a690 con 0x7f4b080051c0 2024-04-04T16:33:55.669 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:55.666+0000 7f4b28e00640 1 -- 172.21.15.72:0/121571998 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4b080051c0 msgr2=0x7f4b0800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:55.669 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:55.666+0000 7f4b28e00640 1 --2- 172.21.15.72:0/121571998 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4b080051c0 0x7f4b0800b9c0 secure :-1 s=READY pgs=2193 cs=0 l=1 rev1=1 crypto rx=0x7f4b1c00aaa0 tx=0x7f4b08005830 comp rx=0 tx=0).stop 2024-04-04T16:33:55.669 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:55.666+0000 7f4b23e00640 1 -- 172.21.15.72:0/121571998 reap_dead start 2024-04-04T16:33:55.669 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:55.667+0000 7f4b28e00640 1 -- 172.21.15.72:0/121571998 shutdown_connections 2024-04-04T16:33:55.669 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:55.667+0000 7f4b28e00640 1 -- 172.21.15.72:0/121571998 >> 172.21.15.72:0/121571998 conn(0x7f4b2406b890 msgr2=0x7f4b2406bca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T16:33:55.670 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:55.667+0000 7f4b28e00640 1 -- 172.21.15.72:0/121571998 shutdown_connections 2024-04-04T16:33:55.670 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:55.667+0000 7f4b28e00640 1 -- 172.21.15.72:0/121571998 wait complete. 2024-04-04T16:33:55.673 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:55.668+0000 7f4b28e00640 1 Processor -- start 2024-04-04T16:33:55.673 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:55.669+0000 7f4b28e00640 1 -- start start 2024-04-04T16:33:55.673 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:55.669+0000 7f4b28e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4b241576d0 0x7f4b2415a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:55.673 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:55.669+0000 7f4b28e00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4b24161720 0x7f4b240b38c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:55.673 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:55.669+0000 7f4b28e00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4b240b3e00 0x7f4b2415fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:55.674 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:55.669+0000 7f4b28e00640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f4b2415e980 con 0x7f4b240b3e00 2024-04-04T16:33:55.674 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:55.669+0000 7f4b28e00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f4b240d2910 con 0x7f4b24161720 2024-04-04T16:33:55.674 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:55.669+0000 7f4b28e00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f4b240d0ff0 con 0x7f4b241576d0 2024-04-04T16:33:55.674 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:55.670+0000 7f4b23e00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4b240b3e00 0x7f4b2415fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:55.674 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:55.670+0000 7f4b23e00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4b240b3e00 0x7f4b2415fc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51678/0 (socket says 172.21.15.72:51678) 2024-04-04T16:33:55.674 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:55.670+0000 7f4b23e00640 1 -- 172.21.15.72:0/1841041126 learned_addr learned my addr 172.21.15.72:0/1841041126 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T16:33:55.674 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:55.670+0000 7f4b22a00640 1 --2- 172.21.15.72:0/1841041126 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4b24161720 0x7f4b240b38c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:55.675 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:55.670+0000 7f4b23400640 1 --2- 172.21.15.72:0/1841041126 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4b241576d0 0x7f4b2415a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:55.675 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:55.670+0000 7f4b23e00640 1 -- 172.21.15.72:0/1841041126 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4b241576d0 msgr2=0x7f4b2415a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:55.675 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:55.670+0000 7f4b23e00640 1 --2- 172.21.15.72:0/1841041126 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4b241576d0 0x7f4b2415a6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:55.675 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:55.670+0000 7f4b23e00640 1 -- 172.21.15.72:0/1841041126 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4b24161720 msgr2=0x7f4b240b38c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:55.675 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:55.670+0000 7f4b23e00640 1 --2- 172.21.15.72:0/1841041126 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4b24161720 0x7f4b240b38c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:55.675 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:55.670+0000 7f4b23e00640 1 -- 172.21.15.72:0/1841041126 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b2415b040 con 0x7f4b240b3e00 2024-04-04T16:33:55.675 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:55.671+0000 7f4b23e00640 1 --2- 172.21.15.72:0/1841041126 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4b240b3e00 0x7f4b2415fc80 secure :-1 s=READY pgs=2194 cs=0 l=1 rev1=1 crypto rx=0x7f4b1c00aaa0 tx=0x7f4b240d2520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T16:33:55.676 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:55.671+0000 7f4b1b400640 1 -- 172.21.15.72:0/1841041126 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b1c038040 con 0x7f4b240b3e00 2024-04-04T16:33:55.676 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:55.671+0000 7f4b1b400640 1 -- 172.21.15.72:0/1841041126 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b1c001bb0 con 0x7f4b240b3e00 2024-04-04T16:33:55.676 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:55.671+0000 7f4b1b400640 1 -- 172.21.15.72:0/1841041126 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b1c00a690 con 0x7f4b240b3e00 2024-04-04T16:33:55.676 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:55.671+0000 7f4b28e00640 1 -- 172.21.15.72:0/1841041126 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b2415b320 con 0x7f4b240b3e00 2024-04-04T16:33:55.676 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:55.671+0000 7f4b28e00640 1 -- 172.21.15.72:0/1841041126 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b2415b8e0 con 0x7f4b240b3e00 2024-04-04T16:33:55.676 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:55.672+0000 7f4b28e00640 1 -- 172.21.15.72:0/1841041126 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b240756c0 con 0x7f4b240b3e00 2024-04-04T16:33:55.676 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:55.673+0000 7f4b1b400640 1 -- 172.21.15.72:0/1841041126 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4b1c0072f0 con 0x7f4b240b3e00 2024-04-04T16:33:55.677 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:55.674+0000 7f4b1b400640 1 --2- 172.21.15.72:0/1841041126 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f4b0406c920 0x7f4b0406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:55.677 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:55.674+0000 7f4b1b400640 1 -- 172.21.15.72:0/1841041126 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 4943+0+0 (secure 0 0 0) 0x7f4b1c0aca30 con 0x7f4b240b3e00 2024-04-04T16:33:55.677 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:55.674+0000 7f4b23400640 1 --2- 172.21.15.72:0/1841041126 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f4b0406c920 0x7f4b0406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:55.677 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:55.675+0000 7f4b23400640 1 --2- 172.21.15.72:0/1841041126 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f4b0406c920 0x7f4b0406ede0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f4b240723e0 tx=0x7f4b14008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T16:33:55.677 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:55.679+0000 7f4b1b400640 1 -- 172.21.15.72:0/1841041126 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f4b240d3820 con 0x7f4b240b3e00 2024-04-04T16:33:55.873 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:55.875+0000 7f4b28e00640 1 -- 172.21.15.72:0/1841041126 --> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7f4b240d2090 con 0x7f4b0406c920 2024-04-04T16:33:55.874 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:55.876+0000 7f4b1b400640 1 -- 172.21.15.72:0/1841041126 <== mgr.4101 v2:172.21.15.72:6832/2205173820 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f4b240d2090 con 0x7f4b0406c920 2024-04-04T16:33:55.874 INFO:teuthology.orchestra.run.smithi072.stderr:instructed osd(s) 2 to deep-scrub 2024-04-04T16:33:55.877 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:55.879+0000 7f4b28e00640 1 -- 172.21.15.72:0/1841041126 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f4b0406c920 msgr2=0x7f4b0406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:55.877 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:55.879+0000 7f4b28e00640 1 --2- 172.21.15.72:0/1841041126 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f4b0406c920 0x7f4b0406ede0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f4b240723e0 tx=0x7f4b14008040 comp rx=0 tx=0).stop 2024-04-04T16:33:55.877 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:55.879+0000 7f4b28e00640 1 -- 172.21.15.72:0/1841041126 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4b240b3e00 msgr2=0x7f4b2415fc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:55.877 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:55.879+0000 7f4b28e00640 1 --2- 172.21.15.72:0/1841041126 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4b240b3e00 0x7f4b2415fc80 secure :-1 s=READY pgs=2194 cs=0 l=1 rev1=1 crypto rx=0x7f4b1c00aaa0 tx=0x7f4b240d2520 comp rx=0 tx=0).stop 2024-04-04T16:33:55.877 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:55.879+0000 7f4b28e00640 1 -- 172.21.15.72:0/1841041126 shutdown_connections 2024-04-04T16:33:55.877 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:55.879+0000 7f4b28e00640 1 --2- 172.21.15.72:0/1841041126 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f4b0406c920 0x7f4b0406ede0 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:55.877 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:55.879+0000 7f4b28e00640 1 --2- 172.21.15.72:0/1841041126 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4b240b3e00 0x7f4b2415fc80 unknown :-1 s=CLOSED pgs=2194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:55.878 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:55.879+0000 7f4b28e00640 1 --2- 172.21.15.72:0/1841041126 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4b24161720 0x7f4b240b38c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:55.878 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:55.879+0000 7f4b28e00640 1 --2- 172.21.15.72:0/1841041126 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4b241576d0 0x7f4b2415a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:55.878 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:55.879+0000 7f4b28e00640 1 -- 172.21.15.72:0/1841041126 >> 172.21.15.72:0/1841041126 conn(0x7f4b2406b890 msgr2=0x7f4b241595d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T16:33:55.878 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:55.879+0000 7f4b28e00640 1 -- 172.21.15.72:0/1841041126 shutdown_connections 2024-04-04T16:33:55.878 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:55.879+0000 7f4b28e00640 1 -- 172.21.15.72:0/1841041126 wait complete. 2024-04-04T16:33:55.896 INFO:tasks.ceph:Scrubbing osd.3 2024-04-04T16:33:55.896 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-04-04T16:33:56.097 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.099+0000 7ff9b9400640 1 Processor -- start 2024-04-04T16:33:56.097 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.099+0000 7ff9b9400640 1 -- start start 2024-04-04T16:33:56.098 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.100+0000 7ff9b9400640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff9b415e4a0 0x7ff9b40b5b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:56.098 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.100+0000 7ff9b9400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff9b40b30e0 0x7ff9b40b6050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:56.099 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.100+0000 7ff9b9400640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9b4162350 con 0x7ff9b40b6590 2024-04-04T16:33:56.099 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.100+0000 7ff9b9400640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7ff9b40b74a0 con 0x7ff9b415e4a0 2024-04-04T16:33:56.099 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.100+0000 7ff9b9400640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7ff9b4162630 con 0x7ff9b40b30e0 2024-04-04T16:33:56.099 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.100+0000 7ff9b3e00640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff9b415e4a0 0x7ff9b40b5b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:56.099 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.100+0000 7ff9b3e00640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff9b415e4a0 0x7ff9b40b5b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51694/0 (socket says 172.21.15.72:51694) 2024-04-04T16:33:56.099 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.100+0000 7ff9b3e00640 1 -- 172.21.15.72:0/3360574371 learned_addr learned my addr 172.21.15.72:0/3360574371 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T16:33:56.099 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.101+0000 7ff9abe00640 1 --2- 172.21.15.72:0/3360574371 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff9b40b30e0 0x7ff9b40b6050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:56.100 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.101+0000 7ff9b3e00640 1 -- 172.21.15.72:0/3360574371 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff9b40b30e0 msgr2=0x7ff9b40b6050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T16:33:56.100 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.101+0000 7ff9b3e00640 1 --2- 172.21.15.72:0/3360574371 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff9b40b30e0 0x7ff9b40b6050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:56.100 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.101+0000 7ff9b3e00640 1 -- 172.21.15.72:0/3360574371 >> v1:172.21.15.117:6789/0 conn(0x7ff9b40b6590 legacy=0x7ff9b40ce980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:56.100 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.101+0000 7ff9b3e00640 1 -- 172.21.15.72:0/3360574371 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9b4162910 con 0x7ff9b415e4a0 2024-04-04T16:33:56.100 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.101+0000 7ff9abe00640 1 --2- 172.21.15.72:0/3360574371 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff9b40b30e0 0x7ff9b40b6050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-04T16:33:56.101 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.102+0000 7ff9b3e00640 1 --2- 172.21.15.72:0/3360574371 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff9b415e4a0 0x7ff9b40b5b10 secure :-1 s=READY pgs=2195 cs=0 l=1 rev1=1 crypto rx=0x7ff9a4009870 tx=0x7ff9a402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=770706a1806e5185 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T16:33:56.101 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.102+0000 7ff9b3400640 1 -- 172.21.15.72:0/3360574371 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9a4035020 con 0x7ff9b415e4a0 2024-04-04T16:33:56.102 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.102+0000 7ff9b3400640 1 -- 172.21.15.72:0/3360574371 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9a4031640 con 0x7ff9b415e4a0 2024-04-04T16:33:56.102 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.102+0000 7ff9b3400640 1 -- 172.21.15.72:0/3360574371 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9a402d040 con 0x7ff9b415e4a0 2024-04-04T16:33:56.102 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.103+0000 7ff9b9400640 1 -- 172.21.15.72:0/3360574371 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff9b415e4a0 msgr2=0x7ff9b40b5b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:56.102 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.103+0000 7ff9b9400640 1 --2- 172.21.15.72:0/3360574371 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff9b415e4a0 0x7ff9b40b5b10 secure :-1 s=READY pgs=2195 cs=0 l=1 rev1=1 crypto rx=0x7ff9a4009870 tx=0x7ff9a402b8f0 comp rx=0 tx=0).stop 2024-04-04T16:33:56.102 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.103+0000 7ff9b9400640 1 -- 172.21.15.72:0/3360574371 shutdown_connections 2024-04-04T16:33:56.102 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.103+0000 7ff9b9400640 1 --2- 172.21.15.72:0/3360574371 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff9b40b30e0 0x7ff9b40b6050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:56.102 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.103+0000 7ff9b9400640 1 --2- 172.21.15.72:0/3360574371 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff9b415e4a0 0x7ff9b40b5b10 unknown :-1 s=CLOSED pgs=2195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:56.102 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.103+0000 7ff9b9400640 1 -- 172.21.15.72:0/3360574371 >> 172.21.15.72:0/3360574371 conn(0x7ff9b406b890 msgr2=0x7ff9b406bca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T16:33:56.103 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.103+0000 7ff9b9400640 1 -- 172.21.15.72:0/3360574371 shutdown_connections 2024-04-04T16:33:56.103 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.103+0000 7ff9b9400640 1 -- 172.21.15.72:0/3360574371 wait complete. 2024-04-04T16:33:56.105 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.104+0000 7ff9b9400640 1 Processor -- start 2024-04-04T16:33:56.105 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.105+0000 7ff9b9400640 1 -- start start 2024-04-04T16:33:56.105 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.105+0000 7ff9b9400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff9b40b30e0 0x7ff9b41525a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:56.105 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.105+0000 7ff9b9400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff9b40b6590 0x7ff9b4157c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:56.105 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.105+0000 7ff9b9400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff9b415e4a0 0x7ff9b415c550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:56.105 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.105+0000 7ff9b9400640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7ff9b4161fe0 con 0x7ff9b40b30e0 2024-04-04T16:33:56.106 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.105+0000 7ff9b9400640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7ff9b415e880 con 0x7ff9b415e4a0 2024-04-04T16:33:56.106 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.105+0000 7ff9b9400640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7ff9b40d3540 con 0x7ff9b40b6590 2024-04-04T16:33:56.106 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.106+0000 7ff9b3e00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff9b40b30e0 0x7ff9b41525a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:56.106 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.106+0000 7ff9b3e00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff9b40b30e0 0x7ff9b41525a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51696/0 (socket says 172.21.15.72:51696) 2024-04-04T16:33:56.106 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.106+0000 7ff9b3e00640 1 -- 172.21.15.72:0/2823905671 learned_addr learned my addr 172.21.15.72:0/2823905671 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T16:33:56.106 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.106+0000 7ff9b8a00640 1 --2- 172.21.15.72:0/2823905671 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff9b415e4a0 0x7ff9b415c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:56.106 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.106+0000 7ff9abe00640 1 --2- 172.21.15.72:0/2823905671 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff9b40b6590 0x7ff9b4157c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:56.106 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.106+0000 7ff9b3e00640 1 -- 172.21.15.72:0/2823905671 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff9b40b6590 msgr2=0x7ff9b4157c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:56.107 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.106+0000 7ff9b3e00640 1 --2- 172.21.15.72:0/2823905671 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff9b40b6590 0x7ff9b4157c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:56.107 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.106+0000 7ff9b3e00640 1 -- 172.21.15.72:0/2823905671 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff9b415e4a0 msgr2=0x7ff9b415c550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:56.107 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.106+0000 7ff9b3e00640 1 --2- 172.21.15.72:0/2823905671 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff9b415e4a0 0x7ff9b415c550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:56.107 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.106+0000 7ff9b3e00640 1 -- 172.21.15.72:0/2823905671 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9b4158500 con 0x7ff9b40b30e0 2024-04-04T16:33:56.107 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.106+0000 7ff9b8a00640 1 --2- 172.21.15.72:0/2823905671 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff9b415e4a0 0x7ff9b415c550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-04T16:33:56.107 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.106+0000 7ff9b3e00640 1 --2- 172.21.15.72:0/2823905671 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff9b40b30e0 0x7ff9b41525a0 secure :-1 s=READY pgs=2196 cs=0 l=1 rev1=1 crypto rx=0x7ff9a402b930 tx=0x7ff9a40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T16:33:56.107 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.107+0000 7ff9b0c00640 1 -- 172.21.15.72:0/2823905671 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9a4035040 con 0x7ff9b40b30e0 2024-04-04T16:33:56.107 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.107+0000 7ff9b0c00640 1 -- 172.21.15.72:0/2823905671 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9a4039bf0 con 0x7ff9b40b30e0 2024-04-04T16:33:56.108 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.107+0000 7ff9b9400640 1 -- 172.21.15.72:0/2823905671 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9b41587e0 con 0x7ff9b40b30e0 2024-04-04T16:33:56.108 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.107+0000 7ff9b0c00640 1 -- 172.21.15.72:0/2823905671 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9a4045480 con 0x7ff9b40b30e0 2024-04-04T16:33:56.108 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.107+0000 7ff9b9400640 1 -- 172.21.15.72:0/2823905671 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9b4158da0 con 0x7ff9b40b30e0 2024-04-04T16:33:56.109 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.108+0000 7ff9b9400640 1 -- 172.21.15.72:0/2823905671 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff9b40685a0 con 0x7ff9b40b30e0 2024-04-04T16:33:56.109 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.109+0000 7ff9b0c00640 1 -- 172.21.15.72:0/2823905671 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff9a4038020 con 0x7ff9b40b30e0 2024-04-04T16:33:56.110 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.110+0000 7ff9b0c00640 1 --2- 172.21.15.72:0/2823905671 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7ff99006c8f0 0x7ff99006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:56.110 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.110+0000 7ff9b0c00640 1 -- 172.21.15.72:0/2823905671 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 4943+0+0 (secure 0 0 0) 0x7ff9a40ad940 con 0x7ff9b40b30e0 2024-04-04T16:33:56.110 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.110+0000 7ff9abe00640 1 --2- 172.21.15.72:0/2823905671 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7ff99006c8f0 0x7ff99006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:56.110 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.110+0000 7ff9b0c00640 1 --2- 172.21.15.72:0/2823905671 >> [v2:172.21.15.72:6817/2806631742,v1:172.21.15.72:6819/2806631742] conn(0x7ff9900727b0 0x7ff990074bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:56.110 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.110+0000 7ff9b0c00640 1 -- 172.21.15.72:0/2823905671 --> [v2:172.21.15.72:6817/2806631742,v1:172.21.15.72:6819/2806631742] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff9a400af30 con 0x7ff9900727b0 2024-04-04T16:33:56.110 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.110+0000 7ff9b0c00640 1 -- 172.21.15.72:0/2823905671 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7ff9a40b22a0 con 0x7ff9b40b30e0 2024-04-04T16:33:56.110 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.110+0000 7ff9b8a00640 1 --2- 172.21.15.72:0/2823905671 >> [v2:172.21.15.72:6817/2806631742,v1:172.21.15.72:6819/2806631742] conn(0x7ff9900727b0 0x7ff990074bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:56.110 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.111+0000 7ff9abe00640 1 --2- 172.21.15.72:0/2823905671 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7ff99006c8f0 0x7ff99006edb0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7ff9b40cdfc0 tx=0x7ff99c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T16:33:56.111 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.111+0000 7ff9b8a00640 1 --2- 172.21.15.72:0/2823905671 >> [v2:172.21.15.72:6817/2806631742,v1:172.21.15.72:6819/2806631742] conn(0x7ff9900727b0 0x7ff990074bd0 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T16:33:56.111 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.112+0000 7ff9b0c00640 1 -- 172.21.15.72:0/2823905671 <== osd.3 v2:172.21.15.72:6817/2806631742 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff9a400af30 con 0x7ff9900727b0 2024-04-04T16:33:56.123 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.126+0000 7ff9b9400640 1 -- 172.21.15.72:0/2823905671 --> [v2:172.21.15.72:6817/2806631742,v1:172.21.15.72:6819/2806631742] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7ff9b40d1fa0 con 0x7ff9900727b0 2024-04-04T16:33:56.124 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.126+0000 7ff9b0c00640 1 -- 172.21.15.72:0/2823905671 <== osd.3 v2:172.21.15.72:6817/2806631742 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7ff9b40d1fa0 con 0x7ff9900727b0 2024-04-04T16:33:56.124 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-04T16:33:56.125 INFO:teuthology.orchestra.run.smithi072.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-04T16:33:56.125 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-04T16:33:56.126 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.127+0000 7ff9b9400640 1 -- 172.21.15.72:0/2823905671 >> [v2:172.21.15.72:6817/2806631742,v1:172.21.15.72:6819/2806631742] conn(0x7ff9900727b0 msgr2=0x7ff990074bd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:56.126 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.127+0000 7ff9b9400640 1 --2- 172.21.15.72:0/2823905671 >> [v2:172.21.15.72:6817/2806631742,v1:172.21.15.72:6819/2806631742] conn(0x7ff9900727b0 0x7ff990074bd0 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:56.126 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.127+0000 7ff9b9400640 1 -- 172.21.15.72:0/2823905671 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7ff99006c8f0 msgr2=0x7ff99006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:56.126 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.127+0000 7ff9b9400640 1 --2- 172.21.15.72:0/2823905671 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7ff99006c8f0 0x7ff99006edb0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7ff9b40cdfc0 tx=0x7ff99c008040 comp rx=0 tx=0).stop 2024-04-04T16:33:56.126 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.127+0000 7ff9b9400640 1 -- 172.21.15.72:0/2823905671 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff9b40b30e0 msgr2=0x7ff9b41525a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:56.126 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.127+0000 7ff9b9400640 1 --2- 172.21.15.72:0/2823905671 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff9b40b30e0 0x7ff9b41525a0 secure :-1 s=READY pgs=2196 cs=0 l=1 rev1=1 crypto rx=0x7ff9a402b930 tx=0x7ff9a40046c0 comp rx=0 tx=0).stop 2024-04-04T16:33:56.126 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.127+0000 7ff9b8a00640 1 -- 172.21.15.72:0/2823905671 reap_dead start 2024-04-04T16:33:56.127 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.127+0000 7ff9b9400640 1 -- 172.21.15.72:0/2823905671 shutdown_connections 2024-04-04T16:33:56.127 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.127+0000 7ff9b9400640 1 -- 172.21.15.72:0/2823905671 >> 172.21.15.72:0/2823905671 conn(0x7ff9b406b890 msgr2=0x7ff9b40d2530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T16:33:56.127 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.127+0000 7ff9b9400640 1 -- 172.21.15.72:0/2823905671 shutdown_connections 2024-04-04T16:33:56.127 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.127+0000 7ff9b9400640 1 -- 172.21.15.72:0/2823905671 wait complete. 2024-04-04T16:33:56.141 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-04-04T16:33:56.345 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.347+0000 7ff957e00640 1 Processor -- start 2024-04-04T16:33:56.346 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.347+0000 7ff957e00640 1 -- start start 2024-04-04T16:33:56.347 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.349+0000 7ff957e00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7ff95815e5a0 0x7ff9580b75c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:56.347 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.349+0000 7ff957e00640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff9580b7b00 0x7ff9580d2e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:56.347 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.349+0000 7ff957e00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9580d3820 con 0x7ff9580d3370 2024-04-04T16:33:56.348 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.349+0000 7ff957e00640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7ff9580cf7f0 con 0x7ff9580b7b00 2024-04-04T16:33:56.348 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.349+0000 7ff957e00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7ff9580cfad0 con 0x7ff95815e5a0 2024-04-04T16:33:56.348 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.349+0000 7ff94fe00640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff9580b7b00 0x7ff9580d2e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:56.348 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.350+0000 7ff94fe00640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff9580b7b00 0x7ff9580d2e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51710/0 (socket says 172.21.15.72:51710) 2024-04-04T16:33:56.348 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.350+0000 7ff94fe00640 1 -- 172.21.15.72:0/1941961801 learned_addr learned my addr 172.21.15.72:0/1941961801 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T16:33:56.349 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.350+0000 7ff956a00640 1 --2- 172.21.15.72:0/1941961801 >> v2:172.21.15.117:3300/0 conn(0x7ff95815e5a0 0x7ff9580b75c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:56.349 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.350+0000 7ff94fe00640 1 -- 172.21.15.72:0/1941961801 >> v2:172.21.15.117:3300/0 conn(0x7ff95815e5a0 msgr2=0x7ff9580b75c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T16:33:56.349 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.350+0000 7ff94fe00640 1 --2- 172.21.15.72:0/1941961801 >> v2:172.21.15.117:3300/0 conn(0x7ff95815e5a0 0x7ff9580b75c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:56.349 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.350+0000 7ff94fe00640 1 -- 172.21.15.72:0/1941961801 >> v1:172.21.15.117:6789/0 conn(0x7ff9580d3370 legacy=0x7ff9580d08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T16:33:56.350 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.350+0000 7ff94fe00640 1 -- 172.21.15.72:0/1941961801 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9580d2350 con 0x7ff9580b7b00 2024-04-04T16:33:56.350 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.350+0000 7ff956a00640 1 --2- 172.21.15.72:0/1941961801 >> v2:172.21.15.117:3300/0 conn(0x7ff95815e5a0 0x7ff9580b75c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-04T16:33:56.350 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.351+0000 7ff94fe00640 1 --2- 172.21.15.72:0/1941961801 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff9580b7b00 0x7ff9580d2e30 secure :-1 s=READY pgs=2197 cs=0 l=1 rev1=1 crypto rx=0x7ff9580d1820 tx=0x7ff94002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9be5fcf840f0b4ca server_cookie=0 in_seq=0 out_seq=0 2024-04-04T16:33:56.350 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.351+0000 7ff956000640 1 -- 172.21.15.72:0/1941961801 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff940035020 con 0x7ff9580b7b00 2024-04-04T16:33:56.350 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.351+0000 7ff956000640 1 -- 172.21.15.72:0/1941961801 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff940031870 con 0x7ff9580b7b00 2024-04-04T16:33:56.350 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.351+0000 7ff956000640 1 -- 172.21.15.72:0/1941961801 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff940031c40 con 0x7ff9580b7b00 2024-04-04T16:33:56.351 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.352+0000 7ff957e00640 1 -- 172.21.15.72:0/1941961801 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff9580b7b00 msgr2=0x7ff9580d2e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:56.351 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.352+0000 7ff957e00640 1 --2- 172.21.15.72:0/1941961801 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff9580b7b00 0x7ff9580d2e30 secure :-1 s=READY pgs=2197 cs=0 l=1 rev1=1 crypto rx=0x7ff9580d1820 tx=0x7ff94002b910 comp rx=0 tx=0).stop 2024-04-04T16:33:56.352 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.352+0000 7ff957e00640 1 -- 172.21.15.72:0/1941961801 shutdown_connections 2024-04-04T16:33:56.352 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.352+0000 7ff957e00640 1 --2- 172.21.15.72:0/1941961801 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff9580b7b00 0x7ff9580d2e30 unknown :-1 s=CLOSED pgs=2197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:56.352 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.352+0000 7ff957e00640 1 --2- 172.21.15.72:0/1941961801 >> v2:172.21.15.117:3300/0 conn(0x7ff95815e5a0 0x7ff9580b75c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:56.352 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.352+0000 7ff957e00640 1 -- 172.21.15.72:0/1941961801 >> 172.21.15.72:0/1941961801 conn(0x7ff95806b890 msgr2=0x7ff95806bca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T16:33:56.352 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.352+0000 7ff957e00640 1 -- 172.21.15.72:0/1941961801 shutdown_connections 2024-04-04T16:33:56.352 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.352+0000 7ff957e00640 1 -- 172.21.15.72:0/1941961801 wait complete. 2024-04-04T16:33:56.352 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.354+0000 7ff957e00640 1 Processor -- start 2024-04-04T16:33:56.354 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.354+0000 7ff957e00640 1 -- start start 2024-04-04T16:33:56.354 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.355+0000 7ff957e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff9580b7b00 0x7ff9580b2e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:56.354 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.355+0000 7ff957e00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff9580d3370 0x7ff9581f4130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:56.354 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.355+0000 7ff957e00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff95815e5a0 0x7ff9580cd690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:56.355 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.355+0000 7ff957e00640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7ff95815e980 con 0x7ff9580d3370 2024-04-04T16:33:56.355 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.355+0000 7ff957e00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7ff9580d2910 con 0x7ff95815e5a0 2024-04-04T16:33:56.355 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.355+0000 7ff957e00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7ff9580d0ff0 con 0x7ff9580b7b00 2024-04-04T16:33:56.355 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.355+0000 7ff94fe00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff9580d3370 0x7ff9581f4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:56.357 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.355+0000 7ff94fe00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff9580d3370 0x7ff9581f4130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51726/0 (socket says 172.21.15.72:51726) 2024-04-04T16:33:56.357 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.355+0000 7ff94fe00640 1 -- 172.21.15.72:0/3868520144 learned_addr learned my addr 172.21.15.72:0/3868520144 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T16:33:56.358 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.355+0000 7ff956a00640 1 --2- 172.21.15.72:0/3868520144 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff9580b7b00 0x7ff9580b2e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:56.358 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.355+0000 7ff957400640 1 --2- 172.21.15.72:0/3868520144 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff95815e5a0 0x7ff9580cd690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:56.358 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.356+0000 7ff94fe00640 1 -- 172.21.15.72:0/3868520144 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff9580b7b00 msgr2=0x7ff9580b2e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:56.358 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.356+0000 7ff94fe00640 1 --2- 172.21.15.72:0/3868520144 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff9580b7b00 0x7ff9580b2e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:56.358 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.356+0000 7ff94fe00640 1 -- 172.21.15.72:0/3868520144 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff95815e5a0 msgr2=0x7ff9580cd690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:56.358 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.356+0000 7ff94fe00640 1 --2- 172.21.15.72:0/3868520144 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff95815e5a0 0x7ff9580cd690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:56.358 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.356+0000 7ff94fe00640 1 -- 172.21.15.72:0/3868520144 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9581569e0 con 0x7ff9580d3370 2024-04-04T16:33:56.358 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.356+0000 7ff94fe00640 1 --2- 172.21.15.72:0/3868520144 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff9580d3370 0x7ff9581f4130 secure :-1 s=READY pgs=2198 cs=0 l=1 rev1=1 crypto rx=0x7ff940000c00 tx=0x7ff9400046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T16:33:56.359 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.356+0000 7ff94ea00640 1 -- 172.21.15.72:0/3868520144 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff940040070 con 0x7ff9580d3370 2024-04-04T16:33:56.359 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.356+0000 7ff94ea00640 1 -- 172.21.15.72:0/3868520144 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff94003e070 con 0x7ff9580d3370 2024-04-04T16:33:56.359 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.356+0000 7ff94ea00640 1 -- 172.21.15.72:0/3868520144 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff940035040 con 0x7ff9580d3370 2024-04-04T16:33:56.359 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.356+0000 7ff957e00640 1 -- 172.21.15.72:0/3868520144 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff958155dd0 con 0x7ff9580d3370 2024-04-04T16:33:56.359 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.356+0000 7ff957e00640 1 -- 172.21.15.72:0/3868520144 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff958156390 con 0x7ff9580d3370 2024-04-04T16:33:56.360 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.357+0000 7ff957e00640 1 -- 172.21.15.72:0/3868520144 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9580756c0 con 0x7ff9580d3370 2024-04-04T16:33:56.360 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.358+0000 7ff94ea00640 1 -- 172.21.15.72:0/3868520144 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff940038020 con 0x7ff9580d3370 2024-04-04T16:33:56.360 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.359+0000 7ff94ea00640 1 --2- 172.21.15.72:0/3868520144 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7ff93406c8f0 0x7ff93406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:56.360 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.359+0000 7ff94ea00640 1 -- 172.21.15.72:0/3868520144 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 4943+0+0 (secure 0 0 0) 0x7ff9400ad8e0 con 0x7ff9580d3370 2024-04-04T16:33:56.361 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.360+0000 7ff956a00640 1 --2- 172.21.15.72:0/3868520144 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7ff93406c8f0 0x7ff93406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:56.361 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.360+0000 7ff956a00640 1 --2- 172.21.15.72:0/3868520144 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7ff93406c8f0 0x7ff93406edb0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7ff94800a950 tx=0x7ff948008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T16:33:56.361 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.364+0000 7ff94ea00640 1 -- 172.21.15.72:0/3868520144 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7ff9580d3820 con 0x7ff9580d3370 2024-04-04T16:33:56.559 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.561+0000 7ff957e00640 1 -- 172.21.15.72:0/3868520144 --> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7ff9580cb2f0 con 0x7ff93406c8f0 2024-04-04T16:33:56.559 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.561+0000 7ff94ea00640 1 -- 172.21.15.72:0/3868520144 <== mgr.4101 v2:172.21.15.72:6832/2205173820 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7ff9580cb2f0 con 0x7ff93406c8f0 2024-04-04T16:33:56.559 INFO:teuthology.orchestra.run.smithi072.stderr:instructed osd(s) 3 to deep-scrub 2024-04-04T16:33:56.562 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.564+0000 7ff957e00640 1 -- 172.21.15.72:0/3868520144 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7ff93406c8f0 msgr2=0x7ff93406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:56.563 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.564+0000 7ff957e00640 1 --2- 172.21.15.72:0/3868520144 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7ff93406c8f0 0x7ff93406edb0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7ff94800a950 tx=0x7ff948008040 comp rx=0 tx=0).stop 2024-04-04T16:33:56.563 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.564+0000 7ff957e00640 1 -- 172.21.15.72:0/3868520144 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff9580d3370 msgr2=0x7ff9581f4130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:56.563 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.564+0000 7ff957e00640 1 --2- 172.21.15.72:0/3868520144 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff9580d3370 0x7ff9581f4130 secure :-1 s=READY pgs=2198 cs=0 l=1 rev1=1 crypto rx=0x7ff940000c00 tx=0x7ff9400046c0 comp rx=0 tx=0).stop 2024-04-04T16:33:56.563 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.564+0000 7ff957e00640 1 -- 172.21.15.72:0/3868520144 shutdown_connections 2024-04-04T16:33:56.563 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.564+0000 7ff957e00640 1 --2- 172.21.15.72:0/3868520144 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7ff93406c8f0 0x7ff93406edb0 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:56.563 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.564+0000 7ff957e00640 1 --2- 172.21.15.72:0/3868520144 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff95815e5a0 0x7ff9580cd690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:56.563 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.564+0000 7ff957e00640 1 --2- 172.21.15.72:0/3868520144 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff9580d3370 0x7ff9581f4130 unknown :-1 s=CLOSED pgs=2198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:56.564 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.564+0000 7ff957e00640 1 --2- 172.21.15.72:0/3868520144 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff9580b7b00 0x7ff9580b2e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:56.564 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.564+0000 7ff957e00640 1 -- 172.21.15.72:0/3868520144 >> 172.21.15.72:0/3868520144 conn(0x7ff95806b890 msgr2=0x7ff958154110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T16:33:56.564 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.564+0000 7ff957e00640 1 -- 172.21.15.72:0/3868520144 shutdown_connections 2024-04-04T16:33:56.564 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.564+0000 7ff957e00640 1 -- 172.21.15.72:0/3868520144 wait complete. 2024-04-04T16:33:56.581 INFO:tasks.ceph:Scrubbing osd.4 2024-04-04T16:33:56.582 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-04-04T16:33:56.783 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.785+0000 7fee8d200640 1 Processor -- start 2024-04-04T16:33:56.783 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.785+0000 7fee8d200640 1 -- start start 2024-04-04T16:33:56.785 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.786+0000 7fee8d200640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fee880b8a90 0x7fee880cec30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:56.785 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.786+0000 7fee8d200640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee880d2d10 con 0x7fee880cf280 2024-04-04T16:33:56.785 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.786+0000 7fee8d200640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee880d2ff0 con 0x7fee8815e860 2024-04-04T16:33:56.785 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.786+0000 7fee8d200640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fee880d3920 con 0x7fee880b8a90 2024-04-04T16:33:56.785 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.787+0000 7fee87400640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fee880cf280 0x7fee880d2550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:39538/0 (socket says 172.21.15.72:39538) 2024-04-04T16:33:56.785 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.787+0000 7fee87400640 1 -- 172.21.15.72:0/2193952888 learned_addr learned my addr 172.21.15.72:0/2193952888 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-04-04T16:33:56.786 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.787+0000 7fee86a00640 1 -- 172.21.15.72:0/2193952888 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 652349107 0 0) 0x7fee880d2d10 con 0x7fee880cf280 2024-04-04T16:33:56.786 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.787+0000 7fee86a00640 1 -- 172.21.15.72:0/2193952888 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fee6c003520 con 0x7fee880cf280 2024-04-04T16:33:56.786 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.787+0000 7fee87e00640 1 --2- 172.21.15.72:0/2193952888 >> v2:172.21.15.117:3300/0 conn(0x7fee880b8a90 0x7fee880cec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:56.788 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.787+0000 7fee86a00640 1 -- 172.21.15.72:0/2193952888 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 304509559 0 0) 0x7fee6c003520 con 0x7fee880cf280 2024-04-04T16:33:56.789 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.788+0000 7fee86a00640 1 -- 172.21.15.72:0/2193952888 >> v2:172.21.15.117:3300/0 conn(0x7fee880b8a90 msgr2=0x7fee880cec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T16:33:56.789 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.788+0000 7fee86a00640 1 --2- 172.21.15.72:0/2193952888 >> v2:172.21.15.117:3300/0 conn(0x7fee880b8a90 0x7fee880cec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:56.789 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.788+0000 7fee86a00640 1 -- 172.21.15.72:0/2193952888 >> v1:172.21.15.117:6789/0 conn(0x7fee8815e860 legacy=0x7fee880cf660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:56.789 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.788+0000 7fee86a00640 1 -- 172.21.15.72:0/2193952888 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee880d32d0 con 0x7fee880cf280 2024-04-04T16:33:56.789 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.788+0000 7fee86a00640 1 -- 172.21.15.72:0/2193952888 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2465650867 0 0) 0x7fee780019f0 con 0x7fee880cf280 2024-04-04T16:33:56.789 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.788+0000 7fee86a00640 1 -- 172.21.15.72:0/2193952888 >> v1:172.21.15.72:6789/0 conn(0x7fee880cf280 legacy=0x7fee880d2550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:56.789 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.788+0000 7fee86a00640 1 --2- 172.21.15.72:0/2193952888 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fee6c0039b0 0x7fee6c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:56.790 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.788+0000 7fee86a00640 1 --2- 172.21.15.72:0/2193952888 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fee6c004800 0x7fee6c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:56.790 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.788+0000 7fee86a00640 1 --2- 172.21.15.72:0/2193952888 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fee6c0051c0 0x7fee6c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:56.790 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.788+0000 7fee86a00640 1 -- 172.21.15.72:0/2193952888 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fee6c00c0e0 con 0x7fee6c004800 2024-04-04T16:33:56.790 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.788+0000 7fee86a00640 1 -- 172.21.15.72:0/2193952888 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fee6c00c290 con 0x7fee6c0051c0 2024-04-04T16:33:56.790 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.788+0000 7fee86a00640 1 -- 172.21.15.72:0/2193952888 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fee6c00c490 con 0x7fee6c0039b0 2024-04-04T16:33:56.790 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.788+0000 7fee7ea00640 1 --2- 172.21.15.72:0/2193952888 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fee6c004800 0x7fee6c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:56.790 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.788+0000 7fee87400640 1 --2- 172.21.15.72:0/2193952888 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fee6c0039b0 0x7fee6c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:56.791 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.788+0000 7fee7ea00640 1 -- 172.21.15.72:0/2193952888 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fee6c0039b0 msgr2=0x7fee6c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T16:33:56.791 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.789+0000 7fee7ea00640 1 --2- 172.21.15.72:0/2193952888 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fee6c0039b0 0x7fee6c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:56.791 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.789+0000 7fee7ea00640 1 -- 172.21.15.72:0/2193952888 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fee6c0051c0 msgr2=0x7fee6c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T16:33:56.791 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.789+0000 7fee7ea00640 1 --2- 172.21.15.72:0/2193952888 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fee6c0051c0 0x7fee6c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:56.791 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.789+0000 7fee7ea00640 1 -- 172.21.15.72:0/2193952888 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee6c003520 con 0x7fee6c004800 2024-04-04T16:33:56.791 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.789+0000 7fee87e00640 1 -- 172.21.15.72:0/2193952888 reap_dead start 2024-04-04T16:33:56.791 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.790+0000 7fee7ea00640 1 --2- 172.21.15.72:0/2193952888 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fee6c004800 0x7fee6c004c80 secure :-1 s=READY pgs=2200 cs=0 l=1 rev1=1 crypto rx=0x7fee70001720 tx=0x7fee6c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14a3562a8c4efe9b server_cookie=0 in_seq=0 out_seq=0 2024-04-04T16:33:56.791 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.790+0000 7fee86a00640 1 -- 172.21.15.72:0/2193952888 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee70001370 con 0x7fee6c004800 2024-04-04T16:33:56.792 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.790+0000 7fee86a00640 1 -- 172.21.15.72:0/2193952888 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee700052d0 con 0x7fee6c004800 2024-04-04T16:33:56.792 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.790+0000 7fee86a00640 1 -- 172.21.15.72:0/2193952888 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee70003830 con 0x7fee6c004800 2024-04-04T16:33:56.792 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.790+0000 7fee8d200640 1 -- 172.21.15.72:0/2193952888 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fee6c004800 msgr2=0x7fee6c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:56.792 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.790+0000 7fee8d200640 1 --2- 172.21.15.72:0/2193952888 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fee6c004800 0x7fee6c004c80 secure :-1 s=READY pgs=2200 cs=0 l=1 rev1=1 crypto rx=0x7fee70001720 tx=0x7fee6c005830 comp rx=0 tx=0).stop 2024-04-04T16:33:56.792 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.791+0000 7fee8d200640 1 -- 172.21.15.72:0/2193952888 shutdown_connections 2024-04-04T16:33:56.792 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.791+0000 7fee8d200640 1 --2- 172.21.15.72:0/2193952888 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fee6c004800 0x7fee6c004c80 unknown :-1 s=CLOSED pgs=2200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:56.792 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.791+0000 7fee8d200640 1 -- 172.21.15.72:0/2193952888 >> 172.21.15.72:0/2193952888 conn(0x7fee8806b860 msgr2=0x7fee8806bc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T16:33:56.793 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.791+0000 7fee8d200640 1 -- 172.21.15.72:0/2193952888 shutdown_connections 2024-04-04T16:33:56.793 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.791+0000 7fee8d200640 1 -- 172.21.15.72:0/2193952888 wait complete. 2024-04-04T16:33:56.796 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.792+0000 7fee8d200640 1 Processor -- start 2024-04-04T16:33:56.796 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.792+0000 7fee8d200640 1 -- start start 2024-04-04T16:33:56.796 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.793+0000 7fee8d200640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fee6c004800 0x7fee88160780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:56.796 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.793+0000 7fee8d200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fee88071d00 0x7fee881f3f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:56.796 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.793+0000 7fee8d200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fee88072180 0x7fee881f4450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:56.796 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.793+0000 7fee8d200640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fee880cedb0 con 0x7fee6c004800 2024-04-04T16:33:56.796 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.793+0000 7fee8d200640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fee880cec30 con 0x7fee88072180 2024-04-04T16:33:56.797 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.793+0000 7fee8d200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fee880cef30 con 0x7fee88071d00 2024-04-04T16:33:56.797 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.794+0000 7fee87400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fee6c004800 0x7fee88160780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:56.797 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.794+0000 7fee87400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fee6c004800 0x7fee88160780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51742/0 (socket says 172.21.15.72:51742) 2024-04-04T16:33:56.797 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.794+0000 7fee87400640 1 -- 172.21.15.72:0/3331064284 learned_addr learned my addr 172.21.15.72:0/3331064284 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T16:33:56.797 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.794+0000 7fee7ea00640 1 --2- 172.21.15.72:0/3331064284 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fee88071d00 0x7fee881f3f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:56.797 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.794+0000 7fee87e00640 1 --2- 172.21.15.72:0/3331064284 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fee88072180 0x7fee881f4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:56.797 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.794+0000 7fee87400640 1 -- 172.21.15.72:0/3331064284 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fee88071d00 msgr2=0x7fee881f3f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:56.798 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.794+0000 7fee87400640 1 --2- 172.21.15.72:0/3331064284 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fee88071d00 0x7fee881f3f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:56.798 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.794+0000 7fee87400640 1 -- 172.21.15.72:0/3331064284 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fee88072180 msgr2=0x7fee881f4450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:56.798 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.794+0000 7fee87400640 1 --2- 172.21.15.72:0/3331064284 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fee88072180 0x7fee881f4450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:56.798 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.794+0000 7fee87400640 1 -- 172.21.15.72:0/3331064284 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee8815fcc0 con 0x7fee6c004800 2024-04-04T16:33:56.798 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.794+0000 7fee87e00640 1 --2- 172.21.15.72:0/3331064284 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fee88072180 0x7fee881f4450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-04T16:33:56.798 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.794+0000 7fee87400640 1 --2- 172.21.15.72:0/3331064284 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fee6c004800 0x7fee88160780 secure :-1 s=READY pgs=2201 cs=0 l=1 rev1=1 crypto rx=0x7fee78007990 tx=0x7fee7800e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T16:33:56.798 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.795+0000 7fee7fe00640 1 -- 172.21.15.72:0/3331064284 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee7800ee50 con 0x7fee6c004800 2024-04-04T16:33:56.799 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.795+0000 7fee7fe00640 1 -- 172.21.15.72:0/3331064284 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee78018070 con 0x7fee6c004800 2024-04-04T16:33:56.799 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.795+0000 7fee7fe00640 1 -- 172.21.15.72:0/3331064284 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee78013640 con 0x7fee6c004800 2024-04-04T16:33:56.799 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.795+0000 7fee8d200640 1 -- 172.21.15.72:0/3331064284 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee881f4a40 con 0x7fee6c004800 2024-04-04T16:33:56.799 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.795+0000 7fee8d200640 1 -- 172.21.15.72:0/3331064284 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee8815ff80 con 0x7fee6c004800 2024-04-04T16:33:56.799 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.796+0000 7fee8d200640 1 -- 172.21.15.72:0/3331064284 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fee880756c0 con 0x7fee6c004800 2024-04-04T16:33:56.799 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.798+0000 7fee7fe00640 1 -- 172.21.15.72:0/3331064284 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fee780137e0 con 0x7fee6c004800 2024-04-04T16:33:56.800 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.798+0000 7fee7fe00640 1 --2- 172.21.15.72:0/3331064284 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fee6406ca90 0x7fee6406ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:56.801 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.798+0000 7fee7fe00640 1 -- 172.21.15.72:0/3331064284 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 4943+0+0 (secure 0 0 0) 0x7fee7808bf20 con 0x7fee6c004800 2024-04-04T16:33:56.801 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.799+0000 7fee7fe00640 1 --2- 172.21.15.72:0/3331064284 >> [v2:172.21.15.117:6824/4293536423,v1:172.21.15.117:6825/4293536423] conn(0x7fee64072950 0x7fee64074d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:56.801 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.799+0000 7fee7fe00640 1 -- 172.21.15.72:0/3331064284 --> [v2:172.21.15.117:6824/4293536423,v1:172.21.15.117:6825/4293536423] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fee78012e50 con 0x7fee64072950 2024-04-04T16:33:56.801 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.799+0000 7fee7fe00640 1 -- 172.21.15.72:0/3331064284 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7fee7808e540 con 0x7fee6c004800 2024-04-04T16:33:56.801 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.799+0000 7fee7ea00640 1 --2- 172.21.15.72:0/3331064284 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fee6406ca90 0x7fee6406ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:56.801 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.799+0000 7fee87e00640 1 --2- 172.21.15.72:0/3331064284 >> [v2:172.21.15.117:6824/4293536423,v1:172.21.15.117:6825/4293536423] conn(0x7fee64072950 0x7fee64074d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:56.802 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.799+0000 7fee7ea00640 1 --2- 172.21.15.72:0/3331064284 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fee6406ca90 0x7fee6406ef50 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7fee70033000 tx=0x7fee70009030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T16:33:56.802 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.800+0000 7fee87e00640 1 --2- 172.21.15.72:0/3331064284 >> [v2:172.21.15.117:6824/4293536423,v1:172.21.15.117:6825/4293536423] conn(0x7fee64072950 0x7fee64074d70 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T16:33:56.802 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.802+0000 7fee7fe00640 1 -- 172.21.15.72:0/3331064284 <== osd.4 v2:172.21.15.117:6824/4293536423 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fee78012e50 con 0x7fee64072950 2024-04-04T16:33:56.814 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.817+0000 7fee8d200640 1 -- 172.21.15.72:0/3331064284 --> [v2:172.21.15.117:6824/4293536423,v1:172.21.15.117:6825/4293536423] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fee88068100 con 0x7fee64072950 2024-04-04T16:33:56.815 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.817+0000 7fee7fe00640 1 -- 172.21.15.72:0/3331064284 <== osd.4 v2:172.21.15.117:6824/4293536423 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fee88068100 con 0x7fee64072950 2024-04-04T16:33:56.815 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-04T16:33:56.816 INFO:teuthology.orchestra.run.smithi072.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-04T16:33:56.816 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-04T16:33:56.817 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.818+0000 7fee8d200640 1 -- 172.21.15.72:0/3331064284 >> [v2:172.21.15.117:6824/4293536423,v1:172.21.15.117:6825/4293536423] conn(0x7fee64072950 msgr2=0x7fee64074d70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:56.817 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.818+0000 7fee8d200640 1 --2- 172.21.15.72:0/3331064284 >> [v2:172.21.15.117:6824/4293536423,v1:172.21.15.117:6825/4293536423] conn(0x7fee64072950 0x7fee64074d70 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:56.817 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.818+0000 7fee8d200640 1 -- 172.21.15.72:0/3331064284 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fee6406ca90 msgr2=0x7fee6406ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:56.817 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.818+0000 7fee8d200640 1 --2- 172.21.15.72:0/3331064284 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fee6406ca90 0x7fee6406ef50 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7fee70033000 tx=0x7fee70009030 comp rx=0 tx=0).stop 2024-04-04T16:33:56.818 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.818+0000 7fee8d200640 1 -- 172.21.15.72:0/3331064284 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fee6c004800 msgr2=0x7fee88160780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:56.818 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.818+0000 7fee8d200640 1 --2- 172.21.15.72:0/3331064284 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fee6c004800 0x7fee88160780 secure :-1 s=READY pgs=2201 cs=0 l=1 rev1=1 crypto rx=0x7fee78007990 tx=0x7fee7800e530 comp rx=0 tx=0).stop 2024-04-04T16:33:56.818 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.818+0000 7fee87e00640 1 -- 172.21.15.72:0/3331064284 reap_dead start 2024-04-04T16:33:56.818 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.818+0000 7fee8d200640 1 -- 172.21.15.72:0/3331064284 shutdown_connections 2024-04-04T16:33:56.818 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.818+0000 7fee8d200640 1 -- 172.21.15.72:0/3331064284 >> 172.21.15.72:0/3331064284 conn(0x7fee8806b860 msgr2=0x7fee880d2340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T16:33:56.818 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.818+0000 7fee8d200640 1 -- 172.21.15.72:0/3331064284 shutdown_connections 2024-04-04T16:33:56.818 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:56.818+0000 7fee8d200640 1 -- 172.21.15.72:0/3331064284 wait complete. 2024-04-04T16:33:56.835 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-04-04T16:33:57.036 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.038+0000 7f083fe00640 1 Processor -- start 2024-04-04T16:33:57.036 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.038+0000 7f083fe00640 1 -- start start 2024-04-04T16:33:57.038 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.040+0000 7f083fe00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f08400cfa00 0x7f0840166f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:57.038 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.040+0000 7f083fe00640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0840160a80 con 0x7f08400b2de0 2024-04-04T16:33:57.038 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.040+0000 7f083fe00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f084015fcc0 con 0x7f084015c0f0 2024-04-04T16:33:57.038 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.040+0000 7f083fe00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f08400c5e50 con 0x7f08400cfa00 2024-04-04T16:33:57.038 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.040+0000 7f083e000640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f08400b2de0 0x7f08400cf2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:39542/0 (socket says 172.21.15.72:39542) 2024-04-04T16:33:57.038 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.040+0000 7f083e000640 1 -- 172.21.15.72:0/2413140391 learned_addr learned my addr 172.21.15.72:0/2413140391 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-04-04T16:33:57.041 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.040+0000 7f083f400640 1 --2- 172.21.15.72:0/2413140391 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f08400cfa00 0x7f0840166f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:57.042 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.040+0000 7f083d600640 1 -- 172.21.15.72:0/2413140391 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 755330393 0 0) 0x7f0840160a80 con 0x7f08400b2de0 2024-04-04T16:33:57.042 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.041+0000 7f083d600640 1 -- 172.21.15.72:0/2413140391 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0824003520 con 0x7f08400b2de0 2024-04-04T16:33:57.042 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.041+0000 7f083d600640 1 -- 172.21.15.72:0/2413140391 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1413616396 0 0) 0x7f0824003520 con 0x7f08400b2de0 2024-04-04T16:33:57.042 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.041+0000 7f083d600640 1 -- 172.21.15.72:0/2413140391 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f08400cfa00 msgr2=0x7f0840166f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T16:33:57.042 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.041+0000 7f083d600640 1 --2- 172.21.15.72:0/2413140391 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f08400cfa00 0x7f0840166f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:57.042 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.041+0000 7f083d600640 1 -- 172.21.15.72:0/2413140391 >> v1:172.21.15.117:6789/0 conn(0x7f084015c0f0 legacy=0x7f08400c5600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:57.042 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.041+0000 7f083d600640 1 -- 172.21.15.72:0/2413140391 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f084015ffa0 con 0x7f08400b2de0 2024-04-04T16:33:57.043 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.041+0000 7f083d600640 1 -- 172.21.15.72:0/2413140391 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2465650867 0 0) 0x7f082c001690 con 0x7f08400b2de0 2024-04-04T16:33:57.043 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.041+0000 7f083d600640 1 -- 172.21.15.72:0/2413140391 >> v1:172.21.15.72:6789/0 conn(0x7f08400b2de0 legacy=0x7f08400cf2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:57.043 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.041+0000 7f083d600640 1 --2- 172.21.15.72:0/2413140391 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f08240039e0 0x7f0824003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:57.043 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.041+0000 7f083d600640 1 --2- 172.21.15.72:0/2413140391 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0824004800 0x7f0824004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:57.043 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.041+0000 7f083d600640 1 --2- 172.21.15.72:0/2413140391 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f08400cfa00 0x7f0824005290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:57.043 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.041+0000 7f083d600640 1 -- 172.21.15.72:0/2413140391 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f08400c5e50 con 0x7f0824004800 2024-04-04T16:33:57.043 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.041+0000 7f083d600640 1 -- 172.21.15.72:0/2413140391 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f082400bbb0 con 0x7f08240039e0 2024-04-04T16:33:57.043 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.041+0000 7f083d600640 1 -- 172.21.15.72:0/2413140391 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f082400bdb0 con 0x7f08400cfa00 2024-04-04T16:33:57.044 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.041+0000 7f083e000640 1 --2- 172.21.15.72:0/2413140391 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0824004800 0x7f0824004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:57.044 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.042+0000 7f083f400640 1 --2- 172.21.15.72:0/2413140391 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f08400cfa00 0x7f0824005290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:57.044 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.042+0000 7f083e000640 1 -- 172.21.15.72:0/2413140391 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f08400cfa00 msgr2=0x7f0824005290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T16:33:57.044 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.042+0000 7f083e000640 1 --2- 172.21.15.72:0/2413140391 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f08400cfa00 0x7f0824005290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:57.044 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.042+0000 7f083e000640 1 -- 172.21.15.72:0/2413140391 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f08240039e0 msgr2=0x7f0824003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T16:33:57.044 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.042+0000 7f083e000640 1 --2- 172.21.15.72:0/2413140391 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f08240039e0 0x7f0824003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:57.044 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.042+0000 7f083e000640 1 -- 172.21.15.72:0/2413140391 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0824003520 con 0x7f0824004800 2024-04-04T16:33:57.044 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.042+0000 7f083f400640 1 --2- 172.21.15.72:0/2413140391 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f08400cfa00 0x7f0824005290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-04T16:33:57.045 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.043+0000 7f083e000640 1 --2- 172.21.15.72:0/2413140391 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0824004800 0x7f0824004c80 secure :-1 s=READY pgs=2203 cs=0 l=1 rev1=1 crypto rx=0x7f082c00c210 tx=0x7f0824005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54412ed835d1b11b server_cookie=0 in_seq=0 out_seq=0 2024-04-04T16:33:57.045 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.043+0000 7f083d600640 1 -- 172.21.15.72:0/2413140391 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f082c007d30 con 0x7f0824004800 2024-04-04T16:33:57.045 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.043+0000 7f083d600640 1 -- 172.21.15.72:0/2413140391 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f082c030070 con 0x7f0824004800 2024-04-04T16:33:57.045 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.043+0000 7f083d600640 1 -- 172.21.15.72:0/2413140391 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f082c005cf0 con 0x7f0824004800 2024-04-04T16:33:57.045 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.044+0000 7f083fe00640 1 -- 172.21.15.72:0/2413140391 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0824004800 msgr2=0x7f0824004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:57.045 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.044+0000 7f083fe00640 1 --2- 172.21.15.72:0/2413140391 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0824004800 0x7f0824004c80 secure :-1 s=READY pgs=2203 cs=0 l=1 rev1=1 crypto rx=0x7f082c00c210 tx=0x7f0824005830 comp rx=0 tx=0).stop 2024-04-04T16:33:57.045 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.044+0000 7f083f400640 1 -- 172.21.15.72:0/2413140391 reap_dead start 2024-04-04T16:33:57.045 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.044+0000 7f083fe00640 1 -- 172.21.15.72:0/2413140391 shutdown_connections 2024-04-04T16:33:57.045 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.044+0000 7f083fe00640 1 -- 172.21.15.72:0/2413140391 >> 172.21.15.72:0/2413140391 conn(0x7f084006faa0 msgr2=0x7f084006fe80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T16:33:57.046 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.044+0000 7f083fe00640 1 -- 172.21.15.72:0/2413140391 shutdown_connections 2024-04-04T16:33:57.046 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.044+0000 7f083fe00640 1 -- 172.21.15.72:0/2413140391 wait complete. 2024-04-04T16:33:57.048 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.046+0000 7f083fe00640 1 Processor -- start 2024-04-04T16:33:57.048 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.046+0000 7f083fe00640 1 -- start start 2024-04-04T16:33:57.048 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.047+0000 7f083fe00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0824004800 0x7f084014d960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:57.048 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.047+0000 7f083fe00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f08400cdb60 0x7f084014fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:57.049 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.047+0000 7f083fe00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f084014d0b0 0x7f084015ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:57.049 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.047+0000 7f083fe00640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f084015d4e0 con 0x7f084014d0b0 2024-04-04T16:33:57.049 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.047+0000 7f083fe00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f0840160560 con 0x7f08400cdb60 2024-04-04T16:33:57.049 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.047+0000 7f083fe00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f084015d660 con 0x7f0824004800 2024-04-04T16:33:57.049 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.047+0000 7f083f400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f084014d0b0 0x7f084015ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:57.049 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.047+0000 7f083f400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f084014d0b0 0x7f084015ed20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51750/0 (socket says 172.21.15.72:51750) 2024-04-04T16:33:57.049 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.047+0000 7f083f400640 1 -- 172.21.15.72:0/2956199138 learned_addr learned my addr 172.21.15.72:0/2956199138 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T16:33:57.050 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.047+0000 7f083ea00640 1 --2- 172.21.15.72:0/2956199138 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0824004800 0x7f084014d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:57.050 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.047+0000 7f083f400640 1 -- 172.21.15.72:0/2956199138 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0824004800 msgr2=0x7f084014d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:57.050 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.047+0000 7f083f400640 1 --2- 172.21.15.72:0/2956199138 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0824004800 0x7f084014d960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:57.050 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.047+0000 7f083f400640 1 -- 172.21.15.72:0/2956199138 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f08400cdb60 msgr2=0x7f084014fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:57.050 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.047+0000 7f083f400640 1 --2- 172.21.15.72:0/2956199138 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f08400cdb60 0x7f084014fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:57.050 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.047+0000 7f083f400640 1 -- 172.21.15.72:0/2956199138 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08401508e0 con 0x7f084014d0b0 2024-04-04T16:33:57.050 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.048+0000 7f083f400640 1 --2- 172.21.15.72:0/2956199138 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f084014d0b0 0x7f084015ed20 secure :-1 s=READY pgs=2204 cs=0 l=1 rev1=1 crypto rx=0x7f0840072e50 tx=0x7f083800f4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T16:33:57.050 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.048+0000 7f0836a00640 1 -- 172.21.15.72:0/2956199138 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f083801c070 con 0x7f084014d0b0 2024-04-04T16:33:57.050 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.048+0000 7f0836a00640 1 -- 172.21.15.72:0/2956199138 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0838017400 con 0x7f084014d0b0 2024-04-04T16:33:57.051 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.048+0000 7f0836a00640 1 -- 172.21.15.72:0/2956199138 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08380177d0 con 0x7f084014d0b0 2024-04-04T16:33:57.051 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.048+0000 7f083fe00640 1 -- 172.21.15.72:0/2956199138 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0840150600 con 0x7f084014d0b0 2024-04-04T16:33:57.051 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.048+0000 7f083fe00640 1 -- 172.21.15.72:0/2956199138 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08400b3820 con 0x7f084014d0b0 2024-04-04T16:33:57.051 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.049+0000 7f083fe00640 1 -- 172.21.15.72:0/2956199138 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f08400685a0 con 0x7f084014d0b0 2024-04-04T16:33:57.051 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.050+0000 7f0836a00640 1 -- 172.21.15.72:0/2956199138 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f083801f070 con 0x7f084014d0b0 2024-04-04T16:33:57.052 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.051+0000 7f0836a00640 1 --2- 172.21.15.72:0/2956199138 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f082006c920 0x7f082006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:57.052 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.051+0000 7f0836a00640 1 -- 172.21.15.72:0/2956199138 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 4943+0+0 (secure 0 0 0) 0x7f083808ba20 con 0x7f084014d0b0 2024-04-04T16:33:57.053 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.051+0000 7f083ea00640 1 --2- 172.21.15.72:0/2956199138 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f082006c920 0x7f082006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:57.053 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.052+0000 7f083ea00640 1 --2- 172.21.15.72:0/2956199138 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f082006c920 0x7f082006ede0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f0830001690 tx=0x7f0830009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T16:33:57.053 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.056+0000 7f0836a00640 1 -- 172.21.15.72:0/2956199138 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f0838012070 con 0x7f084014d0b0 2024-04-04T16:33:57.254 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.256+0000 7f083fe00640 1 -- 172.21.15.72:0/2956199138 --> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7f0840067f40 con 0x7f082006c920 2024-04-04T16:33:57.255 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.257+0000 7f0836a00640 1 -- 172.21.15.72:0/2956199138 <== mgr.4101 v2:172.21.15.72:6832/2205173820 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f0840067f40 con 0x7f082006c920 2024-04-04T16:33:57.255 INFO:teuthology.orchestra.run.smithi072.stderr:instructed osd(s) 4 to deep-scrub 2024-04-04T16:33:57.256 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.259+0000 7f083fe00640 1 -- 172.21.15.72:0/2956199138 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f082006c920 msgr2=0x7f082006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:57.257 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.259+0000 7f083fe00640 1 --2- 172.21.15.72:0/2956199138 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f082006c920 0x7f082006ede0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f0830001690 tx=0x7f0830009040 comp rx=0 tx=0).stop 2024-04-04T16:33:57.257 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.259+0000 7f083fe00640 1 -- 172.21.15.72:0/2956199138 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f084014d0b0 msgr2=0x7f084015ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:57.257 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.259+0000 7f083fe00640 1 --2- 172.21.15.72:0/2956199138 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f084014d0b0 0x7f084015ed20 secure :-1 s=READY pgs=2204 cs=0 l=1 rev1=1 crypto rx=0x7f0840072e50 tx=0x7f083800f4a0 comp rx=0 tx=0).stop 2024-04-04T16:33:57.258 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.259+0000 7f083fe00640 1 -- 172.21.15.72:0/2956199138 shutdown_connections 2024-04-04T16:33:57.258 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.259+0000 7f083fe00640 1 --2- 172.21.15.72:0/2956199138 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f082006c920 0x7f082006ede0 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:57.258 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.259+0000 7f083fe00640 1 --2- 172.21.15.72:0/2956199138 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f084014d0b0 0x7f084015ed20 unknown :-1 s=CLOSED pgs=2204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:57.258 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.259+0000 7f083fe00640 1 --2- 172.21.15.72:0/2956199138 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f08400cdb60 0x7f084014fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:57.258 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.259+0000 7f083fe00640 1 --2- 172.21.15.72:0/2956199138 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0824004800 0x7f084014d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:57.258 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.259+0000 7f083fe00640 1 -- 172.21.15.72:0/2956199138 >> 172.21.15.72:0/2956199138 conn(0x7f084006faa0 msgr2=0x7f0840071c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T16:33:57.258 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.259+0000 7f083fe00640 1 -- 172.21.15.72:0/2956199138 shutdown_connections 2024-04-04T16:33:57.259 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.259+0000 7f083fe00640 1 -- 172.21.15.72:0/2956199138 wait complete. 2024-04-04T16:33:57.274 INFO:tasks.ceph:Scrubbing osd.5 2024-04-04T16:33:57.275 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-04-04T16:33:57.482 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.484+0000 7f5efa200640 1 Processor -- start 2024-04-04T16:33:57.483 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.484+0000 7f5efa200640 1 -- start start 2024-04-04T16:33:57.484 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.486+0000 7f5efa200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5ef40cf280 0x7f5ef40cec30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:57.484 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.486+0000 7f5efa200640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f5ef415e860 0x7f5ef40d2550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:57.484 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.486+0000 7f5efa200640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ef40d2a90 con 0x7f5ef40cf660 2024-04-04T16:33:57.484 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.486+0000 7f5efa200640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f5ef40d3920 con 0x7f5ef415e860 2024-04-04T16:33:57.484 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.486+0000 7f5efa200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f5ef40d2d10 con 0x7f5ef40cf280 2024-04-04T16:33:57.484 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.486+0000 7f5eebe00640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f5ef415e860 0x7f5ef40d2550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:57.484 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.486+0000 7f5ef9800640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f5ef40cf660 0x7f5ef4071a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:39544/0 (socket says 172.21.15.72:39544) 2024-04-04T16:33:57.485 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.486+0000 7f5ef9800640 1 -- 172.21.15.72:0/377158222 learned_addr learned my addr 172.21.15.72:0/377158222 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-04-04T16:33:57.486 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.487+0000 7f5ef8e00640 1 --2- 172.21.15.72:0/377158222 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5ef40cf280 0x7f5ef40cec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:57.486 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.487+0000 7f5eebe00640 1 -- 172.21.15.72:0/377158222 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5ef40cf280 msgr2=0x7f5ef40cec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T16:33:57.486 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.487+0000 7f5eebe00640 1 --2- 172.21.15.72:0/377158222 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5ef40cf280 0x7f5ef40cec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:57.486 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.487+0000 7f5eebe00640 1 -- 172.21.15.72:0/377158222 >> v1:172.21.15.72:6789/0 conn(0x7f5ef40cf660 legacy=0x7f5ef4071a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:57.486 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.487+0000 7f5eebe00640 1 -- 172.21.15.72:0/377158222 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ef40d2ff0 con 0x7f5ef415e860 2024-04-04T16:33:57.486 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.488+0000 7f5eebe00640 1 --2- 172.21.15.72:0/377158222 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5ef415e860 0x7f5ef40d2550 secure :-1 s=READY pgs=2206 cs=0 l=1 rev1=1 crypto rx=0x7f5edc0097a0 tx=0x7f5edc02b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e0837f063009d7a server_cookie=0 in_seq=0 out_seq=0 2024-04-04T16:33:57.487 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.488+0000 7f5ef3e00640 1 -- 172.21.15.72:0/377158222 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5edc035020 con 0x7f5ef415e860 2024-04-04T16:33:57.487 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.488+0000 7f5ef3e00640 1 -- 172.21.15.72:0/377158222 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5edc031810 con 0x7f5ef415e860 2024-04-04T16:33:57.487 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.488+0000 7f5ef3e00640 1 -- 172.21.15.72:0/377158222 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5edc031be0 con 0x7f5ef415e860 2024-04-04T16:33:57.488 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.489+0000 7f5efa200640 1 -- 172.21.15.72:0/377158222 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5ef415e860 msgr2=0x7f5ef40d2550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:57.488 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.489+0000 7f5efa200640 1 --2- 172.21.15.72:0/377158222 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5ef415e860 0x7f5ef40d2550 secure :-1 s=READY pgs=2206 cs=0 l=1 rev1=1 crypto rx=0x7f5edc0097a0 tx=0x7f5edc02b8b0 comp rx=0 tx=0).stop 2024-04-04T16:33:57.488 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.489+0000 7f5efa200640 1 -- 172.21.15.72:0/377158222 shutdown_connections 2024-04-04T16:33:57.488 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.489+0000 7f5efa200640 1 --2- 172.21.15.72:0/377158222 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5ef415e860 0x7f5ef40d2550 unknown :-1 s=CLOSED pgs=2206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:57.488 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.489+0000 7f5efa200640 1 --2- 172.21.15.72:0/377158222 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5ef40cf280 0x7f5ef40cec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:57.488 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.489+0000 7f5efa200640 1 -- 172.21.15.72:0/377158222 >> 172.21.15.72:0/377158222 conn(0x7f5ef406b860 msgr2=0x7f5ef406bc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T16:33:57.488 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.489+0000 7f5efa200640 1 -- 172.21.15.72:0/377158222 shutdown_connections 2024-04-04T16:33:57.489 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.489+0000 7f5efa200640 1 -- 172.21.15.72:0/377158222 wait complete. 2024-04-04T16:33:57.491 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.490+0000 7f5efa200640 1 Processor -- start 2024-04-04T16:33:57.491 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.491+0000 7f5efa200640 1 -- start start 2024-04-04T16:33:57.491 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.491+0000 7f5efa200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5ef40cf280 0x7f5ef414d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:57.491 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.491+0000 7f5efa200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5ef40cf660 0x7f5ef414a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:57.491 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.491+0000 7f5efa200640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5ef415e860 0x7f5ef40cb950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:57.491 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.491+0000 7f5efa200640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f5ef40cfb10 con 0x7f5ef415e860 2024-04-04T16:33:57.492 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.491+0000 7f5efa200640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f5ef40d35b0 con 0x7f5ef40cf280 2024-04-04T16:33:57.492 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.491+0000 7f5efa200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f5ef40b8a90 con 0x7f5ef40cf660 2024-04-04T16:33:57.492 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.492+0000 7f5ef9800640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5ef415e860 0x7f5ef40cb950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:57.492 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.492+0000 7f5ef9800640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5ef415e860 0x7f5ef40cb950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51778/0 (socket says 172.21.15.72:51778) 2024-04-04T16:33:57.492 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.492+0000 7f5ef9800640 1 -- 172.21.15.72:0/3261460805 learned_addr learned my addr 172.21.15.72:0/3261460805 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T16:33:57.492 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.492+0000 7f5eebe00640 1 --2- 172.21.15.72:0/3261460805 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5ef40cf660 0x7f5ef414a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:57.492 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.492+0000 7f5ef8e00640 1 --2- 172.21.15.72:0/3261460805 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5ef40cf280 0x7f5ef414d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:57.492 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.492+0000 7f5ef9800640 1 -- 172.21.15.72:0/3261460805 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5ef40cf660 msgr2=0x7f5ef414a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:57.493 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.492+0000 7f5ef9800640 1 --2- 172.21.15.72:0/3261460805 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5ef40cf660 0x7f5ef414a1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:57.493 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.492+0000 7f5ef9800640 1 -- 172.21.15.72:0/3261460805 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5ef40cf280 msgr2=0x7f5ef414d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:57.493 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.492+0000 7f5ef9800640 1 --2- 172.21.15.72:0/3261460805 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5ef40cf280 0x7f5ef414d490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:57.493 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.492+0000 7f5ef9800640 1 -- 172.21.15.72:0/3261460805 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ef414d9d0 con 0x7f5ef415e860 2024-04-04T16:33:57.493 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.493+0000 7f5ef9800640 1 --2- 172.21.15.72:0/3261460805 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5ef415e860 0x7f5ef40cb950 secure :-1 s=READY pgs=2207 cs=0 l=1 rev1=1 crypto rx=0x7f5eec00cbf0 tx=0x7f5eec00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T16:33:57.493 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.493+0000 7f5ef1600640 1 -- 172.21.15.72:0/3261460805 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5eec017070 con 0x7f5ef415e860 2024-04-04T16:33:57.493 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.493+0000 7f5ef1600640 1 -- 172.21.15.72:0/3261460805 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5eec00ad40 con 0x7f5ef415e860 2024-04-04T16:33:57.493 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.493+0000 7f5ef1600640 1 -- 172.21.15.72:0/3261460805 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5eec012600 con 0x7f5ef415e860 2024-04-04T16:33:57.494 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.493+0000 7f5efa200640 1 -- 172.21.15.72:0/3261460805 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ef414a710 con 0x7f5ef415e860 2024-04-04T16:33:57.494 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.493+0000 7f5efa200640 1 -- 172.21.15.72:0/3261460805 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ef414b190 con 0x7f5ef415e860 2024-04-04T16:33:57.495 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.494+0000 7f5efa200640 1 -- 172.21.15.72:0/3261460805 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5ef40ca8a0 con 0x7f5ef415e860 2024-04-04T16:33:57.495 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.496+0000 7f5ef1600640 1 -- 172.21.15.72:0/3261460805 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5eec01a070 con 0x7f5ef415e860 2024-04-04T16:33:57.495 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.497+0000 7f5ef1600640 1 --2- 172.21.15.72:0/3261460805 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f5ed006c8f0 0x7f5ed006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:57.495 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.497+0000 7f5ef1600640 1 -- 172.21.15.72:0/3261460805 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 4943+0+0 (secure 0 0 0) 0x7f5eec08bda0 con 0x7f5ef415e860 2024-04-04T16:33:57.495 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.497+0000 7f5ef1600640 1 --2- 172.21.15.72:0/3261460805 >> [v2:172.21.15.117:6800/684971679,v1:172.21.15.117:6801/684971679] conn(0x7f5ed00727b0 0x7f5ed0074bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:57.495 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.497+0000 7f5ef1600640 1 -- 172.21.15.72:0/3261460805 --> [v2:172.21.15.117:6800/684971679,v1:172.21.15.117:6801/684971679] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5ed0075280 con 0x7f5ed00727b0 2024-04-04T16:33:57.495 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.497+0000 7f5ef1600640 1 -- 172.21.15.72:0/3261460805 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f5eec08c230 con 0x7f5ef415e860 2024-04-04T16:33:57.496 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.497+0000 7f5ef8e00640 1 --2- 172.21.15.72:0/3261460805 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f5ed006c8f0 0x7f5ed006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:57.496 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.498+0000 7f5eebe00640 1 --2- 172.21.15.72:0/3261460805 >> [v2:172.21.15.117:6800/684971679,v1:172.21.15.117:6801/684971679] conn(0x7f5ed00727b0 0x7f5ed0074bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:57.496 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.498+0000 7f5ef8e00640 1 --2- 172.21.15.72:0/3261460805 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f5ed006c8f0 0x7f5ed006edb0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f5ee4006fd0 tx=0x7f5ee4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T16:33:57.497 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.499+0000 7f5eebe00640 1 --2- 172.21.15.72:0/3261460805 >> [v2:172.21.15.117:6800/684971679,v1:172.21.15.117:6801/684971679] conn(0x7f5ed00727b0 0x7f5ed0074bd0 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T16:33:57.499 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.502+0000 7f5ef1600640 1 -- 172.21.15.72:0/3261460805 <== osd.5 v2:172.21.15.117:6800/684971679 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f5ed0075280 con 0x7f5ed00727b0 2024-04-04T16:33:57.514 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.517+0000 7f5efa200640 1 -- 172.21.15.72:0/3261460805 --> [v2:172.21.15.117:6800/684971679,v1:172.21.15.117:6801/684971679] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f5ef40756c0 con 0x7f5ed00727b0 2024-04-04T16:33:57.515 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.518+0000 7f5ef1600640 1 -- 172.21.15.72:0/3261460805 <== osd.5 v2:172.21.15.117:6800/684971679 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f5ef40756c0 con 0x7f5ed00727b0 2024-04-04T16:33:57.516 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-04T16:33:57.516 INFO:teuthology.orchestra.run.smithi072.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-04T16:33:57.516 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-04T16:33:57.517 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.518+0000 7f5efa200640 1 -- 172.21.15.72:0/3261460805 >> [v2:172.21.15.117:6800/684971679,v1:172.21.15.117:6801/684971679] conn(0x7f5ed00727b0 msgr2=0x7f5ed0074bd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:57.517 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.518+0000 7f5efa200640 1 --2- 172.21.15.72:0/3261460805 >> [v2:172.21.15.117:6800/684971679,v1:172.21.15.117:6801/684971679] conn(0x7f5ed00727b0 0x7f5ed0074bd0 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:57.517 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.518+0000 7f5efa200640 1 -- 172.21.15.72:0/3261460805 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f5ed006c8f0 msgr2=0x7f5ed006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:57.517 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.518+0000 7f5efa200640 1 --2- 172.21.15.72:0/3261460805 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f5ed006c8f0 0x7f5ed006edb0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f5ee4006fd0 tx=0x7f5ee4008040 comp rx=0 tx=0).stop 2024-04-04T16:33:57.517 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.518+0000 7f5efa200640 1 -- 172.21.15.72:0/3261460805 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5ef415e860 msgr2=0x7f5ef40cb950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:57.518 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.518+0000 7f5efa200640 1 --2- 172.21.15.72:0/3261460805 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5ef415e860 0x7f5ef40cb950 secure :-1 s=READY pgs=2207 cs=0 l=1 rev1=1 crypto rx=0x7f5eec00cbf0 tx=0x7f5eec00a430 comp rx=0 tx=0).stop 2024-04-04T16:33:57.518 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.518+0000 7f5ef9800640 1 -- 172.21.15.72:0/3261460805 reap_dead start 2024-04-04T16:33:57.518 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.519+0000 7f5efa200640 1 -- 172.21.15.72:0/3261460805 shutdown_connections 2024-04-04T16:33:57.518 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.519+0000 7f5efa200640 1 -- 172.21.15.72:0/3261460805 >> 172.21.15.72:0/3261460805 conn(0x7f5ef406b860 msgr2=0x7f5ef40b3fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T16:33:57.518 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.519+0000 7f5efa200640 1 -- 172.21.15.72:0/3261460805 shutdown_connections 2024-04-04T16:33:57.518 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.519+0000 7f5efa200640 1 -- 172.21.15.72:0/3261460805 wait complete. 2024-04-04T16:33:57.533 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-04-04T16:33:57.730 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.732+0000 7f62ee600640 1 Processor -- start 2024-04-04T16:33:57.731 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.733+0000 7f62ee600640 1 -- start start 2024-04-04T16:33:57.732 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.734+0000 7f62ee600640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f62e80cd060 0x7f62e80b40e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:57.732 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.734+0000 7f62ee600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f62e80b3640 0x7f62e80b4620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:57.732 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.734+0000 7f62ee600640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f62e80c6b40 con 0x7f62e80b3b90 2024-04-04T16:33:57.732 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.734+0000 7f62ee600640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f62e80998d0 con 0x7f62e80cd060 2024-04-04T16:33:57.732 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.734+0000 7f62ee600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f62e8099bb0 con 0x7f62e80b3640 2024-04-04T16:33:57.733 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.735+0000 7f62dea00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f62e80b3640 0x7f62e80b4620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:57.733 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.735+0000 7f62dea00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f62e80b3640 0x7f62e80b4620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.72:51550/0 (socket says 172.21.15.72:51550) 2024-04-04T16:33:57.734 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.735+0000 7f62dea00640 1 -- 172.21.15.72:0/4129174999 learned_addr learned my addr 172.21.15.72:0/4129174999 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T16:33:57.734 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.735+0000 7f62e7400640 1 --2- 172.21.15.72:0/4129174999 >> v2:172.21.15.117:3300/0 conn(0x7f62e80cd060 0x7f62e80b40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:57.734 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.736+0000 7f62dea00640 1 -- 172.21.15.72:0/4129174999 >> v2:172.21.15.117:3300/0 conn(0x7f62e80cd060 msgr2=0x7f62e80b40e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T16:33:57.734 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.736+0000 7f62dea00640 1 --2- 172.21.15.72:0/4129174999 >> v2:172.21.15.117:3300/0 conn(0x7f62e80cd060 0x7f62e80b40e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:57.734 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.736+0000 7f62dea00640 1 -- 172.21.15.72:0/4129174999 >> v1:172.21.15.117:6789/0 conn(0x7f62e80b3b90 legacy=0x7f62e815ddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:57.735 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.736+0000 7f62dea00640 1 -- 172.21.15.72:0/4129174999 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62e80c6e20 con 0x7f62e80b3640 2024-04-04T16:33:57.735 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.737+0000 7f62dea00640 1 --2- 172.21.15.72:0/4129174999 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f62e80b3640 0x7f62e80b4620 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f62d8009870 tx=0x7f62d802b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=97cdc2d9ac324846 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T16:33:57.735 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.737+0000 7f62e6a00640 1 -- 172.21.15.72:0/4129174999 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62d8034070 con 0x7f62e80b3640 2024-04-04T16:33:57.736 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.738+0000 7f62e6a00640 1 -- 172.21.15.72:0/4129174999 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62d8030840 con 0x7f62e80b3640 2024-04-04T16:33:57.736 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.738+0000 7f62e6a00640 1 -- 172.21.15.72:0/4129174999 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62d8030c10 con 0x7f62e80b3640 2024-04-04T16:33:57.737 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.738+0000 7f62ee600640 1 -- 172.21.15.72:0/4129174999 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f62e80b3640 msgr2=0x7f62e80b4620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:57.737 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.738+0000 7f62ee600640 1 --2- 172.21.15.72:0/4129174999 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f62e80b3640 0x7f62e80b4620 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f62d8009870 tx=0x7f62d802b980 comp rx=0 tx=0).stop 2024-04-04T16:33:57.737 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.738+0000 7f62ee600640 1 -- 172.21.15.72:0/4129174999 shutdown_connections 2024-04-04T16:33:57.737 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.738+0000 7f62ee600640 1 --2- 172.21.15.72:0/4129174999 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f62e80b3640 0x7f62e80b4620 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:57.737 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.738+0000 7f62ee600640 1 --2- 172.21.15.72:0/4129174999 >> v2:172.21.15.117:3300/0 conn(0x7f62e80cd060 0x7f62e80b40e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:57.737 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.738+0000 7f62ee600640 1 -- 172.21.15.72:0/4129174999 >> 172.21.15.72:0/4129174999 conn(0x7f62e806b470 msgr2=0x7f62e806b880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T16:33:57.737 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.738+0000 7f62ee600640 1 -- 172.21.15.72:0/4129174999 shutdown_connections 2024-04-04T16:33:57.738 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.738+0000 7f62ee600640 1 -- 172.21.15.72:0/4129174999 wait complete. 2024-04-04T16:33:57.738 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.740+0000 7f62ee600640 1 Processor -- start 2024-04-04T16:33:57.738 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.740+0000 7f62ee600640 1 -- start start 2024-04-04T16:33:57.741 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.741+0000 7f62ee600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f62e80b3640 0x7f62e814e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:57.741 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.741+0000 7f62ee600640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f62e80b3b90 0x7f62e8150a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:57.741 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.741+0000 7f62ee600640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f62e80cd060 0x7f62e8150fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:57.741 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.741+0000 7f62ee600640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f62e80b3080 con 0x7f62e80cd060 2024-04-04T16:33:57.741 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.741+0000 7f62ee600640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f62e80cd440 con 0x7f62e80b3b90 2024-04-04T16:33:57.742 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.741+0000 7f62ee600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f62e815e4d0 con 0x7f62e80b3640 2024-04-04T16:33:57.742 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.741+0000 7f62e7e00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f62e80cd060 0x7f62e8150fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:57.742 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.741+0000 7f62e7e00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f62e80cd060 0x7f62e8150fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51790/0 (socket says 172.21.15.72:51790) 2024-04-04T16:33:57.742 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.741+0000 7f62e7e00640 1 -- 172.21.15.72:0/2592898523 learned_addr learned my addr 172.21.15.72:0/2592898523 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T16:33:57.742 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.742+0000 7f62e7400640 1 --2- 172.21.15.72:0/2592898523 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f62e80b3640 0x7f62e814e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:57.742 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.742+0000 7f62dea00640 1 --2- 172.21.15.72:0/2592898523 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f62e80b3b90 0x7f62e8150a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:57.742 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.742+0000 7f62e7e00640 1 -- 172.21.15.72:0/2592898523 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f62e80b3640 msgr2=0x7f62e814e9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:57.742 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.742+0000 7f62e7e00640 1 --2- 172.21.15.72:0/2592898523 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f62e80b3640 0x7f62e814e9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:57.743 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.742+0000 7f62e7e00640 1 -- 172.21.15.72:0/2592898523 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f62e80b3b90 msgr2=0x7f62e8150a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:57.743 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.742+0000 7f62e7e00640 1 --2- 172.21.15.72:0/2592898523 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f62e80b3b90 0x7f62e8150a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:57.743 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.742+0000 7f62e7e00640 1 -- 172.21.15.72:0/2592898523 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62e80ca760 con 0x7f62e80cd060 2024-04-04T16:33:57.743 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.742+0000 7f62e7e00640 1 --2- 172.21.15.72:0/2592898523 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f62e80cd060 0x7f62e8150fd0 secure :-1 s=READY pgs=2208 cs=0 l=1 rev1=1 crypto rx=0x7f62e000c7a0 tx=0x7f62e000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T16:33:57.743 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.742+0000 7f62dfe00640 1 -- 172.21.15.72:0/2592898523 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62e0003b70 con 0x7f62e80cd060 2024-04-04T16:33:57.743 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.742+0000 7f62dfe00640 1 -- 172.21.15.72:0/2592898523 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62e0003d30 con 0x7f62e80cd060 2024-04-04T16:33:57.743 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.742+0000 7f62ee600640 1 -- 172.21.15.72:0/2592898523 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62e80caa40 con 0x7f62e80cd060 2024-04-04T16:33:57.744 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.742+0000 7f62dfe00640 1 -- 172.21.15.72:0/2592898523 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62e000aa30 con 0x7f62e80cd060 2024-04-04T16:33:57.744 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.743+0000 7f62ee600640 1 -- 172.21.15.72:0/2592898523 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62e80cb000 con 0x7f62e80cd060 2024-04-04T16:33:57.745 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.744+0000 7f62ee600640 1 -- 172.21.15.72:0/2592898523 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f62e8075840 con 0x7f62e80cd060 2024-04-04T16:33:57.745 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.745+0000 7f62dfe00640 1 -- 172.21.15.72:0/2592898523 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f62e000abd0 con 0x7f62e80cd060 2024-04-04T16:33:57.745 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.746+0000 7f62dfe00640 1 --2- 172.21.15.72:0/2592898523 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f62c406c8f0 0x7f62c406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:57.745 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.746+0000 7f62dfe00640 1 -- 172.21.15.72:0/2592898523 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 4943+0+0 (secure 0 0 0) 0x7f62e008b720 con 0x7f62e80cd060 2024-04-04T16:33:57.745 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.746+0000 7f62e7400640 1 --2- 172.21.15.72:0/2592898523 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f62c406c8f0 0x7f62c406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:57.745 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.747+0000 7f62e7400640 1 --2- 172.21.15.72:0/2592898523 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f62c406c8f0 0x7f62c406edb0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f62d0009a30 tx=0x7f62d0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T16:33:57.748 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.751+0000 7f62dfe00640 1 -- 172.21.15.72:0/2592898523 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f62e0059e60 con 0x7f62e80cd060 2024-04-04T16:33:57.948 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.950+0000 7f62ee600640 1 -- 172.21.15.72:0/2592898523 --> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7f62e80b4300 con 0x7f62c406c8f0 2024-04-04T16:33:57.948 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.950+0000 7f62dfe00640 1 -- 172.21.15.72:0/2592898523 <== mgr.4101 v2:172.21.15.72:6832/2205173820 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f62e80b4300 con 0x7f62c406c8f0 2024-04-04T16:33:57.949 INFO:teuthology.orchestra.run.smithi072.stderr:instructed osd(s) 5 to deep-scrub 2024-04-04T16:33:57.951 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.953+0000 7f62ee600640 1 -- 172.21.15.72:0/2592898523 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f62c406c8f0 msgr2=0x7f62c406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:57.951 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.953+0000 7f62ee600640 1 --2- 172.21.15.72:0/2592898523 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f62c406c8f0 0x7f62c406edb0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f62d0009a30 tx=0x7f62d0008040 comp rx=0 tx=0).stop 2024-04-04T16:33:57.951 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.953+0000 7f62ee600640 1 -- 172.21.15.72:0/2592898523 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f62e80cd060 msgr2=0x7f62e8150fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:57.951 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.953+0000 7f62ee600640 1 --2- 172.21.15.72:0/2592898523 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f62e80cd060 0x7f62e8150fd0 secure :-1 s=READY pgs=2208 cs=0 l=1 rev1=1 crypto rx=0x7f62e000c7a0 tx=0x7f62e000cc60 comp rx=0 tx=0).stop 2024-04-04T16:33:57.951 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.953+0000 7f62ee600640 1 -- 172.21.15.72:0/2592898523 shutdown_connections 2024-04-04T16:33:57.951 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.953+0000 7f62ee600640 1 --2- 172.21.15.72:0/2592898523 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f62c406c8f0 0x7f62c406edb0 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:57.952 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.953+0000 7f62ee600640 1 --2- 172.21.15.72:0/2592898523 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f62e80cd060 0x7f62e8150fd0 unknown :-1 s=CLOSED pgs=2208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:57.952 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.953+0000 7f62ee600640 1 --2- 172.21.15.72:0/2592898523 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f62e80b3b90 0x7f62e8150a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:57.952 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.953+0000 7f62ee600640 1 --2- 172.21.15.72:0/2592898523 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f62e80b3640 0x7f62e814e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:57.952 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.953+0000 7f62ee600640 1 -- 172.21.15.72:0/2592898523 >> 172.21.15.72:0/2592898523 conn(0x7f62e806b470 msgr2=0x7f62e80c5f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T16:33:57.952 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.953+0000 7f62ee600640 1 -- 172.21.15.72:0/2592898523 shutdown_connections 2024-04-04T16:33:57.952 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:57.953+0000 7f62ee600640 1 -- 172.21.15.72:0/2592898523 wait complete. 2024-04-04T16:33:57.969 INFO:tasks.ceph:Scrubbing osd.6 2024-04-04T16:33:57.970 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-04-04T16:33:58.177 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.179+0000 7f5ff7000640 1 Processor -- start 2024-04-04T16:33:58.178 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.180+0000 7f5ff7000640 1 -- start start 2024-04-04T16:33:58.179 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.181+0000 7f5ff7000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5ff015c2d0 0x7f5ff0071610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:58.179 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.181+0000 7f5ff7000640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f5ff015c6b0 0x7f5ff00c5e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:58.179 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.181+0000 7f5ff7000640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ff00c6710 con 0x7f5ff00ccb20 2024-04-04T16:33:58.180 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.181+0000 7f5ff7000640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f5ff00c6fb0 con 0x7f5ff015c6b0 2024-04-04T16:33:58.180 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.181+0000 7f5ff7000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f5ff00c69f0 con 0x7f5ff015c2d0 2024-04-04T16:33:58.180 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.181+0000 7f5ff5000640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f5ff00ccb20 0x7f5ff00b3ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:39548/0 (socket says 172.21.15.72:39548) 2024-04-04T16:33:58.180 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.181+0000 7f5ff5000640 1 -- 172.21.15.72:0/2944006327 learned_addr learned my addr 172.21.15.72:0/2944006327 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-04-04T16:33:58.180 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.182+0000 7f5fe7e00640 1 --2- 172.21.15.72:0/2944006327 >> v2:172.21.15.117:3300/0 conn(0x7f5ff015c6b0 0x7f5ff00c5e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:58.180 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.182+0000 7f5fefe00640 1 --2- 172.21.15.72:0/2944006327 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5ff015c2d0 0x7f5ff0071610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:58.181 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.182+0000 7f5fef400640 1 -- 172.21.15.72:0/2944006327 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 404849764 0 0) 0x7f5ff00c6710 con 0x7f5ff00ccb20 2024-04-04T16:33:58.181 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.182+0000 7f5fef400640 1 -- 172.21.15.72:0/2944006327 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5fd4003520 con 0x7f5ff00ccb20 2024-04-04T16:33:58.181 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.182+0000 7f5fe7e00640 1 -- 172.21.15.72:0/2944006327 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5ff015c2d0 msgr2=0x7f5ff0071610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T16:33:58.182 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.182+0000 7f5fe7e00640 1 --2- 172.21.15.72:0/2944006327 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5ff015c2d0 0x7f5ff0071610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:58.182 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.182+0000 7f5fe7e00640 1 -- 172.21.15.72:0/2944006327 >> v1:172.21.15.72:6789/0 conn(0x7f5ff00ccb20 legacy=0x7f5ff00b3ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:58.182 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.182+0000 7f5fef400640 1 -- 172.21.15.72:0/2944006327 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1350428951 0 0) 0x7f5fd4003520 con 0x7f5ff00ccb20 2024-04-04T16:33:58.182 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.182+0000 7f5fe7e00640 1 -- 172.21.15.72:0/2944006327 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ff00c6cd0 con 0x7f5ff015c6b0 2024-04-04T16:33:58.182 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.183+0000 7f5fe7e00640 1 --2- 172.21.15.72:0/2944006327 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5ff015c6b0 0x7f5ff00c5e50 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f5fd80097a0 tx=0x7f5fd802b710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e3ed8b12f0d8a86d server_cookie=0 in_seq=0 out_seq=0 2024-04-04T16:33:58.184 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.184+0000 7f5fef400640 1 -- 172.21.15.72:0/2944006327 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fd8037070 con 0x7f5ff015c6b0 2024-04-04T16:33:58.184 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.184+0000 7f5fef400640 1 -- 172.21.15.72:0/2944006327 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5fd8030510 con 0x7f5ff015c6b0 2024-04-04T16:33:58.184 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.184+0000 7f5fef400640 1 -- 172.21.15.72:0/2944006327 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fe80019f0 con 0x7f5ff015c6b0 2024-04-04T16:33:58.184 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.185+0000 7f5ff7000640 1 -- 172.21.15.72:0/2944006327 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5ff015c6b0 msgr2=0x7f5ff00c5e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:58.184 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.185+0000 7f5ff7000640 1 --2- 172.21.15.72:0/2944006327 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5ff015c6b0 0x7f5ff00c5e50 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f5fd80097a0 tx=0x7f5fd802b710 comp rx=0 tx=0).stop 2024-04-04T16:33:58.184 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.185+0000 7f5ff7000640 1 -- 172.21.15.72:0/2944006327 shutdown_connections 2024-04-04T16:33:58.184 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.185+0000 7f5ff7000640 1 --2- 172.21.15.72:0/2944006327 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5ff015c6b0 0x7f5ff00c5e50 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:58.184 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.185+0000 7f5ff7000640 1 --2- 172.21.15.72:0/2944006327 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5ff015c2d0 0x7f5ff0071610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:58.185 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.185+0000 7f5ff7000640 1 -- 172.21.15.72:0/2944006327 >> 172.21.15.72:0/2944006327 conn(0x7f5ff006b470 msgr2=0x7f5ff006b880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T16:33:58.185 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.185+0000 7f5ff7000640 1 -- 172.21.15.72:0/2944006327 shutdown_connections 2024-04-04T16:33:58.185 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.185+0000 7f5ff7000640 1 -- 172.21.15.72:0/2944006327 wait complete. 2024-04-04T16:33:58.187 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.187+0000 7f5ff7000640 1 Processor -- start 2024-04-04T16:33:58.187 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.187+0000 7f5ff7000640 1 -- start start 2024-04-04T16:33:58.187 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.188+0000 7f5ff7000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5ff00ccb20 0x7f5ff01f4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:58.187 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.188+0000 7f5ff7000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5ff015c2d0 0x7f5ff00998b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:58.188 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.188+0000 7f5ff7000640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5ff015c6b0 0x7f5ff00caef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:58.188 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.188+0000 7f5ff7000640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f5ff00ccfb0 con 0x7f5ff015c6b0 2024-04-04T16:33:58.188 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.188+0000 7f5ff7000640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f5ff00c6390 con 0x7f5ff015c2d0 2024-04-04T16:33:58.188 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.188+0000 7f5ff7000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f5ff00cd130 con 0x7f5ff00ccb20 2024-04-04T16:33:58.188 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.188+0000 7f5ff5000640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5ff015c6b0 0x7f5ff00caef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:58.188 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.188+0000 7f5ff5000640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5ff015c6b0 0x7f5ff00caef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51802/0 (socket says 172.21.15.72:51802) 2024-04-04T16:33:58.188 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.188+0000 7f5ff5000640 1 -- 172.21.15.72:0/4225848601 learned_addr learned my addr 172.21.15.72:0/4225848601 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T16:33:58.188 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.188+0000 7f5fe7e00640 1 --2- 172.21.15.72:0/4225848601 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5ff015c2d0 0x7f5ff00998b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:58.189 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.188+0000 7f5fefe00640 1 --2- 172.21.15.72:0/4225848601 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5ff00ccb20 0x7f5ff01f4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:58.189 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.189+0000 7f5ff5000640 1 -- 172.21.15.72:0/4225848601 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5ff00ccb20 msgr2=0x7f5ff01f4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:58.189 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.189+0000 7f5ff5000640 1 --2- 172.21.15.72:0/4225848601 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5ff00ccb20 0x7f5ff01f4cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:58.189 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.189+0000 7f5ff5000640 1 -- 172.21.15.72:0/4225848601 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5ff015c2d0 msgr2=0x7f5ff00998b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:58.189 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.189+0000 7f5ff5000640 1 --2- 172.21.15.72:0/4225848601 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5ff015c2d0 0x7f5ff00998b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:58.189 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.189+0000 7f5ff5000640 1 -- 172.21.15.72:0/4225848601 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ff01f5230 con 0x7f5ff015c6b0 2024-04-04T16:33:58.189 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.189+0000 7f5fe7e00640 1 --2- 172.21.15.72:0/4225848601 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5ff015c2d0 0x7f5ff00998b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-04T16:33:58.189 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.189+0000 7f5ff5000640 1 --2- 172.21.15.72:0/4225848601 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5ff015c6b0 0x7f5ff00caef0 secure :-1 s=READY pgs=2210 cs=0 l=1 rev1=1 crypto rx=0x7f5fe8001890 tx=0x7f5fe800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T16:33:58.189 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.189+0000 7f5fecc00640 1 -- 172.21.15.72:0/4225848601 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fe8012400 con 0x7f5ff015c6b0 2024-04-04T16:33:58.190 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.189+0000 7f5fecc00640 1 -- 172.21.15.72:0/4225848601 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5fe80125c0 con 0x7f5ff015c6b0 2024-04-04T16:33:58.190 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.189+0000 7f5fecc00640 1 -- 172.21.15.72:0/4225848601 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fe80129b0 con 0x7f5ff015c6b0 2024-04-04T16:33:58.190 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.189+0000 7f5ff7000640 1 -- 172.21.15.72:0/4225848601 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ff00aef10 con 0x7f5ff015c6b0 2024-04-04T16:33:58.190 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.189+0000 7f5ff7000640 1 -- 172.21.15.72:0/4225848601 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ff00af4d0 con 0x7f5ff015c6b0 2024-04-04T16:33:58.194 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.190+0000 7f5ff7000640 1 -- 172.21.15.72:0/4225848601 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5ff0075840 con 0x7f5ff015c6b0 2024-04-04T16:33:58.194 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.192+0000 7f5fecc00640 1 -- 172.21.15.72:0/4225848601 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5fe8012b50 con 0x7f5ff015c6b0 2024-04-04T16:33:58.194 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.192+0000 7f5fecc00640 1 --2- 172.21.15.72:0/4225848601 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f5fcc06c8f0 0x7f5fcc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:58.194 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.192+0000 7f5fecc00640 1 -- 172.21.15.72:0/4225848601 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 4943+0+0 (secure 0 0 0) 0x7f5fe808ca50 con 0x7f5ff015c6b0 2024-04-04T16:33:58.195 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.193+0000 7f5fecc00640 1 --2- 172.21.15.72:0/4225848601 >> [v2:172.21.15.117:6808/2781186528,v1:172.21.15.117:6809/2781186528] conn(0x7f5fcc0727b0 0x7f5fcc074bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:58.195 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.193+0000 7f5fefe00640 1 --2- 172.21.15.72:0/4225848601 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f5fcc06c8f0 0x7f5fcc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:58.195 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.193+0000 7f5fecc00640 1 -- 172.21.15.72:0/4225848601 --> [v2:172.21.15.117:6808/2781186528,v1:172.21.15.117:6809/2781186528] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5fcc075280 con 0x7f5fcc0727b0 2024-04-04T16:33:58.195 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.193+0000 7f5fecc00640 1 -- 172.21.15.72:0/4225848601 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f5fe808cee0 con 0x7f5ff015c6b0 2024-04-04T16:33:58.195 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.193+0000 7f5fefe00640 1 --2- 172.21.15.72:0/4225848601 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f5fcc06c8f0 0x7f5fcc06edb0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f5ff00afca0 tx=0x7f5fe0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T16:33:58.195 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.193+0000 7f5fe7e00640 1 --2- 172.21.15.72:0/4225848601 >> [v2:172.21.15.117:6808/2781186528,v1:172.21.15.117:6809/2781186528] conn(0x7f5fcc0727b0 0x7f5fcc074bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:58.195 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.194+0000 7f5fe7e00640 1 --2- 172.21.15.72:0/4225848601 >> [v2:172.21.15.117:6808/2781186528,v1:172.21.15.117:6809/2781186528] conn(0x7f5fcc0727b0 0x7f5fcc074bd0 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T16:33:58.196 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.197+0000 7f5fecc00640 1 -- 172.21.15.72:0/4225848601 <== osd.6 v2:172.21.15.117:6808/2781186528 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f5fcc075280 con 0x7f5fcc0727b0 2024-04-04T16:33:58.210 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.212+0000 7f5ff7000640 1 -- 172.21.15.72:0/4225848601 --> [v2:172.21.15.117:6808/2781186528,v1:172.21.15.117:6809/2781186528] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f5ff00ce760 con 0x7f5fcc0727b0 2024-04-04T16:33:58.211 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.213+0000 7f5fecc00640 1 -- 172.21.15.72:0/4225848601 <== osd.6 v2:172.21.15.117:6808/2781186528 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f5ff00ce760 con 0x7f5fcc0727b0 2024-04-04T16:33:58.212 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-04T16:33:58.212 INFO:teuthology.orchestra.run.smithi072.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-04T16:33:58.212 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-04T16:33:58.213 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.214+0000 7f5ff7000640 1 -- 172.21.15.72:0/4225848601 >> [v2:172.21.15.117:6808/2781186528,v1:172.21.15.117:6809/2781186528] conn(0x7f5fcc0727b0 msgr2=0x7f5fcc074bd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:58.213 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.214+0000 7f5ff7000640 1 --2- 172.21.15.72:0/4225848601 >> [v2:172.21.15.117:6808/2781186528,v1:172.21.15.117:6809/2781186528] conn(0x7f5fcc0727b0 0x7f5fcc074bd0 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:58.213 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.214+0000 7f5ff7000640 1 -- 172.21.15.72:0/4225848601 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f5fcc06c8f0 msgr2=0x7f5fcc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:58.213 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.214+0000 7f5ff7000640 1 --2- 172.21.15.72:0/4225848601 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f5fcc06c8f0 0x7f5fcc06edb0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f5ff00afca0 tx=0x7f5fe0008040 comp rx=0 tx=0).stop 2024-04-04T16:33:58.214 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.214+0000 7f5ff7000640 1 -- 172.21.15.72:0/4225848601 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5ff015c6b0 msgr2=0x7f5ff00caef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:58.214 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.214+0000 7f5ff7000640 1 --2- 172.21.15.72:0/4225848601 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5ff015c6b0 0x7f5ff00caef0 secure :-1 s=READY pgs=2210 cs=0 l=1 rev1=1 crypto rx=0x7f5fe8001890 tx=0x7f5fe800a430 comp rx=0 tx=0).stop 2024-04-04T16:33:58.214 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.214+0000 7f5ff5000640 1 -- 172.21.15.72:0/4225848601 reap_dead start 2024-04-04T16:33:58.214 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.214+0000 7f5ff7000640 1 -- 172.21.15.72:0/4225848601 shutdown_connections 2024-04-04T16:33:58.214 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.214+0000 7f5ff7000640 1 -- 172.21.15.72:0/4225848601 >> 172.21.15.72:0/4225848601 conn(0x7f5ff006b470 msgr2=0x7f5ff00b40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T16:33:58.214 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.214+0000 7f5ff7000640 1 -- 172.21.15.72:0/4225848601 shutdown_connections 2024-04-04T16:33:58.214 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.214+0000 7f5ff7000640 1 -- 172.21.15.72:0/4225848601 wait complete. 2024-04-04T16:33:58.229 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-04-04T16:33:58.427 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.429+0000 7f46b2c00640 1 Processor -- start 2024-04-04T16:33:58.427 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.429+0000 7f46b2c00640 1 -- start start 2024-04-04T16:33:58.429 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.430+0000 7f46b2c00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f46ac145e90 0x7f46ac0c74e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:58.429 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.430+0000 7f46b2c00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f46ac0d0360 0x7f46ac0ccd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:58.429 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.430+0000 7f46b2c00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46ac0c7dc0 con 0x7f46ac070ee0 2024-04-04T16:33:58.429 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.430+0000 7f46b2c00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f46ac0c8660 con 0x7f46ac0d0360 2024-04-04T16:33:58.429 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.430+0000 7f46b2c00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f46ac0c80a0 con 0x7f46ac145e90 2024-04-04T16:33:58.429 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.431+0000 7f46abe00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f46ac145e90 0x7f46ac0c74e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:58.429 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.431+0000 7f46abe00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f46ac145e90 0x7f46ac0c74e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.72:51584/0 (socket says 172.21.15.72:51584) 2024-04-04T16:33:58.430 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.431+0000 7f46abe00640 1 -- 172.21.15.72:0/89910619 learned_addr learned my addr 172.21.15.72:0/89910619 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T16:33:58.430 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.431+0000 7f46b0c00640 1 --2- 172.21.15.72:0/89910619 >> v2:172.21.15.117:3300/0 conn(0x7f46ac0d0360 0x7f46ac0ccd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:58.430 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.432+0000 7f46b0c00640 1 -- 172.21.15.72:0/89910619 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f46ac145e90 msgr2=0x7f46ac0c74e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T16:33:58.431 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.432+0000 7f46b0c00640 1 --2- 172.21.15.72:0/89910619 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f46ac145e90 0x7f46ac0c74e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:58.431 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.432+0000 7f46b0c00640 1 -- 172.21.15.72:0/89910619 >> v1:172.21.15.117:6789/0 conn(0x7f46ac070ee0 legacy=0x7f46ac0cfc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:58.431 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.432+0000 7f46b0c00640 1 -- 172.21.15.72:0/89910619 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46ac0c8380 con 0x7f46ac0d0360 2024-04-04T16:33:58.431 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.432+0000 7f46abe00640 1 --2- 172.21.15.72:0/89910619 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f46ac145e90 0x7f46ac0c74e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-04T16:33:58.431 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.433+0000 7f46b0c00640 1 --2- 172.21.15.72:0/89910619 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f46ac0d0360 0x7f46ac0ccd20 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f46a4009d90 tx=0x7f46a402be20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2f89c5d23e0e58c3 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T16:33:58.432 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.433+0000 7f46aaa00640 1 -- 172.21.15.72:0/89910619 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46a4039070 con 0x7f46ac0d0360 2024-04-04T16:33:58.432 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.433+0000 7f46aaa00640 1 -- 172.21.15.72:0/89910619 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46a402cbd0 con 0x7f46ac0d0360 2024-04-04T16:33:58.433 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.433+0000 7f46aaa00640 1 -- 172.21.15.72:0/89910619 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46a4034440 con 0x7f46ac0d0360 2024-04-04T16:33:58.433 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.434+0000 7f46b2c00640 1 -- 172.21.15.72:0/89910619 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f46ac0d0360 msgr2=0x7f46ac0ccd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:58.433 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.434+0000 7f46b2c00640 1 --2- 172.21.15.72:0/89910619 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f46ac0d0360 0x7f46ac0ccd20 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f46a4009d90 tx=0x7f46a402be20 comp rx=0 tx=0).stop 2024-04-04T16:33:58.433 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.434+0000 7f46b2c00640 1 -- 172.21.15.72:0/89910619 shutdown_connections 2024-04-04T16:33:58.433 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.434+0000 7f46b2c00640 1 --2- 172.21.15.72:0/89910619 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f46ac0d0360 0x7f46ac0ccd20 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:58.433 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.434+0000 7f46b2c00640 1 --2- 172.21.15.72:0/89910619 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f46ac145e90 0x7f46ac0c74e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:58.433 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.434+0000 7f46b2c00640 1 -- 172.21.15.72:0/89910619 >> 172.21.15.72:0/89910619 conn(0x7f46ac0d2110 msgr2=0x7f46ac0d24f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T16:33:58.433 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.434+0000 7f46b2c00640 1 -- 172.21.15.72:0/89910619 shutdown_connections 2024-04-04T16:33:58.433 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.434+0000 7f46b2c00640 1 -- 172.21.15.72:0/89910619 wait complete. 2024-04-04T16:33:58.435 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.436+0000 7f46b2c00640 1 Processor -- start 2024-04-04T16:33:58.435 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.436+0000 7f46b2c00640 1 -- start start 2024-04-04T16:33:58.436 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.437+0000 7f46b2c00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f46ac070ee0 0x7f46ac1521e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:58.436 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.437+0000 7f46b2c00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f46ac0d0360 0x7f46ac154c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:58.436 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.437+0000 7f46b2c00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f46ac145e90 0x7f46ac0b0a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:58.436 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.437+0000 7f46b2c00640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f46ac0c7ba0 con 0x7f46ac145e90 2024-04-04T16:33:58.436 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.437+0000 7f46b2c00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f46ac0c7a20 con 0x7f46ac070ee0 2024-04-04T16:33:58.436 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.437+0000 7f46b2c00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f46ac0cd260 con 0x7f46ac0d0360 2024-04-04T16:33:58.436 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.437+0000 7f46b0c00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f46ac145e90 0x7f46ac0b0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:58.437 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.437+0000 7f46b0c00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f46ac145e90 0x7f46ac0b0a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51818/0 (socket says 172.21.15.72:51818) 2024-04-04T16:33:58.437 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.437+0000 7f46b0c00640 1 -- 172.21.15.72:0/3087656236 learned_addr learned my addr 172.21.15.72:0/3087656236 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T16:33:58.437 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.437+0000 7f46ab400640 1 --2- 172.21.15.72:0/3087656236 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f46ac0d0360 0x7f46ac154c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:58.437 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.437+0000 7f46abe00640 1 --2- 172.21.15.72:0/3087656236 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f46ac070ee0 0x7f46ac1521e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:58.437 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.438+0000 7f46b0c00640 1 -- 172.21.15.72:0/3087656236 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f46ac0d0360 msgr2=0x7f46ac154c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:58.437 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.438+0000 7f46b0c00640 1 --2- 172.21.15.72:0/3087656236 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f46ac0d0360 0x7f46ac154c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:58.437 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.438+0000 7f46b0c00640 1 -- 172.21.15.72:0/3087656236 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f46ac070ee0 msgr2=0x7f46ac1521e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:58.437 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.438+0000 7f46b0c00640 1 --2- 172.21.15.72:0/3087656236 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f46ac070ee0 0x7f46ac1521e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:58.438 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.438+0000 7f46b0c00640 1 -- 172.21.15.72:0/3087656236 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46ac155170 con 0x7f46ac145e90 2024-04-04T16:33:58.438 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.438+0000 7f46ab400640 1 --2- 172.21.15.72:0/3087656236 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f46ac0d0360 0x7f46ac154c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-04T16:33:58.438 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.438+0000 7f46b0c00640 1 --2- 172.21.15.72:0/3087656236 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f46ac145e90 0x7f46ac0b0a50 secure :-1 s=READY pgs=2211 cs=0 l=1 rev1=1 crypto rx=0x7f46a4009eb0 tx=0x7f46a4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T16:33:58.439 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.438+0000 7f46a3e00640 1 -- 172.21.15.72:0/3087656236 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46a4039050 con 0x7f46ac145e90 2024-04-04T16:33:58.439 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.438+0000 7f46a3e00640 1 -- 172.21.15.72:0/3087656236 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46a4045070 con 0x7f46ac145e90 2024-04-04T16:33:58.440 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.438+0000 7f46b2c00640 1 -- 172.21.15.72:0/3087656236 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46ac1527c0 con 0x7f46ac145e90 2024-04-04T16:33:58.440 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.438+0000 7f46a3e00640 1 -- 172.21.15.72:0/3087656236 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46a4009450 con 0x7f46ac145e90 2024-04-04T16:33:58.440 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.438+0000 7f46b2c00640 1 -- 172.21.15.72:0/3087656236 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46ac152d80 con 0x7f46ac145e90 2024-04-04T16:33:58.440 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.439+0000 7f46b2c00640 1 -- 172.21.15.72:0/3087656236 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46ac075840 con 0x7f46ac145e90 2024-04-04T16:33:58.440 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.441+0000 7f46a3e00640 1 -- 172.21.15.72:0/3087656236 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f46a403e850 con 0x7f46ac145e90 2024-04-04T16:33:58.440 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.441+0000 7f46a3e00640 1 --2- 172.21.15.72:0/3087656236 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f468c06c8f0 0x7f468c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:58.440 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.442+0000 7f46a3e00640 1 -- 172.21.15.72:0/3087656236 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 4943+0+0 (secure 0 0 0) 0x7f46a40af090 con 0x7f46ac145e90 2024-04-04T16:33:58.441 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.442+0000 7f46abe00640 1 --2- 172.21.15.72:0/3087656236 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f468c06c8f0 0x7f468c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:58.441 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.442+0000 7f46abe00640 1 --2- 172.21.15.72:0/3087656236 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f468c06c8f0 0x7f468c06edb0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f469c009ac0 tx=0x7f469c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T16:33:58.447 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.449+0000 7f46a3e00640 1 -- 172.21.15.72:0/3087656236 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f46a407d840 con 0x7f46ac145e90 2024-04-04T16:33:58.637 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.639+0000 7f46b2c00640 1 -- 172.21.15.72:0/3087656236 --> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7f46ac06e690 con 0x7f468c06c8f0 2024-04-04T16:33:58.638 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.640+0000 7f46a3e00640 1 -- 172.21.15.72:0/3087656236 <== mgr.4101 v2:172.21.15.72:6832/2205173820 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f46ac06e690 con 0x7f468c06c8f0 2024-04-04T16:33:58.638 INFO:teuthology.orchestra.run.smithi072.stderr:instructed osd(s) 6 to deep-scrub 2024-04-04T16:33:58.641 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.642+0000 7f46b2c00640 1 -- 172.21.15.72:0/3087656236 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f468c06c8f0 msgr2=0x7f468c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:58.641 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.642+0000 7f46b2c00640 1 --2- 172.21.15.72:0/3087656236 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f468c06c8f0 0x7f468c06edb0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f469c009ac0 tx=0x7f469c008040 comp rx=0 tx=0).stop 2024-04-04T16:33:58.641 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.642+0000 7f46b2c00640 1 -- 172.21.15.72:0/3087656236 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f46ac145e90 msgr2=0x7f46ac0b0a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:58.641 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.643+0000 7f46b2c00640 1 --2- 172.21.15.72:0/3087656236 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f46ac145e90 0x7f46ac0b0a50 secure :-1 s=READY pgs=2211 cs=0 l=1 rev1=1 crypto rx=0x7f46a4009eb0 tx=0x7f46a4004a40 comp rx=0 tx=0).stop 2024-04-04T16:33:58.641 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.643+0000 7f46b2c00640 1 -- 172.21.15.72:0/3087656236 shutdown_connections 2024-04-04T16:33:58.641 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.643+0000 7f46b2c00640 1 --2- 172.21.15.72:0/3087656236 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f468c06c8f0 0x7f468c06edb0 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:58.641 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.643+0000 7f46b2c00640 1 --2- 172.21.15.72:0/3087656236 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f46ac145e90 0x7f46ac0b0a50 unknown :-1 s=CLOSED pgs=2211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:58.641 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.643+0000 7f46b2c00640 1 --2- 172.21.15.72:0/3087656236 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f46ac0d0360 0x7f46ac154c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:58.642 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.643+0000 7f46b2c00640 1 --2- 172.21.15.72:0/3087656236 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f46ac070ee0 0x7f46ac1521e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:58.642 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.643+0000 7f46b2c00640 1 -- 172.21.15.72:0/3087656236 >> 172.21.15.72:0/3087656236 conn(0x7f46ac0d2110 msgr2=0x7f46ac0d0870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T16:33:58.642 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.643+0000 7f46b2c00640 1 -- 172.21.15.72:0/3087656236 shutdown_connections 2024-04-04T16:33:58.642 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.643+0000 7f46b2c00640 1 -- 172.21.15.72:0/3087656236 wait complete. 2024-04-04T16:33:58.658 INFO:tasks.ceph:Scrubbing osd.7 2024-04-04T16:33:58.658 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-04-04T16:33:58.862 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.864+0000 7fae86e00640 1 Processor -- start 2024-04-04T16:33:58.863 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.865+0000 7fae86e00640 1 -- start start 2024-04-04T16:33:58.864 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.866+0000 7fae86e00640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fae800cf280 0x7fae800cec30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:58.864 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.866+0000 7fae86e00640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae800d2d10 con 0x7fae800cf660 2024-04-04T16:33:58.864 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.866+0000 7fae86e00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae800d2ff0 con 0x7fae8015e860 2024-04-04T16:33:58.864 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.866+0000 7fae86e00640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7fae800d3920 con 0x7fae800cf280 2024-04-04T16:33:58.864 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.866+0000 7fae85a00640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fae800cf280 0x7fae800cec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:58.864 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.866+0000 7fae86400640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fae800cf660 0x7fae800b7a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:39556/0 (socket says 172.21.15.72:39556) 2024-04-04T16:33:58.865 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.866+0000 7fae86400640 1 -- 172.21.15.72:0/3016633115 learned_addr learned my addr 172.21.15.72:0/3016633115 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-04-04T16:33:58.865 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.867+0000 7fae85a00640 1 -- 172.21.15.72:0/3016633115 >> v1:172.21.15.117:6789/0 conn(0x7fae8015e860 legacy=0x7fae800d2550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:58.865 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.867+0000 7fae85a00640 1 -- 172.21.15.72:0/3016633115 >> v1:172.21.15.72:6789/0 conn(0x7fae800cf660 legacy=0x7fae800b7a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:58.865 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.867+0000 7fae85a00640 1 -- 172.21.15.72:0/3016633115 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae800d32d0 con 0x7fae800cf280 2024-04-04T16:33:58.866 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.868+0000 7fae85a00640 1 --2- 172.21.15.72:0/3016633115 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fae800cf280 0x7fae800cec30 secure :-1 s=READY pgs=2213 cs=0 l=1 rev1=1 crypto rx=0x7fae740097a0 tx=0x7fae7402b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e5efa4a81892be6 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T16:33:58.867 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.868+0000 7fae7fe00640 1 -- 172.21.15.72:0/3016633115 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae74034070 con 0x7fae800cf280 2024-04-04T16:33:58.867 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.868+0000 7fae7fe00640 1 -- 172.21.15.72:0/3016633115 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae74030610 con 0x7fae800cf280 2024-04-04T16:33:58.867 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.868+0000 7fae7fe00640 1 -- 172.21.15.72:0/3016633115 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae740309e0 con 0x7fae800cf280 2024-04-04T16:33:58.867 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.869+0000 7fae86e00640 1 -- 172.21.15.72:0/3016633115 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fae800cf280 msgr2=0x7fae800cec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:58.867 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.869+0000 7fae86e00640 1 --2- 172.21.15.72:0/3016633115 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fae800cf280 0x7fae800cec30 secure :-1 s=READY pgs=2213 cs=0 l=1 rev1=1 crypto rx=0x7fae740097a0 tx=0x7fae7402b960 comp rx=0 tx=0).stop 2024-04-04T16:33:58.867 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.869+0000 7fae86e00640 1 -- 172.21.15.72:0/3016633115 shutdown_connections 2024-04-04T16:33:58.867 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.869+0000 7fae86e00640 1 --2- 172.21.15.72:0/3016633115 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fae800cf280 0x7fae800cec30 unknown :-1 s=CLOSED pgs=2213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:58.868 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.869+0000 7fae86e00640 1 -- 172.21.15.72:0/3016633115 >> 172.21.15.72:0/3016633115 conn(0x7fae8006b860 msgr2=0x7fae8006bc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T16:33:58.868 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.869+0000 7fae86e00640 1 -- 172.21.15.72:0/3016633115 shutdown_connections 2024-04-04T16:33:58.868 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.869+0000 7fae86e00640 1 -- 172.21.15.72:0/3016633115 wait complete. 2024-04-04T16:33:58.868 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.870+0000 7fae86e00640 1 Processor -- start 2024-04-04T16:33:58.868 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.871+0000 7fae86e00640 1 -- start start 2024-04-04T16:33:58.871 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.871+0000 7fae86e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fae800cf280 0x7fae80161950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:58.871 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.871+0000 7fae86e00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fae800cf660 0x7fae801e9370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:58.871 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.872+0000 7fae86e00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fae8015e860 0x7fae8015b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:58.871 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.872+0000 7fae86e00640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fae800b8190 con 0x7fae800cf660 2024-04-04T16:33:58.871 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.872+0000 7fae86e00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fae800cfaf0 con 0x7fae8015e860 2024-04-04T16:33:58.871 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.872+0000 7fae86e00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fae800b8310 con 0x7fae800cf280 2024-04-04T16:33:58.871 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.872+0000 7fae85000640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fae800cf660 0x7fae801e9370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:58.872 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.872+0000 7fae85000640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fae800cf660 0x7fae801e9370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51826/0 (socket says 172.21.15.72:51826) 2024-04-04T16:33:58.872 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.872+0000 7fae85000640 1 -- 172.21.15.72:0/628291606 learned_addr learned my addr 172.21.15.72:0/628291606 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T16:33:58.872 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.872+0000 7fae86400640 1 --2- 172.21.15.72:0/628291606 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fae8015e860 0x7fae8015b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:58.872 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.872+0000 7fae85a00640 1 --2- 172.21.15.72:0/628291606 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fae800cf280 0x7fae80161950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:58.872 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.872+0000 7fae85000640 1 -- 172.21.15.72:0/628291606 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fae800cf280 msgr2=0x7fae80161950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:58.873 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.872+0000 7fae85000640 1 --2- 172.21.15.72:0/628291606 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fae800cf280 0x7fae80161950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:58.873 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.872+0000 7fae85000640 1 -- 172.21.15.72:0/628291606 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fae8015e860 msgr2=0x7fae8015b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:58.873 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.872+0000 7fae85000640 1 --2- 172.21.15.72:0/628291606 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fae8015e860 0x7fae8015b7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:58.873 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.872+0000 7fae85000640 1 -- 172.21.15.72:0/628291606 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae801e84e0 con 0x7fae800cf660 2024-04-04T16:33:58.873 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.872+0000 7fae85a00640 1 --2- 172.21.15.72:0/628291606 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fae800cf280 0x7fae80161950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-04T16:33:58.873 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.873+0000 7fae85000640 1 --2- 172.21.15.72:0/628291606 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fae800cf660 0x7fae801e9370 secure :-1 s=READY pgs=2214 cs=0 l=1 rev1=1 crypto rx=0x7fae6c00c3c0 tx=0x7fae6c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T16:33:58.873 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.873+0000 7fae7d600640 1 -- 172.21.15.72:0/628291606 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae6c017070 con 0x7fae800cf660 2024-04-04T16:33:58.873 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.873+0000 7fae7d600640 1 -- 172.21.15.72:0/628291606 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae6c0052f0 con 0x7fae800cf660 2024-04-04T16:33:58.873 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.873+0000 7fae7d600640 1 -- 172.21.15.72:0/628291606 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae6c003830 con 0x7fae800cf660 2024-04-04T16:33:58.874 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.873+0000 7fae86e00640 1 -- 172.21.15.72:0/628291606 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae8015f790 con 0x7fae800cf660 2024-04-04T16:33:58.874 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.873+0000 7fae86e00640 1 -- 172.21.15.72:0/628291606 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae8015fd50 con 0x7fae800cf660 2024-04-04T16:33:58.875 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.874+0000 7fae86e00640 1 -- 172.21.15.72:0/628291606 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fae800b9440 con 0x7fae800cf660 2024-04-04T16:33:58.875 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.875+0000 7fae7d600640 1 -- 172.21.15.72:0/628291606 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fae6c01a070 con 0x7fae800cf660 2024-04-04T16:33:58.875 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.876+0000 7fae7d600640 1 --2- 172.21.15.72:0/628291606 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fae6006c8f0 0x7fae6006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:58.875 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.876+0000 7fae7d600640 1 -- 172.21.15.72:0/628291606 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 4943+0+0 (secure 0 0 0) 0x7fae6c08ab80 con 0x7fae800cf660 2024-04-04T16:33:58.875 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.876+0000 7fae85a00640 1 --2- 172.21.15.72:0/628291606 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fae6006c8f0 0x7fae6006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:58.875 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.876+0000 7fae7d600640 1 --2- 172.21.15.72:0/628291606 >> [v2:172.21.15.117:6816/617469882,v1:172.21.15.117:6817/617469882] conn(0x7fae600727b0 0x7fae60074bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:58.876 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.876+0000 7fae7d600640 1 -- 172.21.15.72:0/628291606 --> [v2:172.21.15.117:6816/617469882,v1:172.21.15.117:6817/617469882] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fae6c015e70 con 0x7fae600727b0 2024-04-04T16:33:58.876 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.876+0000 7fae7d600640 1 -- 172.21.15.72:0/628291606 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7fae6c08f2a0 con 0x7fae800cf660 2024-04-04T16:33:58.876 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.877+0000 7fae85a00640 1 --2- 172.21.15.72:0/628291606 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fae6006c8f0 0x7fae6006edb0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7fae74036000 tx=0x7fae7403b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T16:33:58.876 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.877+0000 7fae86400640 1 --2- 172.21.15.72:0/628291606 >> [v2:172.21.15.117:6816/617469882,v1:172.21.15.117:6817/617469882] conn(0x7fae600727b0 0x7fae60074bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:58.876 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.878+0000 7fae86400640 1 --2- 172.21.15.72:0/628291606 >> [v2:172.21.15.117:6816/617469882,v1:172.21.15.117:6817/617469882] conn(0x7fae600727b0 0x7fae60074bd0 crc :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T16:33:58.877 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.880+0000 7fae7d600640 1 -- 172.21.15.72:0/628291606 <== osd.7 v2:172.21.15.117:6816/617469882 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fae6c015e70 con 0x7fae600727b0 2024-04-04T16:33:58.891 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.893+0000 7fae86e00640 1 -- 172.21.15.72:0/628291606 --> [v2:172.21.15.117:6816/617469882,v1:172.21.15.117:6817/617469882] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fae800756c0 con 0x7fae600727b0 2024-04-04T16:33:58.892 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.894+0000 7fae7d600640 1 -- 172.21.15.72:0/628291606 <== osd.7 v2:172.21.15.117:6816/617469882 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fae800756c0 con 0x7fae600727b0 2024-04-04T16:33:58.892 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-04T16:33:58.892 INFO:teuthology.orchestra.run.smithi072.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-04T16:33:58.892 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-04T16:33:58.893 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.895+0000 7fae86e00640 1 -- 172.21.15.72:0/628291606 >> [v2:172.21.15.117:6816/617469882,v1:172.21.15.117:6817/617469882] conn(0x7fae600727b0 msgr2=0x7fae60074bd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:58.893 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.895+0000 7fae86e00640 1 --2- 172.21.15.72:0/628291606 >> [v2:172.21.15.117:6816/617469882,v1:172.21.15.117:6817/617469882] conn(0x7fae600727b0 0x7fae60074bd0 crc :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:58.894 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.895+0000 7fae86e00640 1 -- 172.21.15.72:0/628291606 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fae6006c8f0 msgr2=0x7fae6006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:58.894 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.895+0000 7fae86e00640 1 --2- 172.21.15.72:0/628291606 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7fae6006c8f0 0x7fae6006edb0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7fae74036000 tx=0x7fae7403b040 comp rx=0 tx=0).stop 2024-04-04T16:33:58.894 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.895+0000 7fae86e00640 1 -- 172.21.15.72:0/628291606 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fae800cf660 msgr2=0x7fae801e9370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:58.894 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.895+0000 7fae86e00640 1 --2- 172.21.15.72:0/628291606 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fae800cf660 0x7fae801e9370 secure :-1 s=READY pgs=2214 cs=0 l=1 rev1=1 crypto rx=0x7fae6c00c3c0 tx=0x7fae6c00c880 comp rx=0 tx=0).stop 2024-04-04T16:33:58.894 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.895+0000 7fae86400640 1 -- 172.21.15.72:0/628291606 reap_dead start 2024-04-04T16:33:58.894 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.895+0000 7fae86e00640 1 -- 172.21.15.72:0/628291606 shutdown_connections 2024-04-04T16:33:58.894 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.895+0000 7fae86e00640 1 -- 172.21.15.72:0/628291606 >> 172.21.15.72:0/628291606 conn(0x7fae8006b860 msgr2=0x7fae800b5d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T16:33:58.894 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.895+0000 7fae86e00640 1 -- 172.21.15.72:0/628291606 shutdown_connections 2024-04-04T16:33:58.895 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:58.895+0000 7fae86e00640 1 -- 172.21.15.72:0/628291606 wait complete. 2024-04-04T16:33:58.909 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-04-04T16:33:59.101 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:59.103+0000 7f36e3200640 1 Processor -- start 2024-04-04T16:33:59.101 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:59.103+0000 7f36e3200640 1 -- start start 2024-04-04T16:33:59.103 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:59.104+0000 7f36e3200640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f36dc15c2d0 0x7f36dc071610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:59.103 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:59.104+0000 7f36e3200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f36dc0ccb20 0x7f36dc0ccfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:59.103 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:59.104+0000 7f36e3200640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36dc0c6710 con 0x7f36dc15c6b0 2024-04-04T16:33:59.103 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:59.104+0000 7f36e3200640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f36dc0c6fb0 con 0x7f36dc15c2d0 2024-04-04T16:33:59.103 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:59.104+0000 7f36e3200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f36dc0c69f0 con 0x7f36dc0ccb20 2024-04-04T16:33:59.103 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:59.105+0000 7f36dbe00640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f36dc15c2d0 0x7f36dc071610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:59.103 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:59.105+0000 7f36db400640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f36dc15c6b0 0x7f36dc0c5e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:39560/0 (socket says 172.21.15.72:39560) 2024-04-04T16:33:59.104 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:59.105+0000 7f36db400640 1 -- 172.21.15.72:0/3366618794 learned_addr learned my addr 172.21.15.72:0/3366618794 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-04-04T16:33:59.104 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:59.105+0000 7f36e1200640 1 --2- 172.21.15.72:0/3366618794 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f36dc0ccb20 0x7f36dc0ccfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:59.105 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:59.105+0000 7f36daa00640 1 -- 172.21.15.72:0/3366618794 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 343804718 0 0) 0x7f36dc0c6710 con 0x7f36dc15c6b0 2024-04-04T16:33:59.106 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:59.105+0000 7f36dbe00640 1 -- 172.21.15.72:0/3366618794 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f36dc0ccb20 msgr2=0x7f36dc0ccfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T16:33:59.106 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:59.105+0000 7f36dbe00640 1 --2- 172.21.15.72:0/3366618794 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f36dc0ccb20 0x7f36dc0ccfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:59.106 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:59.105+0000 7f36dbe00640 1 -- 172.21.15.72:0/3366618794 >> v1:172.21.15.72:6789/0 conn(0x7f36dc15c6b0 legacy=0x7f36dc0c5e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:59.106 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:59.105+0000 7f36dbe00640 1 -- 172.21.15.72:0/3366618794 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36dc0c6cd0 con 0x7f36dc15c2d0 2024-04-04T16:33:59.106 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:59.106+0000 7f36dbe00640 1 --2- 172.21.15.72:0/3366618794 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f36dc15c2d0 0x7f36dc071610 secure :-1 s=READY pgs=2216 cs=0 l=1 rev1=1 crypto rx=0x7f36cc0097a0 tx=0x7f36cc02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aba9d1d305785d44 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T16:33:59.106 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:59.107+0000 7f36daa00640 1 -- 172.21.15.72:0/3366618794 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36cc0315a0 con 0x7f36dc15c2d0 2024-04-04T16:33:59.106 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:59.107+0000 7f36daa00640 1 -- 172.21.15.72:0/3366618794 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36cc037070 con 0x7f36dc15c2d0 2024-04-04T16:33:59.107 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:59.107+0000 7f36daa00640 1 -- 172.21.15.72:0/3366618794 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36cc031960 con 0x7f36dc15c2d0 2024-04-04T16:33:59.107 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:59.107+0000 7f36e3200640 1 -- 172.21.15.72:0/3366618794 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f36dc15c2d0 msgr2=0x7f36dc071610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:59.107 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:59.107+0000 7f36e3200640 1 --2- 172.21.15.72:0/3366618794 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f36dc15c2d0 0x7f36dc071610 secure :-1 s=READY pgs=2216 cs=0 l=1 rev1=1 crypto rx=0x7f36cc0097a0 tx=0x7f36cc02b840 comp rx=0 tx=0).stop 2024-04-04T16:33:59.107 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:59.107+0000 7f36e3200640 1 -- 172.21.15.72:0/3366618794 shutdown_connections 2024-04-04T16:33:59.107 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:59.107+0000 7f36e3200640 1 --2- 172.21.15.72:0/3366618794 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f36dc0ccb20 0x7f36dc0ccfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:59.107 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:59.107+0000 7f36e3200640 1 --2- 172.21.15.72:0/3366618794 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f36dc15c2d0 0x7f36dc071610 unknown :-1 s=CLOSED pgs=2216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:59.107 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:59.107+0000 7f36e3200640 1 -- 172.21.15.72:0/3366618794 >> 172.21.15.72:0/3366618794 conn(0x7f36dc06b470 msgr2=0x7f36dc06b880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T16:33:59.107 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:59.107+0000 7f36e3200640 1 -- 172.21.15.72:0/3366618794 shutdown_connections 2024-04-04T16:33:59.108 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:59.108+0000 7f36e3200640 1 -- 172.21.15.72:0/3366618794 wait complete. 2024-04-04T16:33:59.110 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:59.109+0000 7f36e3200640 1 Processor -- start 2024-04-04T16:33:59.110 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:59.109+0000 7f36e3200640 1 -- start start 2024-04-04T16:33:59.110 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:59.110+0000 7f36e3200640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f36dc0ccb20 0x7f36dc14b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:59.111 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:59.110+0000 7f36e3200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f36dc15c2d0 0x7f36dc09c440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:59.111 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:59.110+0000 7f36e3200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f36dc15c6b0 0x7f36dc14f220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:59.111 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:59.110+0000 7f36e3200640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f36dc0b4020 con 0x7f36dc0ccb20 2024-04-04T16:33:59.111 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:59.110+0000 7f36e3200640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f36dc0b3ea0 con 0x7f36dc15c2d0 2024-04-04T16:33:59.111 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:59.110+0000 7f36e3200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f36dc0b41a0 con 0x7f36dc15c6b0 2024-04-04T16:33:59.111 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:59.111+0000 7f36dbe00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f36dc0ccb20 0x7f36dc14b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:59.112 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:59.111+0000 7f36dbe00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f36dc0ccb20 0x7f36dc14b4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51854/0 (socket says 172.21.15.72:51854) 2024-04-04T16:33:59.112 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:59.111+0000 7f36dbe00640 1 -- 172.21.15.72:0/79486011 learned_addr learned my addr 172.21.15.72:0/79486011 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T16:33:59.112 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:59.111+0000 7f36e1200640 1 --2- 172.21.15.72:0/79486011 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f36dc15c6b0 0x7f36dc14f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:59.112 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:59.111+0000 7f36db400640 1 --2- 172.21.15.72:0/79486011 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f36dc15c2d0 0x7f36dc09c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:59.112 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:59.111+0000 7f36dbe00640 1 -- 172.21.15.72:0/79486011 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f36dc15c6b0 msgr2=0x7f36dc14f220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:59.112 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:59.111+0000 7f36dbe00640 1 --2- 172.21.15.72:0/79486011 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f36dc15c6b0 0x7f36dc14f220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:59.112 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:59.111+0000 7f36dbe00640 1 -- 172.21.15.72:0/79486011 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f36dc15c2d0 msgr2=0x7f36dc09c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:59.113 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:59.111+0000 7f36dbe00640 1 --2- 172.21.15.72:0/79486011 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f36dc15c2d0 0x7f36dc09c440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:59.113 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:59.111+0000 7f36dbe00640 1 -- 172.21.15.72:0/79486011 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36dc09b3a0 con 0x7f36dc0ccb20 2024-04-04T16:33:59.113 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:59.111+0000 7f36dbe00640 1 --2- 172.21.15.72:0/79486011 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f36dc0ccb20 0x7f36dc14b4f0 secure :-1 s=READY pgs=2217 cs=0 l=1 rev1=1 crypto rx=0x7f36cc0097a0 tx=0x7f36cc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T16:33:59.113 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:59.112+0000 7f36d3e00640 1 -- 172.21.15.72:0/79486011 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36cc004230 con 0x7f36dc0ccb20 2024-04-04T16:33:59.113 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:59.112+0000 7f36d3e00640 1 -- 172.21.15.72:0/79486011 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36cc0043d0 con 0x7f36dc0ccb20 2024-04-04T16:33:59.113 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:59.112+0000 7f36d3e00640 1 -- 172.21.15.72:0/79486011 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36cc003850 con 0x7f36dc0ccb20 2024-04-04T16:33:59.113 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:59.112+0000 7f36e3200640 1 -- 172.21.15.72:0/79486011 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36dc09b680 con 0x7f36dc0ccb20 2024-04-04T16:33:59.114 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:59.112+0000 7f36e3200640 1 -- 172.21.15.72:0/79486011 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36dc09bc40 con 0x7f36dc0ccb20 2024-04-04T16:33:59.115 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:59.113+0000 7f36e3200640 1 -- 172.21.15.72:0/79486011 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f36dc075840 con 0x7f36dc0ccb20 2024-04-04T16:33:59.115 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:59.114+0000 7f36d3e00640 1 -- 172.21.15.72:0/79486011 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f36cc0039f0 con 0x7f36dc0ccb20 2024-04-04T16:33:59.115 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:59.115+0000 7f36d3e00640 1 --2- 172.21.15.72:0/79486011 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f36bc06c920 0x7f36bc06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:59.115 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:59.115+0000 7f36d3e00640 1 -- 172.21.15.72:0/79486011 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 4943+0+0 (secure 0 0 0) 0x7f36cc02f030 con 0x7f36dc0ccb20 2024-04-04T16:33:59.115 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:59.115+0000 7f36db400640 1 --2- 172.21.15.72:0/79486011 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f36bc06c920 0x7f36bc06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:59.115 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:59.116+0000 7f36db400640 1 --2- 172.21.15.72:0/79486011 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f36bc06c920 0x7f36bc06ede0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f36dc15b120 tx=0x7f36c8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T16:33:59.116 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:59.119+0000 7f36d3e00640 1 -- 172.21.15.72:0/79486011 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f36cc041070 con 0x7f36dc0ccb20 2024-04-04T16:33:59.302 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:59.304+0000 7f36e3200640 1 -- 172.21.15.72:0/79486011 --> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7f36dc0cd370 con 0x7f36bc06c920 2024-04-04T16:33:59.302 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:59.304+0000 7f36d3e00640 1 -- 172.21.15.72:0/79486011 <== mgr.4101 v2:172.21.15.72:6832/2205173820 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f36dc0cd370 con 0x7f36bc06c920 2024-04-04T16:33:59.302 INFO:teuthology.orchestra.run.smithi072.stderr:instructed osd(s) 7 to deep-scrub 2024-04-04T16:33:59.305 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:59.307+0000 7f36e3200640 1 -- 172.21.15.72:0/79486011 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f36bc06c920 msgr2=0x7f36bc06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:59.305 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:59.307+0000 7f36e3200640 1 --2- 172.21.15.72:0/79486011 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f36bc06c920 0x7f36bc06ede0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f36dc15b120 tx=0x7f36c8009040 comp rx=0 tx=0).stop 2024-04-04T16:33:59.306 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:59.307+0000 7f36e3200640 1 -- 172.21.15.72:0/79486011 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f36dc0ccb20 msgr2=0x7f36dc14b4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:59.306 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:59.307+0000 7f36e3200640 1 --2- 172.21.15.72:0/79486011 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f36dc0ccb20 0x7f36dc14b4f0 secure :-1 s=READY pgs=2217 cs=0 l=1 rev1=1 crypto rx=0x7f36cc0097a0 tx=0x7f36cc0046c0 comp rx=0 tx=0).stop 2024-04-04T16:33:59.306 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:59.307+0000 7f36e3200640 1 -- 172.21.15.72:0/79486011 shutdown_connections 2024-04-04T16:33:59.306 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:59.307+0000 7f36e3200640 1 --2- 172.21.15.72:0/79486011 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f36bc06c920 0x7f36bc06ede0 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:59.306 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:59.307+0000 7f36e3200640 1 --2- 172.21.15.72:0/79486011 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f36dc15c6b0 0x7f36dc14f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:59.306 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:59.307+0000 7f36e3200640 1 --2- 172.21.15.72:0/79486011 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f36dc15c2d0 0x7f36dc09c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:59.306 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:59.307+0000 7f36e3200640 1 --2- 172.21.15.72:0/79486011 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f36dc0ccb20 0x7f36dc14b4f0 unknown :-1 s=CLOSED pgs=2217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:59.306 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:59.307+0000 7f36e3200640 1 -- 172.21.15.72:0/79486011 >> 172.21.15.72:0/79486011 conn(0x7f36dc06b470 msgr2=0x7f36dc06e000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T16:33:59.307 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:59.307+0000 7f36e3200640 1 -- 172.21.15.72:0/79486011 shutdown_connections 2024-04-04T16:33:59.307 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:59.307+0000 7f36e3200640 1 -- 172.21.15.72:0/79486011 wait complete. 2024-04-04T16:33:59.322 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-04T16:33:59.506 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:59.508+0000 7f30a7800640 1 Processor -- start 2024-04-04T16:33:59.506 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:59.508+0000 7f30a7800640 1 -- start start 2024-04-04T16:33:59.507 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:59.509+0000 7f30a7800640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f30a0158390 0x7f30a00c6840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:59.507 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:59.509+0000 7f30a7800640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f30a00b4e40 0x7f30a00b3a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:59.507 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:59.509+0000 7f30a7800640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30a015e590 con 0x7f30a0158770 2024-04-04T16:33:59.508 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:59.509+0000 7f30a7800640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f30a00b3fd0 con 0x7f30a00b4e40 2024-04-04T16:33:59.508 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:59.509+0000 7f30a7800640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f30a00c6e90 con 0x7f30a0158390 2024-04-04T16:33:59.508 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:59.509+0000 7f30a5800640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f30a00b4e40 0x7f30a00b3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:59.508 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:59.509+0000 7f30a5800640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f30a00b4e40 0x7f30a00b3a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40152/0 (socket says 172.21.15.72:40152) 2024-04-04T16:33:59.508 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:59.509+0000 7f30a5800640 1 -- 172.21.15.72:0/2466051512 learned_addr learned my addr 172.21.15.72:0/2466051512 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T16:33:59.508 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:59.509+0000 7f30a4e00640 1 --2- 172.21.15.72:0/2466051512 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f30a0158390 0x7f30a00c6840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:59.508 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:59.510+0000 7f30a5800640 1 -- 172.21.15.72:0/2466051512 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f30a0158390 msgr2=0x7f30a00c6840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T16:33:59.508 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:59.510+0000 7f30a5800640 1 --2- 172.21.15.72:0/2466051512 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f30a0158390 0x7f30a00c6840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:59.509 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:59.510+0000 7f30a5800640 1 -- 172.21.15.72:0/2466051512 >> v1:172.21.15.117:6789/0 conn(0x7f30a0158770 legacy=0x7f30a00b4730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:59.509 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:59.510+0000 7f30a5800640 1 -- 172.21.15.72:0/2466051512 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30a015e830 con 0x7f30a00b4e40 2024-04-04T16:33:59.509 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:59.510+0000 7f30a4e00640 1 --2- 172.21.15.72:0/2466051512 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f30a0158390 0x7f30a00c6840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-04T16:33:59.510 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:59.511+0000 7f30a5800640 1 --2- 172.21.15.72:0/2466051512 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f30a00b4e40 0x7f30a00b3a90 secure :-1 s=READY pgs=2218 cs=0 l=1 rev1=1 crypto rx=0x7f3098009e50 tx=0x7f309802bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8cead64ae7c9f8c server_cookie=0 in_seq=0 out_seq=0 2024-04-04T16:33:59.510 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:59.511+0000 7f309fe00640 1 -- 172.21.15.72:0/2466051512 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f309802cb00 con 0x7f30a00b4e40 2024-04-04T16:33:59.510 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:59.511+0000 7f309fe00640 1 -- 172.21.15.72:0/2466051512 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f309802cca0 con 0x7f30a00b4e40 2024-04-04T16:33:59.510 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:59.511+0000 7f309fe00640 1 -- 172.21.15.72:0/2466051512 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3098034610 con 0x7f30a00b4e40 2024-04-04T16:33:59.510 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:59.512+0000 7f30a7800640 1 -- 172.21.15.72:0/2466051512 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f30a00b4e40 msgr2=0x7f30a00b3a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:59.511 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:59.512+0000 7f30a7800640 1 --2- 172.21.15.72:0/2466051512 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f30a00b4e40 0x7f30a00b3a90 secure :-1 s=READY pgs=2218 cs=0 l=1 rev1=1 crypto rx=0x7f3098009e50 tx=0x7f309802bf60 comp rx=0 tx=0).stop 2024-04-04T16:33:59.511 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:59.512+0000 7f30a7800640 1 -- 172.21.15.72:0/2466051512 shutdown_connections 2024-04-04T16:33:59.511 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:59.512+0000 7f30a7800640 1 --2- 172.21.15.72:0/2466051512 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f30a00b4e40 0x7f30a00b3a90 unknown :-1 s=CLOSED pgs=2218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:59.511 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:59.512+0000 7f30a7800640 1 --2- 172.21.15.72:0/2466051512 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f30a0158390 0x7f30a00c6840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:59.511 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:59.512+0000 7f30a7800640 1 -- 172.21.15.72:0/2466051512 >> 172.21.15.72:0/2466051512 conn(0x7f30a006b470 msgr2=0x7f30a006b880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T16:33:59.511 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:59.512+0000 7f30a7800640 1 -- 172.21.15.72:0/2466051512 shutdown_connections 2024-04-04T16:33:59.511 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:59.512+0000 7f30a7800640 1 -- 172.21.15.72:0/2466051512 wait complete. 2024-04-04T16:33:59.513 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:59.513+0000 7f30a7800640 1 Processor -- start 2024-04-04T16:33:59.514 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:59.514+0000 7f30a7800640 1 -- start start 2024-04-04T16:33:59.514 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:59.514+0000 7f30a7800640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f30a00b4e40 0x7f30a01679f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:59.514 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:59.514+0000 7f30a7800640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f30a0158390 0x7f30a00afbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:59.514 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:59.515+0000 7f30a7800640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f30a0158770 0x7f30a00cb3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:59.514 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:59.515+0000 7f30a7800640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f30a015f310 con 0x7f30a0158390 2024-04-04T16:33:59.514 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:59.515+0000 7f30a7800640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f30a015edf0 con 0x7f30a0158770 2024-04-04T16:33:59.514 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:59.515+0000 7f30a7800640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f30a015f490 con 0x7f30a00b4e40 2024-04-04T16:33:59.514 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:59.515+0000 7f3097e00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f30a0158390 0x7f30a00afbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:59.515 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:59.515+0000 7f3097e00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f30a0158390 0x7f30a00afbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40166/0 (socket says 172.21.15.72:40166) 2024-04-04T16:33:59.515 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:59.515+0000 7f3097e00640 1 -- 172.21.15.72:0/641686152 learned_addr learned my addr 172.21.15.72:0/641686152 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T16:33:59.515 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:59.515+0000 7f30a4e00640 1 --2- 172.21.15.72:0/641686152 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f30a00b4e40 0x7f30a01679f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:59.515 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:59.515+0000 7f30a5800640 1 --2- 172.21.15.72:0/641686152 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f30a0158770 0x7f30a00cb3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:59.515 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:59.515+0000 7f3097e00640 1 -- 172.21.15.72:0/641686152 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f30a00b4e40 msgr2=0x7f30a01679f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:59.515 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:59.515+0000 7f3097e00640 1 --2- 172.21.15.72:0/641686152 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f30a00b4e40 0x7f30a01679f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:59.515 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:59.515+0000 7f3097e00640 1 -- 172.21.15.72:0/641686152 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f30a0158770 msgr2=0x7f30a00cb3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:59.515 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:59.515+0000 7f3097e00640 1 --2- 172.21.15.72:0/641686152 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f30a0158770 0x7f30a00cb3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:59.515 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:59.515+0000 7f3097e00640 1 -- 172.21.15.72:0/641686152 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30a01f8760 con 0x7f30a0158390 2024-04-04T16:33:59.516 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:59.516+0000 7f3097e00640 1 --2- 172.21.15.72:0/641686152 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f30a0158390 0x7f30a00afbb0 secure :-1 s=READY pgs=2219 cs=0 l=1 rev1=1 crypto rx=0x7f308800c470 tx=0x7f3088001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T16:33:59.516 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:59.516+0000 7f309d600640 1 -- 172.21.15.72:0/641686152 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30880052d0 con 0x7f30a0158390 2024-04-04T16:33:59.516 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:59.516+0000 7f309d600640 1 -- 172.21.15.72:0/641686152 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3088005470 con 0x7f30a0158390 2024-04-04T16:33:59.516 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:59.516+0000 7f30a7800640 1 -- 172.21.15.72:0/641686152 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30a01f4fa0 con 0x7f30a0158390 2024-04-04T16:33:59.516 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:59.516+0000 7f309d600640 1 -- 172.21.15.72:0/641686152 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3088007260 con 0x7f30a0158390 2024-04-04T16:33:59.516 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:59.516+0000 7f30a7800640 1 -- 172.21.15.72:0/641686152 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30a00adb50 con 0x7f30a0158390 2024-04-04T16:33:59.517 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:59.517+0000 7f30a7800640 1 -- 172.21.15.72:0/641686152 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30a00af540 con 0x7f30a0158390 2024-04-04T16:33:59.517 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:59.518+0000 7f309d600640 1 -- 172.21.15.72:0/641686152 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3088007400 con 0x7f30a0158390 2024-04-04T16:33:59.517 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:59.519+0000 7f309d600640 1 --2- 172.21.15.72:0/641686152 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f307c06c8f0 0x7f307c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:33:59.517 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:59.519+0000 7f309d600640 1 -- 172.21.15.72:0/641686152 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 4943+0+0 (secure 0 0 0) 0x7f308808ad00 con 0x7f30a0158390 2024-04-04T16:33:59.518 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:59.519+0000 7f30a4e00640 1 --2- 172.21.15.72:0/641686152 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f307c06c8f0 0x7f307c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:33:59.518 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:59.520+0000 7f30a4e00640 1 --2- 172.21.15.72:0/641686152 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f307c06c8f0 0x7f307c06edb0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f3090006fd0 tx=0x7f3090008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T16:33:59.521 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:59.523+0000 7f309d600640 1 -- 172.21.15.72:0/641686152 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f30a00af540 con 0x7f30a0158390 2024-04-04T16:33:59.717 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:59.719+0000 7f30a7800640 1 -- 172.21.15.72:0/641686152 --> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f30a0075840 con 0x7f307c06c8f0 2024-04-04T16:33:59.719 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:59.721+0000 7f309d600640 1 -- 172.21.15.72:0/641686152 <== mgr.4101 v2:172.21.15.72:6832/2205173820 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13494 (secure 0 0 0) 0x7f30a0075840 con 0x7f307c06c8f0 2024-04-04T16:33:59.720 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T16:33:59.720 INFO:teuthology.orchestra.run.smithi072.stderr:dumped all 2024-04-04T16:33:59.722 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:59.724+0000 7f30a7800640 1 -- 172.21.15.72:0/641686152 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f307c06c8f0 msgr2=0x7f307c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:59.723 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:59.724+0000 7f30a7800640 1 --2- 172.21.15.72:0/641686152 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f307c06c8f0 0x7f307c06edb0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f3090006fd0 tx=0x7f3090008040 comp rx=0 tx=0).stop 2024-04-04T16:33:59.723 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:59.724+0000 7f30a7800640 1 -- 172.21.15.72:0/641686152 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f30a0158390 msgr2=0x7f30a00afbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:33:59.723 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:59.724+0000 7f30a7800640 1 --2- 172.21.15.72:0/641686152 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f30a0158390 0x7f30a00afbb0 secure :-1 s=READY pgs=2219 cs=0 l=1 rev1=1 crypto rx=0x7f308800c470 tx=0x7f3088001e70 comp rx=0 tx=0).stop 2024-04-04T16:33:59.723 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:59.724+0000 7f30a7800640 1 -- 172.21.15.72:0/641686152 shutdown_connections 2024-04-04T16:33:59.723 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:59.724+0000 7f30a7800640 1 --2- 172.21.15.72:0/641686152 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f307c06c8f0 0x7f307c06edb0 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:59.723 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:59.724+0000 7f30a7800640 1 --2- 172.21.15.72:0/641686152 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f30a0158770 0x7f30a00cb3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:59.723 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:59.724+0000 7f30a7800640 1 --2- 172.21.15.72:0/641686152 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f30a0158390 0x7f30a00afbb0 unknown :-1 s=CLOSED pgs=2219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:59.724 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:59.724+0000 7f30a7800640 1 --2- 172.21.15.72:0/641686152 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f30a00b4e40 0x7f30a01679f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:33:59.724 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:59.724+0000 7f30a7800640 1 -- 172.21.15.72:0/641686152 >> 172.21.15.72:0/641686152 conn(0x7f30a006b470 msgr2=0x7f30a00b1d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T16:33:59.724 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:59.725+0000 7f30a7800640 1 -- 172.21.15.72:0/641686152 shutdown_connections 2024-04-04T16:33:59.724 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:33:59.725+0000 7f30a7800640 1 -- 172.21.15.72:0/641686152 wait complete. 2024-04-04T16:33:59.740 INFO:teuthology.orchestra.run.smithi072.stdout:{"pg_ready":true,"pg_map":{"version":17353,"stamp":"2024-04-04T16:33:59.111499+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":11965524,"kb_used_data":4424,"kb_used_omap":3345,"kb_used_meta":11957678,"kb_avail":743009196,"statfs":{"total":773094113280,"available":760841416704,"internally_reserved":0,"allocated":4530176,"data_stored":2494792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3426126,"internal_metadata":12244662450},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":312,"apply_latency_ms":312,"commit_latency_ns":312000000,"apply_latency_ns":312000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003011"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":489,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-04T16:33:46.576255+0000","last_change":"2024-04-04T06:56:19.364611+0000","last_active":"2024-04-04T16:33:46.576255+0000","last_peered":"2024-04-04T16:33:46.576255+0000","last_clean":"2024-04-04T16:33:46.576255+0000","last_became_active":"2024-04-04T06:56:19.362232+0000","last_became_peered":"2024-04-04T06:56:19.362232+0000","last_unstale":"2024-04-04T16:33:46.576255+0000","last_undegraded":"2024-04-04T16:33:46.576255+0000","last_fullsized":"2024-04-04T16:33:46.576255+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-04T06:56:17.744258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-04T06:56:17.744258+0000","last_clean_scrub_stamp":"2024-04-04T06:56:17.744258+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T17:25:16.494215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834581783,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1733604,"kb_used_data":988,"kb_used_omap":25,"kb_used_meta":1732582,"kb_avail":92638236,"statfs":{"total":96636764160,"available":94861553664,"internally_reserved":0,"allocated":1011712,"data_stored":754625,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":26454,"internal_metadata":1774164138},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834581783,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1417892,"kb_used_data":408,"kb_used_omap":568,"kb_used_meta":1416903,"kb_avail":92953948,"statfs":{"total":96636764160,"available":95184842752,"internally_reserved":0,"allocated":417792,"data_stored":164257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":581652,"internal_metadata":1450909676},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834581781,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1669600,"kb_used_data":408,"kb_used_omap":393,"kb_used_meta":1668790,"kb_avail":92702240,"statfs":{"total":96636764160,"available":94927093760,"internally_reserved":0,"allocated":417792,"data_stored":164257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":403353,"internal_metadata":1708841063},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834581781,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1707364,"kb_used_data":408,"kb_used_omap":496,"kb_used_meta":1706447,"kb_avail":92664476,"statfs":{"total":96636764160,"available":94888423424,"internally_reserved":0,"allocated":417792,"data_stored":164257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":508871,"internal_metadata":1747401785},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":261,"apply_latency_ms":261,"commit_latency_ns":261000000,"apply_latency_ns":261000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834581744,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1712992,"kb_used_data":408,"kb_used_omap":141,"kb_used_meta":1712434,"kb_avail":92658848,"statfs":{"total":96636764160,"available":94882660352,"internally_reserved":0,"allocated":417792,"data_stored":164257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":145232,"internal_metadata":1753532592},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834581764,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1202272,"kb_used_data":408,"kb_used_omap":450,"kb_used_meta":1201405,"kb_avail":93169568,"statfs":{"total":96636764160,"available":95405637632,"internally_reserved":0,"allocated":417792,"data_stored":164257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":461359,"internal_metadata":1230239185},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834581752,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1683872,"kb_used_data":408,"kb_used_omap":803,"kb_used_meta":1682652,"kb_avail":92687968,"statfs":{"total":96636764160,"available":94912479232,"internally_reserved":0,"allocated":417792,"data_stored":164257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":823151,"internal_metadata":1723035793},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":51,"apply_latency_ms":51,"commit_latency_ns":51000000,"apply_latency_ns":51000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834581774,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":837928,"kb_used_data":988,"kb_used_omap":464,"kb_used_meta":836463,"kb_avail":93533912,"statfs":{"total":96636764160,"available":95778725888,"internally_reserved":0,"allocated":1011712,"data_stored":754625,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":476054,"internal_metadata":856538218},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-04T16:33:59.743 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-04T06:56:17.744258+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=4, tm_hour=6, tm_min=56, tm_sec=17, tm_wday=3, tm_yday=95, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=4, tm_hour=16, tm_min=33, tm_sec=52, tm_wday=3, tm_yday=95, tm_isdst=0) 2024-04-04T16:33:59.743 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-04T16:34:19.744 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-04T16:34:19.952 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:19.954+0000 7f5a20a00640 1 Processor -- start 2024-04-04T16:34:19.953 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:19.955+0000 7f5a20a00640 1 -- start start 2024-04-04T16:34:19.954 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:19.956+0000 7f5a20a00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f5a1c15c2d0 0x7f5a1c071610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:34:19.954 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:19.956+0000 7f5a20a00640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f5a1c0ccb20 0x7f5a1c0ccf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:34:19.954 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:19.956+0000 7f5a20a00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a1c0c6710 con 0x7f5a1c15c6b0 2024-04-04T16:34:19.954 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:19.956+0000 7f5a20a00640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f5a1c0c6fb0 con 0x7f5a1c0ccb20 2024-04-04T16:34:19.955 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:19.956+0000 7f5a20a00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f5a1c0cd4a0 con 0x7f5a1c15c2d0 2024-04-04T16:34:19.955 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:19.956+0000 7f5a1a800640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f5a1c0ccb20 0x7f5a1c0ccf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:34:19.955 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:19.956+0000 7f5a1a800640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f5a1c0ccb20 0x7f5a1c0ccf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:59412/0 (socket says 172.21.15.72:59412) 2024-04-04T16:34:19.955 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:19.956+0000 7f5a1a800640 1 -- 172.21.15.72:0/1254128188 learned_addr learned my addr 172.21.15.72:0/1254128188 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T16:34:19.955 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:19.956+0000 7f5a19e00640 1 --2- 172.21.15.72:0/1254128188 >> v2:172.21.15.117:3300/0 conn(0x7f5a1c15c2d0 0x7f5a1c071610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:34:19.956 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:19.957+0000 7f5a1a800640 1 -- 172.21.15.72:0/1254128188 >> v2:172.21.15.117:3300/0 conn(0x7f5a1c15c2d0 msgr2=0x7f5a1c071610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T16:34:19.956 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:19.957+0000 7f5a1a800640 1 --2- 172.21.15.72:0/1254128188 >> v2:172.21.15.117:3300/0 conn(0x7f5a1c15c2d0 0x7f5a1c071610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:34:19.956 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:19.957+0000 7f5a1a800640 1 -- 172.21.15.72:0/1254128188 >> v1:172.21.15.117:6789/0 conn(0x7f5a1c15c6b0 legacy=0x7f5a1c0c5e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T16:34:19.956 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:19.957+0000 7f5a1a800640 1 -- 172.21.15.72:0/1254128188 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a1c0c69f0 con 0x7f5a1c0ccb20 2024-04-04T16:34:19.957 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:19.958+0000 7f5a1a800640 1 --2- 172.21.15.72:0/1254128188 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5a1c0ccb20 0x7f5a1c0ccf60 secure :-1 s=READY pgs=2220 cs=0 l=1 rev1=1 crypto rx=0x7f5a1c06c210 tx=0x7f5a1402bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd5edd6ac8bd97f6 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T16:34:19.957 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:19.959+0000 7f5a18a00640 1 -- 172.21.15.72:0/1254128188 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a1402ca80 con 0x7f5a1c0ccb20 2024-04-04T16:34:19.957 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:19.959+0000 7f5a18a00640 1 -- 172.21.15.72:0/1254128188 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a1402cc20 con 0x7f5a1c0ccb20 2024-04-04T16:34:19.958 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:19.959+0000 7f5a18a00640 1 -- 172.21.15.72:0/1254128188 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a140343f0 con 0x7f5a1c0ccb20 2024-04-04T16:34:19.958 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:19.959+0000 7f5a20a00640 1 -- 172.21.15.72:0/1254128188 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5a1c0ccb20 msgr2=0x7f5a1c0ccf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:34:19.958 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:19.959+0000 7f5a20a00640 1 --2- 172.21.15.72:0/1254128188 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5a1c0ccb20 0x7f5a1c0ccf60 secure :-1 s=READY pgs=2220 cs=0 l=1 rev1=1 crypto rx=0x7f5a1c06c210 tx=0x7f5a1402bee0 comp rx=0 tx=0).stop 2024-04-04T16:34:19.958 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:19.959+0000 7f5a20a00640 1 -- 172.21.15.72:0/1254128188 shutdown_connections 2024-04-04T16:34:19.958 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:19.959+0000 7f5a20a00640 1 --2- 172.21.15.72:0/1254128188 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5a1c0ccb20 0x7f5a1c0ccf60 unknown :-1 s=CLOSED pgs=2220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:34:19.958 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:19.959+0000 7f5a20a00640 1 --2- 172.21.15.72:0/1254128188 >> v2:172.21.15.117:3300/0 conn(0x7f5a1c15c2d0 0x7f5a1c071610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:34:19.958 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:19.959+0000 7f5a20a00640 1 -- 172.21.15.72:0/1254128188 >> 172.21.15.72:0/1254128188 conn(0x7f5a1c06b470 msgr2=0x7f5a1c06b880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T16:34:19.958 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:19.959+0000 7f5a20a00640 1 -- 172.21.15.72:0/1254128188 shutdown_connections 2024-04-04T16:34:19.958 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:19.959+0000 7f5a20a00640 1 -- 172.21.15.72:0/1254128188 wait complete. 2024-04-04T16:34:19.959 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:19.961+0000 7f5a20a00640 1 Processor -- start 2024-04-04T16:34:19.959 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:19.961+0000 7f5a20a00640 1 -- start start 2024-04-04T16:34:19.961 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:19.962+0000 7f5a20a00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5a1c0ccb20 0x7f5a1c151200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:34:19.961 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:19.962+0000 7f5a20a00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5a1c15c2d0 0x7f5a1c0c88c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:34:19.961 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:19.962+0000 7f5a20a00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5a1c15c6b0 0x7f5a1c15eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:34:19.961 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:19.962+0000 7f5a20a00640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f5a1c0b3ea0 con 0x7f5a1c0ccb20 2024-04-04T16:34:19.962 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:19.962+0000 7f5a20a00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f5a1c15cb30 con 0x7f5a1c15c2d0 2024-04-04T16:34:19.962 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:19.962+0000 7f5a20a00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f5a1c0b4020 con 0x7f5a1c15c6b0 2024-04-04T16:34:19.962 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:19.962+0000 7f5a19e00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5a1c0ccb20 0x7f5a1c151200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:34:19.962 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:19.962+0000 7f5a19e00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5a1c0ccb20 0x7f5a1c151200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:59420/0 (socket says 172.21.15.72:59420) 2024-04-04T16:34:19.962 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:19.962+0000 7f5a19e00640 1 -- 172.21.15.72:0/2268607227 learned_addr learned my addr 172.21.15.72:0/2268607227 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T16:34:19.962 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:19.962+0000 7f5a19400640 1 --2- 172.21.15.72:0/2268607227 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5a1c15c2d0 0x7f5a1c0c88c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:34:19.962 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:19.963+0000 7f5a1a800640 1 --2- 172.21.15.72:0/2268607227 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5a1c15c6b0 0x7f5a1c15eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:34:19.962 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:19.963+0000 7f5a19e00640 1 -- 172.21.15.72:0/2268607227 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5a1c15c6b0 msgr2=0x7f5a1c15eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:34:19.963 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:19.963+0000 7f5a19e00640 1 --2- 172.21.15.72:0/2268607227 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5a1c15c6b0 0x7f5a1c15eaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:34:19.963 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:19.963+0000 7f5a19e00640 1 -- 172.21.15.72:0/2268607227 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5a1c15c2d0 msgr2=0x7f5a1c0c88c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:34:19.963 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:19.963+0000 7f5a19e00640 1 --2- 172.21.15.72:0/2268607227 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5a1c15c2d0 0x7f5a1c0c88c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:34:19.963 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:19.963+0000 7f5a19e00640 1 -- 172.21.15.72:0/2268607227 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a1c0ad060 con 0x7f5a1c0ccb20 2024-04-04T16:34:19.963 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:19.963+0000 7f5a1a800640 1 --2- 172.21.15.72:0/2268607227 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5a1c15c6b0 0x7f5a1c15eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-04T16:34:19.963 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:19.963+0000 7f5a19400640 1 --2- 172.21.15.72:0/2268607227 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5a1c15c2d0 0x7f5a1c0c88c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-04T16:34:19.963 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:19.963+0000 7f5a19e00640 1 --2- 172.21.15.72:0/2268607227 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5a1c0ccb20 0x7f5a1c151200 secure :-1 s=READY pgs=2221 cs=0 l=1 rev1=1 crypto rx=0x7f5a0c00d800 tx=0x7f5a0c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T16:34:19.963 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:19.963+0000 7f5a12000640 1 -- 172.21.15.72:0/2268607227 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a0c00b6c0 con 0x7f5a1c0ccb20 2024-04-04T16:34:19.963 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:19.963+0000 7f5a12000640 1 -- 172.21.15.72:0/2268607227 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a0c019070 con 0x7f5a1c0ccb20 2024-04-04T16:34:19.964 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:19.963+0000 7f5a20a00640 1 -- 172.21.15.72:0/2268607227 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a1c0af170 con 0x7f5a1c0ccb20 2024-04-04T16:34:19.964 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:19.963+0000 7f5a12000640 1 -- 172.21.15.72:0/2268607227 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a0c00ba80 con 0x7f5a1c0ccb20 2024-04-04T16:34:19.964 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:19.964+0000 7f5a20a00640 1 -- 172.21.15.72:0/2268607227 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a1c15ac40 con 0x7f5a1c0ccb20 2024-04-04T16:34:19.965 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:19.965+0000 7f5a20a00640 1 -- 172.21.15.72:0/2268607227 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a1c075840 con 0x7f5a1c0ccb20 2024-04-04T16:34:19.965 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:19.966+0000 7f5a12000640 1 -- 172.21.15.72:0/2268607227 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5a0c00bc20 con 0x7f5a1c0ccb20 2024-04-04T16:34:19.965 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:19.966+0000 7f5a12000640 1 --2- 172.21.15.72:0/2268607227 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f59fc06c8f0 0x7f59fc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:34:19.965 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:19.967+0000 7f5a12000640 1 -- 172.21.15.72:0/2268607227 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 4943+0+0 (secure 0 0 0) 0x7f5a0c08bde0 con 0x7f5a1c0ccb20 2024-04-04T16:34:19.965 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:19.967+0000 7f5a19400640 1 --2- 172.21.15.72:0/2268607227 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f59fc06c8f0 0x7f59fc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:34:19.966 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:19.967+0000 7f5a19400640 1 --2- 172.21.15.72:0/2268607227 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f59fc06c8f0 0x7f59fc06edb0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f5a1c15f780 tx=0x7f5a08009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T16:34:19.971 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:19.974+0000 7f5a12000640 1 -- 172.21.15.72:0/2268607227 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f5a0c01c360 con 0x7f5a1c0ccb20 2024-04-04T16:34:20.165 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:20.167+0000 7f5a20a00640 1 -- 172.21.15.72:0/2268607227 --> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f5a1c0ce760 con 0x7f59fc06c8f0 2024-04-04T16:34:20.166 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:20.168+0000 7f5a12000640 1 -- 172.21.15.72:0/2268607227 <== mgr.4101 v2:172.21.15.72:6832/2205173820 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13446 (secure 0 0 0) 0x7f5a1c0ce760 con 0x7f59fc06c8f0 2024-04-04T16:34:20.167 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T16:34:20.167 INFO:teuthology.orchestra.run.smithi072.stderr:dumped all 2024-04-04T16:34:20.169 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:20.171+0000 7f5a20a00640 1 -- 172.21.15.72:0/2268607227 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f59fc06c8f0 msgr2=0x7f59fc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:34:20.169 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:20.171+0000 7f5a20a00640 1 --2- 172.21.15.72:0/2268607227 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f59fc06c8f0 0x7f59fc06edb0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f5a1c15f780 tx=0x7f5a08009040 comp rx=0 tx=0).stop 2024-04-04T16:34:20.169 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:20.171+0000 7f5a20a00640 1 -- 172.21.15.72:0/2268607227 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5a1c0ccb20 msgr2=0x7f5a1c151200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:34:20.169 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:20.171+0000 7f5a20a00640 1 --2- 172.21.15.72:0/2268607227 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5a1c0ccb20 0x7f5a1c151200 secure :-1 s=READY pgs=2221 cs=0 l=1 rev1=1 crypto rx=0x7f5a0c00d800 tx=0x7f5a0c00dcc0 comp rx=0 tx=0).stop 2024-04-04T16:34:20.169 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:20.171+0000 7f5a20a00640 1 -- 172.21.15.72:0/2268607227 shutdown_connections 2024-04-04T16:34:20.169 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:20.171+0000 7f5a20a00640 1 --2- 172.21.15.72:0/2268607227 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f59fc06c8f0 0x7f59fc06edb0 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:34:20.170 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:20.171+0000 7f5a20a00640 1 --2- 172.21.15.72:0/2268607227 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5a1c15c6b0 0x7f5a1c15eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:34:20.170 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:20.171+0000 7f5a20a00640 1 --2- 172.21.15.72:0/2268607227 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5a1c15c2d0 0x7f5a1c0c88c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:34:20.170 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:20.171+0000 7f5a20a00640 1 --2- 172.21.15.72:0/2268607227 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5a1c0ccb20 0x7f5a1c151200 unknown :-1 s=CLOSED pgs=2221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:34:20.170 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:20.171+0000 7f5a20a00640 1 -- 172.21.15.72:0/2268607227 >> 172.21.15.72:0/2268607227 conn(0x7f5a1c06b470 msgr2=0x7f5a1c06ed00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T16:34:20.170 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:20.171+0000 7f5a20a00640 1 -- 172.21.15.72:0/2268607227 shutdown_connections 2024-04-04T16:34:20.170 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:20.171+0000 7f5a20a00640 1 -- 172.21.15.72:0/2268607227 wait complete. 2024-04-04T16:34:20.188 INFO:teuthology.orchestra.run.smithi072.stdout:{"pg_ready":true,"pg_map":{"version":17363,"stamp":"2024-04-04T16:34:19.116603+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":11965520,"kb_used_data":4424,"kb_used_omap":3345,"kb_used_meta":11957678,"kb_avail":743009200,"statfs":{"total":773094113280,"available":760841420800,"internally_reserved":0,"allocated":4530176,"data_stored":2494792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3426126,"internal_metadata":12244662450},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003078"},"pg_stats":[{"pgid":"1.0","version":"36'119","reported_seq":501,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-04T16:34:00.024776+0000","last_change":"2024-04-04T16:34:00.024776+0000","last_active":"2024-04-04T16:34:00.024776+0000","last_peered":"2024-04-04T16:34:00.024776+0000","last_clean":"2024-04-04T16:34:00.024776+0000","last_became_active":"2024-04-04T06:56:19.362232+0000","last_became_peered":"2024-04-04T06:56:19.362232+0000","last_unstale":"2024-04-04T16:34:00.024776+0000","last_undegraded":"2024-04-04T16:34:00.024776+0000","last_fullsized":"2024-04-04T16:34:00.024776+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'119","last_scrub_stamp":"2024-04-04T16:34:00.024631+0000","last_deep_scrub":"36'119","last_deep_scrub_stamp":"2024-04-04T16:34:00.024631+0000","last_clean_scrub_stamp":"2024-04-04T16:34:00.024631+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-05T23:08:15.079961+0000","scrub_duration":205,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834581787,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1733604,"kb_used_data":988,"kb_used_omap":25,"kb_used_meta":1732582,"kb_avail":92638236,"statfs":{"total":96636764160,"available":94861553664,"internally_reserved":0,"allocated":1011712,"data_stored":754625,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":26454,"internal_metadata":1774164138},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834581787,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1417892,"kb_used_data":408,"kb_used_omap":568,"kb_used_meta":1416903,"kb_avail":92953948,"statfs":{"total":96636764160,"available":95184842752,"internally_reserved":0,"allocated":417792,"data_stored":164257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":581652,"internal_metadata":1450909676},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834581785,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1669600,"kb_used_data":408,"kb_used_omap":393,"kb_used_meta":1668790,"kb_avail":92702240,"statfs":{"total":96636764160,"available":94927093760,"internally_reserved":0,"allocated":417792,"data_stored":164257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":403353,"internal_metadata":1708841063},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834581785,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1707364,"kb_used_data":408,"kb_used_omap":496,"kb_used_meta":1706447,"kb_avail":92664476,"statfs":{"total":96636764160,"available":94888423424,"internally_reserved":0,"allocated":417792,"data_stored":164257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":508871,"internal_metadata":1747401785},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834581748,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1712992,"kb_used_data":408,"kb_used_omap":141,"kb_used_meta":1712434,"kb_avail":92658848,"statfs":{"total":96636764160,"available":94882660352,"internally_reserved":0,"allocated":417792,"data_stored":164257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":145232,"internal_metadata":1753532592},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834581768,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1202272,"kb_used_data":408,"kb_used_omap":450,"kb_used_meta":1201405,"kb_avail":93169568,"statfs":{"total":96636764160,"available":95405637632,"internally_reserved":0,"allocated":417792,"data_stored":164257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":461359,"internal_metadata":1230239185},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834581756,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1683872,"kb_used_data":408,"kb_used_omap":803,"kb_used_meta":1682652,"kb_avail":92687968,"statfs":{"total":96636764160,"available":94912479232,"internally_reserved":0,"allocated":417792,"data_stored":164257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":823151,"internal_metadata":1723035793},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834581778,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":837924,"kb_used_data":988,"kb_used_omap":464,"kb_used_meta":836463,"kb_avail":93533916,"statfs":{"total":96636764160,"available":95778729984,"internally_reserved":0,"allocated":1011712,"data_stored":754625,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":476054,"internal_metadata":856538218},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-04T16:34:20.190 DEBUG:teuthology.orchestra.run.smithi072:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-04-04T16:34:20.376 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:20.378+0000 7f3e28e00640 1 Processor -- start 2024-04-04T16:34:20.377 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:20.378+0000 7f3e28e00640 1 -- start start 2024-04-04T16:34:20.378 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:20.380+0000 7f3e28e00640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f3e2415afb0 0x7f3e24071e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:34:20.378 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:20.380+0000 7f3e28e00640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e2415ece0 con 0x7f3e2415b390 2024-04-04T16:34:20.378 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:20.380+0000 7f3e28e00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e2415efa0 con 0x7f3e240cf360 2024-04-04T16:34:20.378 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:20.380+0000 7f3e28e00640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f3e24072350 con 0x7f3e2415afb0 2024-04-04T16:34:20.378 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:20.380+0000 7f3e21e00640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f3e2415afb0 0x7f3e24071e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:34:20.378 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:20.380+0000 7f3e22800640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f3e2415b390 0x7f3e240cdd00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:48510/0 (socket says 172.21.15.72:48510) 2024-04-04T16:34:20.379 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:20.380+0000 7f3e22800640 1 -- 172.21.15.72:0/3409181362 learned_addr learned my addr 172.21.15.72:0/3409181362 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-04-04T16:34:20.379 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:20.381+0000 7f3e21e00640 1 -- 172.21.15.72:0/3409181362 >> v1:172.21.15.117:6789/0 conn(0x7f3e240cf360 legacy=0x7f3e240726e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:34:20.380 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:20.381+0000 7f3e21e00640 1 -- 172.21.15.72:0/3409181362 >> v1:172.21.15.72:6789/0 conn(0x7f3e2415b390 legacy=0x7f3e240cdd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:34:20.380 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:20.381+0000 7f3e21e00640 1 -- 172.21.15.72:0/3409181362 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e2415f280 con 0x7f3e2415afb0 2024-04-04T16:34:20.380 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:20.381+0000 7f3e20a00640 1 -- 172.21.15.72:0/3409181362 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3666553321 0 0) 0x7f3e2415ece0 con 0x7f3e2415b390 2024-04-04T16:34:20.380 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:20.382+0000 7f3e21e00640 1 --2- 172.21.15.72:0/3409181362 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3e2415afb0 0x7f3e24071e10 secure :-1 s=READY pgs=2223 cs=0 l=1 rev1=1 crypto rx=0x7f3e140097a0 tx=0x7f3e1402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4955971b7f121245 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T16:34:20.381 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:20.382+0000 7f3e20a00640 1 -- 172.21.15.72:0/3409181362 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e14035020 con 0x7f3e2415afb0 2024-04-04T16:34:20.381 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:20.382+0000 7f3e20a00640 1 -- 172.21.15.72:0/3409181362 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e14031830 con 0x7f3e2415afb0 2024-04-04T16:34:20.381 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:20.382+0000 7f3e20a00640 1 -- 172.21.15.72:0/3409181362 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e14031c00 con 0x7f3e2415afb0 2024-04-04T16:34:20.381 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:20.383+0000 7f3e28e00640 1 -- 172.21.15.72:0/3409181362 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3e2415afb0 msgr2=0x7f3e24071e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:34:20.381 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:20.383+0000 7f3e28e00640 1 --2- 172.21.15.72:0/3409181362 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3e2415afb0 0x7f3e24071e10 secure :-1 s=READY pgs=2223 cs=0 l=1 rev1=1 crypto rx=0x7f3e140097a0 tx=0x7f3e1402b8d0 comp rx=0 tx=0).stop 2024-04-04T16:34:20.382 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:20.383+0000 7f3e28e00640 1 -- 172.21.15.72:0/3409181362 shutdown_connections 2024-04-04T16:34:20.382 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:20.383+0000 7f3e28e00640 1 --2- 172.21.15.72:0/3409181362 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3e2415afb0 0x7f3e24071e10 unknown :-1 s=CLOSED pgs=2223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:34:20.382 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:20.383+0000 7f3e28e00640 1 -- 172.21.15.72:0/3409181362 >> 172.21.15.72:0/3409181362 conn(0x7f3e2406b470 msgr2=0x7f3e2406b850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T16:34:20.382 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:20.383+0000 7f3e28e00640 1 -- 172.21.15.72:0/3409181362 shutdown_connections 2024-04-04T16:34:20.382 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:20.383+0000 7f3e28e00640 1 -- 172.21.15.72:0/3409181362 wait complete. 2024-04-04T16:34:20.383 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:20.384+0000 7f3e28e00640 1 Processor -- start 2024-04-04T16:34:20.383 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:20.384+0000 7f3e28e00640 1 -- start start 2024-04-04T16:34:20.384 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:20.385+0000 7f3e28e00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3e240cf360 0x7f3e24158680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:34:20.384 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:20.385+0000 7f3e28e00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3e2415afb0 0x7f3e2414c960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:34:20.385 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:20.385+0000 7f3e28e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3e2415b390 0x7f3e24154910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:34:20.385 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:20.385+0000 7f3e28e00640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f3e2415fb20 con 0x7f3e240cf360 2024-04-04T16:34:20.385 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:20.385+0000 7f3e28e00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f3e2415f620 con 0x7f3e2415afb0 2024-04-04T16:34:20.385 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:20.385+0000 7f3e28e00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f3e240b2fd0 con 0x7f3e2415b390 2024-04-04T16:34:20.385 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:20.386+0000 7f3e21e00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3e240cf360 0x7f3e24158680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:34:20.385 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:20.386+0000 7f3e21e00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3e240cf360 0x7f3e24158680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:59426/0 (socket says 172.21.15.72:59426) 2024-04-04T16:34:20.385 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:20.386+0000 7f3e21e00640 1 -- 172.21.15.72:0/2597073982 learned_addr learned my addr 172.21.15.72:0/2597073982 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T16:34:20.385 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:20.386+0000 7f3e21400640 1 --2- 172.21.15.72:0/2597073982 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3e2415afb0 0x7f3e2414c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:34:20.385 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:20.386+0000 7f3e22800640 1 --2- 172.21.15.72:0/2597073982 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3e2415b390 0x7f3e24154910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:34:20.386 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:20.386+0000 7f3e21e00640 1 -- 172.21.15.72:0/2597073982 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3e2415b390 msgr2=0x7f3e24154910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:34:20.386 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:20.386+0000 7f3e21e00640 1 --2- 172.21.15.72:0/2597073982 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3e2415b390 0x7f3e24154910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:34:20.386 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:20.386+0000 7f3e21e00640 1 -- 172.21.15.72:0/2597073982 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3e2415afb0 msgr2=0x7f3e2414c960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:34:20.386 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:20.386+0000 7f3e21e00640 1 --2- 172.21.15.72:0/2597073982 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3e2415afb0 0x7f3e2414c960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:34:20.386 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:20.386+0000 7f3e21e00640 1 -- 172.21.15.72:0/2597073982 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e241575e0 con 0x7f3e240cf360 2024-04-04T16:34:20.386 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:20.386+0000 7f3e22800640 1 --2- 172.21.15.72:0/2597073982 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3e2415b390 0x7f3e24154910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-04T16:34:20.386 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:20.386+0000 7f3e21e00640 1 --2- 172.21.15.72:0/2597073982 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3e240cf360 0x7f3e24158680 secure :-1 s=READY pgs=2224 cs=0 l=1 rev1=1 crypto rx=0x7f3e140098c0 tx=0x7f3e140046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T16:34:20.386 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:20.387+0000 7f3e1a000640 1 -- 172.21.15.72:0/2597073982 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e1403ba80 con 0x7f3e240cf360 2024-04-04T16:34:20.387 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:20.387+0000 7f3e1a000640 1 -- 172.21.15.72:0/2597073982 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e1403bc40 con 0x7f3e240cf360 2024-04-04T16:34:20.387 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:20.387+0000 7f3e28e00640 1 -- 172.21.15.72:0/2597073982 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e241578c0 con 0x7f3e240cf360 2024-04-04T16:34:20.387 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:20.387+0000 7f3e1a000640 1 -- 172.21.15.72:0/2597073982 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e140453f0 con 0x7f3e240cf360 2024-04-04T16:34:20.387 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:20.387+0000 7f3e28e00640 1 -- 172.21.15.72:0/2597073982 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e24157e80 con 0x7f3e240cf360 2024-04-04T16:34:20.388 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:20.388+0000 7f3e28e00640 1 -- 172.21.15.72:0/2597073982 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e24072ec0 con 0x7f3e240cf360 2024-04-04T16:34:20.388 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:20.389+0000 7f3e1a000640 1 -- 172.21.15.72:0/2597073982 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3e1404c060 con 0x7f3e240cf360 2024-04-04T16:34:20.388 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:20.389+0000 7f3e1a000640 1 --2- 172.21.15.72:0/2597073982 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f3e0406c920 0x7f3e0406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:34:20.388 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:20.390+0000 7f3e1a000640 1 -- 172.21.15.72:0/2597073982 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 4943+0+0 (secure 0 0 0) 0x7f3e140ad5d0 con 0x7f3e240cf360 2024-04-04T16:34:20.388 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:20.390+0000 7f3e21400640 1 --2- 172.21.15.72:0/2597073982 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f3e0406c920 0x7f3e0406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:34:20.388 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:20.390+0000 7f3e21400640 1 --2- 172.21.15.72:0/2597073982 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f3e0406c920 0x7f3e0406ede0 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f3e240adaf0 tx=0x7f3e10009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T16:34:20.392 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:20.394+0000 7f3e1a000640 1 -- 172.21.15.72:0/2597073982 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f3e24072ec0 con 0x7f3e240cf360 2024-04-04T16:34:20.607 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:20.609+0000 7f3e28e00640 1 -- 172.21.15.72:0/2597073982 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7f3e24075730 con 0x7f3e240cf360 2024-04-04T16:34:20.614 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:20.616+0000 7f3e1a000640 1 -- 172.21.15.72:0/2597073982 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v12)=0 v12) ==== 123+0+0 (secure 0 0 0) 0x7f3e14040070 con 0x7f3e240cf360 2024-04-04T16:34:20.615 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:20.617+0000 7f3e1a000640 1 -- 172.21.15.72:0/2597073982 <== mon.0 v2:172.21.15.72:3300/0 8 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f3e1407bd00 con 0x7f3e240cf360 2024-04-04T16:34:20.617 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:20.619+0000 7f3e28e00640 1 -- 172.21.15.72:0/2597073982 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f3e0406c920 msgr2=0x7f3e0406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:34:20.617 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:20.619+0000 7f3e28e00640 1 --2- 172.21.15.72:0/2597073982 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f3e0406c920 0x7f3e0406ede0 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f3e240adaf0 tx=0x7f3e10009040 comp rx=0 tx=0).stop 2024-04-04T16:34:20.617 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:20.619+0000 7f3e28e00640 1 -- 172.21.15.72:0/2597073982 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3e240cf360 msgr2=0x7f3e24158680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:34:20.618 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:20.619+0000 7f3e28e00640 1 --2- 172.21.15.72:0/2597073982 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3e240cf360 0x7f3e24158680 secure :-1 s=READY pgs=2224 cs=0 l=1 rev1=1 crypto rx=0x7f3e140098c0 tx=0x7f3e140046c0 comp rx=0 tx=0).stop 2024-04-04T16:34:20.618 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:20.619+0000 7f3e28e00640 1 -- 172.21.15.72:0/2597073982 shutdown_connections 2024-04-04T16:34:20.618 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:20.619+0000 7f3e28e00640 1 --2- 172.21.15.72:0/2597073982 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f3e0406c920 0x7f3e0406ede0 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:34:20.618 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:20.619+0000 7f3e28e00640 1 --2- 172.21.15.72:0/2597073982 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3e2415b390 0x7f3e24154910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:34:20.618 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:20.619+0000 7f3e28e00640 1 --2- 172.21.15.72:0/2597073982 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3e2415afb0 0x7f3e2414c960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:34:20.618 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:20.619+0000 7f3e28e00640 1 --2- 172.21.15.72:0/2597073982 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3e240cf360 0x7f3e24158680 unknown :-1 s=CLOSED pgs=2224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:34:20.618 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:20.619+0000 7f3e28e00640 1 -- 172.21.15.72:0/2597073982 >> 172.21.15.72:0/2597073982 conn(0x7f3e2406b470 msgr2=0x7f3e24071990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T16:34:20.618 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:20.619+0000 7f3e28e00640 1 -- 172.21.15.72:0/2597073982 shutdown_connections 2024-04-04T16:34:20.619 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:20.619+0000 7f3e28e00640 1 -- 172.21.15.72:0/2597073982 wait complete. 2024-04-04T16:34:20.637 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-04T16:34:20.637 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-04T16:34:20.831 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:20.833+0000 7f8e02e00640 1 Processor -- start 2024-04-04T16:34:20.831 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:20.833+0000 7f8e02e00640 1 -- start start 2024-04-04T16:34:20.833 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:20.834+0000 7f8e02e00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f8dfc15b230 0x7f8dfc0d00c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:34:20.833 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:20.834+0000 7f8e02e00640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8dfc0d0600 0x7f8dfc0c4ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:34:20.834 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:20.834+0000 7f8e02e00640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8dfc0c5980 con 0x7f8dfc0c5530 2024-04-04T16:34:20.834 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:20.834+0000 7f8e02e00640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f8dfc15c2b0 con 0x7f8dfc0d0600 2024-04-04T16:34:20.834 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:20.834+0000 7f8e02e00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f8dfc0d0a40 con 0x7f8dfc15b230 2024-04-04T16:34:20.834 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:20.835+0000 7f8dfb400640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8dfc0d0600 0x7f8dfc0c4ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:34:20.834 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:20.835+0000 7f8e00e00640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f8dfc0c5530 0x7f8dfc15ed60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:48526/0 (socket says 172.21.15.72:48526) 2024-04-04T16:34:20.834 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:20.835+0000 7f8e00e00640 1 -- 172.21.15.72:0/3891304929 learned_addr learned my addr 172.21.15.72:0/3891304929 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-04-04T16:34:20.834 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:20.835+0000 7f8dfbe00640 1 --2- 172.21.15.72:0/3891304929 >> v2:172.21.15.117:3300/0 conn(0x7f8dfc15b230 0x7f8dfc0d00c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:34:20.834 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:20.835+0000 7f8dfb400640 1 -- 172.21.15.72:0/3891304929 >> v2:172.21.15.117:3300/0 conn(0x7f8dfc15b230 msgr2=0x7f8dfc0d00c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-04T16:34:20.834 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:20.835+0000 7f8dfb400640 1 --2- 172.21.15.72:0/3891304929 >> v2:172.21.15.117:3300/0 conn(0x7f8dfc15b230 0x7f8dfc0d00c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:34:20.835 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:20.835+0000 7f8dfb400640 1 -- 172.21.15.72:0/3891304929 >> v1:172.21.15.72:6789/0 conn(0x7f8dfc0c5530 legacy=0x7f8dfc15ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:34:20.835 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:20.835+0000 7f8dfb400640 1 -- 172.21.15.72:0/3891304929 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8dfc0c5c00 con 0x7f8dfc0d0600 2024-04-04T16:34:20.835 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:20.835+0000 7f8dfaa00640 1 -- 172.21.15.72:0/3891304929 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2710143532 0 0) 0x7f8df4001490 con 0x7f8dfc0c5530 2024-04-04T16:34:20.835 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:20.835+0000 7f8dfbe00640 1 --2- 172.21.15.72:0/3891304929 >> v2:172.21.15.117:3300/0 conn(0x7f8dfc15b230 0x7f8dfc0d00c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-04T16:34:20.836 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:20.836+0000 7f8dfb400640 1 --2- 172.21.15.72:0/3891304929 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8dfc0d0600 0x7f8dfc0c4ff0 secure :-1 s=READY pgs=2226 cs=0 l=1 rev1=1 crypto rx=0x7f8dfc0d0c80 tx=0x7f8de802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bf5cd22bd084e94 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T16:34:20.836 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:20.837+0000 7f8dfaa00640 1 -- 172.21.15.72:0/3891304929 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8de8035020 con 0x7f8dfc0d0600 2024-04-04T16:34:20.836 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:20.837+0000 7f8dfaa00640 1 -- 172.21.15.72:0/3891304929 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f8de8031830 con 0x7f8dfc0d0600 2024-04-04T16:34:20.837 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:20.837+0000 7f8dfaa00640 1 -- 172.21.15.72:0/3891304929 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8de8031c20 con 0x7f8dfc0d0600 2024-04-04T16:34:20.837 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:20.837+0000 7f8e02e00640 1 -- 172.21.15.72:0/3891304929 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8dfc0d0600 msgr2=0x7f8dfc0c4ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:34:20.837 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:20.837+0000 7f8e02e00640 1 --2- 172.21.15.72:0/3891304929 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8dfc0d0600 0x7f8dfc0c4ff0 secure :-1 s=READY pgs=2226 cs=0 l=1 rev1=1 crypto rx=0x7f8dfc0d0c80 tx=0x7f8de802b8d0 comp rx=0 tx=0).stop 2024-04-04T16:34:20.837 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:20.837+0000 7f8e02e00640 1 -- 172.21.15.72:0/3891304929 shutdown_connections 2024-04-04T16:34:20.837 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:20.837+0000 7f8e02e00640 1 --2- 172.21.15.72:0/3891304929 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8dfc0d0600 0x7f8dfc0c4ff0 unknown :-1 s=CLOSED pgs=2226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:34:20.837 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:20.837+0000 7f8e02e00640 1 --2- 172.21.15.72:0/3891304929 >> v2:172.21.15.117:3300/0 conn(0x7f8dfc15b230 0x7f8dfc0d00c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:34:20.837 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:20.837+0000 7f8e02e00640 1 -- 172.21.15.72:0/3891304929 >> 172.21.15.72:0/3891304929 conn(0x7f8dfc06b470 msgr2=0x7f8dfc06b880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T16:34:20.837 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:20.837+0000 7f8e02e00640 1 -- 172.21.15.72:0/3891304929 shutdown_connections 2024-04-04T16:34:20.837 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:20.837+0000 7f8e02e00640 1 -- 172.21.15.72:0/3891304929 wait complete. 2024-04-04T16:34:20.840 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:20.839+0000 7f8e02e00640 1 Processor -- start 2024-04-04T16:34:20.840 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:20.839+0000 7f8e02e00640 1 -- start start 2024-04-04T16:34:20.840 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:20.840+0000 7f8e02e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8dfc0c5530 0x7f8dfc15db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:34:20.840 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:20.840+0000 7f8e02e00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8dfc0d0600 0x7f8dfc0affa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:34:20.840 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:20.840+0000 7f8e02e00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8dfc15b230 0x7f8dfc0b04e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:34:20.841 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:20.840+0000 7f8e02e00640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f8dfc15bf40 con 0x7f8dfc0d0600 2024-04-04T16:34:20.841 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:20.840+0000 7f8e02e00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f8dfc15bc60 con 0x7f8dfc15b230 2024-04-04T16:34:20.841 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:20.840+0000 7f8e02e00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f8dfc15b610 con 0x7f8dfc0c5530 2024-04-04T16:34:20.841 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:20.840+0000 7f8dfb400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8dfc0d0600 0x7f8dfc0affa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:34:20.841 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:20.840+0000 7f8dfb400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8dfc0d0600 0x7f8dfc0affa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:59440/0 (socket says 172.21.15.72:59440) 2024-04-04T16:34:20.841 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:20.840+0000 7f8dfb400640 1 -- 172.21.15.72:0/2061968126 learned_addr learned my addr 172.21.15.72:0/2061968126 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-04T16:34:20.842 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:20.841+0000 7f8e00e00640 1 --2- 172.21.15.72:0/2061968126 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8dfc15b230 0x7f8dfc0b04e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:34:20.842 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:20.841+0000 7f8dfbe00640 1 --2- 172.21.15.72:0/2061968126 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8dfc0c5530 0x7f8dfc15db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:34:20.842 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:20.841+0000 7f8dfb400640 1 -- 172.21.15.72:0/2061968126 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8dfc0c5530 msgr2=0x7f8dfc15db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:34:20.842 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:20.841+0000 7f8dfb400640 1 --2- 172.21.15.72:0/2061968126 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8dfc0c5530 0x7f8dfc15db60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:34:20.842 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:20.841+0000 7f8dfb400640 1 -- 172.21.15.72:0/2061968126 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8dfc15b230 msgr2=0x7f8dfc0b04e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:34:20.842 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:20.841+0000 7f8dfb400640 1 --2- 172.21.15.72:0/2061968126 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8dfc15b230 0x7f8dfc0b04e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:34:20.842 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:20.841+0000 7f8dfb400640 1 -- 172.21.15.72:0/2061968126 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8dfc072190 con 0x7f8dfc0d0600 2024-04-04T16:34:20.842 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:20.841+0000 7f8e00e00640 1 --2- 172.21.15.72:0/2061968126 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8dfc15b230 0x7f8dfc0b04e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-04T16:34:20.843 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:20.841+0000 7f8dfb400640 1 --2- 172.21.15.72:0/2061968126 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8dfc0d0600 0x7f8dfc0affa0 secure :-1 s=READY pgs=2227 cs=0 l=1 rev1=1 crypto rx=0x7f8de8009890 tx=0x7f8de80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T16:34:20.843 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:20.841+0000 7f8df3e00640 1 -- 172.21.15.72:0/2061968126 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8de8041070 con 0x7f8dfc0d0600 2024-04-04T16:34:20.843 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:20.841+0000 7f8df3e00640 1 -- 172.21.15.72:0/2061968126 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f8de803a950 con 0x7f8dfc0d0600 2024-04-04T16:34:20.843 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:20.841+0000 7f8df3e00640 1 -- 172.21.15.72:0/2061968126 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8de8035040 con 0x7f8dfc0d0600 2024-04-04T16:34:20.843 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:20.841+0000 7f8e02e00640 1 -- 172.21.15.72:0/2061968126 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8dfc0b0b10 con 0x7f8dfc0d0600 2024-04-04T16:34:20.843 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:20.841+0000 7f8e02e00640 1 -- 172.21.15.72:0/2061968126 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8dfc0b10d0 con 0x7f8dfc0d0600 2024-04-04T16:34:20.844 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:20.843+0000 7f8e02e00640 1 -- 172.21.15.72:0/2061968126 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8dfc075840 con 0x7f8dfc0d0600 2024-04-04T16:34:20.844 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:20.844+0000 7f8df3e00640 1 -- 172.21.15.72:0/2061968126 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8de8038020 con 0x7f8dfc0d0600 2024-04-04T16:34:20.844 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:20.845+0000 7f8df3e00640 1 --2- 172.21.15.72:0/2061968126 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f8ddc06c8f0 0x7f8ddc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-04T16:34:20.845 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:20.845+0000 7f8df3e00640 1 -- 172.21.15.72:0/2061968126 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 4943+0+0 (secure 0 0 0) 0x7f8de80ad7c0 con 0x7f8dfc0d0600 2024-04-04T16:34:20.845 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:20.845+0000 7f8dfbe00640 1 --2- 172.21.15.72:0/2061968126 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f8ddc06c8f0 0x7f8ddc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-04T16:34:20.845 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:20.846+0000 7f8dfbe00640 1 --2- 172.21.15.72:0/2061968126 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f8ddc06c8f0 0x7f8ddc06edb0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f8dec00d8b0 tx=0x7f8dec008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-04T16:34:20.846 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:20.848+0000 7f8df3e00640 1 -- 172.21.15.72:0/2061968126 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f8de807bf60 con 0x7f8dfc0d0600 2024-04-04T16:34:21.086 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:21.088+0000 7f8e02e00640 1 -- 172.21.15.72:0/2061968126 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8dfc06f930 con 0x7f8dfc0d0600 2024-04-04T16:34:21.087 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:21.089+0000 7f8df3e00640 1 -- 172.21.15.72:0/2061968126 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+3873 (secure 0 0 0) 0x7f8de807b860 con 0x7f8dfc0d0600 2024-04-04T16:34:21.088 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-04T16:34:21.088 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":19,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4619,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/2380537280","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6833","nonce":2380537280},{"type":"v1","addr":"172.21.15.117:6835","nonce":2380537280}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4840,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6834/108808341","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":108808341},{"type":"v1","addr":"172.21.15.117:6834","nonce":108808341}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":5253,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6836/3494332623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":3494332623},{"type":"v1","addr":"172.21.15.72:6836","nonce":3494332623}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":10221,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6837/2379755404","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6835","nonce":2379755404},{"type":"v1","addr":"172.21.15.72:6837","nonce":2379755404}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[]} 2024-04-04T16:34:21.088 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 19 2024-04-04T16:34:21.090 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:21.092+0000 7f8e02e00640 1 -- 172.21.15.72:0/2061968126 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f8ddc06c8f0 msgr2=0x7f8ddc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:34:21.090 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:21.092+0000 7f8e02e00640 1 --2- 172.21.15.72:0/2061968126 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f8ddc06c8f0 0x7f8ddc06edb0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f8dec00d8b0 tx=0x7f8dec008040 comp rx=0 tx=0).stop 2024-04-04T16:34:21.090 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:21.092+0000 7f8e02e00640 1 -- 172.21.15.72:0/2061968126 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8dfc0d0600 msgr2=0x7f8dfc0affa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-04T16:34:21.091 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:21.092+0000 7f8e02e00640 1 --2- 172.21.15.72:0/2061968126 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8dfc0d0600 0x7f8dfc0affa0 secure :-1 s=READY pgs=2227 cs=0 l=1 rev1=1 crypto rx=0x7f8de8009890 tx=0x7f8de80046c0 comp rx=0 tx=0).stop 2024-04-04T16:34:21.091 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:21.092+0000 7f8e02e00640 1 -- 172.21.15.72:0/2061968126 shutdown_connections 2024-04-04T16:34:21.091 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:21.092+0000 7f8e02e00640 1 --2- 172.21.15.72:0/2061968126 >> [v2:172.21.15.72:6832/2205173820,v1:172.21.15.72:6833/2205173820] conn(0x7f8ddc06c8f0 0x7f8ddc06edb0 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:34:21.091 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:21.092+0000 7f8e02e00640 1 --2- 172.21.15.72:0/2061968126 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8dfc15b230 0x7f8dfc0b04e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:34:21.091 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:21.092+0000 7f8e02e00640 1 --2- 172.21.15.72:0/2061968126 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8dfc0d0600 0x7f8dfc0affa0 unknown :-1 s=CLOSED pgs=2227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:34:21.091 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:21.092+0000 7f8e02e00640 1 --2- 172.21.15.72:0/2061968126 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8dfc0c5530 0x7f8dfc15db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-04T16:34:21.091 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:21.092+0000 7f8e02e00640 1 -- 172.21.15.72:0/2061968126 >> 172.21.15.72:0/2061968126 conn(0x7f8dfc06b470 msgr2=0x7f8dfc0ce940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-04T16:34:21.091 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:21.092+0000 7f8e02e00640 1 -- 172.21.15.72:0/2061968126 shutdown_connections 2024-04-04T16:34:21.091 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-04T16:34:21.092+0000 7f8e02e00640 1 -- 172.21.15.72:0/2061968126 wait complete. 2024-04-04T16:34:21.110 DEBUG:tasks.cephfs.filesystem:already dead... 2024-04-04T16:34:21.110 INFO:teuthology.misc:Shutting down mds daemons... 2024-04-04T16:34:21.110 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-04T16:34:21.111 INFO:teuthology.orchestra.run:waiting for 300 2024-04-04T16:34:21.131 INFO:tasks.ceph.mds.a:Stopped 2024-04-04T16:34:21.132 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-04T16:34:21.132 INFO:teuthology.orchestra.run:waiting for 300 2024-04-04T16:34:21.207 INFO:tasks.ceph.mds.c:Stopped 2024-04-04T16:34:21.208 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-04T16:34:21.208 INFO:teuthology.orchestra.run:waiting for 300 2024-04-04T16:34:21.233 INFO:tasks.ceph.mds.b:Stopped 2024-04-04T16:34:21.233 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-04T16:34:21.233 INFO:teuthology.orchestra.run:waiting for 300 2024-04-04T16:34:21.294 INFO:tasks.ceph.mds.d:Stopped 2024-04-04T16:34:21.294 INFO:teuthology.misc:Shutting down osd daemons... 2024-04-04T16:34:21.295 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-04-04T16:34:21.295 INFO:teuthology.orchestra.run:waiting for 300 2024-04-04T16:34:27.397 INFO:tasks.ceph.osd.0:Stopped 2024-04-04T16:34:27.397 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-04-04T16:34:27.398 INFO:teuthology.orchestra.run:waiting for 300 2024-04-04T16:34:28.701 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2024-04-04T16:34:33.500 INFO:tasks.ceph.osd.1:Stopped 2024-04-04T16:34:33.500 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-04-04T16:34:33.500 INFO:teuthology.orchestra.run:waiting for 300 2024-04-04T16:34:34.709 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2024-04-04T16:34:34.709 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 has been restored 2024-04-04T16:34:39.602 INFO:tasks.ceph.osd.2:Stopped 2024-04-04T16:34:39.603 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-04-04T16:34:39.603 INFO:teuthology.orchestra.run:waiting for 300 2024-04-04T16:34:40.622 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2024-04-04T16:34:40.622 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 has been restored 2024-04-04T16:34:45.705 INFO:tasks.ceph.osd.3:Stopped 2024-04-04T16:34:45.706 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-04-04T16:34:45.706 INFO:teuthology.orchestra.run:waiting for 300 2024-04-04T16:34:46.530 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~6s 2024-04-04T16:34:51.808 INFO:tasks.ceph.osd.4:Stopped 2024-04-04T16:34:51.809 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-04-04T16:34:51.809 INFO:teuthology.orchestra.run:waiting for 300 2024-04-04T16:34:52.338 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~0s 2024-04-04T16:34:52.338 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 has been restored 2024-04-04T16:34:57.911 INFO:tasks.ceph.osd.5:Stopped 2024-04-04T16:34:57.912 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-04-04T16:34:57.912 INFO:teuthology.orchestra.run:waiting for 300 2024-04-04T16:34:58.044 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~0s 2024-04-04T16:34:58.045 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 has been restored 2024-04-04T16:35:03.651 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2024-04-04T16:35:03.652 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 has been restored 2024-04-04T16:35:04.014 INFO:tasks.ceph.osd.6:Stopped 2024-04-04T16:35:04.014 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-04-04T16:35:04.014 INFO:teuthology.orchestra.run:waiting for 300 2024-04-04T16:35:09.155 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2024-04-04T16:35:09.156 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 has been restored 2024-04-04T16:35:10.116 INFO:tasks.ceph.osd.7:Stopped 2024-04-04T16:35:10.117 INFO:teuthology.misc:Shutting down mgr daemons... 2024-04-04T16:35:10.117 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-04-04T16:35:10.117 INFO:teuthology.orchestra.run:waiting for 300 2024-04-04T16:35:14.559 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~0s 2024-04-04T16:35:14.560 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 has been restored 2024-04-04T16:35:16.219 INFO:tasks.ceph.mgr.y:Stopped 2024-04-04T16:35:16.220 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-04-04T16:35:16.220 INFO:teuthology.orchestra.run:waiting for 300 2024-04-04T16:35:16.310 INFO:tasks.ceph.mgr.x:Stopped 2024-04-04T16:35:16.311 INFO:teuthology.misc:Shutting down mon daemons... 2024-04-04T16:35:16.311 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-04-04T16:35:16.311 INFO:teuthology.orchestra.run:waiting for 300 2024-04-04T16:35:16.406 INFO:tasks.ceph.mon.a:Stopped 2024-04-04T16:35:16.406 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-04-04T16:35:16.406 INFO:teuthology.orchestra.run:waiting for 300 2024-04-04T16:35:16.463 INFO:tasks.ceph.mon.b:Stopped 2024-04-04T16:35:16.464 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-04-04T16:35:16.464 INFO:teuthology.orchestra.run:waiting for 300 2024-04-04T16:35:16.523 INFO:tasks.ceph.mon.c:Stopped 2024-04-04T16:35:16.523 INFO:tasks.ceph:Checking cluster log for badness... 2024-04-04T16:35:16.524 DEBUG:teuthology.orchestra.run.smithi072:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | head -n 1 2024-04-04T16:35:17.053 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi072.front.sepia.ceph.com 2024-04-04T16:35:17.054 DEBUG:teuthology.orchestra.run.smithi072:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-04-04T16:35:18.636 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi072.front.sepia.ceph.com 2024-04-04T16:35:18.637 DEBUG:teuthology.orchestra.run.smithi072:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-04-04T16:35:19.071 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi072.front.sepia.ceph.com 2024-04-04T16:35:19.072 DEBUG:teuthology.orchestra.run.smithi072:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-04-04T16:35:19.349 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi072.front.sepia.ceph.com 2024-04-04T16:35:19.349 DEBUG:teuthology.orchestra.run.smithi072:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-04-04T16:35:19.561 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y has been restored 2024-04-04T16:35:19.757 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi117.front.sepia.ceph.com 2024-04-04T16:35:19.757 DEBUG:teuthology.orchestra.run.smithi117:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-04-04T16:35:20.907 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi117.front.sepia.ceph.com 2024-04-04T16:35:20.907 DEBUG:teuthology.orchestra.run.smithi117:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-04-04T16:35:21.236 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi117.front.sepia.ceph.com 2024-04-04T16:35:21.236 DEBUG:teuthology.orchestra.run.smithi117:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-04-04T16:35:21.541 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi117.front.sepia.ceph.com 2024-04-04T16:35:21.542 DEBUG:teuthology.orchestra.run.smithi117:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-04-04T16:35:21.858 INFO:tasks.ceph:Archiving mon data... 2024-04-04T16:35:21.860 DEBUG:teuthology.misc:Transferring archived files from smithi072:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/vshankar-2024-04-04_05:15:36-fs-wip-vshankar-testing-20240330.172700-testing-default-smithi/7639251/data/mon.a.tgz 2024-04-04T16:35:21.860 DEBUG:teuthology.orchestra.run.smithi072:> mktemp 2024-04-04T16:35:21.965 INFO:teuthology.orchestra.run.smithi072.stdout:/tmp/tmp.OmMdz8xw2R 2024-04-04T16:35:21.965 DEBUG:teuthology.orchestra.run.smithi072:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.OmMdz8xw2R 2024-04-04T16:35:22.300 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod 0666 /tmp/tmp.OmMdz8xw2R 2024-04-04T16:35:22.511 DEBUG:teuthology.orchestra.remote:smithi072:/tmp/tmp.OmMdz8xw2R is 625KB 2024-04-04T16:35:22.626 DEBUG:teuthology.orchestra.run.smithi072:> rm -fr /tmp/tmp.OmMdz8xw2R 2024-04-04T16:35:22.692 DEBUG:teuthology.misc:Transferring archived files from smithi117:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/vshankar-2024-04-04_05:15:36-fs-wip-vshankar-testing-20240330.172700-testing-default-smithi/7639251/data/mon.b.tgz 2024-04-04T16:35:22.692 DEBUG:teuthology.orchestra.run.smithi117:> mktemp 2024-04-04T16:35:22.742 INFO:teuthology.orchestra.run.smithi117.stdout:/tmp/tmp.AcLhLiPqBa 2024-04-04T16:35:22.742 DEBUG:teuthology.orchestra.run.smithi117:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.AcLhLiPqBa 2024-04-04T16:35:23.000 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod 0666 /tmp/tmp.AcLhLiPqBa 2024-04-04T16:35:23.150 DEBUG:teuthology.orchestra.remote:smithi117:/tmp/tmp.AcLhLiPqBa is 639KB 2024-04-04T16:35:23.258 DEBUG:teuthology.orchestra.run.smithi117:> rm -fr /tmp/tmp.AcLhLiPqBa 2024-04-04T16:35:23.308 DEBUG:teuthology.misc:Transferring archived files from smithi117:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/vshankar-2024-04-04_05:15:36-fs-wip-vshankar-testing-20240330.172700-testing-default-smithi/7639251/data/mon.c.tgz 2024-04-04T16:35:23.309 DEBUG:teuthology.orchestra.run.smithi117:> mktemp 2024-04-04T16:35:23.353 INFO:teuthology.orchestra.run.smithi117.stdout:/tmp/tmp.t0l0WK3pTe 2024-04-04T16:35:23.354 DEBUG:teuthology.orchestra.run.smithi117:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.t0l0WK3pTe 2024-04-04T16:35:23.587 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod 0666 /tmp/tmp.t0l0WK3pTe 2024-04-04T16:35:23.718 DEBUG:teuthology.orchestra.remote:smithi117:/tmp/tmp.t0l0WK3pTe is 639KB 2024-04-04T16:35:23.823 DEBUG:teuthology.orchestra.run.smithi117:> rm -fr /tmp/tmp.t0l0WK3pTe 2024-04-04T16:35:23.873 INFO:tasks.ceph:Cleaning ceph cluster... 2024-04-04T16:35:23.873 DEBUG:teuthology.orchestra.run.smithi072:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-04T16:35:23.882 DEBUG:teuthology.orchestra.run.smithi117:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-04T16:35:24.117 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-04T16:35:24.178 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-04T16:35:24.179 INFO:tasks.ceph:Archiving crash dumps... 2024-04-04T16:35:24.181 DEBUG:teuthology.misc:Transferring archived files from smithi072:/var/lib/ceph/crash to /home/teuthworker/archive/vshankar-2024-04-04_05:15:36-fs-wip-vshankar-testing-20240330.172700-testing-default-smithi/7639251/remote/smithi072/crash 2024-04-04T16:35:24.181 DEBUG:teuthology.orchestra.run.smithi072:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-04T16:35:24.265 DEBUG:teuthology.misc:Transferring archived files from smithi117:/var/lib/ceph/crash to /home/teuthworker/archive/vshankar-2024-04-04_05:15:36-fs-wip-vshankar-testing-20240330.172700-testing-default-smithi/7639251/remote/smithi117/crash 2024-04-04T16:35:24.266 DEBUG:teuthology.orchestra.run.smithi117:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-04T16:35:24.348 INFO:tasks.ceph:Shutting down logrotate 2024-04-04T16:43:50.117 INFO:teuthology.orchestra.run.smithi072.stderr:ceph-osd: no process found 2024-04-04T16:50:14.237 DEBUG:teuthology.orchestra.run.smithi072:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-04-04T16:50:14.339 DEBUG:teuthology.orchestra.run.smithi117:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-04-04T16:50:14.438 INFO:tasks.ceph:Compressing logs... 2024-04-04T16:50:14.438 DEBUG:teuthology.orchestra.run.smithi072:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-04T16:50:14.446 DEBUG:teuthology.orchestra.run.smithi117:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-04T16:50:14.569 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49232.log 2024-04-04T16:50:14.570 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-04-04T16:50:14.571 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.269813.log 2024-04-04T16:50:14.572 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37109.log 2024-04-04T16:50:14.572 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.49232.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.547486.log 2024-04-04T16:50:14.573 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37149.log 2024-04-04T16:50:14.573 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.549259.log 2024-04-04T16:50:14.574 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.37109.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.3.43550.log 2024-04-04T16:50:14.575 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.395040.log 2024-04-04T16:50:14.575 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.37149.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.43094.log 2024-04-04T16:50:14.576 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.3.43550.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37229.log 2024-04-04T16:50:14.576 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.273263.log 2024-04-04T16:50:14.577 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.1.43094.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-04T16:50:14.577 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.473823.log 2024-04-04T16:50:14.578 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.37229.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-04-04T16:50:14.579 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.431616.log 2024-04-04T16:50:14.579 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-04-04T16:50:14.580 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.473411.log 2024-04-04T16:50:14.581 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37269.log 2024-04-04T16:50:14.581 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37189.log 2024-04-04T16:50:14.582 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.530205.log 2024-04-04T16:50:14.582 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.483832.log 2024-04-04T16:50:14.583 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.37269.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.37109.log.gz 2024-04-04T16:50:14.583 INFO:teuthology.orchestra.run.smithi117.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.37149.log.gz 2024-04-04T16:50:14.583 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-04-04T16:50:14.584 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.384939.log 2024-04-04T16:50:14.585 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134560.log 2024-04-04T16:50:14.585 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.37189.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-04-04T16:50:14.586 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37349.log 2024-04-04T16:50:14.586 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.206565.log 2024-04-04T16:50:14.587 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.267717.log 2024-04-04T16:50:14.587 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-04-04T16:50:14.587 INFO:teuthology.orchestra.run.smithi117.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.37269.log.gz 2024-04-04T16:50:14.588 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48356.log 2024-04-04T16:50:14.588 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.37349.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37389.log 2024-04-04T16:50:14.589 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.398015.log 2024-04-04T16:50:14.590 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37309.log 2024-04-04T16:50:14.590 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.254234.log 2024-04-04T16:50:14.591 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145346.log 2024-04-04T16:50:14.591 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.37389.log: 90.6% -- replaced with /var/log/ceph/ceph-client.1.43094.log.gz 2024-04-04T16:50:14.592 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.37309.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-04T16:50:14.592 INFO:teuthology.orchestra.run.smithi117.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.3.43550.log.gz 2024-04-04T16:50:14.593 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.282885.log 2024-04-04T16:50:14.594 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-04-04T16:50:14.594 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.547486.log: /var/log/ceph/ceph-client.admin.269813.log: /var/log/ceph/ceph-client.admin.549259.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.366036.log 2024-04-04T16:50:14.595 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.224347.log 2024-04-04T16:50:14.595 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-04-04T16:50:14.596 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-mon.b.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.37229.log.gz 2024-04-04T16:50:14.596 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.365051.log 2024-04-04T16:50:14.596 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.271928.log 2024-04-04T16:50:14.597 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-04-04T16:50:14.598 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.224768.log 2024-04-04T16:50:14.599 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46085.log 2024-04-04T16:50:14.600 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.254665.log 2024-04-04T16:50:14.601 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.537685.log 2024-04-04T16:50:14.602 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157739.log 2024-04-04T16:50:14.603 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.417891.log 2024-04-04T16:50:14.604 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.498290.log 2024-04-04T16:50:14.605 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.407229.log 2024-04-04T16:50:14.606 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.198021.log 2024-04-04T16:50:14.608 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156818.log 2024-04-04T16:50:14.609 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.355861.log 2024-04-04T16:50:14.610 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110065.log 2024-04-04T16:50:14.611 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.480362.log 2024-04-04T16:50:14.612 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.491106.log 2024-04-04T16:50:14.613 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.452862.log 2024-04-04T16:50:14.614 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125626.log 2024-04-04T16:50:14.615 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.323325.log 2024-04-04T16:50:14.616 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.245484.log 2024-04-04T16:50:14.617 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.547477.log 2024-04-04T16:50:14.619 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.473823.log: /var/log/ceph/ceph-client.admin.431616.log: /var/log/ceph/ceph-client.admin.395040.log: /var/log/ceph/ceph-client.admin.473411.log: /var/log/ceph/ceph-client.admin.530205.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.49232.log.gz 2024-04-04T16:50:14.619 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.479008.log 2024-04-04T16:50:14.621 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.483832.log: /var/log/ceph/ceph-client.admin.273263.log: /var/log/ceph/ceph-client.admin.254234.log: /var/log/ceph/ceph-client.admin.267717.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.203419.log 2024-04-04T16:50:14.621 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.245484.log: /var/log/ceph/ceph-client.admin.206565.log: /var/log/ceph/ceph-client.admin.323325.log: /var/log/ceph/ceph-client.admin.398015.log: /var/log/ceph/ceph-client.admin.134560.log: /var/log/ceph/ceph-client.admin.48356.log: /var/log/ceph/ceph-client.admin.537685.log: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.269813.log.gz 2024-04-04T16:50:14.623 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.417891.log: /var/log/ceph/ceph-client.admin.479008.log: /var/log/ceph/ceph-client.admin.498290.log: /var/log/ceph/ceph-client.admin.407229.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.549259.log.gz 2024-04-04T16:50:14.623 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.480362.log: /var/log/ceph/ceph-client.admin.491106.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48602.log 2024-04-04T16:50:14.623 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.452862.log: /var/log/ceph/ceph-client.admin.384939.log: /var/log/ceph/ceph-client.admin.145346.log: /var/log/ceph/ceph-client.admin.282885.log: /var/log/ceph/ceph-client.admin.365051.log: /var/log/ceph/ceph-client.admin.355861.log: /var/log/ceph/ceph-client.admin.125626.log: /var/log/ceph/ceph-client.admin.366036.log: /var/log/ceph/ceph-client.admin.224347.log: /var/log/ceph/ceph-client.admin.271928.log: /var/log/ceph/ceph-client.admin.224768.log: /var/log/ceph/ceph-client.admin.46085.log: /var/log/ceph/ceph-client.admin.157739.log: /var/log/ceph/ceph-client.admin.254665.log: /var/log/ceph/ceph-client.admin.198021.log: /var/log/ceph/ceph-client.admin.156818.log: /var/log/ceph/ceph-client.admin.547477.log: /var/log/ceph/ceph-client.admin.110065.log: /var/log/ceph/ceph-client.admin.203419.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.225241.log 2024-04-04T16:50:14.624 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.48602.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.333320.log 2024-04-04T16:50:14.626 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.225241.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46463.log 2024-04-04T16:50:14.626 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-mds.d.log: /var/log/ceph/ceph-mon.c.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.37189.log.gz 2024-04-04T16:50:14.626 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.333320.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.262408.log 2024-04-04T16:50:14.627 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.46463.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-04-04T16:50:14.628 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.262408.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.280522.log 2024-04-04T16:50:14.628 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151498.log 2024-04-04T16:50:14.629 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.280522.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.401464.log 2024-04-04T16:50:14.630 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.151498.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.411060.log 2024-04-04T16:50:14.631 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.401464.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.228613.log 2024-04-04T16:50:14.632 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.411060.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.414493.log 2024-04-04T16:50:14.633 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.228613.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49621.log 2024-04-04T16:50:14.633 INFO:teuthology.orchestra.run.smithi072.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.547486.log.gz 2024-04-04T16:50:14.633 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.414493.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.433370.log 2024-04-04T16:50:14.634 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.49621.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.244647.log 2024-04-04T16:50:14.635 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.433370.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.317806.log 2024-04-04T16:50:14.636 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.244647.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.262834.log 2024-04-04T16:50:14.637 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.317806.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.335422.log 2024-04-04T16:50:14.637 INFO:teuthology.orchestra.run.smithi072.stderr: 77.7% -- replaced with /var/log/ceph/ceph-client.admin.537685.log.gz 2024-04-04T16:50:14.638 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.262834.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.230621.log 2024-04-04T16:50:14.638 INFO:teuthology.orchestra.run.smithi117.stderr: 88.4% 89.1% -- replaced with /var/log/ceph/ceph-client.admin.37309.log.gz 2024-04-04T16:50:14.639 INFO:teuthology.orchestra.run.smithi117.stderr: -- replaced with /var/log/ceph/ceph-client.admin.37349.log.gz 2024-04-04T16:50:14.639 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.335422.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.469414.log 2024-04-04T16:50:14.640 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.230621.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.352384.log 2024-04-04T16:50:14.640 INFO:teuthology.orchestra.run.smithi117.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.37389.log.gz 2024-04-04T16:50:14.641 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.469414.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.319066.log 2024-04-04T16:50:14.641 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.352384.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110682.log 2024-04-04T16:50:14.642 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.319066.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144475.log 2024-04-04T16:50:14.643 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.110682.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.455431.log 2024-04-04T16:50:14.644 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.144475.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153326.log 2024-04-04T16:50:14.645 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.455431.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.474254.log 2024-04-04T16:50:14.645 INFO:teuthology.orchestra.run.smithi117.stderr: 93.7% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-04-04T16:50:14.646 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.153326.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.484665.log 2024-04-04T16:50:14.646 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.474254.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.48356.log.gz 2024-04-04T16:50:14.646 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43556.log 2024-04-04T16:50:14.647 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.484665.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.353262.log 2024-04-04T16:50:14.648 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.43556.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.244216.log 2024-04-04T16:50:14.649 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.353262.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.545250.log 2024-04-04T16:50:14.649 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.244216.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.516879.log 2024-04-04T16:50:14.650 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.545250.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137924.log 2024-04-04T16:50:14.651 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.516879.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.355010.log 2024-04-04T16:50:14.652 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.137924.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.316115.log 2024-04-04T16:50:14.653 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.355010.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.544837.log 2024-04-04T16:50:14.653 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.316115.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.530205.log.gz 2024-04-04T16:50:14.654 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146203.log 2024-04-04T16:50:14.654 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.544837.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.536797.log 2024-04-04T16:50:14.655 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.146203.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47636.log 2024-04-04T16:50:14.656 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.536797.log: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.473823.log.gz 2024-04-04T16:50:14.656 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.475163.log 2024-04-04T16:50:14.657 INFO:teuthology.orchestra.run.smithi072.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.473411.log.gz 2024-04-04T16:50:14.657 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.47636.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.214258.log 2024-04-04T16:50:14.658 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.475163.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.246391.log 2024-04-04T16:50:14.658 INFO:teuthology.orchestra.run.smithi072.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.480362.log.gz 2024-04-04T16:50:14.658 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.214258.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.338885.log 2024-04-04T16:50:14.659 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.246391.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.266866.log 2024-04-04T16:50:14.660 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.338885.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.281907.log 2024-04-04T16:50:14.661 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.266866.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.243723.log 2024-04-04T16:50:14.662 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.281907.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.333740.log 2024-04-04T16:50:14.662 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.243723.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50372.log 2024-04-04T16:50:14.663 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.333740.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.351496.log 2024-04-04T16:50:14.664 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.50372.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183310.log 2024-04-04T16:50:14.665 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.366494.log 2024-04-04T16:50:14.665 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.351496.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.411060.log.gz 2024-04-04T16:50:14.666 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.183310.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44269.log 2024-04-04T16:50:14.667 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.366494.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129820.log 2024-04-04T16:50:14.667 INFO:teuthology.orchestra.run.smithi072.stderr: 80.3% -- replaced with /var/log/ceph/ceph-client.admin.254234.log.gz 2024-04-04T16:50:14.668 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.44269.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.314846.log 2024-04-04T16:50:14.668 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.129820.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.240681.log 2024-04-04T16:50:14.669 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.314846.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134138.log 2024-04-04T16:50:14.670 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.240681.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.235974.log 2024-04-04T16:50:14.671 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.134138.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.527068.log 2024-04-04T16:50:14.672 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.235974.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.215103.log 2024-04-04T16:50:14.673 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.527068.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.195435.log 2024-04-04T16:50:14.673 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.215103.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.484674.log 2024-04-04T16:50:14.674 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.195435.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.336255.log 2024-04-04T16:50:14.675 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.484674.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.432950.log 2024-04-04T16:50:14.676 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.336255.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.395040.log.gz 2024-04-04T16:50:14.676 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.495173.log 2024-04-04T16:50:14.676 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.432950.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.481651.log 2024-04-04T16:50:14.677 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.495173.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.262417.log 2024-04-04T16:50:14.678 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.481651.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.549511.log 2024-04-04T16:50:14.679 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.262417.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.452394.log 2024-04-04T16:50:14.680 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.549511.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124663.log 2024-04-04T16:50:14.680 INFO:teuthology.orchestra.run.smithi072.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.498290.log.gz 2024-04-04T16:50:14.681 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.452394.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.215534.log 2024-04-04T16:50:14.681 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.124663.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.201161.log 2024-04-04T16:50:14.682 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.215534.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.280968.log 2024-04-04T16:50:14.683 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.201161.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.426141.log 2024-04-04T16:50:14.684 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.280968.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.219083.log 2024-04-04T16:50:14.684 INFO:teuthology.orchestra.run.smithi072.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.491106.log.gz 2024-04-04T16:50:14.685 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.426141.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190595.log 2024-04-04T16:50:14.686 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.219083.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.485963.log 2024-04-04T16:50:14.686 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.190595.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.508865.log 2024-04-04T16:50:14.687 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.485963.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.468563.log 2024-04-04T16:50:14.688 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.508865.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.198921.log 2024-04-04T16:50:14.689 INFO:teuthology.orchestra.run.smithi072.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.145346.log.gz 2024-04-04T16:50:14.689 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.468563.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.361673.log 2024-04-04T16:50:14.690 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.198921.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.389349.log 2024-04-04T16:50:14.690 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.361673.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156809.log 2024-04-04T16:50:14.691 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.389349.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.404199.log 2024-04-04T16:50:14.692 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.156809.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.400687.log 2024-04-04T16:50:14.693 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.404199.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.355010.log.gz 2024-04-04T16:50:14.693 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.483399.log 2024-04-04T16:50:14.694 INFO:teuthology.orchestra.run.smithi072.stderr: 84.3% -- replaced with /var/log/ceph/ceph-client.admin.355861.log.gz 2024-04-04T16:50:14.694 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.400687.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.280106.log 2024-04-04T16:50:14.695 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.483399.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.511398.log 2024-04-04T16:50:14.695 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.280106.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.451538.log 2024-04-04T16:50:14.696 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.511398.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.469405.log 2024-04-04T16:50:14.697 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.451538.log: 84.0% -- replaced with /var/log/ceph/ceph-client.admin.352384.log.gz 2024-04-04T16:50:14.697 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.211314.log 2024-04-04T16:50:14.698 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.469405.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.214681.log 2024-04-04T16:50:14.698 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.211314.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50019.log 2024-04-04T16:50:14.699 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.214681.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.260708.log 2024-04-04T16:50:14.700 INFO:teuthology.orchestra.run.smithi072.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.333320.log.gz 2024-04-04T16:50:14.700 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.50019.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.498300.log 2024-04-04T16:50:14.701 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.260708.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.435732.log 2024-04-04T16:50:14.702 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.498300.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162851.log 2024-04-04T16:50:14.702 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.435732.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.342278.log 2024-04-04T16:50:14.703 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.162851.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.513084.log 2024-04-04T16:50:14.704 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.342278.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114963.log 2024-04-04T16:50:14.705 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.513084.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50414.log 2024-04-04T16:50:14.706 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.114963.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.144475.log.gz 2024-04-04T16:50:14.706 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142258.log 2024-04-04T16:50:14.707 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.50414.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.211726.log 2024-04-04T16:50:14.707 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.142258.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.285002.log 2024-04-04T16:50:14.708 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.211726.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.253813.log 2024-04-04T16:50:14.709 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.285002.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.343551.log 2024-04-04T16:50:14.710 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.253813.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.544828.log 2024-04-04T16:50:14.711 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.343551.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.485954.log 2024-04-04T16:50:14.711 INFO:teuthology.orchestra.run.smithi072.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.414493.log.gz 2024-04-04T16:50:14.711 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.544828.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.354590.log 2024-04-04T16:50:14.712 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.485954.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.399839.log 2024-04-04T16:50:14.713 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.354590.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.401415.log 2024-04-04T16:50:14.714 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.399839.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.326848.log 2024-04-04T16:50:14.714 INFO:teuthology.orchestra.run.smithi072.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.245484.log.gz 2024-04-04T16:50:14.715 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.401415.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130250.log 2024-04-04T16:50:14.715 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.326848.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46295.log 2024-04-04T16:50:14.716 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.130250.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126802.log 2024-04-04T16:50:14.717 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.46295.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.417891.log.gz 2024-04-04T16:50:14.717 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.216859.log 2024-04-04T16:50:14.718 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.126802.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.272808.log 2024-04-04T16:50:14.719 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.216859.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.245952.log 2024-04-04T16:50:14.719 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.272808.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.539896.log 2024-04-04T16:50:14.720 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.245952.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147614.log 2024-04-04T16:50:14.721 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.539896.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49274.log 2024-04-04T16:50:14.722 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.147614.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.217757.log 2024-04-04T16:50:14.723 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.49274.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.210454.log 2024-04-04T16:50:14.724 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.217757.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.346084.log 2024-04-04T16:50:14.725 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.210454.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.201170.log 2024-04-04T16:50:14.725 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.346084.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110074.log 2024-04-04T16:50:14.726 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.201170.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.495634.log 2024-04-04T16:50:14.727 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.110074.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.465187.log 2024-04-04T16:50:14.728 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.495634.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49893.log 2024-04-04T16:50:14.729 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.465187.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.466152.log 2024-04-04T16:50:14.729 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.49893.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143149.log 2024-04-04T16:50:14.730 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.466152.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43051.log 2024-04-04T16:50:14.730 INFO:teuthology.orchestra.run.smithi072.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.271928.log.gz 2024-04-04T16:50:14.731 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.143149.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.209182.log 2024-04-04T16:50:14.732 INFO:teuthology.orchestra.run.smithi072.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.282885.log.gz 2024-04-04T16:50:14.732 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.43051.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.454149.log 2024-04-04T16:50:14.733 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.209182.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.491340.log 2024-04-04T16:50:14.733 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.454149.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.322056.log 2024-04-04T16:50:14.734 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.491340.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.217748.log 2024-04-04T16:50:14.735 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.322056.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50200.log 2024-04-04T16:50:14.736 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.217748.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.261556.log 2024-04-04T16:50:14.737 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.50200.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42446.log 2024-04-04T16:50:14.738 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.261556.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.328131.log 2024-04-04T16:50:14.738 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.42446.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48088.log 2024-04-04T16:50:14.739 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.328131.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.435312.log 2024-04-04T16:50:14.740 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.48088.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.366027.log 2024-04-04T16:50:14.740 INFO:teuthology.orchestra.run.smithi072.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.452862.log.gz 2024-04-04T16:50:14.741 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.435312.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48770.log 2024-04-04T16:50:14.742 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.366027.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161319.log 2024-04-04T16:50:14.743 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.48770.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.456686.log 2024-04-04T16:50:14.743 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.161319.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.341013.log 2024-04-04T16:50:14.744 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.456686.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.397118.log 2024-04-04T16:50:14.745 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.341013.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.336685.log 2024-04-04T16:50:14.746 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.397118.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.130250.log.gz 2024-04-04T16:50:14.746 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.385782.log 2024-04-04T16:50:14.747 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.336685.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120707.log 2024-04-04T16:50:14.748 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.385782.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.396160.log 2024-04-04T16:50:14.748 INFO:teuthology.orchestra.run.smithi072.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.224768.log.gz 2024-04-04T16:50:14.748 INFO:teuthology.orchestra.run.smithi072.stderr: 78.9% -- replaced with /var/log/ceph/ceph-client.admin.225241.log.gz 2024-04-04T16:50:14.749 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.120707.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.401747.log 2024-04-04T16:50:14.750 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.396160.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.514770.log 2024-04-04T16:50:14.751 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.401747.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.350241.log 2024-04-04T16:50:14.751 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.514770.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.110682.log.gz 2024-04-04T16:50:14.752 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.230161.log 2024-04-04T16:50:14.753 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.350241.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44437.log 2024-04-04T16:50:14.754 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.230161.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.357123.log 2024-04-04T16:50:14.754 INFO:teuthology.orchestra.run.smithi072.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.147614.log.gz 2024-04-04T16:50:14.755 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.44437.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.454575.log 2024-04-04T16:50:14.755 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.357123.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163264.log 2024-04-04T16:50:14.756 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.454575.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.204760.log 2024-04-04T16:50:14.757 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.163264.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.324174.log 2024-04-04T16:50:14.757 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.204760.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.335413.log 2024-04-04T16:50:14.758 INFO:teuthology.orchestra.run.smithi072.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.267717.log.gz 2024-04-04T16:50:14.758 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.324174.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121120.log 2024-04-04T16:50:14.764 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.335413.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.350653.log 2024-04-04T16:50:14.764 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.121120.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.452385.log 2024-04-04T16:50:14.764 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.350653.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138347.log 2024-04-04T16:50:14.764 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.452385.log: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.110065.log.gz 2024-04-04T16:50:14.764 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.448347.log 2024-04-04T16:50:14.764 INFO:teuthology.orchestra.run.smithi072.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.224347.log.gz 2024-04-04T16:50:14.765 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.138347.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.455422.log 2024-04-04T16:50:14.765 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.448347.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189635.log 2024-04-04T16:50:14.766 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.455422.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.462004.log 2024-04-04T16:50:14.766 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.189635.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.231072.log 2024-04-04T16:50:14.766 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.462004.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134973.log 2024-04-04T16:50:14.767 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.231072.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.400260.log 2024-04-04T16:50:14.767 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.134973.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.211305.log 2024-04-04T16:50:14.769 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.400260.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.398440.log 2024-04-04T16:50:14.769 INFO:teuthology.orchestra.run.smithi072.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.254665.log.gz 2024-04-04T16:50:14.770 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.211305.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.256043.log 2024-04-04T16:50:14.770 INFO:teuthology.orchestra.run.smithi072.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.244647.log.gz 2024-04-04T16:50:14.770 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.398440.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140051.log 2024-04-04T16:50:14.771 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.256043.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.487237.log 2024-04-04T16:50:14.772 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.140051.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.401117.log 2024-04-04T16:50:14.773 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.487237.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.238084.log 2024-04-04T16:50:14.773 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.401117.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.233831.log 2024-04-04T16:50:14.774 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.238084.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.472172.log 2024-04-04T16:50:14.775 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.233831.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.485526.log 2024-04-04T16:50:14.776 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.472172.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.480783.log 2024-04-04T16:50:14.777 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.485526.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153742.log 2024-04-04T16:50:14.777 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.480783.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129397.log 2024-04-04T16:50:14.778 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.153742.log: 83.1% -- replaced with /var/log/ceph/ceph-client.admin.214681.log.gz 2024-04-04T16:50:14.779 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141363.log 2024-04-04T16:50:14.779 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.129397.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.237671.log 2024-04-04T16:50:14.780 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.141363.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.270658.log 2024-04-04T16:50:14.781 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.237671.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.460279.log 2024-04-04T16:50:14.782 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.270658.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.527556.log 2024-04-04T16:50:14.783 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.460279.log: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.262408.log.gz 2024-04-04T16:50:14.783 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.451959.log 2024-04-04T16:50:14.784 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.527556.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.357132.log 2024-04-04T16:50:14.784 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.451959.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162842.log 2024-04-04T16:50:14.785 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.357132.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.352814.log 2024-04-04T16:50:14.786 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.162842.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43565.log 2024-04-04T16:50:14.787 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.352814.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.455852.log 2024-04-04T16:50:14.787 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.43565.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.419146.log 2024-04-04T16:50:14.788 INFO:teuthology.orchestra.run.smithi072.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.400687.log.gz 2024-04-04T16:50:14.788 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.455852.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.284586.log 2024-04-04T16:50:14.789 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.419146.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.320357.log 2024-04-04T16:50:14.790 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.284586.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.205218.log 2024-04-04T16:50:14.791 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.320357.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137089.log 2024-04-04T16:50:14.791 INFO:teuthology.orchestra.run.smithi072.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.365051.log.gz 2024-04-04T16:50:14.792 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.205218.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.471254.log 2024-04-04T16:50:14.792 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.137089.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.451547.log 2024-04-04T16:50:14.793 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.471254.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.399380.log 2024-04-04T16:50:14.794 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.451547.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.482073.log 2024-04-04T16:50:14.795 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.399380.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.470841.log 2024-04-04T16:50:14.795 INFO:teuthology.orchestra.run.smithi072.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.399839.log.gz 2024-04-04T16:50:14.796 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.482073.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.271086.log 2024-04-04T16:50:14.796 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.470841.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161879.log 2024-04-04T16:50:14.797 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.271086.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.386236.log 2024-04-04T16:50:14.798 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.161879.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.549595.log 2024-04-04T16:50:14.799 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.386236.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.487228.log 2024-04-04T16:50:14.800 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.549595.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.494304.log 2024-04-04T16:50:14.801 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.487228.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.408077.log 2024-04-04T16:50:14.801 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.494304.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44707.log 2024-04-04T16:50:14.802 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.408077.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.219924.log 2024-04-04T16:50:14.803 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.44707.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131096.log 2024-04-04T16:50:14.804 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.219924.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.476422.log 2024-04-04T16:50:14.804 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.131096.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.342692.log 2024-04-04T16:50:14.805 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.476422.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134982.log 2024-04-04T16:50:14.806 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.342692.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.487659.log 2024-04-04T16:50:14.807 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.134982.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.351950.log 2024-04-04T16:50:14.807 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.487659.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.244225.log 2024-04-04T16:50:14.808 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.351950.log: gzip -5 --verbose -- 81.0% /var/log/ceph/ceph-client.admin.415767.log 2024-04-04T16:50:14.808 INFO:teuthology.orchestra.run.smithi072.stderr: -- replaced with /var/log/ceph/ceph-client.admin.262834.log.gz 2024-04-04T16:50:14.809 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.244225.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194552.log 2024-04-04T16:50:14.810 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.415767.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.458954.log 2024-04-04T16:50:14.811 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.194552.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.450573.log 2024-04-04T16:50:14.811 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.458954.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.471263.log 2024-04-04T16:50:14.812 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.450573.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49190.log 2024-04-04T16:50:14.813 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.471263.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.316528.log 2024-04-04T16:50:14.814 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.49190.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.528921.log 2024-04-04T16:50:14.814 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.316528.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.232525.log 2024-04-04T16:50:14.815 INFO:teuthology.orchestra.run.smithi072.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.483832.log.gz 2024-04-04T16:50:14.815 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.528921.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.406374.log 2024-04-04T16:50:14.816 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.232525.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.484674.log.gz 2024-04-04T16:50:14.816 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44479.log 2024-04-04T16:50:14.817 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.406374.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.271937.log 2024-04-04T16:50:14.818 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.44479.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.255087.log 2024-04-04T16:50:14.819 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.271937.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.209603.log 2024-04-04T16:50:14.819 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.255087.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.524900.log 2024-04-04T16:50:14.820 INFO:teuthology.orchestra.run.smithi072.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.465187.log.gz 2024-04-04T16:50:14.820 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.209603.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.491349.log 2024-04-04T16:50:14.821 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.524900.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.513497.log 2024-04-04T16:50:14.822 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.491349.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.508856.log 2024-04-04T16:50:14.822 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.513497.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46211.log 2024-04-04T16:50:14.823 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.508856.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.495182.log 2024-04-04T16:50:14.824 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.46211.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.406803.log 2024-04-04T16:50:14.825 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.495182.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.404199.log.gz 2024-04-04T16:50:14.825 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.231523.log 2024-04-04T16:50:14.825 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.406803.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.409787.log 2024-04-04T16:50:14.826 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.231523.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.516457.log 2024-04-04T16:50:14.827 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.409787.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.241528.log 2024-04-04T16:50:14.828 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.516457.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.384939.log.gz 2024-04-04T16:50:14.828 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.234666.log 2024-04-04T16:50:14.829 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.241528.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46631.log 2024-04-04T16:50:14.830 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.234666.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.462425.log 2024-04-04T16:50:14.830 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.46631.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.458533.log 2024-04-04T16:50:14.831 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.462425.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.365551.log 2024-04-04T16:50:14.832 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.458533.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.534132.log 2024-04-04T16:50:14.833 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.237662.log 2024-04-04T16:50:14.833 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.365551.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.398015.log.gz 2024-04-04T16:50:14.834 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.534132.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.205209.log 2024-04-04T16:50:14.835 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.237662.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37333.log 2024-04-04T16:50:14.836 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.205209.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.387128.log 2024-04-04T16:50:14.836 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.37333.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.431189.log 2024-04-04T16:50:14.837 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.387128.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121129.log 2024-04-04T16:50:14.838 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.431189.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181606.log 2024-04-04T16:50:14.839 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.121129.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.213421.log 2024-04-04T16:50:14.840 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.181606.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155053.log 2024-04-04T16:50:14.841 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.213421.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.431630.log 2024-04-04T16:50:14.842 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.155053.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191013.log 2024-04-04T16:50:14.843 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.431630.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.415758.log 2024-04-04T16:50:14.844 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.191013.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.258600.log 2024-04-04T16:50:14.844 INFO:teuthology.orchestra.run.smithi072.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.273263.log.gz 2024-04-04T16:50:14.845 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.415758.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165100.log 2024-04-04T16:50:14.846 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.258600.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.467686.log 2024-04-04T16:50:14.847 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.165100.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47510.log 2024-04-04T16:50:14.847 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.467686.log: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.319066.log.gz 2024-04-04T16:50:14.848 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46337.log 2024-04-04T16:50:14.849 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.47510.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.201619.log 2024-04-04T16:50:14.850 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.46337.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.414042.log 2024-04-04T16:50:14.851 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.201619.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.357544.log 2024-04-04T16:50:14.852 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.414042.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.533257.log 2024-04-04T16:50:14.853 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.357544.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.453727.log 2024-04-04T16:50:14.853 INFO:teuthology.orchestra.run.smithi072.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.407229.log.gz 2024-04-04T16:50:14.854 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.533257.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161328.log 2024-04-04T16:50:14.855 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.453727.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.238980.log 2024-04-04T16:50:14.856 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.161328.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.415327.log 2024-04-04T16:50:14.858 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.238980.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.204310.log 2024-04-04T16:50:14.858 INFO:teuthology.orchestra.run.smithi072.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.335422.log.gz 2024-04-04T16:50:14.859 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.415327.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.504547.log 2024-04-04T16:50:14.859 INFO:teuthology.orchestra.run.smithi072.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.341013.log.gz 2024-04-04T16:50:14.860 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.204310.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.266875.log 2024-04-04T16:50:14.861 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.504547.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.363025.log 2024-04-04T16:50:14.862 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.266875.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.548409.log 2024-04-04T16:50:14.863 INFO:teuthology.orchestra.run.smithi072.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.323325.log.gz 2024-04-04T16:50:14.864 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.363025.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156331.log 2024-04-04T16:50:14.865 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.548409.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.393312.log 2024-04-04T16:50:14.866 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.156331.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156322.log 2024-04-04T16:50:14.867 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.393312.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.211735.log 2024-04-04T16:50:14.868 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.156322.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140042.log 2024-04-04T16:50:14.869 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.211735.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.387137.log 2024-04-04T16:50:14.871 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.140042.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.539470.log 2024-04-04T16:50:14.871 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.387137.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.543964.log 2024-04-04T16:50:14.872 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.539470.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.259865.log 2024-04-04T16:50:14.873 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.543964.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47846.log 2024-04-04T16:50:14.874 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.259865.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152036.log 2024-04-04T16:50:14.875 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.47846.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.251872.log 2024-04-04T16:50:14.876 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.152036.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.231063.log 2024-04-04T16:50:14.877 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.251872.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.463765.log 2024-04-04T16:50:14.878 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.231063.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181180.log 2024-04-04T16:50:14.879 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.463765.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148040.log 2024-04-04T16:50:14.880 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.492196.log 2024-04-04T16:50:14.880 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.181180.log: /var/log/ceph/ceph-client.admin.148040.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.364554.log 2024-04-04T16:50:14.881 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.492196.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.449202.log 2024-04-04T16:50:14.882 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.364554.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.450564.log 2024-04-04T16:50:14.883 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.449202.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47348.log 2024-04-04T16:50:14.883 INFO:teuthology.orchestra.run.smithi072.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.230161.log.gz 2024-04-04T16:50:14.884 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.450564.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.339730.log 2024-04-04T16:50:14.885 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.47348.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.401376.log 2024-04-04T16:50:14.885 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.339730.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155062.log 2024-04-04T16:50:14.886 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.401376.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.387549.log 2024-04-04T16:50:14.887 INFO:teuthology.orchestra.run.smithi072.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.266866.log.gz 2024-04-04T16:50:14.887 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.155062.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.351959.log 2024-04-04T16:50:14.888 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.387549.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.544398.log 2024-04-04T16:50:14.889 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.351959.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.275451.log 2024-04-04T16:50:14.890 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.544398.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.432097.log 2024-04-04T16:50:14.891 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.275451.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.408068.log 2024-04-04T16:50:14.892 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.432097.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.360318.log 2024-04-04T16:50:14.893 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.408068.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.200252.log 2024-04-04T16:50:14.894 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.360318.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.246400.log 2024-04-04T16:50:14.895 INFO:teuthology.orchestra.run.smithi072.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.455852.log.gz 2024-04-04T16:50:14.895 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.200252.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.243714.log 2024-04-04T16:50:14.896 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.246400.log: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.452385.log.gz 2024-04-04T16:50:14.896 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142726.log 2024-04-04T16:50:14.897 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.243714.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.479465.log 2024-04-04T16:50:14.898 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.142726.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.509709.log 2024-04-04T16:50:14.899 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.479465.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.474254.log.gz 2024-04-04T16:50:14.899 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.336264.log 2024-04-04T16:50:14.900 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.509709.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113554.log 2024-04-04T16:50:14.901 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.336264.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143618.log 2024-04-04T16:50:14.902 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.113554.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.319075.log 2024-04-04T16:50:14.903 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.143618.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130661.log 2024-04-04T16:50:14.904 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.319075.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.2.45786.log 2024-04-04T16:50:14.905 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.130661.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152885.log 2024-04-04T16:50:14.905 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.2.45786.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.401522.log 2024-04-04T16:50:14.906 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.152885.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50107.log 2024-04-04T16:50:14.908 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.401522.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.531534.log 2024-04-04T16:50:14.909 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.50107.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.401473.log 2024-04-04T16:50:14.910 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.531534.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.434234.log 2024-04-04T16:50:14.911 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.401473.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.387971.log 2024-04-04T16:50:14.912 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.434234.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.474676.log 2024-04-04T16:50:14.912 INFO:teuthology.orchestra.run.smithi072.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.48088.log.gz 2024-04-04T16:50:14.913 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.387971.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165109.log 2024-04-04T16:50:14.913 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.474676.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.479941.log 2024-04-04T16:50:14.914 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.165109.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.46463.log.gz 2024-04-04T16:50:14.915 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.521772.log 2024-04-04T16:50:14.915 INFO:teuthology.orchestra.run.smithi072.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.49621.log.gz 2024-04-04T16:50:14.915 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.479941.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.407650.log 2024-04-04T16:50:14.916 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.521772.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.468992.log 2024-04-04T16:50:14.917 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.407650.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.493884.log 2024-04-04T16:50:14.918 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.468992.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.549385.log 2024-04-04T16:50:14.919 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.493884.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.493452.log 2024-04-04T16:50:14.920 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.549385.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.491115.log 2024-04-04T16:50:14.921 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.493452.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.547050.log 2024-04-04T16:50:14.922 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.491115.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.268980.log 2024-04-04T16:50:14.923 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.547050.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.512662.log 2024-04-04T16:50:14.924 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.268980.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.417044.log 2024-04-04T16:50:14.925 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.512662.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.220765.log 2024-04-04T16:50:14.925 INFO:teuthology.orchestra.run.smithi072.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.137924.log.gz 2024-04-04T16:50:14.925 INFO:teuthology.orchestra.run.smithi072.stderr: 81.1%/var/log/ceph/ceph-client.admin.417044.log: -- replaced with /var/log/ceph/ceph-client.admin.138347.log.gz 2024-04-04T16:50:14.926 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.459419.log 2024-04-04T16:50:14.927 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.220765.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.232516.log 2024-04-04T16:50:14.928 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.459419.log: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.228613.log.gz 2024-04-04T16:50:14.928 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.540793.log 2024-04-04T16:50:14.928 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.232516.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.486390.log 2024-04-04T16:50:14.929 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.540793.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42799.log 2024-04-04T16:50:14.930 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.486390.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.332900.log 2024-04-04T16:50:14.931 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.42799.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48130.log 2024-04-04T16:50:14.932 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.332900.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.322047.log 2024-04-04T16:50:14.933 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.433818.log 2024-04-04T16:50:14.934 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.48130.log: /var/log/ceph/ceph-client.admin.322047.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.232988.log 2024-04-04T16:50:14.935 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.433818.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118965.log 2024-04-04T16:50:14.936 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.232988.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.395452.log 2024-04-04T16:50:14.936 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.118965.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.237250.log 2024-04-04T16:50:14.937 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.395452.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.543973.log 2024-04-04T16:50:14.938 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.237250.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.468983.log 2024-04-04T16:50:14.939 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.543973.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164115.log 2024-04-04T16:50:14.940 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.468983.log: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.401464.log.gz 2024-04-04T16:50:14.940 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.327699.log 2024-04-04T16:50:14.941 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.164115.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.516026.log 2024-04-04T16:50:14.942 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.327699.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157285.log 2024-04-04T16:50:14.943 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.516026.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.475578.log 2024-04-04T16:50:14.943 INFO:teuthology.orchestra.run.smithi072.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47636.log.gz 2024-04-04T16:50:14.944 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.157285.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.362095.log 2024-04-04T16:50:14.945 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.475578.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112043.log 2024-04-04T16:50:14.946 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.362095.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.546165.log 2024-04-04T16:50:14.946 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.112043.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.516870.log 2024-04-04T16:50:14.947 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.546165.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.283738.log 2024-04-04T16:50:14.948 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.516870.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.386670.log 2024-04-04T16:50:14.949 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143627.log 2024-04-04T16:50:14.950 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.283738.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.134560.log.gz 2024-04-04T16:50:14.950 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.386670.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.342269.log 2024-04-04T16:50:14.950 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.143627.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.512653.log 2024-04-04T16:50:14.951 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.342269.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.391584.log 2024-04-04T16:50:14.952 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.512653.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.469869.log 2024-04-04T16:50:14.953 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.391584.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.448777.log 2024-04-04T16:50:14.954 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.469869.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.534141.log 2024-04-04T16:50:14.954 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.448777.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.411908.log 2024-04-04T16:50:14.955 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.534141.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188770.log 2024-04-04T16:50:14.956 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.411908.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.213844.log 2024-04-04T16:50:14.957 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.188770.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.517716.log 2024-04-04T16:50:14.957 INFO:teuthology.orchestra.run.smithi072.stderr: 83.7% -- replaced with /var/log/ceph/ceph-client.admin.153742.log.gz 2024-04-04T16:50:14.958 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.213844.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.354161.log 2024-04-04T16:50:14.958 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.517716.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.452853.log 2024-04-04T16:50:14.959 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.354161.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.259017.log 2024-04-04T16:50:14.962 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.452853.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125617.log 2024-04-04T16:50:14.963 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.259017.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144466.log 2024-04-04T16:50:14.963 INFO:teuthology.orchestra.run.smithi072.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.155062.log.gz 2024-04-04T16:50:14.963 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.125617.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.421292.log 2024-04-04T16:50:14.963 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.144466.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.538138.log 2024-04-04T16:50:14.964 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.421292.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.449653.log 2024-04-04T16:50:14.964 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.538138.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.454158.log 2024-04-04T16:50:14.964 INFO:teuthology.orchestra.run.smithi072.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.417044.log.gz 2024-04-04T16:50:14.965 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.449653.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133703.log 2024-04-04T16:50:14.965 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.454158.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138356.log 2024-04-04T16:50:14.966 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.133703.log: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.143618.log.gz 2024-04-04T16:50:14.966 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.259026.log 2024-04-04T16:50:14.967 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.138356.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42711.log 2024-04-04T16:50:14.968 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.259026.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.490851.log 2024-04-04T16:50:14.968 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.42711.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.197144.log 2024-04-04T16:50:14.969 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.490851.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.261143.log 2024-04-04T16:50:14.970 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.197144.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.162851.log.gz 2024-04-04T16:50:14.970 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.257331.log 2024-04-04T16:50:14.971 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.261143.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.341857.log 2024-04-04T16:50:14.972 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.257331.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.390719.log 2024-04-04T16:50:14.972 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.341857.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.321627.log 2024-04-04T16:50:14.973 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.390719.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110673.log 2024-04-04T16:50:14.974 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.321627.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194122.log 2024-04-04T16:50:14.975 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.110673.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.265603.log 2024-04-04T16:50:14.976 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47888.log 2024-04-04T16:50:14.976 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.194122.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.244225.log.gz 2024-04-04T16:50:14.977 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.265603.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.549133.log 2024-04-04T16:50:14.978 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.47888.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.447092.log 2024-04-04T16:50:14.979 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.549133.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.404625.log 2024-04-04T16:50:14.980 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.447092.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165558.log 2024-04-04T16:50:14.981 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.404625.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.548325.log 2024-04-04T16:50:14.982 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.165558.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.527565.log 2024-04-04T16:50:14.983 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.548325.log: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.211305.log.gz 2024-04-04T16:50:14.983 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.224356.log 2024-04-04T16:50:14.984 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.527565.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.384026.log 2024-04-04T16:50:14.985 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.224356.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.208770.log 2024-04-04T16:50:14.986 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.384026.log: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.191013.log.gz 2024-04-04T16:50:14.987 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183730.log 2024-04-04T16:50:14.987 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.208770.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.517293.log 2024-04-04T16:50:14.988 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.183730.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.239835.log 2024-04-04T16:50:14.989 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.517293.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.468128.log 2024-04-04T16:50:14.990 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.239835.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.398966.log 2024-04-04T16:50:14.991 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.468128.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.528056.log 2024-04-04T16:50:14.992 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.398966.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.261565.log 2024-04-04T16:50:14.992 INFO:teuthology.orchestra.run.smithi072.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.317806.log.gz 2024-04-04T16:50:14.993 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.528056.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.477688.log 2024-04-04T16:50:14.993 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.261565.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.434113.log 2024-04-04T16:50:14.994 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.477688.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.468137.log 2024-04-04T16:50:14.995 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.434113.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.429508.log 2024-04-04T16:50:14.995 INFO:teuthology.orchestra.run.smithi072.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.451538.log.gz 2024-04-04T16:50:14.996 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.468137.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.451547.log.gz 2024-04-04T16:50:14.996 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.325453.log 2024-04-04T16:50:14.997 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.429508.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.332478.log 2024-04-04T16:50:14.998 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.325453.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180759.log 2024-04-04T16:50:14.998 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.332478.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44227.log 2024-04-04T16:50:14.999 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.180759.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.548241.log 2024-04-04T16:50:15.000 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.44227.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.457122.log 2024-04-04T16:50:15.001 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.548241.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.220765.log.gz 2024-04-04T16:50:15.001 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.515183.log 2024-04-04T16:50:15.002 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.457122.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.414033.log 2024-04-04T16:50:15.002 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.515183.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.529347.log 2024-04-04T16:50:15.003 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.414033.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.222019.log 2024-04-04T16:50:15.004 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.529347.log: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.280522.log.gz 2024-04-04T16:50:15.005 INFO:teuthology.orchestra.run.smithi072.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.280106.log.gz 2024-04-04T16:50:15.005 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.326857.log 2024-04-04T16:50:15.005 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.222019.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.530618.log 2024-04-04T16:50:15.006 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.326857.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.209191.log 2024-04-04T16:50:15.007 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.530618.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.260296.log 2024-04-04T16:50:15.007 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.209191.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44353.log 2024-04-04T16:50:15.009 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.260296.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.337118.log 2024-04-04T16:50:15.009 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43214.log 2024-04-04T16:50:15.010 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.44353.log: /var/log/ceph/ceph-client.admin.337118.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.531950.log 2024-04-04T16:50:15.011 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.43214.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43814.log 2024-04-04T16:50:15.012 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.531950.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.411899.log 2024-04-04T16:50:15.013 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.43814.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.219074.log 2024-04-04T16:50:15.013 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.411899.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.346093.log 2024-04-04T16:50:15.014 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.219074.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.414484.log 2024-04-04T16:50:15.015 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.346093.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.196686.log 2024-04-04T16:50:15.016 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.414484.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.447505.log 2024-04-04T16:50:15.017 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.196686.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.197568.log 2024-04-04T16:50:15.017 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.447505.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.349820.log 2024-04-04T16:50:15.018 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.197568.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.403764.log 2024-04-04T16:50:15.019 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.349820.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.548965.log 2024-04-04T16:50:15.020 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.403764.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.391593.log 2024-04-04T16:50:15.020 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.548965.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.236396.log 2024-04-04T16:50:15.022 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.391593.log: 77.8% -- replaced with /var/log/ceph/ceph-client.admin.133703.log.gz 2024-04-04T16:50:15.022 INFO:teuthology.orchestra.run.smithi072.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.214258.log.gz 2024-04-04T16:50:15.022 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44749.log 2024-04-04T16:50:15.022 INFO:teuthology.orchestra.run.smithi072.stderr: 78.5% -- replaced with /var/log/ceph/ceph-client.admin.484665.log.gz 2024-04-04T16:50:15.023 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.236396.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.513927.log 2024-04-04T16:50:15.024 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.44749.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180329.log 2024-04-04T16:50:15.025 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.513927.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.488974.log 2024-04-04T16:50:15.026 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.180329.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182870.log 2024-04-04T16:50:15.027 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.488974.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.516035.log 2024-04-04T16:50:15.028 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.182870.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.217308.log 2024-04-04T16:50:15.029 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.516035.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.339315.log 2024-04-04T16:50:15.030 INFO:teuthology.orchestra.run.smithi072.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.365551.log.gz 2024-04-04T16:50:15.030 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.217308.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.202069.log 2024-04-04T16:50:15.031 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.339315.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.274978.log 2024-04-04T16:50:15.032 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.202069.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120276.log 2024-04-04T16:50:15.033 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.274978.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.396590.log 2024-04-04T16:50:15.034 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.120276.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.262843.log 2024-04-04T16:50:15.035 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.396590.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.238093.log 2024-04-04T16:50:15.035 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.262843.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.507278.log 2024-04-04T16:50:15.036 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.238093.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.357975.log 2024-04-04T16:50:15.037 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.507278.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.347388.log 2024-04-04T16:50:15.038 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.357975.log: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.363025.log.gz 2024-04-04T16:50:15.038 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.417456.log 2024-04-04T16:50:15.038 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.347388.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.253401.log 2024-04-04T16:50:15.039 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.417456.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.266033.log 2024-04-04T16:50:15.040 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.253401.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.405484.log 2024-04-04T16:50:15.041 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.266033.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186091.log 2024-04-04T16:50:15.042 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.405484.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.548367.log 2024-04-04T16:50:15.042 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.186091.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.202961.log 2024-04-04T16:50:15.043 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.548367.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.389878.log 2024-04-04T16:50:15.044 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.202961.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.541672.log 2024-04-04T16:50:15.045 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.389878.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.216409.log 2024-04-04T16:50:15.046 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.541672.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.212568.log 2024-04-04T16:50:15.047 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.216409.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.269392.log 2024-04-04T16:50:15.048 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.518147.log 2024-04-04T16:50:15.048 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.212568.log: /var/log/ceph/ceph-client.admin.269392.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.256896.log 2024-04-04T16:50:15.049 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.518147.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.270236.log 2024-04-04T16:50:15.050 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.256896.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.354581.log 2024-04-04T16:50:15.051 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.270236.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118518.log 2024-04-04T16:50:15.051 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.354581.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164412.log 2024-04-04T16:50:15.053 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.118518.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142735.log 2024-04-04T16:50:15.054 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.164412.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.249694.log 2024-04-04T16:50:15.055 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.142735.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.347865.log 2024-04-04T16:50:15.056 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.249694.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112569.log 2024-04-04T16:50:15.057 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.347865.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37222.log 2024-04-04T16:50:15.058 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.112569.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.528912.log 2024-04-04T16:50:15.059 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.37222.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.331635.log 2024-04-04T16:50:15.059 INFO:teuthology.orchestra.run.smithi072.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.366494.log.gz 2024-04-04T16:50:15.060 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.528912.log: 83.7% 85.2% -- replaced with /var/log/ceph/ceph-client.admin.351496.log.gz 2024-04-04T16:50:15.060 INFO:teuthology.orchestra.run.smithi072.stderr: -- replaced with /var/log/ceph/ceph-client.admin.351950.log.gz 2024-04-04T16:50:15.060 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.548115.log 2024-04-04T16:50:15.061 INFO:teuthology.orchestra.run.smithi072.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.351959.log.gz 2024-04-04T16:50:15.061 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.331635.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49334.log 2024-04-04T16:50:15.062 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.548115.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144903.log 2024-04-04T16:50:15.063 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.49334.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.500834.log 2024-04-04T16:50:15.064 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.144903.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.499551.log 2024-04-04T16:50:15.065 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.500834.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.236828.log 2024-04-04T16:50:15.066 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.499551.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.404190.log 2024-04-04T16:50:15.067 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.236828.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46589.log 2024-04-04T16:50:15.068 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.404190.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.255622.log 2024-04-04T16:50:15.068 INFO:teuthology.orchestra.run.smithi072.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.316528.log.gz 2024-04-04T16:50:15.069 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.46589.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.252307.log 2024-04-04T16:50:15.070 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.255622.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.208345.log 2024-04-04T16:50:15.071 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.252307.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141798.log 2024-04-04T16:50:15.072 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.208345.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.282416.log 2024-04-04T16:50:15.073 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.141798.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.504538.log 2024-04-04T16:50:15.073 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.282416.log: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.490851.log.gz 2024-04-04T16:50:15.074 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.214267.log 2024-04-04T16:50:15.074 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.504538.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.482922.log 2024-04-04T16:50:15.075 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.214267.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.461995.log 2024-04-04T16:50:15.076 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.482922.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139193.log 2024-04-04T16:50:15.078 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.461995.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.491775.log 2024-04-04T16:50:15.079 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.139193.log: gzip -5 84.4% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.495173.log.gz /var/log/ceph/ceph-client.admin.394574.log 2024-04-04T16:50:15.079 INFO:teuthology.orchestra.run.smithi072.stderr: 2024-04-04T16:50:15.080 INFO:teuthology.orchestra.run.smithi072.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.479941.log.gz 2024-04-04T16:50:15.080 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.491775.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.482485.log 2024-04-04T16:50:15.080 INFO:teuthology.orchestra.run.smithi072.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.479465.log.gz 2024-04-04T16:50:15.081 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.394574.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.206556.log 2024-04-04T16:50:15.082 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.482485.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.411473.log 2024-04-04T16:50:15.083 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.206556.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135395.log 2024-04-04T16:50:15.084 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.411473.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132006.log 2024-04-04T16:50:15.085 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.135395.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.531959.log 2024-04-04T16:50:15.086 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.132006.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.523992.log 2024-04-04T16:50:15.087 INFO:teuthology.orchestra.run.smithi072.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.468983.log.gz 2024-04-04T16:50:15.087 INFO:teuthology.orchestra.run.smithi072.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.468563.log.gz 2024-04-04T16:50:15.087 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.531959.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151489.log 2024-04-04T16:50:15.088 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.523992.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.394155.log 2024-04-04T16:50:15.089 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.151489.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.492617.log 2024-04-04T16:50:15.090 INFO:teuthology.orchestra.run.smithi072.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.395452.log.gz 2024-04-04T16:50:15.090 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.394155.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.521772.log.gz 2024-04-04T16:50:15.091 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.267287.log 2024-04-04T16:50:15.091 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.492617.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50498.log 2024-04-04T16:50:15.093 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.267287.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.248822.log 2024-04-04T16:50:15.094 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.50498.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114429.log 2024-04-04T16:50:15.094 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.248822.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.46085.log.gz 2024-04-04T16:50:15.095 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.356702.log 2024-04-04T16:50:15.096 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.114429.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.497095.log 2024-04-04T16:50:15.097 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.356702.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46379.log 2024-04-04T16:50:15.098 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.497095.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.434234.log.gz 2024-04-04T16:50:15.098 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50242.log 2024-04-04T16:50:15.099 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.46379.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.261134.log 2024-04-04T16:50:15.100 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.361179.log 2024-04-04T16:50:15.100 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.50242.log: /var/log/ceph/ceph-client.admin.261134.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134129.log 2024-04-04T16:50:15.101 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.361179.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.481651.log.gz 2024-04-04T16:50:15.101 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.526648.log 2024-04-04T16:50:15.102 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.134129.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.446172.log 2024-04-04T16:50:15.103 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.526648.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43857.log 2024-04-04T16:50:15.104 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.446172.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.346936.log 2024-04-04T16:50:15.104 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.43857.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48230.log 2024-04-04T16:50:15.105 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.346936.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.339306.log 2024-04-04T16:50:15.106 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.48230.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126371.log 2024-04-04T16:50:15.106 INFO:teuthology.orchestra.run.smithi072.stderr: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.468128.log.gz 2024-04-04T16:50:15.107 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.339306.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.468137.log.gz 2024-04-04T16:50:15.107 INFO:teuthology.orchestra.run.smithi072.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.467686.log.gz 2024-04-04T16:50:15.107 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-04T16:50:15.108 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.126371.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.199810.log 2024-04-04T16:50:15.109 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph.audit.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.50107.log.gz 2024-04-04T16:50:15.110 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119854.log 2024-04-04T16:50:15.110 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.199810.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.385356.log 2024-04-04T16:50:15.112 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.119854.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.221607.log 2024-04-04T16:50:15.113 INFO:teuthology.orchestra.run.smithi072.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.482922.log.gz 2024-04-04T16:50:15.113 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5/var/log/ceph/ceph-client.admin.385356.log: --verbose -- /var/log/ceph/ceph-client.admin.459857.log 2024-04-04T16:50:15.113 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.221607.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.337535.log 2024-04-04T16:50:15.115 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.459857.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.548157.log 2024-04-04T16:50:15.116 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.364563.log 2024-04-04T16:50:15.116 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.337535.log: /var/log/ceph/ceph-client.admin.548157.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.448356.log 2024-04-04T16:50:15.117 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.535022.log 2024-04-04T16:50:15.119 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.364563.log: /var/log/ceph/ceph-client.admin.448356.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.235983.log 2024-04-04T16:50:15.119 INFO:teuthology.orchestra.run.smithi072.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.46211.log.gz 2024-04-04T16:50:15.120 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.535022.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.271507.log 2024-04-04T16:50:15.121 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.235983.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129829.log 2024-04-04T16:50:15.121 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.271507.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.514348.log 2024-04-04T16:50:15.122 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.129829.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.213835.log 2024-04-04T16:50:15.123 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.514348.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.274969.log 2024-04-04T16:50:15.124 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.213835.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.540784.log 2024-04-04T16:50:15.125 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.274969.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.399848.log 2024-04-04T16:50:15.126 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.540784.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.419609.log 2024-04-04T16:50:15.127 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.399848.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.523983.log 2024-04-04T16:50:15.128 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.419609.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.226926.log 2024-04-04T16:50:15.129 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.523983.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.400696.log 2024-04-04T16:50:15.130 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.226926.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.282425.log 2024-04-04T16:50:15.131 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.400696.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45392.log 2024-04-04T16:50:15.132 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.282425.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.360766.log 2024-04-04T16:50:15.133 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.45392.log: 91.5% -- replaced with /var/log/ceph/ceph-client.admin.491115.log.gz 2024-04-04T16:50:15.133 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.250552.log 2024-04-04T16:50:15.134 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.360766.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.401108.log 2024-04-04T16:50:15.135 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.250552.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.240249.log 2024-04-04T16:50:15.136 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.401108.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.448768.log 2024-04-04T16:50:15.137 INFO:teuthology.orchestra.run.smithi072.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.139193.log.gz 2024-04-04T16:50:15.137 INFO:teuthology.orchestra.run.smithi072.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.516879.log.gz 2024-04-04T16:50:15.138 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.240249.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.134138.log.gz 2024-04-04T16:50:15.138 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.516448.log 2024-04-04T16:50:15.138 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.448768.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.245069.log 2024-04-04T16:50:15.139 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.516448.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184170.log 2024-04-04T16:50:15.140 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.245069.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.316537.log 2024-04-04T16:50:15.141 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.184170.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.222454.log 2024-04-04T16:50:15.142 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.316537.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126811.log 2024-04-04T16:50:15.143 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.222454.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.543533.log 2024-04-04T16:50:15.145 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.126811.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163273.log 2024-04-04T16:50:15.145 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.543533.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.540340.log 2024-04-04T16:50:15.147 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.163273.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.315259.log 2024-04-04T16:50:15.148 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.540340.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192036.log 2024-04-04T16:50:15.149 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.315259.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.392454.log 2024-04-04T16:50:15.150 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.192036.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.334152.log 2024-04-04T16:50:15.151 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.392454.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.485535.log 2024-04-04T16:50:15.152 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.334152.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.521267.log 2024-04-04T16:50:15.152 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.485535.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.461583.log 2024-04-04T16:50:15.153 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.521267.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.219504.log 2024-04-04T16:50:15.154 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.461583.log: 78.3% -- replaced with /var/log/ceph/ceph-client.admin.447505.log.gz 2024-04-04T16:50:15.154 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.351084.log 2024-04-04T16:50:15.156 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.219504.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.478586.log 2024-04-04T16:50:15.157 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.351084.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.451968.log 2024-04-04T16:50:15.158 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.478586.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132438.log 2024-04-04T16:50:15.159 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.451968.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49767.log 2024-04-04T16:50:15.160 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.132438.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.332900.log.gz 2024-04-04T16:50:15.160 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.250965.log 2024-04-04T16:50:15.161 INFO:teuthology.orchestra.run.smithi072.stderr: 78.3% -- replaced with /var/log/ceph/ceph-client.admin.343551.log.gz 2024-04-04T16:50:15.161 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.49767.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.526224.log 2024-04-04T16:50:15.162 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.250965.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71417.log 2024-04-04T16:50:15.163 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.526224.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.490860.log 2024-04-04T16:50:15.164 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.71417.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.394583.log 2024-04-04T16:50:15.166 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.490860.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.267296.log 2024-04-04T16:50:15.169 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.394583.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.432088.log 2024-04-04T16:50:15.170 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.267296.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.410208.log 2024-04-04T16:50:15.170 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.432088.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.324165.log 2024-04-04T16:50:15.171 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.410208.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.386227.log 2024-04-04T16:50:15.171 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.324165.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70940.log 2024-04-04T16:50:15.171 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.386227.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.205658.log 2024-04-04T16:50:15.172 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.70940.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.413188.log 2024-04-04T16:50:15.173 INFO:teuthology.orchestra.run.smithi072.stderr: 78.2% -- replaced with /var/log/ceph/ceph-client.admin.261134.log.gz 2024-04-04T16:50:15.173 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.205658.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.502123.log 2024-04-04T16:50:15.174 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.413188.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.256905.log 2024-04-04T16:50:15.175 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.502123.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.359418.log 2024-04-04T16:50:15.176 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.256905.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.470347.log 2024-04-04T16:50:15.177 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.359418.log: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.356702.log.gz 2024-04-04T16:50:15.177 INFO:teuthology.orchestra.run.smithi072.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.357544.log.gz 2024-04-04T16:50:15.177 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.522185.log 2024-04-04T16:50:15.178 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.470347.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.420875.log 2024-04-04T16:50:15.179 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.522185.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.489834.log 2024-04-04T16:50:15.180 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.420875.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.210024.log 2024-04-04T16:50:15.181 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.489834.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.259443.log 2024-04-04T16:50:15.182 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.210024.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.538582.log 2024-04-04T16:50:15.183 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.259443.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.359855.log 2024-04-04T16:50:15.184 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.538582.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.529770.log 2024-04-04T16:50:15.185 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.359855.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.212156.log 2024-04-04T16:50:15.186 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.529770.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.325890.log 2024-04-04T16:50:15.187 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.212156.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.408954.log 2024-04-04T16:50:15.188 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.325890.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46799.log 2024-04-04T16:50:15.189 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.408954.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127693.log 2024-04-04T16:50:15.190 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.46799.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.522606.log 2024-04-04T16:50:15.191 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.127693.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.522615.log 2024-04-04T16:50:15.193 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.522606.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50540.log 2024-04-04T16:50:15.194 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.522615.log: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.204310.log.gz 2024-04-04T16:50:15.194 INFO:teuthology.orchestra.run.smithi072.stderr: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.204760.log.gz 2024-04-04T16:50:15.194 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43233.log 2024-04-04T16:50:15.194 INFO:teuthology.orchestra.run.smithi072.stderr: 84.4% -- replaced with /var/log/ceph/ceph-client.admin.282416.log.gz 2024-04-04T16:50:15.195 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.50540.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186100.log 2024-04-04T16:50:15.196 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.43233.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.398957.log 2024-04-04T16:50:15.197 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.186100.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.336676.log 2024-04-04T16:50:15.198 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.398957.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.30951.log 2024-04-04T16:50:15.199 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.336676.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154633.log 2024-04-04T16:50:15.199 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph.tmp-client.admin.30951.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.30951.log.gz 2024-04-04T16:50:15.200 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.263269.log 2024-04-04T16:50:15.201 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.154633.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126380.log 2024-04-04T16:50:15.202 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.263269.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.472791.log 2024-04-04T16:50:15.203 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.126380.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.388845.log 2024-04-04T16:50:15.204 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.472791.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.549637.log 2024-04-04T16:50:15.205 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.388845.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.493038.log 2024-04-04T16:50:15.206 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.549637.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.518601.log 2024-04-04T16:50:15.207 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.493038.log: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.354581.log.gz 2024-04-04T16:50:15.207 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42362.log 2024-04-04T16:50:15.208 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.518601.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42008.log 2024-04-04T16:50:15.209 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.42362.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.384445.log 2024-04-04T16:50:15.210 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.42008.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.489394.log 2024-04-04T16:50:15.211 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.384445.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.198912.log 2024-04-04T16:50:15.212 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.489394.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.467677.log 2024-04-04T16:50:15.213 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.198912.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.387558.log 2024-04-04T16:50:15.214 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.467677.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.264534.log 2024-04-04T16:50:15.214 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.387558.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.202970.log 2024-04-04T16:50:15.215 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.264534.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.205667.log 2024-04-04T16:50:15.216 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.202970.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112034.log 2024-04-04T16:50:15.217 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.205667.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.433827.log 2024-04-04T16:50:15.218 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.112034.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.348350.log 2024-04-04T16:50:15.218 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.433827.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140895.log 2024-04-04T16:50:15.219 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.348350.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130670.log 2024-04-04T16:50:15.220 INFO:teuthology.orchestra.run.smithi072.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.259017.log.gz 2024-04-04T16:50:15.220 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.140895.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.259026.log.gz 2024-04-04T16:50:15.221 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.272349.log 2024-04-04T16:50:15.221 INFO:teuthology.orchestra.run.smithi072.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.213835.log.gz 2024-04-04T16:50:15.222 INFO:teuthology.orchestra.run.smithi072.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.213844.log.gz 2024-04-04T16:50:15.222 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.130670.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165549.log 2024-04-04T16:50:15.223 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.272349.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.356282.log 2024-04-04T16:50:15.224 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.165549.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46043.log 2024-04-04T16:50:15.225 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.356282.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43878.log 2024-04-04T16:50:15.226 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.46043.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.321214.log 2024-04-04T16:50:15.227 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.43878.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.530196.log 2024-04-04T16:50:15.229 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.321214.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.534577.log 2024-04-04T16:50:15.229 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.530196.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.471740.log 2024-04-04T16:50:15.230 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.534577.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111527.log 2024-04-04T16:50:15.231 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.471740.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147175.log 2024-04-04T16:50:15.232 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.111527.log: 78.4% -- replaced with /var/log/ceph/ceph-client.admin.385356.log.gz 2024-04-04T16:50:15.232 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.503331.log 2024-04-04T16:50:15.232 INFO:teuthology.orchestra.run.smithi072.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.419609.log.gz 2024-04-04T16:50:15.233 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.147175.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.432529.log 2024-04-04T16:50:15.234 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.503331.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131557.log 2024-04-04T16:50:15.235 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.432529.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.430351.log 2024-04-04T16:50:15.236 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.131557.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.241973.log 2024-04-04T16:50:15.237 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.430351.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182879.log 2024-04-04T16:50:15.238 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.241973.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.494746.log 2024-04-04T16:50:15.239 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.182879.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.397539.log 2024-04-04T16:50:15.240 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.494746.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.510552.log 2024-04-04T16:50:15.241 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.397539.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114438.log 2024-04-04T16:50:15.242 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.510552.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.412328.log 2024-04-04T16:50:15.242 INFO:teuthology.orchestra.run.smithi072.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.401108.log.gz 2024-04-04T16:50:15.243 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.114438.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.447514.log 2024-04-04T16:50:15.243 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.412328.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.196695.log 2024-04-04T16:50:15.244 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.447514.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.223083.log 2024-04-04T16:50:15.245 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.196695.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.536353.log 2024-04-04T16:50:15.246 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.223083.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.536362.log 2024-04-04T16:50:15.247 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.536353.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.355431.log 2024-04-04T16:50:15.247 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.536362.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144040.log 2024-04-04T16:50:15.248 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.355431.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.476431.log 2024-04-04T16:50:15.250 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.144040.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.510964.log 2024-04-04T16:50:15.250 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.456274.log 2024-04-04T16:50:15.251 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.476431.log: /var/log/ceph/ceph-client.admin.510964.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.548283.log 2024-04-04T16:50:15.251 INFO:teuthology.orchestra.run.smithi072.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.359418.log.gz 2024-04-04T16:50:15.252 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.456274.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.418313.log 2024-04-04T16:50:15.253 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.548283.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132429.log 2024-04-04T16:50:15.253 INFO:teuthology.orchestra.run.smithi072.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.385782.log.gz 2024-04-04T16:50:15.253 INFO:teuthology.orchestra.run.smithi072.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.485954.log.gz 2024-04-04T16:50:15.254 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.418313.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128554.log 2024-04-04T16:50:15.254 INFO:teuthology.orchestra.run.smithi072.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.485535.log.gz 2024-04-04T16:50:15.255 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.132429.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.223935.log 2024-04-04T16:50:15.256 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.128554.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.235552.log 2024-04-04T16:50:15.257 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.223935.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.273254.log 2024-04-04T16:50:15.258 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.235552.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50063.log 2024-04-04T16:50:15.259 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.273254.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.202520.log 2024-04-04T16:50:15.260 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.50063.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.471749.log 2024-04-04T16:50:15.261 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.202520.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193701.log 2024-04-04T16:50:15.263 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.471749.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.210875.log 2024-04-04T16:50:15.263 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.193701.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.330336.log 2024-04-04T16:50:15.265 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.210875.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.512241.log 2024-04-04T16:50:15.265 INFO:teuthology.orchestra.run.smithi072.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.357975.log.gz 2024-04-04T16:50:15.266 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.330336.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.398966.log.gz 2024-04-04T16:50:15.266 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189644.log 2024-04-04T16:50:15.267 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.512241.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.264113.log 2024-04-04T16:50:15.268 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.189644.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48272.log 2024-04-04T16:50:15.269 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.264113.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.549721.log 2024-04-04T16:50:15.270 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.48272.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.520409.log 2024-04-04T16:50:15.271 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.549721.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.462901.log 2024-04-04T16:50:15.272 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.520409.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141789.log 2024-04-04T16:50:15.273 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.462901.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127684.log 2024-04-04T16:50:15.273 INFO:teuthology.orchestra.run.smithi072.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.314846.log.gz 2024-04-04T16:50:15.274 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.141789.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.214690.log 2024-04-04T16:50:15.274 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.127684.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.473832.log 2024-04-04T16:50:15.275 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.214690.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.461162.log 2024-04-04T16:50:15.276 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.473832.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118956.log 2024-04-04T16:50:15.277 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.461162.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.405493.log 2024-04-04T16:50:15.278 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.118956.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.517725.log 2024-04-04T16:50:15.278 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.405493.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.232001.log 2024-04-04T16:50:15.279 INFO:teuthology.orchestra.run.smithi072.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.531950.log.gz 2024-04-04T16:50:15.279 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.517725.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139626.log 2024-04-04T16:50:15.280 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.232001.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.531959.log.gz 2024-04-04T16:50:15.280 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.326404.log 2024-04-04T16:50:15.281 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.139626.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.466161.log 2024-04-04T16:50:15.282 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.326404.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.392875.log 2024-04-04T16:50:15.283 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.466161.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.393733.log 2024-04-04T16:50:15.283 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.392875.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46169.log 2024-04-04T16:50:15.284 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.393733.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.523529.log 2024-04-04T16:50:15.285 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.46169.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.538573.log 2024-04-04T16:50:15.286 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.523529.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145772.log 2024-04-04T16:50:15.287 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.538573.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132860.log 2024-04-04T16:50:15.288 INFO:teuthology.orchestra.run.smithi072.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48602.log.gz 2024-04-04T16:50:15.288 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.145772.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42196.log 2024-04-04T16:50:15.288 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.132860.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191528.log 2024-04-04T16:50:15.289 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.42196.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.221177.log 2024-04-04T16:50:15.290 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.191528.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.319496.log 2024-04-04T16:50:15.291 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128563.log 2024-04-04T16:50:15.292 INFO:teuthology.orchestra.run.smithi072.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.461583.log.gz 2024-04-04T16:50:15.292 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.221177.log: /var/log/ceph/ceph-client.admin.319496.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47390.log 2024-04-04T16:50:15.293 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.128563.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.449211.log 2024-04-04T16:50:15.294 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.47390.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.493029.log 2024-04-04T16:50:15.295 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.449211.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.516035.log.gz 2024-04-04T16:50:15.295 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.315268.log 2024-04-04T16:50:15.295 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.493029.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.283729.log 2024-04-04T16:50:15.296 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.315268.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152467.log 2024-04-04T16:50:15.297 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.283729.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.392019.log 2024-04-04T16:50:15.298 INFO:teuthology.orchestra.run.smithi072.stderr: 78.7% -- replaced with /var/log/ceph/ceph-client.admin.527068.log.gz 2024-04-04T16:50:15.298 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.152467.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.210866.log 2024-04-04T16:50:15.299 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.392019.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.228201.log 2024-04-04T16:50:15.300 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.210866.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.466639.log 2024-04-04T16:50:15.301 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.228201.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.492617.log.gz 2024-04-04T16:50:15.301 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.251387.log 2024-04-04T16:50:15.302 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.466639.log: gzip -5 --verbose -- 90.0% /var/log/ceph/ceph-client.admin.210033.log 2024-04-04T16:50:15.303 INFO:teuthology.orchestra.run.smithi072.stderr: -- replaced with /var/log/ceph/ceph-client.admin.493038.log.gz 2024-04-04T16:50:15.303 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.251387.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.326395.log 2024-04-04T16:50:15.304 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.210033.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.333311.log 2024-04-04T16:50:15.305 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.326395.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.200720.log 2024-04-04T16:50:15.306 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.333311.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.235106.log 2024-04-04T16:50:15.308 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.200720.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.218631.log 2024-04-04T16:50:15.309 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.235106.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.447083.log 2024-04-04T16:50:15.309 INFO:teuthology.orchestra.run.smithi072.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.475163.log.gz 2024-04-04T16:50:15.310 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.218631.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.388431.log 2024-04-04T16:50:15.311 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.447083.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.522194.log 2024-04-04T16:50:15.311 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.388431.log: 78.0% -- replaced with /var/log/ceph/ceph-client.admin.515183.log.gz 2024-04-04T16:50:15.312 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46673.log 2024-04-04T16:50:15.312 INFO:teuthology.orchestra.run.smithi072.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.514770.log.gz 2024-04-04T16:50:15.313 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.522194.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.204319.log 2024-04-04T16:50:15.315 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.46673.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46589.log.gz 2024-04-04T16:50:15.315 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.450077.log 2024-04-04T16:50:15.316 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.204319.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.198012.log 2024-04-04T16:50:15.317 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.450077.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43901.log 2024-04-04T16:50:15.318 INFO:teuthology.orchestra.run.smithi072.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.50414.log.gz 2024-04-04T16:50:15.318 INFO:teuthology.orchestra.run.smithi072.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.50372.log.gz 2024-04-04T16:50:15.319 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.198012.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.367940.log 2024-04-04T16:50:15.319 INFO:teuthology.orchestra.run.smithi072.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.48230.log.gz 2024-04-04T16:50:15.319 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.43901.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49022.log 2024-04-04T16:50:15.321 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.367940.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.325018.log 2024-04-04T16:50:15.322 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.49022.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.455843.log 2024-04-04T16:50:15.323 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.325018.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.429931.log 2024-04-04T16:50:15.324 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.455843.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.227771.log 2024-04-04T16:50:15.324 INFO:teuthology.orchestra.run.smithi072.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.283729.log.gz 2024-04-04T16:50:15.325 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.429931.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.199361.log 2024-04-04T16:50:15.326 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.227771.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.334992.log 2024-04-04T16:50:15.327 INFO:teuthology.orchestra.run.smithi072.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.49767.log.gz 2024-04-04T16:50:15.328 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.199361.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.392884.log 2024-04-04T16:50:15.329 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.334992.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.364041.log 2024-04-04T16:50:15.330 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.265017.log 2024-04-04T16:50:15.331 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.392884.log: /var/log/ceph/ceph-client.admin.364041.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.250543.log 2024-04-04T16:50:15.332 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.265017.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.367949.log 2024-04-04T16:50:15.333 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.250543.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.271095.log 2024-04-04T16:50:15.334 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.367949.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111103.log 2024-04-04T16:50:15.335 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.271095.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36965.log 2024-04-04T16:50:15.336 INFO:teuthology.orchestra.run.smithi072.stderr: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.510964.log.gz 2024-04-04T16:50:15.337 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.272358.log 2024-04-04T16:50:15.337 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.111103.log: /var/log/ceph/ceph-client.admin.36965.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42404.log 2024-04-04T16:50:15.339 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.272358.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49377.log 2024-04-04T16:50:15.340 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.42404.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42627.log 2024-04-04T16:50:15.341 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.49377.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.548832.log 2024-04-04T16:50:15.342 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.42627.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188312.log 2024-04-04T16:50:15.344 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.548832.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.333731.log 2024-04-04T16:50:15.345 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.188312.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132015.log 2024-04-04T16:50:15.346 INFO:teuthology.orchestra.run.smithi072.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.44437.log.gz 2024-04-04T16:50:15.346 INFO:teuthology.orchestra.run.smithi072.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.210866.log.gz 2024-04-04T16:50:15.347 INFO:teuthology.orchestra.run.smithi072.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.163264.log.gz 2024-04-04T16:50:15.347 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.333731.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.210875.log.gz 2024-04-04T16:50:15.347 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.359427.log 2024-04-04T16:50:15.348 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.132015.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47552.log 2024-04-04T16:50:15.349 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.359427.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.268138.log 2024-04-04T16:50:15.351 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.47552.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.355440.log 2024-04-04T16:50:15.351 INFO:teuthology.orchestra.run.smithi072.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.418313.log.gz 2024-04-04T16:50:15.352 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.268138.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145781.log 2024-04-04T16:50:15.353 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.355440.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.525357.log 2024-04-04T16:50:15.354 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.145781.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.453283.log 2024-04-04T16:50:15.355 INFO:teuthology.orchestra.run.smithi072.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.130670.log.gz 2024-04-04T16:50:15.355 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.525357.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.224777.log 2024-04-04T16:50:15.356 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.453283.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48046.log 2024-04-04T16:50:15.358 INFO:teuthology.orchestra.run.smithi072.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.132429.log.gz 2024-04-04T16:50:15.358 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155896.log 2024-04-04T16:50:15.358 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.224777.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.132438.log.gz 2024-04-04T16:50:15.358 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.48046.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.355019.log 2024-04-04T16:50:15.360 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.155896.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-04-04T16:50:15.360 INFO:teuthology.orchestra.run.smithi072.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.111527.log.gz 2024-04-04T16:50:15.361 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.355019.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155475.log 2024-04-04T16:50:15.362 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164679.log 2024-04-04T16:50:15.363 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.155475.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44395.log 2024-04-04T16:50:15.364 INFO:teuthology.orchestra.run.smithi072.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.328131.log.gz 2024-04-04T16:50:15.365 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.164679.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.206107.log 2024-04-04T16:50:15.366 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.44395.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.362540.log 2024-04-04T16:50:15.367 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.206107.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.429499.log 2024-04-04T16:50:15.367 INFO:teuthology.orchestra.run.smithi072.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.140895.log.gz 2024-04-04T16:50:15.368 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.362540.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157276.log 2024-04-04T16:50:15.369 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.429499.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.549427.log 2024-04-04T16:50:15.371 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.157276.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.482913.log 2024-04-04T16:50:15.371 INFO:teuthology.orchestra.run.smithi072.stderr: 77.6% -- replaced with /var/log/ceph/ceph-client.admin.528912.log.gz 2024-04-04T16:50:15.374 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.549427.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.460741.log 2024-04-04T16:50:15.374 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.482913.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.539461.log 2024-04-04T16:50:15.374 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.410629.log/var/log/ceph/ceph-client.admin.460741.log: 2024-04-04T16:50:15.375 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.539461.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.329485.log 2024-04-04T16:50:15.375 INFO:teuthology.orchestra.run.smithi072.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.50540.log.gz 2024-04-04T16:50:15.376 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.450086.log 2024-04-04T16:50:15.377 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.410629.log: /var/log/ceph/ceph-client.admin.329485.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.258178.log 2024-04-04T16:50:15.378 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.273676.log 2024-04-04T16:50:15.378 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.450086.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44269.log.gz 2024-04-04T16:50:15.379 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.258178.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.477697.log 2024-04-04T16:50:15.380 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.273676.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.327269.log 2024-04-04T16:50:15.381 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.265008.log 2024-04-04T16:50:15.382 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.477697.log: /var/log/ceph/ceph-client.admin.327269.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.238567.log 2024-04-04T16:50:15.383 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.265008.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.488554.log 2024-04-04T16:50:15.384 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.268971.log 2024-04-04T16:50:15.385 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.238567.log: /var/log/ceph/ceph-client.admin.488554.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.484244.log 2024-04-04T16:50:15.387 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.268971.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.45288.log 2024-04-04T16:50:15.387 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.484244.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.268550.log 2024-04-04T16:50:15.389 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.0.45288.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43231.log 2024-04-04T16:50:15.389 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.268550.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43230.log 2024-04-04T16:50:15.390 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.43231.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.285427.log 2024-04-04T16:50:15.391 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.43230.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.499560.log 2024-04-04T16:50:15.392 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.285427.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.409366.log 2024-04-04T16:50:15.393 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.499560.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.212998.log 2024-04-04T16:50:15.394 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.409366.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.413179.log 2024-04-04T16:50:15.395 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.212998.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.212147.log 2024-04-04T16:50:15.396 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.413179.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44143.log 2024-04-04T16:50:15.397 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.212147.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185184.log 2024-04-04T16:50:15.398 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.44143.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.270667.log 2024-04-04T16:50:15.399 INFO:teuthology.orchestra.run.smithi072.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.235106.log.gz 2024-04-04T16:50:15.400 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.185184.log: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.235974.log.gz 2024-04-04T16:50:15.400 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.331215.log 2024-04-04T16:50:15.400 INFO:teuthology.orchestra.run.smithi072.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.259443.log.gz 2024-04-04T16:50:15.401 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.270667.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.446163.log 2024-04-04T16:50:15.402 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.331215.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.200710.log 2024-04-04T16:50:15.403 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.446163.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.390728.log 2024-04-04T16:50:15.404 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.200710.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127243.log 2024-04-04T16:50:15.405 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.390728.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.256479.log 2024-04-04T16:50:15.406 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.127243.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43851.log 2024-04-04T16:50:15.406 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.256479.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.420866.log 2024-04-04T16:50:15.408 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.43851.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.218210.log 2024-04-04T16:50:15.409 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.420866.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.434886.log 2024-04-04T16:50:15.410 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.218210.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.351505.log 2024-04-04T16:50:15.410 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.434886.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.532805.log 2024-04-04T16:50:15.411 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.351505.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164688.log 2024-04-04T16:50:15.412 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.532805.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.209612.log 2024-04-04T16:50:15.414 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.164688.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.352393.log 2024-04-04T16:50:15.415 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.209612.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.385365.log 2024-04-04T16:50:15.416 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.352393.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.409796.log 2024-04-04T16:50:15.417 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.385365.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.549679.log 2024-04-04T16:50:15.418 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.409796.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47804.log 2024-04-04T16:50:15.419 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.549679.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154624.log 2024-04-04T16:50:15.420 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.47804.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.472800.log 2024-04-04T16:50:15.421 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.154624.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114954.log 2024-04-04T16:50:15.422 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.472800.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.388431.log.gz 2024-04-04T16:50:15.423 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153317.log 2024-04-04T16:50:15.424 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.114954.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.478165.log 2024-04-04T16:50:15.425 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.153317.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.542155.log 2024-04-04T16:50:15.425 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.478165.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.407641.log 2024-04-04T16:50:15.426 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.542155.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.257322.log 2024-04-04T16:50:15.427 INFO:teuthology.orchestra.run.smithi072.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.384026.log.gz 2024-04-04T16:50:15.427 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.407641.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.535475.log 2024-04-04T16:50:15.429 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.257322.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.282894.log 2024-04-04T16:50:15.429 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.535475.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.234244.log 2024-04-04T16:50:15.431 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.282894.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141372.log 2024-04-04T16:50:15.431 INFO:teuthology.orchestra.run.smithi072.stderr: 83.0% -- replaced with /var/log/ceph/ceph-client.admin.431616.log.gz 2024-04-04T16:50:15.432 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.234244.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.548681.log 2024-04-04T16:50:15.432 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.141372.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.509278.log 2024-04-04T16:50:15.434 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.548681.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.316106.log 2024-04-04T16:50:15.435 INFO:teuthology.orchestra.run.smithi072.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.448768.log.gz 2024-04-04T16:50:15.435 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.509278.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.350662.log 2024-04-04T16:50:15.435 INFO:teuthology.orchestra.run.smithi072.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.449202.log.gz 2024-04-04T16:50:15.436 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.316106.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.207007.log 2024-04-04T16:50:15.437 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.350662.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.450086.log.gz 2024-04-04T16:50:15.437 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.406365.log 2024-04-04T16:50:15.438 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.207007.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.533687.log 2024-04-04T16:50:15.439 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.406365.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118283.log 2024-04-04T16:50:15.440 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.533687.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.391593.log.gz 2024-04-04T16:50:15.440 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.547059.log 2024-04-04T16:50:15.441 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.118283.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49665.log 2024-04-04T16:50:15.441 INFO:teuthology.orchestra.run.smithi072.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.392875.log.gz 2024-04-04T16:50:15.442 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.547059.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.392884.log.gz 2024-04-04T16:50:15.442 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.325027.log 2024-04-04T16:50:15.443 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.49665.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.453274.log 2024-04-04T16:50:15.444 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.325027.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43547.log 2024-04-04T16:50:15.445 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.453274.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.492187.log 2024-04-04T16:50:15.446 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.43547.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.526639.log 2024-04-04T16:50:15.447 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.492187.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.362104.log 2024-04-04T16:50:15.449 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.526639.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.468554.log 2024-04-04T16:50:15.450 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.362104.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49419.log 2024-04-04T16:50:15.450 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.468554.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46421.log 2024-04-04T16:50:15.451 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.49419.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164106.log 2024-04-04T16:50:15.452 INFO:teuthology.orchestra.run.smithi072.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.221177.log.gz 2024-04-04T16:50:15.453 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.46421.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.220344.log 2024-04-04T16:50:15.454 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.164106.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.329906.log 2024-04-04T16:50:15.455 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.220344.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42967.log 2024-04-04T16:50:15.456 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.329906.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130241.log 2024-04-04T16:50:15.456 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.42967.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.320788.log 2024-04-04T16:50:15.457 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.130241.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.328140.log 2024-04-04T16:50:15.458 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.320788.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133712.log 2024-04-04T16:50:15.459 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.328140.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192045.log 2024-04-04T16:50:15.460 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.133712.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183721.log 2024-04-04T16:50:15.460 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.192045.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.341427.log 2024-04-04T16:50:15.461 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.183721.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.201610.log 2024-04-04T16:50:15.462 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.341427.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.350232.log 2024-04-04T16:50:15.463 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.201610.log: 84.0% -- replaced with /var/log/ceph/ceph-client.admin.156809.log.gz 2024-04-04T16:50:15.463 INFO:teuthology.orchestra.run.smithi072.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.157276.log.gzgzip 2024-04-04T16:50:15.464 INFO:teuthology.orchestra.run.smithi072.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.458094.log 2024-04-04T16:50:15.464 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.350232.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.360757.log 2024-04-04T16:50:15.465 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.458094.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49579.log 2024-04-04T16:50:15.466 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.360757.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125148.log 2024-04-04T16:50:15.467 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.49579.log: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.462901.log.gz 2024-04-04T16:50:15.467 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.263686.log 2024-04-04T16:50:15.468 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.125148.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.384454.log 2024-04-04T16:50:15.469 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.497085.log 2024-04-04T16:50:15.470 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.263686.log: /var/log/ceph/ceph-client.admin.384454.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.216400.log 2024-04-04T16:50:15.471 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.263695.log 2024-04-04T16:50:15.472 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.497085.log: /var/log/ceph/ceph-client.admin.216400.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.340574.log 2024-04-04T16:50:15.472 INFO:teuthology.orchestra.run.smithi072.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.517725.log.gz 2024-04-04T16:50:15.473 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.483823.log 2024-04-04T16:50:15.474 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.263695.log: /var/log/ceph/ceph-client.admin.340574.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.515192.log 2024-04-04T16:50:15.475 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.483823.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113122.log 2024-04-04T16:50:15.476 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.515192.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.529356.log 2024-04-04T16:50:15.476 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.113122.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.488563.log 2024-04-04T16:50:15.477 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.529356.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.465665.log 2024-04-04T16:50:15.478 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.488563.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191022.log 2024-04-04T16:50:15.479 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.465665.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.548639.log 2024-04-04T16:50:15.480 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.191022.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.215112.log 2024-04-04T16:50:15.480 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.548639.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.478165.log.gz 2024-04-04T16:50:15.481 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.222028.log 2024-04-04T16:50:15.481 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.215112.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.252932.log 2024-04-04T16:50:15.482 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.222028.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.409375.log 2024-04-04T16:50:15.483 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.252932.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186974.log 2024-04-04T16:50:15.484 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.409375.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.318224.log 2024-04-04T16:50:15.484 INFO:teuthology.orchestra.run.smithi072.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.547059.log.gz 2024-04-04T16:50:15.485 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.186974.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.476008.log 2024-04-04T16:50:15.486 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.318224.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.523064.log 2024-04-04T16:50:15.486 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.476008.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.403338.log 2024-04-04T16:50:15.487 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.523064.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.243280.log 2024-04-04T16:50:15.488 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.403338.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.259874.log 2024-04-04T16:50:15.489 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.243280.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182027.log 2024-04-04T16:50:15.490 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.259874.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49935.log 2024-04-04T16:50:15.491 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.182027.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.356711.log 2024-04-04T16:50:15.492 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.49935.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.549553.log 2024-04-04T16:50:15.493 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.356711.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.47390.log.gz 2024-04-04T16:50:15.493 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.346927.log 2024-04-04T16:50:15.494 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.492608.log 2024-04-04T16:50:15.494 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.549553.log: /var/log/ceph/ceph-client.admin.346927.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46841.log 2024-04-04T16:50:15.495 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.492608.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.358460.log 2024-04-04T16:50:15.496 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.46841.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.338450.log 2024-04-04T16:50:15.496 INFO:teuthology.orchestra.run.smithi072.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.525357.log.gz 2024-04-04T16:50:15.497 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.358460.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.327690.log 2024-04-04T16:50:15.498 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.338450.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.356291.log 2024-04-04T16:50:15.499 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.410217.log 2024-04-04T16:50:15.500 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.327690.log: /var/log/ceph/ceph-client.admin.356291.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.461153.log 2024-04-04T16:50:15.501 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.410217.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140904.log 2024-04-04T16:50:15.502 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.461153.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.230612.log 2024-04-04T16:50:15.502 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.140904.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119387.log 2024-04-04T16:50:15.503 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.230612.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.388422.log 2024-04-04T16:50:15.504 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.119387.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.234675.log 2024-04-04T16:50:15.505 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.388422.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.253392.log 2024-04-04T16:50:15.506 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.234675.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.548031.log 2024-04-04T16:50:15.507 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.253392.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.207016.log 2024-04-04T16:50:15.507 INFO:teuthology.orchestra.run.smithi072.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.49579.log.gz 2024-04-04T16:50:15.507 INFO:teuthology.orchestra.run.smithi072.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.195435.log.gz 2024-04-04T16:50:15.508 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.548031.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186525.log 2024-04-04T16:50:15.509 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.207016.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.401425.log 2024-04-04T16:50:15.510 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.186525.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.478999.log 2024-04-04T16:50:15.511 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.401425.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.251863.log 2024-04-04T16:50:15.512 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.478999.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.480792.log 2024-04-04T16:50:15.513 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.251863.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.208761.log 2024-04-04T16:50:15.513 INFO:teuthology.orchestra.run.smithi072.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.270667.log.gz 2024-04-04T16:50:15.514 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.480792.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.340161.log 2024-04-04T16:50:15.515 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.208761.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.417035.log 2024-04-04T16:50:15.516 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43564.log 2024-04-04T16:50:15.517 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.340161.log: /var/log/ceph/ceph-client.admin.417035.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.509700.log 2024-04-04T16:50:15.518 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.43564.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.315684.log 2024-04-04T16:50:15.518 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.509700.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155484.log 2024-04-04T16:50:15.519 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.315684.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.365542.log 2024-04-04T16:50:15.520 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.155484.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.284577.log 2024-04-04T16:50:15.521 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.365542.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.548597.log 2024-04-04T16:50:15.522 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.284577.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.183310.log.gz 2024-04-04T16:50:15.522 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48812.log 2024-04-04T16:50:15.523 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.548597.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.451060.log 2024-04-04T16:50:15.524 INFO:teuthology.orchestra.run.smithi072.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.206107.log.gz 2024-04-04T16:50:15.524 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.48812.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.271516.log 2024-04-04T16:50:15.525 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.451060.log: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.111103.log.gz 2024-04-04T16:50:15.525 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50456.log 2024-04-04T16:50:15.526 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.271516.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.463756.log 2024-04-04T16:50:15.527 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.50456.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.475587.log 2024-04-04T16:50:15.528 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.463756.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.417882.log 2024-04-04T16:50:15.529 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.475587.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.334572.log 2024-04-04T16:50:15.530 INFO:teuthology.orchestra.run.smithi072.stderr: 84.6% -- replaced with /var/log/ceph/ceph-client.admin.216400.log.gz 2024-04-04T16:50:15.530 INFO:teuthology.orchestra.run.smithi072.stderr: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.209603.log.gz 2024-04-04T16:50:15.531 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.417882.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.393724.log 2024-04-04T16:50:15.532 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.334572.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.414905.log 2024-04-04T16:50:15.533 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.393724.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.199370.log 2024-04-04T16:50:15.534 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.414905.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.531104.log 2024-04-04T16:50:15.535 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.199370.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134551.log 2024-04-04T16:50:15.536 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.531104.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.389887.log 2024-04-04T16:50:15.537 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.134551.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.477275.log 2024-04-04T16:50:15.538 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.389887.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.549049.log 2024-04-04T16:50:15.539 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.477275.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42669.log 2024-04-04T16:50:15.540 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.549049.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.257757.log 2024-04-04T16:50:15.541 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.42669.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139617.log 2024-04-04T16:50:15.542 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.257757.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.320779.log 2024-04-04T16:50:15.543 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.139617.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.327278.log 2024-04-04T16:50:15.544 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.320779.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.457113.log 2024-04-04T16:50:15.545 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.327278.log: 92.7% -- replaced with /var/log/ceph/ceph-client.admin.157285.log.gz 2024-04-04T16:50:15.545 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.334161.log 2024-04-04T16:50:15.546 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.457113.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47264.log 2024-04-04T16:50:15.547 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.545710.log 2024-04-04T16:50:15.548 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.334161.log: /var/log/ceph/ceph-client.admin.47264.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.532385.log 2024-04-04T16:50:15.549 INFO:teuthology.orchestra.run.smithi072.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46673.log.gz 2024-04-04T16:50:15.549 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.545710.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.328643.log 2024-04-04T16:50:15.551 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.532385.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.218622.log 2024-04-04T16:50:15.551 INFO:teuthology.orchestra.run.smithi072.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47552.log.gz 2024-04-04T16:50:15.552 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.328643.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.317376.log 2024-04-04T16:50:15.553 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.218622.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.324594.log 2024-04-04T16:50:15.554 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.317376.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.318233.log 2024-04-04T16:50:15.556 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.324594.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137080.log 2024-04-04T16:50:15.557 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.318233.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.394155.log.gz 2024-04-04T16:50:15.557 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42576.log 2024-04-04T16:50:15.558 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.137080.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.195856.log 2024-04-04T16:50:15.559 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.42576.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.530627.log 2024-04-04T16:50:15.560 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.195856.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.274107.log 2024-04-04T16:50:15.561 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.530627.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.396169.log 2024-04-04T16:50:15.562 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.274107.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.350241.log.gz 2024-04-04T16:50:15.563 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184179.log 2024-04-04T16:50:15.563 INFO:teuthology.orchestra.run.smithi072.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.350662.log.gz 2024-04-04T16:50:15.564 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.396169.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44623.log 2024-04-04T16:50:15.565 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.184179.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.457657.log 2024-04-04T16:50:15.566 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.44623.log: 83.2% -- replaced with /var/log/ceph/ceph-client.admin.333731.log.gz 2024-04-04T16:50:15.567 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.281898.log 2024-04-04T16:50:15.568 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.457657.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.464188.log 2024-04-04T16:50:15.569 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.281898.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.485113.log 2024-04-04T16:50:15.570 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.464188.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140478.log 2024-04-04T16:50:15.571 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.485113.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.515614.log 2024-04-04T16:50:15.572 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.140478.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.396581.log 2024-04-04T16:50:15.573 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.515614.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128976.log 2024-04-04T16:50:15.574 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.396581.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147166.log 2024-04-04T16:50:15.575 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.128976.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.543542.log 2024-04-04T16:50:15.576 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.147166.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.241982.log 2024-04-04T16:50:15.577 INFO:teuthology.orchestra.run.smithi072.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.357123.log.gz 2024-04-04T16:50:15.577 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.543542.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.434225.log 2024-04-04T16:50:15.578 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.241982.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42488.log 2024-04-04T16:50:15.582 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.434225.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.436162.log 2024-04-04T16:50:15.582 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.42488.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.361682.log 2024-04-04T16:50:15.582 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.332046.log 2024-04-04T16:50:15.582 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.436162.log: /var/log/ceph/ceph-client.admin.361682.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43852.log 2024-04-04T16:50:15.583 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.332046.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.482064.log 2024-04-04T16:50:15.583 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.43852.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.249703.log 2024-04-04T16:50:15.584 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.482064.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.482494.log 2024-04-04T16:50:15.585 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.249703.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.532394.log 2024-04-04T16:50:15.586 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.482494.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.537241.log 2024-04-04T16:50:15.587 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.532394.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.513506.log 2024-04-04T16:50:15.587 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.537241.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.519036.log 2024-04-04T16:50:15.589 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.513506.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.322908.log 2024-04-04T16:50:15.590 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.519036.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.357984.log 2024-04-04T16:50:15.591 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.322908.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.527830.log 2024-04-04T16:50:15.592 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.357984.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47962.log 2024-04-04T16:50:15.593 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.500824.log 2024-04-04T16:50:15.594 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.527830.log: /var/log/ceph/ceph-client.admin.47962.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.241104.log 2024-04-04T16:50:15.595 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.500824.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127234.log 2024-04-04T16:50:15.597 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.241104.log: 79.9% -- replaced with /var/log/ceph/ceph-client.admin.251863.log.gz 2024-04-04T16:50:15.597 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129406.log 2024-04-04T16:50:15.598 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.127234.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140469.log 2024-04-04T16:50:15.599 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.129406.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.197559.log 2024-04-04T16:50:15.600 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.140469.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.353723.log 2024-04-04T16:50:15.601 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.197559.log: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.316106.log.gz 2024-04-04T16:50:15.601 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.495625.log 2024-04-04T16:50:15.602 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.353723.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118527.log 2024-04-04T16:50:15.604 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.495625.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.398431.log 2024-04-04T16:50:15.605 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.118527.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.254243.log 2024-04-04T16:50:15.606 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.398431.log: 84.0% -- replaced with /var/log/ceph/ceph-client.admin.234244.log.gz 2024-04-04T16:50:15.606 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.449644.log 2024-04-04T16:50:15.607 INFO:teuthology.orchestra.run.smithi072.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.234666.log.gz 2024-04-04T16:50:15.607 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.254243.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.459848.log 2024-04-04T16:50:15.608 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.449644.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.324585.log 2024-04-04T16:50:15.609 INFO:teuthology.orchestra.run.smithi072.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.238567.log.gz 2024-04-04T16:50:15.610 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.459848.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.226513.log 2024-04-04T16:50:15.611 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.324585.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.511811.log 2024-04-04T16:50:15.612 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.226513.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.325881.log 2024-04-04T16:50:15.613 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.511811.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182444.log 2024-04-04T16:50:15.613 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.325881.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.259874.log.gz 2024-04-04T16:50:15.614 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.507287.log 2024-04-04T16:50:15.615 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.182444.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.225662.log 2024-04-04T16:50:15.616 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.507287.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.206116.log 2024-04-04T16:50:15.617 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.225662.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.489403.log 2024-04-04T16:50:15.618 INFO:teuthology.orchestra.run.smithi072.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.37222.log.gz 2024-04-04T16:50:15.618 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.206116.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.343560.log 2024-04-04T16:50:15.619 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.489403.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47062.log 2024-04-04T16:50:15.621 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.343560.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.416609.log 2024-04-04T16:50:15.622 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.47062.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42319.log 2024-04-04T16:50:15.623 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.416609.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48896.log 2024-04-04T16:50:15.624 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.42319.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184629.log 2024-04-04T16:50:15.624 INFO:teuthology.orchestra.run.smithi072.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.365542.log.gz 2024-04-04T16:50:15.625 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.48896.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.348840.log 2024-04-04T16:50:15.626 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.184629.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.223514.log 2024-04-04T16:50:15.627 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.348840.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.436153.log 2024-04-04T16:50:15.628 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.223514.log: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.358460.log.gz 2024-04-04T16:50:15.629 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.245943.log 2024-04-04T16:50:15.629 INFO:teuthology.orchestra.run.smithi072.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.331215.log.gz 2024-04-04T16:50:15.630 INFO:teuthology.orchestra.run.smithi072.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.357984.log.gz 2024-04-04T16:50:15.630 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.436153.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.548493.log 2024-04-04T16:50:15.631 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.245943.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.395031.log 2024-04-04T16:50:15.632 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.548493.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183301.log 2024-04-04T16:50:15.633 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.395031.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.349335.log 2024-04-04T16:50:15.634 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.183301.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.459410.log 2024-04-04T16:50:15.636 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.488105.log 2024-04-04T16:50:15.637 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.349335.log: /var/log/ceph/ceph-client.admin.459410.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.523538.log 2024-04-04T16:50:15.638 INFO:teuthology.orchestra.run.smithi117.stderr: 94.2% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-04-04T16:50:15.638 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.488105.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.405919.log 2024-04-04T16:50:15.639 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.523538.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.548923.log 2024-04-04T16:50:15.640 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.405919.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.340583.log 2024-04-04T16:50:15.640 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.548923.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.397118.log.gz 2024-04-04T16:50:15.641 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.330791.log 2024-04-04T16:50:15.642 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.340583.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.532814.log 2024-04-04T16:50:15.642 INFO:teuthology.orchestra.run.smithi072.stderr: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.240249.log.gz 2024-04-04T16:50:15.643 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.330791.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.433361.log 2024-04-04T16:50:15.644 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.532814.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.231992.log 2024-04-04T16:50:15.645 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.433361.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.543079.log 2024-04-04T16:50:15.646 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.231992.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.274529.log 2024-04-04T16:50:15.647 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.543079.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42100.log 2024-04-04T16:50:15.648 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.274529.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.358469.log 2024-04-04T16:50:15.649 INFO:teuthology.orchestra.run.smithi072.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.399380.log.gz 2024-04-04T16:50:15.650 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.42100.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.524891.log 2024-04-04T16:50:15.650 INFO:teuthology.orchestra.run.smithi072.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.356291.log.gz 2024-04-04T16:50:15.650 INFO:teuthology.orchestra.run.smithi072.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.356711.log.gz 2024-04-04T16:50:15.651 INFO:teuthology.orchestra.run.smithi072.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.237671.log.gz 2024-04-04T16:50:15.651 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.358469.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.408529.log 2024-04-04T16:50:15.652 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.524891.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133277.log 2024-04-04T16:50:15.654 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.408529.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.236819.log 2024-04-04T16:50:15.654 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.133277.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.234253.log 2024-04-04T16:50:15.656 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.236819.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.549804.log 2024-04-04T16:50:15.657 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.234253.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.533266.log 2024-04-04T16:50:15.658 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.549804.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.549511.log.gz 2024-04-04T16:50:15.658 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.400269.log 2024-04-04T16:50:15.659 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.533266.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.421301.log 2024-04-04T16:50:15.661 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.400269.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43555.log 2024-04-04T16:50:15.662 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.421301.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.420445.log 2024-04-04T16:50:15.663 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.43555.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.335843.log 2024-04-04T16:50:15.664 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.420445.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.548325.log.gz 2024-04-04T16:50:15.664 INFO:teuthology.orchestra.run.smithi072.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.548283.log.gz 2024-04-04T16:50:15.665 INFO:teuthology.orchestra.run.smithi117.stderr: 94.3% -- replaced with /var/log/ceph/ceph.log.gz 2024-04-04T16:50:15.665 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.259452.log 2024-04-04T16:50:15.666 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.335843.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115427.log 2024-04-04T16:50:15.667 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.259452.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.519980.log 2024-04-04T16:50:15.668 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.115427.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44851.log 2024-04-04T16:50:15.669 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.519980.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.330327.log 2024-04-04T16:50:15.670 INFO:teuthology.orchestra.run.smithi072.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.529347.log.gz 2024-04-04T16:50:15.670 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.44851.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45932.log 2024-04-04T16:50:15.671 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.330327.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49851.log 2024-04-04T16:50:15.673 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.45932.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.524447.log 2024-04-04T16:50:15.674 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.49851.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.520400.log 2024-04-04T16:50:15.675 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.524447.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.508624.log 2024-04-04T16:50:15.676 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.520400.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.50926.log 2024-04-04T16:50:15.677 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.508624.log: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.547477.log.gz 2024-04-04T16:50:15.677 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152894.log 2024-04-04T16:50:15.679 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.0.50926.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.270245.log 2024-04-04T16:50:15.680 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.152894.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111094.log 2024-04-04T16:50:15.681 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.270245.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.531113.log 2024-04-04T16:50:15.682 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.111094.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.260717.log 2024-04-04T16:50:15.684 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.531113.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120285.log 2024-04-04T16:50:15.685 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.260717.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.269401.log 2024-04-04T16:50:15.687 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.120285.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119863.log 77.7% 2024-04-04T16:50:15.687 INFO:teuthology.orchestra.run.smithi072.stderr: -- replaced with /var/log/ceph/ceph-client.admin.509278.log.gz 2024-04-04T16:50:15.687 INFO:teuthology.orchestra.run.smithi072.stderr: 84.3% -- replaced with /var/log/ceph/ceph-client.admin.449644.log.gz 2024-04-04T16:50:15.688 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.269401.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115436.log 2024-04-04T16:50:15.689 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.119863.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.321636.log 2024-04-04T16:50:15.691 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.115436.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.242853.log 2024-04-04T16:50:15.692 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.321636.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.358942.log 2024-04-04T16:50:15.693 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.242853.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189191.log 2024-04-04T16:50:15.694 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.358942.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.486817.log 2024-04-04T16:50:15.696 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.189191.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48314.log 2024-04-04T16:50:15.696 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.486817.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.483408.log 2024-04-04T16:50:15.698 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.48314.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42532.log 2024-04-04T16:50:15.699 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.483408.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.408945.log 2024-04-04T16:50:15.700 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.42532.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.256053.log 2024-04-04T16:50:15.700 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.408945.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194543.log 2024-04-04T16:50:15.701 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.256053.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.339739.log 2024-04-04T16:50:15.702 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.194543.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.348849.log 2024-04-04T16:50:15.703 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.339739.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.329915.log 2024-04-04T16:50:15.703 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.348849.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46547.log 2024-04-04T16:50:15.705 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.329915.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47206.log 2024-04-04T16:50:15.706 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.46547.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146744.log 2024-04-04T16:50:15.707 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.47206.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.243289.log 2024-04-04T16:50:15.708 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.146744.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.479456.log 2024-04-04T16:50:15.708 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.243289.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112578.log 2024-04-04T16:50:15.709 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.479456.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.337109.log 2024-04-04T16:50:15.710 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.112578.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181597.log 2024-04-04T16:50:15.711 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.337109.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44185.log 2024-04-04T16:50:15.711 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.181597.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.466648.log 2024-04-04T16:50:15.712 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.44185.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43009.log 2024-04-04T16:50:15.713 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.466648.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.505921.log 2024-04-04T16:50:15.714 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.43009.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.418734.log 2024-04-04T16:50:15.715 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.505921.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47104.log 2024-04-04T16:50:15.715 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.418734.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.207911.log 2024-04-04T16:50:15.716 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.47104.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.349326.log 2024-04-04T16:50:15.717 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.207911.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46715.log 2024-04-04T16:50:15.718 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.349326.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.519971.log 2024-04-04T16:50:15.719 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.46715.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.494295.log 2024-04-04T16:50:15.719 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.519971.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.502114.log 2024-04-04T16:50:15.720 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.494295.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.484253.log 2024-04-04T16:50:15.721 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.502114.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.462425.log.gz 2024-04-04T16:50:15.722 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.519027.log 2024-04-04T16:50:15.723 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.484253.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184620.log 2024-04-04T16:50:15.724 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.519027.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.225250.log 2024-04-04T16:50:15.725 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.184620.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.239412.log 2024-04-04T16:50:15.726 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.225250.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.464673.log 2024-04-04T16:50:15.727 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.239412.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.510122.log 2024-04-04T16:50:15.728 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.464673.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48476.log 2024-04-04T16:50:15.729 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.510122.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.248366.log 2024-04-04T16:50:15.730 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.48476.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.316950.log 2024-04-04T16:50:15.730 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.248366.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.323754.log 2024-04-04T16:50:15.731 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.316950.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.393303.log 2024-04-04T16:50:15.732 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.323754.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138771.log 2024-04-04T16:50:15.733 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.393303.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.535466.log 2024-04-04T16:50:15.734 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.138771.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.199819.log 2024-04-04T16:50:15.734 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.535466.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181171.log 2024-04-04T16:50:15.735 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.199819.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.549217.log 2024-04-04T16:50:15.736 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.181171.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.397109.log 2024-04-04T16:50:15.737 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.549217.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.458085.log 2024-04-04T16:50:15.737 INFO:teuthology.orchestra.run.smithi072.stderr: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.451959.log.gz 2024-04-04T16:50:15.738 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.397109.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.432941.log 2024-04-04T16:50:15.739 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.458085.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.232979.log 2024-04-04T16:50:15.740 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.432941.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.533678.log 2024-04-04T16:50:15.741 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.232979.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.430763.log 2024-04-04T16:50:15.742 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.533678.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188321.log 2024-04-04T16:50:15.742 INFO:teuthology.orchestra.run.smithi072.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.511811.log.gz 2024-04-04T16:50:15.743 INFO:teuthology.orchestra.run.smithi072.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.46421.log.gz 2024-04-04T16:50:15.744 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.430763.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.323334.log 2024-04-04T16:50:15.745 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.188321.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.322482.log 2024-04-04T16:50:15.746 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45890.log 2024-04-04T16:50:15.747 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.323334.log: /var/log/ceph/ceph-client.admin.322482.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.242431.log 2024-04-04T16:50:15.748 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.223505.log 2024-04-04T16:50:15.749 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.45890.log: /var/log/ceph/ceph-client.admin.242431.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.493875.log 2024-04-04T16:50:15.750 INFO:teuthology.orchestra.run.smithi072.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.502114.log.gz 2024-04-04T16:50:15.750 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.223505.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.476844.log 2024-04-04T16:50:15.752 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.493875.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.447935.log 2024-04-04T16:50:15.753 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.476844.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.410638.log 2024-04-04T16:50:15.754 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.447935.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.317797.log 2024-04-04T16:50:15.755 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.410638.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132851.log 2024-04-04T16:50:15.755 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.317797.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133286.log 2024-04-04T16:50:15.756 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.132851.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.210445.log 2024-04-04T16:50:15.757 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.133286.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48980.log 2024-04-04T16:50:15.758 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.210445.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.455001.log 2024-04-04T16:50:15.759 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.48980.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.401513.log 2024-04-04T16:50:15.759 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.455001.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.541681.log 2024-04-04T16:50:15.760 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.401513.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.283316.log 2024-04-04T16:50:15.761 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.541681.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.527821.log 2024-04-04T16:50:15.762 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.283316.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.480371.log 2024-04-04T16:50:15.763 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.527821.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.435321.log 2024-04-04T16:50:15.764 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.480371.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153751.log 2024-04-04T16:50:15.764 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.435321.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42757.log 2024-04-04T16:50:15.765 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.153751.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.487650.log 2024-04-04T16:50:15.766 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.42757.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186983.log 2024-04-04T16:50:15.767 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.487650.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144894.log 2024-04-04T16:50:15.768 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.186983.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.337544.log 2024-04-04T16:50:15.768 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.144894.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.535909.log 2024-04-04T16:50:15.769 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.337544.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.349811.log 2024-04-04T16:50:15.770 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.535909.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194131.log 2024-04-04T16:50:15.770 INFO:teuthology.orchestra.run.smithi072.stderr: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.536797.log.gz 2024-04-04T16:50:15.771 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.520833.log 2024-04-04T16:50:15.772 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.349811.log: /var/log/ceph/ceph-client.admin.194131.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50158.log 2024-04-04T16:50:15.773 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120698.log 2024-04-04T16:50:15.774 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.520833.log: /var/log/ceph/ceph-client.admin.50158.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.261991.log 2024-04-04T16:50:15.775 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-04-04T16:50:15.776 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.120698.log: /var/log/ceph/ceph-client.admin.261991.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.204769.log 2024-04-04T16:50:15.777 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.488096.log 2024-04-04T16:50:15.779 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180750.log 2024-04-04T16:50:15.779 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.204769.log: /var/log/ceph/ceph-client.admin.488096.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46757.log 2024-04-04T16:50:15.780 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.180750.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46883.log 2024-04-04T16:50:15.780 INFO:teuthology.orchestra.run.smithi072.stderr: 84.3% -- replaced with /var/log/ceph/ceph-client.admin.545250.log.gz 2024-04-04T16:50:15.781 INFO:teuthology.orchestra.run.smithi072.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.544837.log.gz 2024-04-04T16:50:15.781 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.46757.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189182.log 2024-04-04T16:50:15.782 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.46883.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.249276.log 2024-04-04T16:50:15.783 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.398006.log 2024-04-04T16:50:15.784 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.189182.log: /var/log/ceph/ceph-client.admin.249276.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.338459.log 2024-04-04T16:50:15.785 INFO:teuthology.orchestra.run.smithi072.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.543542.log.gz 2024-04-04T16:50:15.785 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.398006.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.517302.log 2024-04-04T16:50:15.786 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.485103.log 2024-04-04T16:50:15.787 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.338459.log: /var/log/ceph/ceph-client.admin.517302.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.253822.log 2024-04-04T16:50:15.788 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.485103.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135404.log 2024-04-04T16:50:15.789 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.239826.log 2024-04-04T16:50:15.790 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.253822.log: /var/log/ceph/ceph-client.admin.135404.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.503322.log 2024-04-04T16:50:15.791 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47678.log 2024-04-04T16:50:15.792 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.239826.log: /var/log/ceph/ceph-client.admin.503322.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194965.log 2024-04-04T16:50:15.793 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.338876.log 2024-04-04T16:50:15.794 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.47678.log: /var/log/ceph/ceph-client.admin.194965.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.384017.log 2024-04-04T16:50:15.795 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.403347.log 2024-04-04T16:50:15.796 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.338876.log: /var/log/ceph/ceph-client.admin.384017.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42883.log 2024-04-04T16:50:15.797 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.403347.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.391149.log 2024-04-04T16:50:15.798 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.42883.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.228622.log 2024-04-04T16:50:15.800 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.391149.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.331206.log 2024-04-04T16:50:15.801 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.228622.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.405067.log 2024-04-04T16:50:15.802 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.331206.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44311.log 2024-04-04T16:50:15.803 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.405067.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.223926.log 2024-04-04T16:50:15.804 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.44311.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.265612.log 2024-04-04T16:50:15.805 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.223926.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.542618.log 2024-04-04T16:50:15.806 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.265612.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190088.log 2024-04-04T16:50:15.807 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.542618.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146753.log 2024-04-04T16:50:15.808 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.190088.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47020.log 2024-04-04T16:50:15.809 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.146753.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.387980.log 2024-04-04T16:50:15.810 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.47020.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.229096.log 2024-04-04T16:50:15.811 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.387980.log: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.472172.log.gz 2024-04-04T16:50:15.811 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.202511.log 2024-04-04T16:50:15.812 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.229096.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.528065.log 2024-04-04T16:50:15.813 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.202511.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.543088.log 2024-04-04T16:50:15.814 INFO:teuthology.orchestra.run.smithi072.stderr: 77.6% -- replaced with /var/log/ceph/ceph-client.admin.436153.log.gz 2024-04-04T16:50:15.814 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.528065.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.220756.log 2024-04-04T16:50:15.816 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.543088.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.549091.log 2024-04-04T16:50:15.817 INFO:teuthology.orchestra.run.smithi072.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.492187.log.gz 2024-04-04T16:50:15.817 INFO:teuthology.orchestra.run.smithi072.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44479.log.gz 2024-04-04T16:50:15.817 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.220756.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.230170.log 2024-04-04T16:50:15.818 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.549091.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43229.log 2024-04-04T16:50:15.820 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.230170.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.453736.log 2024-04-04T16:50:15.821 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.43229.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47762.log 2024-04-04T16:50:15.822 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.453736.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.359846.log 2024-04-04T16:50:15.823 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.539017.log 2024-04-04T16:50:15.823 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.47762.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.48812.log.gz 2024-04-04T16:50:15.824 INFO:teuthology.orchestra.run.smithi072.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.48896.log.gz 2024-04-04T16:50:15.824 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.359846.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.266445.log 2024-04-04T16:50:15.825 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.539017.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.268559.log 2024-04-04T16:50:15.826 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.266445.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.460732.log 2024-04-04T16:50:15.828 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.268559.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49064.log 2024-04-04T16:50:15.829 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.460732.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.451060.log.gz 2024-04-04T16:50:15.829 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.257748.log 2024-04-04T16:50:15.830 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.49064.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.203410.log 2024-04-04T16:50:15.830 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.257748.log: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.524891.log.gz 2024-04-04T16:50:15.831 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.514339.log 2024-04-04T16:50:15.832 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.513075.log 2024-04-04T16:50:15.833 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.203410.log: /var/log/ceph/ceph-client.admin.514339.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.526215.log 2024-04-04T16:50:15.834 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.513075.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.212577.log 2024-04-04T16:50:15.835 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.526215.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137933.log 2024-04-04T16:50:15.835 INFO:teuthology.orchestra.run.smithi072.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.549804.log.gz 2024-04-04T16:50:15.835 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.212577.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.343126.log 2024-04-04T16:50:15.836 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.137933.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.481220.log 2024-04-04T16:50:15.837 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.343126.log: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.461153.log.gz 2024-04-04T16:50:15.837 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.490403.log 2024-04-04T16:50:15.838 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.481220.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43566.log 2024-04-04T16:50:15.839 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.490403.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.285011.log 2024-04-04T16:50:15.840 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.43566.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.281406.log 2024-04-04T16:50:15.841 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.285011.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.352805.log 2024-04-04T16:50:15.842 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.510973.log 2024-04-04T16:50:15.843 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.281406.log: /var/log/ceph/ceph-client.admin.352805.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.548199.log 2024-04-04T16:50:15.844 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.510973.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.226092.log 2024-04-04T16:50:15.845 INFO:teuthology.orchestra.run.smithi072.stderr: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.231063.log.gz 2024-04-04T16:50:15.845 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.202060.log 2024-04-04T16:50:15.846 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.548199.log: /var/log/ceph/ceph-client.admin.226092.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.194552.log.gz 2024-04-04T16:50:15.846 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.251396.log 2024-04-04T16:50:15.847 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.258591.log 2024-04-04T16:50:15.848 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.202060.log: /var/log/ceph/ceph-client.admin.251396.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.508615.log 2024-04-04T16:50:15.849 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.261982.log 2024-04-04T16:50:15.850 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.258591.log: /var/log/ceph/ceph-client.admin.508615.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.268129.log 2024-04-04T16:50:15.851 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.351075.log 2024-04-04T16:50:15.852 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.261982.log: /var/log/ceph/ceph-client.admin.268129.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182018.log 2024-04-04T16:50:15.853 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.238558.log 2024-04-04T16:50:15.854 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.351075.log: /var/log/ceph/ceph-client.admin.182018.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.463322.log 2024-04-04T16:50:15.855 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.238558.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.329494.log 2024-04-04T16:50:15.856 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.463322.log: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.328643.log.gz 2024-04-04T16:50:15.856 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44563.log 2024-04-04T16:50:15.857 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.329494.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162323.log 2024-04-04T16:50:15.858 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.44563.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.391140.log 2024-04-04T16:50:15.859 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.162323.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.222463.log 2024-04-04T16:50:15.860 INFO:teuthology.orchestra.run.smithi072.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.227771.log.gz 2024-04-04T16:50:15.860 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.391140.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.274520.log 2024-04-04T16:50:15.861 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.222463.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.228201.log.gz 2024-04-04T16:50:15.862 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.319940.log 2024-04-04T16:50:15.863 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.274520.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.405058.log 2024-04-04T16:50:15.864 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.512232.log 2024-04-04T16:50:15.866 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.319940.log: /var/log/ceph/ceph-client.admin.405058.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.539026.log 2024-04-04T16:50:15.866 INFO:teuthology.orchestra.run.smithi072.stderr: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.257748.log.gz 2024-04-04T16:50:15.867 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.363537.log 2024-04-04T16:50:15.867 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.512232.log: /var/log/ceph/ceph-client.admin.539026.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.195847.log 2024-04-04T16:50:15.868 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.407220.log 2024-04-04T16:50:15.870 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.363537.log: /var/log/ceph/ceph-client.admin.195847.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.365060.log 2024-04-04T16:50:15.870 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.418725.log 2024-04-04T16:50:15.872 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.407220.log: /var/log/ceph/ceph-client.admin.365060.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.458945.log 2024-04-04T16:50:15.872 INFO:teuthology.orchestra.run.smithi072.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.355019.log.gz 2024-04-04T16:50:15.873 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.418725.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.548451.log 2024-04-04T16:50:15.874 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.458945.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162332.log 2024-04-04T16:50:15.875 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.548451.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.520842.log 2024-04-04T16:50:15.876 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.162332.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.215525.log 2024-04-04T16:50:15.877 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.520842.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.549007.log 2024-04-04T16:50:15.878 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.215525.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.434895.log 2024-04-04T16:50:15.879 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.549007.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43569.log 2024-04-04T16:50:15.880 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.434895.log: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.332046.log.gz 2024-04-04T16:50:15.881 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143158.log 2024-04-04T16:50:15.882 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.43569.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.548555.log 2024-04-04T16:50:15.883 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.143158.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47432.log 2024-04-04T16:50:15.884 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.548555.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.248375.log 2024-04-04T16:50:15.884 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.47432.log: 78.3% -- replaced with /var/log/ceph/ceph-client.admin.343126.log.gz 2024-04-04T16:50:15.885 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.455010.log 2024-04-04T16:50:15.886 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.248375.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.519485.log 2024-04-04T16:50:15.887 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.455010.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43554.log 2024-04-04T16:50:15.888 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.519485.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138780.log 2024-04-04T16:50:15.889 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.43554.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.337957.log 2024-04-04T16:50:15.890 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.138780.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.392463.log 2024-04-04T16:50:15.891 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.337957.log: 84.9% -- replaced with /var/log/ceph/ceph-client.admin.417882.log.gz 2024-04-04T16:50:15.891 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187872.log 2024-04-04T16:50:15.893 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.392463.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.266454.log 2024-04-04T16:50:15.894 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.187872.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.346506.log 2024-04-04T16:50:15.894 INFO:teuthology.orchestra.run.smithi072.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.409375.log.gz 2024-04-04T16:50:15.895 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.266454.log: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.410629.log.gz 2024-04-04T16:50:15.895 INFO:teuthology.orchestra.run.smithi072.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.409796.log.gz 2024-04-04T16:50:15.895 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186534.log 2024-04-04T16:50:15.896 INFO:teuthology.orchestra.run.smithi072.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.410217.log.gz 2024-04-04T16:50:15.897 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.346506.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.250974.log 81.2% 2024-04-04T16:50:15.897 INFO:teuthology.orchestra.run.smithi072.stderr: -- replaced with /var/log/ceph/ceph-client.admin.223926.log.gz 2024-04-04T16:50:15.897 INFO:teuthology.orchestra.run.smithi072.stderr: 84.3% -- replaced with /var/log/ceph/ceph-client.admin.223505.log.gz 2024-04-04T16:50:15.898 INFO:teuthology.orchestra.run.smithi072.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.223514.log.gz 2024-04-04T16:50:15.898 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.186534.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.281415.log 2024-04-04T16:50:15.900 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.250974.log: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.220756.log.gz 2024-04-04T16:50:15.900 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.273685.log 2024-04-04T16:50:15.900 INFO:teuthology.orchestra.run.smithi072.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44623.log.gz 2024-04-04T16:50:15.901 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.281415.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.215951.log 2024-04-04T16:50:15.903 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.273685.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.212989.log 2024-04-04T16:50:15.904 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.215951.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.544407.log 2024-04-04T16:50:15.905 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.212989.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49707.log 2024-04-04T16:50:15.907 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.544407.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.412319.log 2024-04-04T16:50:15.908 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.49707.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.254656.log 2024-04-04T16:50:15.910 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.412319.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.337966.log 2024-04-04T16:50:15.910 INFO:teuthology.orchestra.run.smithi072.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.254243.log.gz 2024-04-04T16:50:15.911 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.254656.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43886.log 2024-04-04T16:50:15.912 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.337966.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.252923.log 2024-04-04T16:50:15.913 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.43886.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.260287.log 2024-04-04T16:50:15.914 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.252923.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.343135.log 2024-04-04T16:50:15.915 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.260287.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.413614.log 2024-04-04T16:50:15.916 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.343135.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.416192.log 2024-04-04T16:50:15.916 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.413614.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.319931.log 2024-04-04T16:50:15.918 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.416192.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-04-04T16:50:15.919 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.319931.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.233822.log 2024-04-04T16:50:15.920 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.392010.log 2024-04-04T16:50:15.921 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-osd.0.log: /var/log/ceph/ceph-client.admin.233822.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.263695.log.gz 2024-04-04T16:50:15.921 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.215960.log 2024-04-04T16:50:15.922 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.392010.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.528492.log 2024-04-04T16:50:15.923 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.215960.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.478577.log 2024-04-04T16:50:15.924 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.528492.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.390299.log 2024-04-04T16:50:15.925 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.478577.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.476853.log 2024-04-04T16:50:15.926 INFO:teuthology.orchestra.run.smithi072.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.329915.log.gz 2024-04-04T16:50:15.927 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.390299.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.491766.log 2024-04-04T16:50:15.928 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.476853.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.269822.log 2024-04-04T16:50:15.929 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.491766.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.462416.log 2024-04-04T16:50:15.930 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.269822.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128106.log 2024-04-04T16:50:15.931 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.462416.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136237.log 2024-04-04T16:50:15.932 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.128106.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.401367.log 2024-04-04T16:50:15.933 INFO:teuthology.orchestra.run.smithi072.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.120285.log.gz 2024-04-04T16:50:15.933 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.136237.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.446660.log 2024-04-04T16:50:15.935 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.401367.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.239403.log 2024-04-04T16:50:15.935 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.446660.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.394146.log 2024-04-04T16:50:15.936 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.239403.log: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.494295.log.gz 2024-04-04T16:50:15.937 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.513918.log 2024-04-04T16:50:15.938 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.394146.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43220.log 2024-04-04T16:50:15.939 INFO:teuthology.orchestra.run.smithi072.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.535466.log.gz 2024-04-04T16:50:15.940 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.513918.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42841.log 2024-04-04T16:50:15.941 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.43220.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.549091.log.gz 2024-04-04T16:50:15.941 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.401756.log 2024-04-04T16:50:15.942 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.42841.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50330.log 2024-04-04T16:50:15.944 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.401756.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.220335.log 2024-04-04T16:50:15.945 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.50330.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46925.log 2024-04-04T16:50:15.946 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.220335.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.549175.log 2024-04-04T16:50:15.947 INFO:teuthology.orchestra.run.smithi072.stderr: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.129820.log.gz 2024-04-04T16:50:15.948 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.46925.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.129406.log.gz 2024-04-04T16:50:15.948 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.280097.log 2024-04-04T16:50:15.949 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.549175.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.525366.log 2024-04-04T16:50:15.950 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.280097.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.361188.log 2024-04-04T16:50:15.951 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.525366.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.389340.log 2024-04-04T16:50:15.952 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.361188.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.70940.log.gz 2024-04-04T16:50:15.952 INFO:teuthology.orchestra.run.smithi072.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.46757.log.gz 2024-04-04T16:50:15.953 INFO:teuthology.orchestra.run.smithi072.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47432.log.gz 2024-04-04T16:50:15.953 INFO:teuthology.orchestra.run.smithi072.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.46337.log.gz 2024-04-04T16:50:15.953 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.478156.log 2024-04-04T16:50:15.954 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.389340.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44101.log 2024-04-04T16:50:15.956 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.478156.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.219915.log 2024-04-04T16:50:15.957 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.44101.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.472181.log 2024-04-04T16:50:15.958 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.219915.log: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.478577.log.gz 2024-04-04T16:50:15.959 INFO:teuthology.orchestra.run.smithi072.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.549217.log.gz 2024-04-04T16:50:15.959 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.233400.log 2024-04-04T16:50:15.959 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.472181.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.320366.log 2024-04-04T16:50:15.961 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.233400.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.195426.log 2024-04-04T16:50:15.962 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.320366.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.518592.log 2024-04-04T16:50:15.963 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.195426.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187432.log 2024-04-04T16:50:15.964 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.518592.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.426150.log 2024-04-04T16:50:15.965 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.187432.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46505.log 2024-04-04T16:50:15.966 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.426150.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.321205.log 2024-04-04T16:50:15.967 INFO:teuthology.orchestra.run.smithi072.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.528065.log.gz 2024-04-04T16:50:15.967 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.46505.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.207920.log 2024-04-04T16:50:15.969 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.321205.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.330782.log 2024-04-04T16:50:15.969 INFO:teuthology.orchestra.run.smithi072.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.47678.log.gz 2024-04-04T16:50:15.969 INFO:teuthology.orchestra.run.smithi072.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.47762.log.gz 2024-04-04T16:50:15.970 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.207920.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113545.log 2024-04-04T16:50:15.972 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.330782.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.548881.log 2024-04-04T16:50:15.973 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.113545.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.460270.log 2024-04-04T16:50:15.974 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.548881.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187863.log 2024-04-04T16:50:15.975 INFO:teuthology.orchestra.run.smithi072.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.474676.log.gz 2024-04-04T16:50:15.976 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.460270.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.403773.log 2024-04-04T16:50:15.977 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.187863.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.469860.log 2024-04-04T16:50:15.978 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.403773.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46127.log 2024-04-04T16:50:15.980 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.469860.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.347874.log 2024-04-04T16:50:15.981 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.46127.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48728.log 2024-04-04T16:50:15.982 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.347874.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136246.log 2024-04-04T16:50:15.983 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.48728.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.229692.log 2024-04-04T16:50:15.984 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.136246.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124672.log 2024-04-04T16:50:15.986 INFO:teuthology.orchestra.run.smithi072.stderr: 77.4% -- replaced with /var/log/ceph/ceph-client.admin.510122.log.gz 2024-04-04T16:50:15.986 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.229692.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49148.log 2024-04-04T16:50:15.991 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.124672.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.363546.log 2024-04-04T16:50:15.991 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.49148.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.341436.log 2024-04-04T16:50:15.991 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.219495.log 2024-04-04T16:50:15.991 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.363546.log: /var/log/ceph/ceph-client.admin.341436.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.341848.log 2024-04-04T16:50:15.991 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.219495.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.238989.log 2024-04-04T16:50:15.992 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.341848.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155905.log 2024-04-04T16:50:15.992 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.238989.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190586.log 2024-04-04T16:50:15.993 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.155905.log: 80.1% -- replaced with /var/log/ceph/ceph-client.admin.526215.log.gz 2024-04-04T16:50:15.994 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.318645.log 2024-04-04T16:50:15.994 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.190586.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.430342.log 2024-04-04T16:50:15.995 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.318645.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.481642.log 2024-04-04T16:50:15.996 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.430342.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.362549.log 2024-04-04T16:50:15.996 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.481642.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.264543.log 2024-04-04T16:50:15.997 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.362549.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.322473.log 2024-04-04T16:50:15.998 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.264543.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.416618.log 2024-04-04T16:50:15.999 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.322473.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.390308.log 2024-04-04T16:50:16.000 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.416618.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49809.log 2024-04-04T16:50:16.000 INFO:teuthology.orchestra.run.smithi072.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.512232.log.gz 2024-04-04T16:50:16.001 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5/var/log/ceph/ceph-client.admin.390308.log: --verbose -- /var/log/ceph/ceph-client.admin.200262.log 2024-04-04T16:50:16.002 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.49809.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163694.log 2024-04-04T16:50:16.003 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.200262.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146194.log 2024-04-04T16:50:16.004 INFO:teuthology.orchestra.run.smithi072.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.434895.log.gz 2024-04-04T16:50:16.004 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.163694.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48004.log 2024-04-04T16:50:16.005 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.146194.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.386661.log 2024-04-04T16:50:16.007 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.48004.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-04T16:50:16.008 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.386661.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.535031.log 2024-04-04T16:50:16.009 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.319487.log 2024-04-04T16:50:16.011 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.535031.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.456695.log 2024-04-04T16:50:16.012 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.319487.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.454584.log 2024-04-04T16:50:16.012 INFO:teuthology.orchestra.run.smithi072.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.483399.log.gz 2024-04-04T16:50:16.013 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.456695.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.348359.log 2024-04-04T16:50:16.015 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.454584.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.285436.log 2024-04-04T16:50:16.016 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.348359.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.227780.log 2024-04-04T16:50:16.016 INFO:teuthology.orchestra.run.smithi072.stderr: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.268129.log.gz 2024-04-04T16:50:16.017 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.285436.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182453.log 2024-04-04T16:50:16.019 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.227780.log: 79.2% -- replaced with /var/log/ceph/ceph-client.admin.127234.log.gz 2024-04-04T16:50:16.019 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.539905.log 2024-04-04T16:50:16.020 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.182453.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.524438.log 2024-04-04T16:50:16.021 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.539905.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.481211.log 2024-04-04T16:50:16.023 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.524438.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118293.log 2024-04-04T16:50:16.024 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.481211.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.510543.log 2024-04-04T16:50:16.025 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.118293.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.470832.log 2024-04-04T16:50:16.026 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.510543.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48686.log 2024-04-04T16:50:16.027 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.470832.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.534586.log 2024-04-04T16:50:16.028 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.537694.log 2024-04-04T16:50:16.029 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.48686.log: /var/log/ceph/ceph-client.admin.534586.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.511389.log 2024-04-04T16:50:16.030 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.537694.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131087.log 2024-04-04T16:50:16.031 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.511389.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.414914.log 2024-04-04T16:50:16.032 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.131087.log: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.420445.log.gz 2024-04-04T16:50:16.032 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.364050.log 2024-04-04T16:50:16.033 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.414914.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.228192.log 2024-04-04T16:50:16.034 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.364050.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.464179.log 2024-04-04T16:50:16.035 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.515605.log 2024-04-04T16:50:16.036 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.228192.log: /var/log/ceph/ceph-client.admin.464179.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.536806.log 2024-04-04T16:50:16.037 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.515605.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.387137.log.gz 2024-04-04T16:50:16.037 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.541237.log 2024-04-04T16:50:16.038 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.233409.log 2024-04-04T16:50:16.040 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.536806.log: /var/log/ceph/ceph-client.admin.541237.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.519476.log 2024-04-04T16:50:16.040 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.226935.log 2024-04-04T16:50:16.041 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.233409.log: /var/log/ceph/ceph-client.admin.519476.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.218201.log 2024-04-04T16:50:16.042 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154205.log 2024-04-04T16:50:16.044 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.226935.log: /var/log/ceph/ceph-client.admin.218201.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.388854.log 2024-04-04T16:50:16.044 INFO:teuthology.orchestra.run.smithi072.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.340583.log.gz 2024-04-04T16:50:16.045 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.154205.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.431198.log 2024-04-04T16:50:16.046 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.388854.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.420454.log 2024-04-04T16:50:16.047 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.431198.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.477266.log 2024-04-04T16:50:16.048 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.420454.log: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.391140.log.gz 2024-04-04T16:50:16.049 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.417465.log 2024-04-04T16:50:16.050 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.477266.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.355870.log 2024-04-04T16:50:16.051 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.417465.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.542146.log 2024-04-04T16:50:16.052 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.355870.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44521.log 2024-04-04T16:50:16.053 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.542146.log: 84.4% -- replaced with /var/log/ceph/ceph-client.admin.450564.log.gz 2024-04-04T16:50:16.053 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.463331.log 2024-04-04T16:50:16.055 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.44521.log: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.430763.log.gz 2024-04-04T16:50:16.055 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.198471.log 2024-04-04T16:50:16.056 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.463331.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.272799.log 2024-04-04T16:50:16.058 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.198471.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.284165.log 2024-04-04T16:50:16.059 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.272799.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-04-04T16:50:16.060 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.284165.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.385791.log 2024-04-04T16:50:16.061 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.240258.log 2024-04-04T16:50:16.062 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-mds.c.log: /var/log/ceph/ceph-client.admin.385791.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.511820.log 2024-04-04T16:50:16.063 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5/var/log/ceph/ceph-client.admin.240258.log: --verbose -- /var/log/ceph/ceph-client.admin.264122.log 2024-04-04T16:50:16.065 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.511820.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.412762.log 2024-04-04T16:50:16.066 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.456265.log 2024-04-04T16:50:16.066 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.264122.log: /var/log/ceph/ceph-client.admin.412762.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.384930.log 2024-04-04T16:50:16.068 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.456265.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.549301.log 2024-04-04T16:50:16.068 INFO:teuthology.orchestra.run.smithi072.stderr: 78.6% -- replaced with /var/log/ceph/ceph-client.admin.359846.log.gz 2024-04-04T16:50:16.069 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137502.log 2024-04-04T16:50:16.070 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.384930.log: /var/log/ceph/ceph-client.admin.549301.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.434104.log 2024-04-04T16:50:16.071 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.354152.log 2024-04-04T16:50:16.072 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.137502.log: /var/log/ceph/ceph-client.admin.434104.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139202.log 2024-04-04T16:50:16.073 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.354152.log: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.398006.log.gzgzip 2024-04-04T16:50:16.074 INFO:teuthology.orchestra.run.smithi072.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.451051.log 2024-04-04T16:50:16.075 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.139202.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47594.log 2024-04-04T16:50:16.076 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.451051.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.335001.log 2024-04-04T16:50:16.077 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.47594.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113113.log 2024-04-04T16:50:16.078 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.335001.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113977.log 2024-04-04T16:50:16.079 INFO:teuthology.orchestra.run.smithi072.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.274107.log.gz 2024-04-04T16:50:16.079 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.113113.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.235561.log 2024-04-04T16:50:16.081 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.113977.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49106.log 2024-04-04T16:50:16.082 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.235561.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.405910.log 2024-04-04T16:50:16.082 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.49106.log: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.320779.log.gz 2024-04-04T16:50:16.083 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.488983.log 2024-04-04T16:50:16.084 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.405910.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.447926.log 2024-04-04T16:50:16.086 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.488983.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.470356.log 2024-04-04T16:50:16.087 INFO:teuthology.orchestra.run.smithi072.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.197559.log.gz 2024-04-04T16:50:16.087 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.447926.log: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.198012.log.gz 2024-04-04T16:50:16.087 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137511.log 2024-04-04T16:50:16.089 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.470356.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.527077.log 2024-04-04T16:50:16.090 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.137511.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.329064.log 2024-04-04T16:50:16.091 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.527077.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.461574.log 2024-04-04T16:50:16.092 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.329064.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119378.log 2024-04-04T16:50:16.094 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.461574.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.250116.log 2024-04-04T16:50:16.095 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.119378.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.250125.log 2024-04-04T16:50:16.096 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.250116.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.346515.log 2024-04-04T16:50:16.098 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.250125.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.255631.log 2024-04-04T16:50:16.099 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.346515.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.462910.log 2024-04-04T16:50:16.100 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.255631.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42925.log 2024-04-04T16:50:16.101 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.462910.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.236405.log 2024-04-04T16:50:16.103 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.42925.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.266024.log 2024-04-04T16:50:16.103 INFO:teuthology.orchestra.run.smithi072.stderr: 78.1% -- replaced with /var/log/ceph/ceph-client.admin.219915.log.gz 2024-04-04T16:50:16.104 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.236405.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.235115.log 2024-04-04T16:50:16.105 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46253.log 2024-04-04T16:50:16.106 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.266024.log: /var/log/ceph/ceph-client.admin.235115.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.486808.log 2024-04-04T16:50:16.108 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.46253.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.357553.log 2024-04-04T16:50:16.109 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.486808.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.325444.log 2024-04-04T16:50:16.110 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.415336.log 2024-04-04T16:50:16.111 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.357553.log: /var/log/ceph/ceph-client.admin.325444.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187423.log 2024-04-04T16:50:16.111 INFO:teuthology.orchestra.run.smithi072.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.190595.log.gz 2024-04-04T16:50:16.112 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.415336.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160902.log 2024-04-04T16:50:16.113 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.187423.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.353732.log 2024-04-04T16:50:16.114 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.160902.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.416183.log 2024-04-04T16:50:16.115 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.353732.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.217299.log 2024-04-04T16:50:16.116 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.416183.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.226504.log 2024-04-04T16:50:16.117 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.217299.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.244638.log 2024-04-04T16:50:16.118 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.226504.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.354590.log.gz 2024-04-04T16:50:16.119 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.458524.log 2024-04-04T16:50:16.120 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.244638.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.358933.log 2024-04-04T16:50:16.121 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.458524.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.360327.log 2024-04-04T16:50:16.122 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.358933.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43225.log 2024-04-04T16:50:16.123 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.360327.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.263260.log 2024-04-04T16:50:16.124 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.43225.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48434.log 2024-04-04T16:50:16.125 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.263260.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.258169.log 2024-04-04T16:50:16.126 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.48434.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.283307.log 2024-04-04T16:50:16.127 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.332891.log 2024-04-04T16:50:16.128 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.258169.log: /var/log/ceph/ceph-client.admin.283307.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.546630.log 2024-04-04T16:50:16.129 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.332891.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.229087.log 2024-04-04T16:50:16.130 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.546630.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194974.log 2024-04-04T16:50:16.131 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.229087.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161870.log 2024-04-04T16:50:16.132 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.194974.log: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.412319.log.gz 2024-04-04T16:50:16.132 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.340152.log 2024-04-04T16:50:16.133 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.332055.log 2024-04-04T16:50:16.134 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.161870.log: /var/log/ceph/ceph-client.admin.340152.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47164.log 2024-04-04T16:50:16.135 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.332055.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135825.log 2024-04-04T16:50:16.136 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.47164.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.446669.log 2024-04-04T16:50:16.137 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.135825.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.414914.log.gz 2024-04-04T16:50:16.137 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.241519.log 2024-04-04T16:50:16.138 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.446669.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152458.log 2024-04-04T16:50:16.139 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.241519.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48938.log 2024-04-04T16:50:16.140 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.152458.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.404616.log 2024-04-04T16:50:16.141 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.521258.log 2024-04-04T16:50:16.141 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.48938.log: /var/log/ceph/ceph-client.admin.404616.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.490412.log 2024-04-04T16:50:16.142 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.521258.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48188.log 2024-04-04T16:50:16.143 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.490412.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.248813.log 2024-04-04T16:50:16.144 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.48188.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.529779.log 2024-04-04T16:50:16.145 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.248813.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.245060.log 2024-04-04T16:50:16.146 INFO:teuthology.orchestra.run.smithi072.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.128106.log.gz 2024-04-04T16:50:16.146 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.529779.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152045.log 2024-04-04T16:50:16.147 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.245060.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48854.log 2024-04-04T16:50:16.148 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.152045.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.531525.log 2024-04-04T16:50:16.149 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.48854.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.535918.log 2024-04-04T16:50:16.150 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.531525.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188761.log 2024-04-04T16:50:16.151 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.521763.log 2024-04-04T16:50:16.152 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.535918.log: /var/log/ceph/ceph-client.admin.188761.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144049.log 2024-04-04T16:50:16.153 INFO:teuthology.orchestra.run.smithi072.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.268559.log.gz 2024-04-04T16:50:16.153 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.521763.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160893.log 2024-04-04T16:50:16.154 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.144049.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.229683.log 2024-04-04T16:50:16.155 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.160893.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44665.log 2024-04-04T16:50:16.156 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.229683.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.412753.log 2024-04-04T16:50:16.157 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.494755.log 2024-04-04T16:50:16.158 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.44665.log: /var/log/ceph/ceph-client.admin.412753.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48560.log 2024-04-04T16:50:16.159 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.494755.log: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.239403.log.gz 2024-04-04T16:50:16.159 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128985.log 2024-04-04T16:50:16.160 INFO:teuthology.orchestra.run.smithi072.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.238989.log.gz 2024-04-04T16:50:16.161 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.48560.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111536.log 2024-04-04T16:50:16.162 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.128985.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163685.log 2024-04-04T16:50:16.162 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.111536.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.418304.log 2024-04-04T16:50:16.164 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.163685.log: 83.5% -- replaced with /var/log/ceph/ceph-client.admin.233400.log.gz 2024-04-04T16:50:16.164 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.486381.log 2024-04-04T16:50:16.164 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.418304.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.232988.log.gz 2024-04-04T16:50:16.164 INFO:teuthology.orchestra.run.smithi072.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.233409.log.gz 2024-04-04T16:50:16.165 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.231514.log 2024-04-04T16:50:16.167 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.486381.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.207457.log 2024-04-04T16:50:16.168 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.231514.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.329073.log 2024-04-04T16:50:16.169 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.207457.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.221186.log 2024-04-04T16:50:16.170 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.329073.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.216850.log 2024-04-04T16:50:16.172 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.221186.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50288.log 2024-04-04T16:50:16.173 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.216850.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.316959.log 2024-04-04T16:50:16.174 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.50288.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49977.log 2024-04-04T16:50:16.175 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.316959.log: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.211726.log.gz 2024-04-04T16:50:16.176 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.525797.log 2024-04-04T16:50:16.176 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.49977.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.505930.log 2024-04-04T16:50:16.177 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.525797.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147605.log 2024-04-04T16:50:16.178 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.505930.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191537.log 2024-04-04T16:50:16.179 INFO:teuthology.orchestra.run.smithi072.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.155905.log.gz 2024-04-04T16:50:16.179 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.147605.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.464664.log 2024-04-04T16:50:16.180 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.191537.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.509287.log 2024-04-04T16:50:16.181 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.464664.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.315693.log 2024-04-04T16:50:16.182 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.509287.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.335834.log 2024-04-04T16:50:16.183 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.315693.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.420033.log 2024-04-04T16:50:16.184 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.335834.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135816.log 2024-04-04T16:50:16.185 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.420033.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.549469.log 2024-04-04T16:50:16.186 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.135816.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.226083.log 2024-04-04T16:50:16.187 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.549469.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.549762.log 2024-04-04T16:50:16.188 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.226083.log: 93.3% -- replaced with /var/log/ceph/ceph-client.admin.206116.log.gz 2024-04-04T16:50:16.188 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.429922.log 2024-04-04T16:50:16.189 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.549762.log: 83.5% -- replaced with /var/log/ceph/ceph-client.admin.142258.log.gz 2024-04-04T16:50:16.190 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.467069.log 2024-04-04T16:50:16.194 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.429922.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.227347.log 2024-04-04T16:50:16.194 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.467069.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.473402.log 81.7% 2024-04-04T16:50:16.195 INFO:teuthology.orchestra.run.smithi072.stderr: -- replaced with /var/log/ceph/ceph-client.admin.463322.log.gz 2024-04-04T16:50:16.195 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.227347.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.548073.log 2024-04-04T16:50:16.195 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.473402.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.430772.log 2024-04-04T16:50:16.196 INFO:teuthology.orchestra.run.smithi072.stderr: 84.4% -- replaced with /var/log/ceph/ceph-client.admin.542146.log.gz 2024-04-04T16:50:16.196 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.548073.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.434469.log 2024-04-04T16:50:16.198 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.430772.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.514761.log 2024-04-04T16:50:16.199 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.434469.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.245493.log 2024-04-04T16:50:16.199 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.514761.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.46925.log.gz 2024-04-04T16:50:16.200 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180338.log 2024-04-04T16:50:16.201 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.245493.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47306.log 2024-04-04T16:50:16.203 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.180338.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.435741.log 2024-04-04T16:50:16.203 INFO:teuthology.orchestra.run.smithi072.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.529779.log.gz 2024-04-04T16:50:16.204 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.47306.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.538129.log 2024-04-04T16:50:16.205 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.435741.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.252316.log 2024-04-04T16:50:16.206 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.538129.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125139.log 2024-04-04T16:50:16.207 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.252316.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.256470.log 2024-04-04T16:50:16.208 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.125139.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.341004.log 2024-04-04T16:50:16.210 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.256470.log: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.513918.log.gz 2024-04-04T16:50:16.210 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113986.log 2024-04-04T16:50:16.211 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.341004.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.549343.log 2024-04-04T16:50:16.212 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.113986.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.347379.log 2024-04-04T16:50:16.213 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.549343.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.474245.log 2024-04-04T16:50:16.214 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.347379.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.510131.log 2024-04-04T16:50:16.215 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.474245.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43975.log 2024-04-04T16:50:16.216 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.510131.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.342701.log 2024-04-04T16:50:16.217 INFO:teuthology.orchestra.run.smithi072.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.47164.log.gz 2024-04-04T16:50:16.218 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.43975.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128115.log 2024-04-04T16:50:16.219 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.342701.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.525788.log 2024-04-04T16:50:16.220 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.128115.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.475999.log 2024-04-04T16:50:16.221 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.525788.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.493461.log 2024-04-04T16:50:16.222 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48644.log 2024-04-04T16:50:16.223 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.475999.log: /var/log/ceph/ceph-client.admin.493461.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.267708.log 2024-04-04T16:50:16.224 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.540349.log 2024-04-04T16:50:16.225 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.48644.log: /var/log/ceph/ceph-client.admin.267708.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.275442.log 2024-04-04T16:50:16.226 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136667.log 2024-04-04T16:50:16.227 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.540349.log: /var/log/ceph/ceph-client.admin.275442.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.432520.log 2024-04-04T16:50:16.230 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.523073.log 2024-04-04T16:50:16.230 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.136667.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.548073.log.gz 2024-04-04T16:50:16.230 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.432520.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.323745.log 2024-04-04T16:50:16.231 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.523073.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.227356.log 2024-04-04T16:50:16.232 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.323745.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.467060.log 2024-04-04T16:50:16.233 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.227356.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.546639.log 2024-04-04T16:50:16.234 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.467060.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.208336.log 2024-04-04T16:50:16.235 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.546639.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.395461.log 2024-04-04T16:50:16.237 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.208336.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.542609.log 2024-04-04T16:50:16.237 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.395461.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.456695.log.gz 2024-04-04T16:50:16.238 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.249267.log 2024-04-04T16:50:16.239 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.542609.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.546156.log 2024-04-04T16:50:16.240 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.249267.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.457666.log 2024-04-04T16:50:16.241 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.546156.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.332467.log 2024-04-04T16:50:16.243 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.457666.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.489843.log 2024-04-04T16:50:16.243 INFO:teuthology.orchestra.run.smithi072.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.384930.log.gz 2024-04-04T16:50:16.244 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.332467.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185175.log 2024-04-04T16:50:16.245 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.489843.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131548.log 2024-04-04T16:50:16.246 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.185175.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.331626.log 2024-04-04T16:50:16.247 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.131548.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.397530.log 2024-04-04T16:50:16.248 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.331626.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.366503.log 2024-04-04T16:50:16.249 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.397530.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.250974.log.gz 2024-04-04T16:50:16.249 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.334581.log 2024-04-04T16:50:16.250 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.366503.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.408520.log 2024-04-04T16:50:16.251 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.334581.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.203869.log 2024-04-04T16:50:16.252 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.408520.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.413605.log 2024-04-04T16:50:16.253 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.203869.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.317385.log 2024-04-04T16:50:16.255 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.413605.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.242844.log 2024-04-04T16:50:16.256 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.545701.log 2024-04-04T16:50:16.256 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.317385.log: /var/log/ceph/ceph-client.admin.242844.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50648.log 2024-04-04T16:50:16.258 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.545701.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.474667.log 2024-04-04T16:50:16.259 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.50648.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50582.log 2024-04-04T16:50:16.259 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.474667.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.255078.log 2024-04-04T16:50:16.260 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.50582.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.353271.log 2024-04-04T16:50:16.261 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.255078.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.318654.log 2024-04-04T16:50:16.262 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.353271.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.528483.log 2024-04-04T16:50:16.263 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.318654.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.280959.log 2024-04-04T16:50:16.264 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.528483.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.465178.log 2024-04-04T16:50:16.265 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.280959.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.223093.log 2024-04-04T16:50:16.266 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.465178.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145355.log 2024-04-04T16:50:16.266 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.223093.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193710.log 2024-04-04T16:50:16.267 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.145355.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.314837.log 2024-04-04T16:50:16.268 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.193710.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47720.log 2024-04-04T16:50:16.269 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.314837.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.541228.log 2024-04-04T16:50:16.270 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.47720.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.274098.log 2024-04-04T16:50:16.270 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.541228.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.266454.log.gz 2024-04-04T16:50:16.271 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.198462.log 2024-04-04T16:50:16.272 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.274098.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.328652.log 2024-04-04T16:50:16.272 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.198462.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.284156.log 2024-04-04T16:50:16.274 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.328652.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43232.log 2024-04-04T16:50:16.275 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.284156.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.399389.log 2024-04-04T16:50:16.275 INFO:teuthology.orchestra.run.smithi072.stderr: 77.4% -- replaced with /var/log/ceph/ceph-client.admin.321205.log.gz 2024-04-04T16:50:16.276 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.43232.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42277.log 2024-04-04T16:50:16.276 INFO:teuthology.orchestra.run.smithi072.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.390308.log.gz 2024-04-04T16:50:16.277 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.399389.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.411051.log 2024-04-04T16:50:16.278 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.42277.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.280531.log 2024-04-04T16:50:16.280 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.411051.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154196.log 2024-04-04T16:50:16.281 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.280531.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.465674.log 2024-04-04T16:50:16.282 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.154196.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142267.log 2024-04-04T16:50:16.283 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.465674.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.537250.log 2024-04-04T16:50:16.285 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.142267.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.363034.log 2024-04-04T16:50:16.286 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.537250.log: /var/log/ceph/ceph-mds.a.log 2024-04-04T16:50:16.287 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.363034.log: 83.3% -- replaced with /var/log/ceph/ceph-client.admin.535909.log.gz 2024-04-04T16:50:16.287 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148031.log 2024-04-04T16:50:16.289 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.479950.log 2024-04-04T16:50:16.289 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.148031.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.434460.log 2024-04-04T16:50:16.291 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.479950.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.518138.log 2024-04-04T16:50:16.292 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.434460.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.213412.log 2024-04-04T16:50:16.292 INFO:teuthology.orchestra.run.smithi072.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.113113.log.gz 2024-04-04T16:50:16.293 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.518138.log: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.119378.log.gz 2024-04-04T16:50:16.293 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49499.log 2024-04-04T16:50:16.295 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.213412.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.420024.log 2024-04-04T16:50:16.296 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.49499.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.197135.log 2024-04-04T16:50:16.296 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.420024.log: 78.0% -- replaced with /var/log/ceph/ceph-client.admin.447926.log.gz 2024-04-04T16:50:16.297 INFO:teuthology.orchestra.run.smithi072.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.228192.log.gz 2024-04-04T16:50:16.297 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.419600.log 2024-04-04T16:50:16.297 INFO:teuthology.orchestra.run.smithi072.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.227780.log.gz 2024-04-04T16:50:16.298 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.197135.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.406794.log 2024-04-04T16:50:16.300 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.419600.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136658.log 2024-04-04T16:50:16.301 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.406794.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.322899.log 2024-04-04T16:50:16.303 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.136658.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.240672.log 2024-04-04T16:50:16.305 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.322899.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.207466.log 2024-04-04T16:50:16.305 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.240672.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179912.log 2024-04-04T16:50:16.306 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.207466.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.419155.log 2024-04-04T16:50:16.308 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.179912.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.221598.log 2024-04-04T16:50:16.309 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.419155.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.241095.log 2024-04-04T16:50:16.310 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.221598.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.225671.log 2024-04-04T16:50:16.312 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.241095.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.203860.log 2024-04-04T16:50:16.313 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.225671.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157730.log 2024-04-04T16:50:16.313 INFO:teuthology.orchestra.run.smithi072.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.470356.log.gz 2024-04-04T16:50:16.314 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.203860.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190097.log 2024-04-04T16:50:16.315 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.157730.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164421.log 2024-04-04T16:50:16.316 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.190097.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48518.log 2024-04-04T16:50:16.318 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.164421.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.475154.log 2024-04-04T16:50:16.319 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.48518.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.237241.log 2024-04-04T16:50:16.320 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.475154.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.545259.log 2024-04-04T16:50:16.321 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.237241.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.411482.log 2024-04-04T16:50:16.322 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.545259.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.242422.log 2024-04-04T16:50:16.323 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.411482.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179903.log 2024-04-04T16:50:16.323 INFO:teuthology.orchestra.run.smithi072.stderr: 93.2% -- replaced with /var/log/ceph/ceph-client.admin.198021.log.gz 2024-04-04T16:50:16.324 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.242422.log: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.284156.log.gz 2024-04-04T16:50:16.324 INFO:teuthology.orchestra.run.smithi072.stderr: 78.6% -- replaced with /var/log/ceph/ceph-client.admin.510543.log.gz 2024-04-04T16:50:16.326 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.179903.log: 82.9% -- replaced with /var/log/ceph/ceph-client.admin.478156.log.gz 2024-04-04T16:50:16.328 INFO:teuthology.orchestra.run.smithi072.stderr: 93.4% -- replaced with /var/log/ceph/ceph-client.admin.187872.log.gz 2024-04-04T16:50:16.339 INFO:teuthology.orchestra.run.smithi072.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.49977.log.gz 2024-04-04T16:50:16.340 INFO:teuthology.orchestra.run.smithi072.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.50019.log.gz 2024-04-04T16:50:16.349 INFO:teuthology.orchestra.run.smithi072.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.49106.log.gz 2024-04-04T16:50:16.356 INFO:teuthology.orchestra.run.smithi072.stderr: 93.4% -- replaced with /var/log/ceph/ceph-client.admin.205218.log.gz 2024-04-04T16:50:16.359 INFO:teuthology.orchestra.run.smithi072.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.161870.log.gz 2024-04-04T16:50:16.362 INFO:teuthology.orchestra.run.smithi072.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.281406.log.gz 2024-04-04T16:50:16.366 INFO:teuthology.orchestra.run.smithi072.stderr: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.154196.log.gz 2024-04-04T16:50:16.367 INFO:teuthology.orchestra.run.smithi072.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.154205.log.gz 2024-04-04T16:50:16.368 INFO:teuthology.orchestra.run.smithi072.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.135816.log.gz 2024-04-04T16:50:16.372 INFO:teuthology.orchestra.run.smithi072.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.180338.log.gz 2024-04-04T16:50:16.373 INFO:teuthology.orchestra.run.smithi072.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.163685.log.gz 2024-04-04T16:50:16.377 INFO:teuthology.orchestra.run.smithi072.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.203860.log.gz 2024-04-04T16:50:16.383 INFO:teuthology.orchestra.run.smithi072.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.224356.log.gz 2024-04-04T16:50:16.383 INFO:teuthology.orchestra.run.smithi072.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.226504.log.gz 2024-04-04T16:50:16.384 INFO:teuthology.orchestra.run.smithi072.stderr: 77.3% -- replaced with /var/log/ceph/ceph-client.admin.227347.log.gz 2024-04-04T16:50:16.387 INFO:teuthology.orchestra.run.smithi072.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44521.log.gz 2024-04-04T16:50:16.393 INFO:teuthology.orchestra.run.smithi072.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.221598.log.gz 2024-04-04T16:50:16.399 INFO:teuthology.orchestra.run.smithi072.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.522615.log.gz 2024-04-04T16:50:16.407 INFO:teuthology.orchestra.run.smithi072.stderr: 84.3% -- replaced with /var/log/ceph/ceph-client.admin.197135.log.gz 2024-04-04T16:50:16.411 INFO:teuthology.orchestra.run.smithi072.stderr: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.391584.log.gz 2024-04-04T16:50:16.417 INFO:teuthology.orchestra.run.smithi072.stderr: 80.3% -- replaced with /var/log/ceph/ceph-client.admin.332467.log.gz 2024-04-04T16:50:16.420 INFO:teuthology.orchestra.run.smithi072.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.242422.log.gz 2024-04-04T16:50:16.433 INFO:teuthology.orchestra.run.smithi072.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.346093.log.gz 2024-04-04T16:50:16.437 INFO:teuthology.orchestra.run.smithi072.stderr: 77.5% -- replaced with /var/log/ceph/ceph-client.admin.466639.log.gz 2024-04-04T16:50:16.454 INFO:teuthology.orchestra.run.smithi072.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.48188.log.gz 2024-04-04T16:50:16.454 INFO:teuthology.orchestra.run.smithi072.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.48130.log.gz 2024-04-04T16:50:16.462 INFO:teuthology.orchestra.run.smithi072.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.136667.log.gz 2024-04-04T16:50:16.464 INFO:teuthology.orchestra.run.smithi072.stderr: 84.7% -- replaced with /var/log/ceph/ceph-client.admin.488974.log.gz 2024-04-04T16:50:16.466 INFO:teuthology.orchestra.run.smithi072.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.513927.log.gz 2024-04-04T16:50:16.480 INFO:teuthology.orchestra.run.smithi072.stderr: 93.4% -- replaced with /var/log/ceph/ceph-client.admin.186534.log.gz 2024-04-04T16:50:16.486 INFO:teuthology.orchestra.run.smithi072.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.47720.log.gz 2024-04-04T16:50:16.492 INFO:teuthology.orchestra.run.smithi072.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.514761.log.gz 2024-04-04T16:50:16.500 INFO:teuthology.orchestra.run.smithi072.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.513084.log.gz 2024-04-04T16:50:16.502 INFO:teuthology.orchestra.run.smithi072.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.434460.log.gz 2024-04-04T16:50:16.504 INFO:teuthology.orchestra.run.smithi072.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.435732.log.gz 2024-04-04T16:50:16.510 INFO:teuthology.orchestra.run.smithi072.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.432520.log.gz 2024-04-04T16:50:16.511 INFO:teuthology.orchestra.run.smithi072.stderr: 78.2% -- replaced with /var/log/ceph/ceph-client.admin.517716.log.gz 2024-04-04T16:50:16.537 INFO:teuthology.orchestra.run.smithi072.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.44227.log.gz 2024-04-04T16:50:16.537 INFO:teuthology.orchestra.run.smithi072.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44353.log.gz 2024-04-04T16:50:16.555 INFO:teuthology.orchestra.run.smithi072.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.342269.log.gz 2024-04-04T16:50:16.564 INFO:teuthology.orchestra.run.smithi072.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.326857.log.gz 2024-04-04T16:50:16.613 INFO:teuthology.orchestra.run.smithi072.stderr: 84.8% -- replaced with /var/log/ceph/ceph-client.admin.389340.log.gz 2024-04-04T16:50:16.632 INFO:teuthology.orchestra.run.smithi072.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.327699.log.gz 2024-04-04T16:50:16.636 INFO:teuthology.orchestra.run.smithi072.stderr: 84.7% -- replaced with /var/log/ceph/ceph-client.admin.222019.log.gz 2024-04-04T16:50:16.636 INFO:teuthology.orchestra.run.smithi072.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.179903.log.gz 2024-04-04T16:50:16.636 INFO:teuthology.orchestra.run.smithi072.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.180329.log.gz 2024-04-04T16:50:16.642 INFO:teuthology.orchestra.run.smithi072.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.180759.log.gz 2024-04-04T16:50:16.644 INFO:teuthology.orchestra.run.smithi072.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.209191.log.gz 2024-04-04T16:50:16.652 INFO:teuthology.orchestra.run.smithi072.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.414484.log.gz 85.0% 2024-04-04T16:50:16.652 INFO:teuthology.orchestra.run.smithi072.stderr: -- replaced with /var/log/ceph/ceph-client.admin.414033.log.gz 2024-04-04T16:50:16.654 INFO:teuthology.orchestra.run.smithi072.stderr: 92.9% -- replaced with /var/log/ceph/ceph-client.admin.415336.log.gz 2024-04-04T16:50:16.667 INFO:teuthology.orchestra.run.smithi072.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.339315.log.gz 2024-04-04T16:50:16.674 INFO:teuthology.orchestra.run.smithi072.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.239835.log.gz 2024-04-04T16:50:16.682 INFO:teuthology.orchestra.run.smithi072.stderr: 84.9% -- replaced with /var/log/ceph/ceph-client.admin.411899.log.gz 2024-04-04T16:50:16.686 INFO:teuthology.orchestra.run.smithi072.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.196686.log.gz 2024-04-04T16:50:16.687 INFO:teuthology.orchestra.run.smithi072.stderr: 91.9% -- replaced with /var/log/ceph/ceph-client.admin.348359.log.gz 2024-04-04T16:50:16.698 INFO:teuthology.orchestra.run.smithi072.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.346084.log.gz 2024-04-04T16:50:16.698 INFO:teuthology.orchestra.run.smithi072.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.341857.log.gz 2024-04-04T16:50:16.709 INFO:teuthology.orchestra.run.smithi072.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.405484.log.gz 2024-04-04T16:50:16.715 INFO:teuthology.orchestra.run.smithi072.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.318654.log.gz 2024-04-04T16:50:16.718 INFO:teuthology.orchestra.run.smithi072.stderr: 84.7% -- replaced with /var/log/ceph/ceph-client.admin.347865.log.gz 2024-04-04T16:50:16.728 INFO:teuthology.orchestra.run.smithi117.stderr: 94.2% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-04-04T16:50:16.750 INFO:teuthology.orchestra.run.smithi072.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.266033.log.gz 2024-04-04T16:50:16.750 INFO:teuthology.orchestra.run.smithi072.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.431198.log.gz 2024-04-04T16:50:16.751 INFO:teuthology.orchestra.run.smithi072.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.404625.log.gz 2024-04-04T16:50:16.764 INFO:teuthology.orchestra.run.smithi072.stderr: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.337957.log.gz 2024-04-04T16:50:16.765 INFO:teuthology.orchestra.run.smithi072.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.337118.log.gz 2024-04-04T16:50:16.777 INFO:teuthology.orchestra.run.smithi072.stderr: 80.1% -- replaced with /var/log/ceph/ceph-client.admin.265603.log.gz 2024-04-04T16:50:16.810 INFO:teuthology.orchestra.run.smithi072.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.535918.log.gz 2024-04-04T16:50:16.816 INFO:teuthology.orchestra.run.smithi072.stderr: 93.8% -- replaced with /var/log/ceph/ceph-client.admin.272808.log.gz 2024-04-04T16:50:16.820 INFO:teuthology.orchestra.run.smithi072.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.262843.log.gz 2024-04-04T16:50:16.826 INFO:teuthology.orchestra.run.smithi072.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.236405.log.gz 2024-04-04T16:50:16.829 INFO:teuthology.orchestra.run.smithi072.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.253401.log.gz 2024-04-04T16:50:16.841 INFO:teuthology.orchestra.run.smithi072.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.397530.log.gz 2024-04-04T16:50:16.873 INFO:teuthology.orchestra.run.smithi072.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.255622.log.gz 2024-04-04T16:50:16.875 INFO:teuthology.orchestra.run.smithi072.stderr: 93.1% -- replaced with /var/log/ceph/ceph-client.admin.545259.log.gz 2024-04-04T16:50:16.893 INFO:teuthology.orchestra.run.smithi072.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.50200.log.gz 2024-04-04T16:50:16.900 INFO:teuthology.orchestra.run.smithi072.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.142735.log.gz 2024-04-04T16:50:16.911 INFO:teuthology.orchestra.run.smithi072.stderr: 84.8% -- replaced with /var/log/ceph/ceph-client.admin.477688.log.gz 2024-04-04T16:50:16.916 INFO:teuthology.orchestra.run.smithi072.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.186091.log.gz 2024-04-04T16:50:16.920 INFO:teuthology.orchestra.run.smithi072.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.269392.log.gz 2024-04-04T16:50:16.925 INFO:teuthology.orchestra.run.smithi072.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.112569.log.gz 2024-04-04T16:50:16.929 INFO:teuthology.orchestra.run.smithi072.stderr: 77.9% -- replaced with /var/log/ceph/ceph-client.admin.539896.log.gz 2024-04-04T16:50:16.938 INFO:teuthology.orchestra.run.smithi072.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.214267.log.gz 2024-04-04T16:50:16.953 INFO:teuthology.orchestra.run.smithi072.stderr: 77.4% -- replaced with /var/log/ceph/ceph-client.admin.530618.log.gz 2024-04-04T16:50:16.955 INFO:teuthology.orchestra.run.smithi072.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.262417.log.gz 2024-04-04T16:50:16.964 INFO:teuthology.orchestra.run.smithi072.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.417456.log.gz 2024-04-04T16:50:16.970 INFO:teuthology.orchestra.run.smithi072.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.455431.log.gz 2024-04-04T16:50:16.975 INFO:teuthology.orchestra.run.smithi072.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.403764.log.gz 2024-04-04T16:50:16.976 INFO:teuthology.orchestra.run.smithi072.stderr: 84.5% -- replaced with /var/log/ceph/ceph-client.admin.404190.log.gz 2024-04-04T16:50:16.982 INFO:teuthology.orchestra.run.smithi072.stderr: 93.4% -- replaced with /var/log/ceph/ceph-client.admin.183730.log.gz 2024-04-04T16:50:16.991 INFO:teuthology.orchestra.run.smithi072.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.331635.log.gz 2024-04-04T16:50:16.993 INFO:teuthology.orchestra.run.smithi072.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.347388.log.gz 2024-04-04T16:50:16.996 INFO:teuthology.orchestra.run.smithi072.stderr: 84.3% -- replaced with /var/log/ceph/ceph-client.admin.267287.log.gz 2024-04-04T16:50:17.001 INFO:teuthology.orchestra.run.smithi072.stderr: 77.5% -- replaced with /var/log/ceph/ceph-client.admin.389878.log.gz 2024-04-04T16:50:17.039 INFO:teuthology.orchestra.run.smithi072.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.337535.log.gz 2024-04-04T16:50:17.057 INFO:teuthology.orchestra.run.smithi072.stderr: 84.9% -- replaced with /var/log/ceph/ceph-client.admin.256896.log.gz 2024-04-04T16:50:17.073 INFO:teuthology.orchestra.run.smithi072.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46379.log.gz 2024-04-04T16:50:17.076 INFO:teuthology.orchestra.run.smithi072.stderr: 84.6% -- replaced with /var/log/ceph/ceph-client.admin.396160.log.gz 2024-04-04T16:50:17.080 INFO:teuthology.orchestra.run.smithi072.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.461995.log.gz 2024-04-04T16:50:17.082 INFO:teuthology.orchestra.run.smithi072.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.151489.log.gz 2024-04-04T16:50:17.085 INFO:teuthology.orchestra.run.smithi072.stderr: 77.5% -- replaced with /var/log/ceph/ceph-client.admin.482485.log.gz 2024-04-04T16:50:17.102 INFO:teuthology.orchestra.run.smithi072.stderr: 78.5% -- replaced with /var/log/ceph/ceph-client.admin.126371.log.gz 2024-04-04T16:50:17.105 INFO:teuthology.orchestra.run.smithi072.stderr: 92.6% -- replaced with /var/log/ceph/ceph-client.admin.274978.log.gz 2024-04-04T16:50:17.131 INFO:teuthology.orchestra.run.smithi072.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.134129.log.gz 2024-04-04T16:50:17.132 INFO:teuthology.orchestra.run.smithi072.stderr: 93.8% -- replaced with /var/log/ceph/ceph-client.admin.197568.log.gz 2024-04-04T16:50:17.134 INFO:teuthology.orchestra.run.smithi072.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.49274.log.gz 2024-04-04T16:50:17.134 INFO:teuthology.orchestra.run.smithi072.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.49334.log.gz 2024-04-04T16:50:17.140 INFO:teuthology.orchestra.run.smithi072.stderr: 93.2% -- replaced with /var/log/ceph/ceph-client.admin.433370.log.gz 2024-04-04T16:50:17.141 INFO:teuthology.orchestra.run.smithi072.stderr: 77.5% -- replaced with /var/log/ceph/ceph-client.admin.270236.log.gz 2024-04-04T16:50:17.142 INFO:teuthology.orchestra.run.smithi072.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.144903.log.gz 2024-04-04T16:50:17.155 INFO:teuthology.orchestra.run.smithi072.stderr: 77.9% -- replaced with /var/log/ceph/ceph-client.admin.132006.log.gz 2024-04-04T16:50:17.156 INFO:teuthology.orchestra.run.smithi072.stderr: 93.4% -- replaced with /var/log/ceph/ceph-client.admin.201170.log.gz 2024-04-04T16:50:17.158 INFO:teuthology.orchestra.run.smithi072.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.209182.log.gz 2024-04-04T16:50:17.193 INFO:teuthology.orchestra.run.smithi072.stderr: 77.2% -- replaced with /var/log/ceph/ceph-client.admin.533257.log.gz 2024-04-04T16:50:17.197 INFO:teuthology.orchestra.run.smithi072.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.548115.log.gz 2024-04-04T16:50:17.197 INFO:teuthology.orchestra.run.smithi072.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.548157.log.gz 2024-04-04T16:50:17.198 INFO:teuthology.orchestra.run.smithi072.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.548241.log.gz 2024-04-04T16:50:17.205 INFO:teuthology.orchestra.run.smithi072.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.544828.log.gz 2024-04-04T16:50:17.215 INFO:teuthology.orchestra.run.smithi072.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.543973.log.gz 2024-04-04T16:50:17.222 INFO:teuthology.orchestra.run.smithi072.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.540784.log.gz 2024-04-04T16:50:17.225 INFO:teuthology.orchestra.run.smithi072.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.548881.log.gz 2024-04-04T16:50:17.227 INFO:teuthology.orchestra.run.smithi072.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.518138.log.gz 2024-04-04T16:50:17.230 INFO:teuthology.orchestra.run.smithi072.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.518147.log.gz 2024-04-04T16:50:17.233 INFO:teuthology.orchestra.run.smithi072.stderr: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.499551.log.gz 2024-04-04T16:50:17.242 INFO:teuthology.orchestra.run.smithi072.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.250552.log.gz 2024-04-04T16:50:17.256 INFO:teuthology.orchestra.run.smithi072.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.401747.log.gz 2024-04-04T16:50:17.264 INFO:teuthology.orchestra.run.smithi072.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.360766.log.gz 2024-04-04T16:50:17.265 INFO:teuthology.orchestra.run.smithi072.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.420024.log.gz 2024-04-04T16:50:17.270 INFO:teuthology.orchestra.run.smithi072.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.466152.log.gz 2024-04-04T16:50:17.304 INFO:teuthology.orchestra.run.smithi072.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.274969.log.gz 2024-04-04T16:50:17.311 INFO:teuthology.orchestra.run.smithi072.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.222454.log.gz 2024-04-04T16:50:17.320 INFO:teuthology.orchestra.run.smithi072.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.221607.log.gz 2024-04-04T16:50:17.331 INFO:teuthology.orchestra.run.smithi072.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.411473.log.gz 2024-04-04T16:50:17.355 INFO:teuthology.orchestra.run.smithi072.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.543533.log.gz 2024-04-04T16:50:17.360 INFO:teuthology.orchestra.run.smithi072.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.491775.log.gz 2024-04-04T16:50:17.361 INFO:teuthology.orchestra.run.smithi072.stderr: 77.6% -- replaced with /var/log/ceph/ceph-client.admin.504538.log.gz 2024-04-04T16:50:17.366 INFO:teuthology.orchestra.run.smithi072.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.478586.log.gz 2024-04-04T16:50:17.373 INFO:teuthology.orchestra.run.smithi072.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.129829.log.gz 2024-04-04T16:50:17.377 INFO:teuthology.orchestra.run.smithi072.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.516448.log.gz 2024-04-04T16:50:17.387 INFO:teuthology.orchestra.run.smithi072.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.489834.log.gz 2024-04-04T16:50:17.388 INFO:teuthology.orchestra.run.smithi072.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.283738.log.gz 2024-04-04T16:50:17.395 INFO:teuthology.orchestra.run.smithi072.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.71417.log.gz 2024-04-04T16:50:17.398 INFO:teuthology.orchestra.run.smithi072.stderr: 83.9% -- replaced with /var/log/ceph/ceph-client.admin.143149.log.gz 2024-04-04T16:50:17.403 INFO:teuthology.orchestra.run.smithi072.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.212156.log.gz 2024-04-04T16:50:17.405 INFO:teuthology.orchestra.run.smithi072.stderr: 78.3% -- replaced with /var/log/ceph/ceph-client.admin.184170.log.gz 2024-04-04T16:50:17.408 INFO:teuthology.orchestra.run.smithi072.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.192036.log.gz 2024-04-04T16:50:17.414 INFO:teuthology.orchestra.run.smithi072.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.163273.log.gz 2024-04-04T16:50:17.415 INFO:teuthology.orchestra.run.smithi072.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.410208.log.gz 2024-04-04T16:50:17.417 INFO:teuthology.orchestra.run.smithi072.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.219504.log.gz 2024-04-04T16:50:17.425 INFO:teuthology.orchestra.run.smithi072.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.124663.log.gz 2024-04-04T16:50:17.426 INFO:teuthology.orchestra.run.smithi072.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.121120.log.gz 2024-04-04T16:50:17.453 INFO:teuthology.orchestra.run.smithi072.stderr: 78.5% -- replaced with /var/log/ceph/ceph-client.admin.401415.log.gz 2024-04-04T16:50:17.506 INFO:teuthology.orchestra.run.smithi072.stderr: 79.6% -- replaced with /var/log/ceph/ceph-client.admin.540340.log.gz 2024-04-04T16:50:17.507 INFO:teuthology.orchestra.run.smithi072.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.548367.log.gz 2024-04-04T16:50:17.523 INFO:teuthology.orchestra.run.smithi072.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.400696.log.gz 2024-04-04T16:50:17.535 INFO:teuthology.orchestra.run.smithi072.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.455422.log.gz 2024-04-04T16:50:17.537 INFO:teuthology.orchestra.run.smithi072.stderr: 93.7% -- replaced with /var/log/ceph/ceph-client.admin.363034.log.gz 2024-04-04T16:50:17.540 INFO:teuthology.orchestra.run.smithi072.stderr: 84.6% -- replaced with /var/log/ceph/ceph-client.admin.472791.log.gz 2024-04-04T16:50:17.544 INFO:teuthology.orchestra.run.smithi072.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.336676.log.gz 2024-04-04T16:50:17.551 INFO:teuthology.orchestra.run.smithi072.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.154633.log.gz 2024-04-04T16:50:17.554 INFO:teuthology.orchestra.run.smithi072.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.205658.log.gz 2024-04-04T16:50:17.556 INFO:teuthology.orchestra.run.smithi072.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.140051.log.gz 2024-04-04T16:50:17.560 INFO:teuthology.orchestra.run.smithi072.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.112034.log.gz 2024-04-04T16:50:17.561 INFO:teuthology.orchestra.run.smithi072.stderr: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.119854.log.gz 2024-04-04T16:50:17.568 INFO:teuthology.orchestra.run.smithi072.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.210024.log.gz 2024-04-04T16:50:17.570 INFO:teuthology.orchestra.run.smithi072.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.114429.log.gz 2024-04-04T16:50:17.577 INFO:teuthology.orchestra.run.smithi072.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.529770.log.gz 2024-04-04T16:50:17.587 INFO:teuthology.orchestra.run.smithi072.stderr: 80.0% -- replaced with /var/log/ceph/ceph-client.admin.467677.log.gz 2024-04-04T16:50:17.590 INFO:teuthology.orchestra.run.smithi072.stderr: 83.1% -- replaced with /var/log/ceph/ceph-client.admin.522185.log.gz 2024-04-04T16:50:17.606 INFO:teuthology.orchestra.run.smithi072.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.491340.log.gz 2024-04-04T16:50:17.620 INFO:teuthology.orchestra.run.smithi072.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.215103.log.gz 2024-04-04T16:50:17.622 INFO:teuthology.orchestra.run.smithi072.stderr: 80.1% -- replaced with /var/log/ceph/ceph-client.admin.256043.log.gz 2024-04-04T16:50:17.625 INFO:teuthology.orchestra.run.smithi072.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.256905.log.gz 2024-04-04T16:50:17.626 INFO:teuthology.orchestra.run.smithi072.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.399848.log.gz 2024-04-04T16:50:17.634 INFO:teuthology.orchestra.run.smithi072.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.366027.log.gz 2024-04-04T16:50:17.637 INFO:teuthology.orchestra.run.smithi072.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.398957.log.gz 2024-04-04T16:50:17.637 INFO:teuthology.orchestra.run.smithi072.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.361179.log.gz 2024-04-04T16:50:17.637 INFO:teuthology.orchestra.run.smithi072.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.339306.log.gz 2024-04-04T16:50:17.647 INFO:teuthology.orchestra.run.smithi072.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.388845.log.gz 2024-04-04T16:50:17.651 INFO:teuthology.orchestra.run.smithi072.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.384445.log.gz 2024-04-04T16:50:17.657 INFO:teuthology.orchestra.run.smithi072.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.342278.log.gz 2024-04-04T16:50:17.660 INFO:teuthology.orchestra.run.smithi072.stderr: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.272349.log.gz 2024-04-04T16:50:17.665 INFO:teuthology.orchestra.run.smithi072.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.386227.log.gz 2024-04-04T16:50:17.666 INFO:teuthology.orchestra.run.smithi072.stderr: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.324165.log.gz 2024-04-04T16:50:17.676 INFO:teuthology.orchestra.run.smithi072.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.518601.log.gz 2024-04-04T16:50:17.681 INFO:teuthology.orchestra.run.smithi072.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.267296.log.gz 2024-04-04T16:50:17.690 INFO:teuthology.orchestra.run.smithi072.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.430351.log.gz 2024-04-04T16:50:17.690 INFO:teuthology.orchestra.run.smithi072.stderr: 77.4% -- replaced with /var/log/ceph/ceph-client.admin.392454.log.gz 2024-04-04T16:50:17.713 INFO:teuthology.orchestra.run.smithi072.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.536353.log.gz 2024-04-04T16:50:17.738 INFO:teuthology.orchestra.run.smithi072.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.523983.log.gz 2024-04-04T16:50:17.753 INFO:teuthology.orchestra.run.smithi072.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.526648.log.gz 2024-04-04T16:50:17.770 INFO:teuthology.orchestra.run.smithi072.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.321214.log.gz 2024-04-04T16:50:17.773 INFO:teuthology.orchestra.run.smithi072.stderr: 78.6% -- replaced with /var/log/ceph/ceph-client.admin.250965.log.gz 2024-04-04T16:50:17.813 INFO:teuthology.orchestra.run.smithi072.stderr: 93.4% -- replaced with /var/log/ceph/ceph-client.admin.206565.log.gz 2024-04-04T16:50:17.817 INFO:teuthology.orchestra.run.smithi072.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.245069.log.gz 2024-04-04T16:50:17.817 INFO:teuthology.orchestra.run.smithi072.stderr: 84.6% -- replaced with /var/log/ceph/ceph-client.admin.226926.log.gz 2024-04-04T16:50:17.827 INFO:teuthology.orchestra.run.smithi072.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.490860.log.gz 2024-04-04T16:50:17.829 INFO:teuthology.orchestra.run.smithi072.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.127693.log.gz 2024-04-04T16:50:17.833 INFO:teuthology.orchestra.run.smithi072.stderr: 83.5% -- replaced with /var/log/ceph/ceph-client.admin.454149.log.gz 2024-04-04T16:50:17.837 INFO:teuthology.orchestra.run.smithi072.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.432950.log.gz 2024-04-04T16:50:17.847 INFO:teuthology.orchestra.run.smithi072.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.264534.log.gz 2024-04-04T16:50:17.850 INFO:teuthology.orchestra.run.smithi072.stderr: 84.9% -- replaced with /var/log/ceph/ceph-client.admin.315259.log.gz 2024-04-04T16:50:17.854 INFO:teuthology.orchestra.run.smithi072.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.316537.log.gz 2024-04-04T16:50:17.857 INFO:teuthology.orchestra.run.smithi072.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.235552.log.gz 2024-04-04T16:50:17.866 INFO:teuthology.orchestra.run.smithi072.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.233831.log.gz 2024-04-04T16:50:17.869 INFO:teuthology.orchestra.run.smithi072.stderr: 83.5% -- replaced with /var/log/ceph/ceph-client.admin.223083.log.gz 2024-04-04T16:50:17.891 INFO:teuthology.orchestra.run.smithi072.stderr: 93.3% -- replaced with /var/log/ceph/ceph-client.admin.202069.log.gz 2024-04-04T16:50:17.901 INFO:teuthology.orchestra.run.smithi072.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.387558.log.gz 2024-04-04T16:50:17.903 INFO:teuthology.orchestra.run.smithi072.stderr: 91.9% -- replaced with /var/log/ceph/ceph-client.admin.245952.log.gz 2024-04-04T16:50:17.911 INFO:teuthology.orchestra.run.smithi072.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.241973.log.gz 2024-04-04T16:50:17.935 INFO:teuthology.orchestra.run.smithi072.stderr: 93.1% -- replaced with /var/log/ceph/ceph-client.admin.479008.log.gz 2024-04-04T16:50:17.942 INFO:teuthology.orchestra.run.smithi072.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.454575.log.gz 2024-04-04T16:50:17.950 INFO:teuthology.orchestra.run.smithi072.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.473832.log.gz 2024-04-04T16:50:17.953 INFO:teuthology.orchestra.run.smithi072.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.46043.log.gz 2024-04-04T16:50:17.967 INFO:teuthology.orchestra.run.smithi072.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.189635.log.gz 2024-04-04T16:50:17.971 INFO:teuthology.orchestra.run.smithi072.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.48272.log.gz 2024-04-04T16:50:17.981 INFO:teuthology.orchestra.run.smithi072.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.461162.log.gz 2024-04-04T16:50:17.990 INFO:teuthology.orchestra.run.smithi072.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.447514.log.gz 2024-04-04T16:50:17.998 INFO:teuthology.orchestra.run.smithi072.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.48770.log.gz 2024-04-04T16:50:18.001 INFO:teuthology.orchestra.run.smithi072.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.432529.log.gz 2024-04-04T16:50:18.006 INFO:teuthology.orchestra.run.smithi072.stderr: 78.5% -- replaced with /var/log/ceph/ceph-client.admin.128554.log.gz 2024-04-04T16:50:18.011 INFO:teuthology.orchestra.run.smithi072.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.413188.log.gz 2024-04-04T16:50:18.013 INFO:teuthology.orchestra.run.smithi072.stderr: 83.2% -- replaced with /var/log/ceph/ceph-client.admin.217748.log.gz 2024-04-04T16:50:18.016 INFO:teuthology.orchestra.run.smithi072.stderr: 84.3% -- replaced with /var/log/ceph/ceph-client.admin.193701.log.gz 2024-04-04T16:50:18.018 INFO:teuthology.orchestra.run.smithi072.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.165549.log.gz 2024-04-04T16:50:18.024 INFO:teuthology.orchestra.run.smithi072.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.223935.log.gz 2024-04-04T16:50:18.034 INFO:teuthology.orchestra.run.smithi072.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.152467.log.gz 2024-04-04T16:50:18.038 INFO:teuthology.orchestra.run.smithi072.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.456274.log.gz 2024-04-04T16:50:18.045 INFO:teuthology.orchestra.run.smithi072.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.412328.log.gz 2024-04-04T16:50:18.060 INFO:teuthology.orchestra.run.smithi072.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.355431.log.gz 2024-04-04T16:50:18.065 INFO:teuthology.orchestra.run.smithi072.stderr: 83.4% -- replaced with /var/log/ceph/ceph-client.admin.145772.log.gz 2024-04-04T16:50:18.070 INFO:teuthology.orchestra.run.smithi072.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.361673.log.gz 2024-04-04T16:50:18.076 INFO:teuthology.orchestra.run.smithi072.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.357132.log.gz 2024-04-04T16:50:18.083 INFO:teuthology.orchestra.run.smithi072.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.319496.log.gz 2024-04-04T16:50:18.086 INFO:teuthology.orchestra.run.smithi072.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.273254.log.gz 2024-04-04T16:50:18.092 INFO:teuthology.orchestra.run.smithi072.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.324174.log.gz 2024-04-04T16:50:18.098 INFO:teuthology.orchestra.run.smithi072.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.214690.log.gz 2024-04-04T16:50:18.101 INFO:teuthology.orchestra.run.smithi072.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.50242.log.gz 2024-04-04T16:50:18.144 INFO:teuthology.orchestra.run.smithi072.stderr: 80.1% -- replaced with /var/log/ceph/ceph-client.admin.522606.log.gz 2024-04-04T16:50:18.160 INFO:teuthology.orchestra.run.smithi072.stderr: 93.4% -- replaced with /var/log/ceph/ceph-client.admin.196695.log.gz 2024-04-04T16:50:18.164 INFO:teuthology.orchestra.run.smithi072.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.549637.log.gz 2024-04-04T16:50:18.167 INFO:teuthology.orchestra.run.smithi072.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.161319.log.gz 2024-04-04T16:50:18.171 INFO:teuthology.orchestra.run.smithi072.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.494746.log.gz 2024-04-04T16:50:18.173 INFO:teuthology.orchestra.run.smithi072.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.141789.log.gz 2024-04-04T16:50:18.176 INFO:teuthology.orchestra.run.smithi072.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.493029.log.gz 2024-04-04T16:50:18.190 INFO:teuthology.orchestra.run.smithi072.stderr: 78.1% -- replaced with /var/log/ceph/ceph-client.admin.489394.log.gz 2024-04-04T16:50:18.194 INFO:teuthology.orchestra.run.smithi072.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.530196.log.gz 2024-04-04T16:50:18.205 INFO:teuthology.orchestra.run.smithi072.stderr: 79.9% -- replaced with /var/log/ceph/ceph-client.admin.523529.log.gz 2024-04-04T16:50:18.207 INFO:teuthology.orchestra.run.smithi072.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.527556.log.gz 2024-04-04T16:50:18.210 INFO:teuthology.orchestra.run.smithi072.stderr: 84.0% -- replaced with /var/log/ceph/ceph-client.admin.455843.log.gz 2024-04-04T16:50:18.221 INFO:teuthology.orchestra.run.smithi072.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.534577.log.gz 2024-04-04T16:50:18.227 INFO:teuthology.orchestra.run.smithi072.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.471740.log.gz 2024-04-04T16:50:18.236 INFO:teuthology.orchestra.run.smithi072.stderr: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.480783.log.gz 2024-04-04T16:50:18.254 INFO:teuthology.orchestra.run.smithi072.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.271086.log.gz 2024-04-04T16:50:18.266 INFO:teuthology.orchestra.run.smithi072.stderr: 78.2% -- replaced with /var/log/ceph/ceph-client.admin.127684.log.gz 2024-04-04T16:50:18.273 INFO:teuthology.orchestra.run.smithi072.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.50063.log.gz 2024-04-04T16:50:18.290 INFO:teuthology.orchestra.run.smithi072.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.522194.log.gz 2024-04-04T16:50:18.293 INFO:teuthology.orchestra.run.smithi117.stderr: 95.3% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-04-04T16:50:18.301 INFO:teuthology.orchestra.run.smithi072.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.420875.log.gz 2024-04-04T16:50:18.307 INFO:teuthology.orchestra.run.smithi072.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.432088.log.gz 2024-04-04T16:50:18.315 INFO:teuthology.orchestra.run.smithi072.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.510552.log.gz 2024-04-04T16:50:18.326 INFO:teuthology.orchestra.run.smithi072.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.49377.log.gz 2024-04-04T16:50:18.333 INFO:teuthology.orchestra.run.smithi072.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.49022.log.gz 2024-04-04T16:50:18.334 INFO:teuthology.orchestra.run.smithi072.stderr: 93.3% -- replaced with /var/log/ceph/ceph-client.admin.204319.log.gz 2024-04-04T16:50:18.338 INFO:teuthology.orchestra.run.smithi072.stderr: 92.6% -- replaced with /var/log/ceph/ceph-client.admin.330336.log.gz 2024-04-04T16:50:18.341 INFO:teuthology.orchestra.run.smithi072.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.271095.log.gz 2024-04-04T16:50:18.348 INFO:teuthology.orchestra.run.smithi072.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.507278.log.gz 2024-04-04T16:50:18.384 INFO:teuthology.orchestra.run.smithi072.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.218631.log.gz 2024-04-04T16:50:18.403 INFO:teuthology.orchestra.run.smithi072.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.155896.log.gz 2024-04-04T16:50:18.408 INFO:teuthology.orchestra.run.smithi072.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.128563.log.gz 2024-04-04T16:50:18.413 INFO:teuthology.orchestra.run.smithi072.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.210033.log.gz 2024-04-04T16:50:18.417 INFO:teuthology.orchestra.run.smithi072.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.219924.log.gz 2024-04-04T16:50:18.422 INFO:teuthology.orchestra.run.smithi072.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.449211.log.gz 2024-04-04T16:50:18.428 INFO:teuthology.orchestra.run.smithi072.stderr: 92.5% -- replaced with /var/log/ceph/ceph-client.admin.126811.log.gz 2024-04-04T16:50:18.429 INFO:teuthology.orchestra.run.smithi072.stderr: 92.8% -- replaced with /var/log/ceph/ceph-client.admin.471749.log.gz 2024-04-04T16:50:18.448 INFO:teuthology.orchestra.run.smithi072.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.132015.log.gz 2024-04-04T16:50:18.453 INFO:teuthology.orchestra.run.smithi072.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.120707.log.gz 2024-04-04T16:50:18.458 INFO:teuthology.orchestra.run.smithi072.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.333311.log.gz 2024-04-04T16:50:18.459 INFO:teuthology.orchestra.run.smithi072.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.334152.log.gz 2024-04-04T16:50:18.467 INFO:teuthology.orchestra.run.smithi072.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.393733.log.gz 2024-04-04T16:50:18.472 INFO:teuthology.orchestra.run.smithi072.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.466161.log.gz 2024-04-04T16:50:18.474 INFO:teuthology.orchestra.run.smithi072.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.485526.log.gz 2024-04-04T16:50:18.479 INFO:teuthology.orchestra.run.smithi072.stderr: 78.5% -- replaced with /var/log/ceph/ceph-client.admin.199361.log.gz 2024-04-04T16:50:18.486 INFO:teuthology.orchestra.run.smithi072.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.182879.log.gz 2024-04-04T16:50:18.503 INFO:teuthology.orchestra.run.smithi072.stderr: 93.3% -- replaced with /var/log/ceph/ceph-client.admin.433827.log.gz 2024-04-04T16:50:18.514 INFO:teuthology.orchestra.run.smithi072.stderr: 93.1% -- replaced with /var/log/ceph/ceph-client.admin.238093.log.gz 2024-04-04T16:50:18.516 INFO:teuthology.orchestra.run.smithi072.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.145781.log.gz 2024-04-04T16:50:18.529 INFO:teuthology.orchestra.run.smithi072.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44395.log.gz 2024-04-04T16:50:18.535 INFO:teuthology.orchestra.run.smithi072.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.268138.log.gz 2024-04-04T16:50:18.549 INFO:teuthology.orchestra.run.smithi072.stderr: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.261556.log.gz 2024-04-04T16:50:18.559 INFO:teuthology.orchestra.run.smithi072.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.549721.log.gz 2024-04-04T16:50:18.587 INFO:teuthology.orchestra.run.smithi072.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.536362.log.gz 2024-04-04T16:50:18.588 INFO:teuthology.orchestra.run.smithi072.stderr: 84.9% -- replaced with /var/log/ceph/ceph-client.admin.539461.log.gz 2024-04-04T16:50:18.593 INFO:teuthology.orchestra.run.smithi072.stderr: 78.3% -- replaced with /var/log/ceph/ceph-client.admin.476422.log.gz 2024-04-04T16:50:18.593 INFO:teuthology.orchestra.run.smithi072.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.141363.log.gz 2024-04-04T16:50:18.602 INFO:teuthology.orchestra.run.smithi072.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.470841.log.gz 2024-04-04T16:50:18.604 INFO:teuthology.orchestra.run.smithi072.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.488554.log.gz 2024-04-04T16:50:18.610 INFO:teuthology.orchestra.run.smithi072.stderr: 92.9% -- replaced with /var/log/ceph/ceph-client.admin.346936.log.gz 2024-04-04T16:50:18.619 INFO:teuthology.orchestra.run.smithi072.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.487237.log.gz 2024-04-04T16:50:18.632 INFO:teuthology.orchestra.run.smithi072.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.325018.log.gz 2024-04-04T16:50:18.640 INFO:teuthology.orchestra.run.smithi072.stderr: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.326395.log.gz 2024-04-04T16:50:18.650 INFO:teuthology.orchestra.run.smithi072.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.392019.log.gz 2024-04-04T16:50:18.661 INFO:teuthology.orchestra.run.smithi072.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.429499.log.gz 2024-04-04T16:50:18.685 INFO:teuthology.orchestra.run.smithi072.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.250543.log.gz 2024-04-04T16:50:18.702 INFO:teuthology.orchestra.run.smithi072.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.315268.log.gz 2024-04-04T16:50:18.709 INFO:teuthology.orchestra.run.smithi072.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.45288.log.gz 2024-04-04T16:50:18.718 INFO:teuthology.orchestra.run.smithi072.stderr: 84.7% -- replaced with /var/log/ceph/ceph-client.admin.285427.log.gz 2024-04-04T16:50:18.718 INFO:teuthology.orchestra.run.smithi072.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.284586.log.gz 2024-04-04T16:50:18.721 INFO:teuthology.orchestra.run.smithi072.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.327269.log.gz 2024-04-04T16:50:18.757 INFO:teuthology.orchestra.run.smithi072.stderr: 78.2% -- replaced with /var/log/ceph/ceph-client.admin.188312.log.gz 2024-04-04T16:50:18.759 INFO:teuthology.orchestra.run.smithi072.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.212147.log.gz 2024-04-04T16:50:18.761 INFO:teuthology.orchestra.run.smithi072.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.215534.log.gz 2024-04-04T16:50:18.766 INFO:teuthology.orchestra.run.smithi072.stderr: 84.6% -- replaced with /var/log/ceph/ceph-client.admin.154624.log.gz 2024-04-04T16:50:18.769 INFO:teuthology.orchestra.run.smithi072.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.162842.log.gz 2024-04-04T16:50:18.781 INFO:teuthology.orchestra.run.smithi072.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.406365.log.gz 2024-04-04T16:50:18.784 INFO:teuthology.orchestra.run.smithi072.stderr: 93.2% -- replaced with /var/log/ceph/ceph-client.admin.272358.log.gz 2024-04-04T16:50:18.795 INFO:teuthology.orchestra.run.smithi072.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.359427.log.gz 2024-04-04T16:50:18.799 INFO:teuthology.orchestra.run.smithi072.stderr: 83.1% -- replaced with /var/log/ceph/ceph-client.admin.342692.log.gz 2024-04-04T16:50:18.804 INFO:teuthology.orchestra.run.smithi072.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.364041.log.gz 2024-04-04T16:50:18.808 INFO:teuthology.orchestra.run.smithi072.stderr: 79.4% -- replaced with /var/log/ceph/ceph-client.admin.238084.log.gz 2024-04-04T16:50:18.816 INFO:teuthology.orchestra.run.smithi072.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.338885.log.gz 2024-04-04T16:50:18.822 INFO:teuthology.orchestra.run.smithi072.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.212998.log.gz 2024-04-04T16:50:18.830 INFO:teuthology.orchestra.run.smithi072.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.258178.log.gz 2024-04-04T16:50:18.834 INFO:teuthology.orchestra.run.smithi072.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.256479.log.gz 2024-04-04T16:50:18.834 INFO:teuthology.orchestra.run.smithi072.stderr: 80.9% 80.4% -- replaced with /var/log/ceph/ceph-client.admin.367940.log.gz -- replaced with /var/log/ceph/ceph-client.admin.484244.log.gz 2024-04-04T16:50:18.835 INFO:teuthology.orchestra.run.smithi072.stderr: 2024-04-04T16:50:18.845 INFO:teuthology.orchestra.run.smithi072.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.460741.log.gz 2024-04-04T16:50:18.857 INFO:teuthology.orchestra.run.smithi072.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.355440.log.gz 2024-04-04T16:50:18.866 INFO:teuthology.orchestra.run.smithi072.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.207007.log.gz 2024-04-04T16:50:18.870 INFO:teuthology.orchestra.run.smithi072.stderr: 93.4% -- replaced with /var/log/ceph/ceph-client.admin.205667.log.gz 2024-04-04T16:50:18.875 INFO:teuthology.orchestra.run.smithi072.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.334992.log.gz 2024-04-04T16:50:18.894 INFO:teuthology.orchestra.run.smithi072.stderr: 78.1% -- replaced with /var/log/ceph/ceph-client.admin.446163.log.gz 2024-04-04T16:50:18.895 INFO:teuthology.orchestra.run.smithi072.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.450077.log.gz 2024-04-04T16:50:18.901 INFO:teuthology.orchestra.run.smithi072.stderr: 83.6% -- replaced with /var/log/ceph/ceph-client.admin.200710.log.gz 2024-04-04T16:50:18.901 INFO:teuthology.orchestra.run.smithi072.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.320788.log.gz 2024-04-04T16:50:18.921 INFO:teuthology.orchestra.run.smithi072.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.48046.log.gz 2024-04-04T16:50:18.923 INFO:teuthology.orchestra.run.smithi072.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.487228.log.gz 2024-04-04T16:50:18.924 INFO:teuthology.orchestra.run.smithi072.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.141372.log.gz 2024-04-04T16:50:18.929 INFO:teuthology.orchestra.run.smithi072.stderr: 84.4% -- replaced with /var/log/ceph/ceph-client.admin.482913.log.gz 2024-04-04T16:50:18.948 INFO:teuthology.orchestra.run.smithi072.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.549679.log.gz 2024-04-04T16:50:18.948 INFO:teuthology.orchestra.run.smithi072.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.549595.log.gz 2024-04-04T16:50:18.980 INFO:teuthology.orchestra.run.smithi072.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.362104.log.gz 2024-04-04T16:50:18.983 INFO:teuthology.orchestra.run.smithi072.stderr: 93.7% -- replaced with /var/log/ceph/ceph-client.admin.364563.log.gz 2024-04-04T16:50:18.993 INFO:teuthology.orchestra.run.smithi072.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.419146.log.gz 2024-04-04T16:50:18.995 INFO:teuthology.orchestra.run.smithi072.stderr: 93.9% -- replaced with /var/log/ceph/ceph-client.admin.189644.log.gz 2024-04-04T16:50:19.004 INFO:teuthology.orchestra.run.smithi072.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.127243.log.gz 2024-04-04T16:50:19.006 INFO:teuthology.orchestra.run.smithi072.stderr: 77.7% -- replaced with /var/log/ceph/ceph-client.admin.118283.log.gz 2024-04-04T16:50:19.010 INFO:teuthology.orchestra.run.smithi072.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.164679.log.gz 2024-04-04T16:50:19.010 INFO:teuthology.orchestra.run.smithi072.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.164106.log.gz 2024-04-04T16:50:19.015 INFO:teuthology.orchestra.run.smithi072.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.218210.log.gz 2024-04-04T16:50:19.017 INFO:teuthology.orchestra.run.smithi072.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.413179.log.gz 2024-04-04T16:50:19.020 INFO:teuthology.orchestra.run.smithi072.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.186974.log.gz 2024-04-04T16:50:19.026 INFO:teuthology.orchestra.run.smithi072.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.282894.log.gz 2024-04-04T16:50:19.027 INFO:teuthology.orchestra.run.smithi072.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.268971.log.gz 2024-04-04T16:50:19.028 INFO:teuthology.orchestra.run.smithi072.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.270658.log.gz 2024-04-04T16:50:19.033 INFO:teuthology.orchestra.run.smithi072.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.42967.log.gz 2024-04-04T16:50:19.040 INFO:teuthology.orchestra.run.smithi072.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.205209.log.gz 2024-04-04T16:50:19.053 INFO:teuthology.orchestra.run.smithi072.stderr: 91.8% -- replaced with /var/log/ceph/ceph-client.admin.520409.log.gz 2024-04-04T16:50:19.070 INFO:teuthology.orchestra.run.smithi072.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.350232.log.gz 2024-04-04T16:50:19.070 INFO:teuthology.orchestra.run.smithi072.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.257322.log.gz 2024-04-04T16:50:19.080 INFO:teuthology.orchestra.run.smithi072.stderr: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.318224.log.gz 2024-04-04T16:50:19.098 INFO:teuthology.orchestra.run.smithi072.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.329485.log.gz 2024-04-04T16:50:19.104 INFO:teuthology.orchestra.run.smithi072.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.385365.log.gz 2024-04-04T16:50:19.107 INFO:teuthology.orchestra.run.smithi072.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.346927.log.gz 2024-04-04T16:50:19.110 INFO:teuthology.orchestra.run.smithi072.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.320357.log.gz 2024-04-04T16:50:19.111 INFO:teuthology.orchestra.run.smithi072.stderr: 84.0% -- replaced with /var/log/ceph/ceph-client.admin.360757.log.gz 2024-04-04T16:50:19.149 INFO:teuthology.orchestra.run.smithi072.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.390728.log.gz 2024-04-04T16:50:19.152 INFO:teuthology.orchestra.run.smithi072.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.341427.log.gz 2024-04-04T16:50:19.161 INFO:teuthology.orchestra.run.smithi072.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.407641.log.gz 2024-04-04T16:50:19.168 INFO:teuthology.orchestra.run.smithi072.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.153317.log.gz 2024-04-04T16:50:19.170 INFO:teuthology.orchestra.run.smithi072.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.325027.log.gz 2024-04-04T16:50:19.179 INFO:teuthology.orchestra.run.smithi072.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.458094.log.gz 2024-04-04T16:50:19.190 INFO:teuthology.orchestra.run.smithi072.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.542155.log.gz 2024-04-04T16:50:19.190 INFO:teuthology.orchestra.run.smithi072.stderr: 78.0% -- replaced with /var/log/ceph/ceph-client.admin.497085.log.gz 2024-04-04T16:50:19.195 INFO:teuthology.orchestra.run.smithi072.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.480792.log.gz 2024-04-04T16:50:19.203 INFO:teuthology.orchestra.run.smithi072.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.476008.log.gz 2024-04-04T16:50:19.207 INFO:teuthology.orchestra.run.smithi072.stderr: 93.5% -- replaced with /var/log/ceph/ceph-client.admin.460279.log.gz 2024-04-04T16:50:19.208 INFO:teuthology.orchestra.run.smithi072.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.488563.log.gz 2024-04-04T16:50:19.209 INFO:teuthology.orchestra.run.smithi072.stderr: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.492608.log.gz 2024-04-04T16:50:19.222 INFO:teuthology.orchestra.run.smithi072.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.515192.log.gz 2024-04-04T16:50:19.223 INFO:teuthology.orchestra.run.smithi072.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.453727.log.gz 2024-04-04T16:50:19.224 INFO:teuthology.orchestra.run.smithi072.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.453274.log.gz 2024-04-04T16:50:19.228 INFO:teuthology.orchestra.run.smithi072.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.482073.log.gz 2024-04-04T16:50:20.624 INFO:teuthology.orchestra.run.smithi117.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-04-04T16:50:22.749 INFO:teuthology.orchestra.run.smithi117.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-04-04T16:50:23.556 INFO:teuthology.orchestra.run.smithi117.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-04-04T16:50:23.774 INFO:teuthology.orchestra.run.smithi072.stderr: 89.1% 88.0% 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44851.log.gz -- replaced with /var/log/ceph/ceph-client.admin.43556.log.gz -- replaced with /var/log/ceph/ceph-client.admin.43565.log.gz 89.4% 87.4% 88.0% 2024-04-04T16:50:23.774 INFO:teuthology.orchestra.run.smithi072.stderr: 2024-04-04T16:50:23.774 INFO:teuthology.orchestra.run.smithi072.stderr: 2024-04-04T16:50:23.775 INFO:teuthology.orchestra.run.smithi072.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.42627.log.gz -- replaced with /var/log/ceph/ceph-client.admin.43225.log.gz -- replaced with /var/log/ceph/ceph-client.admin.42100.log.gz -- replaced with /var/log/ceph/ceph-client.admin.43901.log.gz 88.6% 2024-04-04T16:50:23.775 INFO:teuthology.orchestra.run.smithi072.stderr: 2024-04-04T16:50:23.775 INFO:teuthology.orchestra.run.smithi072.stderr: 2024-04-04T16:50:23.775 INFO:teuthology.orchestra.run.smithi072.stderr: 2024-04-04T16:50:23.775 INFO:teuthology.orchestra.run.smithi072.stderr: -- replaced with /var/log/ceph/ceph-client.admin.44101.log.gz 2024-04-04T16:50:23.775 INFO:teuthology.orchestra.run.smithi072.stderr: 88.7% 88.9% 87.3% -- replaced with /var/log/ceph/ceph-client.admin.43975.log.gz -- replaced with /var/log/ceph/ceph-client.admin.43051.log.gz -- replaced with /var/log/ceph/ceph-client.admin.43214.log.gz 2024-04-04T16:50:23.775 INFO:teuthology.orchestra.run.smithi072.stderr: 2024-04-04T16:50:23.776 INFO:teuthology.orchestra.run.smithi072.stderr: 2024-04-04T16:50:23.776 INFO:teuthology.orchestra.run.smithi072.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43814.log.gz 2024-04-04T16:50:23.776 INFO:teuthology.orchestra.run.smithi072.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.44749.log.gz 2024-04-04T16:50:23.777 INFO:teuthology.orchestra.run.smithi072.stderr: 89.3% 88.1% 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42008.log.gz -- replaced with /var/log/ceph/ceph-client.admin.43233.log.gz 2024-04-04T16:50:23.777 INFO:teuthology.orchestra.run.smithi072.stderr: 2024-04-04T16:50:23.777 INFO:teuthology.orchestra.run.smithi072.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43878.log.gz 2024-04-04T16:50:23.777 INFO:teuthology.orchestra.run.smithi072.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42196.log.gz 2024-04-04T16:50:23.777 INFO:teuthology.orchestra.run.smithi072.stderr: -- replaced with /var/log/ceph/ceph-client.admin.45392.log.gz 2024-04-04T16:50:23.777 INFO:teuthology.orchestra.run.smithi072.stderr: 93.4% 88.5% -- replaced with /var/log/ceph/ceph-client.admin.202970.log.gz -- replaced with /var/log/ceph/ceph-client.admin.42404.log.gz 2024-04-04T16:50:23.778 INFO:teuthology.orchestra.run.smithi072.stderr: 2024-04-04T16:50:23.778 INFO:teuthology.orchestra.run.smithi072.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44707.log.gz 2024-04-04T16:50:23.778 INFO:teuthology.orchestra.run.smithi072.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.36965.log.gz 2024-04-04T16:50:23.778 INFO:teuthology.orchestra.run.smithi072.stderr: 87.9% 87.9% -- replaced with /var/log/ceph/ceph-client.admin.43230.log.gz 2024-04-04T16:50:23.778 INFO:teuthology.orchestra.run.smithi072.stderr: -- replaced with /var/log/ceph/ceph-client.admin.43851.log.gz 2024-04-04T16:50:23.778 INFO:teuthology.orchestra.run.smithi072.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.44143.log.gz 2024-04-04T16:50:23.782 INFO:teuthology.orchestra.run.smithi072.stderr: 87.6% 92.3% -- replaced with /var/log/ceph/ceph-client.admin.538138.log.gz 2024-04-04T16:50:23.782 INFO:teuthology.orchestra.run.smithi072.stderr: 83.2% -- replaced with /var/log/ceph/ceph-client.admin.244216.log.gz 2024-04-04T16:50:23.782 INFO:teuthology.orchestra.run.smithi072.stderr: 77.7% -- replaced with /var/log/ceph/ceph-client.admin.134551.log.gz 2024-04-04T16:50:23.782 INFO:teuthology.orchestra.run.smithi072.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.338450.log.gz 2024-04-04T16:50:23.782 INFO:teuthology.orchestra.run.smithi072.stderr: 92.0% -- replaced with /var/log/ceph/ceph-client.admin.230621.log.gz 2024-04-04T16:50:23.785 INFO:teuthology.orchestra.run.smithi072.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.43547.log.gz -- replaced with /var/log/ceph/ceph-client.admin.417035.log.gz 2024-04-04T16:50:23.785 INFO:teuthology.orchestra.run.smithi072.stderr: 2024-04-04T16:50:23.786 INFO:teuthology.orchestra.run.smithi072.stderr: 92.5% -- replaced with /var/log/ceph/ceph-client.admin.406374.log.gz 2024-04-04T16:50:23.787 INFO:teuthology.orchestra.run.smithi072.stderr: 83.0% -- replaced with /var/log/ceph/ceph-client.admin.253392.log.gz 2024-04-04T16:50:23.787 INFO:teuthology.orchestra.run.smithi072.stderr: 93.2% -- replaced with /var/log/ceph/ceph-client.admin.495182.log.gz 2024-04-04T16:50:23.787 INFO:teuthology.orchestra.run.smithi072.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.415758.log.gz 2024-04-04T16:50:23.787 INFO:teuthology.orchestra.run.smithi072.stderr: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.208761.log.gz 2024-04-04T16:50:23.787 INFO:teuthology.orchestra.run.smithi072.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.340161.log.gz 2024-04-04T16:50:23.787 INFO:teuthology.orchestra.run.smithi072.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.201610.log.gz 2024-04-04T16:50:23.787 INFO:teuthology.orchestra.run.smithi072.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.468992.log.gz 2024-04-04T16:50:23.802 INFO:teuthology.orchestra.run.smithi072.stderr: 84.5% -- replaced with /var/log/ceph/ceph-client.admin.340574.log.gz 2024-04-04T16:50:23.923 INFO:teuthology.orchestra.run.smithi117.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-04-04T16:50:24.735 INFO:teuthology.orchestra.run.smithi072.stderr: 94.1% 87.8% 80.5% -- replaced with /var/log/ceph/ceph-client.admin.548832.log.gz -- replaced with /var/log/ceph/ceph-client.admin.250116.log.gz 2024-04-04T16:50:24.735 INFO:teuthology.orchestra.run.smithi072.stderr: 2024-04-04T16:50:24.735 INFO:teuthology.orchestra.run.smithi072.stderr: 84.7% -- replaced with /var/log/ceph/ceph-client.admin.482064.log.gz 2024-04-04T16:50:24.735 INFO:teuthology.orchestra.run.smithi072.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.263269.log.gz 2024-04-04T16:50:24.735 INFO:teuthology.orchestra.run.smithi072.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.478999.log.gz 2024-04-04T16:50:24.736 INFO:teuthology.orchestra.run.smithi072.stderr: 88.9% 89.0% -- replaced with /var/log/ceph/ceph-client.admin.49809.log.gz -- replaced with /var/log/ceph/ceph-client.admin.46715.log.gz 2024-04-04T16:50:24.736 INFO:teuthology.orchestra.run.smithi072.stderr: 2024-04-04T16:50:24.736 INFO:teuthology.orchestra.run.smithi072.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.548451.log.gz 2024-04-04T16:50:24.739 INFO:teuthology.orchestra.run.smithi072.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.229087.log.gz 2024-04-04T16:50:24.739 INFO:teuthology.orchestra.run.smithi072.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.325881.log.gz 2024-04-04T16:50:24.739 INFO:teuthology.orchestra.run.smithi072.stderr: 77.5% -- replaced with /var/log/ceph/ceph-client.admin.322473.log.gz 2024-04-04T16:50:24.739 INFO:teuthology.orchestra.run.smithi072.stderr: 90.1% 85.4% -- replaced with /var/log/ceph/ceph-client.admin.433361.log.gz 2024-04-04T16:50:24.739 INFO:teuthology.orchestra.run.smithi072.stderr: 90.1% 77.8% -- replaced with /var/log/ceph/ceph-client.admin.249694.log.gz 2024-04-04T16:50:24.739 INFO:teuthology.orchestra.run.smithi072.stderr: -- replaced with /var/log/ceph/ceph-client.admin.486390.log.gz 90.0% -- replaced with /var/log/ceph/ceph-client.admin.213421.log.gz 2024-04-04T16:50:24.740 INFO:teuthology.orchestra.run.smithi072.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.146753.log.gz 2024-04-04T16:50:24.740 INFO:teuthology.orchestra.run.smithi072.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.349820.log.gz 2024-04-04T16:50:24.740 INFO:teuthology.orchestra.run.smithi072.stderr: 2024-04-04T16:50:24.740 INFO:teuthology.orchestra.run.smithi072.stderr: 92.8% -- replaced with /var/log/ceph/ceph-client.admin.208345.log.gz 2024-04-04T16:50:24.740 INFO:teuthology.orchestra.run.smithi072.stderr: 89.8% 84.7% -- replaced with /var/log/ceph/ceph-client.admin.229683.log.gz 2024-04-04T16:50:24.740 INFO:teuthology.orchestra.run.smithi072.stderr: 84.3% 85.8% -- replaced with /var/log/ceph/ceph-client.admin.394146.log.gz -- replaced with /var/log/ceph/ceph-client.admin.183301.log.gz 2024-04-04T16:50:24.740 INFO:teuthology.orchestra.run.smithi072.stderr: 2024-04-04T16:50:24.740 INFO:teuthology.orchestra.run.smithi072.stderr: 84.3% -- replaced with /var/log/ceph/ceph-client.admin.434225.log.gz 2024-04-04T16:50:24.741 INFO:teuthology.orchestra.run.smithi072.stderr: -- replaced with /var/log/ceph/ceph-client.admin.472800.log.gz 2024-04-04T16:50:24.741 INFO:teuthology.orchestra.run.smithi072.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.480371.log.gz 2024-04-04T16:50:24.741 INFO:teuthology.orchestra.run.smithi072.stderr: -- replaced with /var/log/ceph/ceph-client.admin.413614.log.gz 2024-04-04T16:50:24.741 INFO:teuthology.orchestra.run.smithi072.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.475999.log.gz 2024-04-04T16:50:24.741 INFO:teuthology.orchestra.run.smithi072.stderr: 83.1% -- replaced with /var/log/ceph/ceph-client.admin.416183.log.gz 2024-04-04T16:50:24.741 INFO:teuthology.orchestra.run.smithi072.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.186525.log.gz 2024-04-04T16:50:24.741 INFO:teuthology.orchestra.run.smithi072.stderr: 77.3% -- replaced with /var/log/ceph/ceph-client.admin.164412.log.gz 2024-04-04T16:50:24.746 INFO:teuthology.orchestra.run.smithi072.stderr: 80.3% -- replaced with /var/log/ceph/ceph-client.admin.190088.log.gz 2024-04-04T16:50:24.747 INFO:teuthology.orchestra.run.smithi072.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.182870.log.gz 2024-04-04T16:50:24.747 INFO:teuthology.orchestra.run.smithi072.stderr: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.252307.log.gz 2024-04-04T16:50:24.747 INFO:teuthology.orchestra.run.smithi072.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.47264.log.gz 2024-04-04T16:50:24.747 INFO:teuthology.orchestra.run.smithi072.stderr: 90.1% 92.4% -- replaced with /var/log/ceph/ceph-client.admin.386236.log.gz 2024-04-04T16:50:24.747 INFO:teuthology.orchestra.run.smithi072.stderr: 77.9% -- replaced with /var/log/ceph/ceph-client.admin.462416.log.gz 2024-04-04T16:50:24.747 INFO:teuthology.orchestra.run.smithi072.stderr: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.245060.log.gz 2024-04-04T16:50:24.747 INFO:teuthology.orchestra.run.smithi072.stderr: -- replaced with /var/log/ceph/ceph-client.admin.483408.log.gz 93.3% -- replaced with /var/log/ceph/ceph-client.admin.352814.log.gz 2024-04-04T16:50:24.748 INFO:teuthology.orchestra.run.smithi072.stderr: 2024-04-04T16:50:24.748 INFO:teuthology.orchestra.run.smithi072.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.332891.log.gz 2024-04-04T16:50:24.748 INFO:teuthology.orchestra.run.smithi072.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.49419.log.gz 2024-04-04T16:50:24.748 INFO:teuthology.orchestra.run.smithi072.stderr: -- replaced with /var/log/ceph/ceph-client.admin.140478.log.gz 2024-04-04T16:50:24.748 INFO:teuthology.orchestra.run.smithi072.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.326848.log.gz 2024-04-04T16:50:24.748 INFO:teuthology.orchestra.run.smithi072.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.46841.log.gz 2024-04-04T16:50:24.748 INFO:teuthology.orchestra.run.smithi072.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.452853.log.gz 2024-04-04T16:50:24.748 INFO:teuthology.orchestra.run.smithi072.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.48728.log.gz 2024-04-04T16:50:24.748 INFO:teuthology.orchestra.run.smithi072.stderr: 78.5% -- replaced with /var/log/ceph/ceph-client.admin.246391.log.gz 2024-04-04T16:50:24.749 INFO:teuthology.orchestra.run.smithi072.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.131087.log.gz 2024-04-04T16:50:24.749 INFO:teuthology.orchestra.run.smithi072.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.530627.log.gz 2024-04-04T16:50:24.749 INFO:teuthology.orchestra.run.smithi072.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.284577.log.gz 2024-04-04T16:50:24.749 INFO:teuthology.orchestra.run.smithi072.stderr: 93.8% -- replaced with /var/log/ceph/ceph-client.admin.401117.log.gz 2024-04-04T16:50:24.749 INFO:teuthology.orchestra.run.smithi072.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.519971.log.gz 2024-04-04T16:50:24.749 INFO:teuthology.orchestra.run.smithi072.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.548681.log.gz 2024-04-04T16:50:24.749 INFO:teuthology.orchestra.run.smithi072.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48314.log.gz 2024-04-04T16:50:24.749 INFO:teuthology.orchestra.run.smithi072.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.239826.log.gz 2024-04-04T16:50:24.750 INFO:teuthology.orchestra.run.smithi072.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.434104.log.gz 2024-04-04T16:50:24.750 INFO:teuthology.orchestra.run.smithi072.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.37333.log.gz 2024-04-04T16:50:24.750 INFO:teuthology.orchestra.run.smithi072.stderr: 78.4% -- replaced with /var/log/ceph/ceph-client.admin.348840.log.gz 2024-04-04T16:50:24.750 INFO:teuthology.orchestra.run.smithi072.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.474245.log.gz 2024-04-04T16:50:24.750 INFO:teuthology.orchestra.run.smithi072.stderr: 90.9% 85.4% -- replaced with /var/log/ceph/ceph-client.admin.248375.log.gz -- replaced with /var/log/ceph/ceph-client.admin.245943.log.gz 2024-04-04T16:50:24.750 INFO:teuthology.orchestra.run.smithi072.stderr: 2024-04-04T16:50:24.750 INFO:teuthology.orchestra.run.smithi072.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.353732.log.gz 2024-04-04T16:50:24.751 INFO:teuthology.orchestra.run.smithi072.stderr: 93.0% -- replaced with /var/log/ceph/ceph-client.admin.156818.log.gz 2024-04-04T16:50:24.751 INFO:teuthology.orchestra.run.smithi072.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.210454.log.gz 2024-04-04T16:50:24.751 INFO:teuthology.orchestra.run.smithi072.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.361682.log.gz 2024-04-04T16:50:24.751 INFO:teuthology.orchestra.run.smithi072.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.329494.log.gz 2024-04-04T16:50:24.751 INFO:teuthology.orchestra.run.smithi072.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.48434.log.gz 2024-04-04T16:50:24.751 INFO:teuthology.orchestra.run.smithi072.stderr: 93.3% -- replaced with /var/log/ceph/ceph-client.admin.203419.log.gz 2024-04-04T16:50:24.751 INFO:teuthology.orchestra.run.smithi072.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.144040.log.gz 2024-04-04T16:50:24.751 INFO:teuthology.orchestra.run.smithi072.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.139626.log.gz 2024-04-04T16:50:24.751 INFO:teuthology.orchestra.run.smithi072.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.346506.log.gz 2024-04-04T16:50:24.752 INFO:teuthology.orchestra.run.smithi072.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.398431.log.gz 2024-04-04T16:50:24.752 INFO:teuthology.orchestra.run.smithi072.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.321636.log.gz 2024-04-04T16:50:24.752 INFO:teuthology.orchestra.run.smithi072.stderr: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.460270.log.gz 2024-04-04T16:50:24.752 INFO:teuthology.orchestra.run.smithi072.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.48686.log.gz 2024-04-04T16:50:24.752 INFO:teuthology.orchestra.run.smithi072.stderr: 78.1% -- replaced with /var/log/ceph/ceph-client.admin.330327.log.gz 2024-04-04T16:50:24.752 INFO:teuthology.orchestra.run.smithi072.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.394574.log.gz 2024-04-04T16:50:24.752 INFO:teuthology.orchestra.run.smithi072.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.271516.log.gz 2024-04-04T16:50:24.752 INFO:teuthology.orchestra.run.smithi072.stderr: 80.6% 84.1% -- replaced with /var/log/ceph/ceph-client.admin.132851.log.gz 2024-04-04T16:50:24.752 INFO:teuthology.orchestra.run.smithi072.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.253822.log.gz 2024-04-04T16:50:24.753 INFO:teuthology.orchestra.run.smithi072.stderr: 77.7% -- replaced with /var/log/ceph/ceph-client.admin.254656.log.gz 2024-04-04T16:50:24.753 INFO:teuthology.orchestra.run.smithi072.stderr: 83.1% -- replaced with /var/log/ceph/ceph-client.admin.495625.log.gz 2024-04-04T16:50:24.753 INFO:teuthology.orchestra.run.smithi072.stderr: 80.1% -- replaced with /var/log/ceph/ceph-client.admin.517293.log.gz 2024-04-04T16:50:24.753 INFO:teuthology.orchestra.run.smithi072.stderr: 89.1% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-04-04T16:50:24.753 INFO:teuthology.orchestra.run.smithi072.stderr: 90.0% 80.6% -- replaced with /var/log/ceph/ceph-client.admin.412753.log.gz 2024-04-04T16:50:24.753 INFO:teuthology.orchestra.run.smithi072.stderr: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.350653.log.gz 2024-04-04T16:50:24.753 INFO:teuthology.orchestra.run.smithi072.stderr: -- replaced with /var/log/ceph/ceph-client.admin.412762.log.gz 80.8% 2024-04-04T16:50:24.753 INFO:teuthology.orchestra.run.smithi072.stderr: -- replaced with /var/log/ceph/ceph-client.admin.384017.log.gz 2024-04-04T16:50:24.753 INFO:teuthology.orchestra.run.smithi072.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.485113.log.gz 2024-04-04T16:50:24.765 INFO:teuthology.orchestra.run.smithi072.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.415767.log.gz 2024-04-04T16:50:24.766 INFO:teuthology.orchestra.run.smithi072.stderr: 80.4% 88.1% -- replaced with /var/log/ceph/ceph-client.admin.243714.log.gz -- replaced with /var/log/ceph/ceph-client.admin.49190.log.gz 2024-04-04T16:50:24.766 INFO:teuthology.orchestra.run.smithi072.stderr: 2024-04-04T16:50:24.766 INFO:teuthology.orchestra.run.smithi072.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.47104.log.gz 2024-04-04T16:50:24.766 INFO:teuthology.orchestra.run.smithi072.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.47804.log.gz 2024-04-04T16:50:24.766 INFO:teuthology.orchestra.run.smithi072.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.329906.log.gz 2024-04-04T16:50:24.766 INFO:teuthology.orchestra.run.smithi072.stderr: 85.4% 77.4% -- replaced with /var/log/ceph/ceph-client.admin.130661.log.gz 2024-04-04T16:50:24.766 INFO:teuthology.orchestra.run.smithi072.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.471254.log.gz 2024-04-04T16:50:24.767 INFO:teuthology.orchestra.run.smithi072.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.469869.log.gz -- replaced with /var/log/ceph/ceph-client.admin.539017.log.gz 2024-04-04T16:50:24.767 INFO:teuthology.orchestra.run.smithi072.stderr: 2024-04-04T16:50:24.767 INFO:teuthology.orchestra.run.smithi072.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.335843.log.gz 2024-04-04T16:50:24.767 INFO:teuthology.orchestra.run.smithi072.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.252923.log.gz 2024-04-04T16:50:24.767 INFO:teuthology.orchestra.run.smithi072.stderr: 77.7% -- replaced with /var/log/ceph/ceph-client.admin.458524.log.gz 2024-04-04T16:50:24.767 INFO:teuthology.orchestra.run.smithi072.stderr: 77.9% -- replaced with /var/log/ceph/ceph-client.admin.263686.log.gz 2024-04-04T16:50:24.767 INFO:teuthology.orchestra.run.smithi072.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.48644.log.gz 2024-04-04T16:50:24.767 INFO:teuthology.orchestra.run.smithi072.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.526224.log.gz 2024-04-04T16:50:24.767 INFO:teuthology.orchestra.run.smithi072.stderr: -- replaced with /var/log/ceph/ceph-client.admin.411051.log.gz 2024-04-04T16:50:24.768 INFO:teuthology.orchestra.run.smithi072.stderr: 84.7% -- replaced with /var/log/ceph/ceph-client.admin.201161.log.gz 2024-04-04T16:50:24.768 INFO:teuthology.orchestra.run.smithi072.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.484253.log.gz 2024-04-04T16:50:24.768 INFO:teuthology.orchestra.run.smithi072.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.341436.log.gz 2024-04-04T16:50:24.768 INFO:teuthology.orchestra.run.smithi072.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.131548.log.gz 2024-04-04T16:50:24.768 INFO:teuthology.orchestra.run.smithi072.stderr: 80.3% 84.3% -- replaced with /var/log/ceph/ceph-client.admin.218622.log.gz 2024-04-04T16:50:24.768 INFO:teuthology.orchestra.run.smithi072.stderr: -- replaced with /var/log/ceph/ceph-client.admin.503322.log.gz 2024-04-04T16:50:24.768 INFO:teuthology.orchestra.run.smithi072.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.482494.log.gz 2024-04-04T16:50:24.768 INFO:teuthology.orchestra.run.smithi072.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.207457.log.gz 2024-04-04T16:50:24.769 INFO:teuthology.orchestra.run.smithi072.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.42446.log.gz 2024-04-04T16:50:24.769 INFO:teuthology.orchestra.run.smithi072.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.284165.log.gz 2024-04-04T16:50:24.769 INFO:teuthology.orchestra.run.smithi072.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.261143.log.gz 2024-04-04T16:50:24.769 INFO:teuthology.orchestra.run.smithi072.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.457657.log.gz 2024-04-04T16:50:24.769 INFO:teuthology.orchestra.run.smithi072.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.459410.log.gz 2024-04-04T16:50:24.769 INFO:teuthology.orchestra.run.smithi072.stderr: 78.7% -- replaced with /var/log/ceph/ceph-client.admin.512653.log.gz 2024-04-04T16:50:24.769 INFO:teuthology.orchestra.run.smithi072.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.48938.log.gz 2024-04-04T16:50:24.769 INFO:teuthology.orchestra.run.smithi072.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.207911.log.gz 2024-04-04T16:50:24.769 INFO:teuthology.orchestra.run.smithi072.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43231.log.gz 2024-04-04T16:50:24.770 INFO:teuthology.orchestra.run.smithi072.stderr: 89.9% 80.4% -- replaced with /var/log/ceph/ceph-client.admin.219495.log.gz 2024-04-04T16:50:24.770 INFO:teuthology.orchestra.run.smithi072.stderr: -- replaced with /var/log/ceph/ceph-client.admin.510131.log.gz 88.2% -- replaced with /var/log/ceph/ceph-client.admin.548493.log.gz 2024-04-04T16:50:24.770 INFO:teuthology.orchestra.run.smithi072.stderr: 2024-04-04T16:50:24.770 INFO:teuthology.orchestra.run.smithi072.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.509709.log.gz 2024-04-04T16:50:24.770 INFO:teuthology.orchestra.run.smithi072.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.215112.log.gz 2024-04-04T16:50:24.770 INFO:teuthology.orchestra.run.smithi072.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.194965.log.gz 2024-04-04T16:50:24.770 INFO:teuthology.orchestra.run.smithi072.stderr: 80.6% 83.1% -- replaced with /var/log/ceph/ceph-client.admin.387128.log.gz 2024-04-04T16:50:24.771 INFO:teuthology.orchestra.run.smithi072.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.49499.log.gz 2024-04-04T16:50:24.771 INFO:teuthology.orchestra.run.smithi072.stderr: -- replaced with /var/log/ceph/ceph-client.admin.392010.log.gz 2024-04-04T16:50:24.771 INFO:teuthology.orchestra.run.smithi072.stderr: 93.5% -- replaced with /var/log/ceph/ceph-client.admin.359855.log.gz 2024-04-04T16:50:24.771 INFO:teuthology.orchestra.run.smithi072.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.549133.log.gz 2024-04-04T16:50:24.771 INFO:teuthology.orchestra.run.smithi072.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.181606.log.gz 2024-04-04T16:50:24.771 INFO:teuthology.orchestra.run.smithi072.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.255631.log.gz 2024-04-04T16:50:24.771 INFO:teuthology.orchestra.run.smithi072.stderr: 93.3% -- replaced with /var/log/ceph/ceph-client.admin.207016.log.gz 2024-04-04T16:50:24.771 INFO:teuthology.orchestra.run.smithi072.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.475578.log.gz 84.5% -- replaced with /var/log/ceph/ceph-client.admin.274098.log.gz 2024-04-04T16:50:24.771 INFO:teuthology.orchestra.run.smithi072.stderr: 2024-04-04T16:50:24.772 INFO:teuthology.orchestra.run.smithi072.stderr: 78.0% -- replaced with /var/log/ceph/ceph-client.admin.244638.log.gz 2024-04-04T16:50:24.772 INFO:teuthology.orchestra.run.smithi072.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.200252.log.gz 2024-04-04T16:50:24.772 INFO:teuthology.orchestra.run.smithi072.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.181171.log.gz 2024-04-04T16:50:24.772 INFO:teuthology.orchestra.run.smithi072.stderr: 90.0% 88.5% 92.0% -- replaced with /var/log/ceph/ceph-client.admin.47510.log.gz -- replaced with /var/log/ceph/ceph-client.admin.458954.log.gz 2024-04-04T16:50:24.772 INFO:teuthology.orchestra.run.smithi072.stderr: 2024-04-04T16:50:24.772 INFO:teuthology.orchestra.run.smithi072.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.142726.log.gz 2024-04-04T16:50:24.772 INFO:teuthology.orchestra.run.smithi072.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.447083.log.gz 2024-04-04T16:50:24.772 INFO:teuthology.orchestra.run.smithi072.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.266875.log.gz 2024-04-04T16:50:24.773 INFO:teuthology.orchestra.run.smithi072.stderr: -- replaced with /var/log/ceph/ceph-client.admin.476431.log.gz 2024-04-04T16:50:24.773 INFO:teuthology.orchestra.run.smithi072.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.237241.log.gz 2024-04-04T16:50:24.773 INFO:teuthology.orchestra.run.smithi072.stderr: 83.7% -- replaced with /var/log/ceph/ceph-client.admin.182444.log.gz 2024-04-04T16:50:24.773 INFO:teuthology.orchestra.run.smithi072.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.549427.log.gz 90.0% -- replaced with /var/log/ceph/ceph-client.admin.351084.log.gz 2024-04-04T16:50:24.773 INFO:teuthology.orchestra.run.smithi072.stderr: 81.3% 2024-04-04T16:50:24.773 INFO:teuthology.orchestra.run.smithi072.stderr: -- replaced with /var/log/ceph/ceph-client.admin.140469.log.gz 2024-04-04T16:50:24.773 INFO:teuthology.orchestra.run.smithi072.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.533678.log.gz 2024-04-04T16:50:24.773 INFO:teuthology.orchestra.run.smithi072.stderr: 80.6% 90.0% -- replaced with /var/log/ceph/ceph-client.admin.430772.log.gz 2024-04-04T16:50:24.774 INFO:teuthology.orchestra.run.smithi072.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.335001.log.gz 2024-04-04T16:50:24.774 INFO:teuthology.orchestra.run.smithi072.stderr: 88.6% 80.7% -- replaced with /var/log/ceph/ceph-client.admin.231992.log.gz 2024-04-04T16:50:24.774 INFO:teuthology.orchestra.run.smithi072.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.327278.log.gz 2024-04-04T16:50:24.774 INFO:teuthology.orchestra.run.smithi072.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.486817.log.gz 2024-04-04T16:50:24.774 INFO:teuthology.orchestra.run.smithi072.stderr: -- replaced with /var/log/ceph/ceph-client.admin.549049.log.gz 2024-04-04T16:50:24.774 INFO:teuthology.orchestra.run.smithi072.stderr: 89.9% 85.3% -- replaced with /var/log/ceph/ceph-client.admin.413605.log.gz 2024-04-04T16:50:24.774 INFO:teuthology.orchestra.run.smithi072.stderr: -- replaced with /var/log/ceph/ceph-client.admin.242431.log.gz 2024-04-04T16:50:24.774 INFO:teuthology.orchestra.run.smithi072.stderr: -- replaced with /var/log/ceph/ceph-client.admin.182018.log.gz 2024-04-04T16:50:24.774 INFO:teuthology.orchestra.run.smithi072.stderr: 89.8% 85.1% -- replaced with /var/log/ceph/ceph-client.admin.189182.log.gz 2024-04-04T16:50:24.775 INFO:teuthology.orchestra.run.smithi072.stderr: 93.5% -- replaced with /var/log/ceph/ceph-client.admin.191022.log.gz 2024-04-04T16:50:24.775 INFO:teuthology.orchestra.run.smithi072.stderr: -- replaced with /var/log/ceph/ceph-client.admin.135404.log.gz 2024-04-04T16:50:24.775 INFO:teuthology.orchestra.run.smithi072.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.194543.log.gz 2024-04-04T16:50:24.775 INFO:teuthology.orchestra.run.smithi072.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.340152.log.gz 78.4% -- replaced with /var/log/ceph/ceph-client.admin.233822.log.gz 2024-04-04T16:50:24.775 INFO:teuthology.orchestra.run.smithi072.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.136246.log.gz 2024-04-04T16:50:24.775 INFO:teuthology.orchestra.run.smithi072.stderr: 2024-04-04T16:50:24.775 INFO:teuthology.orchestra.run.smithi072.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.549301.log.gz 2024-04-04T16:50:24.775 INFO:teuthology.orchestra.run.smithi072.stderr: 84.3% -- replaced with /var/log/ceph/ceph-client.admin.272799.log.gz 2024-04-04T16:50:24.776 INFO:teuthology.orchestra.run.smithi072.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.493875.log.gz 2024-04-04T16:50:24.776 INFO:teuthology.orchestra.run.smithi072.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.488983.log.gz 2024-04-04T16:50:24.776 INFO:teuthology.orchestra.run.smithi072.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.404616.log.gz 2024-04-04T16:50:24.776 INFO:teuthology.orchestra.run.smithi072.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.393724.log.gz 2024-04-04T16:50:24.776 INFO:teuthology.orchestra.run.smithi072.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.271507.log.gz 2024-04-04T16:50:24.776 INFO:teuthology.orchestra.run.smithi072.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.420033.log.gz 2024-04-04T16:50:24.776 INFO:teuthology.orchestra.run.smithi072.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.549343.log.gz 2024-04-04T16:50:24.776 INFO:teuthology.orchestra.run.smithi072.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.208336.log.gz 2024-04-04T16:50:24.776 INFO:teuthology.orchestra.run.smithi072.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.194131.log.gz 2024-04-04T16:50:24.777 INFO:teuthology.orchestra.run.smithi072.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.549007.log.gz 2024-04-04T16:50:24.777 INFO:teuthology.orchestra.run.smithi072.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.469405.log.gz 2024-04-04T16:50:24.777 INFO:teuthology.orchestra.run.smithi072.stderr: 90.0% 90.0% -- replaced with /var/log/ceph/ceph-client.admin.223093.log.gz 2024-04-04T16:50:24.777 INFO:teuthology.orchestra.run.smithi072.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.458945.log.gz 2024-04-04T16:50:24.777 INFO:teuthology.orchestra.run.smithi072.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.220335.log.gz 2024-04-04T16:50:24.777 INFO:teuthology.orchestra.run.smithi072.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.181180.log.gz 2024-04-04T16:50:24.777 INFO:teuthology.orchestra.run.smithi072.stderr: -- replaced with /var/log/ceph/ceph-client.admin.193710.log.gz 80.7% -- replaced with /var/log/ceph/ceph-client.admin.337109.log.gz 2024-04-04T16:50:24.777 INFO:teuthology.orchestra.run.smithi072.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.336255.log.gz 2024-04-04T16:50:24.777 INFO:teuthology.orchestra.run.smithi072.stderr: 2024-04-04T16:50:24.778 INFO:teuthology.orchestra.run.smithi072.stderr: 80.5% 81.1% 90.9% 90.1% -- replaced with /var/log/ceph/ceph-client.admin.459848.log.gz -- replaced with /var/log/ceph/ceph-client.admin.270245.log.gz -- replaced with /var/log/ceph/ceph-client.admin.418725.log.gz -- replaced with /var/log/ceph/ceph-client.admin.494755.log.gz 2024-04-04T16:50:24.778 INFO:teuthology.orchestra.run.smithi072.stderr: 2024-04-04T16:50:24.778 INFO:teuthology.orchestra.run.smithi072.stderr: 2024-04-04T16:50:24.778 INFO:teuthology.orchestra.run.smithi072.stderr: 2024-04-04T16:50:24.778 INFO:teuthology.orchestra.run.smithi072.stderr: 83.8% -- replaced with /var/log/ceph/ceph-client.admin.137080.log.gz 2024-04-04T16:50:24.778 INFO:teuthology.orchestra.run.smithi072.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.135825.log.gz 2024-04-04T16:50:24.778 INFO:teuthology.orchestra.run.smithi072.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.531113.log.gz 2024-04-04T16:50:24.778 INFO:teuthology.orchestra.run.smithi072.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.476844.log.gz 2024-04-04T16:50:24.778 INFO:teuthology.orchestra.run.smithi072.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.155053.log.gz 2024-04-04T16:50:24.779 INFO:teuthology.orchestra.run.smithi072.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.457666.log.gz 2024-04-04T16:50:24.779 INFO:teuthology.orchestra.run.smithi072.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.418734.log.gz 2024-04-04T16:50:24.779 INFO:teuthology.orchestra.run.smithi072.stderr: 78.3% -- replaced with /var/log/ceph/ceph-client.admin.232979.log.gz 2024-04-04T16:50:24.779 INFO:teuthology.orchestra.run.smithi072.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.42841.log.gz 2024-04-04T16:50:24.779 INFO:teuthology.orchestra.run.smithi072.stderr: 90.0% 90.0% -- replaced with /var/log/ceph/ceph-client.admin.338459.log.gz 2024-04-04T16:50:24.779 INFO:teuthology.orchestra.run.smithi072.stderr: -- replaced with /var/log/ceph/ceph-client.admin.403347.log.gz 2024-04-04T16:50:24.779 INFO:teuthology.orchestra.run.smithi072.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.519036.log.gz 2024-04-04T16:50:24.780 INFO:teuthology.orchestra.run.smithi072.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.457113.log.gz 2024-04-04T16:50:24.780 INFO:teuthology.orchestra.run.smithi072.stderr: 90.0% 90.0% -- replaced with /var/log/ceph/ceph-client.admin.389887.log.gz 2024-04-04T16:50:24.780 INFO:teuthology.orchestra.run.smithi072.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.256053.log.gz 2024-04-04T16:50:24.780 INFO:teuthology.orchestra.run.smithi072.stderr: -- replaced with /var/log/ceph/ceph-client.admin.429508.log.gz 90.1% -- replaced with /var/log/ceph/ceph-client.admin.489403.log.gz 2024-04-04T16:50:24.780 INFO:teuthology.orchestra.run.smithi072.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.511398.log.gz 2024-04-04T16:50:24.780 INFO:teuthology.orchestra.run.smithi072.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.520842.log.gz 2024-04-04T16:50:24.780 INFO:teuthology.orchestra.run.smithi072.stderr: 2024-04-04T16:50:24.780 INFO:teuthology.orchestra.run.smithi072.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.475587.log.gz 2024-04-04T16:50:24.781 INFO:teuthology.orchestra.run.smithi072.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.234253.log.gz 2024-04-04T16:50:24.781 INFO:teuthology.orchestra.run.smithi072.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.188770.log.gz 2024-04-04T16:50:24.781 INFO:teuthology.orchestra.run.smithi072.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.182027.log.gz 2024-04-04T16:50:24.781 INFO:teuthology.orchestra.run.smithi072.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.391149.log.gz 2024-04-04T16:50:24.781 INFO:teuthology.orchestra.run.smithi072.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.416192.log.gz 2024-04-04T16:50:24.781 INFO:teuthology.orchestra.run.smithi072.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.admin.243289.log.gz 81.1% 2024-04-04T16:50:24.781 INFO:teuthology.orchestra.run.smithi072.stderr: -- replaced with /var/log/ceph/ceph-client.admin.327690.log.gz 2024-04-04T16:50:24.781 INFO:teuthology.orchestra.run.smithi072.stderr: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.532805.log.gz 2024-04-04T16:50:24.782 INFO:teuthology.orchestra.run.smithi072.stderr: 80.1% -- replaced with /var/log/ceph/ceph-client.admin.509700.log.gz 2024-04-04T16:50:24.782 INFO:teuthology.orchestra.run.smithi072.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.491349.log.gz 2024-04-04T16:50:24.782 INFO:teuthology.orchestra.run.smithi072.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.155484.log.gz 2024-04-04T16:50:24.782 INFO:teuthology.orchestra.run.smithi072.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.243280.log.gz 2024-04-04T16:50:24.782 INFO:teuthology.orchestra.run.smithi072.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.271937.log.gz 2024-04-04T16:50:24.782 INFO:teuthology.orchestra.run.smithi072.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.187863.log.gz 2024-04-04T16:50:24.782 INFO:teuthology.orchestra.run.smithi072.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.493884.log.gz 2024-04-04T16:50:24.782 INFO:teuthology.orchestra.run.smithi072.stderr: 78.0% -- replaced with /var/log/ceph/ceph-client.admin.403338.log.gz 2024-04-04T16:50:24.782 INFO:teuthology.orchestra.run.smithi072.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.531104.log.gz 2024-04-04T16:50:24.783 INFO:teuthology.orchestra.run.smithi072.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.387549.log.gz 2024-04-04T16:50:24.783 INFO:teuthology.orchestra.run.smithi072.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.414905.log.gz 2024-04-04T16:50:24.783 INFO:teuthology.orchestra.run.smithi072.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.339730.log.gz 2024-04-04T16:50:24.783 INFO:teuthology.orchestra.run.smithi072.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.133712.log.gz 2024-04-04T16:50:24.783 INFO:teuthology.orchestra.run.smithi072.stderr: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.415327.log.gz 2024-04-04T16:50:24.783 INFO:teuthology.orchestra.run.smithi072.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.202060.log.gz 2024-04-04T16:50:24.783 INFO:teuthology.orchestra.run.smithi072.stderr: 78.6% -- replaced with /var/log/ceph/ceph-client.admin.518592.log.gz 2024-04-04T16:50:24.783 INFO:teuthology.orchestra.run.smithi072.stderr: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.195426.log.gz 2024-04-04T16:50:24.784 INFO:teuthology.orchestra.run.smithi072.stderr: 90.1% 90.0% -- replaced with /var/log/ceph/ceph-client.admin.492196.log.gz 2024-04-04T16:50:24.784 INFO:teuthology.orchestra.run.smithi072.stderr: 92.8% -- replaced with /var/log/ceph/ceph-client.admin.241528.log.gz 85.5% 2024-04-04T16:50:24.784 INFO:teuthology.orchestra.run.smithi072.stderr: -- replaced with /var/log/ceph/ceph-client.admin.274520.log.gz 2024-04-04T16:50:24.784 INFO:teuthology.orchestra.run.smithi072.stderr: -- replaced with /var/log/ceph/ceph-client.admin.392463.log.gz 2024-04-04T16:50:24.784 INFO:teuthology.orchestra.run.smithi072.stderr: 78.3% -- replaced with /var/log/ceph/ceph-client.admin.493452.log.gz 2024-04-04T16:50:24.816 INFO:teuthology.orchestra.run.smithi072.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.469860.log.gz 2024-04-04T16:50:24.817 INFO:teuthology.orchestra.run.smithi072.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.130241.log.gz 2024-04-04T16:50:24.817 INFO:teuthology.orchestra.run.smithi072.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.512662.log.gz 2024-04-04T16:50:24.817 INFO:teuthology.orchestra.run.smithi072.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.273685.log.gz 2024-04-04T16:50:24.817 INFO:teuthology.orchestra.run.smithi072.stderr: 92.8% -- replaced with /var/log/ceph/ceph-client.admin.469414.log.gz 2024-04-04T16:50:24.817 INFO:teuthology.orchestra.run.smithi072.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.231514.log.gz 2024-04-04T16:50:24.817 INFO:teuthology.orchestra.run.smithi072.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.419600.log.gz 2024-04-04T16:50:24.817 INFO:teuthology.orchestra.run.smithi072.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.531534.log.gz 2024-04-04T16:50:24.818 INFO:teuthology.orchestra.run.smithi072.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.165109.log.gz 2024-04-04T16:50:24.818 INFO:teuthology.orchestra.run.smithi072.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.418304.log.gz 2024-04-04T16:50:24.818 INFO:teuthology.orchestra.run.smithi072.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.543964.log.gz 2024-04-04T16:50:24.818 INFO:teuthology.orchestra.run.smithi072.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.549385.log.gz 2024-04-04T16:50:24.818 INFO:teuthology.orchestra.run.smithi072.stderr: 84.3% -- replaced with /var/log/ceph/ceph-client.admin.232516.log.gz 2024-04-04T16:50:24.818 INFO:teuthology.orchestra.run.smithi072.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.208770.log.gz 2024-04-04T16:50:24.818 INFO:teuthology.orchestra.run.smithi072.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.528921.log.gz 2024-04-04T16:50:24.818 INFO:teuthology.orchestra.run.smithi072.stderr: 93.3% -- replaced with /var/log/ceph/ceph-client.admin.188321.log.gz 2024-04-04T16:50:24.819 INFO:teuthology.orchestra.run.smithi072.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.384454.log.gz 2024-04-04T16:50:24.819 INFO:teuthology.orchestra.run.smithi072.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.477266.log.gz 2024-04-04T16:50:24.819 INFO:teuthology.orchestra.run.smithi072.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.403773.log.gz 2024-04-04T16:50:24.819 INFO:teuthology.orchestra.run.smithi072.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.222028.log.gz 2024-04-04T16:50:24.819 INFO:teuthology.orchestra.run.smithi072.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.542609.log.gz 2024-04-04T16:50:24.819 INFO:teuthology.orchestra.run.smithi072.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.516457.log.gz 2024-04-04T16:50:24.819 INFO:teuthology.orchestra.run.smithi072.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.187432.log.gz 2024-04-04T16:50:24.819 INFO:teuthology.orchestra.run.smithi072.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.535475.log.gz 2024-04-04T16:50:24.819 INFO:teuthology.orchestra.run.smithi072.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.220344.log.gz 2024-04-04T16:50:24.820 INFO:teuthology.orchestra.run.smithi072.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.230612.log.gz 2024-04-04T16:50:24.820 INFO:teuthology.orchestra.run.smithi072.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.admin.366503.log.gz 2024-04-04T16:50:24.820 INFO:teuthology.orchestra.run.smithi072.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.388422.log.gz 2024-04-04T16:50:24.820 INFO:teuthology.orchestra.run.smithi072.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.477275.log.gz 2024-04-04T16:50:24.820 INFO:teuthology.orchestra.run.smithi072.stderr: 93.4% -- replaced with /var/log/ceph/ceph-client.admin.199370.log.gz 2024-04-04T16:50:24.820 INFO:teuthology.orchestra.run.smithi072.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.548199.log.gz 2024-04-04T16:50:24.820 INFO:teuthology.orchestra.run.smithi072.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.49064.log.gz 2024-04-04T16:50:24.820 INFO:teuthology.orchestra.run.smithi072.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.321627.log.gz 2024-04-04T16:50:24.821 INFO:teuthology.orchestra.run.smithi072.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.449653.log.gz 2024-04-04T16:50:24.821 INFO:teuthology.orchestra.run.smithi072.stderr: 78.2% -- replaced with /var/log/ceph/ceph-client.admin.406794.log.gz 2024-04-04T16:50:24.821 INFO:teuthology.orchestra.run.smithi072.stderr: 84.3% -- replaced with /var/log/ceph/ceph-client.admin.219074.log.gz 2024-04-04T16:50:24.821 INFO:teuthology.orchestra.run.smithi072.stderr: 93.9% 89.2% -- replaced with /var/log/ceph/ceph-client.admin.457122.log.gz -- replaced with /var/log/ceph/ceph-client.admin.548409.log.gz 2024-04-04T16:50:24.821 INFO:teuthology.orchestra.run.smithi072.stderr: 2024-04-04T16:50:24.821 INFO:teuthology.orchestra.run.smithi072.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.212568.log.gz 2024-04-04T16:50:24.821 INFO:teuthology.orchestra.run.smithi072.stderr: 87.5% 78.5% -- replaced with /var/log/ceph/ceph-client.admin.314837.log.gz 2024-04-04T16:50:24.821 INFO:teuthology.orchestra.run.smithi072.stderr: -- replaced with /var/log/ceph/ceph-client.admin.548031.log.gz 90.0% 2024-04-04T16:50:24.821 INFO:teuthology.orchestra.run.smithi072.stderr: -- replaced with /var/log/ceph/ceph-client.admin.408954.log.gz 2024-04-04T16:50:24.822 INFO:teuthology.orchestra.run.smithi072.stderr: 90.0% 81.2% -- replaced with /var/log/ceph/ceph-client.admin.268980.log.gz -- replaced with /var/log/ceph/ceph-client.admin.448347.log.gz 2024-04-04T16:50:24.822 INFO:teuthology.orchestra.run.smithi072.stderr: 2024-04-04T16:50:24.822 INFO:teuthology.orchestra.run.smithi072.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.465178.log.gz 2024-04-04T16:50:24.822 INFO:teuthology.orchestra.run.smithi072.stderr: 88.7% 85.2% -- replaced with /var/log/ceph/ceph-client.admin.525788.log.gz 2024-04-04T16:50:24.822 INFO:teuthology.orchestra.run.smithi072.stderr: -- replaced with /var/log/ceph/ceph-client.admin.46799.log.gz 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43857.log.gz 2024-04-04T16:50:24.822 INFO:teuthology.orchestra.run.smithi072.stderr: 84.6% -- replaced with /var/log/ceph/ceph-client.admin.395031.log.gz 2024-04-04T16:50:24.822 INFO:teuthology.orchestra.run.smithi072.stderr: 84.0% -- replaced with /var/log/ceph/ceph-client.admin.429922.log.gz 2024-04-04T16:50:24.823 INFO:teuthology.orchestra.run.smithi072.stderr: 2024-04-04T16:50:24.823 INFO:teuthology.orchestra.run.smithi072.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.448356.log.gz 2024-04-04T16:50:24.823 INFO:teuthology.orchestra.run.smithi072.stderr: 83.4% -- replaced with /var/log/ceph/ceph-client.admin.408520.log.gz 2024-04-04T16:50:24.823 INFO:teuthology.orchestra.run.smithi072.stderr: 78.3% -- replaced with /var/log/ceph/ceph-client.admin.547050.log.gz 2024-04-04T16:50:24.823 INFO:teuthology.orchestra.run.smithi072.stderr: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.162323.log.gz 2024-04-04T16:50:24.823 INFO:teuthology.orchestra.run.smithi072.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.475154.log.gz 2024-04-04T16:50:24.823 INFO:teuthology.orchestra.run.smithi072.stderr: 80.2% -- replaced with /var/log/ceph/ceph-client.admin.545701.log.gz 2024-04-04T16:50:24.823 INFO:teuthology.orchestra.run.smithi072.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.185175.log.gz 2024-04-04T16:50:24.823 INFO:teuthology.orchestra.run.smithi072.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.535022.log.gz 2024-04-04T16:50:24.824 INFO:teuthology.orchestra.run.smithi072.stderr: 77.6% -- replaced with /var/log/ceph/ceph-client.admin.194122.log.gz 2024-04-04T16:50:24.824 INFO:teuthology.orchestra.run.smithi072.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.137089.log.gz 2024-04-04T16:50:24.824 INFO:teuthology.orchestra.run.smithi072.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.456265.log.gz 2024-04-04T16:50:24.824 INFO:teuthology.orchestra.run.smithi072.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.508865.log.gz 2024-04-04T16:50:24.824 INFO:teuthology.orchestra.run.smithi072.stderr: 77.6% -- replaced with /var/log/ceph/ceph-client.admin.206556.log.gz 2024-04-04T16:50:24.824 INFO:teuthology.orchestra.run.smithi072.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.541672.log.gz 2024-04-04T16:50:24.824 INFO:teuthology.orchestra.run.smithi072.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.146744.log.gz 2024-04-04T16:50:24.825 INFO:teuthology.orchestra.run.smithi072.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.136658.log.gz 2024-04-04T16:50:24.825 INFO:teuthology.orchestra.run.smithi072.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.145355.log.gz 2024-04-04T16:50:24.825 INFO:teuthology.orchestra.run.smithi072.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.49893.log.gz 2024-04-04T16:50:24.825 INFO:teuthology.orchestra.run.smithi072.stderr: 84.7% -- replaced with /var/log/ceph/ceph-client.admin.280959.log.gz 2024-04-04T16:50:24.825 INFO:teuthology.orchestra.run.smithi072.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.118965.log.gz 2024-04-04T16:50:24.825 INFO:teuthology.orchestra.run.smithi072.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.147166.log.gz 2024-04-04T16:50:24.825 INFO:teuthology.orchestra.run.smithi072.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.354152.log.gz 2024-04-04T16:50:24.825 INFO:teuthology.orchestra.run.smithi072.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.516026.log.gz 2024-04-04T16:50:24.825 INFO:teuthology.orchestra.run.smithi072.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43569.log.gz 2024-04-04T16:50:24.826 INFO:teuthology.orchestra.run.smithi072.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.450573.log.gz 2024-04-04T16:50:24.826 INFO:teuthology.orchestra.run.smithi072.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.352805.log.gz 2024-04-04T16:50:24.826 INFO:teuthology.orchestra.run.smithi072.stderr: 84.3% 78.2% -- replaced with /var/log/ceph/ceph-client.admin.135395.log.gz 2024-04-04T16:50:24.826 INFO:teuthology.orchestra.run.smithi072.stderr: 93.3% -- replaced with /var/log/ceph/ceph-client.admin.200262.log.gz 2024-04-04T16:50:24.826 INFO:teuthology.orchestra.run.smithi072.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.351075.log.gz 2024-04-04T16:50:24.826 INFO:teuthology.orchestra.run.smithi072.stderr: -- replaced with /var/log/ceph/ceph-client.admin.120276.log.gz 2024-04-04T16:50:24.826 INFO:teuthology.orchestra.run.smithi072.stderr: 93.4% -- replaced with /var/log/ceph/ceph-client.admin.216409.log.gz 2024-04-04T16:50:24.826 INFO:teuthology.orchestra.run.smithi072.stderr: 89.8% 88.6% -- replaced with /var/log/ceph/ceph-client.admin.137511.log.gz 2024-04-04T16:50:24.827 INFO:teuthology.orchestra.run.smithi072.stderr: -- replaced with /var/log/ceph/ceph-client.admin.48518.log.gz 2024-04-04T16:50:24.827 INFO:teuthology.orchestra.run.smithi072.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.355870.log.gz 2024-04-04T16:50:24.827 INFO:teuthology.orchestra.run.smithi072.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.225250.log.gz 2024-04-04T16:50:24.827 INFO:teuthology.orchestra.run.smithi072.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.385791.log.gz 2024-04-04T16:50:24.827 INFO:teuthology.orchestra.run.smithi072.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.454584.log.gz 2024-04-04T16:50:24.827 INFO:teuthology.orchestra.run.smithi072.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.329073.log.gz 2024-04-04T16:50:24.827 INFO:teuthology.orchestra.run.smithi072.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.465674.log.gz 2024-04-04T16:50:24.827 INFO:teuthology.orchestra.run.smithi072.stderr: 84.7% -- replaced with /var/log/ceph/ceph-client.admin.432941.log.gz 2024-04-04T16:50:24.827 INFO:teuthology.orchestra.run.smithi072.stderr: 80.7% 80.7% -- replaced with /var/log/ceph/ceph-client.admin.241095.log.gz -- replaced with /var/log/ceph/ceph-client.admin.137502.log.gz 2024-04-04T16:50:24.828 INFO:teuthology.orchestra.run.smithi072.stderr: 2024-04-04T16:50:24.828 INFO:teuthology.orchestra.run.smithi072.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.47348.log.gz 2024-04-04T16:50:24.828 INFO:teuthology.orchestra.run.smithi072.stderr: 85.1% 79.9% -- replaced with /var/log/ceph/ceph-client.admin.421292.log.gz -- replaced with /var/log/ceph/ceph-client.admin.198462.log.gz 2024-04-04T16:50:24.828 INFO:teuthology.orchestra.run.smithi072.stderr: 2024-04-04T16:50:24.828 INFO:teuthology.orchestra.run.smithi072.stderr: 77.5% -- replaced with /var/log/ceph/ceph-client.admin.348350.log.gz 2024-04-04T16:50:24.828 INFO:teuthology.orchestra.run.smithi072.stderr: 83.0% -- replaced with /var/log/ceph/ceph-client.admin.152036.log.gz 2024-04-04T16:50:24.828 INFO:teuthology.orchestra.run.smithi072.stderr: 78.5% -- replaced with /var/log/ceph/ceph-client.admin.241519.log.gz 2024-04-04T16:50:24.828 INFO:teuthology.orchestra.run.smithi072.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.411908.log.gz 2024-04-04T16:50:24.829 INFO:teuthology.orchestra.run.smithi072.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.319931.log.gz 2024-04-04T16:50:24.829 INFO:teuthology.orchestra.run.smithi072.stderr: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.285002.log.gz 2024-04-04T16:50:24.829 INFO:teuthology.orchestra.run.smithi072.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.322047.log.gz 2024-04-04T16:50:24.829 INFO:teuthology.orchestra.run.smithi072.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.236396.log.gz 2024-04-04T16:50:24.829 INFO:teuthology.orchestra.run.smithi072.stderr: 88.6% 77.4% -- replaced with /var/log/ceph/ceph-client.admin.275442.log.gz 2024-04-04T16:50:24.829 INFO:teuthology.orchestra.run.smithi072.stderr: -- replaced with /var/log/ceph/ceph-client.admin.42277.log.gz 89.9% -- replaced with /var/log/ceph/ceph-client.admin.257331.log.gz 2024-04-04T16:50:24.829 INFO:teuthology.orchestra.run.smithi072.stderr: 2024-04-04T16:50:24.829 INFO:teuthology.orchestra.run.smithi072.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.42711.log.gz 2024-04-04T16:50:24.829 INFO:teuthology.orchestra.run.smithi072.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.322908.log.gz 2024-04-04T16:50:24.830 INFO:teuthology.orchestra.run.smithi072.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.235561.log.gz 2024-04-04T16:50:24.830 INFO:teuthology.orchestra.run.smithi072.stderr: 84.5% -- replaced with /var/log/ceph/ceph-client.admin.331626.log.gz 2024-04-04T16:50:24.830 INFO:teuthology.orchestra.run.smithi072.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.125139.log.gz 2024-04-04T16:50:24.830 INFO:teuthology.orchestra.run.smithi072.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.179912.log.gz 2024-04-04T16:50:24.830 INFO:teuthology.orchestra.run.smithi072.stderr: 78.1% -- replaced with /var/log/ceph/ceph-client.admin.546156.log.gz 2024-04-04T16:50:24.830 INFO:teuthology.orchestra.run.smithi072.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.329064.log.gz 2024-04-04T16:50:24.830 INFO:teuthology.orchestra.run.smithi072.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.316959.log.gz 2024-04-04T16:50:24.830 INFO:teuthology.orchestra.run.smithi072.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.328652.log.gz 2024-04-04T16:50:24.830 INFO:teuthology.orchestra.run.smithi072.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.527077.log.gz 2024-04-04T16:50:24.831 INFO:teuthology.orchestra.run.smithi072.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.42925.log.gz 2024-04-04T16:50:24.831 INFO:teuthology.orchestra.run.smithi072.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.318233.log.gz 2024-04-04T16:50:24.831 INFO:teuthology.orchestra.run.smithi072.stderr: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.485103.log.gz 2024-04-04T16:50:24.831 INFO:teuthology.orchestra.run.smithi072.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.548555.log.gz 2024-04-04T16:50:24.831 INFO:teuthology.orchestra.run.smithi072.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.128985.log.gz 2024-04-04T16:50:24.831 INFO:teuthology.orchestra.run.smithi072.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.525797.log.gz 2024-04-04T16:50:24.831 INFO:teuthology.orchestra.run.smithi072.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.50582.log.gz 2024-04-04T16:50:24.831 INFO:teuthology.orchestra.run.smithi072.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.346515.log.gz 2024-04-04T16:50:24.832 INFO:teuthology.orchestra.run.smithi072.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.455001.log.gz 2024-04-04T16:50:24.832 INFO:teuthology.orchestra.run.smithi072.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.261565.log.gz 2024-04-04T16:50:24.832 INFO:teuthology.orchestra.run.smithi072.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.163694.log.gz 2024-04-04T16:50:24.832 INFO:teuthology.orchestra.run.smithi072.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.474667.log.gz 2024-04-04T16:50:24.832 INFO:teuthology.orchestra.run.smithi072.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.549762.log.gz 2024-04-04T16:50:24.832 INFO:teuthology.orchestra.run.smithi072.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.202511.log.gz 2024-04-04T16:50:24.832 INFO:teuthology.orchestra.run.smithi072.stderr: 83.1% -- replaced with /var/log/ceph/ceph-client.admin.409787.log.gz 2024-04-04T16:50:24.832 INFO:teuthology.orchestra.run.smithi072.stderr: 78.8% -- replaced with /var/log/ceph/ceph-client.admin.268550.log.gz 2024-04-04T16:50:24.833 INFO:teuthology.orchestra.run.smithi072.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.405067.log.gz 2024-04-04T16:50:24.833 INFO:teuthology.orchestra.run.smithi072.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.447092.log.gz 2024-04-04T16:50:24.833 INFO:teuthology.orchestra.run.smithi072.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.463756.log.gz 2024-04-04T16:50:24.833 INFO:teuthology.orchestra.run.smithi072.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.139202.log.gz 2024-04-04T16:50:24.833 INFO:teuthology.orchestra.run.smithi072.stderr: 89.8% 81.2% -- replaced with /var/log/ceph/ceph-client.admin.515614.log.gz -- replaced with /var/log/ceph/ceph-client.admin.125617.log.gz 2024-04-04T16:50:24.833 INFO:teuthology.orchestra.run.smithi072.stderr: 2024-04-04T16:50:24.833 INFO:teuthology.orchestra.run.smithi072.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.520400.log.gz 2024-04-04T16:50:24.833 INFO:teuthology.orchestra.run.smithi072.stderr: 81.3% 89.9% -- replaced with /var/log/ceph/ceph-client.admin.236828.log.gz 2024-04-04T16:50:24.833 INFO:teuthology.orchestra.run.smithi072.stderr: 84.5% -- replaced with /var/log/ceph/ceph-client.admin.473402.log.gz 2024-04-04T16:50:24.834 INFO:teuthology.orchestra.run.smithi072.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.43220.log.gz 2024-04-04T16:50:24.834 INFO:teuthology.orchestra.run.smithi072.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.528483.log.gz 2024-04-04T16:50:24.834 INFO:teuthology.orchestra.run.smithi072.stderr: -- replaced with /var/log/ceph/ceph-client.admin.524438.log.gz 2024-04-04T16:50:24.834 INFO:teuthology.orchestra.run.smithi072.stderr: 83.0% -- replaced with /var/log/ceph/ceph-client.admin.405058.log.gz 2024-04-04T16:50:24.834 INFO:teuthology.orchestra.run.smithi072.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.549175.log.gz 2024-04-04T16:50:24.834 INFO:teuthology.orchestra.run.smithi072.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.416618.log.gz 2024-04-04T16:50:24.834 INFO:teuthology.orchestra.run.smithi072.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.50648.log.gz 2024-04-04T16:50:24.834 INFO:teuthology.orchestra.run.smithi072.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.283316.log.gz 2024-04-04T16:50:24.834 INFO:teuthology.orchestra.run.smithi072.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.400269.log.gz 2024-04-04T16:50:24.835 INFO:teuthology.orchestra.run.smithi072.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.269822.log.gz 2024-04-04T16:50:24.835 INFO:teuthology.orchestra.run.smithi072.stderr: 77.9% -- replaced with /var/log/ceph/ceph-client.admin.138771.log.gz 2024-04-04T16:50:24.835 INFO:teuthology.orchestra.run.smithi072.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.47020.log.gz 2024-04-04T16:50:24.835 INFO:teuthology.orchestra.run.smithi072.stderr: 78.5% -- replaced with /var/log/ceph/ceph-client.admin.362095.log.gz 2024-04-04T16:50:24.835 INFO:teuthology.orchestra.run.smithi072.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.462910.log.gz 2024-04-04T16:50:24.835 INFO:teuthology.orchestra.run.smithi072.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.349811.log.gz 2024-04-04T16:50:24.835 INFO:teuthology.orchestra.run.smithi072.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.113545.log.gz 2024-04-04T16:50:24.836 INFO:teuthology.orchestra.run.smithi072.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42576.log.gz 2024-04-04T16:50:24.836 INFO:teuthology.orchestra.run.smithi072.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.429931.log.gz 2024-04-04T16:50:24.836 INFO:teuthology.orchestra.run.smithi072.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.260708.log.gz 2024-04-04T16:50:24.836 INFO:teuthology.orchestra.run.smithi072.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.358933.log.gz 2024-04-04T16:50:24.836 INFO:teuthology.orchestra.run.smithi072.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42319.log.gz 2024-04-04T16:50:24.836 INFO:teuthology.orchestra.run.smithi072.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.347874.log.gz 2024-04-04T16:50:24.836 INFO:teuthology.orchestra.run.smithi072.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46883.log.gz 2024-04-04T16:50:24.836 INFO:teuthology.orchestra.run.smithi072.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.50456.log.gz 2024-04-04T16:50:24.836 INFO:teuthology.orchestra.run.smithi072.stderr: 80.3% -- replaced with /var/log/ceph/ceph-client.admin.508856.log.gz 2024-04-04T16:50:24.837 INFO:teuthology.orchestra.run.smithi072.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44311.log.gz 2024-04-04T16:50:24.837 INFO:teuthology.orchestra.run.smithi072.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.464188.log.gz 2024-04-04T16:50:24.837 INFO:teuthology.orchestra.run.smithi072.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.45890.log.gz 2024-04-04T16:50:24.837 INFO:teuthology.orchestra.run.smithi072.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.249267.log.gz 2024-04-04T16:50:24.837 INFO:teuthology.orchestra.run.smithi072.stderr: 78.4% -- replaced with /var/log/ceph/ceph-client.admin.505921.log.gz 2024-04-04T16:50:24.837 INFO:teuthology.orchestra.run.smithi072.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.203410.log.gz 2024-04-04T16:50:24.837 INFO:teuthology.orchestra.run.smithi072.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.317385.log.gz 2024-04-04T16:50:24.837 INFO:teuthology.orchestra.run.smithi072.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.544407.log.gz 2024-04-04T16:50:24.838 INFO:teuthology.orchestra.run.smithi072.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.349335.log.gz 2024-04-04T16:50:24.838 INFO:teuthology.orchestra.run.smithi072.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.237250.log.gz 2024-04-04T16:50:24.838 INFO:teuthology.orchestra.run.smithi072.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.admin.186100.log.gz 2024-04-04T16:50:24.838 INFO:teuthology.orchestra.run.smithi072.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.46505.log.gz 2024-04-04T16:50:24.838 INFO:teuthology.orchestra.run.smithi072.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.212989.log.gz 2024-04-04T16:50:24.838 INFO:teuthology.orchestra.run.smithi072.stderr: 83.0% -- replaced with /var/log/ceph/ceph-client.admin.280097.log.gz 2024-04-04T16:50:24.838 INFO:teuthology.orchestra.run.smithi072.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.47062.log.gz 2024-04-04T16:50:24.838 INFO:teuthology.orchestra.run.smithi072.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.42799.log.gz 2024-04-04T16:50:24.838 INFO:teuthology.orchestra.run.smithi072.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.548965.log.gz 2024-04-04T16:50:24.839 INFO:teuthology.orchestra.run.smithi072.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.486808.log.gz 2024-04-04T16:50:24.839 INFO:teuthology.orchestra.run.smithi072.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.187423.log.gz 2024-04-04T16:50:24.839 INFO:teuthology.orchestra.run.smithi072.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.152045.log.gz 2024-04-04T16:50:24.839 INFO:teuthology.orchestra.run.smithi072.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.217299.log.gz 2024-04-04T16:50:24.839 INFO:teuthology.orchestra.run.smithi072.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.259452.log.gz 2024-04-04T16:50:24.839 INFO:teuthology.orchestra.run.smithi072.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.435312.log.gz 2024-04-04T16:50:24.839 INFO:teuthology.orchestra.run.smithi072.stderr: 78.3% -- replaced with /var/log/ceph/ceph-client.admin.325444.log.gz 2024-04-04T16:50:24.839 INFO:teuthology.orchestra.run.smithi072.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.464673.log.gz 2024-04-04T16:50:24.840 INFO:teuthology.orchestra.run.smithi072.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.43009.log.gz 2024-04-04T16:50:24.840 INFO:teuthology.orchestra.run.smithi072.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.405910.log.gz 2024-04-04T16:50:24.840 INFO:teuthology.orchestra.run.smithi072.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.323745.log.gz 2024-04-04T16:50:24.840 INFO:teuthology.orchestra.run.smithi072.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44185.log.gz 2024-04-04T16:50:24.840 INFO:teuthology.orchestra.run.smithi072.stderr: 80.3% -- replaced with /var/log/ceph/ceph-client.admin.531525.log.gz 2024-04-04T16:50:24.840 INFO:teuthology.orchestra.run.smithi072.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.188761.log.gz 2024-04-04T16:50:24.840 INFO:teuthology.orchestra.run.smithi072.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43886.log.gz 2024-04-04T16:50:24.840 INFO:teuthology.orchestra.run.smithi072.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.465665.log.gz 2024-04-04T16:50:24.840 INFO:teuthology.orchestra.run.smithi072.stderr: 78.3% -- replaced with /var/log/ceph/ceph-client.admin.521763.log.gz 2024-04-04T16:50:24.841 INFO:teuthology.orchestra.run.smithi072.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.493461.log.gz 2024-04-04T16:50:24.841 INFO:teuthology.orchestra.run.smithi072.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.242844.log.gz 2024-04-04T16:50:24.841 INFO:teuthology.orchestra.run.smithi072.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.240258.log.gz 2024-04-04T16:50:24.841 INFO:teuthology.orchestra.run.smithi072.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.527830.log.gz 2024-04-04T16:50:24.841 INFO:teuthology.orchestra.run.smithi072.stderr: 84.7% -- replaced with /var/log/ceph/ceph-client.admin.431189.log.gz 2024-04-04T16:50:24.841 INFO:teuthology.orchestra.run.smithi072.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.393312.log.gz 2024-04-04T16:50:24.841 INFO:teuthology.orchestra.run.smithi072.stderr: 78.3% -- replaced with /var/log/ceph/ceph-client.admin.248813.log.gz 2024-04-04T16:50:24.841 INFO:teuthology.orchestra.run.smithi072.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43566.log.gz 2024-04-04T16:50:24.841 INFO:teuthology.orchestra.run.smithi072.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.319075.log.gz 2024-04-04T16:50:24.841 INFO:teuthology.orchestra.run.smithi072.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.407650.log.gz 2024-04-04T16:50:24.842 INFO:teuthology.orchestra.run.smithi072.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.47846.log.gz 2024-04-04T16:50:24.842 INFO:teuthology.orchestra.run.smithi072.stderr: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.541228.log.gz 2024-04-04T16:50:24.842 INFO:teuthology.orchestra.run.smithi072.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.348849.log.gz 2024-04-04T16:50:24.842 INFO:teuthology.orchestra.run.smithi072.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.362549.log.gz 2024-04-04T16:50:24.842 INFO:teuthology.orchestra.run.smithi072.stderr: 84.3% -- replaced with /var/log/ceph/ceph-client.admin.260287.log.gz 2024-04-04T16:50:24.842 INFO:teuthology.orchestra.run.smithi072.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.513497.log.gz 2024-04-04T16:50:24.842 INFO:teuthology.orchestra.run.smithi072.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.46547.log.gz 2024-04-04T16:50:24.843 INFO:teuthology.orchestra.run.smithi072.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.138780.log.gz 2024-04-04T16:50:24.843 INFO:teuthology.orchestra.run.smithi072.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.319940.log.gz 2024-04-04T16:50:24.843 INFO:teuthology.orchestra.run.smithi072.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.226092.log.gz 2024-04-04T16:50:24.843 INFO:teuthology.orchestra.run.smithi072.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.446669.log.gz 2024-04-04T16:50:24.843 INFO:teuthology.orchestra.run.smithi072.stderr: 92.0% -- replaced with /var/log/ceph/ceph-client.2.45786.log.gz 2024-04-04T16:50:24.843 INFO:teuthology.orchestra.run.smithi072.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.446660.log.gz 2024-04-04T16:50:24.843 INFO:teuthology.orchestra.run.smithi072.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.212577.log.gz 2024-04-04T16:50:24.843 INFO:teuthology.orchestra.run.smithi072.stderr: 89.9% 85.2% -- replaced with /var/log/ceph/ceph-client.admin.454158.log.gz 2024-04-04T16:50:24.844 INFO:teuthology.orchestra.run.smithi072.stderr: -- replaced with /var/log/ceph/ceph-client.admin.148031.log.gz 2024-04-04T16:50:24.844 INFO:teuthology.orchestra.run.smithi072.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.358942.log.gz 2024-04-04T16:50:24.844 INFO:teuthology.orchestra.run.smithi072.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.160893.log.gz 2024-04-04T16:50:24.844 INFO:teuthology.orchestra.run.smithi072.stderr: 84.9% -- replaced with /var/log/ceph/ceph-client.admin.198912.log.gz 2024-04-04T16:50:24.844 INFO:teuthology.orchestra.run.smithi072.stderr: 83.3% -- replaced with /var/log/ceph/ceph-client.admin.118518.log.gz 2024-04-04T16:50:24.844 INFO:teuthology.orchestra.run.smithi072.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.43555.log.gz 2024-04-04T16:50:24.844 INFO:teuthology.orchestra.run.smithi072.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.330782.log.gz 2024-04-04T16:50:24.844 INFO:teuthology.orchestra.run.smithi072.stderr: 89.9% 89.9% -- replaced with /var/log/ceph/ceph-client.admin.455010.log.gz 2024-04-04T16:50:24.844 INFO:teuthology.orchestra.run.smithi072.stderr: -- replaced with /var/log/ceph/ceph-client.admin.257757.log.gz 2024-04-04T16:50:24.845 INFO:teuthology.orchestra.run.smithi072.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.266024.log.gz 2024-04-04T16:50:24.845 INFO:teuthology.orchestra.run.smithi072.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.132860.log.gz 2024-04-04T16:50:24.845 INFO:teuthology.orchestra.run.smithi072.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.281898.log.gz 2024-04-04T16:50:24.845 INFO:teuthology.orchestra.run.smithi072.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.479456.log.gz 2024-04-04T16:50:24.845 INFO:teuthology.orchestra.run.smithi072.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.407220.log.gz 2024-04-04T16:50:24.845 INFO:teuthology.orchestra.run.smithi072.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.513506.log.gz 2024-04-04T16:50:24.845 INFO:teuthology.orchestra.run.smithi072.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.266445.log.gz 2024-04-04T16:50:24.845 INFO:teuthology.orchestra.run.smithi072.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.47206.log.gz 2024-04-04T16:50:24.846 INFO:teuthology.orchestra.run.smithi072.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.315693.log.gz 2024-04-04T16:50:24.846 INFO:teuthology.orchestra.run.smithi072.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.42532.log.gz 2024-04-04T16:50:24.846 INFO:teuthology.orchestra.run.smithi072.stderr: 78.3% -- replaced with /var/log/ceph/ceph-client.admin.237662.log.gz 2024-04-04T16:50:24.846 INFO:teuthology.orchestra.run.smithi072.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.47888.log.gz 2024-04-04T16:50:24.846 INFO:teuthology.orchestra.run.smithi072.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.184620.log.gz 2024-04-04T16:50:24.846 INFO:teuthology.orchestra.run.smithi072.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.529356.log.gz 2024-04-04T16:50:24.846 INFO:teuthology.orchestra.run.smithi072.stderr: 84.4% -- replaced with /var/log/ceph/ceph-client.admin.258591.log.gz 2024-04-04T16:50:24.846 INFO:teuthology.orchestra.run.smithi072.stderr: 83.3% -- replaced with /var/log/ceph/ceph-client.admin.527821.log.gz 2024-04-04T16:50:24.846 INFO:teuthology.orchestra.run.smithi072.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.515605.log.gz 2024-04-04T16:50:24.847 INFO:teuthology.orchestra.run.smithi072.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.236819.log.gz 2024-04-04T16:50:24.847 INFO:teuthology.orchestra.run.smithi072.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.239412.log.gz 2024-04-04T16:50:24.847 INFO:teuthology.orchestra.run.smithi072.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.46127.log.gz 2024-04-04T16:50:24.847 INFO:teuthology.orchestra.run.smithi072.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.331206.log.gz 2024-04-04T16:50:24.847 INFO:teuthology.orchestra.run.smithi072.stderr: 93.2% 89.9% -- replaced with /var/log/ceph/ceph-client.admin.265612.log.gz 2024-04-04T16:50:24.847 INFO:teuthology.orchestra.run.smithi072.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.240681.log.gz 2024-04-04T16:50:24.847 INFO:teuthology.orchestra.run.smithi072.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.136237.log.gz 2024-04-04T16:50:24.847 INFO:teuthology.orchestra.run.smithi072.stderr: -- replaced with /var/log/ceph/ceph-client.admin.200720.log.gz 2024-04-04T16:50:24.848 INFO:teuthology.orchestra.run.smithi072.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.417465.log.gz 2024-04-04T16:50:24.848 INFO:teuthology.orchestra.run.smithi072.stderr: 78.3% 88.9% -- replaced with /var/log/ceph/ceph-client.admin.548597.log.gz 2024-04-04T16:50:24.848 INFO:teuthology.orchestra.run.smithi072.stderr: -- replaced with /var/log/ceph/ceph-client.admin.426141.log.gz 2024-04-04T16:50:24.848 INFO:teuthology.orchestra.run.smithi072.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.516870.log.gz 2024-04-04T16:50:24.848 INFO:teuthology.orchestra.run.smithi072.stderr: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.408945.log.gz 2024-04-04T16:50:24.848 INFO:teuthology.orchestra.run.smithi072.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.110673.log.gz 2024-04-04T16:50:24.848 INFO:teuthology.orchestra.run.smithi072.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.195847.log.gz 2024-04-04T16:50:24.848 INFO:teuthology.orchestra.run.smithi072.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.46253.log.gz 2024-04-04T16:50:24.848 INFO:teuthology.orchestra.run.smithi072.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.453736.log.gz 2024-04-04T16:50:24.849 INFO:teuthology.orchestra.run.smithi072.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.549553.log.gz 2024-04-04T16:50:24.849 INFO:teuthology.orchestra.run.smithi072.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.401513.log.gz 2024-04-04T16:50:24.849 INFO:teuthology.orchestra.run.smithi072.stderr: 91.8% -- replaced with /var/log/ceph/ceph-client.admin.519980.log.gz 2024-04-04T16:50:24.849 INFO:teuthology.orchestra.run.smithi072.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.216850.log.gz 2024-04-04T16:50:24.849 INFO:teuthology.orchestra.run.smithi072.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.538129.log.gz 2024-04-04T16:50:24.849 INFO:teuthology.orchestra.run.smithi072.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.49707.log.gz 2024-04-04T16:50:24.849 INFO:teuthology.orchestra.run.smithi072.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.113977.log.gz 2024-04-04T16:50:24.849 INFO:teuthology.orchestra.run.smithi072.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.139617.log.gz 2024-04-04T16:50:24.849 INFO:teuthology.orchestra.run.smithi072.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.528492.log.gz 2024-04-04T16:50:24.850 INFO:teuthology.orchestra.run.smithi072.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.544398.log.gz 2024-04-04T16:50:24.850 INFO:teuthology.orchestra.run.smithi072.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.49148.log.gz 2024-04-04T16:50:24.850 INFO:teuthology.orchestra.run.smithi072.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.406803.log.gz 2024-04-04T16:50:24.850 INFO:teuthology.orchestra.run.smithi072.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.533266.log.gz 2024-04-04T16:50:24.850 INFO:teuthology.orchestra.run.smithi072.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43232.log.gz 2024-04-04T16:50:24.850 INFO:teuthology.orchestra.run.smithi072.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.152458.log.gz 2024-04-04T16:50:24.850 INFO:teuthology.orchestra.run.smithi072.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.520833.log.gz 2024-04-04T16:50:24.850 INFO:teuthology.orchestra.run.smithi072.stderr: 90.0% 77.4% -- replaced with /var/log/ceph/ceph-client.admin.405493.log.gz -- replaced with /var/log/ceph/ceph-client.admin.543079.log.gz 2024-04-04T16:50:24.851 INFO:teuthology.orchestra.run.smithi072.stderr: 2024-04-04T16:50:24.851 INFO:teuthology.orchestra.run.smithi072.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.456686.log.gz 2024-04-04T16:50:24.851 INFO:teuthology.orchestra.run.smithi072.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.323754.log.gz 2024-04-04T16:50:24.851 INFO:teuthology.orchestra.run.smithi072.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43229.log.gz 2024-04-04T16:50:24.851 INFO:teuthology.orchestra.run.smithi072.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.460732.log.gz 2024-04-04T16:50:24.851 INFO:teuthology.orchestra.run.smithi072.stderr: 90.0% 90.0% -- replaced with /var/log/ceph/ceph-client.admin.316115.log.gz -- replaced with /var/log/ceph/ceph-client.admin.396169.log.gz 2024-04-04T16:50:24.851 INFO:teuthology.orchestra.run.smithi072.stderr: 2024-04-04T16:50:24.851 INFO:teuthology.orchestra.run.smithi072.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.464664.log.gz 2024-04-04T16:50:24.852 INFO:teuthology.orchestra.run.smithi072.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.147605.log.gz 2024-04-04T16:50:24.852 INFO:teuthology.orchestra.run.smithi072.stderr: 78.1% -- replaced with /var/log/ceph/ceph-client.admin.334572.log.gz 2024-04-04T16:50:24.852 INFO:teuthology.orchestra.run.smithi072.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46631.log.gz 2024-04-04T16:50:24.852 INFO:teuthology.orchestra.run.smithi072.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.48004.log.gz 2024-04-04T16:50:24.852 INFO:teuthology.orchestra.run.smithi072.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.396581.log.gz 2024-04-04T16:50:24.852 INFO:teuthology.orchestra.run.smithi072.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.514348.log.gz 2024-04-04T16:50:24.852 INFO:teuthology.orchestra.run.smithi072.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.360318.log.gz 2024-04-04T16:50:24.852 INFO:teuthology.orchestra.run.smithi072.stderr: 94.1% -- replaced with /var/log/ceph/ceph-client.admin.366036.log.gz 2024-04-04T16:50:24.852 INFO:teuthology.orchestra.run.smithi072.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.479950.log.gz 2024-04-04T16:50:24.853 INFO:teuthology.orchestra.run.smithi072.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.50330.log.gz 2024-04-04T16:50:24.853 INFO:teuthology.orchestra.run.smithi072.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.215525.log.gz 2024-04-04T16:50:24.853 INFO:teuthology.orchestra.run.smithi072.stderr: 90.0% 89.5% -- replaced with /var/log/ceph/ceph-client.admin.219083.log.gz -- replaced with /var/log/ceph/ceph-client.admin.49851.log.gz 2024-04-04T16:50:24.853 INFO:teuthology.orchestra.run.smithi072.stderr: 2024-04-04T16:50:24.853 INFO:teuthology.orchestra.run.smithi072.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.408529.log.gz 2024-04-04T16:50:24.853 INFO:teuthology.orchestra.run.smithi072.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.49665.log.gz 2024-04-04T16:50:24.853 INFO:teuthology.orchestra.run.smithi072.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.273676.log.gz 2024-04-04T16:50:24.853 INFO:teuthology.orchestra.run.smithi072.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.264122.log.gz 2024-04-04T16:50:24.853 INFO:teuthology.orchestra.run.smithi072.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.324585.log.gz 2024-04-04T16:50:24.853 INFO:teuthology.orchestra.run.smithi072.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.249276.log.gz 2024-04-04T16:50:24.854 INFO:teuthology.orchestra.run.smithi072.stderr: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.353262.log.gz 2024-04-04T16:50:24.854 INFO:teuthology.orchestra.run.smithi072.stderr: 80.3% -- replaced with /var/log/ceph/ceph-client.admin.538573.log.gz 2024-04-04T16:50:24.854 INFO:teuthology.orchestra.run.smithi072.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.admin.527565.log.gz 2024-04-04T16:50:24.854 INFO:teuthology.orchestra.run.smithi072.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.466648.log.gz 2024-04-04T16:50:24.854 INFO:teuthology.orchestra.run.smithi072.stderr: 84.5% -- replaced with /var/log/ceph/ceph-client.admin.120698.log.gz 2024-04-04T16:50:24.854 INFO:teuthology.orchestra.run.smithi072.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.434469.log.gz 2024-04-04T16:50:24.854 INFO:teuthology.orchestra.run.smithi072.stderr: 77.5% -- replaced with /var/log/ceph/ceph-client.admin.317376.log.gz 2024-04-04T16:50:24.854 INFO:teuthology.orchestra.run.smithi072.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.183721.log.gz 2024-04-04T16:50:24.855 INFO:teuthology.orchestra.run.smithi072.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.46169.log.gz 2024-04-04T16:50:24.855 INFO:teuthology.orchestra.run.smithi072.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.211314.log.gz 2024-04-04T16:50:24.855 INFO:teuthology.orchestra.run.smithi072.stderr: 79.9% -- replaced with /var/log/ceph/ceph-client.admin.191528.log.gz 2024-04-04T16:50:24.855 INFO:teuthology.orchestra.run.smithi072.stderr: 77.8% -- replaced with /var/log/ceph/ceph-client.admin.526639.log.gz 2024-04-04T16:50:24.855 INFO:teuthology.orchestra.run.smithi072.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.397109.log.gz 2024-04-04T16:50:24.855 INFO:teuthology.orchestra.run.smithi072.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.43554.log.gz 2024-04-04T16:50:24.855 INFO:teuthology.orchestra.run.smithi072.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.320366.log.gz 2024-04-04T16:50:24.855 INFO:teuthology.orchestra.run.smithi072.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.119863.log.gz 2024-04-04T16:50:24.856 INFO:teuthology.orchestra.run.smithi072.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.322056.log.gz 2024-04-04T16:50:24.856 INFO:teuthology.orchestra.run.smithi072.stderr: 93.3% -- replaced with /var/log/ceph/ceph-client.admin.232001.log.gz 2024-04-04T16:50:24.856 INFO:teuthology.orchestra.run.smithi072.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.180750.log.gz 2024-04-04T16:50:24.856 INFO:teuthology.orchestra.run.smithi072.stderr: 84.2% 85.3% -- replaced with /var/log/ceph/ceph-client.admin.464179.log.gz -- replaced with /var/log/ceph/ceph-client.admin.315684.log.gz 2024-04-04T16:50:24.856 INFO:teuthology.orchestra.run.smithi072.stderr: 2024-04-04T16:50:24.856 INFO:teuthology.orchestra.run.smithi072.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.322899.log.gz 2024-04-04T16:50:24.856 INFO:teuthology.orchestra.run.smithi072.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.248366.log.gz 2024-04-04T16:50:24.856 INFO:teuthology.orchestra.run.smithi072.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.152885.log.gz 2024-04-04T16:50:24.856 INFO:teuthology.orchestra.run.smithi072.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.322482.log.gz 2024-04-04T16:50:24.857 INFO:teuthology.orchestra.run.smithi072.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.525366.log.gz 2024-04-04T16:50:24.857 INFO:teuthology.orchestra.run.smithi072.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.532394.log.gz 2024-04-04T16:50:24.857 INFO:teuthology.orchestra.run.smithi072.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.341848.log.gz 2024-04-04T16:50:24.857 INFO:teuthology.orchestra.run.smithi072.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.50288.log.gz 2024-04-04T16:50:24.857 INFO:teuthology.orchestra.run.smithi072.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42757.log.gz 2024-04-04T16:50:24.857 INFO:teuthology.orchestra.run.smithi072.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.144049.log.gz 2024-04-04T16:50:24.857 INFO:teuthology.orchestra.run.smithi072.stderr: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.420866.log.gz 2024-04-04T16:50:24.857 INFO:teuthology.orchestra.run.smithi072.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.144466.log.gz 2024-04-04T16:50:24.858 INFO:teuthology.orchestra.run.smithi072.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.400260.log.gz 2024-04-04T16:50:24.858 INFO:teuthology.orchestra.run.smithi072.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.323334.log.gz 2024-04-04T16:50:24.858 INFO:teuthology.orchestra.run.smithi072.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.317797.log.gz 2024-04-04T16:50:24.858 INFO:teuthology.orchestra.run.smithi072.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.459857.log.gz 2024-04-04T16:50:24.858 INFO:teuthology.orchestra.run.smithi072.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.512241.log.gz 2024-04-04T16:50:24.858 INFO:teuthology.orchestra.run.smithi072.stderr: 78.4% -- replaced with /var/log/ceph/ceph-client.admin.146194.log.gz 2024-04-04T16:50:24.858 INFO:teuthology.orchestra.run.smithi072.stderr: 84.4% -- replaced with /var/log/ceph/ceph-client.admin.115427.log.gz 2024-04-04T16:50:24.858 INFO:teuthology.orchestra.run.smithi072.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.364554.log.gz 2024-04-04T16:50:24.859 INFO:teuthology.orchestra.run.smithi072.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.157730.log.gz 2024-04-04T16:50:24.859 INFO:teuthology.orchestra.run.smithi072.stderr: 83.3% -- replaced with /var/log/ceph/ceph-client.admin.202961.log.gz 2024-04-04T16:50:24.859 INFO:teuthology.orchestra.run.smithi072.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.47594.log.gz 2024-04-04T16:50:24.859 INFO:teuthology.orchestra.run.smithi072.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.387971.log.gz 2024-04-04T16:50:24.859 INFO:teuthology.orchestra.run.smithi072.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.316950.log.gz 2024-04-04T16:50:24.859 INFO:teuthology.orchestra.run.smithi072.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.330791.log.gz 2024-04-04T16:50:24.859 INFO:teuthology.orchestra.run.smithi072.stderr: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.111094.log.gz 2024-04-04T16:50:24.859 INFO:teuthology.orchestra.run.smithi072.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.215951.log.gz 2024-04-04T16:50:24.859 INFO:teuthology.orchestra.run.smithi072.stderr: 92.9% -- replaced with /var/log/ceph/ceph-client.admin.207920.log.gz 83.9% 2024-04-04T16:50:24.860 INFO:teuthology.orchestra.run.smithi072.stderr: -- replaced with /var/log/ceph/ceph-client.admin.490403.log.gz 2024-04-04T16:50:24.860 INFO:teuthology.orchestra.run.smithi072.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.211735.log.gz 2024-04-04T16:50:24.860 INFO:teuthology.orchestra.run.smithi072.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.334581.log.gz 2024-04-04T16:50:24.860 INFO:teuthology.orchestra.run.smithi072.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.511820.log.gz 2024-04-04T16:50:24.860 INFO:teuthology.orchestra.run.smithi072.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.250125.log.gz 2024-04-04T16:50:24.860 INFO:teuthology.orchestra.run.smithi072.stderr: 92.9% -- replaced with /var/log/ceph/ceph-client.admin.131096.log.gz 2024-04-04T16:50:24.860 INFO:teuthology.orchestra.run.smithi072.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.134982.log.gz 2024-04-04T16:50:24.860 INFO:teuthology.orchestra.run.smithi072.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.144894.log.gz 2024-04-04T16:50:24.860 INFO:teuthology.orchestra.run.smithi072.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.451968.log.gz 2024-04-04T16:50:24.861 INFO:teuthology.orchestra.run.smithi072.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.491766.log.gz 2024-04-04T16:50:24.861 INFO:teuthology.orchestra.run.smithi072.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.393303.log.gz 2024-04-04T16:50:24.861 INFO:teuthology.orchestra.run.smithi072.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.318645.log.gz 2024-04-04T16:50:24.861 INFO:teuthology.orchestra.run.smithi072.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45932.log.gz 2024-04-04T16:50:24.861 INFO:teuthology.orchestra.run.smithi072.stderr: 83.8% -- replaced with /var/log/ceph/ceph-client.admin.226083.log.gz 2024-04-04T16:50:24.861 INFO:teuthology.orchestra.run.smithi072.stderr: 77.7% 89.3% -- replaced with /var/log/ceph/ceph-client.admin.534132.log.gz 2024-04-04T16:50:24.861 INFO:teuthology.orchestra.run.smithi072.stderr: -- replaced with /var/log/ceph/ceph-client.admin.48854.log.gz 2024-04-04T16:50:24.861 INFO:teuthology.orchestra.run.smithi072.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.390299.log.gz 2024-04-04T16:50:24.862 INFO:teuthology.orchestra.run.smithi072.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.509287.log.gz 2024-04-04T16:50:24.862 INFO:teuthology.orchestra.run.smithi072.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.264113.log.gz 2024-04-04T16:50:24.862 INFO:teuthology.orchestra.run.smithi072.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.319487.log.gz 2024-04-04T16:50:24.862 INFO:teuthology.orchestra.run.smithi072.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.258600.log.gz 2024-04-04T16:50:24.862 INFO:teuthology.orchestra.run.smithi072.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.238558.log.gz 2024-04-04T16:50:24.862 INFO:teuthology.orchestra.run.smithi072.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.225671.log.gz 2024-04-04T16:50:24.862 INFO:teuthology.orchestra.run.smithi072.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.269401.log.gz 2024-04-04T16:50:24.862 INFO:teuthology.orchestra.run.smithi072.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.470832.log.gz 2024-04-04T16:50:24.862 INFO:teuthology.orchestra.run.smithi072.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.430342.log.gz 2024-04-04T16:50:24.863 INFO:teuthology.orchestra.run.smithi072.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.463765.log.gz 2024-04-04T16:50:24.863 INFO:teuthology.orchestra.run.smithi072.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.546630.log.gz 2024-04-04T16:50:24.863 INFO:teuthology.orchestra.run.smithi072.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.238980.log.gz 2024-04-04T16:50:24.863 INFO:teuthology.orchestra.run.smithi072.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.411482.log.gz 2024-04-04T16:50:24.863 INFO:teuthology.orchestra.run.smithi072.stderr: 91.8% -- replaced with /var/log/ceph/ceph-client.admin.280968.log.gz 2024-04-04T16:50:24.863 INFO:teuthology.orchestra.run.smithi072.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.133286.log.gz 92.8% 2024-04-04T16:50:24.863 INFO:teuthology.orchestra.run.smithi072.stderr: -- replaced with /var/log/ceph/ceph-client.admin.542618.log.gz 2024-04-04T16:50:24.863 INFO:teuthology.orchestra.run.smithi072.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.47306.log.gz 2024-04-04T16:50:24.864 INFO:teuthology.orchestra.run.smithi072.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.241104.log.gz 2024-04-04T16:50:24.864 INFO:teuthology.orchestra.run.smithi072.stderr: 83.4% -- replaced with /var/log/ceph/ceph-client.admin.514339.log.gz 2024-04-04T16:50:24.864 INFO:teuthology.orchestra.run.smithi072.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.342701.log.gz 2024-04-04T16:50:24.864 INFO:teuthology.orchestra.run.smithi072.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.44665.log.gz 2024-04-04T16:50:24.864 INFO:teuthology.orchestra.run.smithi072.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.534141.log.gz 2024-04-04T16:50:24.864 INFO:teuthology.orchestra.run.smithi072.stderr: 80.8% 77.3% -- replaced with /var/log/ceph/ceph-client.admin.118956.log.gz 2024-04-04T16:50:24.864 INFO:teuthology.orchestra.run.smithi072.stderr: 83.8% -- replaced with /var/log/ceph/ceph-client.admin.513075.log.gz 2024-04-04T16:50:24.864 INFO:teuthology.orchestra.run.smithi072.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.339739.log.gz 2024-04-04T16:50:24.865 INFO:teuthology.orchestra.run.smithi072.stderr: -- replaced with /var/log/ceph/ceph-client.admin.114954.log.gz 2024-04-04T16:50:24.865 INFO:teuthology.orchestra.run.smithi072.stderr: 91.9% -- replaced with /var/log/ceph/ceph-client.admin.431630.log.gz 2024-04-04T16:50:24.865 INFO:teuthology.orchestra.run.smithi072.stderr: 90.0% 92.0% -- replaced with /var/log/ceph/ceph-client.admin.126380.log.gz 2024-04-04T16:50:24.865 INFO:teuthology.orchestra.run.smithi072.stderr: -- replaced with /var/log/ceph/ceph-client.admin.410638.log.gz 2024-04-04T16:50:24.865 INFO:teuthology.orchestra.run.smithi072.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.458085.log.gz 2024-04-04T16:50:24.865 INFO:teuthology.orchestra.run.smithi072.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.337544.log.gz 2024-04-04T16:50:24.865 INFO:teuthology.orchestra.run.smithi072.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.43852.log.gz 2024-04-04T16:50:24.865 INFO:teuthology.orchestra.run.smithi072.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.487650.log.gz 2024-04-04T16:50:24.865 INFO:teuthology.orchestra.run.smithi072.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.549469.log.gz 2024-04-04T16:50:24.866 INFO:teuthology.orchestra.run.smithi072.stderr: 90.1% 80.6% -- replaced with /var/log/ceph/ceph-client.admin.225662.log.gz 2024-04-04T16:50:24.866 INFO:teuthology.orchestra.run.smithi072.stderr: -- replaced with /var/log/ceph/ceph-client.admin.476853.log.gz 2024-04-04T16:50:24.866 INFO:teuthology.orchestra.run.smithi072.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.511389.log.gz 2024-04-04T16:50:24.866 INFO:teuthology.orchestra.run.smithi072.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.470347.log.gz 2024-04-04T16:50:24.866 INFO:teuthology.orchestra.run.smithi072.stderr: 79.5% -- replaced with /var/log/ceph/ceph-client.admin.521258.log.gz 2024-04-04T16:50:24.866 INFO:teuthology.orchestra.run.smithi072.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.42488.log.gz 2024-04-04T16:50:24.867 INFO:teuthology.orchestra.run.smithi072.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.199819.log.gz 2024-04-04T16:50:24.867 INFO:teuthology.orchestra.run.smithi072.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.253813.log.gz 2024-04-04T16:50:24.867 INFO:teuthology.orchestra.run.smithi072.stderr: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.488096.log.gz 2024-04-04T16:50:24.867 INFO:teuthology.orchestra.run.smithi072.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.447935.log.gz 2024-04-04T16:50:24.867 INFO:teuthology.orchestra.run.smithi072.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.48560.log.gz 2024-04-04T16:50:24.867 INFO:teuthology.orchestra.run.smithi072.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.519476.log.gz 2024-04-04T16:50:24.867 INFO:teuthology.orchestra.run.smithi072.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.416609.log.gz 2024-04-04T16:50:24.868 INFO:teuthology.orchestra.run.smithi072.stderr: 78.5% -- replaced with /var/log/ceph/ceph-client.admin.213412.log.gz 2024-04-04T16:50:24.868 INFO:teuthology.orchestra.run.smithi072.stderr: 79.6% -- replaced with /var/log/ceph/ceph-client.admin.519027.log.gz 2024-04-04T16:50:24.868 INFO:teuthology.orchestra.run.smithi072.stderr: 84.3% -- replaced with /var/log/ceph/ceph-client.admin.386661.log.gz 2024-04-04T16:50:24.868 INFO:teuthology.orchestra.run.smithi072.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.548923.log.gz 2024-04-04T16:50:24.868 INFO:teuthology.orchestra.run.smithi072.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.249703.log.gz 2024-04-04T16:50:24.868 INFO:teuthology.orchestra.run.smithi072.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.500824.log.gz 2024-04-04T16:50:24.868 INFO:teuthology.orchestra.run.smithi072.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.433818.log.gz 2024-04-04T16:50:24.868 INFO:teuthology.orchestra.run.smithi072.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.42883.log.gz 2024-04-04T16:50:24.869 INFO:teuthology.orchestra.run.smithi072.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.354161.log.gz 2024-04-04T16:50:24.869 INFO:teuthology.orchestra.run.smithi072.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.260717.log.gz 2024-04-04T16:50:24.869 INFO:teuthology.orchestra.run.smithi072.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.467060.log.gz 2024-04-04T16:50:24.869 INFO:teuthology.orchestra.run.smithi072.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.420454.log.gz 2024-04-04T16:50:24.869 INFO:teuthology.orchestra.run.smithi072.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.43564.log.gz 2024-04-04T16:50:24.869 INFO:teuthology.orchestra.run.smithi072.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.435741.log.gz 2024-04-04T16:50:24.869 INFO:teuthology.orchestra.run.smithi072.stderr: 77.7% -- replaced with /var/log/ceph/ceph-client.admin.508615.log.gz 2024-04-04T16:50:24.869 INFO:teuthology.orchestra.run.smithi072.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.401367.log.gz 2024-04-04T16:50:24.869 INFO:teuthology.orchestra.run.smithi072.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.165100.log.gz 2024-04-04T16:50:24.869 INFO:teuthology.orchestra.run.smithi072.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.548639.log.gz 2024-04-04T16:50:24.870 INFO:teuthology.orchestra.run.smithi072.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.226513.log.gz 2024-04-04T16:50:24.870 INFO:teuthology.orchestra.run.smithi072.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.42669.log.gz 2024-04-04T16:50:24.870 INFO:teuthology.orchestra.run.smithi072.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.481642.log.gz 2024-04-04T16:50:24.870 INFO:teuthology.orchestra.run.smithi072.stderr: 78.6% -- replaced with /var/log/ceph/ceph-client.admin.451051.log.gz 2024-04-04T16:50:24.870 INFO:teuthology.orchestra.run.smithi072.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.263260.log.gz 2024-04-04T16:50:24.870 INFO:teuthology.orchestra.run.smithi072.stderr: 83.6% 89.8% -- replaced with /var/log/ceph/ceph-client.admin.138356.log.gz 2024-04-04T16:50:24.870 INFO:teuthology.orchestra.run.smithi072.stderr: 84.7% -- replaced with /var/log/ceph/ceph-client.admin.128976.log.gz 2024-04-04T16:50:24.870 INFO:teuthology.orchestra.run.smithi072.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.285011.log.gz 2024-04-04T16:50:24.871 INFO:teuthology.orchestra.run.smithi072.stderr: -- replaced with /var/log/ceph/ceph-client.admin.363537.log.gz 2024-04-04T16:50:24.871 INFO:teuthology.orchestra.run.smithi072.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.137933.log.gz 2024-04-04T16:50:24.871 INFO:teuthology.orchestra.run.smithi072.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.234675.log.gz 2024-04-04T16:50:24.871 INFO:teuthology.orchestra.run.smithi072.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.226935.log.gz 2024-04-04T16:50:24.871 INFO:teuthology.orchestra.run.smithi072.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.221186.log.gz 2024-04-04T16:50:24.871 INFO:teuthology.orchestra.run.smithi072.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.283307.log.gz 2024-04-04T16:50:24.871 INFO:teuthology.orchestra.run.smithi072.stderr: 84.4% -- replaced with /var/log/ceph/ceph-client.admin.199810.log.gz 2024-04-04T16:50:24.871 INFO:teuthology.orchestra.run.smithi072.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.471263.log.gz 2024-04-04T16:50:24.872 INFO:teuthology.orchestra.run.smithi072.stderr: 80.3% -- replaced with /var/log/ceph/ceph-client.admin.335413.log.gz 2024-04-04T16:50:24.872 INFO:teuthology.orchestra.run.smithi072.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.336264.log.gz 2024-04-04T16:50:24.872 INFO:teuthology.orchestra.run.smithi072.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.510973.log.gz 2024-04-04T16:50:24.943 INFO:teuthology.orchestra.run.smithi072.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.481211.log.gz 2024-04-04T16:50:24.954 INFO:teuthology.orchestra.run.smithi072.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44563.log.gz 2024-04-04T16:50:24.960 INFO:teuthology.orchestra.run.smithi072.stderr: 91.9% -- replaced with /var/log/ceph/ceph-client.admin.153751.log.gz 2024-04-04T16:50:24.970 INFO:teuthology.orchestra.run.smithi072.stderr: 84.5% -- replaced with /var/log/ceph/ceph-client.admin.140042.log.gz 2024-04-04T16:50:24.973 INFO:teuthology.orchestra.run.smithi072.stderr: 78.5% -- replaced with /var/log/ceph/ceph-client.admin.134973.log.gz 2024-04-04T16:50:24.990 INFO:teuthology.orchestra.run.smithi072.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.133277.log.gz 2024-04-04T16:50:24.991 INFO:teuthology.orchestra.run.smithi072.stderr: 93.3% -- replaced with /var/log/ceph/ceph-client.admin.198921.log.gz 2024-04-04T16:50:24.993 INFO:teuthology.orchestra.run.smithi072.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.255078.log.gz 2024-04-04T16:50:25.005 INFO:teuthology.orchestra.run.smithi072.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.338876.log.gz 2024-04-04T16:50:25.041 INFO:teuthology.orchestra.run.smithi072.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.335834.log.gz 2024-04-04T16:50:25.094 INFO:teuthology.orchestra.run.smithi072.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.343135.log.gz 2024-04-04T16:50:25.138 INFO:teuthology.orchestra.run.smithi072.stderr: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.477697.log.gz 2024-04-04T16:50:25.140 INFO:teuthology.orchestra.run.smithi072.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.251387.log.gz 2024-04-04T16:50:25.174 INFO:teuthology.orchestra.run.smithi072.stderr: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.258169.log.gz 2024-04-04T16:50:25.185 INFO:teuthology.orchestra.run.smithi072.stderr: 84.3% -- replaced with /var/log/ceph/ceph-client.admin.356282.log.gz 2024-04-04T16:50:25.190 INFO:teuthology.orchestra.run.smithi072.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.352393.log.gz 2024-04-04T16:50:25.235 INFO:teuthology.orchestra.run.smithi072.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.485963.log.gz 2024-04-04T16:50:25.315 INFO:teuthology.orchestra.run.smithi072.stderr: 84.8% -- replaced with /var/log/ceph/ceph-client.admin.528056.log.gz 2024-04-04T16:50:25.323 INFO:teuthology.orchestra.run.smithi072.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.281415.log.gz 2024-04-04T16:50:25.329 INFO:teuthology.orchestra.run.smithi072.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.541237.log.gz 2024-04-04T16:50:25.341 INFO:teuthology.orchestra.run.smithi072.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.50498.log.gz 2024-04-04T16:50:25.350 INFO:teuthology.orchestra.run.smithi072.stderr: 93.2% -- replaced with /var/log/ceph/ceph-client.admin.202520.log.gz 2024-04-04T16:50:25.351 INFO:teuthology.orchestra.run.smithi072.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.209612.log.gz 2024-04-04T16:50:25.358 INFO:teuthology.orchestra.run.smithi072.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.235115.log.gz 2024-04-04T16:50:25.363 INFO:teuthology.orchestra.run.smithi072.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.486381.log.gz 2024-04-04T16:50:25.366 INFO:teuthology.orchestra.run.smithi072.stderr: 93.5% -- replaced with /var/log/ceph/ceph-client.admin.328140.log.gz 2024-04-04T16:50:25.370 INFO:teuthology.orchestra.run.smithi072.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.540793.log.gz 2024-04-04T16:50:25.377 INFO:teuthology.orchestra.run.smithi072.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.434886.log.gz 2024-04-04T16:50:25.392 INFO:teuthology.orchestra.run.smithi072.stderr: 92.6% -- replaced with /var/log/ceph/ceph-client.admin.152894.log.gz 2024-04-04T16:50:25.443 INFO:teuthology.orchestra.run.smithi072.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.155475.log.gz 2024-04-04T16:50:25.448 INFO:teuthology.orchestra.run.smithi072.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.336685.log.gz 2024-04-04T16:50:25.463 INFO:teuthology.orchestra.run.smithi072.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.458533.log.gz 2024-04-04T16:50:25.478 INFO:teuthology.orchestra.run.smithi072.stderr: 94.0% -- replaced with /var/log/ceph/ceph-client.admin.539470.log.gz 2024-04-04T16:50:25.548 INFO:teuthology.orchestra.run.smithi072.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.539026.log.gz 2024-04-04T16:50:25.569 INFO:teuthology.orchestra.run.smithi072.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.156322.log.gz 2024-04-04T16:50:25.616 INFO:teuthology.orchestra.run.smithi072.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.539905.log.gz 2024-04-04T16:50:25.622 INFO:teuthology.orchestra.run.smithi072.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.48476.log.gz 2024-04-04T16:50:25.634 INFO:teuthology.orchestra.run.smithi072.stderr: 93.9% -- replaced with /var/log/ceph/ceph-client.admin.207466.log.gz 2024-04-04T16:50:25.635 INFO:teuthology.orchestra.run.smithi072.stderr: 93.0% -- replaced with /var/log/ceph/ceph-client.admin.453283.log.gz 2024-04-04T16:50:25.647 INFO:teuthology.orchestra.run.smithi072.stderr: 93.0% -- replaced with /var/log/ceph/ceph-client.admin.190097.log.gz 2024-04-04T16:50:25.655 INFO:teuthology.orchestra.run.smithi072.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.540349.log.gz 2024-04-04T16:50:25.658 INFO:teuthology.orchestra.run.smithi072.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.537250.log.gz 2024-04-04T16:50:25.702 INFO:teuthology.orchestra.run.smithi072.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.409366.log.gz 2024-04-04T16:50:25.714 INFO:teuthology.orchestra.run.smithi072.stderr: 92.7% -- replaced with /var/log/ceph/ceph-client.admin.494304.log.gz 2024-04-04T16:50:25.716 INFO:teuthology.orchestra.run.smithi072.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.490412.log.gz 2024-04-04T16:50:25.722 INFO:teuthology.orchestra.run.smithi072.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.541681.log.gz 2024-04-04T16:50:25.726 INFO:teuthology.orchestra.run.smithi072.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.537694.log.gz 2024-04-04T16:50:25.792 INFO:teuthology.orchestra.run.smithi072.stderr: 92.5% -- replaced with /var/log/ceph/ceph-client.admin.337966.log.gz 2024-04-04T16:50:25.837 INFO:teuthology.orchestra.run.smithi072.stderr: 78.4% -- replaced with /var/log/ceph/ceph-client.admin.408068.log.gz 2024-04-04T16:50:25.838 INFO:teuthology.orchestra.run.smithi072.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.390719.log.gz 2024-04-04T16:50:25.946 INFO:teuthology.orchestra.run.smithi072.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.532385.log.gz 2024-04-04T16:50:25.954 INFO:teuthology.orchestra.run.smithi072.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.435321.log.gz 2024-04-04T16:50:25.955 INFO:teuthology.orchestra.run.smithi072.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.156331.log.gz 2024-04-04T16:50:25.970 INFO:teuthology.orchestra.run.smithi072.stderr: 83.2% -- replaced with /var/log/ceph/ceph-client.admin.240672.log.gz 2024-04-04T16:50:25.975 INFO:teuthology.orchestra.run.smithi072.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.546639.log.gz 2024-04-04T16:50:25.984 INFO:teuthology.orchestra.run.smithi072.stderr: 93.3% -- replaced with /var/log/ceph/ceph-client.admin.186983.log.gz 2024-04-04T16:50:25.990 INFO:teuthology.orchestra.run.smithi072.stderr: 91.9% -- replaced with /var/log/ceph/ceph-client.admin.481220.log.gz 2024-04-04T16:50:25.990 INFO:teuthology.orchestra.run.smithi072.stderr: 93.4% -- replaced with /var/log/ceph/ceph-client.admin.217308.log.gz 2024-04-04T16:50:26.008 INFO:teuthology.orchestra.run.smithi072.stderr: 94.1% -- replaced with /var/log/ceph/ceph-client.admin.353271.log.gz 2024-04-04T16:50:26.012 INFO:teuthology.orchestra.run.smithi072.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.259865.log.gz 2024-04-04T16:50:26.047 INFO:teuthology.orchestra.run.smithi072.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.353723.log.gz 2024-04-04T16:50:26.070 INFO:teuthology.orchestra.run.smithi072.stderr: 84.0% -- replaced with /var/log/ceph/ceph-client.admin.362540.log.gz 2024-04-04T16:50:26.090 INFO:teuthology.orchestra.run.smithi072.stderr: 93.3% -- replaced with /var/log/ceph/ceph-client.admin.203869.log.gz 2024-04-04T16:50:26.093 INFO:teuthology.orchestra.run.smithi072.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.349326.log.gz 2024-04-04T16:50:26.155 INFO:teuthology.orchestra.run.smithi072.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.256470.log.gz 2024-04-04T16:50:26.233 INFO:teuthology.orchestra.run.smithi072.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.324594.log.gz 2024-04-04T16:50:26.256 INFO:teuthology.orchestra.run.smithi072.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.347379.log.gz 2024-04-04T16:50:26.268 INFO:teuthology.orchestra.run.smithi072.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.468554.log.gz 2024-04-04T16:50:26.270 INFO:teuthology.orchestra.run.smithi072.stderr: 93.4% -- replaced with /var/log/ceph/ceph-client.admin.216859.log.gz 2024-04-04T16:50:26.279 INFO:teuthology.orchestra.run.smithi072.stderr: 93.0% -- replaced with /var/log/ceph/ceph-client.admin.153326.log.gz 2024-04-04T16:50:26.288 INFO:teuthology.orchestra.run.smithi072.stderr: 94.0% -- replaced with /var/log/ceph/ceph-client.admin.217757.log.gz 2024-04-04T16:50:26.291 INFO:teuthology.orchestra.run.smithi072.stderr: 93.1% -- replaced with /var/log/ceph/ceph-client.admin.184179.log.gz 2024-04-04T16:50:26.296 INFO:teuthology.orchestra.run.smithi072.stderr: 91.8% -- replaced with /var/log/ceph/ceph-client.admin.463331.log.gz 2024-04-04T16:50:26.300 INFO:teuthology.orchestra.run.smithi072.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.241982.log.gz 2024-04-04T16:50:26.303 INFO:teuthology.orchestra.run.smithi072.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.459419.log.gz 2024-04-04T16:50:26.314 INFO:teuthology.orchestra.run.smithi072.stderr: 92.5% -- replaced with /var/log/ceph/ceph-client.admin.432097.log.gz 2024-04-04T16:50:26.316 INFO:teuthology.orchestra.run.smithi072.stderr: 93.3% -- replaced with /var/log/ceph/ceph-client.admin.204769.log.gz 2024-04-04T16:50:26.333 INFO:teuthology.orchestra.run.smithi072.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.190586.log.gz 2024-04-04T16:50:26.337 INFO:teuthology.orchestra.run.smithi072.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.118527.log.gz 2024-04-04T16:50:26.440 INFO:teuthology.orchestra.run.smithi072.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.260296.log.gz 2024-04-04T16:50:26.450 INFO:teuthology.orchestra.run.smithi072.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.admin.242853.log.gz 2024-04-04T16:50:26.476 INFO:teuthology.orchestra.run.smithi072.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.332478.log.gz 2024-04-04T16:50:26.504 INFO:teuthology.orchestra.run.smithi072.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.483823.log.gz 2024-04-04T16:50:26.524 INFO:teuthology.orchestra.run.smithi072.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.235983.log.gz 2024-04-04T16:50:26.649 INFO:teuthology.orchestra.run.smithi072.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.48980.log.gz 2024-04-04T16:50:26.652 INFO:teuthology.orchestra.run.smithi072.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.126802.log.gz 2024-04-04T16:50:26.664 INFO:teuthology.orchestra.run.smithi072.stderr: 93.5% -- replaced with /var/log/ceph/ceph-client.admin.360327.log.gz 2024-04-04T16:50:26.665 INFO:teuthology.orchestra.run.smithi072.stderr: 91.9% -- replaced with /var/log/ceph/ceph-client.admin.197144.log.gz 2024-04-04T16:50:26.678 INFO:teuthology.orchestra.run.smithi072.stderr: 94.6% -- replaced with /var/log/ceph/ceph-client.admin.389349.log.gz 2024-04-04T16:50:26.686 INFO:teuthology.orchestra.run.smithi072.stderr: 93.0% -- replaced with /var/log/ceph/ceph-client.admin.452394.log.gz 2024-04-04T16:50:26.702 INFO:teuthology.orchestra.run.smithi072.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.181597.log.gz 2024-04-04T16:50:26.705 INFO:teuthology.orchestra.run.smithi072.stderr: 79.8% -- replaced with /var/log/ceph/ceph-client.admin.218201.log.gz 2024-04-04T16:50:26.714 INFO:teuthology.orchestra.run.smithi072.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.261982.log.gz 2024-04-04T16:50:26.936 INFO:teuthology.orchestra.run.smithi072.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.537241.log.gz 2024-04-04T16:50:26.997 INFO:teuthology.orchestra.run.smithi072.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.536806.log.gz 2024-04-04T16:50:27.004 INFO:teuthology.orchestra.run.smithi072.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46295.log.gz 2024-04-04T16:50:27.007 INFO:teuthology.orchestra.run.smithi072.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.42362.log.gz 2024-04-04T16:50:27.012 INFO:teuthology.orchestra.run.smithi072.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.517302.log.gz 2024-04-04T16:50:27.017 INFO:teuthology.orchestra.run.smithi072.stderr: 94.5% -- replaced with /var/log/ceph/ceph-client.admin.164421.log.gz 2024-04-04T16:50:27.025 INFO:teuthology.orchestra.run.smithi072.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.462004.log.gz 2024-04-04T16:50:27.126 INFO:teuthology.orchestra.run.smithi072.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.341004.log.gz 2024-04-04T16:50:27.214 INFO:teuthology.orchestra.run.smithi072.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.231072.log.gz 2024-04-04T16:50:27.229 INFO:teuthology.orchestra.run.smithi072.stderr: 91.9% -- replaced with /var/log/ceph/ceph-client.admin.230170.log.gz 2024-04-04T16:50:27.233 INFO:teuthology.orchestra.run.smithi072.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.399389.log.gz 2024-04-04T16:50:27.282 INFO:teuthology.orchestra.run.smithi072.stderr: 95.5% -- replaced with /var/log/ceph/ceph-client.0.50926.log.gz 2024-04-04T16:50:27.652 INFO:teuthology.orchestra.run.smithi072.stderr: 83.7% -- replaced with /var/log/ceph/ceph-client.admin.523064.log.gz 2024-04-04T16:50:27.720 INFO:teuthology.orchestra.run.smithi072.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.535031.log.gz 2024-04-04T16:50:27.721 INFO:teuthology.orchestra.run.smithi072.stderr: 93.3% -- replaced with /var/log/ceph/ceph-client.admin.488105.log.gz 2024-04-04T16:50:27.953 INFO:teuthology.orchestra.run.smithi072.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.admin.281907.log.gz 2024-04-04T16:50:28.144 INFO:teuthology.orchestra.run.smithi072.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.227356.log.gz 2024-04-04T16:50:28.166 INFO:teuthology.orchestra.run.smithi072.stderr: 94.3% -- replaced with /var/log/ceph/ceph-client.admin.164115.log.gz 2024-04-04T16:50:28.225 INFO:teuthology.orchestra.run.smithi072.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.261991.log.gz 2024-04-04T16:50:28.537 INFO:teuthology.orchestra.run.smithi072.stderr: 95.1% -- replaced with /var/log/ceph/ceph-client.admin.434113.log.gz 2024-04-04T16:50:28.551 INFO:teuthology.orchestra.run.smithi072.stderr: 92.0% -- replaced with /var/log/ceph/ceph-client.admin.274529.log.gz 2024-04-04T16:50:28.621 INFO:teuthology.orchestra.run.smithi072.stderr: 92.9% -- replaced with /var/log/ceph/ceph-client.admin.231523.log.gz 2024-04-04T16:50:28.634 INFO:teuthology.orchestra.run.smithi072.stderr: 92.6% -- replaced with /var/log/ceph/ceph-client.admin.543088.log.gz 2024-04-04T16:50:28.634 INFO:teuthology.orchestra.run.smithi072.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.160902.log.gz 2024-04-04T16:50:28.637 INFO:teuthology.orchestra.run.smithi072.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.461574.log.gz 2024-04-04T16:50:28.647 INFO:teuthology.orchestra.run.smithi072.stderr: 93.4% -- replaced with /var/log/ceph/ceph-client.admin.201619.log.gz 2024-04-04T16:50:28.652 INFO:teuthology.orchestra.run.smithi072.stderr: 78.3% -- replaced with /var/log/ceph/ceph-client.admin.129397.log.gz 2024-04-04T16:50:28.769 INFO:teuthology.orchestra.run.smithi072.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.265008.log.gz 2024-04-04T16:50:29.404 INFO:teuthology.orchestra.run.smithi072.stderr: 91.8% 92.2% -- replaced with /var/log/ceph/ceph-client.admin.538582.log.gz -- replaced with /var/log/ceph/ceph-client.admin.414042.log.gz 2024-04-04T16:50:29.404 INFO:teuthology.orchestra.run.smithi072.stderr: 2024-04-04T16:50:29.405 INFO:teuthology.orchestra.run.smithi072.stderr: 93.1% 93.4% -- replaced with /var/log/ceph/ceph-client.admin.394583.log.gz 89.9% 2024-04-04T16:50:29.405 INFO:teuthology.orchestra.run.smithi072.stderr: -- replaced with /var/log/ceph/ceph-client.admin.333740.log.gz 2024-04-04T16:50:29.406 INFO:teuthology.orchestra.run.smithi072.stderr: 94.0% -- replaced with /var/log/ceph/ceph-client.admin.222463.log.gz 2024-04-04T16:50:29.406 INFO:teuthology.orchestra.run.smithi072.stderr: 90.0% 90.0% -- replaced with /var/log/ceph/ceph-client.admin.332055.log.gz -- replaced with /var/log/ceph/ceph-client.admin.334161.log.gz 2024-04-04T16:50:29.407 INFO:teuthology.orchestra.run.smithi072.stderr: 2024-04-04T16:50:29.407 INFO:teuthology.orchestra.run.smithi072.stderr: -- replaced with /var/log/ceph/ceph-client.admin.521267.log.gz 2024-04-04T16:50:29.440 INFO:teuthology.orchestra.run.smithi072.stderr: 93.8% -- replaced with /var/log/ceph/ceph-client.admin.419155.log.gz 2024-04-04T16:50:29.558 INFO:teuthology.orchestra.run.smithi072.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.182453.log.gz 2024-04-04T16:50:29.609 INFO:teuthology.orchestra.run.smithi072.stderr: 93.4% -- replaced with /var/log/ceph/ceph-client.admin.401425.log.gz 2024-04-04T16:50:29.934 INFO:teuthology.orchestra.run.smithi072.stderr: 91.9% -- replaced with /var/log/ceph/ceph-client.admin.161879.log.gz 2024-04-04T16:50:29.967 INFO:teuthology.orchestra.run.smithi072.stderr: 93.3% -- replaced with /var/log/ceph/ceph-client.admin.215960.log.gz 2024-04-04T16:50:29.991 INFO:teuthology.orchestra.run.smithi072.stderr: 95.3% -- replaced with /var/log/ceph/ceph-client.admin.110074.log.gz 2024-04-04T16:50:29.996 INFO:teuthology.orchestra.run.smithi072.stderr: 92.9% -- replaced with /var/log/ceph/ceph-client.admin.448777.log.gz 2024-04-04T16:50:30.050 INFO:teuthology.orchestra.run.smithi072.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.280531.log.gz 2024-04-04T16:50:30.701 INFO:teuthology.orchestra.run.smithi072.stderr: 93.3% -- replaced with /var/log/ceph/ceph-client.admin.365060.log.gz 2024-04-04T16:50:30.755 INFO:teuthology.orchestra.run.smithi072.stderr: 93.1% -- replaced with /var/log/ceph/ceph-client.admin.162332.log.gz 2024-04-04T16:50:30.776 INFO:teuthology.orchestra.run.smithi072.stderr: 93.3% -- replaced with /var/log/ceph/ceph-client.admin.401522.log.gz 2024-04-04T16:50:30.933 INFO:teuthology.orchestra.run.smithi072.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.50158.log.gz 2024-04-04T16:50:30.936 INFO:teuthology.orchestra.run.smithi072.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.524900.log.gz 2024-04-04T16:50:30.963 INFO:teuthology.orchestra.run.smithi072.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.252932.log.gz 2024-04-04T16:50:30.975 INFO:teuthology.orchestra.run.smithi072.stderr: 93.3% -- replaced with /var/log/ceph/ceph-client.admin.472181.log.gz 2024-04-04T16:50:30.980 INFO:teuthology.orchestra.run.smithi072.stderr: 91.9% -- replaced with /var/log/ceph/ceph-client.admin.357553.log.gz 2024-04-04T16:50:31.268 INFO:teuthology.orchestra.run.smithi072.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.534586.log.gz 2024-04-04T16:50:31.277 INFO:teuthology.orchestra.run.smithi072.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.210445.log.gz 2024-04-04T16:50:31.301 INFO:teuthology.orchestra.run.smithi072.stderr: 95.8% -- replaced with /var/log/ceph/ceph-client.admin.224777.log.gz 2024-04-04T16:50:31.308 INFO:teuthology.orchestra.run.smithi072.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.143627.log.gz 2024-04-04T16:50:31.390 INFO:teuthology.orchestra.run.smithi072.stderr: 93.4% -- replaced with /var/log/ceph/ceph-client.admin.401473.log.gz 2024-04-04T16:50:31.783 INFO:teuthology.orchestra.run.smithi072.stderr: 94.2% -- replaced with /var/log/ceph/ceph-client.admin.532814.log.gz 2024-04-04T16:50:31.785 INFO:teuthology.orchestra.run.smithi072.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.47962.log.gz 2024-04-04T16:50:31.828 INFO:teuthology.orchestra.run.smithi072.stderr: 93.5% -- replaced with /var/log/ceph/ceph-client.admin.363546.log.gz 2024-04-04T16:50:32.244 INFO:teuthology.orchestra.run.smithi072.stderr: 94.2% -- replaced with /var/log/ceph/ceph-client.admin.387980.log.gz 2024-04-04T16:50:33.005 INFO:teuthology.orchestra.run.smithi072.stderr: 94.0% -- replaced with /var/log/ceph/ceph-client.admin.189191.log.gz 2024-04-04T16:50:33.094 INFO:teuthology.orchestra.run.smithi072.stderr: 93.3% -- replaced with /var/log/ceph/ceph-client.admin.245493.log.gz 2024-04-04T16:50:33.227 INFO:teuthology.orchestra.run.smithi072.stderr: 93.3% -- replaced with /var/log/ceph/ceph-client.admin.198471.log.gz 2024-04-04T16:50:33.490 INFO:teuthology.orchestra.run.smithi072.stderr: 94.4% -- replaced with /var/log/ceph/ceph-client.admin.194974.log.gz 2024-04-04T16:50:33.733 INFO:teuthology.orchestra.run.smithi072.stderr: 94.3% -- replaced with /var/log/ceph/ceph-client.admin.364050.log.gz 2024-04-04T16:50:33.906 INFO:teuthology.orchestra.run.smithi072.stderr: 78.4% -- replaced with /var/log/ceph/ceph-client.admin.267708.log.gz 2024-04-04T16:50:34.090 INFO:teuthology.orchestra.run.smithi072.stderr: 94.0% -- replaced with /var/log/ceph/ceph-client.admin.408077.log.gz 2024-04-04T16:50:34.540 INFO:teuthology.orchestra.run.smithi072.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.164688.log.gz 2024-04-04T16:50:34.672 INFO:teuthology.orchestra.run.smithi072.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.49935.log.gz 2024-04-04T16:50:36.238 INFO:teuthology.orchestra.run.smithi072.stderr: 95.1% -- replaced with /var/log/ceph/ceph-client.admin.401756.log.gz 2024-04-04T16:50:36.247 INFO:teuthology.orchestra.run.smithi072.stderr: 93.2% -- replaced with /var/log/ceph/ceph-client.admin.191537.log.gz 2024-04-04T16:50:36.573 INFO:teuthology.orchestra.run.smithi072.stderr: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.401376.log.gz 2024-04-04T16:50:37.910 INFO:teuthology.orchestra.run.smithi072.stderr: 96.0% -- replaced with /var/log/ceph/ceph-client.admin.533687.log.gz 2024-04-04T16:50:38.830 INFO:teuthology.orchestra.run.smithi072.stderr: 94.1% -- replaced with /var/log/ceph/ceph-client.admin.386670.log.gz 2024-04-04T16:50:41.690 INFO:teuthology.orchestra.run.smithi117.stderr: 92.0% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-04-04T16:50:43.652 INFO:teuthology.orchestra.run.smithi117.stderr: 92.1% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-04-04T16:50:43.657 INFO:teuthology.orchestra.run.smithi117.stderr: 2024-04-04T16:50:43.657 INFO:teuthology.orchestra.run.smithi117.stderr:real 0m29.161s 2024-04-04T16:50:43.657 INFO:teuthology.orchestra.run.smithi117.stderr:user 0m55.593s 2024-04-04T16:50:43.657 INFO:teuthology.orchestra.run.smithi117.stderr:sys 0m6.389s 2024-04-04T16:50:49.379 INFO:teuthology.orchestra.run.smithi072.stderr: 94.2% -- replaced with /var/log/ceph/ceph-client.admin.396590.log.gz 2024-04-04T16:50:52.902 INFO:teuthology.orchestra.run.smithi072.stderr: 93.4% -- replaced with /var/log/ceph/ceph-client.admin.125626.log.gz 2024-04-04T16:50:56.663 INFO:teuthology.orchestra.run.smithi072.stderr: 94.0% -- replaced with /var/log/ceph/ceph-client.admin.111536.log.gz 2024-04-04T16:50:56.663 INFO:teuthology.orchestra.run.smithi072.stderr: 96.2% -- replaced with /var/log/ceph/ceph-client.admin.113986.log.gz 2024-04-04T16:50:56.784 INFO:teuthology.orchestra.run.smithi072.stderr: 94.6% -- replaced with /var/log/ceph/ceph-client.admin.128115.log.gz 2024-04-04T16:50:57.730 INFO:teuthology.orchestra.run.smithi072.stderr: 93.9% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-04-04T16:50:57.883 INFO:teuthology.orchestra.run.smithi072.stderr: 96.5% -- replaced with /var/log/ceph/ceph-client.admin.388854.log.gz 2024-04-04T16:51:04.664 INFO:teuthology.orchestra.run.smithi072.stderr: 93.9% -- replaced with /var/log/ceph/ceph-client.admin.252316.log.gz 2024-04-04T16:51:06.290 INFO:teuthology.orchestra.run.smithi072.stderr: 95.7% -- replaced with /var/log/ceph/ceph-client.admin.264543.log.gz 2024-04-04T16:51:10.150 INFO:teuthology.orchestra.run.smithi072.stderr: 89.5% -- replaced with /var/log/ceph/ceph.log.gz 2024-04-04T16:51:15.375 INFO:teuthology.orchestra.run.smithi072.stderr: 96.8% -- replaced with /var/log/ceph/ceph-client.admin.114963.log.gz 2024-04-04T16:51:16.522 INFO:teuthology.orchestra.run.smithi072.stderr: 96.6% -- replaced with /var/log/ceph/ceph-client.admin.232525.log.gz 2024-04-04T16:51:19.868 INFO:teuthology.orchestra.run.smithi072.stderr: 96.6% -- replaced with /var/log/ceph/ceph-client.admin.251872.log.gz 2024-04-04T16:51:22.468 INFO:teuthology.orchestra.run.smithi072.stderr: 96.6% -- replaced with /var/log/ceph/ceph-client.admin.140904.log.gz 2024-04-04T16:51:22.901 INFO:teuthology.orchestra.run.smithi072.stderr: 96.6% -- replaced with /var/log/ceph/ceph-client.admin.282425.log.gz 2024-04-04T16:51:23.032 INFO:teuthology.orchestra.run.smithi072.stderr: 96.9% -- replaced with /var/log/ceph/ceph-client.admin.113122.log.gz 2024-04-04T16:51:24.825 INFO:teuthology.orchestra.run.smithi072.stderr: 95.7% -- replaced with /var/log/ceph/ceph-client.admin.229692.log.gz 2024-04-04T16:51:25.027 INFO:teuthology.orchestra.run.smithi072.stderr: 96.7% -- replaced with /var/log/ceph/ceph-client.admin.358469.log.gz 2024-04-04T16:51:27.207 INFO:teuthology.orchestra.run.smithi072.stderr: 96.6% -- replaced with /var/log/ceph/ceph-client.admin.141798.log.gz 2024-04-04T16:51:30.549 INFO:teuthology.orchestra.run.smithi072.stderr: 95.2% -- replaced with /var/log/ceph/ceph-client.admin.467069.log.gz 2024-04-04T16:51:30.701 INFO:teuthology.orchestra.run.smithi072.stderr: 96.6% -- replaced with /var/log/ceph/ceph-client.admin.251396.log.gz 2024-04-04T16:51:31.220 INFO:teuthology.orchestra.run.smithi072.stderr: 97.3% -- replaced with /var/log/ceph/ceph-client.admin.351505.log.gz 2024-04-04T16:51:31.233 INFO:teuthology.orchestra.run.smithi072.stderr: 96.7% -- replaced with /var/log/ceph/ceph-client.admin.325453.log.gz 2024-04-04T16:51:32.320 INFO:teuthology.orchestra.run.smithi072.stderr: 96.8% -- replaced with /var/log/ceph/ceph-client.admin.325890.log.gz 2024-04-04T16:51:32.698 INFO:teuthology.orchestra.run.smithi072.stderr: 96.5% -- replaced with /var/log/ceph/ceph-client.admin.125148.log.gz 2024-04-04T16:51:33.207 INFO:teuthology.orchestra.run.smithi072.stderr: 96.6% -- replaced with /var/log/ceph/ceph-client.admin.142267.log.gz 2024-04-04T16:51:40.842 INFO:teuthology.orchestra.run.smithi072.stderr: 97.3% -- replaced with /var/log/ceph/ceph-client.admin.405919.log.gz 2024-04-04T16:51:40.843 INFO:teuthology.orchestra.run.smithi072.stderr: 96.7% -- replaced with /var/log/ceph/ceph-client.admin.147175.log.gz 2024-04-04T16:51:40.845 INFO:teuthology.orchestra.run.smithi072.stderr: 96.6% -- replaced with /var/log/ceph/ceph-client.admin.326404.log.gz 2024-04-04T16:51:40.845 INFO:teuthology.orchestra.run.smithi072.stderr: 95.5% -- replaced with /var/log/ceph/ceph-client.admin.395461.log.gz 2024-04-04T16:51:40.846 INFO:teuthology.orchestra.run.smithi072.stderr: 96.8% -- replaced with /var/log/ceph/ceph-client.admin.113554.log.gz 2024-04-04T16:51:43.068 INFO:teuthology.orchestra.run.smithi072.stderr: 96.8% -- replaced with /var/log/ceph/ceph-client.admin.446172.log.gz 2024-04-04T16:51:43.766 INFO:teuthology.orchestra.run.smithi072.stderr: 96.5% -- replaced with /var/log/ceph/ceph-client.admin.143158.log.gz 2024-04-04T16:51:43.779 INFO:teuthology.orchestra.run.smithi072.stderr: 96.5% -- replaced with /var/log/ceph/ceph-client.admin.124672.log.gz 2024-04-04T16:51:44.369 INFO:teuthology.orchestra.run.smithi072.stderr: 96.5% -- replaced with /var/log/ceph/ceph-client.admin.119387.log.gz 2024-04-04T16:51:44.682 INFO:teuthology.orchestra.run.smithi072.stderr: 95.9% -- replaced with /var/log/ceph/ceph-client.admin.228622.log.gz 2024-04-04T16:51:56.378 INFO:teuthology.orchestra.run.smithi072.stderr: 95.4% -- replaced with /var/log/ceph/ceph-client.admin.121129.log.gz 2024-04-04T16:51:59.236 INFO:teuthology.orchestra.run.smithi072.stderr: 96.6% -- replaced with /var/log/ceph/ceph-client.admin.248822.log.gz 2024-04-04T16:52:09.647 INFO:teuthology.orchestra.run.smithi072.stderr: 96.6% -- replaced with /var/log/ceph/ceph-client.admin.545710.log.gz 2024-04-04T16:52:14.647 INFO:teuthology.orchestra.run.smithi072.stderr: 96.6% -- replaced with /var/log/ceph/ceph-client.admin.523073.log.gz 2024-04-04T16:52:14.648 INFO:teuthology.orchestra.run.smithi072.stderr: 96.5% -- replaced with /var/log/ceph/ceph-client.admin.523992.log.gz 2024-04-04T16:52:14.648 INFO:teuthology.orchestra.run.smithi072.stderr: 96.6% -- replaced with /var/log/ceph/ceph-client.admin.524447.log.gz 2024-04-04T16:52:16.662 INFO:teuthology.orchestra.run.smithi072.stderr: 96.7% -- replaced with /var/log/ceph/ceph-client.admin.397539.log.gz 2024-04-04T16:52:21.239 INFO:teuthology.orchestra.run.smithi072.stderr: 93.7% -- replaced with /var/log/ceph/ceph-client.admin.489843.log.gz 2024-04-04T16:52:31.011 INFO:teuthology.orchestra.run.smithi072.stderr: 96.5% -- replaced with /var/log/ceph/ceph-client.admin.523538.log.gz 2024-04-04T16:52:36.572 INFO:teuthology.orchestra.run.smithi072.stderr: 95.0% -- replaced with /var/log/ceph/ceph-client.admin.246400.log.gz 2024-04-04T16:52:53.347 INFO:teuthology.orchestra.run.smithi072.stderr: 96.9% -- replaced with /var/log/ceph/ceph-client.admin.487659.log.gz 2024-04-04T16:53:16.838 INFO:teuthology.orchestra.run.smithi072.stderr: 96.8% -- replaced with /var/log/ceph/ceph-client.admin.131557.log.gz 2024-04-04T16:53:56.063 INFO:teuthology.orchestra.run.smithi072.stderr: 96.0% -- replaced with /var/log/ceph/ceph-client.admin.229096.log.gz 2024-04-04T16:54:04.416 INFO:teuthology.orchestra.run.smithi072.stderr: 94.0% -- replaced with /var/log/ceph/ceph-client.admin.255087.log.gz 2024-04-04T16:54:19.069 INFO:teuthology.orchestra.run.smithi072.stderr: 94.1% -- replaced with /var/log/ceph/ceph-client.admin.184629.log.gz 2024-04-04T16:54:21.040 INFO:teuthology.orchestra.run.smithi072.stderr: 94.1% -- replaced with /var/log/ceph/ceph-client.admin.151498.log.gz 2024-04-04T16:54:37.382 INFO:teuthology.orchestra.run.smithi072.stderr: 93.7% -- replaced with /var/log/ceph/ceph-client.admin.118293.log.gz 2024-04-04T16:54:42.776 INFO:teuthology.orchestra.run.smithi072.stderr: 95.7% -- replaced with /var/log/ceph/ceph-client.admin.343560.log.gz 2024-04-04T16:56:14.193 INFO:teuthology.orchestra.run.smithi072.stderr: 94.1% -- replaced with /var/log/ceph/ceph-client.admin.185184.log.gz 2024-04-04T16:57:32.338 INFO:teuthology.orchestra.run.smithi072.stderr: 94.2% -- replaced with /var/log/ceph/ceph-client.admin.161328.log.gz 2024-04-04T16:58:00.516 INFO:teuthology.orchestra.run.smithi072.stderr: 94.9% -- replaced with /var/log/ceph/ceph-client.admin.361188.log.gz 2024-04-04T16:59:37.259 INFO:teuthology.orchestra.run.smithi072.stderr: 91.8% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-04-04T16:59:42.432 INFO:teuthology.orchestra.run.smithi072.stderr: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.146203.log.gz 2024-04-04T17:00:19.508 INFO:teuthology.orchestra.run.smithi072.stderr: 96.1% -- replaced with /var/log/ceph/ceph-client.admin.195856.log.gz 2024-04-04T17:02:21.573 INFO:teuthology.orchestra.run.smithi072.stderr: 94.7% -- replaced with /var/log/ceph/ceph-client.admin.398440.log.gz 2024-04-04T17:03:08.313 INFO:teuthology.orchestra.run.smithi072.stderr: 94.9% -- replaced with /var/log/ceph/ceph-client.admin.112043.log.gz 2024-04-04T17:04:01.571 INFO:teuthology.orchestra.run.smithi072.stderr: 93.7% -- replaced with /var/log/ceph/ceph-client.admin.165558.log.gz 2024-04-04T17:06:17.308 INFO:teuthology.orchestra.run.smithi072.stderr: 93.5% -- replaced with /var/log/ceph/ceph-client.admin.114438.log.gz 2024-04-04T17:09:15.173 INFO:teuthology.orchestra.run.smithi072.stderr: 93.5% -- replaced with /var/log/ceph/ceph-client.admin.508624.log.gz 2024-04-04T17:12:55.359 INFO:teuthology.orchestra.run.smithi072.stderr: 93.1% -- replaced with /var/log/ceph/ceph-client.admin.243723.log.gz 2024-04-04T17:13:54.490 INFO:teuthology.orchestra.run.smithi072.stderr: 95.6% -- replaced with /var/log/ceph/ceph-client.admin.367949.log.gz 2024-04-04T17:14:09.581 INFO:teuthology.orchestra.run.smithi072.stderr: 96.4% -- replaced with /var/log/ceph/ceph-client.admin.265017.log.gz 2024-04-04T17:17:33.135 INFO:teuthology.orchestra.run.smithi072.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.499560.log.gz 2024-04-04T17:18:18.629 INFO:teuthology.orchestra.run.smithi072.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.500834.log.gz 2024-04-04T17:18:26.748 INFO:teuthology.orchestra.run.smithi072.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.497095.log.gz 2024-04-04T17:18:53.478 INFO:teuthology.orchestra.run.smithi072.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.502123.log.gz 2024-04-04T17:18:57.148 INFO:teuthology.orchestra.run.smithi072.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.503331.log.gz 2024-04-04T17:18:59.025 INFO:teuthology.orchestra.run.smithi072.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.495634.log.gz 2024-04-04T17:19:10.265 INFO:teuthology.orchestra.run.smithi072.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.498300.log.gz 2024-04-04T17:19:18.993 INFO:teuthology.orchestra.run.smithi072.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.504547.log.gz 2024-04-04T17:19:34.921 INFO:teuthology.orchestra.run.smithi072.stderr: 93.8% -- replaced with /var/log/ceph/ceph-client.admin.112578.log.gz 2024-04-04T17:19:38.720 INFO:teuthology.orchestra.run.smithi072.stderr: 90.1% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-04-04T17:19:46.254 INFO:teuthology.orchestra.run.smithi072.stderr: 91.9% -- replaced with /var/log/ceph/ceph-client.admin.115436.log.gz 2024-04-04T17:19:57.205 INFO:teuthology.orchestra.run.smithi072.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.505930.log.gz 2024-04-04T17:20:06.199 INFO:teuthology.orchestra.run.smithi072.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.507287.log.gz 2024-04-04T17:22:32.193 INFO:teuthology.orchestra.run.smithi072.stderr: 95.3% -- replaced with /var/log/ceph/ceph-client.admin.285436.log.gz 2024-04-04T17:27:13.109 INFO:teuthology.orchestra.run.smithi072.stderr: 94.7% -- replaced with /var/log/ceph/ceph-client.admin.546165.log.gz 2024-04-04T17:29:21.235 INFO:teuthology.orchestra.run.smithi072.stderr: 95.6% -- replaced with /var/log/ceph/ceph-client.admin.436162.log.gz 2024-04-04T17:30:04.751 INFO:teuthology.orchestra.run.smithi072.stderr: 94.6% -- replaced with /var/log/ceph/ceph-client.admin.192045.log.gz 2024-04-04T17:31:23.624 INFO:teuthology.orchestra.run.smithi072.stderr: 91.9% -- replaced with /var/log/ceph/ceph-client.admin.275451.log.gz 2024-04-04T17:40:42.591 INFO:teuthology.orchestra.run.smithi072.stderr: 94.1% -- replaced with /var/log/ceph/ceph-client.admin.426150.log.gz 2024-04-04T17:41:08.218 INFO:teuthology.orchestra.run.smithi072.stderr: 94.0% -- replaced with /var/log/ceph/ceph-client.admin.421301.log.gz 2024-04-04T17:46:04.250 INFO:teuthology.orchestra.run.smithi072.stderr: 93.6% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-04-04T17:51:43.185 INFO:teuthology.orchestra.run.smithi072.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-04-04T17:53:13.893 INFO:teuthology.orchestra.run.smithi072.stderr: 93.5% -- replaced with /var/log/ceph/ceph-client.admin.157739.log.gz 2024-04-04T17:54:42.572 INFO:teuthology.orchestra.run.smithi072.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-04-04T18:21:31.322 INFO:teuthology.orchestra.run.smithi072.stderr: 95.6% -- replaced with /var/log/ceph/ceph-client.admin.148040.log.gz 2024-04-04T18:31:17.904 INFO:teuthology.orchestra.run.smithi072.stderr: 91.8% -- replaced with /var/log/ceph/ceph-client.admin.519485.log.gz 2024-04-04T18:31:17.938 INFO:teuthology.orchestra.run.smithi072.stderr: 2024-04-04T18:31:17.938 INFO:teuthology.orchestra.run.smithi072.stderr:real 101m3.420s 2024-04-04T18:31:17.938 INFO:teuthology.orchestra.run.smithi072.stderr:user 60m2.737s 2024-04-04T18:31:17.939 INFO:teuthology.orchestra.run.smithi072.stderr:sys 8m40.521s 2024-04-04T18:31:17.939 INFO:tasks.ceph:Archiving logs... 2024-04-04T18:31:17.941 DEBUG:teuthology.misc:Transferring archived files from smithi072:/var/log/ceph to /home/teuthworker/archive/vshankar-2024-04-04_05:15:36-fs-wip-vshankar-testing-20240330.172700-testing-default-smithi/7639251/remote/smithi072/log 2024-04-04T18:31:17.943 DEBUG:teuthology.orchestra.run.smithi072:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-04T18:39:32.791 DEBUG:teuthology.exit:Got signal 15; running 1 handler... 2024-04-04T18:39:32.791 DEBUG:teuthology.task.console_log:Killing console logger for smithi072 2024-04-04T18:39:32.792 DEBUG:teuthology.task.console_log:Killing console logger for smithi117 2024-04-04T18:39:32.792 DEBUG:teuthology.exit:Finished running handlers